No, it's great that you're all fired up. I am a big fan of using that initial enthusiasm to make a dent in it - this is how I approached it. It's good that you are planting, too, you don't want vast tracts of clear earth as you'll end up having to weed over and over and over - and you have an investment in it now, with your own baby veg growing!
You still have time to sow green manure if there are areas you can clear but don't want to use until spring, too.
In the longer run, as long as you get there once or twice a week, you should be able to keep on top of it, if you have the usual half plot sized allotment.