I've lived in some awful flats when I was younger, with very noisy neighbours etc. but then I moved to a detached house, and though it was wonderful, it was in a very studenty area so there was noise every night at around 2am. We slept so badly there.
I did have a home birth in that house which would not be ideal in a flat (noise)
I always said I would never live in another flat however when we found this one, we went for it immediately due to beautiful location and size of the rooms etc. Also it has a 120ft x 30ft garden which we are going to miss like mad.
Our neighbours here have been absolutely perfect (well apart from the top floor which has varied) and they are patient with the children's noise. The ceilings are massively high, it's very old and would be stunning if it wasn't for all our messy stuff everywhere.
But it is rented. Ironically we're buying for the first time and we've bought a flat again. But it is top floor maisonette and again, huge and spacious and compared to the houses available at our budget, it is bloody brilliant.
Excellent location/street, loads of children and space to play, nice neighbours, and it has sole use of the garden which is about 60x24 but that's big enough (and less to mow and weed than where we are).
Only problem is the steps from flat to garden are a bit unsafe but we can easily go round from the front till we can afford to replace them.
It is worth it just for the sake of location and size tbh. And it's beautiful
I hope we are not too noisy for the people downstairs.
To sum up I think a garden and your own entrance makes all the difference, as my three boys would be desolate without a garden but I am broadly with you OP. Flats can be great.