Getting rid of a large tree in a small garden?

[Jemster]

We have a small garden and a largeish tree at the end of it. It is very pretty when it blossoms (once a year) but it is a bit inconvenient. It's leaves fall constantly on the kids trampoline and now in the paddling pool as well as all over the lawn as the lawn area is pretty small.
My dh just wants to get rid of it to give dc's more room to play and to create less mess. I am a bjt reluctant as I love it when it blossoms and it seems wrong to just cut it down.
Would it be wrong to get rid of it and do you have to get permission from anywhere?

If it has a TPO on it or you are in a conservation area you need to get permission from the council otherwise you can face hefty fines.
You need to check if it has a TPO (tree protection order) through the council planning dept.

We are waiting for our permission, due next week to cut down several trees in our garden which is in a conservation area. All need work but we have to wait for permission (which is free, just takes a bit of firm filling & time)