Yes, and sadly, even if you think a garden is gorgeous and you would genuinely love to work in it, if someone else is offering a secure 6 hour day and winter work, you are going to prioritise them.
I'm trying to imagine the cleaner/gardener idea in practice - can you imagine going on to your second client of the day?!
'Hello Mrs Immaculate White Home, it is I, your cleaner! What's that? I am wearing mud-caked boots and shedding particles of hedge from my hair, and there clings to me a distinct perfume of manure? That's because of my special trademark profession: cleaner then gardener!' <twirls>