With ds1 this happened all the time as he wouldn't nap unless on me or in pram or car.
Ds2 is altogether different. This morning, I put him in his sleepyhead and he fell asleep. Yey. I then washed my hair, put makeup on (same room) packed some bags in my room and ds1 room. Basically I was flitting from my room where he was, to the other room and bathroom and back. It occurred to me that he was not in the same room...... I also took sone things downstairs.
How rigid are you about this 'rule'? I had the radio on and wasn't tip toeing around if that makes a difference.