Hi! I think our solution was slightly unusual but it has worked for us.
We did it at the same time as night weaning which basically meant her dad went to her in the night when she woke up and settled her back to sleep.
It also coincided more or less with her going into a cot in her own room. Formerly we had been bed sharing but that just stopped working for reasons similar to what you have said, it actually kept her awake.
Although supposedly they don't "need" night feeds at that age, her dad offered her a bottle which at first she rejected but then started to take. Sometimes she would wake up and cry or moan a bit we would give her a couple of minutes and often she would then just fall back asleep. We started then to put the bottle in the cot and he had to show her a few times that it was there until she started taking it herself.
What we do now, is we put her to bed with a bottle, and replenish that when we go to bed (she will be asleep). She does wake in the night or early morning and drink the bottle but she doesn't wake us up. She may not "need" it but it definitely comforts her. She's intolerant to dairy so it's actually Oatley Barista, so no probs with it going off etc.
We had a phase recently when she was waking at about 4am because her nappy was completely full. We found the night-time huggies nappies keep her dry all night so that doesn't happen any more.
There have been blips of course, like sleep regressions, teething, etc, and of course in situations like that where she's really distressed and needs cuddles we just do that, it's not rigid at all, but generally we all get just about enough sleep. She is 13 months now.
Other friends of mine have actually paid a professional "sleep trainer" to tell them what to do to get over the hump, which is good if you are sleep deprived and massively questioning your own judgement. You can choose someone who has a method that fits with your feelings.
My personal feeling is that a lot of our generation have almost a taboo about the idea of babies crying at all, as though there's no spectrum between crying for a few minutes and being completely neglected and then developing major attachment issues.
My two pence worth: the emotional difficulties at around this age on both sides are that the separation between baby and carer is having to be negotiated and part of that is about gently introducing baby to reality, part of which is not having needs met instantly, forever.
Parents' needs, eg for sleep, at this stage can start to play a small part I think. An eight month old is not the same as a three month old in this respect. How this is done and in what way is a personal thing between each individual baby and their carer/s.
I hope that's helpful x