DD really disliked bottles from the get go so we used a sippy cup that didn't need a suck to work - more of a drippy cup really. She happily took expressed breast milk and then later formula that way.
Re solids - some babies just take a bit longer, and it really can seem there's more on the floor than in their tummies- that's because there is more on the floor.
Continue to sit him in the highchair, with bib etc and give him finger foods just to play with really. Messy for you, but builds the routine and If any gets into his mouth that's a bonus. At some point stuff will go in his mouth. Try different foods - bread sticks, carrot sticks, banana slices, cucumber sticks. Don't try and feed him with a spoon yourself although you can give him a spoon to play with.
One thing I found about yoghurt (which DD disliked intensely and still does, she's mid 20s) it's actually got quite a strong taste. An EBF baby is accustomed to the sweet taste of breast milk, so yoghurt is going to be a bit of a shock.
I know it's difficult however be chilled about meal times. Eat alongside at every opportunity, even if your just having a mug of tea and a sandwich. And chat away - Mummy's eating her cheese sandwich, would you like a piece of cheese? Give milk after the meal, not before.
Little ones change so fast, a lot can happen in a month. Your baby will be fine. You will be fine.
edit for a missing word