She's being a good friend - thinking you might be lonely and welcome some adult company.
You are understandably aware that 'looking after a guest' is just one more burden you could do without.
You can solve this euqation, if you want to, by making it clear you won't be 'hosting' and telling her, very directly, what she can bring or do during her visit to be helpful.
I've found, from the 'childless guest' perspective, that, at first, the start-stop nature of conversations was a bit frustrating, as you're used to having your adult friend's undivided attention. But you soon get used to it and realise that the rythmn of 'conversation flowing but with pauses' does work perfectly well - especially over relaxed longer time periods, when nobodody's trying to rush off and force a conversation into the allocated half hour.
From a parent's perspective, I found that one thing you really can do with babies, is sit and chat (in a stop-start way) with people. Which is why so many parents with babies spend a lot of time meeting for coffee. You can also watch a lot of television, or films, again stop-start.
She'll get used to the new rythmn of your life pretty quickly. She could also make herself useful if you direct her a bit.
So, depends whether you want to stay friends, see her and think she can be directed.
You make it sound as though you're doing her a bit of a favour by staying friends with her after others have drifted away. Hubris might bite you. You might be surprised at which friends you lose, because they're not interested in hanging out with babies, thinking about your needs, or willing to fit in with you.
asked if I'll 'be ok' (by all accounts I think I'm doing pretty well as a FTM!) is a silly comment, that speaks only of a defensive state of mind on your part. No-one's awarding medals for good parenting. Your friend just thinks you might be lonely.