Oh Maddie please try to stop blaming yourself for your illness. You wouldn't be doing this if you had a physical illness, I DO understand though because I think it is one of the tricks that mental illness plays on us, and makes us think it is somehow out fault that we are ill and should be able to do something to get better. I certainly have felt this and still do at times as I am not fully recovered from my last severe episode of depression.
My CPN has visited me weekly since I was discharged from hospital last July (now on 2/3 weekly visits)and she has been a godsend. She couldn't cure me of course but just to have someone to talk to who understands what you are going through and give advice and reassurance has been invaluable.
You ask what she did to help (sorry Maddie I can't recall the exact nature of your illness but think it was depression and anxiety ? sorry if I have that wrong - I recognise you on this thread but my recall is not too good these days!
My CPN has always encouraged me when having bad days (sometimes weeks) not to isolate myself, get some exercise, talk to people about how I am feeling, try to distract myself and generally try to "ride out" the blip and have faith that it will pass and that I will eventually recover. She has also introduced me to CBT and you could ask your CPN about that.
CPNs are professional people and they do not just "walk away" but their services are based on clinical need, so they will make a judgement about the state of your illness and circumstances, and that will determine how often they visit and how long they stay involved. What I am trying to say is they will see you as long as they feel there is still a need, but when someone is recovering well, they will cut down their visits. Mine has advised me that she will probably be discharging me in the summer - so I have plenty of notice.
Talk to your CPN about this and I'm sure she will re-assure you. Take good care and remember that there are many of us struggling out here, and we must believe that This Too Will Pass.