If he isn’t settling at all then it could be reflux, an allergy, an underlying condition / pain
When my baby was very young he had a viral infection, before this was confirmed he had days of just screaming any time I tried to move him, put him down or do anything but lay perfectly still with him on my chest - he ended up needing a hospital stay and really wasn’t well.
There could be something like dairy allergy or intolerance...silent reflux?
Reach out to your HV again and tell them you’re struggling and feel like something isn’t right. They need to assist you, that’s their job.
This isn’t a disconnect, it’s just really bloody hard when you have a child who hasn’t adapted in the 4th trimester very easily.
My first was very easy and happy going baby even as a newborn; my second was the opposite and it was a total shock and took me a while to get to grips with.
Speak to HV, GP if necessary