I would really like some opinions on whether IABU, after an incident today I'm really shaken up and upset.
We bought our first home in March, a complete doer-upper as its all we could afford. It needed gutting, new electrics, plumbing, boiler, staircase you name it.
Our next door neighbours moved in the day after we got our keys, they are renting the other half of our semi-detached.
In the first couple of days, we were working in the house in the evening (around 7pm) when neighbour (lets call him A) knocked and asked us to not work later than 7 as his son goes to bed at 7.30. Fair enough, and we packed up - haven't worked past 5/6pm again.
Looking back now, its a little strange that he knocked as we were only stripping wallpaper (not noisy at all). He also didn't introduce himself or anything, was right into complaining. I was the one who actually stopped him and said "oh, nice to meet you by the way, what's your name?" Etc.
We have had noisy work done since, as is to be expected. We've told neighbours about what we are doing and are apologising every time we see them! DP and I are mostly doing all the work ourselves which means the weekends. We don't do evenings considering the noise we can make at times.
Our other neighbours are lovely, very much "don't worry, do what you need to do" even going as far as offering their drive for us to put a skip on!
Now, A is starting to come around EVERY time we work. Every time we have accommodated his requests as I think we are considerate and would like to keep things friendly. We've previously packed up at 3.30 (after only starting at 12) because he was having family around for dinner, for example.
A couple of weeks ago he collared me while alone in the garden and made me feel so uncomfortable I went inside and cried. Complaining along the lines of "we only have weekends here too, we've had enough" etc.
Today it came to a head. We started to work around 11.30. We realise its Sunday and people would like a lie-in (including us!) so we start late.
DP was screwing plasterboard to the ceiling in the living room. It wasn't actually that loud at all, as it was cushioned by the existing plasterboard and DP has a specific quieter drill that he can use. Its heavy and uncomfortable to use but he does to try and keep the peace! I wouldn't say it was louder than a TV being on.
We had only been going for 20 minutes when A FLEW to the front door and started shouting and swearing.
"I WAS IN BED AT 11.30 AND I CAN HEAR YOU START AGAIN! MY ONLY DAY OFF AND I DON'T GET A LIE IN! YOU'RE SO INCONSIDERATE, YOU'RE TAKING THE PISS!" etc.
He wouldn't let us speak, just swore and shouted and left. I've been feeling sick to the stomach all day.
We've really tried to bend over backwards to be considerate:
Not starting work until 10.30/11 at the earliest.
Packing up by 5ish and no evenings.
Keeping people informed.
We've even gone to the expense of adding thick, insulated plasterboard on each of the party walls to try and soundproof for them.
We haven't actually worked every single weekend. There have been days or even full weekends when we haven't been there at all.
I honestly don't know what more we can do, I'm absolutely gutted about today and don't want to go back really. 
Do you think we are BU? What would/have people done in our situation?