At work we have a rota for a certain task that needs to be completed at a certain time of day by 2 people. I was working in a different room but turned up at the right time to find the usual person (my line manager) already doing it with someone else. I am extremely reliable where this task is concerned and always turn up on time, whereas my line manager usually needs reminding by me or I need to go and find him to do it. So I said to him "why didn't you come and get me if you're starting it early?" He replied "I ain't got time to go running after you, Funky" So I said, "but you knew where I was" and he again said "I ain't got time to be waiting around for you". I then said "but you were early!" and must admit my voice got a bit higher and louder by this point. He called after me "be early next time, please".
10 mins later I get called in by the department manager telling me off for how I spoke to him. Also the fact that this conversation was done in earshot of another member of staff plus a visitor to the place of work. I was very taken aback so I just nodded and then left the room. However I've had time to digest it and feel I was not in the wrong - he should be the one being told off! I feel all I did was ask a question. AIBU to ask for another meeting with the manager to put my side of the story across or should I just let it go, be the bigger person and apologise to my line manager?