I am not sure whether you are still reading OP but we have been through this and out the other side, so I am not sure whether this will help.
My son was a nightmare for about four years. Similar stuff to your son to be honest. I was at my wits end with him. Nothing seemed to get through to him.
I tried shouting, grounding him, talking calmly with him, taking away his possessions, stopping him seeing certain friends - nothing worked. Nothing. He simply did not seem to care about consequences.
We had visits from the police, letters from the council threatening an ASBO, almost constant calls from school about behaviour. I was close to having a breakdown.
My DS got kicked out of school permanently when he was 15.
He was not even allowed inside a Pupil Referral Unit so instead the local authority set up lots of different courses for him to do, bricklaying, fixing cars, other construction work. He also did some courses with young people who had been through similar things and they did some workshops with him about his behaviour/drugs/alcohol etc.
He also had a key worker. What an amazing man he was. I think my son would be dead or in prison without him.
During this period he was diagnosed with ASD. For some reason this diagnosis seemed to flick a switch inside him and once he knew why he felt different to his friends he seemed to calm right down.
He took GCSE maths and English and is now doing a three year plastering course at college and has an apprenticeship. When he finishes that he will enrol on another course to train to become an electrician as well.
He has a lovely girlfriend and they have been on three holidays this year, which he has paid for himself.
He has learnt to drive and bought his own car and pays for the insurance himself.
I honestly don't know what changed. The ASD diagnosis seemed to calm him and his key worker was a superstar too. But DS had to put the work in as well.
I am so proud of him and what he has achieved so far.
I know it all seems hopeless now but your son can do this.