This is the legislation which appears to put the obligation on you
Regulations
The Control of Asbestos Regulations 2012 (CAR 2012), Regulation 4 places a legal duty on those who either own, occupy, manage or are responsible for properties that have been built using asbestos. They are legally obligated to either manage the risk posed by this material or liaise and collaborate fully with whoever manages this risk.
In addition, the Construction (Design and Management) Regulations 2015 (CDM 2015) place explicit responsibilities on clients to manage the risk posed by asbestos to health and safety.
Ultimately, clients have the final say on what course of action is taken. This means they are legally responsible for making suitable arrangements regarding the management of a project. They must also maintain and review these arrangements continually to ensure that all health and safety risks are managed correctly.
Clients are required to appoint competent individuals and provide them with adequate time, information and resources to complete the job to the necessary standards.
In the event that asbestos needs to be removed, the client must appoint a specialist in asbestos removal.
As clients are legally obligated to hire suitably skilled people to carry out the task, they must make adequate enquires to ensure that contractors are suitably resourced and fully capable of completing the work in a satisfactory manner.