When you say buy to let in this context, would you need a mortgage? I don't know a lot about it, but if you were doing an airbnb type thing, I'm not sure you could get a standard buy to let mortgage- but I'm also not sure you can get a residential mortgage if you're not really planning to live in the property?
Depending on where you are in the UK, you could also have quite long empty periods- my understanding is that this can make your building insurance a lot more expensive. You'd also have increased council tax in some areas and I think stamp duty too?
There is also definitely a push towards more regulation of air bnb type properties, locally to me there is a lot of concern about fire safety/gas safety, and I think it won't be that long until you have to have some kind of gas safety certificate for the property.
Would you use a local management firm or would you pay for cleaning/maintenance etc yourselves? It's worth bearing in mind that holiday makers are likely to be more careless than most people who are living in a house for a long time, and won't necessarily report damage/breakages but will just leave it all to become a massive issue. They'll also be very happy to rack up large utility bills which wouldn't be an issue with a "normal" tenant, and probably a lot more than you'd expend as a householder.
Final thing is depending on where you are, your neighbours may not like having an air bnb/holiday let flat next to them, it's disruptive and damaging to the local community. In some areas, it isn't unusual for known air bnbs which are left empty in the winter to be specifically targeted for vandalism, or very occasionally rough sleeping.
Living in a holiday type area, my perception is this year there are less UK based tourists than previous years BUT this is the first summer we've really seen European tourists come back since Covid so probably overall tourist numbers are similar.