Right to Manage block after threat of repossession?

I would like advice on how to go about implementing my right to manage my own leasehold flats please.

History: 3 of us got together and purchased 7 flats, this was one complete block. The intention was that we run our own management company and maintain these flats.

We did not do anything about this, but managed the 7 flats ourselves. There have been 2 management companies involved over the year.
Charging the annual fees, but not doing any works. They have insured the building, that’s all.

The charges have built up over the years and now they want to repossess the property’s

They are charging about £2,000. Per flat for doing nothing and the law seems to be in their side. The bills have now racked up and they have not managed the flats, but want over £50,000.

All I want is to continue to manage my flats, but not be getting bills each year and they don’t do anything for it. I am told by law I have a right to manage my own properties?

Any advise would be very much appreciated.

Thank You

JT