Can I leave with my domain?

Yes, at any time. A domain is transferable to the registrar of your choice, and we hand over the transfer code without argument. A domain held hostage wouldn't be a service.