I have an RX6800XT and I use KoboldCPP to run models I download off of Huggingface.
I’m not sure how many tokens per second it generates, probably about 10?
If you want to try it yourself here’s a link to the Github page: https://github.com/LostRuins/koboldcpp
Sure, you can use a VPN if you want to spin up the instance and connect to it without having a domain. You can always open the instance of Nextcloud to the internet later, when you buy a domain.
Get a cheap .XYZ domain if you just want to experiment with spinning up a reverse proxy.