Hi all, I’d like to hear some suggestions on self hosting LLMs on a remote server, and accessing said LLM via a client app or a convenient website. Either hear about your setups or products you got good impression on.
I’ve hosted Ollama before but I don’t think it’s intented for remote use. On the other hand I’m not really an expert and maybe there’s other things to do like add-ons.
Thanks in advance!
https://runpod.io/
They also offer some templates, instructions and blog posts about this. And since I’m not advertising for a single company, there’s also vast.ai and several others.
thanks. I’ll give it a try