Launch a Free Public LLM Server with vLLM and Ngrok

Today, I’d like to share how you can create a public LLM server to which you can send requests from anywhere in the world- for free!