Do You Actually Need a Cloud GPU to Run an LLM?

You want to test an open-source LLM. Should you rent a cloud GPU immediately?