← All articles

LA

Author

LatentSpace

@devbyankit

articles: 1
total claps: 0
top claps: 0
avg read: 6.3 min
active: 2025-07-25 → 2025-07-25

Wiki topics

EDU · Education & Learning · 1 LLM · Large Language Models · 1 ML · Machine Learning · 1 OPS · LLMOps & Inference · 1

Top tags

#machine-learning ·1 #llms-utilization ·1 #llm-inference ·1 #llm-on-cpu ·1 #deep-learning ·1

HUM AI

Run LLMs on a 6 GB Laptop GPU & CPU — SmolLM-3 Quantization + Nim Kernels

A diary of a giant model into a friendly 6 GB guest on my laptop.

Jul 25, 2025 · 6 min read · 0 claps #machine-learning #llms-utilization #llm-inference

Run LLMs on a 6 GB Laptop GPU & CPU — SmolLM-3 Quantization + Nim Kernels