← Back to list

I Tried “Caveman” for AI Coding Agents — It Cut Response Tokens by 65% Without Making the AI Dumber

Every AI coding assistant has the same bad habit. It talks too much. You ask a simple question like:

Code Coup in Coding Nexus · 2026-07-07 03:23 · 38 claps · 4.6 min read paywalled
#ai #ai-agent #ai-coding #coding #ai-coding-assistant
Open on Medium ↗
Wiki topics: AGT · AI Agents AI · AI · General 💻 · Programming 🚀 · Self Improvement

I Tried “Caveman” for AI Coding Agents — It Cut Response Tokens by 65% Without Making the AI Dumber

Every AI coding assistant has the same bad habit. It talks too much. You ask a simple question like:

“Why is my React component re-rendering?”

Instead of answering directly, your AI writes an entire blog post.

It usually looks something like this:

“The reason your React component is re-rendering is likely because you’re creating a new object reference on each render cycle. When you pass an inline object as a prop, React’s shallow comparison sees it as a different object every time, which triggers a re-render. I’d recommend using useMemo to memoize the object.”

Technically correct? Yes.

Necessary? Not really.

A new open-source plugin called Caveman solves exactly this problem.

Instead of making the AI smarter, it makes the AI quieter.

The result? The same technical answer using about 65% fewer output tokens.

What Is Caveman?

Think of Caveman as a communication style for AI coding agents.

It doesn’t change how the AI thinks.

It only changes how the AI speaks.

The philosophy is simple:

Big brain. Small mouth.

Instead of saying everything politely with long introductions and filler words, the AI gets straight to the point.

For example…

Normal AI:

The reason your React component is re-rendering is likely because you’re creating a new object reference on each render cycle. I’d recommend using useMemo.

Caveman:

New object ref each render. Wrap in useMemo.

Nothing important disappeared.

The explanation simply became shorter.

Here’s Another Example

Imagine you’re debugging authentication middleware.

Normal AI:

Sure! I’d be happy to help you with that. The issue you’re experiencing is most likely caused by your authentication middleware not properly validating the token expiry. Let me suggest a fix.

Caveman:

Bug in auth middleware.
Token expiry check use < not <=.
Fix:

That’s it. Same diagnosis. Far fewer words.

The Plugin Doesn’t Touch Your Code

One of the smartest design decisions is what Caveman doesn’t modify.

It never changes:

  • Code
  • Commands
  • Terminal output
  • File paths
  • URLs
  • Error messages

Only the natural-language explanation gets compressed.

Consider this React example.

Before:

const options = {
  theme: "dark"
}
return <Card options={options} />

Suppose the AI explains why the component keeps re-rendering.

Normal response:

React compares object references. Since you’re creating a new object during every render, React considers it different each time.

Caveman:

New object every render. React think different. useMemo

The code stays identical.

Only the explanation changes.

Why This Matters

Every AI response costs tokens.

Many developers focus on reducing input tokens, but output tokens also matter.

Imagine your coding assistant answers hundreds of questions every day.

If every answer becomes 65% shorter, several things happen:

  • You read answers faster.
  • The conversation feels less cluttered.
  • Long chat sessions stay easier to navigate.
  • In many situations, API costs decrease.

The plugin doesn’t magically reduce the number of reasoning tokens.

The model still performs the same thinking.

It simply stops narrating every thought.

Installing Caveman

Installation is surprisingly simple.

For macOS, Linux, WSL, or Git Bash:

curl -fsSL https://raw.githubusercontent.com/JuliusBrussee/caveman/main/install.sh | bash

For Windows PowerShell:

irm https://raw.githubusercontent.com/JuliusBrussee/caveman/main/install.ps1 | iex

The installer automatically searches for supported AI coding agents on your machine and installs Caveman where possible.

It requires:

  • Node.js 18 or newer
  • Around 30 seconds
  • Safe to run multiple times

It Supports More Than Just Claude

Although many people associate it with Claude Code, Caveman works with over 30 AI coding agents, including:

  • Claude Code
  • Codex
  • Gemini CLI
  • Cursor
  • Windsurf
  • Cline
  • GitHub Copilot

Each platform has its own installation method, but the plugin works with all of them.

Different Levels of Compression

Not everyone wants maximum brevity.

Caveman provides several modes.

Lite

Wrap object in useMemo.
New ref every render.

Full (Default)

New ref each render.
Wrap object in useMemo.

Ultra

New ref/render.
useMemo.

There’s even a Wenyan mode, which expresses responses using Classical Chinese because it packs more meaning into fewer characters.

It Includes More Than Just Short Replies

Caveman isn’t only about compressing conversations.

It also provides commands for everyday development.

For example:

PR Reviews

Instead of writing long review comments:

L42:
 user null.
Add guard.

Git Commits

Generate short Conventional Commit messages with concise subjects.

Memory Compression

Large files like:

CLAUDE.md

can be rewritten into a shorter version while preserving code, URLs, and commands.

This can reduce recurring prompt size in future sessions.

Benchmarks Look Impressive

According to the published benchmark results:

| Task                        | Normal     | Caveman     | Saved |
| --------------------------- | ---------: | ----------: | ----- |
| React re-render explanation |      1,180 |         159 |   87% |
| PostgreSQL connection pool  |      2,347 |         380 |   84% |
| Docker multi-stage build    |      1,042 |         290 |   72% |
| Git rebase vs merge         |        702 |         292 |   58% |
| React Error Boundary        |        345 |          44 |   87% |

Average output reduction: 65%

That’s substantial, especially for long technical conversations.

But There’s an Important Catch

The project’s documentation is refreshingly honest.

Caveman reduces output tokens, not thinking tokens.

It also adds roughly 1,000–1,500 input tokens to each conversation, as the AI needs instructions that describe the compressed speaking style.

This means total session costs don’t always decrease.

On very short conversations, the plugin may actually increase total token usage.

Its biggest benefits are:

  • Cleaner conversations
  • Faster reading
  • Less scrolling
  • Better focus

Lower API costs are more of a bonus than a guarantee.

Interestingly, Shorter Answers Might Also Be Better

One of the most fascinating claims comes from a research paper published in March 2026 titled:

“Brevity Constraints Reverse Performance Hierarchies in Language Models.”

Researchers evaluated 31 language models and found that forcing models to produce shorter answers improved accuracy on several benchmarks — by as much as 26 percentage points in some cases.

The idea sounds strange at first.

But it makes sense.

When an AI has fewer words available, it often spends those words on the most important information instead of unnecessary explanation.

Less filler. More signal.

Should You Use Caveman?

If you enjoy detailed tutorials and long explanations, probably not.

But if you’re an experienced developer who already understands the basics, Caveman feels surprisingly natural.

Instead of reading:

“The issue is likely caused by…”

You immediately see:

Null check missing.
Add guard.
Done.

It feels closer to reading notes from a senior engineer than chatting with a verbose assistant.

And after a few hours of coding, you’ll probably realize something interesting:

You don’t actually miss the extra words.

Final Thoughts

Most AI tools compete by becoming more intelligent.

Caveman takes a different approach.

It assumes the intelligence is already there.

The real problem is verbosity.

Rather than building a smarter model, it teaches existing models to communicate like an experienced programmer who has already explained the same bug a thousand times.

The slogan captures the idea perfectly:

Caveman no make brain smaller. Caveman make mouth smaller.

Sometimes, that’s exactly what developers need.


메타데이터
post_id
712d290a99e4
slug
i-tried-caveman-for-ai-coding-agents-it-cut-response-tokens-by-65-without-making-the-ai-dumber-712d290a99e4
url
https://medium.com/coding-nexus/i-tried-caveman-for-ai-coding-agents-it-cut-response-tokens-by-65-without-making-the-ai-dumber-712d290a99e4
canonical_url
https://medium.com/coding-nexus/i-tried-caveman-for-ai-coding-agents-it-cut-response-tokens-by-65-without-making-the-ai-dumber-712d290a99e4
author_url
https://medium.com/@CodeCoup
status
ok
fetched_at
2026-07-08 18:29:56