My Fake Door Test Got a 16.5% CTR… and a 2.47% Conversion Rate. Here’s What I Learned.

The raw data and unfiltered analysis of my first validation test for ‘WWW’, a stock market for culture. A story of phenomenal success and brutal failure, all in one night.

Photo by Philippe Leone on Unsplash

A few days ago, I published the playbook for my new venture, WWW — a social stock market for culture. I laid out my hypothesis, my design philosophy, and my plan to validate it with a three-pronged fake door test.

I promised to build in public and share everything. Well, the first results are in. And they are both wildly exciting and deeply humbling.

This is the unfiltered story of what happened, what the data is telling me, and what I’m doing next.

The Setup: A/B/C Testing for Desire

As a refresher, my goal was to discover the primary psychological driver for potential users. I ran three ad campaigns on Instagram, each targeting a different motivation:

• Campaign A (The Achiever): “Prove your skill.”
• Campaign B (The Novice): “Start investing, the easy way.”
• Campaign C (The Opportunist): “Get prizes for your predictions.”

Each ad led to a simple Tally form. I set a small budget and let the experiment run for about 9 hours. Then I looked at the data.

The Data: A Tale of Two Metrics

The results painted a confusing picture. One metric was screaming “ROCKET SHIP!”, while the other whispered “…failure.”

Part 1: The Phenomenal Success — Click-Through Rate (CTR)

The initial interest was beyond my wildest expectations.

• Campaign C (Rewards): 16.5% CTR
• Campaign A (Skill): 13.4% CTR
• Campaign B (Easy Start): 6.2% CTR

To put this in perspective, the industry average for Instagram ads is around 1–2%. A 16.5% CTR isn’t just good; it’s a statistical anomaly. It’s a powerful, undeniable signal that the core concept of “trading words for prizes” is exceptionally compelling. The hook works. It works brilliantly.

Part 2: The Brutal Failure — Conversion Rate (CVR)

I had a flood of people rushing to the front door of my store. But almost no one came inside.

• Total Visitors to Tally Form: 121
• Total Sign-ups (Submissions): 3
• Overall Conversion Rate: 2.47%

This number was a punch in the gut. My goal was >10%. A 2.47% CVR meant that for every 100 people who were interested enough to click, more than 97 of them decided it wasn’t worth giving me their email. The bucket was leaking. Catastrophically.

The Diagnosis: Why Did 97% Leave?

This is the most critical moment for a founder. It’s easy to get discouraged or blame the market. But the data tells a story. My job is to listen.

My diagnosis: the problem wasn’t the ‘Promise’ (the ad); it was the ‘Proof’ (the landing page).

1. The Trust Gap: The ads were exciting and professional, but they led to a simple, unbranded Tally form. This jarring transition likely created a “trust gap.” Users probably thought, “Is this real? Or is this just some student’s project?” Their excitement turned into skepticism.
2. The Friction Barrier: Even a simple question like “What type of player are you?” adds cognitive load. At this early stage, any friction, no matter how small, is a conversion killer. I was asking for too much, too soon.

The high CTR proved the ‘desirability’ of the concept. The low CVR revealed the ‘inadequacy’ of my initial MVP.

The Pivot: What I’m Doing Next

This isn’t a failure. It’s an incredibly valuable lesson purchased for the price of a few dollars in ad spend. Now I have a clear direction.

My next iteration will focus on closing the Trust Gap:

1. Build a Real “Front Door”: I will build a dedicated, professional-looking one-page website using Carrd or Framer. It will feature the app mockups, the value proposition, and social proof (even if it’s just testimonials from friends initially). The Tally form will be embedded seamlessly within this trusted environment.
2. Make the “Ask” Effortless: The new form will have one field and one field only: “Enter your email.” My goal is to reduce the friction of signing up to near zero.
3. Relaunch and Measure: I will relaunch the two winning ad campaigns (‘Rewards’ and ‘Skill’) and point them to this new, improved landing page. My hypothesis is that by solving the trust and friction problem, the conversion rate will climb much closer to my 10% target.

This is the Lean Startup in action. Not a straight line to success, but a loop: Build → Measure → Learn → Iterate.

I’m more optimistic than ever. The market has screamed that they are interested. Now it’s my job to build a trustworthy bridge for them to walk across. I’ll share the results of the next test soon.

Follow me to see if I can fix my leaky bucket. For a full overview of all my projects, you can visit my personal HQ at www.dankims.com