How to Discover Website Problems Before They Cost You Customers
The problem
Here’s a screenshot that’s hard to explain away:
Score: 0 of 1 correct.
Headline: “Congratulations on a great start! Let’s build from here.”
A 0% score, framed as a celebration. Nobody designed that on purpose — it’s the kind of gap that quietly forms when a page is built, works, and then never gets looked at again with fresh eyes.
You’ll see exactly how that happened further down. But first, the reason it happened at all:
The better you know your own site, the worse a judge of it you become.
You built your site. You know every menu, every shortcut, every “oh yeah, just ignore that.” Which means you’re the one person who can’t see it the way everyone else does — not a brand-new visitor sizing you up in the first 30 seconds, and not a student who’s been enrolled for two months and still can’t find where to check their progress.
So how do you see your website the way a first-time visitor does?
One option is to ask someone who has never seen it before to complete a specific task, and describe everything they notice along the way:
“You’re a busy student who just found this page through Google. Try to sign up. Tell me everything that confuses you along the way.”
A short while later, you have a written report of exactly what happened, in plain language, with screenshots.
What’s covered in this article
- A real example, from a site I work with
- The problem behind “I don’t know why people are dropping off here”
- How this approach works, without the tech jargon
- The kinds of problems this can surface
- Where this approach falls short
Who should read this
Anyone who runs a website where people are supposed to do something — sign up, enroll, finish a course, join a community, renew a membership — and who has ever looked at a drop-off number and thought “I don’t know why people are leaving here.” This is especially relevant if you run an LMS, training site, or membership community, where the cost of confusion isn’t just a lost visitor — it’s a student who quietly disengages after paying you.
A quick example
I ran this against NurseHub, a site I maintain, on a short public practice quiz anyone can try at nursehub.com/quick-quiz/ — no login required. I asked it to browse the way an impatient, skimming visitor would: someone who clicked in from an ad, moving fast, not reading closely.
It answered one quick math question, got it wrong, and landed on the results screen. The score: 0 of 1 correct. The headline: “Congratulations on a great start! Let’s build from here.”
A 0% score, framed as a celebration.
It didn’t stop there. Following the single most visually obvious button on that same screen, the very next page wasn’t a free next step — it was a full $29.99/month membership checkout, with no free option shown anywhere in between.
Two clicks: a fake congratulations, then a billing form. Nobody sat down and designed that experience on purpose — it’s the kind of gap that quietly forms when a page is built, works, and then never gets looked at again with fresh eyes. Obvious once you see it. Invisible if you’re not the one taking the quiz cold.
The problem, in detail
Here’s the trap: the better you know your own site, the worse a judge of it you become.
You don’t see the confusing signup step, because you’ve clicked through it a hundred times. You don’t notice the dashboard buries the one thing new students are looking for, because you know where everything is. And it’s not just first impressions — the same blindness applies to people who’ve been using your site for weeks. A student who’s enrolled for a month and still can’t find their certificate, or gives up trying to post in your community, is telling you something you’ll never see just by using your own site.
So you reach for the tools that are supposed to help: analytics, heatmaps, session recordings. And they do tell you something — a drop-off rate on step 3 of checkout, a heatmap showing nobody scrolls past the fold, a recording of someone rage-clicking a button. But notice what all of that has in common: it tells you what happened, not why it felt confusing. A heatmap shows where someone clicked, not what they were thinking when they clicked it. A drop-off number tells you people left — not what they saw right before they did. To turn “what happened” into “here’s what to fix,” you’re stuck watching dozens of recordings, guessing at intent, and still ending up with a hunch. That’s real hours spent producing a guess, not a decision.
How it works
This is really just the scenario from the top, made concrete. You can review the exact same journey from very different perspectives:
Whichever perspective you pick, that “person” goes through a real flow on your live site, start to finish, narrating their reaction as they go — what caught their eye, what they ignored, where they hesitated.
Under the hood, this is an AI agent actually driving a real browser — clicking, typing, scrolling — the same way a human tester would, not a script replaying pre-recorded steps. It sees the page the way a visitor sees it and reacts in real time, rather than following a fixed checklist.
At the end, instead of a spreadsheet of clicks, you get a short, scored writeup: the top issues, each with a screenshot and a specific recommendation, plus a section on what’s actually working well (so you know what not to touch).
One honest note: this doesn’t magically redesign your site for you. What it reliably does is surface the handful of things you’ve simply stopped noticing, because you’re too close to the site to see them anymore.
What fresh eyes tend to notice
Things like:
This list isn’t exhaustive — if it’s a flow a real person goes through on your site, it can be tested.
Sample journeys you can test
Some of this depends on what kind of site you run — a general signup flow looks different from a course dashboard. Here’s a starting list, split by relevance:
General (most sites with signup or conversion):
If your site’s job is to get someone to sign up, pay, or come back, these are the flows worth a fresh pair of eyes:
- New visitor signup or free trial flow
- Checkout / membership purchase
- First-time onboarding after signup
LMS-specific:
If you’re running a course platform or membership community, the friction usually hides in the parts a builder never has to use twice:
- Taking a practice quiz or assessment
- First-time use of the course/student dashboard
- Enrolling in and starting a course
- Participating in a community or discussion forum
- Managing or renewing a membership/subscription
- Finding and downloading a certificate or tracking progress
Any of these can be tested on their own, or run together as a set if you want a fuller picture of where a student’s experience actually breaks down.
Limitations
Worth being upfront about what this isn’t:
– It’s a draft, not a verdict. Every report gets read and edited by a human (me) before it goes anywhere — cutting weak findings, adding context the report might miss.
– It sees what’s visible and clickable, not your backend logic, database, or anything that doesn’t show up on screen.
– It doesn’t replace analytics. It doesn’t tell you how many people hit a given problem — just that the problem exists and what it looks like up close.
– It doesn’t replace talking to real users. It’s a stand-in for the fresh pair of eyes you don’t have easy access to, not a substitute for real usability research at scale.
– Results vary run to run, since each pass simulates one persona having one specific experience — a real, specific account, not a statistical average. It’s most useful as another perspective, often before or between more formal usability studies — not the final word.
– It’s hands-on right now, run individually per site rather than available as a self-serve tool.
Want to know more?
If you’re curious what a first-time visitor would actually experience on your site, I’d be happy to run one customer journey and share the report. You might find something you’ve been looking at for years without noticing.