You've seen the format. The typical agency portfolio page: glossy screenshots of finished sites, a client logo row, maybe a case study with a headline like "3,000% increase in organic traffic." Then a quote from the client, collected right after launch, when they were happiest.
That's not information. That's marketing — designed for the agency, not for you.
Which is fine. Everyone knows a portfolio is a highlights reel. The problem is when it's treated like due diligence.
What portfolios actually show
A good-looking portfolio page tells you two things: the agency can design something that photographs well, and they were able to deliver at least one project to completion. That's useful. But it leaves out the things that actually predict whether working with them will go well.
Take the "3,000% traffic increase" headline. What was the baseline? 200 visitors to 6,200? Over what timeframe — three months or three years? Was there a product launch or a PR hit during the measurement window that drove it? Nobody's going to put that context in a case study unless you ask, and most clients don't ask.
More often, the case study ends at launch. Here's the deliverable. Here are the screenshots. The 90-day check — when the site is under real load, when the content gaps become obvious, when the integrations start failing — doesn't make it in.
A portfolio is marketing for the agency, not information for the client.
And the client logos? Some of those relationships ended two years ago. Some of them ended badly. You can't tell from the logo.
The three questions a portfolio won't answer
When I evaluate vendors for our own work, I ask three things. A portfolio page can't answer any of them.
Was the client happy at the 6-month mark? Launch day happiness doesn't count — that's just relief that it's over. The real test is whether the thing held up under actual use. Most agencies don't follow up at month six, which means they often don't know the answer themselves.
What went wrong? Every project hits something. A scope creep moment, a missed spec, an integration that took three extra weeks. A portfolio that shows zero friction didn't have none — it left the friction out. The vendors I trust most are the ones who tell me upfront what broke and what they did about it. It tells me they've learned something.
Would you hire them again? This is the only testimonial that means anything. "We'd recommend them" is table stakes — you're only going to publish the good quotes. "We've used them three times" is a different signal entirely. Ask specifically whether they came back for a second project.
What we're doing instead
We made a deliberate call early: we weren't going to wait for a portfolio to build trust. We built credibility a different way.
We built comparison pages before we had much of a portfolio at all. The thinking: an agency that honestly tells you when a competitor is the better fit for your situation earns more trust than one that never mentions the competition exists. There's a full post on the reasoning — the SEO bet, the GEO bet, why we thought it would work for a brand-new agency.
We published the actual cost breakdown of a $5K website. Not a range, not a "it depends" — the real hours by phase, where things get underpriced, what "free" actually costs you down the line. Clients who read it before they contact us come in with better questions.
And our own site is the demo. If you want to know what our web work looks like, you're looking at it. If you want to know how we write and think, you're reading it right now. That cuts out a lot of ambiguity that a third-party screenshot doesn't.
If you want to know what a contractor builds, look at the projects they wouldn't put in their portfolio.
We're not against a good portfolio — we have work we're proud of, and we'll show it. But we'd rather be judged by how we explain our thinking, what we recommend when it's not us, and whether our references pick up the phone.
What to actually look at when you're evaluating an agency
The specificity of their results. "40% conversion increase" means nothing. "From 1.2% to 1.7% on their main product page, over 90 days, versus the prior period" means something you can think about. If they can't give you the baseline and the window, the number is decorative.
Whether they recommend alternatives. If an agency is incapable of telling you that a different tool, platform, or vendor might be right for your situation, they're selling, not advising. Ask directly — "when would you recommend a competitor over yourself?" — and see what happens.
How they talk about hard projects. Ask them: tell me about a project that didn't go the way you expected. Good agencies have a real answer. Hedging tells you more than they think it does.
Referrals, not testimonials. A testimonial is someone who agreed to be quoted. A reference is someone you can call. Ask for two references from projects similar to yours, and actually call them. Ask whether they came back for more work.
We make references available on request — reach out through the contact page and we'll connect you with clients who'll give you the unpolished version. That's a commitment we're comfortable making because it's the version that's accurate.
— Cole