Why case studies need a critical read
A Shopify SEO case study is a story the seller chose to tell, using numbers the seller chose to show. That does not make it false. It makes it selective. Your job is to find out what was left out.
Case studies are the most persuasive thing in SEO sales because they show a result on a real store. They are also easy to shape. A vendor can pick the best client, the best month and the most flattering metric, and every sentence can be true.
Reading one well takes about ten minutes and four questions. This page teaches them. It is useful before you hire anyone, and our guide to how to find a Shopify SEO expert you can trust shows where case studies fit in the wider decision.
It is also useful when you read results from RunOctopus or anyone else, including the examples further down this page. We apply the same questions to ourselves.
Check what was counted, over how long, from which source, and what else changed at the same time.
Clicks against impressions
The first question is what number is being shown. Two are common and they mean different things.
Impressions count how often a page appeared in search results. A page can be shown thousands of times and never clicked. Impressions can rise because you rank for many obscure searches nobody acts on, so a big impressions number alone proves little. Our glossary page on GSC impressions explains exactly what is counted.
Clicks count how often a person chose your page. This is closer to what you care about, because a click is a visit.
Even clicks have limits. A click is not a sale. For a store, the number that pays is revenue from organic visitors, but that depends on many things beyond SEO, like price, product and checkout. A fair case study separates what SEO controlled, which is getting people to the page, from what it did not.
Treat any case study that leads with impressions and never mentions clicks as incomplete. Treat any that leads with a "traffic" figure, without saying what kind, as the same. Ask for clicks from Google Search Console, with the dates.
The time window
The second question is over how long. Search traffic moves in waves with seasons, news and Google's own updates. A short window can show a spike that fades or a dip that recovers.
Look for the start date and end date of the comparison. A sound case study states them and compares like with like, such as 28 days against the previous 28 days or the same period a year earlier. A weak one says "grew 300%" without saying from when, to when.
Watch for three habits. Starting the clock at the lowest point, such as just after a store launch or a penalty. Ending it at the highest point, like the best single month. And leaving out a later fall.
Also check for seasonality. A store selling holiday goods will always show growth into November. If the study compares September to November, the season did the work.
The best test is a longer view. Ask for a chart of weekly clicks over at least six months. A real, lasting result looks like a climb that holds. A spike and a slide looks different.
The two checks together
The diagram combines the first two questions. Where a case study sits on this grid tells you how much weight to give it.
A result in the top right, clicks measured over many months, is hard to produce by accident and hard to fake. Give it the most trust. A result in the top left, clicks over a short window, may be real but could be a blip. Ask what happened next.
The bottom two cells are impressions. Over a long window they show reach, which is a good early sign but not a result. Over a short window they show almost nothing.
None of this means a short or impressions-based case study is useless. It means you should place it correctly. A vendor who says "impressions doubled in six weeks" is describing the early stage of a project, honestly. A vendor who says "we doubled your traffic" on the same data is not.
Ask each vendor for the top-right cell for at least one client. If they cannot produce clicks over a long window for anyone, they either have not been doing this long or the results were not good.
What else changed at the same time
The third question is whether SEO was the only thing that moved. Search results improve for many reasons, and a case study usually credits the vendor for all of them.
Look for these confounders. A new product line or a big range extension. A price cut. A sale or a seasonal peak. A press mention or a viral social post that sent links. A redesign. A change in Google's own algorithm. An ad campaign running at the same time, which can lift branded searches.
A trustworthy case study mentions at least some of these, because the writer knows they exist. A glossy one treats the result as pure cause and effect.
Ask directly: "What else changed on this store during that period?" A good vendor knows and will tell you. A vague answer suggests no one checked.
Finally, ask what the work was. A case study that says "we did SEO" has told you nothing. One that says "we rewrote 40 collection pages and published 30 buyer guides" lets you judge whether the effort plausibly caused the result. Our page on the Shopify SEO report shows how reporting should connect the work to the numbers.
Is it your kind of store
The fourth question is whether the result transfers to you. A case study from a store very different from yours says little about what you can expect.
Check four things. Size: a store with a large catalog and years of history behaves differently from a new one with twenty products. Category: some niches are crowded with large brands and some are thinly covered. Starting point: a store that began from nearly zero can show a big percentage from tiny numbers. Business type: a local service business and a retailer face different searches.
Percentages deserve special care. "Up 500%" sounds huge, but from 10 clicks to 60 it is 50 extra visits. Ask for the starting and ending numbers in full, not just the ratio.
Also be careful with case studies that are labeled as Shopify results when they are not. If a vendor shows a result from another platform, it may still be a useful signal about their method, but it is not proof they can do the same on Shopify. Good vendors say plainly what kind of site each example is.
Our page on Shopify SEO red flags collects more of these signs.
Three results to practice on
Here are three real results from RunOctopus clients, with the questions applied. All figures are from Google Search Console, 28 days to September 29, 2026. We do not claim any of the three is a Shopify store, and we label each by its business type.
Sterman, a real estate business in Los Angeles, went from 44 to 210 Google clicks a month since April. Clicks, not impressions, over about five months. Starting from a small base, so the ratio is large. A local service business, not a retailer.
Florida Realtor Careers went from 8 to 116 Google clicks a month since launching in June. Clicks over about four months. A very small starting point, so treat the percentage with care. A Florida real estate licensing school, not a store.
All Angles Creatures, a reptile supply store and the business where RunOctopus started, went from 0 to 4,500+ Google clicks a month in five months. Clicks over five months. This is the one closest to a retailer, which is why we mention it, and it is also the one we built ourselves, so apply your own caution.
Notice what we cannot tell you from those lines alone: what else changed, or what any of them earned in sales. Ask us, or anyone, for that.
Questions to ask a vendor about their case studies
Take these into any sales conversation.
Which Search Console property is this from, and can I see the dates? What was the starting number and the ending number, not the percentage? What was the window and what does the same chart look like six months later? What else changed on the store at that time? What exactly did you do, in numbers of pages and fixes? Is it a Shopify store, and if not, what is it? May I speak to the owner?
That last question matters most. A real client who got a real result is usually glad to say so for a few minutes. If a vendor never lets you talk to anyone, treat the case study as marketing.
Keep notes on the answers. A vendor who responds clearly and shows the data is demonstrating the same habits they will use in your reports. Our page of questions to ask a Shopify SEO expert gives you more to ask.
Finally, remember that past results never guarantee yours. They tell you whether a method can work, not whether it will on your store.
Seven signs a case study is doing more selling than showing
Once you know the four questions, the weak case studies stand out. These are the habits to watch.
It gives a percentage with no starting number. It names a time period vaguely, such as "in just a few months." It shows a chart with no axis labels or with an axis that starts partway up. It credits the vendor for a rise that matches the season. It lists only impressions or "visibility" and not clicks. It never says what the vendor actually did. It uses a client name you cannot find or a store that no longer exists.
Any one of these is a prompt for a question, not proof of dishonesty. Several together tell you the document was designed to impress, not to be checked.
Also be careful with screenshots of tool dashboards. A third-party tool's estimated traffic is a model, not a measurement. Only Search Console shows real clicks for a site, and only the site owner can see it. Ask for a screen share of the real thing, or for the owner to confirm the numbers.
For a wider list of things to question in proposals, see our page on Shopify SEO red flags.
Finally, a missing case study is not damning on its own. A new provider may have none to show. In that case, a small paid test project does the job a case study would have done.
Keeping your own case study from day one
The best case study you will ever read is your own. It costs nothing, and it is built from the one source you trust, which is your own accounts. Start keeping it on day one of any SEO effort.
Record the baseline. Before any work begins, note clicks, impressions and the count of indexed pages from Search Console for the last 28 days and the last 90 days. Save a screenshot and the date.
Keep a change log. A simple list with a date, a page address and what was changed. Rewrote the collection page. Published a buyer guide. Fixed duplicate titles. Without it, you will not remember six months later what could have caused a rise.
Note outside events. Sales, new products, price changes, press, big social posts, ad campaigns. These are the confounders from the earlier section, and you are the only one who knows them all.
Review at fixed intervals. Compare the same 28-day windows at three, six and twelve months. Write two sentences on what changed and what you think caused it.
After a year you will have a better case study than any vendor can show you, and a clear idea of what is worth paying for. It also makes you a much harder prospect for a weak vendor, which is no bad thing. Our Shopify SEO report page shows what the monthly numbers should look like.
How RunOctopus handles proof
RunOctopus is a done-for-you service. Its AI, Ollie, researches your business, then writes and publishes pages directly on your own website, with a team planning, writing and reviewing alongside Ollie. It works with Shopify, WordPress, WooCommerce and Wix.
Instead of asking you to trust a case study, it measures against your own history. The promise is more visibility on Google and in AI answers within 90 days, measured against the 90 days before you joined, or every dollar back. That is a clicks-and-impressions comparison on your own Search Console, so you can check it yourself.
The first week brings 8 long-form articles, 6 pages and a custom interactive tool built for your niche. After that it is 175+ pieces of content a month, written, published and linked. It also reports on where ChatGPT, Perplexity, Claude and Gemini name your business.
Nothing to install, approve, upload or schedule. Paste your address for a free site read and see the plan for your store. No account, no call.