r/TechSEO • • Feb 08 '24

List of 15000+ Websites And Blogs That Accept Guest Posts

Thumbnail
icopify.co
334 Upvotes

r/TechSEO • • Feb 28 '26 Popcorn

Open Source Semrush alternative built on DataForSEO

Thumbnail
gallery
279 Upvotes

Hi! Last week I posted in this reddit about whether an Open Source tool wrapping DataForSEO would be a good idea and some people seemed excited. So, this week I built it!

Right now, its focused on key core features, but I think it could actually become a serious alternative by providing a simpler user interface and better AI features at a much cheaper price.

Try self hosting it, instructions here: https://github.com/every-app/open-seo

Current Features

  • Keyword Research - Search keywords, get related keywords and SERP results. Save keywords for future reference.

  • Domain Research - See what keywords your competitors rank for and what their top pages are.

  • Site Audit - Audit your pages with Page Speed Insights and for things like site titles, word counts, and image counts.

Price (Free)
Totally free to use since its open source and you self host it. It does require a pay by usage DataForSEO API key, but you get $1 of free credits through them to test it out.

Roadmap

  • AI Content Writer

    • My background is in AI so super excited about what workflows we can make smoother. Content writing seems like a good first step?

  • SEO AI Agent

  • Keyword Tracking

  • Backlinks

Community
I'm a software engineer, not an SEO expert. I appreciate any and all feedback on the tool + the roadmap. Would love to chat!

EDIT: I'm working on a hosted version of this since people seem really excited. That mailing list will also have product updates in case you miss them in github.

Sign up for the waitlist / product updates here: openseo.so


r/TechSEO • • Nov 18 '25

I got frustrated with ScreamingFrog crawler pricing so I built an open-source alternative

234 Upvotes

I wasn't about to pay $259/year for Screaming Frog just to audit client websites. The free version caps at 500 URLs which is useless for any real site. I looked at alternatives like Sitebulb ($420/year) and DeepCrawl ($1000+/year) and thought "this is ridiculous for what's essentially just crawling websites and parsing HTML."

So I built LibreCrawl over the past few months. It's MIT licensed and designed to run on your own infrastructure. It handles:

  • Technical SEO audits (broken links, missing meta tags, duplicate content, etc.)

  • JavaScript-heavy sites with Playwright rendering

  • 1M+ URLs with virtual scrolling and real-time memory profiling

  • Multi-tenant deployments for agencies

  • Unlimited exports (CSV/JSON/XML)

In its current state, it works and I use it daily for client audits. Documentation needs improvement and I'm sure there are bugs I haven't found yet. It's definitely rough around the edges compared to commercial tools but it does the core job.

Demo: https://librecrawl.com/app/ (3 free crawls, no signup, install it on your own machine to get the full feature set, my server would die if i had everything enabled)
GitHub: https://github.com/PhialsBasement/LibreCrawl
Plugin Workshop: https://librecrawl.com/workshop

Happy to answer technical questions or hear feedback on what's missing.


r/TechSEO • • Sep 21 '26 Bravo

I read 9,249 SEO case studies to build the biggest SEO meta study I could and here are the weirdest things I found.

228 Upvotes

I spent the summer reading every SEO case study, test and paper I could find. 9,249 documents out of over 30k documents, 552 cited sources, and 182 tactics that survived to a card with a source and a number attached. It is free and there is no email gate, but that is at the bottom.

Here's some info:

How I did it

Crawled everything I could find on SEO, AEO and GEO (over 30k documents). A cheap model screened all 9,249 for whether they report a measured outcome from a specific change. Every survivor was extracted twice, by two models from two different providers, and any number that was not literally in the source text was thrown out.

Then each tactic got graded on evidence strength and on how actionable it is, separately.

Here are some interesting things:

The controlled tests that make no sense

These are all split tests, not before and after screenshots.

  • Writing the entire title tag in CAPITAL LETTERS: +17.5% organic traffic (two independent tests). A separate test on travel listing pages got +14%.

  • Removing synonym keywords from title tags to shorten them: -27%. Biggest negative in the whole book from a single controlled test.

  • Removing the word "Compare" from title tags: +24%.

  • Putting the product price in the title tag: -15%. On location pages with static rental prices: -7%.

  • Replacing numbers with number emojis in meta descriptions: -5%.

  • Moving a flight search widget from below the hero image to the top: -7%.

  • Removing self-referential breadcrumb links: -5.5% clicks.

  • Serving a 404 instead of a 410 on removed pages: +49.6% pages staying indexed. The status code you use for "this is gone forever" gets it dropped almost twice as fast.

How about links

The single most replicated claim in the entire review is "publish content, build links, clean up the code". There are 26 independent samples, 25 of them are positive, 20 different publishers, agreement is 0.963. But this is just kind of describing what SEO is, no?

Editorial backlinks through digital PR outreach: +71% organic sessions (19 samples, 14 publishers, agreement 0.9524). Zero of them are controlled, sixteen are before and after, three are single case.

Disavow is interesting as it landed in the IT DEPENDS lane (where two different clusters disagree):

  • With an active manual penalty: +80% organic sessions

  • Without one, just "cleaning up": no measurable direction

This is what I always thought would happen. I think Google recognizes SPAM links and disregards them easily. If you have no manual penalty, the published evidence gives you nothing.

Also worth knowing is that the disavow plus on-page cleanup cluster has the lowest agreement of any link tactic in the book, 14 samples and only 10 positive. Sooo kind of telling.

Internal links are also interesting. Adding internal links to orphaned blog posts get us up to +64 ranking positions, but the raw spread across samples runs from -4 to +64. Most of the effect sits in a couple of pages.

Adding lots of internal links to the homepage footer gets us +5% organic sessions. I did this with many clients and had many issues, but sometimes it worked wonderfully. I would always test this.

One more interesting thing is that adding brand icon CTA blocks with internal links to product pages gets us +80% conversions across two controlled tests. But that could just be because the CTA is more visible, idk.

AEO and GEO: What actually works

This is the area everyone talks about and it has the thinnest evidence base in the entire book. All we get is 10 entries worth anything.

Controlled, from academic work:

  • Adding quantitative statistics to the page: +37% citations

  • Adding quotes from credible named sources: +22% to +41%

  • Keyword stuffing for AI: -10%

Controlled, from one practitioner running split tests:

  • Direct answer in the opening paragraph, before the evidence: +280%

  • Content written as discrete factual statements, not prose: 5x

  • Moving footnotes to inline parentheses next to the claim: +40%

The strongest GEO evidence overall is rewriting page text using GEO techniques as a bundle: +83.2% citations, 12 samples, 6 publishers, agreement 0.9286.

Author bylines give us +113% AI citations, and the detail matters. The controlled test added bylines for staff members with low public recognizability (7 samples, 5 positive).

Human editing of AI-written text gets us +67% citations, 5 samples, 4 positive.

llms.txt is also very interesting. Three samples, all uncontrolled, median +25% organic sessions.

But the raw reported values across the underlying measurements run from -19.7% to +81%.

There is no controlled test of llms.txt anywhere in 9,249 documents. Anyone telling you it works is telling you what they believe.

Tactics flipping depending on context

These got their own lane because averaging them would describe neither side.

AI-generated content blocks:

  • Enriching specific pages with targeted AI copy: +73% citations

  • Publishing AI text across the whole site: -35% sessions

Google Business Profile primary category:

  • Generic to specific niche category: +3.4 positions

  • Specific back to a broader label: -30 positions

Keywords in URLs:

  • Specific role or service modifiers: positive, direction only

  • Broad high-volume terms: -38%

Emojis in title tags:

  • Tested alone in a controlled test: -6%

  • Bundled with a full page redesign: +1,851 impressions

Things that were true and aren't anymore

The most replicated schema finding in the whole book is FAQPage markup: 13 samples, 12 publishers, agreement 0.9333, +25% organic sessions and a 3.2x citation multiplier.

Google stopped showing FAQ rich results in May 2026 and removed the reporting in June. So the single best evidenced schema tactic in my own study is dead, and the evidence for it is still perfectly good evidence about a world that no longer exists.

Review schema on category pages measured +16% in a controlled test, and is explicitly against Google's guidelines. Both things are true at once.

Full study in comment

I found it interesting that title tag studies are giving us way more sessions than I would expect. It goes crazy, like +40% clicks when changing stuff. Really interesting, considering everyone is concentrating on AI right now and disregarding the "10 blue links".

Also, nearly every "GEO" number in existence is a bundle. Someone rewrote everything and reported a citation increase (which I don't really believe in completely, but that's not the point of my post). I couldn't isolate a single GEO tactic with more than 1 controlled test behind it.

Anyways, full thing is free, no email, 170 pages, has a DOI and the link is in the comments.

Happy to pull the exact source and number for anything above, just ask.

P.S. This took me a couple k$ and two months of work, so I hope you’ll find something interesting there.

Next step is testing all of these, including the experimental ones on a website and seeing what checks out. Might try it out with my clients.


r/TechSEO • • May 15 '26

Google says: Google releases the Official AI SEO/GEO Guide

Thumbnail
developers.google.com
215 Upvotes

Critical document as Google not only forms the main basis for RAG/QFO or grounding searches for most of the LLMs but Gemini is the fastest growing and possibly second largest LLM globally.

The Document lists what you should do and also has super interesting Myth Busting Guide!

This is copied verbatim from the Google Guide:

Myth busting generative AI search: what you don't need to do

As generative AI search evolves, so have the theories and practices—and sometimes, the misconceptions—surrounding it. While terms like Answer Engine Optimization (AEO) or Generative Engine Optimization (GEO) are common online, many suggested "hacks" aren't effective or supported by how Google Search actually works.

To help you focus on what matters for your website's visibility, we've collected some of the most prominent topics circulating the internet around generative AI and Google Search. Here are a few things you can ignore for Google Search:

  • LLMS.txt files and other "special" markup: You don't need to create new machine readable files, AI text files, markup, or Markdown to appear in generative AI search. Note that Google may discover, crawl, and index many kinds of files in addition to HTML on a website: this doesn't mean that the file is treated in a special way.

  • "Chunking" content: There's no requirement to break your content into tiny pieces for AI to better understand it. Google systems are able to understand the nuance of multiple topics on a page and show the relevant piece to users. However, sometimes shorter (or longer!) pages can work well depending on your audience and subject matter. There's no ideal page length, and in the end, make pages for your audience, not just for generative AI search.

  • Rewriting content just for AI systems: You don't need to write in a specific way just for generative AI search. AI systems can understand synonyms and general meanings of what someone is seeking, in order to connect them with content that might not use the same precise words. This means you don't have to worry that you don't have enough "long-tail" keywords or haven't captured every variation of how someone might seek content like yours.

  • Seeking inauthentic "mentions": Just like the rest of Google Search, our generative AI features can show what's being said about products and services across the web, including in blogs, videos, and forum discussions. However, seeking inauthentic "mentions" across the web isn't as helpful as it might seem. Our core ranking systems focus on high-quality content while other systems block spam; our generative AI features depend on both.

  • Overfocusing on structured data: Structured data isn't required for generative AI search, and there's no special schema.org markup you need to add. However, it's a good idea to continue using it as part of your overall SEO strategy, as it helps with being eligible for rich results on Google Search.


r/TechSEO • • Feb 07 '19

AMA: I am Gary Illyes, Google's Chief of Sunshine and Happiness & trends analyst. AMA.

187 Upvotes

Hoi Reddit,

Gary from Google here. This will be my first AMA on Reddit and am looking forward to your questions. I will be taking questions Friday from 1pm -3pm EST. I will try to get to as many as I can.

I've been with Google for over 8 years, always working on Web Search. I worked on most parts of search: Googlebot, Caffeine, as well as ranking and serving systems that don't have weird public names. Nowadays I'm focusing more on Google Images and Video. I don't know anything about AdWords or Gmail or Google+, so if possible, don't ask me about stuff that's not web search, unless you want a silly reply.

If you heard one of my public talks before, you probably know I'm quite candid, but also sarcastic as hell, and I try to joke a lot, most often failing. Also, I usually don't try to offend, i just suck at drawing lines.

AMA!


r/TechSEO • • Mar 17 '26

OpenSEO - Thank you for the support! Also, I added Backlink Analysis...

Post image
179 Upvotes

A couple weeks ago I posted my project, OpenSEO, and was overwhelmed by the support it got from this community. It just passed 500 stars on Github and I think its the second most upvoted post in this subreddit which is crazy to me.

When I originally posted, there were lots of rough edges that I think were preventing people from actually trying it out. These last few weeks I've been making lots of improvements to make it really easy to get started with Docker + improving the documentation.

The top feature requests have been 1. Backlinks 2. SERP Rank Tracking. I just pushed a new release adding support for backlinks. Next, I'll tackle Rank Tracking. Let me know if you have any specific workflows or gripes with other products that I should consider.

This is probably the last product-update style post I'll make in this forum given the "Don't be a shill" rule, but figured this was a bit of an exception since people seemed so excited about the project. If you want to follow along, make sure to read the "Community" section on Github for info about the discord or sign up for mailing list on the new website I made: https://openseo.so This will just have big product updates like for Rank Tracking + an announcement when I release a managed version of OpenSEO which will make it easier to get started and work around the minimum monthly commitments for the Backlinks + LLM mention APIs from DataForSEO.

Here's the github again: https://github.com/every-app/open-seo

Thanks again for all the support!


r/TechSEO • • Apr 03 '23

Tell me you're an SEO expert without telling me you're an SEO expert😂

Post image
163 Upvotes

r/TechSEO • • 24d ago

Google traffic dropped 95% overnight – can the website recover?

Thumbnail
gallery
144 Upvotes

Hey everyone,

My website was growing steadily, reaching around 300–350 daily clicks and 8,000–10,000 impressions.

In early October, my Google traffic suddenly dropped by over 95%.

I built most of my website using AI, so I suspect this might be the reason Google penalized it, although I'm not sure.

Interestingly, I still receive a lot of traffic from ChatGPT.

My questions:

  • Has anyone experienced something similar and recovered?

  • How long does recovery typically take?

  • Should I improve my existing website or start fresh with a new domain?

  • Does ChatGPT use different ranking systems than Google, explaining why I still get traffic from there?

I've attached my Search Console screenshots.

Would really appreciate any experiences or advice!


r/TechSEO • • Feb 05 '26

Googlebot file size crawability down to 2mb.

Post image
139 Upvotes

Another massive shift just from a few hours ago.

Here's what this means for your site:

  1. Every HTML file over 2MB gets is only partially indexed.

Google stops fetching and only sends what it already downloaded.

Your content below the cutoff? Invisible.

2. Every resource (CSS, JS, JSON) has the same limit.

Each file referenced in your HTML is fetched separately.

Heavy files? They're getting chopped.

3. PDFs get 64MB (the only exception).

Everything else, HTML, JS, JSON etc. now plays by the 2MB rule.


r/TechSEO • • Jun 26 '21

RIP Russ Jones. Fellow SEO, Fellow Mod. We will miss you.

Post image
129 Upvotes

r/TechSEO • • Dec 06 '18

SEO Friendly Translation Services

128 Upvotes

Would love to get community feedback on a service like MotionPoint.. Anyone have experience using a proxy translation service?


r/TechSEO • • Mar 28 '18

I am John Mueller, Webmaster Trends Analyst at Google. AMA.

109 Upvotes

Hi Reddit!

It's me - John :). I work as a webmaster trends analyst / developer advocate at Google, connecting the internal search engineering teams with the "real" world outside of Google. This is my first AMA on Reddit and I'm looking forward to your questions.

Since this is /r/TechSEO, questions that are technical or development focused will receive priority. Questions about specific sites and all-too theoretical questions are probably out of scope, and may be moderated. I'm happy to go into basic questions too, sometimes the basics are what we need to move forward.

I will be answering questions today from 3pm-5pm EST ( https://www.timeanddate.com/worldclock/fixedtime.html?iso=20180328T21&p1=268 because I'm bad with timezones). I will try to get to as many as I can.

AMA!

Edit: Whew, so many questions, thanks! There are a lot of good ones in there, hope the answers are useful! I'm going to pause now and check out what Twitter & my inbox are saying. Maybe I'll have time to catch up on some more questions here over the long weekend. Thanks again, this was fun!


r/TechSEO • • May 12 '26

1800+ Posts completely deindexed overnight. Lost, Need Help.

Post image
99 Upvotes

My blog has over 1,800 posts. I publish 3-5 articles daily, all manually written. Traffic was stable and growing until around March when it started a slow decline, then dropped sharply in April. Today I checked Google Search Console and realised every single page on the site has been deindexed. I am completely lost. (PS: Bing is still indexing and providing traffic, but Google isn't)

Here is everything I have checked so far:

What GSC is showing:

  • 1,015 pages with status: Crawled - currently not indexed

  • Sitemap shows 1,932 discovered pages and status shows Success

  • But when I inspect individual URLs, they all say "No referring sitemaps detected"

  • Google-selected canonical is blank on every page I inspect

  • Crawl is allowed, page fetch is successful, indexing is allowed, but pages are still not indexed

  • No manual action. No security issues flagged

The timeline:

  • 1,500+ pages indexed before May 1

  • Dropped to around 280 indexed by May 2

  • Fully deindexed by May 5

What I have already ruled out:

  • WordPress Reading settings. "Discourage search engines" is not checked

  • Robots.txt looks clean, no accidental disallow rules

  • No manual penalty showing in GSC

  • Yoast is set to index posts and pages

The blank Google-selected canonical on every page is what concerns me most. I have never seen this before. The content is original, the site has been running for years, and nothing obvious changed on my end around the time this started.

Has anyone experienced a mass deindexation event like this before, particularly where the Google-selected canonical suddenly goes blank across the entire site? Any ideas on what could cause this technically and where I should be looking would be really appreciated.

This blog is a genuine passion project and losing it would be gutting. Any help or direction is appreciated.


r/TechSEO • • May 07 '25

ScamAdviser is damaging SEO for honest websites — here’s how

98 Upvotes

Just wanted to share a recent experience we had with a reputation management platform that negatively affected our SEO and visibility.

ScamAdviser, the scam pretending to fight scams

ScamAdviser claims to fight online scams, but in reality, it’s one of the biggest frauds on the web.
Here’s how it works:

They destroy the reputation of new websites by making up fake fraud accusations out of thin air.
To “fix” those lies, you’re asked to pay $14 for a so-called manual verification.
Their platform is totally unmoderated — anyone can post anything about any website, no checks whatsoever.
The result? A playground for trolls, fake reviewers, and shady competitors.

Real case: our website

We found out by chance that ScamAdviser was rating our site as “60% scam risk”… supposedly because of “high-risk crypto services.”
Except is 100% free.
No cookies.
No trackers.
No ads.
No payment systems whatsoever.

It takes less than 2 minutes to visit the site and see that ScamAdviser is completely lying.

But it gets worse.

After we sent them an email warning of a defamation lawsuit and saying we refused to pay their $14 scam, our score magically dropped to 95% scam risk.
And then — surprise! Dozens of fake profiles popped up claiming they had lost $100,000 on our site (again: it’s literally impossible to pay anything on our site).

And guess what? Those same profiles post the exact same stories on tons of other sites.
Same copy-pasted text, same dollar amounts, same fake drama.

Check ScamAdviser’s Trustpilot page: you’ll see plenty of people reporting the exact same scam pattern.
Honest websites are being smeared, while known scam sites get great ratings — obviously, the ones that paid.

We dug a little deeper

Their official address in Amsterdam is just a cheap rented mailbox.
Their real activity has nothing to do with cybersecurity — it’s a fear-based manipulation business, dressed up as a "trust tool."

What we’re doing now

We’re inviting every webmaster out there to check what ScamAdviser says about their site — this can seriously tank your SEO.
If they’re smearing your website like they did to ours, join our legal complaint and claim damages.
We’re not just going after their fake company — we’re going after the individual responsible: Jorij Abraham.
We’re also preparing an official GDPR complaint.
And any action that helps take this long-running scam down is more than welcome.

If you’re a victim of ScamAdviser, speak up. It’s time to shut this down.


r/TechSEO • • Mar 30 '26

Google Search Console + Claude Code

94 Upvotes

Hey just want to share something free and open source for technical SEO

https://github.com/nowork-studio/toprank

I built this free open-source skill for Claude Code - Toprank. Run /seo-analysis inside your website repo and Claude pulls 90 days of real search data, finds what's hurting you, and fixes it. Checkout the output from below (I redacted domain/links/keyterms for privacy)

Running it from inside your website repo is where it really clicks — Claude sees your code and your real traffic data at the same time. It recommend things to fix based on the data about your own website, then proceed to make those changes - whether it's fixing certain metadata, improving content, or creating new content.

The only friction is Google Cloud, which is required to access Search Console data. If you already have it, setup is a breeze. If not, the skill guides you through it. Everything else is free — just your Claude Code subscription.

Happy to answer any questions, contributions are welcome!


r/TechSEO • • Oct 10 '22

Google updates

Post image
88 Upvotes

r/TechSEO • • Jan 29 '23

I created this Tech SEO framework so I could explain it easily to non-SEOs internally.

Post image
82 Upvotes

r/TechSEO • • Mar 02 '26

udm=14 - How to get "Old School" Google back by default in Chrome

81 Upvotes

I just discovered "udm=14".
By adding it to the end of a Google search request it just shows the top 10 results with no clutter no ai nonsense.

For example:

https://www.google.com/search?q=best+seo+tips+for+2026&udm=14

I then asked Gemini if there was a "trick" to make it run when I need it, but better than that there is a way to make it permanent/default.

So in Geminis own words:

“
If you’re tired of Google Search results being dominated by AI Overviews, "People Also Ask" boxes, and massive widgets, there is a simple URL parameter (udm=14) that forces Google to show only the "Classic" web results—the old-school 10 blue links.

You can set this as your default search engine in Chrome so you never have to see the AI clutter again.

What it does

Adding &udm=14 to a Google search URL strips away the "modern" features. It returns a clean list of indexed websites, similar to how Google looked 10+ years ago. It’s faster, less distracting, and better for seeing actual rankings.

How to set it as Default in Chrome

  1. Open Chrome Settings*.*

  2. Go to Search engine > Manage search engines and site search*.*

  3. Scroll down to the Site search section and click Add*.*

  4. Fill in the fields exactly like this:

  5.  

  6. Click Add*.*

  7. Find your new "Google Classic" in the list, click the three dots (⋮) next to it, and select Make default*.*

Now, anything you type into your address bar will automatically use the "Web" filter, bypassing the AI and "extra" modules.

“

Just imagine if there was a movement/trend to make this the setting everyone one wanted, and what it could do for SEO.

Here are the other udm endings if anyone is interested

udm=14 WebThe "Classic" view. No AI Overviews, no knowledge panels—just 10 blue links.

udm=12 NewsFilters results to news articles only.

udm=7 VideosSwitches the view to the Video search tab.

udm=2 ImagesSwitches the view to the Image search tab.

udm=18 ForumsPrioritizes Reddit, Quora, and other discussion-based sites.

udm=28 ShoppingSwitches to the Google Shopping comparison view.

udm=36 BooksSearches within Google Books.


r/TechSEO • • Mar 26 '26

I built a Screaming Frog Python library to automate crawling and analysis end to end

75 Upvotes

Basically the title. A few months ago I figued out how to create conig files programmatically, and I kept diggin. Then I found how to crack open the crawl files so you don't have to export a bunch of CSVs. Decided to take it all the way.

If you use Screaming Frog a lot, you probably know the pattern:

crawl site open GUI export CSVs clean them then start answering the actual question

I got tired of that, so I built a Python library around the crawl files themselves.

It’s now in public alpha:

pip install screamingfrog

The main use case is working directly with Screaming Frog crawl data in Python without having to live in the GUI for every analysis.

What it does right now:

  • load .dbseospider files directly

  • access all 628 Screaming Frog exports programmatically

  • query crawl data with a typed API

  • query pages and links sitewide

  • find broken inlinks, nofollow inlinks, and orphan pages

  • compare crawls over time

  • detect redirect and canonical chains

  • start crawls and exports from Python

  • convert .seospider into portable .dbseospider files

  • run raw SQL when needed

Current coverage:

  • 601 / 628 export/report tabs fully mapped

  • 15,490 / 15,589 fields mapped

I’ve already been using it to run crawl analysis inside Claude Code, which is part of why I decided to open it up.

Still alpha, so I’m mainly looking for feedback from people who do real technical SEO work with Screaming Frog every week.

If you use SF heavily, I’d be interested in:

  • what workflow you’d automate first

  • what report/tab you rely on most

  • what would stop you from actually using this

GitHub: https://github.com/Amaculus/screaming-frog-api


r/TechSEO • • Jan 25 '26 Helpful

Google's New GIST Algorithm Explained - Practical Impacts for SEO & Business

74 Upvotes

On Friday (Jan 23), Google Research published details on GIST (Greedy Independent Set Thresholding), a new protocol presented at NeurIPS 2025.

While the paper is heavy on math, the implications for SEO and Content Strategy are straightforward and critical to understand. This isn't just a ranking update, it is a fundamental shift in how Google selects data for AI models to save compute costs.

Me and my team broke down the core points you should take in consideration.

Part 1: What is GIST? (The "Selection" Problem)

To understand GIST, you have to understand the problem Google is solving: redundancy is expensive.

When generating an AI answer (AEO), Google cannot feed 10,000 search results into the model context window - it costs too much. It needs to pick a small subset of data (e.g., 5 sources) that covers the most information possible.

The Old Way (Ranking): Google picks the top 5 highest authority pages. If all 5 say the exact same thing, the AI gets 5 duplicates. This is a waste of processing power.

The GIST Way (Sampling): The algorithm actively rejects redundancy. It selects the highest-value source and then draws a conflict radius around it.

Part 2: The Mechanism (The "No-Go Zone")

GIST uses a method called Max-Min Diversity.

Utility Score - It identifies the piece of content with the highest information density (Utility).

The Bubble: It mathematically defines a rradiusr around that content based on semantic similarity.

The Lockout: Any other content falling inside that radius is excluded from the selection set, regardless of its authority.If your content is semantically identical to Wikipedia , you aren't just ranked lower, you are effectively invisible to the model because you provide zero marginal utility.

Part 3: Practical Impact on SEO Strategy

The era of consensus content is over.

For the last decade, the standard advice was "Skyscraper Content" - look at the top result and rewrite it slightly better. Under GIST, this strategy puts you directly inside the "No-Go Zone" of the winner.

The Pivot:

Stop: Rewriting the top-ranking article's outline.

Start: Optimizing for Semantic Distance.

You need to ask: "What data point, perspective, or user scenario is the current top result missing?" If the VIP covers the what, you must cover the how or the data. You need to be distinct enough to exist outside their radius.

Part 4: The Business Reality - Why is Google doing this? Unit Economics.

Processing redundant tokens costs millions in GPU compute. GIST provides a mathematical guarantee (proven in the paper) that the model can get 50% of the optimal utility while processing a fraction of the data.

Part 5:The Business Takeaway:

For Publishers: Traffic from generalist content will crater as AI models ignore redundant sources.

For Brands: You must own a specific information node. Being a me-too brand in search is now a technical liability.

Part 6: FAQs & Practical Implementation

Since this dropped, I’ve had a few DMs asking if this is just theory or active production code. Here is the technical reality check.

Q: Is GIST already functioning in Search? Short Answer: Yes, almost certainly in AEO (AI Overviews) and SGE, likely rolling out to Core Search. The Proof: The paper explicitly mentions that the YouTube home ranking team already employs this exact diversity principle to prevent user fatigue (e.g., stopping the feed from showing 5 "Minecraft" videos in a row). Given that the primary driver for GIST is compute cost reduction (saving token processing for LLMs), it is economically illogical for Google not to use this for AI Overviews immediately. Every redundant token they don't process saves them money.

Q: Will restructuring my content actually help? Yes, but only if you focus on Information Gain. The patent literature refers to this as "Information Gain Scoring." GIST is just the mechanism that enforces it. If you are smaller than the market leader: You cannot win by being better. You must be orthogonal.

The Restructure Strategy:

Analyze the Top Result: What entities are in their knowledge graph? (e.g., they cover Price, Features, Speed).

Identify the Missing Node: What vector is missing? (e.g., Integration challenges, Legal compliance, Edge cases).

The Addendum Strategy: Don't rewrite their guide. Write the missing manual that they failed to cover.

Schema is Critical: Use claimReviewed or specific ItemList schema to explicitly signal to the crawler that your data points are distinct from the consensus.

Q: How do I test if I'm in the"No-Go Zone? There is no tool for this yet, but you can use a "Semantic Overlap" proxy.

Take the top 3 ranking URLs.

Take your draft.

Feed them into an LLM (Claude/Gemini) and ask: Calculate the semantic cosine similarity between my draft and these 3 URLs. If the overlap is >85%, list the redundant sections.

Part 7: What’s Next (Tool & Protocol)

To help navigate this, my team and I are currently developing a Strict GIST Implementation Protocol to standardize how we optimize for diversity-based selection.(Ill create a specific thread for it as soon as its ready).

We are also prototyping a "GIST Compliance Checker" (aiming to release a beta version within the next week). The goal is to give you a simple way to visualize your semantic distance from the current VIPs and see if you are actively sitting in a No-Go Zone.

I’ll be hanging out in the comments for the next few hours. I would gladly answer any questions regarding the technical side of the protocol or how to adapt your specific business model to this shift with minimal damage.

Ask away.

UPDATE (Jan 27): The GIST Check Tool is Live (v0.9 Beta) To help visualize this Vector Exclusion Zone concept, I built a free diagnostic tool. It simulates the GIST selection process by measuring the semantic distance between your content and the current Top 3 ranking results.

I’ve posted a detailed breakdown of how to use it, the current limitations, and the roadmap in the comments below. Please read that before running your first check.


r/TechSEO • • Apr 13 '20

I created a directory of SEO tools over the weekend.

Post image
73 Upvotes

r/TechSEO • • Oct 17 '19

Just bringing some fun to serious conversations :)

Post image
72 Upvotes