Fluent Collective / courses
0 XP Explorer rank
← Advanced SEO

Module 0: Start Here

How search really works: crawling, indexing, and ranking — and why the famous “200 ranking factors” matter less than the handful that actually move the needle.

3
Steps: crawl, index, rank
4
Factors that do the real work
1
System, in order
Illustration for Module 0: Start Here

The crawler comes first

Before Google can rank your page, it has to find it. That job belongs to crawlers — automated programs that follow links from page to page across the web, reading as they go. Think of them as librarians walking every aisle: if no aisle leads to your book, it never gets shelved. This is why crawling is step one of all SEO, and why brand-new pages on sites with no links can sit invisible for weeks.

A crawler starts from pages it already knows and follows links outward. Every link on the web is a road, and your site needs roads leading in. That is the real reason backlinks matter at the discovery level — they are how Google finds you in the first place. Your own internal links do the same job inside your site: a page with no internal links pointing at it is called an orphan page, and crawlers may never visit it.

You control crawling more than you think. A sitemap — a simple XML file listing your pages — is a direct invitation: "here is everything, please come read it." Your robots.txt file is the bouncer: it tells crawlers which areas are off-limits. And in Google Search Console, the URL Inspection tool lets you ask Google to crawl a specific page right now instead of waiting.

If a page isn't crawled, it doesn't exist to Google. Before you optimize anything, make sure every important page is reachable: linked from somewhere, listed in your sitemap, and not blocked by robots.txt. Discovery first, everything else second.

Build brief

List your 5 most important pages (homepage, top services, contact). For each one: is it linked from your main navigation or homepage? If any page is more than 2 clicks from your homepage, write down exactly where you will add a link to it.

Indexing: getting understood

Once a crawler visits your page, Google tries to understand it and store a copy — that stored copy is the index. Only indexed pages can appear in search results. Crawling is the visit; indexing is moving in. And Google is picky about what it keeps: thin pages with almost no content, duplicate pages, and pages blocked by a noindex tag get left out.

Here is what most people miss: Google now indexes the mobile version of your page first. If your mobile site hides content behind tabs, strips out text, or loads differently than desktop, Google judges the mobile version — because that is what most searchers see. A page that looks rich on desktop but thin on mobile gets indexed as a thin page.

Duplicate content is the other silent killer. If the same content lives at three URLs — with and without www, with tracking parameters, on HTTP and HTTPS — Google has to guess which one is real, and it may pick wrong or split the credit. The fix is the canonical tag: a small line of code on each page that points to the one true version. One page, one canonical, no confusion.

Check your own index right now: search Google for site:yourdomain.com and count what comes back. That is roughly what Google has shelved. Missing important pages? That is a crawling problem from lesson one. Seeing junk pages — tag archives, thin thank-you pages? Those dilute your site and can be noindexed. The index is your inventory — audit it like one.

Build brief

Run a site: search for your domain on Google. How many pages show up? List any important pages that are missing and any junk pages that should not be there. Write your fix for each (add to sitemap, add internal link, or noindex).

Ranking: the myth of 200 factors

You have heard that Google uses over 200 ranking factors. That number gets repeated because it sounds impressive, and it paralyzes people — how could anyone optimize 200 things? Here is the truth that working SEOs know: a small handful of factors do almost all of the work, and the rest are tiebreakers. This course is built around the handful.

The big four are simple to say and hard to do. Relevance: does this page actually answer the query? Content quality: is it deep, current, and genuinely useful? Authority: do other trusted sites link to it? Experience: does the page load fast and work well on phones? Get these four right and you beat 90 percent of competitors, because 90 percent of competitors have not done the unglamorous work.

Everything else — keyword in the URL, image alt text, the exact length of your title — matters at the margins. Margins matter when you are fighting for position one against an equal competitor. They do not matter when your page is thin, slow, and linkless. Work in order: relevance, quality, authority, experience — then the margins.

That order is also this course's structure. Module 1 finds queries you can win. Module 2 makes your pages relevant and well-built. Module 3 fixes the experience. Module 4 builds the quality moat. Module 5 earns the authority. Module 6 grabs the extra SERP real estate. Module 7 measures it all. One system, in order — no 200-factor checklist required.

Build brief

Score your homepage honestly on the big four, 1–5 each: relevance (does it match what searchers want?), content quality (deep and current?), authority (who links to you?), experience (fast on your phone?). Write your two lowest scores — those are your first projects.

The big four ranking factors

Relevancedoes the page answer the query?
Content qualitydeep, current, genuinely useful
Authoritytrusted sites link to it
Experiencefast, works on phones

A friend's new site has 3 pages, no sitemap, and no links from anywhere. Her pages aren't in Google at all. What's the first fix?

Your turn: Audit your index: write down how many pages Google shows for site:yourdomain.com, list your 3 most important missing pages, and your first fix for each.

Your next 24 hours

Open Google Search Console (set it up free if you haven't), submit your sitemap, and use URL Inspection on your homepage. Write down whether it's indexed and when it was last crawled.

Steal this template

CRAWL & INDEX AUDIT

site:yourdomain.com shows ___ pages indexed.

Important pages missing: ___

Junk pages to noindex: ___

Sitemap submitted: ☐   Robots.txt checked: ☐

Cheat sheet

  • Crawling is discovery — crawlers follow links, so every important page needs roads leading in.
  • Indexing is storage — only indexed pages can rank; check with site:yourdomain.com.
  • Google indexes the mobile version first — mobile content is what counts.
  • Use canonical tags when the same content lives at multiple URLs.
  • The big four ranking factors: relevance, content quality, authority, experience.
  • Work in that order — margins and minor factors come last, not first.