Episode 7: How Does Website Searching Actually Work?

Article by Rajat Patil

(A fun guide for Curious Minds)

Imagine.

You open Google, type “Why is the sky blue?”, hit enter - and boom, millions of results appear in less than a second. (sometimes it takes more if your internet connection is bad😉)

But have you ever wondered….

• How did the internet find those answers so fast?

• Is there someone sitting inside Google reading websites?

Let’s break it down - STEMiscope style :)

The Internet Is a GIANT Library

Think of the internet as the biggest library ever created

• Each website = a book

• Each web page = a page in that book

• Google/Bing = super-smart librarians

But here’s the catch - No one tells Google what websites exist.

So how does it know? 🤔

Meet the Web Crawlers (Internet Explorers!)

Search engines use special programs called web crawlers (also called bots or spiders).

Their job:

• Travel from one website to another

• Read pages

• Follow links

• Collect Information

Just like how you hop from one Instagram profile to another by clicking links.

Fun Fact:

Google’s crawler is called Googlebot 🕷️

Storing Everything in an Index (The Brain of Google)

Once crawlers read websites, they store the information in something called an index.

Think of it like:

• A massive notebook

• Organized by keywords

• Faster than flipping real pages

  
  

Example:

If a page talks about “photosynthesis”. Google notes:

• What the page is about

• Important words

• Images

• Headings

This step is called indexing.

You Search → Google Thinks Fast

Now comes your moment.

In a Search Engine, you type: “Why is the sky blue?”

Behind the scenes:

• Google scans its index

• Finds pages related to your words

• Ranks them using smart rules (algorithms)

How does Google rank the search results?

Google doesn’t just pick random websites;

It checks things like:

• Is the content helpful?

• Does the website look trustworthy?

• Do other websites link to it?

• Is it easy to read?

• Does it load fast on mobile?

The better the answers - The higher the rank ⬆️

That’s why the first page matters the most.

As a fun exercise, you can try to integrate the search-simple-demo.html file into your website’s Lab section. What does it show? It displays an animation illustrating how web search engines operate. 

Check out the lab here (Click the link below) ↓

stemiscope.wixsite.com

Mini Search Engine Lab | STEMiscope