A 5-step approach to optimizing websites with millions of pages – Search Engine Land

sel logo
Search Engine Land » SEO » A 5-step approach to optimizing websites with millions of pages
You’ve been tasked to optimize a site that is so massive it makes the Great Wall of China look like a picket fence. And it’s your sole responsibility. You need to make a big SEO impact with fewer resources. What do you do?
In this article, I’ll share five approaches you can focus on when you’re optimizing massive websites. 
By the end, you’ll feel confident knowing that you have a battle plan to conquer that great wall of webpages that lie ahead:
It’s useful to have a certain mindset about your SEO program before you start. 
That said, two key steps will help you create an SEO game plan: 
Let’s look at those in more detail.
In the battlefield of the search engine results pages, your website is the weapon. 
So your first mission: Sharpen that weapon by making the site the best it can be so that you’re not your own worst enemy. 
A site analysis will uncover the things that are hindering your rankings. 
You can do this in a couple of ways:
Diagnostic tools
The average SEO tool is meant to repair your site, not rank it. In other words, it will not tell you how to rank but what you need to fix based on best practices.
Most businesses use diagnostic tools to do a self-audit. While it can uncover some useful information, there are a couple of limitations:
For example, let’s say you’re seeing a drop in organic search traffic. The diagnostic tool will not be able to understand what factors contribute to that – is it due to an algorithm update? Did your site recently migrate? Is your content bad?  
So, it is the diagnostic tool operator’s job (a.k.a. you) to be able to take the data and apply wisdom to ensure you are focusing on the most impactful things.  
Some tools you might consider for diagnosing your site include:
SEO audits
Nothing beats the strategies you can uncover from a professional-level SEO audit that marries diagnostic tools with expert wisdom from an SEO vendor. 
In addition to running the best tools, an SEO expert conducting a site audit can:
Once you’ve sharpened your tool, it’s time to go to the battlefield in the SERPs, where your second mission is to beat the competition (not the algorithm). 
Remember, you cannot attempt to beat an infinitely large algorithm. 
By focusing on what your competition is doing, and trying to do as well as them or better, you set the stage for a more manageable battle.  
Here again, you will rely on tools to help you uncover your competition’s strategy. 
You are looking to find things like who your true competitors are, and recommendations on optimizing your webpages based on the top-ranked pages in the SERPs.
Some tools you might consider for competitive research include:
By understanding your site and your competition, you can enter the battlefield with a clearly defined plan. This makes managing a large site’s SEO less overwhelming.
When you have a massive website, every change needs to count. That means looking at the things that can elevate the entire site or key pages across the site. 
One of the obvious wins here is improving your website performance (and your content, but more on that later). 
You can tackle things like:
Website speed can impact many things: The user experience, your website rankings and conversions … so this is something to take seriously. 
Google conducted some research on speed and its impact on users back in 2017 (highlighted below), and while the data is a bit old, the message still holds.
As you look at your site, you may find that some of your pages may load slower than others. If that happens on your most important pages, you want to start there. 
And you may have groups of pages with the same template where making a few changes can improve speed across all those types of pages. 
Some things you may need to address are:
Some helpful tools and resources for this include:
(Note that, technically, the old page speed algorithm has been replaced by core web vitals, which I’ll cover next.)
Core web vitals focus on factors that create a good user experience on your website, this includes:
Google says that “if at least 75 percent of page views to a site meet the ‘good’ threshold, the site is classified as having ‘good’ performance for that metric.”
This most likely only matters to the top-performing pages on the site, though, not the entire site, as pointed out in this Google SEO office hours: 


However, Google has noted that some sites may not need to dedicate too many resources to core web vitals, or obsess about the scores:
IMO most people don’t need to do anything different. This is not a change in how ranking works, it’s more about how we’ve been thinking about these elements. We’ve seen people hyper-focus on these numbers, that’s not a good use of time & energy. Think holistically instead.
Several tools offer lab and field data that can help you understand core web vitals:
So look at the most critical pages on the site, and run some tests to see what can be improved.
Ensuring your site is mobile-friendly is a no-brainer in today’s mobile-centric world. Of course, there’s also Google’s mobile-first indexing.
There is more to consider than you may think in order to have a mobile-friendly site. In general, you will want to think about:
Tools that can help you along the way include:
Because the code on your website can impact a search engine’s ability to crawl your website, you can consider optimizing that code. 
Again, you can start with certain page templates or key page types and go from there.
Checking out W3.org’s developer tools can be helpful. 
But a warning for beginners: You can spend a lot of time and resources trying to chase perfect code and the effort doesn’t always match the outcome. 
So it’s wise to know how to prioritize the recommendations, and you may need expert help from a developer who also understands SEO or vice versa.
Get the daily newsletter search marketers rely on.
See terms.
Another area to laser focus your SEO efforts when you are contending with a large website is the top-performing pages. 
Typically, a handful of webpages drive the majority of organic traffic to a website. Look at those first.
This is consistent with an Ahrefs study which found that out of billions of webpages, only about 4% of them received any meaningful traffic at all.
In other words: If you have to choose between optimizing a product page that drives a lot of traffic to your site versus a lesser-known product page featuring a left-handed socket wrench with a light on it, choose the top performer.
You can easily track down your top-performing pages using Google Analytics, and you can also use information from Search Console.
In terms of how you improve these pages, again, you’ll want to focus on page analysis and competitor analysis. 
Run some diagnostic tools like those linked earlier to get a sense of where those pages are, then compare that to the top-ranked pages in the SERPs for the queries you are targeting.
As part of this, you may need to strengthen the content, so look at your content with a critical eye, too.
In my experience, maybe 15% of a website is targeting its “head” terms – the broader, more generic keywords/queries that people use when searching for what you have to offer. 
Ultimately, you can drive a ton of traffic if you can rank for these more generic terms – and they can be million-dollar keywords. 
So if I were to focus my efforts on a large site, I would want to optimize the pages that target head terms (the landing pages), and then secondly, optimize all the subpages that support them. 
This typically means you need solid information architecture – how you organize your content. 
If you already have well-organized content that supports your head terms, then you’d focus on optimizing those pages using some of the tools and strategies I’ve already mentioned. 
If you don’t, however, you may need to do some reorganization of the content, links and navigation on your site. This is where SEO siloing comes in handy.
SEO siloing is a form of website content organization and internal linking practices. One of the goals of this strategy is to maximize your site’s relevance for head terms.
Not only that, but SEO siloing can help by:
Just to give a quick example: Say you own a power tools business that sells cordless power tools, electric power tools and gas-powered tools.
You’d start by organizing the website content (and site navigation) into categories supporting the three product lines you sell. 
Your SEO program aligns with this because these categories will be the head terms you are after, too.
Practically, each product line will have its own section on the site with a landing page and supporting pages. 
The goal is to have well-organized landing pages and supporting pages with helpful, expert content that aligns with how people search and learn about the things you have to offer. 
Links between the landing pages and their own subpages clarify the relationships for search engine spiders crawling the website.
You can apply siloing to all types of sites, including ecommerce, B2B and informational sites.
Of course, this is a highly simplified explanation, and the details of how to make SEO siloing work well are vast.
Can this be a massive project? Yes. But it depends on the state of the site.
For some, they may have to do a larger reorganization of the content to achieve their goals, while others may need less effort with perhaps some new internal linking.
How big of a job this is depends on things like:
It can be a challenge but well worth it in most cases – it’s one of the ways we get our clients to rank for highly competitive one-word terms. 
For our final step in optimizing massive websites, let’s look at how you can elevate the quality of a website from an SEO perspective by focusing on the content.
Last but not least, having excellent content is a priority. And this can be a huge challenge for large sites.
When you have massive amounts of content, you will need to divide and conquer. 
I’ve said previously that website publishers should spend half the time creating new content, and half the time updating old content
(And by the way, if you plan on creating new AI content, see my article on ChatGPT and SEO content.)
Large websites need a system for:
Google’s helpful content system looks at the site as a whole, not just at a page level. 
So if you have some great content, and then a whole bunch of “search engine first” content, it can negatively impact the ability of the site to do well in the search results. 
As you are evaluating your content, keep some important guidelines in mind from Google:
Then you will go through all the steps of optimizing those pages after the content is of the highest quality.
Large sites have their own unique issues. As you stand before the towering fortress that is your website, the divide-and-conquer attitude will help you stay sane. 
While the task may seem daunting, you can remind yourself that SEO is an ongoing job – so play the long game.
Opinions expressed in this article are those of the guest author and not necessarily Search Engine Land. Staff authors are listed here.
Related stories
New on Search Engine Land
About the author
Related topics
Get the daily newsletter search marketers rely on.
See terms.
Learn actionable search marketing tactics that can help you drive more traffic, leads, and revenue.
March 15-16, 2023: SMX Munich
Online Aug. 16-17: SMX Master Classes
Start training now: SMX Next
Start training now: SMX Advanced
Discover time-saving technologies and actionable tactics that can help you overcome crucial marketing challenges.
April 15-17, 2020: San Jose
Decode the Future of AI and Privacy with Metadata Mastery
Maximizing Marketing ROI With a Composable Stack: Separating Reality from Fallacy
Upgrade Your 2024 B2B-Marketing Game With This Powerful Ad Channel
Enterprise Marketing Attribution and Performance Management Platforms: A Marketer’s Guide
Enterprise Account-Based Marketing Platforms: A Marketer’s Guide
Enterprise Marketing Work Management Platforms: A Marketer’s Guide
Demystifying Inbox Deliverability Changes Coming in 2024
Meet your new AI-powered marketing assistant!
Get the must-read newsletter for search marketers.
Topics
Our events
About
Follow us
© 2023 Third Door Media, Inc. All rights reserved.
Third Door Media, Inc. is a publisher and marketing solutions provider incorporated in Delaware, USA, with an address 88 Schoolhouse Road, PO Box 3103, Edgartown, MA 02539. Third Door Media operates business-to-business media properties and produces events. It is the publisher of Search Engine Land the leading Search Engine Optimization digital publication.

source

Related Posts

Google Strengthens Search Console Security With Token Removal Tools – Search Engine Journal

Stay ahead of the game with the best marketing tools and ensure your tactics are primed for success in this new era of digital marketing.This webinar will equip you with…

Read more

Google Search Console security update improves management of ownership tokens – Search Engine Land

sel logoSearch Engine Land » SEO » Google Search Console security update improves management of ownership tokensChat with SearchBot Please note that your conversations will be recorded. SearchBot: I am…

Read more

Search Engine Optimization (SEO) Market Size Worth USD 157.41 Billion in 2032 | Emergen Research – Yahoo Finance

Search Engine Optimization (SEO) Market Size Worth USD 157.41 Billion in 2032 | Emergen Research  Yahoo Financesource

Read more

AI Prompt Engineering Tips for SEO – JumpFly PPC Advertising News

AI Prompt Engineering Tips for SEO  JumpFly PPC Advertising Newssource

Read more

Most Common B2B SaaS SEO Mistakes – MarketingProfs.com

by Ryan Lingenfelser Many B2B SaaS companies ignore SEO… and they are often right to do so!For SMBs, especially startups, it rarely makes sense to prioritize SEO. Compared with marketing…

Read more

How To Create an XML Sitemap To Improve Your Website’s SEO (2023) – Shopify

Start your businessBuild your brandCreate your websiteOnline store editorCustomize your storeStore themesFind business appsShopify app storeOwn your site domainDomains & hostingExplore free business toolsTools to run your businessSell your productsSell…

Read more

Leave a Reply

Your email address will not be published. Required fields are marked *