What is a Sitemap?

What is a Sitemap?

A sitemap is a file or page that lists all the important pages of a website, providing a roadmap for search engines and users to navigate the site effectively. Sitemaps ensure that every significant page is discoverable and indexable by search engines, even if those pages aren’t well-linked internally.

There are two primary types of sitemaps: XML sitemaps and HTML sitemaps, each serving a unique purpose for both search engines and website visitors.

What is an XML Sitemap?

An XML (Extensible Markup Language) sitemap is designed specifically for search engines. It lists all the URLs of a website, along with metadata that provides additional information such as:

• Last modified date: when the page last changed. Google uses this, provided it is accurate.
• Priority and change frequency: still part of the sitemap standard, but Google ignores both, so there is no benefit in setting them.

XML sitemaps are not meant for visitors. Search engines read them to discover URLs and to learn which pages have changed since the last crawl.

Benefits of an XML Sitemap:

1. Improves Crawlability: Helps search engines find and index pages that may not be easily discoverable via internal links.
2. Supports Large Websites: Ensures that large websites with extensive page structures are fully indexed.
3. Enhances SEO: Provides search engines with direct information about page updates and priorities.

What an XML sitemap should and should not contain

Include every page you want indexed: service pages, product pages, articles, category pages that carry content. Leave out anything that redirects, returns a 404, carries a noindex tag, or canonicalises to another URL. A sitemap full of URLs Google cannot or should not index teaches Google to trust the sitemap less. One sitemap can hold up to 50,000 URLs or 50MB uncompressed; larger sites split into several sitemaps listed in a sitemap index file.

What is an HTML Sitemap?

An HTML (HyperText Markup Language) sitemap is a web page listing a website’s most important pages, intended for human visitors. It acts as a directory, helping users navigate a site more easily.

Benefits of an HTML Sitemap:

1. Improves User Experience: Allows visitors to locate content quickly, especially on large or complex websites.
2. Enhances Internal Linking: Provides an additional path for users to access various pages.
3. Supports SEO: Though primarily user-focused, HTML sitemaps can also help search engines understand the site structure.

What Are Sitemaps For?

Sitemaps are essential tools for both search engines and users:

1. Ensuring Full Indexing: Sitemaps help search engines discover and index all important pages, even those buried deep within a website.
2. Highlighting Key Pages: They prioritise essential pages, guiding search engines on where to focus their efforts.
3. Improving Crawl Efficiency: By providing a clear roadmap, sitemaps ensure search engines don’t miss valuable content.
4. Supporting SEO: Sitemaps improve the overall visibility of your site, ensuring new and updated content is indexed promptly.
5. Enhancing Navigation: HTML sitemaps improve user experience by making content easier to find.

Sitemap Relevance for Different Website Sizes and Types

Not every website has the same needs when it comes to sitemaps. Whether your site should have a sitemap depends on factors like its size, structure, and how often content is updated.

Do All Websites Need a Sitemap?

• Small Websites (under 500 pages):
  • If your website is small and all pages are well-linked internally, a sitemap is often not essential. Search engines can typically discover and index all content through regular crawling.
  • However, even for small sites, having a sitemap can serve as a safety net, ensuring that every important page is found and indexed, especially if you occasionally add new sections or pages.
• Large or Complex Websites:
  • For websites with hundreds or thousands of pages, complex navigation, or extensive archives, a sitemap becomes much more important. It helps search engines efficiently find and prioritise key content, reducing the chances of missing valuable pages.
  • Large e-commerce sites, news portals, and sites with frequent updates benefit significantly from having a well-maintained sitemap.
• New Websites or Sites with Few Backlinks:
  • If your website is new or doesn’t have many external links, a sitemap can help search engines discover your content more quickly.
• Sites with Rich Media or Special Content:
  • Websites featuring lots of images, videos, or news articles often require specialised sitemaps (such as image or video sitemaps) to ensure this content is indexed properly.

Image, video and news sitemaps

Sites that depend on images or video can add image and video sitemaps, or image and video tags inside the main sitemap, so that media gets indexed in its own right. News sitemaps are for publishers in Google News and list only articles from the last two days. Most business sites need none of these.

Generating a Sitemap for WordPress Websites

WordPress offers several ways to generate both XML and HTML sitemaps:

XML Sitemaps for WordPress:

1. Using Plugins:
   • Rank Math: generates a sitemap index at /sitemap_index.xml, with separate sitemaps for posts, pages and any custom post types, and lets you exclude post types or individual pages.
   • Yoast SEO: the same structure at /sitemap_index.xml.
   • XML Sitemap Generator for Google (formerly Google XML Sitemaps): a standalone option if you do not run an SEO plugin.

Whichever you use, it replaces the native /wp-sitemap.xml. Submit the plugin’s sitemap index in Search Console, not the native one.

1. Native WordPress XML Sitemaps: Since WordPress 5.5, a basic XML sitemap is generated automatically. You can access it by adding /wp-sitemap.xml to your site’s URL (e.g., www.example.com/wp-sitemap.xml).

HTML Sitemaps for WordPress:

1. Plugins for HTML Sitemaps:
   • Simple Sitemap: Helps you create a customisable HTML sitemap for your website.
   • WP Sitemap Page: Allows you to add an HTML sitemap via a shortcode.
2. Manually Creating an HTML Sitemap:
   • Create a dedicated page in WordPress.
   • List your important pages manually or use code to generate the list dynamically.

How to find your sitemap

Try yoursite.co.uk/sitemap.xml, /sitemap_index.xml or /wp-sitemap.xml. If none loads, check robots.txt (yoursite.co.uk/robots.txt), which usually contains a Sitemap: line pointing to it. If there is still nothing, the site has no sitemap and your SEO plugin’s sitemap setting is probably switched off.

Sitemaps and Google Search Console

Google Search Console is a powerful tool for managing and monitoring your sitemaps:

Checking Your Sitemap:

1. Log in to Google Search Console.
2. Navigate to the Sitemaps section under the Indexing tab.
3. View the status of submitted sitemaps, including errors or warnings.

Submitting Your Sitemap:

1. Ensure your XML sitemap is accessible (e.g., www.example.com/sitemap.xml).
2. In Google Search Console, enter the URL of your sitemap in the Sitemaps section.
3. Click Submit.

Google will crawl your sitemap and use it to improve how it indexes your site. Submitting a sitemap does not force indexing. It tells Google the URLs exist; Google still decides whether each one is worth indexing, and the Pages report shows which it has excluded and why.

How Sitemaps Support SEO

Sitemaps are invaluable for SEO because they:

1. Enhance Crawlability: Ensure all pages, even those with few internal links, are indexed by search engines.
2. Prioritise Content: Direct search engines to focus on your most important and frequently updated pages.
3. Boost Visibility: Help new content appear in search results faster.
4. Aid Large or Complex Sites: Simplify indexing for sites with extensive or complicated structures.
5. Improve Indexing for Dynamic Content: Ensure pages with dynamic URLs or parameters are not overlooked.

Sitemaps are one part of a wider technical SEO audit, which covers crawlability, indexing, speed and structure together.

Conclusion

Sitemaps are a critical tool for any website aiming to improve its SEO performance and user experience. XML sitemaps streamline the process for search engines to discover and index your pages, while HTML sitemaps enhance navigation for users.

Whether you’re using WordPress or another platform, generating and submitting a sitemap ensures that your content is visible to both search engines and your audience. With tools like Google Search Console, you can monitor and optimise the indexing process, helping your website achieve its full potential in search rankings.

Sitemap review and implementation is an important part of our expert SEO services.