What an XML sitemap does for your site
Think of an XML sitemap as a table of contents for robots. The crawler opens the file, sees which URLs exist and, if dates are provided, which ones changed recently.
Search engines can find pages without it, but only by following links. Imagine an online shop in Tashkent with hundreds of product pages, some buried deep inside category filters. Those pages may sit unnoticed for a long time. A brand-new site for a dental clinic or a language school, which hardly anyone links to yet, is in a similar position.
One limit is worth stating clearly: a sitemap does not guarantee indexing and does not improve rankings. It is a hint for crawlers and a monitoring tool for you.
Which pages to include
The rule is simple: list only pages you want to appear in search results. Every URL in the file should meet these conditions:
- returns a 200 status code, with no redirect
- is open to indexing, with no noindex tag
- is not blocked in robots.txt
- is the canonical version, not a duplicate
- uses your main domain version: https, and either www or non-www, consistently
What to leave out
Skip redirects, 404 and other error pages, cart and checkout steps, internal search results, and filter or sorting URLs. A common mistake is a plugin that dumps everything into the file, so the crawler receives hundreds of addresses your own site asks it not to index. These contradictions weaken the file and make later analysis harder.
Last-modified dates and automatic updates
Each URL can carry a last-modified date. Search engines treat it as a hint about when to recrawl a page, but only while it reflects real changes. If every regeneration stamps all pages with today's date, crawlers learn to ignore it.
The sitemap should maintain itself: publish an article or add a product and the URL appears, delete a page and it disappears. Most CMS platforms, e-commerce systems and frameworks can do this natively or through a plugin. A file built by hand months ago in an online generator is almost certainly out of date.
Large and bilingual websites
A single sitemap file has limits on the number of URLs and on file size. Big catalogs use several sitemaps plus a sitemap index file that points to them. Splitting by page type, such as categories, products and articles, makes reports much easier to read because you see which section has the problem.
In Uzbekistan many businesses run sites in both Russian and Uzbek. In that case the sitemap should include pages of both versions, and the link between them can be declared with hreflang. This helps search engines serve the right version to someone searching in Uzbek and another to someone searching in Russian.
How to submit your sitemap
Once the file opens at its own address, usually in the site root, tell the search engines about it. Three steps are enough:
- add the sitemap URL to your robots.txt file
- submit it in Google Search Console
- submit it in Yandex Webmaster if Yandex matters to your audience
Reading the reports
After submission, the reports show how many URLs from the sitemap were found and indexed. Compare that number with the number of URLs you submitted. A small gap is normal, especially on a new site. If most pages stay out of the index, look for the cause: thin or duplicate content, server errors, an accidental noindex, or weak internal linking.
If you would like a specialist to review your sitemap, robots.txt and indexing, markdev works on SEO optimisation for websites in Uzbekistan. Tell us about your project and we can talk through where to start.
FAQ
Do I need an XML sitemap?
Not strictly, since a site can be indexed without one. But a sitemap speeds up discovery of new pages and gives you indexing reports, so it is useful for most business websites.
Where should sitemap.xml be located?
Usually in the root of the site, for example yourdomain/sitemap.xml. Also reference it in robots.txt and submit it in Search Console and Webmaster tools.
Should Russian and Uzbek pages both be in the sitemap?
Yes, if both versions should appear in search. You can additionally declare the relationship between language versions with hreflang.
Why are pages from my sitemap not indexed?
Common causes are duplicates, thin content, noindex tags, server errors and robots.txt blocks. Start with the Search Console report and inspect one affected URL.
Let’s look at your task for free
Leave your contact — in a 15-minute call we’ll show where leads get lost and what to fix first.