XML Sitemaps are XML files created to make it easier for Search Engine crawlers and other bots to efficiently and fully crawl a website.

learn more… | top users | synonyms

1
vote
1answer
26 views

Why is this date in my sitemap “invalid” according to Google

My XML sitemap file has <lastmod>2013-07-06T09:39:51-0400</lastmod> formatted with W3C Datetime Format. Google has a warning message in webmaster tools about this for me: Google's ...
-1
votes
1answer
29 views

How to create sitemap for my shopping site? [closed]

I have one shopping site related to Home Goods and I need to create and submit the sitemap of my site in Google Webmaster Tool. I know there are several online tools to generate XML sitemap but some ...
1
vote
2answers
54 views

sitemap.xml file extension, does it have to be .xml?

Do XML sitemap files have to end with the .xml file extension? On the Bigcommerce platform, their XML sitemap file are defined as: http://www.examplesite.com/xmlsitemap.php The sitemap file is ...
2
votes
4answers
62 views

Do you really need robots.txt and sitemap.xml if I want bot to follow every link? [duplicate]

I wonder if I really need robots.txt/*sitemap.xml* files if I want bots to go through every link on my website without any restrictions? And if I do, what should I write in there?
2
votes
1answer
35 views

Why does my sitemap have a “.gz” extension, and how can I edit it?

An XML sitemap generator plugin for WordPress puts the following strings in my robots.txt file: User-agent: * Disallow: /wp-admin/ Disallow: /wp-includes/ But other WordPress blogs have lots of ...
4
votes
1answer
69 views

Understanding product search links in sitemaps

I am looking at sitemaps of a few large websites like ebay.com and I noticed that the URLs in the sitemap point to search results rather than the actual product page and I have confirmed that all the ...
1
vote
1answer
36 views

Why important/big sites don't include a sitemap? [closed]

I've been looking at most important sites and none of them have a sitemap.xml defined. My list includes: Amazon Ebay Yahoo Microsoft ... and others But none of them include a sitemap.xml file. Why ...
0
votes
1answer
32 views

Should I add the CDN or the source URL of an image to the XML image sitemap?

I'm creating a WP plugin and I have the source URL for the image and the CDN URL to the image as well that is generated by replacing the host to the CDN host. Which is better, if I add the source URL ...
3
votes
4answers
217 views

How does Google have more results than I have pages?

Our site has about 6500 pages. These are kept up to date in our sitemap.xml. When I go to our Google Webmaster Tools account I see that Google has indexed about 6000 of our pages. This seems quite ...
4
votes
2answers
147 views

Can a sitemap index file reference sitemap files under different domains?

My company owns several domain names. We also host websites for our users at their custom domains. Our domains: company.com product1.com product2.com Users's domains: user1.com user2.com ...
0
votes
2answers
41 views

Trying to create my first sitemap

I'm inserting a website map for the first time. I found this page: http://www.sitemaps.org/protocol.html That page shows examples about sitemaps with xml, should I insert and xml code in my html? ...
1
vote
1answer
283 views

Is there an XML sitemap generator with command line interface for nginx on Linux?

I'm looking for an XML sitemap generator that can be triggered from the command line, supports nginx, and works on Linux (Debian). What can you recommend?
5
votes
4answers
220 views

Robots.txt vs Sitemap — Who wins in a Conflict

If I block off the directory /foo in robots.txt, but my xml sitemap contains URLs with /foo, will the URLs in the sitemap get picked up by Google and other search engines? In other words, does the ...
9
votes
2answers
172 views

Should I Include RSS Feed URLs in an XML Sitemap?

Simple question - Should I Include the RSS Feed URLs in my site's XML Sitemap? I am NOT asking whether I should USE an RSS Feed AS an XML sitemap, but rather, should I include the URLs to the ...
1
vote
1answer
90 views

Multiple Sitemaps Doesn't Index Quickly - How To Get Quick Index

I have a serious problem in my site: http://www.coimbatorematrimony.com I will create multiple sitemaps.xml with all terms & conditions of Google Webmaster and some other search engines. I have ...
3
votes
2answers
147 views

Impact of blocking site search from googlebot, but listing content pages in sitemap.xml

We have a fairly large site 600k+ unique pages with various unique URLs along with a custom, local search interface for the site. The search interface has sorting and faceting capabilities to allow ...
5
votes
1answer
206 views

Are there specific advantages or disadvantages of an XML sitemap over a TXT based sitemap?

Are there any specific advantages or disadvantages in generating an XML based sitemap in place of a simple txt based sitemap (list of URLs)? I realize that in the XML format I can set priority and ...
1
vote
1answer
89 views

Google Site Search (commercial) not indexing files in sitemap

I have a client for whom we have purchased Google Site Search. It works well for HTML pages served by the CMS, but files aren't being reliably indexed. I wrote a script to generate an XML feed ...
1
vote
2answers
97 views

My Xmap generated sitemap is not being submitted

I m using joomla xmap component for creating sitemap. Here the URl of my xmap generated Sitemap: http://www.acethehimalaya.com/index.php?option=com_xmap&sitemap=1&view=xml I tried to submit ...
2
votes
1answer
58 views

Url blocked by robots.txt

I badly stuck on error in webmaster tools. I have created Sitemap and when I try to test it on webmaster tools it showing me this below error: Issue : Url blocked by robots.txt Description : ...
3
votes
5answers
233 views

Is there any benefit to having a link to your website's XML sitemap?

In Google's WebmasterTools, I submitted my site's XML sitemap, which is accessible through www.mysite.com/sitemap. However, no where on the site do I have an actual link that points to this. Is ...
0
votes
3answers
215 views

How to properly remove URL's from Google's index?

On some of our sites, we now have several thousand pages that dilute our website's keyword density. The website is an MVC site with SEO routing. If I submit a new sitemap with say only the 2000 or ...
1
vote
0answers
159 views

The “Total Indexed” is always zero in Google Webmaster Tools

I'm a newbie in Google Webmaster Tools. I've verified my site, created my sitemap and submitted it to the google webmaster account. But after a week of waiting I've found that 46 out of 250 URLs in ...
5
votes
1answer
152 views

In Google Webmaster Tools we have 3 sitemaps attributed to 1 domain

I have a website that has been on the internet for almost 10 years created in "Microsoft FrontPage" with over 900 pages. Currently in Google Webmaster tools it shows up as 2 domains and 3 sitemaps: ...
5
votes
3answers
545 views

Sitemap: Hierarchical layout possible?

Is it possible to design my sitemap hierarchically? My site is laid out hierarchically into World=>Continent=>Country=>State=>City=>Articles Can I design my sitemap xml like ...
1
vote
2answers
88 views

SiteMap / webmaster / google adsense

Can we apply for Adsense without sending Sitemap to webmaster tools ?
0
votes
2answers
128 views

Question about paginated based URLs and category URLs with XML sitemaps

I have a blog site that has this URL structure: http://website.com/category/ http://website.com/category/page1/ http://website.com/category/subcat/ http://website.com/category/article_title A flow ...
2
votes
1answer
216 views

Sitemap file getting double compressed

I have a script that generates my XML sitemap and writes it to the file sitemap.xml.gz - i.e. an XML file, compressed with gzip. This file is definitely written correctly as when I download it via FTP ...
2
votes
1answer
50 views

adding tagged / dynamic pages in sitemap

ive got a blog thats been running for about a year ive made about 200 posts, and there should be about 220 pages to index (additional pages for about / contact ect). When i go to crawl the site i get ...
0
votes
1answer
497 views

How to let Google know about dynamic content?

I'm looking for the best practice to let Google know about a vast number of dynamically created content. Let's say (I mean - dream) that I'm Facebook, and I want to let Google to index all the users' ...
-2
votes
2answers
41 views

I don't know how to set up a sitemap [closed]

I have a pretty nice site, but don't know much about webmaster issues. How do I create a sitemap and submit it to Google? What other very basic things should I be doing with my webmaster tools to ...
55
votes
4answers
28k views

Are there any clear indicators that my sitemap file is beneficial?

I have recently created a sitemap.xml file and uploaded it to my Google Webmasters Tools account. Google didn't report any issues or errors with the uploaded sitemap of my site. Now my question is: ...
3
votes
2answers
313 views

How often are sitemap.xml checked for updates by crawlers?

How often do crawlers check for updates in submitted sitemap.xml? Every hour, day, week, month, more?
2
votes
1answer
186 views

SEO for a wallpaper site [closed]

I am administering a wallpaper website. It hasn't got much content. Pictures mainly and at the moment my sitemap has 1700 entries that includes all the pages ( download pages for single items also ). ...
1
vote
3answers
467 views

Google SEO - remove site map from search result

I am an amateur to SEO. I have a new site recently and submitted the site map to GWT. But after several weeks. I found when I search my domain in google. The site map also appears to be one of the ...
3
votes
3answers
204 views

Delay before getting URLs into Google's in web index?

4 days ago, I have submitted a sitemap.xml into Google's WebMaster Tool for a new website. It contains 3 entries. I have tested the site map and Google found not errors. In about how much time can I ...
1
vote
3answers
122 views

How do I make a free sitemap.xml for a site that is few thousand pages? [duplicate]

Possible Duplicate: Free unlimited-page sitemap generator? Is there a free tool out there that would let me make a free sitemap for about 3k page site? Thanks!
0
votes
1answer
522 views

What is the best practice with KML files when adding geositemap?

Im not sure how to deal with kml files. Now important particularly in reference to the Google Venice update. My site basically is a guide of many company listings (sort of Yellow Pages). I want each ...
3
votes
2answers
304 views

2 the same page addresses in generated sitemap?

I tried different sitemap generators and they generate 2 data structures refering to the same webpage: On the beginning: <url> <loc>http://pundaquit.republika.pl/</loc> ...
7
votes
1answer
338 views

Should I ping to Google sitemap-index.xml or only the sitemap file that has been modified?

I have a sitemap-index.xml with 7 files. After updating one of the 7 with new content should I ping Google with the index file or with the updated file? In my index I also use lastmod so Google can ...
4
votes
1answer
105 views

sitemap.xml : shall I put all my URLs including the ones that have “empty result” for a dataset?

Here's my problem: on my website, you can click on all the regions, and the new web page is the result of the search of the region. Thus the result may be empty. Shall I include all those "empty ...
4
votes
2answers
209 views

sitemap.xml for huge online store

I'm running online store with 30,000+ products (having unique urls) which are updated every day. I want google to index my products faster. Now crawler index ~500 pages/day (reports from google ...
3
votes
2answers
611 views

Can a sitemap index file list sitemaps in a different directory?

If I have a sitemap index, can the sitemaps listed in the index be located in a subdirectory, but have links that isn't specific to the subdirectory? I'm trying to avoid having multiple sitemaps in ...
2
votes
6answers
393 views

Sitemap tool fails to find all URLs in my site

I added my url to Google http://www.google.com/addurl.html I added a meta tag with description and keywords I added it in Google web master tools and submit the site map There is no any robots in my ...
2
votes
1answer
438 views

Can a sitemap index file point to sitemaps in another directory?

I am creating multiple sitemaps for a site, and for the sake of organization I would like to put these sitemaps into their own directory (of course the sitemap.xml file will be in the root site ...
1
vote
1answer
98 views

Logo Image in Image Sitemap

Here is my concern. I have the logo image along with the entire header section of the site in an 'included' file. How do I present that image in the image sitemap? Should I give the URL of the ...
4
votes
3answers
753 views

Sitemap to display hash tag links or not?

I am just creating sitemap for my site and wanted to find out if I should include # links for SEO? For Example: www.mydomain.com/#comment1 www.mydomain.com/#comment2 Does this help with SEO or ...
2
votes
3answers
257 views

Why is Google ignoring my pages after a sitemap submit?

I've submitted a Google sitemap with 12 links in, and Google has accepted the links (2 weeks ago) but it insists on only showing 4 out of the 12 pages in the search results. Even when doing a site: ...
1
vote
2answers
96 views

your fresh content on Google

I have actually pretty simple question. Having new sitemap every week and get it indexed immediately. How can I guarantee that the new fresh content will be indexed immediately by Google without ...
2
votes
1answer
129 views

Site.xml with #!, still ok to have bare URL as home page?

I'm trying to get some ajax content on my main page indexed by google. I've implemented the #! url structure for that content and the corresponding piece on the server which renders what users see ...

1 2