Site Map Question

[everettholman2]

Hello all,

I have been trying to build a site map and get it loaded on my web site. I have used the google site map builder, and followed all instructions exactly. However, Google can still not find my site map.

Can anyone offer any help?

[Melissa]

Does this help at all?
http://www.google.com/support/webmas...&answer=156184 ("Fix a problem with Sitemaps")

Problems submitting Sitemaps

If you're having problems submitting a Sitemap, make sure that the URLs in your Sitemap include the URL of your site exactly as it appears in your Webmaster Tools account. For example, if you have added the site http://www.example.com to Webmaster Tools, don't list URLs in this format: http://example.com/home.html. Instead, use http:///www.example.com/home.html.

Sitemap errors

The Sitemap Details page lists any errors Google found with your Sitemap, as well as warnings about potentially problematic issues. See details about the most common Sitemap errors.

Once you've reviewed your Sitemap and made any changes, save it and then resubmit it. It can take up to a day for Google to process the resubmitted Sitemap, so the warning status may continue to display until then.

[Arthur]

Originally Posted by everettholman2

However, Google can still not find my site map.

Whenever a page or file can't be found, take a look at the error log (/big/dom/xyourdomain/logs_web/error).

Your error log contains amongst others;
[error] [client 66.249.65.140] File does not exist: /big/dom/xyourdomain/www/www/sitemap.xml
(66.249.65.140 is a Google IP address)

That means Google is looking for /www/sitemap.xml, or in other words http://example.com/www/sitemap.xml, instead of http://example.com/sitemap.xml

From the URL Melissa posted;
# In the text box, complete the path to your Sitemap (for example, if your Sitemap is at http://www.example.com/sitemap.xml, type sitemap.xml).

-Arthur

[dansbanners]

Hi,

If you use Wordpress, this might help:

http://www.netprofitstoday.com/blog/...ordpress-blog/

I plan to follow up on it shortly myself.

Does the Google Site Map Generator based on python work here? From the documents I see instructions about altering Apache config file, restarting Apache etc?

We've tried s PHP script but it appears that because of the low memory allocation on FQuest it does not run with all its functions enabled.

[Bob]

The information I located here:

The Google Sitemap Generator is a Python script that creates a Sitemap for your site using the Sitemap Protocol

http://sitemap-generators.googlecode...or.html#config

Appears that it could be installed locally on an account as there is no mention of Apache configuration changes or root access required.

-Bob

Originally Posted by Bob

The information I located here:

http://sitemap-generators.googlecode...or.html#config

Appears that it could be installed locally on an account as there is no mention of Apache configuration changes or root access required.

-Bob

Bob might that be the old Google site map generator?

The one I was referring to is this one:

http://googlesitemapgenerator.google...html#gsg_i_lin

P.S. Just noticed the the page you refer to is dated 2006. The page I am referring to was updated 2009.

P.S. P.S. Here is the information: Google Sitemap Generator takes a fresh approach to Sitemap generation. The previous generation of Sitemap generators created Sitemaps by crawling websites, so they did not necessarily improve on the coverage provided by search engine crawlers. In contrast, Google Sitemap Generator monitors your web server traffic and detects updates to your site whenever a user accesses a new page. The main features of Google Sitemap Generator are:

* Creation of Sitemaps based on web server traffic, web server logs and web server files.
* Efficient generation of Web Sitemaps used by many search engines, and of Google-specific feeds for Mobile, Code Search, and Blog Search.
* Easy configuration. Once you’ve completed the initial configuration, no further administration is needed. But if you do want to tweak the settings, you can use a web-based administration console.
* Easy filtering of URLs, based on URL patterns.
* Automatic calculation of certain metadata, such as modified time and change frequency.
* Automatic submission of Sitemaps for Web search.

[Bob]

I saw that one but as you mentioned Python and I saw no mention of Python on that page I assumed it was the older one...

The one you indicated does not appear that it would be suitable for installation as it does specifically indicate "Web server access. You'll need administrative access to the web server. "

-Bob

Thanks. That's a bummer.

Is it possible to install this free tool on all the servers and allow individual websites to invoke the script?

[Terra]

I have looked over the new Beta version of Google's site map generator, and a few things concern me about it...

1) Adds a new compiled Apache module

2) They provide Apache 1.3 module, but it appears they are heading towards needing Apache 2.x which we do not want to use right now for a myriad of reasons... The biggest reason is that many of the modules we use were written for 1.3 and they have not been updated for 2.x... Both for 3rd party modules and our own internal custom ones... The next major reason is the increased resources that Apache 2.x requires to run in relation to Apache 1.3 for little to no benefit in operational features on a massive scale...

3) The module relies on pthreads, which is an instant segfault with PHP due to how the pthread mutex library works on the older Phoenix class servers... Enigma class is better with pthreads and PHP (it will still intermittently segfault though), and with Genesis class it should be a non-issue... This was the reason why we had to pull the SQLite module out of PHP, as the library it depends on is heavily threaded and caused operational crashes unrelated to the usage of PHP and SQLite itself due to how Zend handles critical section accesses to shared internal data structures which depend on multi access contention locking...

4) The module is written in C++, and it uses an iterator to walk through a mutex protected lookup file during the logging phase... This means that only one Apache child can have access to that mutex at any one time and this could potentially cause a backlog of children to wait its turn to gain access to that resource... Critical resource locking in the logging phase can cause out of order log entries due to the race between when the timestamp is generated and when the lock is obtained allowing another child with a later timestamp to be sent to your logs before a child with an earlier timestamp gets the chance to log its entry... I have been bitten by this in the past and it takes very careful coding to prevent this from happening when dealing with disk I/O...

5) The module itself would have to be modified to prevent site owners from leveraging it to gain access to another site's content as it would execute with Apache's standard credentials within the Apache engine context...

6) The module has another iterator that walks over all defined vhost records (from within your vhost container context), and I'm not sure yet if that could cause security information leaks...

At this point, it is not feasible to be added to the server core and there is no way at the moment for site owners to use this because of the Apache module requirement...

However, Google's sitemap generator is interesting enough that I will put this on the Genesis development track and see if I can work around some of the issues above (pthreads, timestamp race, security)...

(tag:Genesis)