Index page does not appear to be spider friendly

[Steven Barkess]

Hi

I have asked elsewhere about the keywords of my section pages not being picked up in search engine spider simulators but have a more specific question now.

Looking at my index page (using http://www.webconfs.com/search-engin...-simulator.php) I have about 800 sections on it (http://www.xxx dj.co.uk/acatalog/index.html, no gap after fidelity!!), however I only get the following spidered links

Spidered Links :
http://www.xxx dj.co.uk
http://www.xxx dj.co.uk/acatalog/New_Releases.html
http://www.xxx dj.co.uk/acatalog/PhatWax_info1.html
http://www.xxx dj.co.uk/cgi-bin/ca000001.pl?ACTION=SHOWCART
http://www.xxx dj.co.uk/cgi-bin/os000001.pl?ACTION=Start

Using http://www.searchengineworld.com/cgi-bin/sim_spider.cgi I only get the following

Link
spider this link keyword analyze this link http://www.xxx dj.co.uk/
spider this link keyword analyze this link http://www.xxx dj.co.uk/acatalog/New_Releases.html
spider this link keyword analyze this link http://www.xxx dj.co.uk/acatalog/PhatWax_info1.html
spider this link keyword analyze this link http://www.xxx dj.co.uk/cgi-bin/ca000001.pl?ACTION=SHOW
CART
spider this link keyword analyze this link http://www.xxxdj.co.uk/cgi-bin/os000001.pl?ACTION=Star

I am pretty happy with my store and have really started to look at optimising the site but I feel that some of the things Actinic should do it fails at (such as the above and the keywords on the sections queried elsewhere).

So, am I missing something obvious here, and has anyone else had a similar xp and how resolved. Whats the index file in the Site1 folder, I may pull out the original and reload it to see if that makes a difference.

As always, thanks for info.

Steven

[pinbrook]

If you do an advanced search in google using this url

http://www.google.co.uk/search?q=+si...r=all&filter=0

you will see that google has indexed 53 of your pages. This is probably a better indicator of how well your pages are being indexed. SimSpiders have their uses but are unreliable with their results.

I noticed though that google hasn't indexed your site map, i suggest you get a link to your sitemap on your index page to help google along abit more

MSN has 115 pages indexed.

[Steven Barkess]

Hi

Thanks for that.

I am confused now. My index.html page is the sitemap page. I have made a link on most of my pages to the sitemap.

Steven

[cdicken]

I think Jo means that the page at 'http://www.fidelity dj.co.uk/' should contain a link somewhere to http://www.fidelity dj.co.uk/acatalog/sitemap.html

[Steven Barkess]

Jo, Chris

Many thanks for that. I think my words were 'fun that, i did not know that page existed!!'.

I have always assumed that since all my sections were on the index.html page that it was this that was to be spidered. I have repointed all to sitemap and check with the sims and they are reading it beautifully.

Thanks again

Steven