Secure Pages Being Indexed By Google ???

[Big Game Hunter]

Greetings

We seem to be having a problem with our secure site: www.gardengamesltd.co.uk . It seems that google is indexing secure pages that should only be seen when a customer is logged on. TFor instance as manufacturers we have different prices for different customers, now people searching on the web are picking up these indexed pages and you can imagine the nightmare it's causing. How is this possible ? Anyone have any ideas how this is happening ?

Cheers
Shannon

[Donald Gray]

Search engine bots crawl the web looking at an indexing the pages it finds. Obviously the Google bot has visited your site and indexed all pages.

I am not sure how of if it is possible to 'un-index' pages at Google but I believe that it is possible to stop certain pages from being indexed in the first place.

Do a search (dare I mention Google) for ROBOTS.TXT

That is a text file that you can put into the root directory of the website and it tells the search bots which pages it can or cannot index...

As a starting point, try:
http://www.robotstxt.org/wc/norobots.html

There are several software programmes out there that can generate/automate the creation of a robots.txt file

[Big Game Hunter]

Hi Donald

I appreciate the reply here. I understand what you saying.
But doesn't this def what actinic is supposed to do? Surely dynamically generated pages that are created by actinic in secure areas are locked by actinic ? Otherwise everyones secure login areas are going to be indexed and price wars will happen as in our situation ?

Cheers
Shannon

[Duncan Rounding]

Three things I think:
1. I had a look in G at site:www.. for your site and didn't see any pages with prices.
2. As said above a robot.txt file would be a good idea.
3. Most importantly - Remove your sitemap.

[RuralWeb]

Post a link to a page that is indexed

[Big Game Hunter]

the page

here's an example page: http://www.gardengamesltd.co.uk/acat..._Draughts.html

if we run site: www.gardengamesltd.co.uk in google it brings up the cached pages.

This just doesn' make sense, isn't actinic supposed to block secure pages automatically from being indexed by google?

Thanks for the input so far.. It looks ike i'm going to have to put spider blocks in the pages.

[RuralWeb]

isn't actinic supposed to block secure pages

I may be a bit thick here but I dont see why google should consider this page as being secure eg its not hosted on a secure server

[Big Game Hunter]

Hi Malcom

That's the thing, if you have a scratch around on the website, there is no physical way of seeing that exact page with pricing on. You need to log in to see prices, where actinic dinamically generates session ID's.. Unless google has logged in, i can't see how it's managed to get these pages? This page is a static html page with prices, the prices shouldn't be there. It should have a session ID but it doesn't? If i have a look at the exact file on the server it doesn't display those prices. Hopefully this gives a little more insight into what's actually happening.

Cheers
Shannon

[wjcampbe]

there is no physical way of seeing that exact page with pricing on

Sorry, that's not true.

If i have a look at the exact file on the server it doesn't display those prices.

This is also not true.

If you look at the html filenames with the correct /acatalog/ path you will see the prices. You can use a robots.txt to stop your entire site being indexed. The command you need is noindex - not nofollow.

If you want your homepage indexed, but not your inner content, you will first need to add enough content to the home page to make it worth indexing, and then use the noindex command on the acatalog folder in your robots text file.