Home About Contact
Spanish Real Estate forum - Spanish property - Estate agents


Google talk The search engine, adwords and adsense...

Reply
Old 04-17-2008, 06:49 PM   #1 (permalink)
Rating: 0% (0)
Super Moderator
 
Homefinder's Avatar
 
Join Date: Apr 2007
Location: Moraira
Posts: 915
Blog Entries: 3
Default Stopping the Robot

Nobody really knows but I am trying to make a decision and opinions will help.
The problem is a real estate site that has the normal search button. However, the result of the click is a listing but there is another search button at the top of the listing page as well as links to the full description but they all have a search button as well.
FIRST QUESTION: My belief is that this is a no-go for most robots because their job is to follow links and, in this case, they would get into a virtual loop. Is this the case or does the robot stop after so many iterations, pull back out and start over?
SECOND QUESTION: On this particular site the link created by the code under the search button contains a long, long string of parameters with one "?" and is .php. Is that bad for robots?
THIRD QUESTION: Let us assume that we don't want any of these pages indexed anyway because they are not good to optimise and we have lots of static pages that are much better. How do we keep the robot out -
The robots.txt will obviously do this in a positive manner.
... but would a "noindex,nofollow" tag in the header keep the robot out of the whole page?
... or would a "nofollow" tag in the search button code prevent the robot from following the link.
Important to bear in mind that the reason for all this is to have a relatively small number of pages which can be perfectly optimised as opposed to literally 1,000's that are out of control.
Additionally, the Google Webmaster "comment" was that -
a) There were 100's of indexed pages with duplicated title and description tags in the header - the pages produced by the search code.
b) There were many pages with the 404 Error: File not found - where the property was deleted from the database.
Can anyone help with this?

Homefinder
Homefinder is offline   Reply With Quote
Old 04-17-2008, 06:58 PM   #2 (permalink)
Rating: 0% (0)
Retired ...
 
Richie's Avatar
 
Join Date: Apr 2007
Location: Costa Blanca south
Posts: 676
Blog Entries: 4
Send a message via Skype™ to Richie
Default

What search facility are you talking about homefinder and maybe I can see for myself?

You have lost me a little but I know what you are talking about with the search.php? in the url because I have had the same problem but we changed the search engine to stop this. There was too many and it was rewritten.
Richie is offline   Reply With Quote
Old 04-17-2008, 07:20 PM   #3 (permalink)
Rating: 0% (0)
Super Moderator
 
Homefinder's Avatar
 
Join Date: Apr 2007
Location: Moraira
Posts: 915
Blog Entries: 3
Default

Blimey - that was quick!
I don't think that I should mention which site I am referring to but I'll PM you about it.
However, it is not the property search facility on this Forum. Nevertheless, I did just have a look and there is a "?" in the link generated by the .php code.
I think that the site in question is not that important anyawy. It is just that I am trying to find out how to stop index and follow generally.

Homefinder
Homefinder is offline   Reply With Quote
Old 04-17-2008, 07:22 PM   #4 (permalink)
Rating: 0% (0)
Retired ...
 
Richie's Avatar
 
Join Date: Apr 2007
Location: Costa Blanca south
Posts: 676
Blog Entries: 4
Send a message via Skype™ to Richie
Default

What you can do in the url is to stop it at the .php? in the robot text file so you can keep the search.php page.

But I wouldn't bother, I have found links (not in google) that have got past the .php? and the forum used to be like that before we got vbseo installed on the forum and that didn't stop it being crawled.

But it is hard to see without looking myself.

Last edited by Richie; 04-17-2008 at 07:27 PM. Reason: missed out robot text file!
Richie is offline   Reply With Quote
Reply

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are On
Pingbacks are On
Refbacks are On


All times are GMT +2. The time now is 08:54 AM.
Powered by vBulletin® Version 3.7.3
Copyright ©2000 - 2009, Jelsoft Enterprises Ltd.
SEO by vBSEO 3.2.0
Skin purchased from CompletevB
Inactive Reminders By Icora Web Design

Copyright 2008 © Spanish Real Estate Forum

Our / partners websites:



Forum Navigation
Spanish property for sale

Accreditation of International Real Estate Professionals


Costa Blanca forum

Alphashare - Real Estate management software

Free Spanish agent advertising for 1 year!


Forum Staff
Colin S
- Hamiltons of London

Homefinder
- Villaservers

andypropertyswapshop
- Property Swap Shop

gregor
- 123 Businesses for sale

top-tour-of-spain
- Top Tour of Spain

Girasol Homes
- Girasol Homes

wood1e
- En Casa Baleares
Areas in Spain
Partner Websites
English speaking jobs in Spain