Go Back   Webmaster Forums - DN Lodge > Revenue & Traffic > Search Engine Optimization
Reload this Page Prevent spider grabbing URLs....

Reply
 
LinkBack Thread Tools Display Modes
  #1  
Old 05-06-08, 06:32 AM
DNL Newbie
  
Join Date: Feb 2008
Posts: 6
DNL Trust: (0)
tygh44 is a pretty decent person
Smile Prevent spider grabbing URLs....
Is there any way to prevent a spider from grabbing URLs that you want to keep off search engines?

thanks......
_________________
 indoor fountain florida refinance
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
Want to remove these ads? Register for your free account here.

  #2  
Old 05-06-08, 07:14 AM
DNL Member
  
Join Date: May 2008
Posts: 10
DNL Trust: (0)
spain is a pretty decent person
Default Re: Prevent spider grabbing URLs....
you may want to read this
LINK
__________________
Real estate France, Thailand, Dubai and property Cyprus are just one of the must haves.
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
  #3  
Old 05-07-08, 08:37 AM
bermuda's Avatar
DNL Enthusiast
  
Join Date: Aug 2006
Posts: 283
DNL Trust: (0)
bermuda is a pretty decent person
Default Re: Prevent spider grabbing URLs....
The robots.txt file is still recommended to be used by the webmasters, you may check out the section at your Google webmasters panel for having a better idea of keeping some web pages off getting indexed.
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
Reply

Tags
grabbing, prevent, spider, urls

« 11 Essential Tips to Writing the Ultimate Tutorial | Website Design , Professional Web Development and SEO. »

Currently Active Users Viewing This Thread: 1 (0 members and 1 guests)
 
Thread Tools
Display Modes
Linear Mode Linear Mode

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts
BB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are On
Pingbacks are On
Refbacks are On

Similar Threads
Thread Thread Starter Forum Replies Last Post
:::ADD URLs AND GET SPONSORED FOR FREE:::, Submit your Url at CyberWays forumhelp Site Advertising 2 01-14-08 11:13 AM
Keywords In Urls / Directories, Keyword Prominance & URLs / Directories Sabres Search Engine Optimization 0 11-17-06 05:08 AM


All times are GMT -5. The time now is 12:48 PM.



Copyright © 2005-2009 DNLodge.com.
vBulletin, © 2000-2009, Jelsoft Enterprises Limited.
SEO by vBSEO.
About Us |  Contact Us |  RSS |  Privacy Policy  |  Back to Top