Blue Reef Technical Support Blue Reef Virtual Server Reseller ProgramInstallation instructions, manuals, how-tos, and more!About Blue Reef Consulting, Inc.

About Blue Reef Virtual ServersEcommerce Solutions for your Virtual ServerSearch the Blue Reef Virtual Server web site		 Return to Blue Reef Virtual Servers Home Page
Order virtual servers, software, computers, and more!
Return to Blue Reef Main Home Page
Specials
Site Map
Support Solutions to help you do business with your Virtual Server.



Blue Reef Virtual Servers
Virtual Server Support
Support Archive Menu
Support Archive Overview
Changing Administrative Passwords
Anonymous FTP
Frequency of the Server backup
Clearing the Email Queue
DNS Server Information
Changing FTP Directories
Internet Relay Chat
Configuring Manual Pages
Robots.txt File
Monitoring Server Space Limits
Blocking Spam
Using the #include SSI Includes
Creating Symbolic Links
Changing the Time Zone of your Server
Unzipping Dos files in Unix
Lising Users on the Server
Frequent Questions
White Papers
Virtual Server Handbook
Request help using our Problem Tracking System
Order a Blue Reef Virtual Server now!


What is the robots.txt file?

You may have noticed that a special file "robots.txt" is often requested and not found by visitors to your web site. These "visitors" are actually search engine spiders that are indexing your site. Spiders will look for a special file "robots.txt" that contains special instructions such as what not to index, etc. More information about Web Robots and the "robots.txt" file can be found at the following URL at WebCrawler.

SEE ALSO:

About Server Log Reporting

Frequently Asked Questions

Featured Solutions

Administrator Handbook

Whitepapers

Recommended Books

Request help from Technical Support

BOOKS TO HELP YOU:

Apache Server : Administrators Handbook
Apache Server:
Administrators Handbook
$23.99

Unix Power Tools Unix Power Tools
$47.96


Amazon.com logo
Search for :
Enter keywords...






[ SERVERS | ECOMMERCE | SUPPORT | SPECIALS | SEARCH | SITE MAP | ORDER]
[ HOME | CONTACT US | ABOUT US | PRIVACY | LEGAL | REFUND POLICY ]
© Copyright 1998 - 2001 Blue Reef Consulting, Inc. All Rights Reserved.
Comments or questions about this web site? Write to webmaster@bluereef.net. Phone: (305) 274-8393