TXT File o' Mysteries

For requests for help from CG administrators, Wranglers, and experienced CG members. Please read the FAQ before posting. Also look at CG Wiki for tutorials and how-tos written by other CG webtoonists.
Post Reply
User avatar
PieceOfSkunk
Cartoon Hero
Posts: 1350
Joined: Tue Jan 13, 2004 1:42 pm
Location: DFW TX USA

TXT File o' Mysteries

Post by PieceOfSkunk »

Just out of curiosity, can anyone tell me what this is? It showed up randomly in my webalizer logs and I am intrigued by it.
Top
User avatar
Clawster
Regular Poster
Posts: 58
Joined: Mon Dec 01, 2003 6:24 pm
Location: brisbane. australia
Contact:
Contact Clawster

Post by Clawster »

it's the little file that tells webbots where they can go and where they can't go in your directory structure. search engines like google use these automated programs to search through and list your website on the engine. the file tells them what pages you want listed on the search engine, and what you don't.

that's about it
i am a consumer whore.
i am poor.
i am in denial.
Top
Post Reply

Return to “Help Center”