[Halloween] Google is scared of Zombies
Posted on | November 1, 2008 |
Google, the most popular search engine has huge computing resources available at its disposal. Google’s bots and spiders crawl the farthest reaches of interweb in search of more and more content to munch on — but when it comes to zombies eating their brains, they don’t want to take any chance. Google.com’s robots.txt directive currently doesn’t allow zombies to access its /brains.
Robots.txt file is normally uploaded to the document root directory of websites. These files contain instructions for automated robots that specify directory access permissions, crawl delay, sitemap locations among others. Google’s robots.txt file is probably the second largest robots file i’ve seen.
Happy Halloween!
[via cnet]
Comments
Leave a Reply
About Xinh
Xinh was started in 2006 as a small community of like minded people. The Xinh website helps you keep uptodate with new developments in technology, internet and free/open source software world... continue reading.