Web SEO Analytics: Check your domain's Age, Alexa Rank, Robots.txt & whois records by using Domain Info Tool: http://bit.ly/4iDqHf #seo #web #tools #webseo
Alexandre C. Barbosa: RT @mgalves: O robots.txt do last.fm tem as 3 regras da robótica: http://bit.ly/9JL8gFWeb SEO Analytics: Get the status of your domain,including AlexaRank,Age,indexation in DMOZ & Archive.org,robots.txt&WHOIS records. http://bit.ly/4iDqHf #seo
fff: / Disallow: /harming/humans Disallow: /ignoring/human/orders Disallow: /harm/to/self RT @codinghorror http://www.last.fm/robots.txt
Miroslav Rigler: Last.fm pridalo tri zakony robotiky od Asimova do suboru robots.txt http://bit.ly/dbO8Sl Skyphire tam ma ASCII (cont) http://tl.gd/2qlaja
John Foliot: @johnallsopp @cssquirrel na, that's easy - apply the 3 laws of robotics http://www.last.fm/robots.txt - Asimov FTW
synopsi: Last.fm pridalo tri zakony robotiky od Asimova do suboru robots.txt http://bit.ly/dbO8Sl Skyphire tam ma ASCII art http://bit.ly/dyzSuk
Bryce Ewing: RT @wombleton: haha, they're right, THIS is how you write a robots.txt: http://j.mp/bVgUuL
Lisandro Pérez Meyer: RT @mricon RT @quaid A little 'robots.txt' humor from @LastFM : http://www.last.fm/robots.txt
Rowan Crawford: haha, they're right, THIS is how you write a robots.txt: http://j.mp/bVgUuL
Kimberly Castleberry: @denharsh theres no robots.txt on the new install yet, naa no stress, if it doesnt pick up in a couple days ill need a hand though
socketwench: RT @OwlofDoom: Ahahahaha last.fm's robots.txt (via BoingBoing): http://www.last.fm/robots.txt
zwitscherelfe: RT @sixtus: Was muss man eigentlich in die robots.txt schreiben, damit die Googlebots einem den Nacken crawlen?
beining: @radio_nova “@LarsLaad: RT @astronewth: RT @rgangstad: Humrer litt over http://www.last.fm/robots.txt :) #nerdesommer”
Bendik Heiberg: RT @LarsLaad: RT @astronewth: RT @rgangstad: Humrer litt over http://www.last.fm/robots.txt :) #nerdesommer
shellshark: RT @sixtus: Was muss man eigentlich in die robots.txt schreiben, damit die Googlebots einem den Nacken crawlen?
Miroslav Milov: http://www.last.fm/robots.txt - remind them, just in case (hint - last three rules)
Hugo Morales: @Kangrejo Alguna vez viste el robots.txt de google que era contra la invasión zombie?
kashicat: @marirandomities You don't have to tweak that code, especially if it's got the robots.txt in there somewhere.kashicat: @marirandomities Some blog templates come "SEO-ready" and have the robots.txt included. You have to search blog template's code. #bookmarket
Mari: Cool! RT @angelaperry: A robots.txt file tells the search engines that they can index your site or not http://www.robotstxt.org/ #bookmarket
#BookMarket: @marirandomities robots.txt is a small bit of code that helps the Google robots work on your site. You can Google the code #bookmarket
Angela Perry: @marirandomities A robots.txt file tells the search engines that they can index your site or not. http://www.robotstxt.org/ #bookmarketMari: What the heck is that? lol RT @angelaperry: be sure you have a robots.txt file in your main directory that allows search engines #bookmarket#BookMarket: RT @angelaperry: Also, be sure you have a robots.txt file in your main directory that allows search engines. #bookmarket
Paul Freeman: RT @OwlofDoom Ahahahaha last.fm's robots.txt (via BoingBoing): http://www.last.fm/robots.txt
Håkon Dreyer: RT @rgangstad: Humrer litt over http://www.last.fm/robots.txt :) #nerdesommer
Andrew Hickey: RT @OwlofDoom: Ahahahaha last.fm's robots.txt (via BoingBoing): http://www.last.fm/robots.txt
Magne K. Davidsen: RT @rgangstad: Humrer litt over http://www.last.fm/robots.txt :) #nerdesommer
Jostein Emmerhoff: RT @rgangstad: Humrer litt over http://www.last.fm/robots.txt :) #nerdesommer
Rich Daley: Ahahahaha last.fm's robots.txt (via BoingBoing): http://www.last.fm/robots.txt
Lars Laading: RT @astronewth: RT @rgangstad: Humrer litt over http://www.last.fm/robots.txt :) #nerdesommer
Morten Teinum: RT @rgangstad: Humrer litt over http://www.last.fm/robots.txt :) #nerdesommer
Helge Bernhardsen: RT @rgangstad: Humrer litt over http://www.last.fm/robots.txt :) #nerdesommer
Terje Karlsen: RT @rgangstad: Humrer litt over http://www.last.fm/robots.txt :) #nerdesommer
Luc Ronco: RT @aysoon: si vous l'aviez raté hier soir : L'un des robots.txt les plus originaux → http://ays.li/18g
Stephen Nielson: RT @shahidhussain: Just in case the internet gets out of control, some instructions from @lastfm http://www.last.fm/robots.txt (via @macros)
Aymeric Augustin: RT @srstrong: RT @nickhalstead Best robots.txt ever: http://www.last.fm/robots.txt (via @edavis10) #brilliant #geeky
James Conroy-Finn: RT @zee: Quite possibly the best Robots.txt file ever. http://tnw.to/16bnV
Heili: RT @sixtus: Was muss man eigentlich in die robots.txt schreiben, damit die Googlebots einem den Nacken crawlen?
Scott Petersen: RT @mezzoblue: RT @nickhalstead: Best robots.txt ever: http://www.last.fm/robots.txt (via @jimpick)
m_ttz: RT @sixtus: Was muss man eigentlich in die robots.txt schreiben, damit die Googlebots einem den Nacken crawlen?
tajti ákos: RT @mezzoblue: RT @nickhalstead: Best robots.txt ever: http://www.last.fm/robots.txt (via @jimpick)
Erdélyi Tamás: RT @mezzoblue: RT @nickhalstead: Best robots.txt ever: http://www.last.fm/robots.txt (via @jimpick)
Jeremy Heath: RT @mezzoblue: RT @nickhalstead: Best robots.txt ever: http://www.last.fm/robots.txt (via @jimpick)
Marc Drummond: RT @mezzoblue: RT @nickhalstead: Best robots.txt ever: http://www.last.fm/robots.txt (via @jimpick)
Kevin Steffan: RT @sixtus: Was muss man eigentlich in die robots.txt schreiben, damit die Googlebots einem den Nacken crawlen?
Shahid Hussain: Just in case the internet gets out of control, some instructions from @lastfm http://www.last.fm/robots.txt (via @macros)
Peter O'Shaughnessy: RT @StevenWalling: Those Last.fm folks have a sense of humor (check the last three lines). http://www.last.fm/robots.txt
NiallKennedy: RT @juux: Isaac Asimov would be proud of last.fm's robots.txt file http://www.last.fm/robots.txt (via @bmcharg)
Nicola Heck: RT @sixtus Was muss man eigentlich in die robots.txt schreiben, damit die Googlebots einem den Nacken crawlen?
osiridian: Robots.txt Retrieval Exclusion.
We're sorry, access to http://washingtonpost.com/ has been blocked by the site owner via robots.txt.
Thorsten Gieseler: RT @sixtus: Was muss man eigentlich in die robots.txt schreiben, damit die Googlebots einem den Nacken crawlen?
Amy Young: Love that the three laws are there. :) RT @azurelunatic: Via @jamoche: http://bit.ly/dh9B1e
ronanmccoy: Does something seem strange about Last.fm's #robot.txt file? http://www.last.fm/robots.txt
Brett Cooper: RT @brianhoch: Best robots.txt ever: http://www.last.fm/robots.txt (via @josephwilk)
Simon Schwarz: RT @sixtus: Was muss man eigentlich in die robots.txt schreiben, damit die Googlebots einem den Nacken crawlen?
Mikkel Troest: #Asimov ftw RT @Cumbayah RT @batmule_dk: Much geeklove here: http://www.last.fm/robots.txt
kaktuskuchen: RT @sixtus: Was muss man eigentlich in die robots.txt schreiben, damit die Googlebots einem den Nacken crawlen?
Sebastian B.: RT @sixtus: Was muss man eigentlich in die robots.txt schreiben, damit die Googlebots einem den Nacken crawlen?
Simon Petrik Schmitt: RT @sixtus: Was muss man eigentlich in die robots.txt schreiben, damit die Googlebots einem den Nacken crawlen?
Viola bicolor: RT @sixtus: Was muss man eigentlich in die robots.txt schreiben, damit die Googlebots einem den Nacken crawlen?
Richard Brown Photog: Quite possibly the best Robots.txt file ever : http://digg.com/d31YDQM
Felix: RT @sixtus: Was muss man eigentlich in die robots.txt schreiben, damit die Googlebots einem den Nacken crawlen?
Basti: RT: @sixtus Was muss man eigentlich in die robots.txt schreiben, damit die Googlebots einem den Nacken crawlen?
Roberto: The three laws of robots.txt
Disallow: /harming/humans
Disallow: /ignoring/human/orders
Disallow: /harm/to/self
Déréférencement: Vive robots.txt : Encoure une bonne blague sur last.fm => http://short.ie/55cnx4 = http://short.ie/h887uf (merci @Renardudezert)
Johannes G.: RT @sixtus: Was muss man eigentlich in die robots.txt schreiben, damit die Googlebots einem den Nacken crawlen?
Nicklas Jarnesjö: RT @Antaru_: http://bit.ly/cXnMMs Gillar deras Asimov-referens på slutet ^^
Michel Salim: RT @mezzoblue: RT @nickhalstead: Best robots.txt ever: http://www.last.fm/robots.txt (via @jimpick)
Twipsy von FK-tv: RT @sixtus: Was muss man eigentlich in die robots.txt schreiben, damit die Googlebots einem den Nacken crawlen?
Christopher Chandler: RT @LaMenta3: Clever? Or an insurance policy? http://www.last.fm/robots.txt
Domi: RT @sixtus: Was muss man eigentlich in die robots.txt schreiben, damit die Googlebots einem den Nacken crawlen?
