robots.txt Discovery News, Software Apr 032009 Made an interesting discovery post on the BBS: Robots.txt (what not to do).