[Rails] robots.txt best practices

[softwareengineer 99]

      Hello Kevin,
      
      Thank you for your reply.
      
      Here is a mini tutorial I created on how to install/configure mod_security for Apache:
      
      http://frankmash.blogspot.com/2005_12_09_frankmash_archive.html
      
      Here I have posted my current useragents.conf files and a sample of   how to ban using .htaccess/mod_rewrite, as well as links to a great  three -part discussion on WebmasterWorld.
      http://frankmash.blogspot.com/2006/02/banning-abusing-bots-using-modrewrite.html
      
      And finally, I also posted a current copy of my blacklist.conf file for mod_security
      http://network-security-blacklists.blogspot.com/2006/02/my-etcmodsecurityblacklistconf.html
      
      Please feel free to ask any question you may have regarding this.
      
      Hope this helps.
      
      Frank
      
    
    Kevin Skoglund <kevin at pixelandpress.com> wrote:Please do post (or send just to me) your mod_rewrite banned user  
    agents.  That would be very helpful.
    
    Thanks,
    Kevin
		
---------------------------------
 Yahoo! Mail
 Use Photomail to share photos without annoying attachments.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://wrath.rubyonrails.org/pipermail/rails/attachments/20060210/2abe57c9/attachment.html