Subject: Re: Usenet feed? - no web access   
   @VIA: REALITY   
   @MSGID: <513B8346.1214.dove.dove-int@realitycheckbbs.org>   
   @REPLY: <5139C9FE.1225.dove-int@bismaninfo.hopto.org>   
   @TZ: 41e0   
     Re: Re: Usenet feed? - no web access   
     By: Khelair to Dreamer on Fri Mar 08 2013 05:22 am   
      
   Kh>     OMG.  I'm really sorry, but I haven't had enough coffee yet this   
   Kh> morning and it's impossible for me to bite my tongue when I'm like this.  I   
   Kh> can totally understand Fidonet's Zone 2 wanting it to be no web-based   
   Kh> access of any kind.    
      
   It's been a problem for semi-closed othernets that find their message boards   
   spidered by search engines. Web searches have been a boon for finding   
   information to fix my BBS, although ironically the information I'm looking for   
   is almost always already in my message bases (just difficult to search).   
      
   I found that without a proper robots.txt and limiting access to my guest   
   account that google was able to spider my message bases. Luckily, they seem to   
   fall off after a while if they're unavailable.   
      
   ---   
    þ Synchronet þ realitycheckBBS -- http://realitycheckBBS.org   
    * Origin: Time Warp of the Future BBS - Home of League 10 (1:340/400)