TZUTC: -0500   
   MSGID: 54363.sync@1:103/705 2cc3bc3b   
   REPLY: 54360.sync@1:103/705 2cc2d743   
   PID: Synchronet 3.19b-Win32 master/a2a9dc027 Jan  2 2022 MSC 1928   
   TID: SBBSecho 3.28-Linux master/a43ca30ea Jun 18 2025 GCC 12.2.0   
   BBSID: BBSESINF   
   CHRS: CP437 2   
   FORMAT: flowed   
   NOTE: SlyEdit 1.73 (2020-03-31) (ICE style)   
     Re: Web server and BOT's   
     By: nelgin to Richard Vonzel on Wed Jun 25 2025 11:26 pm   
      
    >> guess a BOT got on my site and jst downloaded all the file I had   
    >> available. Here's the log entry for this,   
      
    ne> I have found gptbot ignores a global disallow rule in robots.txt   
      
    ne> User-agent: *   
    ne> Disallow: /   
      
    ne> But you could try adding   
      
      
   dude where have you been? most of those bots ignore robots.txt   
      
   google bot, archive.org's bots, all of them.  there's no law that they   
   have to obey robots.txt   
   ---   
    þ Synchronet þ ::: BBSES.info - free BBS services :::   
    * Origin: Vertrauen - [vert/cvs/bbs].synchro.net (1:103/705)   
   SEEN-BY: 1/19 16/0 19/37 40 103/705 105/81 106/201 123/130 128/187   
   SEEN-BY: 129/14 142/104 153/7715 154/10 110 203/0 218/700 221/1 6   
   SEEN-BY: 221/242 226/30 227/114 229/110 114 206 317 400 426 428 470   
   SEEN-BY: 229/550 700 705 240/1120 5832 266/512 280/464 5003 291/111   
   SEEN-BY: 301/1 113 320/119 219 319 2119 322/757 762 326/101 341/66   
   SEEN-BY: 342/200 396/45 423/81 460/58 633/280 712/848 902/26 5020/1042   
   SEEN-BY: 5075/35   
   PATH: 103/705 301/1 221/1 320/219 229/426