14 Jun 15 06:41, you wrote to Nicholas Boel:   
      
    NB>> Does HPT default to dupechecking by MsgID and some kind of hash check?   
    NB>> I don't have anything specific specified, so it's using the default   
    NB>> (which I thought was MsgIDwithHashCheck or something in those lines -   
    NB>> I didn't look it up so I'm probably on the right track but it's   
    NB>> probably the wrong config option). Then in my area definitions, I use:   
      
    NB>> -dupecheck move -dupehistory 365 -tooold 365 -sbkeepall   
      
    TK> It is almost the same here, only "-TooOld 365" missing from my conf.   
      
   i don't use -tooold but i do have dupehistory set to 1100 to cover a full   
   three years of dupes as per the FTS specs...   
      
                           "[...] The serial number may be any eight   
        character hexadecimal number,  as long as it is unique - no two   
        messages from a given system may have the same serial number   
        within a three years. [...]"   
      
   365.25 * 3 = 1,095.75 so i pick up an extra 4.25 days :shrug: ;)   
      
    TK> "EchoAreaDefaults -SBkeepAll -dupeCheck move -dupeHistory 31 -b JAM"   
      
   i also keep three years of messages just because i can... here's the defaults   
   line for one of my feed's...   
      
   areafixAutoCreateDefaults -d "Automatically added area" -b jam -a 1:3634/12.73   
   -g Z -p 1100 -dupeCheck move -dupeHistory 1100 -sbkeepall   
      
    NB>> Is there something I may be missing?   
      
    TK> I'm not that famimiar with hpt, so I don't know about its dupe detection   
    TK> mechanism.   
      
   i found this in some old docs...   
      
   [quote]   
   DupeBaseType   
      
   Syntax:   
       dupeBaseType    
   Example:   
       dupeBaseType HashDupesWMsgId   
      
   TextDupes   
       stores from, to, subj & msgid as text lines.   
   HashDupes   
       stores src32 of from + to + subj + msgid.   
   HashDupesWMsgId   
       same as HashDupes, but stores also msgid as text.   
   CommonDupeBase   
       stores hashes of from + to + subj + areatag + msgid in one file   
   (hpt_base.dpa)   
      
   Default is HashDupesWMsgId.   
      
   This statement cannot be repeated.   
   [/quote]   
      
   which seems accurate when looking at this from huskylib/fidoconf/fidoconf.h   
      
   [quote]   
   typedef enum typeDupeCheck {   
                       hashDupes, /*Base bild from crc32*/   
                 hashDupesWmsgid, /*Base bild from crc32+MSGID*/   
                       textDupes, /*Base bild from FromName+ToName+Subj+MSGID*/   
                  commonDupeBase  /*Common base for all areas bild from crc32*/   
   } e_typeDupeCheck;   
   [/quote]   
      
   one improvement i can see would possibly be to also use the timestamp in the   
   calculations... especially for those systems that don't put MSGID but do use   
   complete time stamps including the seconds... but even that may not be good   
   enough since some can post numerous messages in one second...   
      
   i'm trying to remember the other ways that dupe detection is done... this one   
   is "good enough" but there are others... one takes the entire message header   
   plus the following 40 bytes, IIRC... that way it gets most all of the control   
   lines as well as possibly some of the message body text... another strips the   
   message body of CR and LF and i think white space and does a crc on that to be   
   used along with the crc on the header... the message body stops at the tear   
   line (not inclusive) if one exists or the origin line if there is no tear   
   line... for netmails, the message body stops at the tear line (not inclusive),   
   or the origin line if one exists or the first path control line... it has been   
   a while and i can't find all of my notes... i've dug this out of some old   
   source code, though...   
      
   )\/(ark   
      
   ... That darned Tom, this is ALL his fault for inventing this beast anyhow.   
   ---   
    * Origin:  (1:3634/12.73)