From: simon@josefsson.org 
  
 Paul Gevers  writes: 
  
 >> If we mark the (apparently) flaky tests with 'flaky', would it still be 
 >> 'Serious'? 
 > 
 > If the test isn't marked as FAILED, it's no longer serious. So yes, 
 > marking a test flaky will lower the severity of this bug report. 
  
 Ok.  Let's see if 1.3.1-8 improves things, it marks tests as flaky that 
 I've witnessed flip-flop on some archs.  I may have missed some, we'll 
 see: I queued a couple of debci runs of it on all archs.  I am hoping 
 that flaky tests won't result in FAILED even on failure, but end up in 
 some other state that is ignored by people who keep debci running. 
  
 I suggest to use this bug report to discuss (and tag) flaky tests in 
 Debian, but reports to FIX the tests to not fail at all in the first 
 place should go upstream.  I am hoping Ludo' has some cycles to look 
 into these reports, or at least push out a new upstream release shortly 
 to see if anything applied since the last release already address this. 
  
 /Simon 
  
 -----BEGIN PGP SIGNATURE----- 
  
 iQNoBAEWCAMQFiEEo8ychwudMQq61M8vUXIrCP5HRaIFAmispZwUHHNpbW9uQGpv 
 c2Vmc3Nvbi5vcmfCHCYAmDMEXJLOtBYJKwYBBAHaRw8BAQdACIcrZIvhrxDBkK9f 
 V+QlTmXxo2naObDuGtw58YaxlOu0JVNpbW9uIEpvc2Vmc3NvbiA8c2ltb25Aam9z 
 ZWZzc29uLm9yZz6IlgQTFggAPgIbAwULCQgHAgYVCAkKCwIEFgIDAQIeAQIXgBYh 
 BLHSvRN1vst4TPT4xNc89jjFPAa+BQJn0XQkBQkNZGbwAAoJENc89jjFPAa+BtIA 
 /iR73CfBurG9y8pASh3cbGOMHpDZfMAtosu6jbpO69GHAP4p7l57d+iVty2VQMsx 
 +3TCSAvZkpr4P/FuTzZ8JZe8BrgzBFySz4EWCSsGAQQB2kcPAQEHQOxTCIOaeXAx 
 I2hIX4HK9bQTpNVei708oNr1Klm8qCGKiPUEGBYIACYCGwIWIQSx0r0Tdb7LeEz0 
 +MTXPPY4xTwGvgUCZ9F0SgUJDWRmSQCBdiAEGRYIAB0WIQSjzJyHC50xCrrUzy9R 
 cisI/kdFogUCXJLPgQAKCRBRcisI/kdFoqdMAQCgH45aseZgIrwKOvUOA9QfsmeE 
 8GZHYNuFHmM9FEQS6AD6A4x5aYvoY6lo98pgtw2HPDhmcCXFItjXCrV4A0GmJA4J 
 ENc89jjFPAa+wUUBAO64fbZek6FPlRK0DrlWsrjCXuLi6PUxyzCAY6lG2nhUAQC6 
 qobB9mkZlZ0qihy1x4JRtflqFcqqT9n7iUZkCDIiDbg4BFySz2oSCisGAQQBl1UB 
 BQEBB0AxlRumDW6nZY7A+VCfek9VpEx6PJmdJyYPt3lNHMd6HAMBCAeIfgQYFggA 
 JgIbDBYhBLHSvRN1vst4TPT4xNc89jjFPAa+BQJn0XTSBQkNZGboAAoJENc89jjF 
 PAa+0M0BAPPRq73kLnHYNDMniVBOzUdi2XeF32idjEWWfjvyIJUOAP4wZ+ALxIeh 
 is3Uw2BzGZE6ttXQ2Q+DeCJO3TPpIqaXDAAKCRBRcisI/kdFolekAP9hHajjiQze 
 KSflooN1SA9vb71JmicTFUXL6PbC+X25NQEAjkwspLdzgBFmrLvHefT/7tfMX81w 
 CRRFNmEvmYcqJwA= 
 =2Z2s 
 -----END PGP SIGNATURE----- 
  
 --- SoupGate-Win32 v1.05 
  * Origin: you cannot sedate... all the things you hate (1:229/2)