Summary of failing PIM tests

[Christophe Giboudeaux]

Hey,

Here's a short summary of the failing PIM tests on the CI.
Reminder: you can run individual tests with `ctest -R <test name>`

- kidentitymanagement:
  * kpimidentity-signaturetest fails on Windows due to a timeout in 
SignatureTester::testSignatures()

- kcalutils:
  * kcalutils-testincidenceformatter fails because of different colors in the 
control files

  * IncidenceFormatterTest::testErrorTemplate() fails on Windows, because of 
    grantlee.template: "Plugin library 'grantlee_defaulttags' not found."'

- akonadi-search:
  * akonadi-sqlite-schedulertest (akonadi-pgsql-schedulertest also fails 
locally for the same reason):
    SchedulerTest::testInitialIndexing() Compared values are not the same

  * akonadi-mysql-schedulertest (Linux):
    SchedulerTest::testInitialIndexing() Compared values are not the same
    SchedulerTest::testIndexCollections() '(agent.isOnline())' only for the 
MySQL backend

- messagelib (interestingly, I see more failures locally than on the CI):
  * mimetreeparser-basicobjecttreeparsertest:
    ObjectTreeParserTest::testRenderedTree(openpgp-encrypted-no-text-
attachment.mbox) Compared values are not the same

  * messageviewer-messageparttheme-rendertest:
    RenderTest::testRenderSmart(alternative-notext.mbox) Compared values are 
not the same

  * messageviewer-messageparttheme-showonlymimeparttest:
    ShowOnlyMimePartTest::testRelated(only html) Compared values are not the 
same
  
  The HTML warning message seems to be the cause.
  
  * messagecomposer-cryptocomposertest:
    CryptoComposerTest::testEditEncryptAndLateAttachments(OpenPGPMime) 
Compared values are not the same

  * webengineview-riceencodingdecodertest hangs:
    QFATAL : RiceEncodingDecoderTest::shouldDecodeRiceIndices(empty) Requested 
type 'QVector<uint>' does not match available type 'QList<uint>'.

- kimap:
  * testsession (on BSD):
    SessionTest::shouldFailForInvalidHosts() Compared values are not the same

- kmailtransport:
  * akonadi-mysql-messagequeuejobtest, akonadi-sqlite-messagequeuejobtest:
    MessageQueueJobTest::initTestCase() 'mda.isValid()' returned FALSE. ()

- kpimtextedit:
  * kpimtextedit-composerng-richtextcomposertest (timeouts on Windows):
    RichTextComposerTest::testWrappedPlainText(wrap) Compared values are not 
the same

  * kpimtextedit-plaintext-textgotolinewidgettest (Windows):
    TextGoToLineWidgetTest::shouldChangeMaximumValue() 
'QTest::qWaitForWindowExposed(&edit)' returned FALSE. ()

  * kpimtextedit-texttospeech-texttospeechwidgettest (Windows):
    TextToSpeechWidgetTest::shouldHaveDefaultValue() '!stopButton-
>icon().isNull()' returned FALSE. ()

  * kpimtextedit-texttospeech-texttospeechactionstest (Windows):
    TextToSpeechActionsTest::shouldHaveDefaultValue() '!act.stopAction()-
>icon().isNull()' returned FALSE. ()

  * kpimtextedit-composerng-richtextcomposercontrolertest (Windows):
    RichTextComposerControlerTest::shouldAlignCenter() 
'QTest::qWaitForWindowExposed(&composer)' returned FALSE. ()

  * kpimtextedit-widgetslidecontainertest (Windows):
    SlideContainerAutoTest::testHiddenContentResize() 
'QTest::qWaitForWindowExposed(&window)' returned FALSE. ()

- libksieve:
  * sieveeditor-autocreatescripts-sieveeditorgraphicalmodewidgettest:
    SieveEditorGraphicalModeWidgetTest::shouldLoadScripts(test-date) Compared 
values are not the same

  * sieveeditorhelphtmlwidgettest:
    SieveEditorHelpHtmlWidgetTest::shouldHaveDefaultValue() 
'QTest::qWaitForWindowExposed(&w)' returned FALSE. ()

- kmail:
  * akonadi-mysql-kmcommandstest, akonadi-sqlite-kmcommandstest fail (akonadi-
pgsql-kmcommandstest also fails locally):
    KMCommandsTest::testMailtoReply() 'signature' returned FALSE. ()

- kdepim-runtime:
  * testchangeitemtask:
    AddressSanitizer: heap-use-after-free resources/imap/uidnextattribute.cpp:
38 in UidNextAttribute::uidNext() const
    (full log at https://build.kde.org/job/Applications/job/kdepim-runtime/
job/kf5-qt5%20SUSEQt5.12/80/consoleFull)

  * formattest:
    FormatTest::testContact(v2contactSimple) '!
convertedAddressee.custom(QStringLiteral("KOLAB"), 
QStringLiteral("CreationDate")).isEmpty()' returned FALSE. ()
    (repeated a couple times)

  * kcalconversiontest:
    KCalConversionTest::testConversion(with endDate and recurrence duration) 
Compared values are not the same
    KCalConversionTest::testContactConversion(bday) Compared values are not 
the same

  * calendaringtest:
    CalendaringTest::testTimesInInterval(simple) Compared values are not the 
same
    CalendaringTest::testCalendar(startEndTimeInclusive) Compared values are 
not the same
    ASAN also complains

  * kolabobjecttest:
    QSYSTEM: KolabObjectTest::dontCrashWithEmptyIncidence() 
org.kde.pim.pimkolab: passed a null pointer
    KolabObjectTest::dontCrashWithEmptyIncidence() Compared values are not the 
same
    KolabObjectTest::parseRelationMembers() Compared values are not the same

  * timezonetest:
    QDEBUG : TimezoneTest::testKolabObjectWriter() org.kde.pim.pimkolab: 
Guessed timezone and found:  "UTC"
    Error:  0:   Not a valid olson timezone: UTC
    TimezoneTest::testKolabObjectWriter() Compared values are not the same
    TimezoneTest::localTimezone() '!result.timezone().empty()' returned FALSE. 
()
    
  * akonadi-mysql-pop3test:
    org.kde.pim.akonadiserver: QueryBuilder::exec(): database reported 
transaction deadlock, retrying transaction
    QFATAL : Pop3Test::testBigFetch() ASSERT: "mails.size() == items.size()

  * storecompacttest:
    AddressSanitizer: heap-use-after-free resources/shared/filestore/
entitycompactchangeattribute.cpp:74 in 
Akonadi::FileStore::EntityCompactChangeAttribute::remoteRevision() const

  * testsessionpool (BSD):
    TestSessionPool::shouldNotifyFailureToConnect() Compared values are not 
the same

- akonadi:
  * akonadi-mysql-testenvironmenttest, akonadi-sqlite-collectionjobtest:
    AddressSanitizer: SEGV src/server/aggregatedfetchscope.h:91 in 
Akonadi::Server::AggregatedItemFetchScope::d_func()

  The other akonadi failures are timeouts.