[Kde-pim] Unittest policy?

[Torgny Nyblom]

Hi,

I decided to run the entire kdepimlibs test suite...

This resulted in that after >20 hours I terminated the suite (almost all time 
spent waiting for akonadi tests to timeout) .

I'm wondering if there is a policy about tests in kdepim[libs]?
Or if there isn't should there be?

After my test run I think that any tests should always pass and any commit 
that introduces a failure is a bad commit. Further if a test requires any 
special setup it is that tests responsibility to ensure that this setup is in 
place (in my case the akonadi db tests).

$ time make test
Running tests...
Start processing tests
Test project /home/naga/kde/build/trunk/KDE/kdepimlibs
 15/684 Testing kblog-testwordpressbuggy      ***Failed 

 79/684 Testing RecurNext-KOrganizer_Test01.ic***Failed 
 80/684 Testing RecurNext-KOrganizer_Test02.ic***Failed 
 81/684 Testing RecurNext-KOrganizer_Test03.ic***Failed 
 82/684 Testing RecurNext-KOrganizer_Test04.ic***Failed 
 83/684 Testing RecurNext-KOrganizer_Test05.ic***Failed 
 84/684 Testing RecurNext-KOrganizer_Test06.ic***Failed 
 85/684 Testing RecurNext-KOrganizer_Test07.ic***Failed 
 86/684 Testing RecurNext-KOrganizer_Test08.ic***Failed 
 87/684 Testing RecurNext-KOrganizer_Test09.ic***Failed 
 88/684 Testing RecurNext-KOrganizer_Test10.ic***Failed 
 89/684 Testing RecurNext-KOrganizer_Test11.ic***Failed 
 90/684 Testing RecurNext-KOrganizer_Test12.ic***Failed 
 91/684 Testing RecurNext-KOrganizer_Test13.ic***Failed 

223/684 Testing RecurPrev-KOrganizer_Test01.ic***Failed 
224/684 Testing RecurPrev-KOrganizer_Test02.ic***Failed 
225/684 Testing RecurPrev-KOrganizer_Test03.ic***Failed 
226/684 Testing RecurPrev-KOrganizer_Test04.ic***Failed 
227/684 Testing RecurPrev-KOrganizer_Test05.ic***Failed 
228/684 Testing RecurPrev-KOrganizer_Test06.ic***Failed 
229/684 Testing RecurPrev-KOrganizer_Test07.ic***Failed 
230/684 Testing RecurPrev-KOrganizer_Test08.ic***Failed 
231/684 Testing RecurPrev-KOrganizer_Test09.ic***Failed 
232/684 Testing RecurPrev-KOrganizer_Test10.ic***Failed 
233/684 Testing RecurPrev-KOrganizer_Test11.ic***Failed 
234/684 Testing RecurPrev-KOrganizer_Test12.ic***Failed 
235/684 Testing RecurPrev-KOrganizer_Test13.ic***Failed 

512/684 Testing akonadi-mimetypecheckertest   ***Failed 

518/684 Testing akonadi-mysql-db-testenvironme2424***Timeout
519/684 Testing akonadi-mysql-fs-testenvironme***Timeout
520/684 Testing akonadi-mysql-db-autoincrement***Timeout
521/684 Testing akonadi-mysql-fs-autoincrement***Timeout
522/684 Testing akonadi-mysql-db-attributefact***Timeout
523/684 Testing akonadi-mysql-fs-attributefact***Timeout
524/684 Testing akonadi-mysql-db-collectionjob***Timeout
525/684 Testing akonadi-mysql-fs-collectionjob***Timeout
526/684 Testing akonadi-mysql-db-collectionpat***Timeout
527/684 Testing akonadi-mysql-fs-collectionpat***Timeout
528/684 Testing akonadi-mysql-db-collectionatt***Timeout
529/684 Testing akonadi-mysql-fs-collectionatt***Timeout
530/684 Testing akonadi-mysql-db-itemfetchtest***Timeout
531/684 Testing akonadi-mysql-fs-itemfetchtest***Timeout
532/684 Testing akonadi-mysql-db-itemappendtes***Timeout
533/684 Testing akonadi-mysql-fs-itemappendtes***Timeout
534/684 Testing akonadi-mysql-db-itemstoretest***Timeout
535/684 Testing akonadi-mysql-fs-itemstoretest***Timeout
536/684 Testing akonadi-mysql-db-itemdeletetes***Timeout
537/684 Testing akonadi-mysql-fs-itemdeletetes***Timeout
538/684 Testing akonadi-mysql-db-entitycachete***Timeout
539/684 Testing akonadi-mysql-fs-entitycachete***Timeout
540/684 Testing akonadi-mysql-db-monitortest  ***Timeout
541/684 Testing akonadi-mysql-fs-monitortest  ***Timeout
542/684 Testing akonadi-mysql-db-searchjobtest***Timeout
543/684 Testing akonadi-mysql-fs-searchjobtest***Timeout
544/684 Testing akonadi-mysql-db-changerecorde***Timeout
545/684 Testing akonadi-mysql-fs-changerecorde***Timeout
546/684 Testing akonadi-mysql-db-resourcetest ***Timeout
547/684 Testing akonadi-mysql-fs-resourcetest ***Timeout
548/684 Testing akonadi-mysql-db-subscriptiont***Timeout
549/684 Testing akonadi-mysql-fs-subscriptiont***Timeout
550/684 Testing akonadi-mysql-db-transactionte***Timeout
551/684 Testing akonadi-mysql-fs-transactionte***Timeout
552/684 Testing akonadi-mysql-db-filteractiont***Timeout
553/684 Testing akonadi-mysql-fs-filteractiont***Timeout
554/684 Testing akonadi-mysql-db-itemcopytest ***Timeout
555/684 Testing akonadi-mysql-fs-itemcopytest ***Timeout
556/684 Testing akonadi-mysql-db-itemmovetest ***Timeout
557/684 Testing akonadi-mysql-fs-itemmovetest ***Timeout
558/684 Testing akonadi-mysql-db-collectioncop***Timeout
559/684 Testing akonadi-mysql-fs-collectioncop***Timeout
560/684 Testing akonadi-mysql-db-collectionmov***Timeout
561/684 Testing akonadi-mysql-fs-collectionmov***Timeout
562/684 Testing akonadi-mysql-db-collectionsyn***Timeout
563/684 Testing akonadi-mysql-fs-collectionsyn***Timeout
564/684 Testing akonadi-mysql-db-itemsynctest ***Timeout
565/684 Testing akonadi-mysql-fs-itemsynctest ***Timeout
566/684 Testing akonadi-mysql-db-linktest     ***Timeout
567/684 Testing akonadi-mysql-fs-linktest  	   ^Cmake: *** [test] Interrupt

real	1248m26.365s
user	1m39.791s
sys	0m8.942s
-------------- next part --------------
A non-text attachment was scrubbed...
Name: signature.asc
Type: application/pgp-signature
Size: 198 bytes
Desc: This is a digitally signed message part.
URL: <http://mail.kde.org/pipermail/kde-pim/attachments/20090926/d9693091/attachment.sig>
-------------- next part --------------
_______________________________________________
KDE PIM mailing list kde-pim at kde.org
https://mail.kde.org/mailman/listinfo/kde-pim
KDE PIM home page at http://pim.kde.org/