Help with KAuth tests

[Albert Astals Cid]

El divendres, 21 d’octubre de 2016, a les 20:09:30 CEST, Aleix Pol va 
escriure:
> Hey,
> I pushed a change today that broke our build CI which I reverted, I've
> been investigating further and found out that if I run the KAuth tests
> at bulk they don't pass but they do separately. This test is rather
> intricate, I'd appreciate a hand.
> 
> Can someone at least confirm my behavior or build.kde.org's?

Reading your paste is really hard, lots of weird markers on it so i am not 
sure i can figure out what your problem is.

Here ctest passes just fine

Running ./autotests/KAuthHelperTest and ./autotests/KAuthSetupActionTest 
manually also works.

Not sure if that's what you were asking or not, does that help?

Cheers,
  Albert
 
> Aleix
> 
> apol at oliver:~/build-devel/frameworks/kauth

> ./autotests/KAuthHelperTest testActionData
> ********* Start testing of HelperTest *********
> Config: Using QtTest library 5.8.0, Qt 5.8.0
> (x86_64-little_endian-lp64 shared (dynamic) release build; by GCC
> 6.2.1 20160830)
> QDEBUG : HelperTest::initTestCase() KAuthHelperTest(8012)/(default)
> ?[31m?[34mKAuth::TestBackend::TestBackend?[0m: Test backend loaded
> QDEBUG : HelperTest::initTestCase() KAuthHelperTest(8012)/(default)
> ?[31m?[34mHelperTest::initTestCase?[0m: Waiting for HelperHandler to
> be initialized
> QDEBUG : HelperTest::initTestCase() KAuthHelperTest(8012)/(default)
> ?[31m?[34mHelperHandler::init?[0m: Initializing helper handler
> QDEBUG : HelperTest::initTestCase() KAuthHelperTest(8012)/(default)
> ?[31m?[34mKAuth::BackendsManager::setProxyForThread?[0m: Adding proxy
> for thread QThread(0x64ebf0)
> PASS   : HelperTest::initTestCase()
> QDEBUG : HelperTest::testActionData() KAuthHelperTest(8012)/(default)
> ?[31m?[34mKAuth::TestBackend::actionExists?[0m: Checking if action
> "org.kde.kf5auth.autotest.echoaction" exists
> QDEBUG : HelperTest::testActionData() KAuthHelperTest(8012)/(default)
> ?[31m?[34mKAuth::TestBackend::isCallerAuthorized?[0m: Caller ID: "a
> random caller Id"
> QDEBUG : HelperTest::testActionData() KAuthHelperTest(8012)/(default)
> ?[31m?[34mTestHelper::echoaction?[0m: Echo action running
> PASS   : HelperTest::testActionData()
> PASS   : HelperTest::cleanupTestCase()
> Totals: 3 passed, 0 failed, 0 skipped, 0 blacklisted, 4ms
> ********* Finished testing of HelperTest *********
> apol at oliver:~/build-devel/frameworks/kauth$ ./autotests/KAuthHelperTest
> ********* Start testing of HelperTest *********
> Config: Using QtTest library 5.8.0, Qt 5.8.0
> (x86_64-little_endian-lp64 shared (dynamic) release build; by GCC
> 6.2.1 20160830)
> QDEBUG : HelperTest::initTestCase() KAuthHelperTest(8019)/(default)
> ?[31m?[34mKAuth::TestBackend::TestBackend?[0m: Test backend loaded
> QDEBUG : HelperTest::initTestCase() KAuthHelperTest(8019)/(default)
> ?[31m?[34mHelperTest::initTestCase?[0m: Waiting for HelperHandler to
> be initialized
> QDEBUG : HelperTest::initTestCase() KAuthHelperTest(8019)/(default)
> ?[31m?[34mHelperHandler::init?[0m: Initializing helper handler
> QDEBUG : HelperTest::initTestCase() KAuthHelperTest(8019)/(default)
> ?[31m?[34mKAuth::BackendsManager::setProxyForThread?[0m: Adding proxy
> for thread QThread(0x8c1c10)
> PASS   : HelperTest::initTestCase()
> QDEBUG : HelperTest::testBasicActionExecution()
> KAuthHelperTest(8019)/(default)
> ?[31m?[34mKAuth::TestBackend::setNewCapabilities?[0m: Capabilities
> changing
> QDEBUG : HelperTest::testBasicActionExecution()
> KAuthHelperTest(8019)/(default)
> ?[31m?[34mKAuth::TestBackend::actionExists?[0m: Checking if action
> "org.kde.kf5auth.autotest.standardaction" exis
> ts
> QDEBUG : HelperTest::testBasicActionExecution()
> KAuthHelperTest(8019)/(default)
> ?[31m?[34mKAuth::TestBackend::isCallerAuthorized?[0m: Caller ID: "a
> random caller Id"
> QDEBUG : HelperTest::testBasicActionExecution()
> KAuthHelperTest(8019)/(default)
> ?[31m?[34mTestHelper::standardaction?[0m: Standard action running
> PASS   : HelperTest::testBasicActionExecution()
> QDEBUG : HelperTest::testExecuteJobSignals()
> KAuthHelperTest(8019)/(default)
> ?[31m?[34mKAuth::TestBackend::actionExists?[0m: Checking if action
> "org.kde.kf5auth.autotest.longaction" exists
> QDEBUG : HelperTest::testExecuteJobSignals()
> KAuthHelperTest(8019)/(default)
> ?[31m?[34mKAuth::TestBackend::isCallerAuthorized?[0m: Caller ID: "a
> random caller Id"
> QDEBUG : HelperTest::testExecuteJobSignals()
> KAuthHelperTest(8019)/(default) ?[31m?[34mTestHelper::longaction?[0m:
> Long action running. Don't be scared, this action takes 2 seconds to
> complete
> FAIL!  : HelperTest::testExecuteJobSignals() 'job->exec()' returned FALSE.
> () Loc: [/home/apol/devel/frameworks/kauth/autotests/HelperTest.cpp(169)]
> QDEBUG : HelperTest::testActionData() KAuthHelperTest(8019)/(default)
> ?[31m?[34mKAuth::TestBackend::actionExists?[0m: Checking if action
> "org.kde.kf5auth.autotest.echoaction" exists
> QDEBUG : HelperTest::testActionData() KAuthHelperTest(8019)/(default)
> ?[31m?[34mKAuth::TestBackend::isCallerAuthorized?[0m: Caller ID: "a
> random caller Id"
> QDEBUG : HelperTest::testActionData() KAuthHelperTest(8019)/(default)
> ?[31m?[34mTestHelper::echoaction?[0m: Echo action running
> FAIL!  : HelperTest::testActionData() 'job->exec()' returned FALSE. ()
>   Loc: [/home/apol/devel/frameworks/kauth/autotests/HelperTest.cpp(204)]
> PASS   : HelperTest::cleanupTestCase()
> Totals: 3 passed, 2 failed, 0 skipped, 0 blacklisted, 2037ms
> ********* Finished testing of HelperTest *********