Help with KAuth tests

[Aleix Pol]

Hey,
I pushed a change today that broke our build CI which I reverted, I've
been investigating further and found out that if I run the KAuth tests
at bulk they don't pass but they do separately. This test is rather
intricate, I'd appreciate a hand.

Can someone at least confirm my behavior or build.kde.org's?

Aleix

apol at oliver:~/build-devel/frameworks/kauth$
./autotests/KAuthHelperTest testActionData
********* Start testing of HelperTest *********
Config: Using QtTest library 5.8.0, Qt 5.8.0
(x86_64-little_endian-lp64 shared (dynamic) release build; by GCC
6.2.1 20160830)
QDEBUG : HelperTest::initTestCase() KAuthHelperTest(8012)/(default)
?[31m?[34mKAuth::TestBackend::TestBackend?[0m: Test backend loaded
QDEBUG : HelperTest::initTestCase() KAuthHelperTest(8012)/(default)
?[31m?[34mHelperTest::initTestCase?[0m: Waiting for HelperHandler to
be initialized
QDEBUG : HelperTest::initTestCase() KAuthHelperTest(8012)/(default)
?[31m?[34mHelperHandler::init?[0m: Initializing helper handler
QDEBUG : HelperTest::initTestCase() KAuthHelperTest(8012)/(default)
?[31m?[34mKAuth::BackendsManager::setProxyForThread?[0m: Adding proxy
for thread QThread(0x64ebf0)
PASS   : HelperTest::initTestCase()
QDEBUG : HelperTest::testActionData() KAuthHelperTest(8012)/(default)
?[31m?[34mKAuth::TestBackend::actionExists?[0m: Checking if action
"org.kde.kf5auth.autotest.echoaction" exists
QDEBUG : HelperTest::testActionData() KAuthHelperTest(8012)/(default)
?[31m?[34mKAuth::TestBackend::isCallerAuthorized?[0m: Caller ID: "a
random caller Id"
QDEBUG : HelperTest::testActionData() KAuthHelperTest(8012)/(default)
?[31m?[34mTestHelper::echoaction?[0m: Echo action running
PASS   : HelperTest::testActionData()
PASS   : HelperTest::cleanupTestCase()
Totals: 3 passed, 0 failed, 0 skipped, 0 blacklisted, 4ms
********* Finished testing of HelperTest *********
apol at oliver:~/build-devel/frameworks/kauth$ ./autotests/KAuthHelperTest
********* Start testing of HelperTest *********
Config: Using QtTest library 5.8.0, Qt 5.8.0
(x86_64-little_endian-lp64 shared (dynamic) release build; by GCC
6.2.1 20160830)
QDEBUG : HelperTest::initTestCase() KAuthHelperTest(8019)/(default)
?[31m?[34mKAuth::TestBackend::TestBackend?[0m: Test backend loaded
QDEBUG : HelperTest::initTestCase() KAuthHelperTest(8019)/(default)
?[31m?[34mHelperTest::initTestCase?[0m: Waiting for HelperHandler to
be initialized
QDEBUG : HelperTest::initTestCase() KAuthHelperTest(8019)/(default)
?[31m?[34mHelperHandler::init?[0m: Initializing helper handler
QDEBUG : HelperTest::initTestCase() KAuthHelperTest(8019)/(default)
?[31m?[34mKAuth::BackendsManager::setProxyForThread?[0m: Adding proxy
for thread QThread(0x8c1c10)
PASS   : HelperTest::initTestCase()
QDEBUG : HelperTest::testBasicActionExecution()
KAuthHelperTest(8019)/(default)
?[31m?[34mKAuth::TestBackend::setNewCapabilities?[0m: Capabilities
changing
QDEBUG : HelperTest::testBasicActionExecution()
KAuthHelperTest(8019)/(default)
?[31m?[34mKAuth::TestBackend::actionExists?[0m: Checking if action
"org.kde.kf5auth.autotest.standardaction" exis
ts
QDEBUG : HelperTest::testBasicActionExecution()
KAuthHelperTest(8019)/(default)
?[31m?[34mKAuth::TestBackend::isCallerAuthorized?[0m: Caller ID: "a
random caller Id"
QDEBUG : HelperTest::testBasicActionExecution()
KAuthHelperTest(8019)/(default)
?[31m?[34mTestHelper::standardaction?[0m: Standard action running
PASS   : HelperTest::testBasicActionExecution()
QDEBUG : HelperTest::testExecuteJobSignals()
KAuthHelperTest(8019)/(default)
?[31m?[34mKAuth::TestBackend::actionExists?[0m: Checking if action
"org.kde.kf5auth.autotest.longaction" exists
QDEBUG : HelperTest::testExecuteJobSignals()
KAuthHelperTest(8019)/(default)
?[31m?[34mKAuth::TestBackend::isCallerAuthorized?[0m: Caller ID: "a
random caller Id"
QDEBUG : HelperTest::testExecuteJobSignals()
KAuthHelperTest(8019)/(default) ?[31m?[34mTestHelper::longaction?[0m:
Long action running. Don't be scared, this action takes 2 seconds to
complete
FAIL!  : HelperTest::testExecuteJobSignals() 'job->exec()' returned FALSE. ()
  Loc: [/home/apol/devel/frameworks/kauth/autotests/HelperTest.cpp(169)]
QDEBUG : HelperTest::testActionData() KAuthHelperTest(8019)/(default)
?[31m?[34mKAuth::TestBackend::actionExists?[0m: Checking if action
"org.kde.kf5auth.autotest.echoaction" exists
QDEBUG : HelperTest::testActionData() KAuthHelperTest(8019)/(default)
?[31m?[34mKAuth::TestBackend::isCallerAuthorized?[0m: Caller ID: "a
random caller Id"
QDEBUG : HelperTest::testActionData() KAuthHelperTest(8019)/(default)
?[31m?[34mTestHelper::echoaction?[0m: Echo action running
FAIL!  : HelperTest::testActionData() 'job->exec()' returned FALSE. ()
  Loc: [/home/apol/devel/frameworks/kauth/autotests/HelperTest.cpp(204)]
PASS   : HelperTest::cleanupTestCase()
Totals: 3 passed, 2 failed, 0 skipped, 0 blacklisted, 2037ms
********* Finished testing of HelperTest *********