Help with KAuth tests

[Aleix Pol]

On Sun, Oct 23, 2016 at 11:56 PM, Albert Astals Cid <aacid at kde.org> wrote:
> El divendres, 21 d’octubre de 2016, a les 20:09:30 CEST, Aleix Pol va
> escriure:
>> Hey,
>> I pushed a change today that broke our build CI which I reverted, I've
>> been investigating further and found out that if I run the KAuth tests
>> at bulk they don't pass but they do separately. This test is rather
>> intricate, I'd appreciate a hand.
>>
>> Can someone at least confirm my behavior or build.kde.org's?
>
> Reading your paste is really hard, lots of weird markers on it so i am not
> sure i can figure out what your problem is.
>
> Here ctest passes just fine
>
> Running ./autotests/KAuthHelperTest and ./autotests/KAuthSetupActionTest
> manually also works.
>
> Not sure if that's what you were asking or not, does that help?
>
> Cheers,
>   Albert
>
>> Aleix
>>
>> apol at oliver:~/build-devel/frameworks/kauth
>
>> ./autotests/KAuthHelperTest testActionData
>> ********* Start testing of HelperTest *********
>> Config: Using QtTest library 5.8.0, Qt 5.8.0
>> (x86_64-little_endian-lp64 shared (dynamic) release build; by GCC
>> 6.2.1 20160830)
>> QDEBUG : HelperTest::initTestCase() KAuthHelperTest(8012)/(default)
>> ?[31m?[34mKAuth::TestBackend::TestBackend?[0m: Test backend loaded
>> QDEBUG : HelperTest::initTestCase() KAuthHelperTest(8012)/(default)
>> ?[31m?[34mHelperTest::initTestCase?[0m: Waiting for HelperHandler to
>> be initialized
>> QDEBUG : HelperTest::initTestCase() KAuthHelperTest(8012)/(default)
>> ?[31m?[34mHelperHandler::init?[0m: Initializing helper handler
>> QDEBUG : HelperTest::initTestCase() KAuthHelperTest(8012)/(default)
>> ?[31m?[34mKAuth::BackendsManager::setProxyForThread?[0m: Adding proxy
>> for thread QThread(0x64ebf0)
>> PASS   : HelperTest::initTestCase()
>> QDEBUG : HelperTest::testActionData() KAuthHelperTest(8012)/(default)
>> ?[31m?[34mKAuth::TestBackend::actionExists?[0m: Checking if action
>> "org.kde.kf5auth.autotest.echoaction" exists
>> QDEBUG : HelperTest::testActionData() KAuthHelperTest(8012)/(default)
>> ?[31m?[34mKAuth::TestBackend::isCallerAuthorized?[0m: Caller ID: "a
>> random caller Id"
>> QDEBUG : HelperTest::testActionData() KAuthHelperTest(8012)/(default)
>> ?[31m?[34mTestHelper::echoaction?[0m: Echo action running
>> PASS   : HelperTest::testActionData()
>> PASS   : HelperTest::cleanupTestCase()
>> Totals: 3 passed, 0 failed, 0 skipped, 0 blacklisted, 4ms
>> ********* Finished testing of HelperTest *********
>> apol at oliver:~/build-devel/frameworks/kauth$ ./autotests/KAuthHelperTest
>> ********* Start testing of HelperTest *********
>> Config: Using QtTest library 5.8.0, Qt 5.8.0
>> (x86_64-little_endian-lp64 shared (dynamic) release build; by GCC
>> 6.2.1 20160830)
>> QDEBUG : HelperTest::initTestCase() KAuthHelperTest(8019)/(default)
>> ?[31m?[34mKAuth::TestBackend::TestBackend?[0m: Test backend loaded
>> QDEBUG : HelperTest::initTestCase() KAuthHelperTest(8019)/(default)
>> ?[31m?[34mHelperTest::initTestCase?[0m: Waiting for HelperHandler to
>> be initialized
>> QDEBUG : HelperTest::initTestCase() KAuthHelperTest(8019)/(default)
>> ?[31m?[34mHelperHandler::init?[0m: Initializing helper handler
>> QDEBUG : HelperTest::initTestCase() KAuthHelperTest(8019)/(default)
>> ?[31m?[34mKAuth::BackendsManager::setProxyForThread?[0m: Adding proxy
>> for thread QThread(0x8c1c10)
>> PASS   : HelperTest::initTestCase()
>> QDEBUG : HelperTest::testBasicActionExecution()
>> KAuthHelperTest(8019)/(default)
>> ?[31m?[34mKAuth::TestBackend::setNewCapabilities?[0m: Capabilities
>> changing
>> QDEBUG : HelperTest::testBasicActionExecution()
>> KAuthHelperTest(8019)/(default)
>> ?[31m?[34mKAuth::TestBackend::actionExists?[0m: Checking if action
>> "org.kde.kf5auth.autotest.standardaction" exis
>> ts
>> QDEBUG : HelperTest::testBasicActionExecution()
>> KAuthHelperTest(8019)/(default)
>> ?[31m?[34mKAuth::TestBackend::isCallerAuthorized?[0m: Caller ID: "a
>> random caller Id"
>> QDEBUG : HelperTest::testBasicActionExecution()
>> KAuthHelperTest(8019)/(default)
>> ?[31m?[34mTestHelper::standardaction?[0m: Standard action running
>> PASS   : HelperTest::testBasicActionExecution()
>> QDEBUG : HelperTest::testExecuteJobSignals()
>> KAuthHelperTest(8019)/(default)
>> ?[31m?[34mKAuth::TestBackend::actionExists?[0m: Checking if action
>> "org.kde.kf5auth.autotest.longaction" exists
>> QDEBUG : HelperTest::testExecuteJobSignals()
>> KAuthHelperTest(8019)/(default)
>> ?[31m?[34mKAuth::TestBackend::isCallerAuthorized?[0m: Caller ID: "a
>> random caller Id"
>> QDEBUG : HelperTest::testExecuteJobSignals()
>> KAuthHelperTest(8019)/(default) ?[31m?[34mTestHelper::longaction?[0m:
>> Long action running. Don't be scared, this action takes 2 seconds to
>> complete
>> FAIL!  : HelperTest::testExecuteJobSignals() 'job->exec()' returned FALSE.
>> () Loc: [/home/apol/devel/frameworks/kauth/autotests/HelperTest.cpp(169)]
>> QDEBUG : HelperTest::testActionData() KAuthHelperTest(8019)/(default)
>> ?[31m?[34mKAuth::TestBackend::actionExists?[0m: Checking if action
>> "org.kde.kf5auth.autotest.echoaction" exists
>> QDEBUG : HelperTest::testActionData() KAuthHelperTest(8019)/(default)
>> ?[31m?[34mKAuth::TestBackend::isCallerAuthorized?[0m: Caller ID: "a
>> random caller Id"
>> QDEBUG : HelperTest::testActionData() KAuthHelperTest(8019)/(default)
>> ?[31m?[34mTestHelper::echoaction?[0m: Echo action running
>> FAIL!  : HelperTest::testActionData() 'job->exec()' returned FALSE. ()
>>   Loc: [/home/apol/devel/frameworks/kauth/autotests/HelperTest.cpp(204)]
>> PASS   : HelperTest::cleanupTestCase()
>> Totals: 3 passed, 2 failed, 0 skipped, 0 blacklisted, 2037ms
>> ********* Finished testing of HelperTest *********
>
>

Yes, that was useful. I found out that it wasn't working on my system
but on Neon it worked.

Here's a patch that fixes it altogether (together with the issue I had
in the first place), if someone can review, that will be very welcome.
https://git.reviewboard.kde.org/r/129236/

Aleix