[Akonadi] [Bug 325132] New: long mail repeatedly fails to be indexed, indexation never ends, virtuoso keeps crashing , some programs are completely unresponsive

[dmatt]

https://bugs.kde.org/show_bug.cgi?id=325132

            Bug ID: 325132
           Summary: long mail repeatedly fails to be indexed, indexation
                    never ends, virtuoso keeps crashing , some programs
                    are completely unresponsive
    Classification: Unclassified
           Product: Akonadi
           Version: 4.11
          Platform: Kubuntu Packages
                OS: Linux
            Status: UNCONFIRMED
          Severity: major
          Priority: NOR
         Component: IMAP resource
          Assignee: ervin at kde.org
          Reporter: xdarkmatter at gmail.com
                CC: kdepim-bugs at kde.org, vkrause at kde.org

After receiving very long mail (3.6MB of plain text - log of rsync from cron
job), indexing on my PC is stuck in evil loop. After each boot normal indexing
starts, than suddenly virtuoso-t process uses one core to full capacity, memory
requirements of virtuoso-t grow to something like 80MB of memory and then
virtuoso ends and new virtuoso process spawns. Once at this stage, this repeats
cca every 15 seconds. Indexing never ends and percentage of mails indexed shown
in system setting randomly jumps to anything under 100%. 
in the akonadictl output or .xsession-errors file could be seen the failing
query (with whole 3.6MB of text inside).

To verify the problem I setup clean Kubuntu install. Connecting to the same
IMAP account leads to same corruption.  

There are also other bugs:
1, once corrupted stays corrupted and user cannot fix it via nondestructive
means:
Even after offending email is deleted, akonadi is trying to run the query and
system behaves like the email is still on IMAP. Nepomuk cleaner does not help
(probably even shouldn't in this case). Only option is create clean install and
connect to IMAP only after the mail was deleted.
Or manually delete akonadi database maybe.

2. dolphin and some gui elements do not react to inputs for long seconds. One
core is free and some other programs react adequatly, so there must be some
blocking behind the scene. 

I should add, that at the beginning I thought there was problem with folders
because of this error:
akonadi_nepomuk_feeder ItemQueue::fetchJobResult: Not all items were fetched:
21 2
I attempted to move few folders to newly created one. Only part of the emails
were copied. The rest was deleted from source folder but not copied into
target, so I lost lots of emails and had to restore backup
This might or might be not due to this email being among copied files.

Reproducible: Always

Steps to Reproduce:
1.send long email to IMAP account
2.run Kontaxt with email indexing on
3.
Actual Results:  
indexing is stuck in loop and eating system resources

Expected Results:  
email is successfully indexed

bug manifested on notebook (core2duo, 4GB RAM) with Kubuntu 12.04 and KDE
4.10.5, which was later updated to 4.11.0 and 4.11.1. Test clean install was
13.10 beta with 4.11.1.

-- 
You are receiving this mail because:
You are on the CC list for the bug.