[Akonadi] [Bug 334318] New: on adding old mail archive mixedmaildir resource consumes tons of memory

[Martin Steigerwald]

https://bugs.kde.org/show_bug.cgi?id=334318

            Bug ID: 334318
           Summary: on adding old mail archive mixedmaildir resource
                    consumes tons of memory
    Classification: Unclassified
           Product: Akonadi
           Version: GIT (master)
          Platform: Debian unstable
                OS: Linux
            Status: UNCONFIRMED
          Severity: grave
          Priority: NOR
         Component: Mixed Maildir resource
          Assignee: kdepim-bugs at kde.org
          Reporter: Martin at Lichtvoll.de
                CC: krammer at kde.org

On looking whether mixedmaildir resource needs a similar fix as in

Bug #334206 - While maildir resources synchronizes a folder KMail blocks on
switching to a different folder

I thought I try to through my old mixedmaildir archive into Akonadi. During
KMail 1 times I used mbox folders to archive mails from maildir folders at the
time when KMail 1 became to slow with large folders (i.e. about 20000-40000
mails in one folder was the usability limit back then on my old laptop).

Well I did and on trying mixedmailresource consumed memory until the Linux
kernel OOM killed it.

Reproducible: Always

Steps to Reproduce:
1. Have a large mixedmail folder.
2. Add a mixed maildir resource in Akonadiconsole and point it to that folder
3. Watch machine becomes sluggish until OOM killer steps in.
Actual Results:  
6.1 GB Resident Set usage on a 8 GB machine.

  PID     TID    MINFLT   MAJFLT    VSTEXT   VSLIBS     VDATA   VSTACK    
VSIZE     RSIZE    VGROW     RGROW   SWAPSZ    RUID       EUID         MEM   
CMD        1/7
 6132       -    142595       41      328K   77724K      6.3G     136K     
6.6G      5.4G   556.1M    95936K   903.6M    martin     martin       71%   
akonadi_mixedm

  PID     TID    MINFLT   MAJFLT    VSTEXT   VSLIBS     VDATA   VSTACK    
VSIZE     RSIZE    VGROW     RGROW   SWAPSZ    RUID       EUID         MEM   
CMD        1/7
 6222       -    140411       20      328K   77064K      6.5G     136K     
6.8G      6.1G   547.8M    50216K   485.4M    martin     martin       80%   
akonadi_mixedm

OOM killer:

[103900.424539] Out of memory: Kill process 6222 (akonadi_mixedma) score 809 or
sacrifice child
[103900.424547] Killed process 6222 (akonadi_mixedma) total-vm:16966204kB,
anon-rss:6681748kB, file-rss:1352kB


Expected Results:  
Sane memory usage during scan of mixed maildir archive folder. Yes, it is
large, but still, it doesn´t have to load it all into memory at the same time.

martin at merkaba:~> cat /proc/version
Linux version 3.14.0-tp520 (martin at merkaba) (gcc version 4.8.2 (Debian
4.8.2-17) ) #52 SMP PREEMPT Mon Mar 31 13:41:48 CEST 2014
martin at merkaba:~> free -m
             total       used       free     shared    buffers     cached
Mem:          7767       2771       4996        326          0       1331
-/+ buffers/cache:       1440       6327
Swap:        12287       2114      10173

Akonadi, kdepimlibs, kdepim-runtime are git master as of today. KMail is 4.12.4
as from Debian unstable package.

-- 
You are receiving this mail because:
You are the assignee for the bug.