[Kde-pim] MySQL growing even when deleting content

Kevin Krammer kevin.krammer at gmx.at
Tue Jun 22 23:46:55 BST 2010 

Followup to myself.

After getting the tip that one of our config options (log_bin) is related to 
replication, I removed it and retested.

See new value inline.

On Monday, 2010-06-21, Kevin Krammer wrote:
> Hi folks,
> 
> repeated testing of the KMail migrator got me into a situation where the
> parition holding my test Akonadi directory (2GB) filled up.
> 
> Side note: interesting behavior of the migrator, it just idles, not doing
> anything anymore, probably waiting for a socket operation towards Akonadi.
> 
> The following situation is after an akonadictl start with totally empty
> directory.
> 
> kevin at artemis ~/.akonadi-test/.local/share/akonadi % ll -h db_data && du -h
> -- max-depth=1
> insgesamt 139M
> drwx------ 2 kevin kevin 4,0K 21. Jun 18:21 akonadi/
> -rw-rw---- 1 kevin kevin    6 21. Jun 18:21 artemis.pid
> -rw-rw---- 1 kevin kevin  10M 21. Jun 18:22 ibdata1
> -rw-rw---- 1 kevin kevin  64M 21. Jun 18:22 ib_logfile0
> -rw-rw---- 1 kevin kevin  64M 21. Jun 18:21 ib_logfile1
> drwx------ 2 kevin kevin 4,0K 21. Jun 18:21 mysql/
> -rw-rw---- 1 kevin kevin  19K 21. Jun 18:21 mysql-bin.000001
> -rw-rw---- 1 kevin kevin 703K 21. Jun 18:21 mysql-bin.000002
> -rw-rw---- 1 kevin kevin  96K 21. Jun 18:22 mysql-bin.000003
> -rw-rw---- 1 kevin kevin   57 21. Jun 18:21 mysql-bin.index
> -rw-rw---- 1 kevin kevin 1,3K 21. Jun 18:21 mysql.err
> 0       ./db_misc
> 0       ./file_db_data
> 142M    ./db_data
> 142M    .
> 
> The two biggest files at this point are, as expected, the two InnoDB log
> files.
> The next biggest one is ibdata1 at 10MB.

No change at being, other than the absence of mysql-bin.* files

ll -h db_data && du -h
insgesamt 139M
drwx------ 2 kevin kevin 4,0K 23. Jun 00:21 akonadi/
-rw-rw---- 1 kevin kevin    4 23. Jun 00:21 artemis.pid
-rw-rw---- 1 kevin kevin  10M 23. Jun 00:22 ibdata1
-rw-rw---- 1 kevin kevin  64M 23. Jun 00:22 ib_logfile0
-rw-rw---- 1 kevin kevin  64M 23. Jun 00:21 ib_logfile1
drwx------ 2 kevin kevin 4,0K 23. Jun 00:21 mysql/
-rw-rw---- 1 kevin kevin 1,1K 23. Jun 00:21 mysql.err
0       ./db_misc
0       ./file_db_data
960K    ./db_data/mysql
1,5M    ./db_data/akonadi
141M    ./db_data
141M    .

> The next situation is after running the migrator, one DIMAP account with
> about 67MB cache, quite some local folders (collection tree has been
> synchronized). Headers of a almost empty IMAP resource, calendar entries
> from a 1KB file and roughtly 80 contacts.
> 
> kevin at artemis ~/.akonadi-test/.local/share/akonadi % ll -h db_data && du -h
> -- max-depth=1
> insgesamt 219M
> drwx------ 2 kevin kevin 4,0K 21. Jun 18:21 akonadi/
> -rw-rw---- 1 kevin kevin    6 21. Jun 18:21 artemis.pid
> -rw-rw---- 1 kevin kevin  10M 21. Jun 18:27 ibdata1
> -rw-rw---- 1 kevin kevin  64M 21. Jun 18:27 ib_logfile0
> -rw-rw---- 1 kevin kevin  64M 21. Jun 18:26 ib_logfile1
> drwx------ 2 kevin kevin 4,0K 21. Jun 18:21 mysql/
> -rw-rw---- 1 kevin kevin  19K 21. Jun 18:21 mysql-bin.000001
> -rw-rw---- 1 kevin kevin 703K 21. Jun 18:21 mysql-bin.000002
> -rw-rw---- 1 kevin kevin  80M 21. Jun 18:26 mysql-bin.000003
> -rw-rw---- 1 kevin kevin   57 21. Jun 18:21 mysql-bin.index
> -rw-rw---- 1 kevin kevin 1,3K 21. Jun 18:21 mysql.err
> 0       ./db_misc
> 0       ./file_db_data
> 342M    ./db_data
> 342M    .

kevin at artemis ~/.akonadi-test/.local/share/akonadi % ll -h db_data && du -h
insgesamt 139M
drwx------ 2 kevin kevin 4,0K 23. Jun 00:21 akonadi/
-rw-rw---- 1 kevin kevin    4 23. Jun 00:21 artemis.pid
-rw-rw---- 1 kevin kevin  10M 23. Jun 00:25 ibdata1
-rw-rw---- 1 kevin kevin  64M 23. Jun 00:25 ib_logfile0
-rw-rw---- 1 kevin kevin  64M 23. Jun 00:25 ib_logfile1
drwx------ 2 kevin kevin 4,0K 23. Jun 00:21 mysql/
-rw-rw---- 1 kevin kevin 1,1K 23. Jun 00:21 mysql.err
0       ./db_misc
0       ./file_db_data
960K    ./db_data/mysql
123M    ./db_data/akonadi
262M    ./db_data
262M    .

We've already saved about 80 MB! Thats the now absent mysql-bin.000003 file.

> As expected, the log files keep their sizes.
> ibdata1 has not changed, mysql-bin.000003 is now the biggest file.
> Suprisingly it is 13MB bigger than the imported data.
> 
> Next I deleted all migrated resources.
> 
> kevin at artemis ~/.akonadi-test/.local/share/akonadi % ll -h db_data && du -h
> -- max-depth=1
> insgesamt 235M
> drwx------ 2 kevin kevin 4,0K 21. Jun 18:21 akonadi/
> -rw-rw---- 1 kevin kevin    6 21. Jun 18:21 artemis.pid
> -rw-rw---- 1 kevin kevin  18M 21. Jun 18:30 ibdata1
> -rw-rw---- 1 kevin kevin  64M 21. Jun 18:30 ib_logfile0
> -rw-rw---- 1 kevin kevin  64M 21. Jun 18:30 ib_logfile1
> drwx------ 2 kevin kevin 4,0K 21. Jun 18:21 mysql/
> -rw-rw---- 1 kevin kevin  19K 21. Jun 18:21 mysql-bin.000001
> -rw-rw---- 1 kevin kevin 703K 21. Jun 18:21 mysql-bin.000002
> -rw-rw---- 1 kevin kevin  88M 21. Jun 18:30 mysql-bin.000003
> -rw-rw---- 1 kevin kevin   57 21. Jun 18:21 mysql-bin.index
> -rw-rw---- 1 kevin kevin 1,3K 21. Jun 18:21 mysql.err
> 0       ./db_misc
> 0       ./file_db_data
> 358M    ./db_data
> 358M    .

kevin at artemis ~/.akonadi-test/.local/share/akonadi % ll -h db_data && du -h
insgesamt 147M
drwx------ 2 kevin kevin 4,0K 23. Jun 00:21 akonadi/
-rw-rw---- 1 kevin kevin    4 23. Jun 00:21 artemis.pid
-rw-rw---- 1 kevin kevin  18M 23. Jun 00:27 ibdata1
-rw-rw---- 1 kevin kevin  64M 23. Jun 00:27 ib_logfile0
-rw-rw---- 1 kevin kevin  64M 23. Jun 00:27 ib_logfile1
drwx------ 2 kevin kevin 4,0K 23. Jun 00:21 mysql/
-rw-rw---- 1 kevin kevin 1,1K 23. Jun 00:21 mysql.err
0       ./db_misc
0       ./file_db_data
960K    ./db_data/mysql
123M    ./db_data/akonadi
270M    ./db_data
270M    .

After deletion we now have again 8MB more in iddata1, but everything else 
keeps its size.
Almost 90MB difference.

I now ran the migration again:

kevin at artemis ~/.akonadi-test/.local/share/akonadi % ll -h db_data && du -h
insgesamt 147M
drwx------ 2 kevin kevin 4,0K 23. Jun 00:21 akonadi/
-rw-rw---- 1 kevin kevin    4 23. Jun 00:21 artemis.pid
-rw-rw---- 1 kevin kevin  18M 23. Jun 00:35 ibdata1
-rw-rw---- 1 kevin kevin  64M 23. Jun 00:35 ib_logfile0
-rw-rw---- 1 kevin kevin  64M 23. Jun 00:35 ib_logfile1
drwx------ 2 kevin kevin 4,0K 23. Jun 00:21 mysql/
-rw-rw---- 1 kevin kevin 1,1K 23. Jun 00:21 mysql.err
0       ./db_misc
0       ./file_db_data
960K    ./db_data/mysql
123M    ./db_data/akonadi
270M    ./db_data
270M    .

Excellent, no change in size!


And removal again:

kevin at artemis ~/.akonadi-test/.local/share/akonadi % ll -h db_data && du -h
insgesamt 147M
drwx------ 2 kevin kevin 4,0K 23. Jun 00:21 akonadi/
-rw-rw---- 1 kevin kevin    4 23. Jun 00:21 artemis.pid
-rw-rw---- 1 kevin kevin  18M 23. Jun 00:37 ibdata1
-rw-rw---- 1 kevin kevin  64M 23. Jun 00:37 ib_logfile0
-rw-rw---- 1 kevin kevin  64M 23. Jun 00:36 ib_logfile1
drwx------ 2 kevin kevin 4,0K 23. Jun 00:21 mysql/
-rw-rw---- 1 kevin kevin 1,1K 23. Jun 00:21 mysql.err
0       ./db_misc
0       ./file_db_data
960K    ./db_data/mysql
123M    ./db_data/akonadi
270M    ./db_data
270M    .

Still constant size.

So I recommend we remove the log_bin option from our config.
Anyone know why it is in there actually?

Cheers,
Kevin

-- 
Kevin Krammer, KDE developer, xdg-utils developer
KDE user support, developer mentoring
-------------- next part --------------
A non-text attachment was scrubbed...
Name: signature.asc
Type: application/pgp-signature
Size: 190 bytes
Desc: This is a digitally signed message part.
URL: <http://mail.kde.org/pipermail/kde-pim/attachments/20100623/b33b56bf/attachment.sig>
-------------- next part --------------
_______________________________________________
KDE PIM mailing list kde-pim at kde.org
https://mail.kde.org/mailman/listinfo/kde-pim
KDE PIM home page at http://pim.kde.org/

More information about the kde-pim mailing list