<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
<meta name="Generator" content="Microsoft Word 15 (filtered medium)">
<style><!--
/* Font Definitions */
@font-face
{font-family:"Cambria Math";
panose-1:0 0 0 0 0 0 0 0 0 0;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
@font-face
{font-family:Consolas;
panose-1:2 11 6 9 2 2 4 3 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0cm;
margin-bottom:.0001pt;
font-size:11.0pt;
font-family:"Calibri",sans-serif;
color:#2E3436;}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:#2A76C6;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:#2E3436;
text-decoration:underline;}
pre
{mso-style-priority:99;
mso-style-link:"HTML Vorformatiert Zchn";
margin:0cm;
margin-bottom:.0001pt;
font-size:10.0pt;
font-family:"Courier New";
color:#2E3436;}
p.msonormal0, li.msonormal0, div.msonormal0
{mso-style-name:msonormal;
mso-margin-top-alt:auto;
margin-right:0cm;
mso-margin-bottom-alt:auto;
margin-left:0cm;
font-size:11.0pt;
font-family:"Calibri",sans-serif;
color:#2E3436;}
span.HTMLVorformatiertZchn
{mso-style-name:"HTML Vorformatiert Zchn";
mso-style-priority:99;
mso-style-link:"HTML Vorformatiert";
font-family:Consolas;
color:#2E3436;}
span.E-MailFormatvorlage20
{mso-style-type:personal-reply;
font-family:"Calibri",sans-serif;}
.MsoChpDefault
{mso-style-type:export-only;
font-size:10.0pt;}
@page WordSection1
{size:612.0pt 792.0pt;
margin:70.85pt 70.85pt 2.0cm 70.85pt;}
div.WordSection1
{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]-->
</head>
<body bgcolor="white" lang="DE" link="#2A76C6" vlink="#2E3436">
<div class="WordSection1">
<p class="MsoNormal"><span style="mso-fareast-language:EN-US">Hi Rob,<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="mso-fareast-language:EN-US">i can’t find a table called imageSimilarity in my MySQL db.<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="mso-fareast-language:EN-US"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="mso-fareast-language:EN-US">Can you point out where it should be?<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="mso-fareast-language:EN-US"><o:p> </o:p></span></p>
<div>
<div style="border:none;border-top:solid #E1E1E1 1.0pt;padding:3.0pt 0cm 0cm 0cm">
<p class="MsoNormal"><b>Von:</b> Digikam-users <digikam-users-bounces@kde.org> <b>
Im Auftrag von </b>Rob Dueckman<br>
<b>Gesendet:</b> Freitag, 19. Oktober 2018 16:40<br>
<b>An:</b> digiKam - Home Manage your photographs as a professional with the power of open source <digikam-users@kde.org><br>
<b>Betreff:</b> Re: [digiKam-users] Anyone with a +300K photos internal mysql database?<o:p></o:p></p>
</div>
</div>
<p class="MsoNormal"><o:p> </o:p></p>
<div>
<p class="MsoNormal">I have found that the majority of the startup time is spent reading the similarity database.<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">Startup takes about 8 minutes on a image collection of about 400K images. Most of the time is spent on the query "SELECT value FROM ImageSimilarity WHERE ( imageid1=? OR imageid2=? ) AND algorithm=? ..." (I don't have any of the query after
the ?. Sorry)<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">Nothing is logged to the console while reading the database.If I replace the similarity database with a blank one, startup is reduced to about 34 seconds.<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">If I re-build the database, start up times are again slow.<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">This is running DK6 Beta2 Oct 15 release.<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">Rob<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">On Fri, 2018-10-19 at 08:22 +0000, Dumelle, Timo (E+K) wrote:<o:p></o:p></p>
</div>
<blockquote style="border:none;border-left:solid #729FCF 1.5pt;padding:0cm 0cm 0cm 6.0pt;margin-left:4.8pt;margin-right:0cm">
<pre>I am dropping in here.<o:p></o:p></pre>
<pre><o:p> </o:p></pre>
<pre>I have 305k photos in many folders on a network share.<o:p></o:p></pre>
<pre>Many of the folders on that share don't contain pictures, but since the paths are kinda "mixed up" with other files I can't just scan the photos.<o:p></o:p></pre>
<pre><o:p> </o:p></pre>
<pre>Dk needs about 5 - 10 minutes to start up while hanging on "reading database"<o:p></o:p></pre>
<pre>And nearly every operation that goes beyond just viewing pics in albums cause it to either not responding for a long time or crashing<o:p></o:p></pre>
<pre>Currently it is finding duplicates which seems to proceed pretty fast.<o:p></o:p></pre>
<pre><o:p> </o:p></pre>
<pre>Picasa for example has absolute no problems with this pictures. <o:p></o:p></pre>
<pre>But I need server functions for about 20 clients to connect to the DB<o:p></o:p></pre>
<pre><o:p> </o:p></pre>
<pre>Can I help with any of these tests?<o:p></o:p></pre>
<pre><o:p> </o:p></pre>
<pre>-----Ursprüngliche Nachricht-----<o:p></o:p></pre>
<pre>Von: Digikam-users <<o:p></o:p></pre>
<p class="MsoNormal"><a href="mailto:digikam-users-bounces@kde.org"><o:p></o:p></a></p>
<pre><u><span style="color:#2A76C6"><a href="mailto:digikam-users-bounces@kde.org">digikam-users-bounces@kde.org<span style="color:#2E3436;text-decoration:none"><o:p></o:p></span></a></span></u></pre>
<p class="MsoNormal"><o:p> </o:p></p>
<pre>> Im Auftrag von Rafael Linux<o:p></o:p></pre>
<pre>Gesendet: Freitag, 24. August 2018 00:54<o:p></o:p></pre>
<pre>An: <o:p></o:p></pre>
<p class="MsoNormal"><a href="mailto:digikam-users@kde.org"><o:p></o:p></a></p>
<pre><u><span style="color:#2A76C6"><a href="mailto:digikam-users@kde.org">digikam-users@kde.org<span style="color:#2E3436;text-decoration:none"><o:p></o:p></span></a></span></u></pre>
<p class="MsoNormal"><o:p> </o:p></p>
<pre><o:p> </o:p></pre>
<pre>Betreff: Re: [digiKam-users] Anyone with a +300K photos internal mysql database?<o:p></o:p></pre>
<pre><o:p> </o:p></pre>
<pre>Maik, as I wrote to Gilles, I can't see how many folders cause the user is on holidays this week, and I have no access to it, but I estimate that could be<o:p></o:p></pre>
<pre>+13k albums, mostly with JPG photos.<o:p></o:p></pre>
<pre><o:p> </o:p></pre>
<pre>I want to thank you your test, cause I was sure that the reason of the issues weren't in the hardware or the database (mysql process never fired up any CPU core).<o:p></o:p></pre>
<pre><o:p> </o:p></pre>
<pre>If I can help anyway, let me know, but take into account that I can't do any test in any moment, cause the real system is not mine, so I have not access to it at my own <o:p></o:p></pre>
<pre><o:p> </o:p></pre>
<pre><o:p> </o:p></pre>
<pre><o:p> </o:p></pre>
<pre>--<o:p></o:p></pre>
<pre>Sent from: <o:p></o:p></pre>
<p class="MsoNormal"><a href="http://digikam.1695700.n4.nabble.com/digikam-users-f1735189.html"><o:p></o:p></a></p>
<pre><u><span style="color:#2A76C6"><a href="http://digikam.1695700.n4.nabble.com/digikam-users-f1735189.html">http://digikam.1695700.n4.nabble.com/digikam-users-f1735189.html<span style="color:#2E3436;text-decoration:none"><o:p></o:p></span></a></span></u></pre>
<p class="MsoNormal"><o:p> </o:p></p>
<pre><o:p> </o:p></pre>
</blockquote>
</div>
</body>
</html>