Hello all, it's me again<br><br>I was working on a kind of optimization
for the user_ldap app. As I told you in past emails, we have a ldap with
more than 100k users. And the process of creating the cache still not
working (takes to much time, more than 7h).<br><br>I've cloned the core
repo on github and made very little changes (here is the commit:
<a href="https://github.com/valarauco/owncloud_core/commit/c0fbea11d543d9d47922f13a39940d9f4969880a">https://github.com/valarauco/owncloud_core/commit/c0fbea11d543d9d47922f13a39940d9f4969880a</a>),
I was able to reduce the time to 4 hours (aprox.) and have no idea on
how to reduce it more. I think the problem is not in the ldap but in the
greedy (foreach/recursive) search in ldap2ownCloudNames method.<br><br>Regards,<br clear="all">Manuel Delgado<br><br>-----------------------------------------------------------<br><b>Usuario Linux</b> <i>#<a href="http://counter.li.org/" target="_blank">520940</a></i> <br>
<br>Bach. Computación e Informática<br>Universidad de Costa Rica<br><br><br><br>
<br><br><div class="gmail_quote">On Tue, Sep 4, 2012 at 9:54 PM, Manuel Delgado <span dir="ltr"><<a href="mailto:manuel.delgado@ucr.ac.cr" target="_blank">manuel.delgado@ucr.ac.cr</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
Exactly, I'm trying to access Settings/Users page, but it never load. That's why I'm asking how does the cache work, because all the 109.402 user entries and 25 groups are in the database but a heavy work still there.<br>
<br>As far as I know the cache resides in a file (not in DB), where is it or how is it stored? and why not to use DB?<span class="HOEnZb"><font color="#888888"><br><br><br clear="all">Manuel Delgado</font></span><div class="HOEnZb">
<div class="h5"><br><br><br><br><div class="gmail_quote">On Tue, Sep 4, 2012 at 6:27 PM, Michael Gapczynski <span dir="ltr"><<a href="mailto:mtgap@owncloud.com" target="_blank">mtgap@owncloud.com</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">What do you mean by trying to make a simple list? The problem areas of sharing<br>
and the Settings -> Users page were rewritten to fix the performance issues by<br>
loading in batches.<br>
<br>
I think LDAP may still have to load all the users once to populate the cache.<br>
Arthur will be able to answer your question better, but he is away right now.<br>
<br>
<br>
Michael<br>
<div><br>
On Tuesday, September 04, 2012 06:21:52 PM Manuel Delgado wrote:<br>
> Hi!<br>
><br>
> I'm trying again with the Owncloud 4.5 Beta (Well actually the master<br>
> branch) and I have almost the same issue... the CPU of my server goes to<br>
> 100% when I try to make a simple list or query over the LDAP users.<br>
> Actually it loops until time is up...<br>
><br>
> How does the cache work?<br>
><br>
> Another issue, I think there's a mistyped in apps/user_ldap/lib/access.php<br>
> line 388, it reads:<br>
> $sqlAdjustment = 'FROM `dual`';<br>
> And it should be:<br>
> $sqlAdjustment = 'FROM DUAL';<br>
> Otherwise it throws a syntax error on MySQL<br>
><br>
> Regards,<br>
> Manuel Delgado<br>
><br>
> -----------------------------------------------------------<br>
</div><div>> *Usuario Linux* *#520940 <<a href="http://counter.li.org/" target="_blank">http://counter.li.org/</a>>*<br>
><br>
</div><div>> Bach. Computación e Informática<br>
> Universidad de Costa Rica<br>
><br>
</div><div>> On Fri, Aug 10, 2012 at 3:33 AM, Arthur Schiwon <<a href="mailto:blizzz@owncloud.com" target="_blank">blizzz@owncloud.com</a>> wrote:<br>
> > On 08/10/2012 09:02 AM, Dirk Kastens wrote:<br>
> >> Hi Manual,<br>
> >><br>
> >> When I set the size limit, ldap_serch will only return X entries, so<br>
> >><br>
> >>> autocompletion will only work on those X entries and I'll be unable to<br>
> >>> share the file with anyone beyond X.<br>
> >>><br>
> >>> Is this right? or am I missing something?<br>
> >><br>
> >> Theoretically you're right. But with autocompletion, the more letters<br>
> >> you type, the less users will match. For example, you will share a file<br>
> >> with user tomcat: you type "t" and will get a list of 100 users out of<br>
> >> 2000 that start with a "t". Then you type "o" and now you will see all<br>
> >> 50 users that start with "to". This is the way autocompletion works with<br>
> >> SOGo. But if owncloud will only use the initial list of users that is<br>
> >> found after typing the first letter, this will not work. So it depends<br>
> >> on how owncloud's autocompletion is implemented.<br>
> ><br>
> > Unfortunately it is like this, yet. As Michael said, we're working on a<br>
> > better implementation with OC 5.<br>
> ><br>
> > Cheers<br>
> > Arthur<br>
> ><br>
> >> Dirk<br>
> >><br>
> >><br>
> >><br>
</div>> >> ______________________________**_________________<br>
> >> Owncloud mailing list<br>
> >> <a href="mailto:Owncloud@kde.org" target="_blank">Owncloud@kde.org</a><br>
> >> <a href="https://mail.kde.org/mailman/**listinfo/owncloud" target="_blank">https://mail.kde.org/mailman/**listinfo/owncloud</a><<a href="https://mail.kde.org/mai" target="_blank">https://mail.kde.org/mai</a><br>
> >> lman/listinfo/owncloud>>><br>
> >> ______________________________**_________________<br>
> ><br>
> > Owncloud mailing list<br>
> > <a href="mailto:Owncloud@kde.org" target="_blank">Owncloud@kde.org</a><br>
> > <a href="https://mail.kde.org/mailman/**listinfo/owncloud" target="_blank">https://mail.kde.org/mailman/**listinfo/owncloud</a><<a href="https://mail.kde.org/mail" target="_blank">https://mail.kde.org/mail</a><br>
> > man/listinfo/owncloud><br>
</blockquote></div><br>
</div></div></blockquote></div><br>