[KPhotoAlbum] Performance issue: KPA too slow when clickingon "big" supercategories

[Lars Clausen]

Robert L Krawitz said:
>    From: "Jesper K. Pedersen" <blackie at blackie.dk>
>    Date: Tue, 26 Dec 2006 12:05:05 +0100
>
>    One of my goals is to push all this onto a worker thread, so it is
>    backgrounded. Esp md5sum calculation is tedious at when new images
>    are found.
>
> The time required to actually import the images isn't bad.  The
> problem is the time spent scanning for images when you're only
> importing a few.
>
> Importing 100 images or so only takes about a minute.  Scanning my
> filesystem for new images, with 17000 already present, currently takes
> about 100 seconds.  This is likely to scale linearly with the number
> of images already present (specifically, with the number of files in
> the image directory and all of its children).

I think I mentioned this before:  If you store for each directory involved
whether it's a leaf directory, you can skip those leaf directories that
haven't changed.  I'd wager in most setups, this would skip the majority
of old images.

-Lars