[KPhotoAlbum] Performance issue: KPA too slow when clickingon "big" supercategories
lars at raeder.dk
Thu Dec 28 01:51:56 GMT 2006
Robert L Krawitz said:
> From: "Jesper K. Pedersen" <blackie at blackie.dk>
> Date: Tue, 26 Dec 2006 12:05:05 +0100
> One of my goals is to push all this onto a worker thread, so it is
> backgrounded. Esp md5sum calculation is tedious at when new images
> are found.
> The time required to actually import the images isn't bad. The
> problem is the time spent scanning for images when you're only
> importing a few.
> Importing 100 images or so only takes about a minute. Scanning my
> filesystem for new images, with 17000 already present, currently takes
> about 100 seconds. This is likely to scale linearly with the number
> of images already present (specifically, with the number of files in
> the image directory and all of its children).
I think I mentioned this before: If you store for each directory involved
whether it's a leaf directory, you can skip those leaf directories that
haven't changed. I'd wager in most setups, this would skip the majority
of old images.
More information about the Kphotoalbum