[KimDaBa] Rescan for images proposal

[Marco Molteni]

On Fri, 21 Oct 2005 22:23:00 -0400
"Jesper K. Pedersen" <blackie at blackie.dk> wrote:

> Interesting idea.
> Still with ~6000 images here, it takes less than 2 sec to rescan.
> How long does it take for you, and how many images do you have?

I did some tests, and I have to say kimdaba's performance is more
that acceptable as is with my setup:

3212 images, 3.8 GB, 200 directories
start kimdaba: 10 sec (from a non KDE environment)
build database from scratch: 2 min 30 sec
rescan, cache warm or cold no difference, < 2 sec

running this test on FreeBSD -current, standard kernel,
standard UFS2 filesystem, soft updates, dirhash,
AMD Athlon(tm) 64 Processor 3200+ (2010.31-MHz 686-class CPU)
ad0: 190782MB <WDC WD2000BB-55GUA0 08.02D08> at ata0-master UDMA100

marco

> On Friday 21 October 2005 04:53, Marco Molteni wrote:
> | On Friday 21 October 2005 03:57, Robert L Krawitz wrote:
> | >    Date: Thu, 20 Oct 2005 20:34:25 +0200
> | >    From: Eugen Dedu <Eugen.Dedu at pu-pm.univ-fcomte.fr>
> | >    Cc: kimdaba at kdab.net
> | >
> | >    Marco Colnaghi wrote:
> |
> | [..]
> |
> | >    > 2001/
> | >    >     /010515_SeaTrip
> | >    > 2002/
> | >    >     /020712_SeaTrip2002
> | >    >     /020712_Mountain
> | >    > 2005/
> | >    >     /050811_Holidays
> | >    >     /050902_Friends
> | >    >     /051001_NewDir
> | >    >
> | >    > When I add the new subdir 051001_NewDir in 2005 dir I should
> | >    > not need to rescan all the tree, I would like to rescan 2005
> | >    > subtree only.
> | >    >
> | >    > Thanks for you opinions,
> | >    > bye, Marco.
> | >
> | >    Your feature adds complexity.  IMHO, I think it's not
> | >    necessary,
> | > since you execute rarely kimdaba with new images.  The most
> | > frequently you execute it without new images.
> | >
> | > That depends upon individual usage patterns.  If you're an active
> | > photographer, you might be adding images multiple times per day.
> | >
> | > This feature could also be useful as a way of adding new
> | > directories to the collection (currently kimdaba can only handle
> | > images in a single directory tree).
> |
> | I agree with Robert.
> |
> | Another possibility to speed up rescanning without the need to have
> | another dialogue window is to add the possibility of rescanning
> | looking only at directory dates. Let me explain:
> |
> | I assume that the most of time in rescanning is due to the fact that
> | you might have a *lot* of files, and a subset of those files must
> | be read to calculate the md5 signature. It this is true, one might
> | use as workflow the convention that new files are added to new
> | directories, say a new dir is created automatically each time that
> | you download images from the camera.
> |
> | In this case, the rescanning algorithm could look at the date of the
> | lest time kimdaba run, and only at the date of each directory in the
> | whole directory tree, and rescan only the directories with newer
> | dates.
> |
> | So you would have to rescan modes:
> | -rescan as usual (with today's semantics)
> | -rescan new dirs only
> |
> | marco
> |
> |
> | _______________________________________________
> | KimDaBa mailing list
> | KimDaBa at mail.kdab.net
> | http://mail.kdab.net/mailman/listinfo/kimdaba
> 
> -- 
> Jesper K. Pedersen          |  Klarälvdalens Datakonsult
> Senior Software Engineer    |  www.klaralvdalens-datakonsult.se
> Prinsensgade 4a st.         |
> 9800 Hjørring               |  Platform-independent
> Denmark                     |  software solutions


-- 
He who receives an idea from me, receives instruction himself
without lessening mine; as he who lights his taper at mine,
receives light without darkening me. -- Thomas Jefferson