[Digikam-devel] Collection Scanning of Specific Directories

[Todd Goodman]

* Marcel Wiesweg <marcel.wiesweg at gmx.de> [100628 07:05]:
> > > > I have a large number of pictures spread out over a number of
> > > > directories.
> > > 
> > > 10^6? 10^7?
> > 
> > About 5.5million
> > 
> 
> Ok, this explains it. That's a lot indeed.
> The complete scan is performed within one database transaction, so the changes 
> become public only afterwards, and we need to store change notifications. That 
> works, but afterwards, with the current simple solution, notifications are 
> sent out one by one instead of collapsing them. This is when you run out of 
> memory.
> I can try to optimize this situation.
> 
> Please note: These are a lot of pictures. It would be interesting where 
> digikam is hitting walls here ;-) Some operations require linear memory, e.g. 
> if you want to display all of your pictures in the view, the view will keep a 
> list of all entries in the collection, and the sort-filter model will also 
> need memory to do the sorting.


Thanks Marcel.  If I can help let me know.  It would be nice to perform
the transaction every N files.

I'll certainly keep an eye out for other things.  Once I'm up and
running I generally operate in subdirectories but will be happy to try
anything you'd like.

Thanks,

Todd