[Digikam-devel] [Bug 216145] New: Infinite Loop when scanning large folders

[David H]

https://bugs.kde.org/show_bug.cgi?id=216145

           Summary: Infinite Loop when scanning large folders
           Product: digikam
           Version: unspecified
          Platform: Gentoo Packages
        OS/Version: Linux
            Status: UNCONFIRMED
          Severity: crash
          Priority: NOR
         Component: general
        AssignedTo: digikam-devel at kde.org
        ReportedBy: kde-bugzilla at dharty.com


Version:           digikam-0.10.0-r1 (using KDE 4.3.3)
OS:                Linux
Installed from:    Gentoo Packages

A user was having problems (unrelated to digikam) with her KDE4.3.3 plasma
workspace.  We had recently upgraded the systems from kde3.5.  I moved her
.kde4 directory to a backup location and logged her in again.  This fixed the
desktop problems we were having but of course all of her previous [application]
settings had to be redone.

We started digikam and pointed it at her "Pictures" directory.  
The users "Pictures" folder had a link to a network drive with 19G of images in
it: eg

./Pictures (digikam images folder)
    digikamdb.4 (200M+)
    SomeLocalFolders
    LinkToNetworkFolder (19G)


The digikam dialog said it was scanning images in the folders.  This went on
for hours.  I noticed the digikam4.db file was reaching several hundred
megabytes in size.  Eventually the information at the bootom of this message
started coming out slowly.  I let it run for a while until I noticed the
message sets repeating (after about 257 messages) at which point I killed the
process.

As mentioned earlier the users "Pictures" folder had a link to a network drive
with 19G of images in it: eg

./Pictures (digikam images folder)
    digikamdb.4 (200M+)
    SomeLocalFolders
    LinkToNetworkFolder (19G)

When I removed the link, the program was able to start correctly, and the
digikamdb.4 file returned to a sane size (279k).

There are other users on the network with access to the same network folder in
a setup similar to the structure listed above (and same KDE and digikam
versions).  Their .db files are on the order of 5M or so.

This particular users digikam had been working fine previously.  I tried
replacing her ./share/apps/digikam and ./share/config/digikamrc with files from
her original .kde4 directory to see if it helped, but the same errors occurred.

Below is the repeating section of output created by digikam while "Scanning the
folders".  I have removed some [200] of the repeating lines and added some
comments inside brackets < like this >:

Note
------------------ output ------------------------
$digikam

<pause of several minutes while dialog indicates folders are being scanned >

Warning: Directory OlympusCs, entry 0x0101: Strip 0 is outside of the data
area; ignored. 
Warning: No image data to encode Exif.OlympusCs.PreviewImageStart.  
Warning: Directory OlympusCs, entry 0x0101: Strip 0 is outside of the data
area; ignored. 
Warning: No image data to encode Exif.OlympusCs.PreviewImageStart. 

< there is no OlympusCs directory in any of the images folders >
< this message repeats some 200 times >

Warning: Directory OlympusCs, entry 0x0101: Strip 0 is outside of the data
area; ignored. 
Warning: No image data to encode Exif.OlympusCs.PreviewImageStart.  
Warning: Directory OlympusCs, entry 0x0101: Strip 0 is outside of the data
area; ignored. 
Warning: No image data to encode Exif.OlympusCs.PreviewImageStart.  
libpng warning: zTXt: CRC error 
libpng warning: zTXt: CRC error 
libpng warning: zTXt: CRC error 
libpng warning: zTXt: CRC error 
Warning: XMP toolkit support not compiled in. 
Warning: Failed to decode XMP metadata. 
Warning: XMP toolkit support not compiled in. 
Warning: Failed to decode XMP metadata. 
Warning: XMP toolkit support not compiled in. 
Warning: Failed to decode XMP metadata. 
Warning: XMP toolkit support not compiled in. 
Warning: Failed to decode XMP metadata. 
Warning: XMP toolkit support not compiled in. 
Warning: Failed to decode XMP metadata. 
Warning: Directory NikonPreview, entry 0x0201: Data area exceeds data buffer,
ignoring it.
Error: Directory NikonPreview with 2020 entries considered invalid; not read. 
Error: Directory Sony with 1c00 entries considered invalid; not read. 
Error: Directory Sony with 1c00 entries considered invalid; not read. 
Error: Directory Sony with 1c00 entries considered invalid; not read. 
Error: Directory Sony with 1c00 entries considered invalid; not read. 
Error: Directory Sony with 1c00 entries considered invalid; not read. 
Error: Directory Sony with 1c00 entries considered invalid; not read. 
Error: Directory Sony with 1c00 entries considered invalid; not read. 
Error: Directory Sony with 1c00 entries considered invalid; not read. 
Error: Directory Sony with 1c00 entries considered invalid; not read. 
Error: Directory Sony with 1c00 entries considered invalid; not read. 
Error: Directory Sony with 1c00 entries considered invalid; not read. 
Error: Directory Sony with 1c00 entries considered invalid; not read. 
Error: Directory Sony with 1c00 entries considered invalid; not read. 
Error: Directory Sony with 1c00 entries considered invalid; not read. 
Error: Directory Sony with 1c00 entries considered invalid; not read. 
Error: Directory Sony with 1c00 entries considered invalid; not read. 
Error: Directory NikonPreview with 2020 entries considered invalid; not read. 
Warning: Directory NikonPreview, entry 0x0201: Data area exceeds data buffer,
ignoring it.
Error: Directory NikonPreview with 2020 entries considered invalid; not read. 
Error: Directory NikonPreview with 2020 entries considered invalid; not read. 
Warning: Directory NikonPreview, entry 0x0201: Data area exceeds data buffer,
ignoring it.
Warning: Directory NikonPreview, entry 0x0201: Data area exceeds data buffer,
ignoring it.
Warning: XMP toolkit support not compiled in. 
Warning: Failed to decode XMP metadata. 
Warning: XMP toolkit support not compiled in. 
Warning: Failed to decode XMP metadata. 

< then the process starts over again >

Warning: Directory OlympusCs, entry 0x0101: Strip 0 is outside of the data
area; ignored. 
Warning: No image data to encode Exif.OlympusCs.PreviewImageStart.  

< ... >


------------------end output ---------------------

-- 
Configure bugmail: https://bugs.kde.org/userprefs.cgi?tab=email
------- You are receiving this mail because: -------
You are the assignee for the bug.