just curiosity: AI image analysis ?

[Michael Miller]

Hi Daniel,
I agree.  That would be wonderful.

Unfortunately, there are 2 roadblocks keeping digiKam from being able to accomplish this: local processing power and AI model availability.

The auto-tagging models in digiKam can accomplish a small portion of this by identifying objects in images like cars, people, animals, etc (YOLOv11 models), and can also identify some compositional elements like lakeshores, mountains, sand dunes, etc (EfficientNetB7 model).  These models are the best available at the moment that can be run somewhat effectively on a person’s computer.  There are much better models, but those models require massive computing power that’s not really available on most home computers.  Additionally, the more powerful models are typically proprietary to the vendor and require a license fee.  Since digiKam is open source, we’re limited to freely available models.

I’m always looking for new models to help with enriching image metadata.  Anything we can do to add more and better tags helps with organizing our libraries.

Cheers,
Mike

> On Mar 29, 2025, at 2:26 PM, Daniel Bauer <linux at daniel-bauer.com> wrote:
>
> Hi,
>
> I read now and then here about face recognition. For me personally this is not interesting, as my archive is ordered by persons.
>
> But what would be really fantastic would be "general image content analysis" using *local* AI.
>
> Like, for example, searching for images that contain
> - a group of persons
> - mountains in the background
> - a person with a teddybaer
> - somebody wearing a red shirt
> - somebody sleeping/laughing/sitting/running
> etc.
>
> Of course, google, fakebook, X etc. can analyze the content of images this way, and very precise, but the (poor) tools available for the public only work with uploaded images, which, besides of all the data protection questions, means "giving them away".
>
> A local AI (without uploading any data to anywhere) with such capabilities would be simply mind-blowing.
>
> I have no idea if something like this is even possible, of if it is already planned for the future of digikam, but maybe my post here brings somebody to the idea, and who knows?
>
> Have a nice weekend.
>
> Daniel
>
>
>
>
> --
> Daniel Bauer photographer Basel Málaga
> Twitter: @Marsfotografo (often explicit nudes)
> https://www.patreon.com/danielbauer
> https://www.daniel-bauer.com/ (nudes)
>