Hi Mahesh,<div><br></div><div>since you already posted it here - I'm (sort of) leading the effort of integrating PIMO persons into KDE and it would be super awesome if you've contacted me once you start working on it. However note that I've already looked into exactly this in digiKam and it turned out you'd need to port the entire nepomuk implementation in digiKam which still uses rather old implementation to a newer DMS, which is not exactly trivial and in my opinion is a project for at least half of gsoc.</div>
<div><br></div><div>In any case, let me know, I'll try to help you out :)<br clear="all"><div><br></div>--<div><font color="#666666">Martin Klapetek | KDE Developer</font></div><br>
<br><br><div class="gmail_quote">On Tue, Mar 27, 2012 at 22:50, Mahesh Hegde <span dir="ltr"><<a href="mailto:maheshmhegade@gmail.com">maheshmhegade@gmail.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div><b>Project</b>: Face Recognition</div><div><br></div><div><b>Name</b> :Mahesh M Hegde</div><div><br></div><div><b>E-mail</b> :<a href="mailto:maheshmhegade@gmail.com" style="color:rgb(17,85,204)" target="_blank">maheshmhegade@gmail.com</a></div>
<div><br></div><div><b>Freenode/IRC</b> :mmh</div><div><br></div><div><b>Github</b>:<a href="http://goo.gl/Ivblf" target="_blank">http://goo.gl/Ivblf</a></div><div><br></div><div><b>Location </b>:Bangalore India</div>
<div><br></div><div><b>Motivation</b>:</div><div><br></div><div>Since Development is continuous process,integrating library like opentld not only solves face recognition bug,but also opens many possibilities for future development of Digikam,</div>
<div>for instance i can extend face recognition idea to general object recognition.I believe adding feature like face recognition and automatic taging which is most requested feature for digikam(492 votes in KDE bugzilla),add to user experience a lot.It was long time desire to be developer of image editor or part of it.</div>
<div><br></div><div><b>Proposal Title</b>: Face Recognition, and tagging in digiKam</div><div><br></div><div><b>Implementation</b>: </div><div><br></div><div>Digikam already has face detection for most of posture of faces for images from album.Also has UI interface for mannual taging with Name string.But this information is not being used for recognitionising faces in new images.This task needs Face Recognition using modified version of OpenTLD.</div>
<div><br></div><div>OpenTLD is opensource algorithm and <b>working principle</b> is as below:</div><div>As soon as we provide template for tracking object,it initialises intial training parameters and confidence parameter.Model consists of growing event and proning event,proning event focusses on providing negative examples to denoise growing event.Detector and Tracker are key concepts in this algorithm since they agree upon position of object of interest.</div>
<div>I communicated with the author of this algorithm who actually has implemented kind of face recognition from a webcam video stream.I discussed briefly with regard to our digikam project with him,for sure he will be helping us if we face any abstacles.</div>
<div><br></div><div>Face recognition is crucial part of the project which needs to be very accurate and precise.Track learn detect is most suitable algorithm for Face Recognition.Even though its kind of predator based algorithm,its differs a lot from classical approach,it is pretty new algorithm(designed in 2011) works very nice with any kind of objects.TLD uses combination of haar waveletts and local binary patterns as basis of feature space.Its invariance to illumination and still captures sufficient structural information.It has confidence parameter which provides possibilities of varying accuracy-computation trdeoff.</div>
<div><br></div><div><br></div><div>We are not using tracking part of this algorithm as we have already implented face detection.OpenTLD implementation is available in cpp.I will be modifying and using this library for specific object(Face) Recognition.General implementation flow will be storing new Face feature vectors in database and comparing and finding minimum distance and percent of accuracy with input intensity normalised patch feature vector.</div>
<div><br></div><div>Digikam already has face detection may with very minute bugs i guess,ui interface for each detected faces.Tags on regions of image needs coordinates defining region,which can be obtained during face detection itself.</div>
<div><br></div><div>PIMO person ontology and NCO contact ontology feature will be added for taging,for this purpose i will take help from digiKam team and also from my friend who was last year Nepomuk gsocer and developer.</div>
<div><br></div><div>Optionally adding feature to detect birds,animal and commonly used objects.</div><div><br></div><div><b>Tentative Timeline</b>: </div><div><br></div><div>24th April to 10th May:Go through Digikam internal architecture,components coordination and source code related to taging so far.</div>
<div><br></div><div>10th May to 25th May:Work on OpenTLD digikam integration.Library related stuff and get rid of mannual selection of image template of opentld.Extending one region selection to many region(faces).</div>
<div><br></div><div>25th June to 10th June:Storing feature space of manually tagged templates(faces).And checking and polishing functionality by giving "real"stuff,new face detected image.</div><div>
<br></div><div>10th june to 25 june:Checking for best optional features that can be added to improve recognition on cost of computation.</div><div><br></div><div>25th june to 10th july:Finalising feature considerations,integrating with Nepomuk may be PIMO person or NCO contact or both of them.</div>
<div><br></div><div>11th july to 30th july:Removing irrelevent portion opentld source code i.e tracking/predator portion of code,achieving stable recognition.</div><div><br></div><div>1st aug to ...:Continue developing Digikam by adding more features like testing performance in detecting birds,animals and objects through haar classifier which later on can be used for wiki page integration.</div>
<div><br></div><div><b>About Me:</b></div><div><br></div><div>I am third year telecommunication engineering student of Peoples Education Society Institute of Tecnology(PESIT) india.Very passionate about image processing.I love playing chess which is one of my hobby.I am extremely interested in arteficial neural network.I have developed basic image editor in matlab guide framework a year ago,now Source code can be found here:<a href="http://goo.gl/OERwN" style="color:rgb(17,85,204)" target="_blank">http://goo.gl/OERwN</a> screen shots can be found here:<a href="http://goo.gl/X7WOr" style="color:rgb(17,85,204)" target="_blank">http://goo.gl/X7WOr</a></div>
<div><br></div><div><br></div><div>I was advanced track student of machine learning which was offered online for free,a few months ago by Andrew NG(stanford lecturer),where i got opportunity to programme in octave(matlab equivalent) on interesting systems like handwritten number/character recognition,eigen face(principle component analysis) recognition,email-spam classification, recommender systems and lot more.</div>
<div><br></div><div>I am familiar with KDE,c++ and Qt and matlab/octave.I am good at Linear Algebra,algorithms and machine learing.</div><div><br></div><div>I am part of ARKA 2012 2 day event which includes 1 day technical workshop on opensource technologies and a 24 hour Hackathon for all opensource enthusiasts.I freequently attend FSMK(free software movement karnataka) sessions.</div>
<div><br></div><div>expecting suggesions from you</div>
<br>_______________________________________________<br>
Digikam-devel mailing list<br>
<a href="mailto:Digikam-devel@kde.org">Digikam-devel@kde.org</a><br>
<a href="https://mail.kde.org/mailman/listinfo/digikam-devel" target="_blank">https://mail.kde.org/mailman/listinfo/digikam-devel</a><br>
<br></blockquote></div><br></div>