<html>
<body>
<div style="font-family: Verdana, Arial, Helvetica, Sans-Serif;">
<table bgcolor="#f9f3c9" width="100%" cellpadding="8" style="border: 1px #c9c399 solid;">
<tr>
<td>
This is an automatically generated e-mail. To reply, visit:
<a href="https://git.reviewboard.kde.org/r/114717/">https://git.reviewboard.kde.org/r/114717/</a>
</td>
</tr>
</table>
<br />
<blockquote style="margin-left: 1em; border-left: 2px solid #d0d0d0; padding-left: 10px;">
<p style="margin-top: 0;">On December 29th, 2013, 4:39 p.m. UTC, <b>Àlex Fiestas</b> wrote:</p>
<blockquote style="margin-left: 1em; border-left: 2px solid #d0d0d0; padding-left: 10px;">
<pre style="white-space: pre-wrap; white-space: -moz-pre-wrap; white-space: -pre-wrap; white-space: -o-pre-wrap; word-wrap: break-word;">I wonder if we could use https://code.google.com/p/chromium-compact-language-detector/, apparently it is known to be really small, fast and contained, what do you think?</pre>
</blockquote>
</blockquote>
<pre style="white-space: pre-wrap; white-space: -moz-pre-wrap; white-space: -pre-wrap; white-space: -o-pre-wrap; word-wrap: break-word;">It probably has better detection (uses quadgraphs instead of trigraphs), and covers more languages, but it hardly looks "compact", with the cld2_generated_quad0720.cc file being over 20 megabytes large :)</pre>
<br />
<p>- Christoph</p>
<br />
<p>On December 29th, 2013, 4:49 a.m. UTC, Martin Tobias Holmedahl Sandsmark wrote:</p>
<table bgcolor="#fefadf" width="100%" cellspacing="0" cellpadding="8" style="background-image: url('https://git.reviewboard.kde.org/static/rb/images/review_request_box_top_bg.ab6f3b1072c9.png'); background-position: left top; background-repeat: repeat-x; border: 1px black solid;">
<tr>
<td>
<div>Review request for kdelibs and KDEPIM.</div>
<div>By Martin Tobias Holmedahl Sandsmark.</div>
<p style="color: grey;"><i>Updated Dec. 29, 2013, 4:49 a.m.</i></p>
<div style="margin-top: 1.5em;">
<b style="color: #575012; font-size: 10pt;">Repository: </b>
sonnet
</div>
<h1 style="color: #575012; font-size: 10pt; margin-top: 1.5em;">Description </h1>
<table width="100%" bgcolor="#ffffff" cellspacing="0" cellpadding="10" style="border: 1px solid #b8b5a0">
<tr>
<td>
<pre style="margin: 0; padding: 0; white-space: pre-wrap; white-space: -moz-pre-wrap; white-space: -pre-wrap; white-space: -o-pre-wrap; word-wrap: break-word;">I started by merging in the old language detection branch from SVN, while improving it as I went along. One improvement was to use QChar's unicode information instead of shipping our own unicode code point information tables. The old filter class also got replaced with a new tokenizer, which I rewrote most of to simplify.
I added kdepim to the reviewers because I remember talking with someone working on PIM stuff on IRC, and he was interested in this (a long time ago, though).</pre>
</td>
</tr>
</table>
<h1 style="color: #575012; font-size: 10pt; margin-top: 1.5em;">Testing </h1>
<table width="100%" bgcolor="#ffffff" cellspacing="0" cellpadding="10" style="border: 1px solid #b8b5a0">
<tr>
<td>
<pre style="margin: 0; padding: 0; white-space: pre-wrap; white-space: -moz-pre-wrap; white-space: -pre-wrap; white-space: -o-pre-wrap; word-wrap: break-word;">mostly using test_highlighter.</pre>
</td>
</tr>
</table>
<h1 style="color: #575012; font-size: 10pt; margin-top: 1.5em;">Diffs</b> </h1>
<ul style="margin-left: 3em; padding-left: 0;">
<li>data/trigrams/ja <span style="color: grey">(PRE-CREATION)</span></li>
<li>data/trigrams/kk <span style="color: grey">(PRE-CREATION)</span></li>
<li>data/trigrams/ko <span style="color: grey">(PRE-CREATION)</span></li>
<li>data/trigrams/ky <span style="color: grey">(PRE-CREATION)</span></li>
<li>data/trigrams/la <span style="color: grey">(PRE-CREATION)</span></li>
<li>data/trigrams/lt <span style="color: grey">(PRE-CREATION)</span></li>
<li>data/trigrams/lv <span style="color: grey">(PRE-CREATION)</span></li>
<li>data/trigrams/mk <span style="color: grey">(PRE-CREATION)</span></li>
<li>data/trigrams/mn <span style="color: grey">(PRE-CREATION)</span></li>
<li>data/trigrams/nb <span style="color: grey">(PRE-CREATION)</span></li>
<li>data/trigrams/ne <span style="color: grey">(PRE-CREATION)</span></li>
<li>data/trigrams/nl <span style="color: grey">(PRE-CREATION)</span></li>
<li>data/trigrams/nr <span style="color: grey">(PRE-CREATION)</span></li>
<li>data/trigrams/pl <span style="color: grey">(PRE-CREATION)</span></li>
<li>data/trigrams/ps <span style="color: grey">(PRE-CREATION)</span></li>
<li>data/trigrams/pt <span style="color: grey">(PRE-CREATION)</span></li>
<li>data/trigrams/pt_BR <span style="color: grey">(PRE-CREATION)</span></li>
<li>data/trigrams/pt_PT <span style="color: grey">(PRE-CREATION)</span></li>
<li>data/trigrams/ro <span style="color: grey">(PRE-CREATION)</span></li>
<li>data/trigrams/ru <span style="color: grey">(PRE-CREATION)</span></li>
<li>data/trigrams/sk <span style="color: grey">(PRE-CREATION)</span></li>
<li>data/trigrams/sl <span style="color: grey">(PRE-CREATION)</span></li>
<li>data/trigrams/so <span style="color: grey">(PRE-CREATION)</span></li>
<li>data/trigrams/sq <span style="color: grey">(PRE-CREATION)</span></li>
<li>data/trigrams/sr <span style="color: grey">(PRE-CREATION)</span></li>
<li>data/trigrams/ss <span style="color: grey">(PRE-CREATION)</span></li>
<li>data/trigrams/st <span style="color: grey">(PRE-CREATION)</span></li>
<li>data/trigrams/sv <span style="color: grey">(PRE-CREATION)</span></li>
<li>data/trigrams/sw <span style="color: grey">(PRE-CREATION)</span></li>
<li>data/trigrams/th <span style="color: grey">(PRE-CREATION)</span></li>
<li>data/trigrams/tl <span style="color: grey">(PRE-CREATION)</span></li>
<li>data/trigrams/tn <span style="color: grey">(PRE-CREATION)</span></li>
<li>data/trigrams/tr <span style="color: grey">(PRE-CREATION)</span></li>
<li>data/trigrams/ts <span style="color: grey">(PRE-CREATION)</span></li>
<li>data/trigrams/uk <span style="color: grey">(PRE-CREATION)</span></li>
<li>data/trigrams/ur <span style="color: grey">(PRE-CREATION)</span></li>
<li>data/trigrams/uz <span style="color: grey">(PRE-CREATION)</span></li>
<li>data/trigrams/ve <span style="color: grey">(PRE-CREATION)</span></li>
<li>data/trigrams/vi <span style="color: grey">(PRE-CREATION)</span></li>
<li>data/trigrams/xh <span style="color: grey">(PRE-CREATION)</span></li>
<li>data/trigrams/zu <span style="color: grey">(PRE-CREATION)</span></li>
<li>sonnet.yaml <span style="color: grey">(c54f87b)</span></li>
<li>src/CMakeLists.txt <span style="color: grey">(e79492f)</span></li>
<li>src/core/CMakeLists.txt <span style="color: grey">(2f8a184)</span></li>
<li>src/core/backgroundchecker.cpp <span style="color: grey">(8b9e983)</span></li>
<li>src/core/backgroundchecker_p.h <span style="color: grey">(PRE-CREATION)</span></li>
<li>src/core/backgroundengine.cpp <span style="color: grey">(3a14d34)</span></li>
<li>src/core/backgroundengine_p.h <span style="color: grey">(10f6a27)</span></li>
<li>src/core/client_p.h <span style="color: grey">(bd3e416)</span></li>
<li>src/core/filter.cpp <span style="color: grey">(e99d332)</span></li>
<li>src/core/filter_p.h <span style="color: grey">(6c7d8c9)</span></li>
<li>src/core/globals.h <span style="color: grey">(0c54c96)</span></li>
<li>src/core/globals.cpp <span style="color: grey">(e57450f)</span></li>
<li>src/core/guesslanguage.h <span style="color: grey">(PRE-CREATION)</span></li>
<li>src/core/guesslanguage.cpp <span style="color: grey">(PRE-CREATION)</span></li>
<li>src/core/languagefilter.cpp <span style="color: grey">(PRE-CREATION)</span></li>
<li>src/core/languagefilter_p.h <span style="color: grey">(PRE-CREATION)</span></li>
<li>src/core/loader.cpp <span style="color: grey">(ee8db0e)</span></li>
<li>src/core/settings.cpp <span style="color: grey">(095eddb)</span></li>
<li>src/core/settings_p.h <span style="color: grey">(ee2d22c)</span></li>
<li>src/core/speller.h <span style="color: grey">(7428339)</span></li>
<li>src/core/speller.cpp <span style="color: grey">(8cc2a1e)</span></li>
<li>src/core/textbreaks.cpp <span style="color: grey">(PRE-CREATION)</span></li>
<li>src/core/textbreaks_p.h <span style="color: grey">(PRE-CREATION)</span></li>
<li>src/core/tokenizer.cpp <span style="color: grey">(PRE-CREATION)</span></li>
<li>src/core/tokenizer_p.h <span style="color: grey">(PRE-CREATION)</span></li>
<li>src/plugins/CMakeLists.txt <span style="color: grey">(fc33a97)</span></li>
<li>src/plugins/aspell/kspell_aspellclient.h <span style="color: grey">(eadb52a)</span></li>
<li>src/plugins/enchant/CMakeLists.txt <span style="color: grey">(817db0c)</span></li>
<li>src/plugins/enchant/enchantclient.h <span style="color: grey">(25f62eb)</span></li>
<li>src/plugins/hspell/CMakeLists.txt <span style="color: grey">(e128cb3)</span></li>
<li>src/plugins/hspell/kspell_hspellclient.h <span style="color: grey">(966303f)</span></li>
<li>src/plugins/hunspell/CMakeLists.txt <span style="color: grey">(ccae7f7)</span></li>
<li>src/plugins/hunspell/kspell_hunspellclient.h <span style="color: grey">(79638bb)</span></li>
<li>src/ui/configui.ui <span style="color: grey">(6532552)</span></li>
<li>src/ui/configwidget.cpp <span style="color: grey">(7a5cc99)</span></li>
<li>src/ui/dialog.cpp <span style="color: grey">(13ad39d)</span></li>
<li>src/ui/highlighter.h <span style="color: grey">(46418b9)</span></li>
<li>src/ui/highlighter.cpp <span style="color: grey">(9f31268)</span></li>
<li>src/unicode/CMakeLists.txt <span style="color: grey">(1be0a54)</span></li>
<li>src/unicode/README <span style="color: grey">(f9b8030)</span></li>
<li>src/unicode/data/GraphemeBreakProperty.txt <span style="color: grey">(8805f36)</span></li>
<li>src/unicode/data/SentenceBreakProperty.txt <span style="color: grey">(fc58820)</span></li>
<li>src/unicode/data/WordBreakProperty.txt <span style="color: grey">(78c531c)</span></li>
<li>src/unicode/parseucd/parseucd.cpp <span style="color: grey">(a050140)</span></li>
<li>tests/test_dialog.cpp <span style="color: grey">(0579bb2)</span></li>
<li>tests/test_highlighter.h <span style="color: grey">(9cf5657)</span></li>
<li>tests/test_highlighter.cpp <span style="color: grey">(695a2df)</span></li>
<li>tests/test_textedit.cpp <span style="color: grey">(5c02809)</span></li>
<li>data/trigrams/fr <span style="color: grey">(PRE-CREATION)</span></li>
<li>data/trigrams/ha <span style="color: grey">(PRE-CREATION)</span></li>
<li>data/trigrams/hi <span style="color: grey">(PRE-CREATION)</span></li>
<li>data/trigrams/hr <span style="color: grey">(PRE-CREATION)</span></li>
<li>data/trigrams/hu <span style="color: grey">(PRE-CREATION)</span></li>
<li>data/trigrams/id <span style="color: grey">(PRE-CREATION)</span></li>
<li>data/trigrams/is <span style="color: grey">(PRE-CREATION)</span></li>
<li>data/trigrams/it <span style="color: grey">(PRE-CREATION)</span></li>
<li>data/parsetrigrams.cpp <span style="color: grey">(PRE-CREATION)</span></li>
<li>data/trigrams/af <span style="color: grey">(PRE-CREATION)</span></li>
<li>data/trigrams/ar <span style="color: grey">(PRE-CREATION)</span></li>
<li>data/trigrams/az <span style="color: grey">(PRE-CREATION)</span></li>
<li>data/trigrams/bg <span style="color: grey">(PRE-CREATION)</span></li>
<li>data/trigrams/ca <span style="color: grey">(PRE-CREATION)</span></li>
<li>data/trigrams/cs <span style="color: grey">(PRE-CREATION)</span></li>
<li>data/trigrams/cy <span style="color: grey">(PRE-CREATION)</span></li>
<li>data/trigrams/da <span style="color: grey">(PRE-CREATION)</span></li>
<li>data/trigrams/de <span style="color: grey">(PRE-CREATION)</span></li>
<li>data/trigrams/en <span style="color: grey">(PRE-CREATION)</span></li>
<li>data/trigrams/es <span style="color: grey">(PRE-CREATION)</span></li>
<li>data/trigrams/et <span style="color: grey">(PRE-CREATION)</span></li>
<li>data/trigrams/eu <span style="color: grey">(PRE-CREATION)</span></li>
<li>data/trigrams/fa <span style="color: grey">(PRE-CREATION)</span></li>
<li>data/trigrams/fi <span style="color: grey">(PRE-CREATION)</span></li>
<li>CMakeLists.txt <span style="color: grey">(1fdcf1e)</span></li>
<li>README.md <span style="color: grey">(63e2c6a)</span></li>
<li>autotests/CMakeLists.txt <span style="color: grey">(e9fc573)</span></li>
<li>data/CMakeLists.txt <span style="color: grey">(PRE-CREATION)</span></li>
</ul>
<p><a href="https://git.reviewboard.kde.org/r/114717/diff/" style="margin-left: 3em;">View Diff</a></p>
</td>
</tr>
</table>
</div>
</body>
</html>