<div dir="ltr">Hi John,<div><br></div><div>The RGB ones have a few nice images, but most images have a lot of artifacts, so I think it's better to stay with your initial monochrome version for now. Thanks for the awesome contribution John! I think it is great as it is now.</div><div><br></div><div>Regards,</div><div>Jasem</div><div><br></div></div><div class="gmail_extra"><br><div class="gmail_quote">On Wed, Apr 19, 2017 at 7:25 PM, John S. <span dir="ltr"><<a href="mailto:myxlflik@hotmail.com" target="_blank">myxlflik@hotmail.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div dir="ltr">
<div id="m_-8417383449373530433divtagdefaultwrapper" style="font-size:12pt;color:#000000;font-family:Calibri,Arial,Helvetica,sans-serif" dir="ltr">
<p>All,</p>
<p><br>
</p>
<p>I tweaked the settings as much as I could and I did a run of the NGC objects to see how many of them came out usable. I used data from the DSS1R for RED, DSS for GREEN and DSS1B for BLUE. I used the same sizing parameters for the original monochrome pulls.</p>
<p><br>
</p>
<p>I am attaching a link to the onedrive shared file for you guys to pull and review:</p>
<p><a href="https://1drv.ms/u/s!AnSnRFrNRtfXviM4XnBnN9neLucR" class="m_-8417383449373530433OWAAutoLink" id="m_-8417383449373530433LPlnk668328|2:odcLink" target="_blank">https://1drv.ms/u/s!<wbr>AnSnRFrNRtfXviM4XnBnN9neLucR</a></p>
<p><br>
</p>
<p>You will probably notice quite a few of the images have a yellow or green overall appearance. I am not 100% sure if that is because of missing data or the histeq method I chose this time. Probably a bit of both. <br>
</p>
<br>
<p>Some of the images appear to be quite usable like the attached NGC1432 and NGC2024. That being said, many of the objects came out like NGC10, NGC40 and NGC56. There are also ones that have significant source data issues like NGC101.</p>
<p><br>
</p>
<p>My question to the group is this, Do we feel there is enough good picture data like 1432 and 2024 to warrant the time and effort to comb through the 7840 objects to get the color objects out and include them in the mix. Once we identify the 'good' data
images, I have to rename and convert them to PNG for inclusion. I would also intend to split up the excel spreadsheet so that the ones we deemed worthy would be pulled in RGB if we ever needed to pull them again. The remaining black and white images would
be either candidates for further experimentation to get the color data right in them or they would be left as monochrome in the thumbnails collection.</p>
<p><br>
</p>
<p>Please weigh in on this and also let me know if you would be willing to QA these images and give me a listing of the good ones you find. This is a fairly time consuming effort and I would like some help as well as guidance on what others feel are decent
images or not.</p><span class="HOEnZb"><font color="#888888">
<p><br>
</p>
<p>John<br>
</p>
</font></span><div class="hm HOEnZb"><p><br>
</p>
<br>
</div><div style="color:rgb(0,0,0)"><div class="hm HOEnZb">
<hr style="display:inline-block;width:98%">
</div><div id="m_-8417383449373530433divRplyFwdMsg" dir="ltr"><font style="font-size:11pt" face="Calibri, sans-serif" color="#000000"><div class="hm HOEnZb"><b>From:</b> John S. <<a href="mailto:myxlflik@hotmail.com" target="_blank">myxlflik@hotmail.com</a>><br>
<b>Sent:</b> Tuesday, April 18, 2017 3:01 PM</div><div><div class="h5"><br>
<b>To:</b> Jasem Mutlaq; KStars Development Mailing List<br>
<b>Subject:</b> Re: NGC Thumbnails</div></div></font>
<div> </div>
</div><div><div class="h5">
<div>
<div id="m_-8417383449373530433divtagdefaultwrapper" dir="ltr" style="font-size:12pt;color:#000000;font-family:Calibri,Arial,Helvetica,sans-serif">
<p>Jasem,</p>
<p><br>
</p>
<p>You can use my last name (Sadler) for the credit on the packages. I played around with the data some more and have gotten a few images to come out acceptably, but most of completely out of balance when you convert them to RGB. I think I found out why.
One of my underlying assumptions about the DSS data appears to be incorrect. Although the original DSS survey is monochrome, it does not appear to be filtered. It appears to be visible light. Obviously when you assign full spectrum to one channel it's going
to play all kinds of havok with the balance of the channels. I am not certain if there is a practical way to deal with the data, but perhaps a 'green' channel can be extracted by subtracting the red and blue channels from the DSS green channel. This all
would require significant effort but may yield results and be worthwhile if we can find a way to do it in a batch manner. I can certainly pull all three channels separately and start playing to see if I get any kind of real results. I will let you know what
I find out.</p>
<p><br>
</p>
<p>John<br>
</p>
<br>
<br>
<div style="color:rgb(0,0,0)">
<hr style="display:inline-block;width:98%">
<div id="m_-8417383449373530433divRplyFwdMsg" dir="ltr"><font style="font-size:11pt" face="Calibri, sans-serif" color="#000000"><b>From:</b> John S. <<a href="mailto:myxlflik@hotmail.com" target="_blank">myxlflik@hotmail.com</a>><br>
<b>Sent:</b> Tuesday, April 18, 2017 9:27 AM<br>
<b>To:</b> Jasem Mutlaq; KStars Development Mailing List<br>
<b>Subject:</b> Re: NGC Thumbnails</font>
<div> </div>
</div>
<div>
<div id="m_-8417383449373530433divtagdefaultwrapper" dir="ltr" style="font-size:12pt;color:#000000;font-family:Calibri,Arial,Helvetica,sans-serif">
<p>Great. I am continuing to tweak and play with settings on the object pulls to see if I can get better data. The problem I think is that they don't have a setting to adjust the levels and it seems like the blue channel is too weak overall to make for a
proper color balance. The last thing I want to do here is manually adjust 13000 images. Even with a batch process it feels like a lot of effort. I will keep you posted as to what I find. I will start 'versioning' the tarball files as I change them so that
you will know if it's newer than what you have now.<br>
</p>
<br>
<br>
<div style="color:rgb(0,0,0)">
<hr style="display:inline-block;width:98%">
<div id="m_-8417383449373530433divRplyFwdMsg" dir="ltr"><font style="font-size:11pt" face="Calibri, sans-serif" color="#000000"><b>From:</b> Kstars-devel <<a href="mailto:kstars-devel-bounces@kde.org" target="_blank">kstars-devel-bounces@kde.org</a>> on behalf of Jasem Mutlaq <<a href="mailto:mutlaqja@ikarustech.com" target="_blank">mutlaqja@ikarustech.com</a>><br>
<b>Sent:</b> Tuesday, April 18, 2017 8:13 AM<br>
<b>To:</b> KStars Development Mailing List<br>
<b>Subject:</b> Re: NGC Thumbnails</font>
<div> </div>
</div>
<div>
<div dir="ltr">Yup we can publish an updated version if we get better data</div>
<div class="gmail_extra"><br>
<div class="gmail_quote">On Tue, Apr 18, 2017 at 2:59 PM, John S. <span dir="ltr">
<<a href="mailto:myxlflik@hotmail.com" target="_blank">myxlflik@hotmail.com</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div dir="ltr">
<div id="m_-8417383449373530433m_7160945877431352804divtagdefaultwrapper" dir="ltr" style="font-size:12pt;color:#000000;font-family:Calibri,Arial,Helvetica,sans-serif">
<p>Oh wow. I thought you wanted to try to work on them some more. Assuming we can get better images for this, what will the process be to update this now that it is incorporated? Just publish a new version and have them download it via that data downloads
in Kstars?<br>
</p>
<br>
<br>
<div style="color:rgb(0,0,0)">
<hr style="display:inline-block;width:98%">
<div id="m_-8417383449373530433m_7160945877431352804divRplyFwdMsg" dir="ltr"><font style="font-size:11pt" face="Calibri, sans-serif" color="#000000"><b>From:</b> Jasem Mutlaq <<a href="mailto:mutlaqja@ikarustech.com" target="_blank">mutlaqja@ikarustech.com</a>><br>
<b>Sent:</b> Tuesday, April 18, 2017 4:38 AM<br>
<b>To:</b> John S.<br>
<b>Cc:</b> Hans; KStars Development Mailing List<br>
<b>Subject:</b> Re: NGC Thumbnails</font>
<div> </div>
</div>
<div>
<div class="m_-8417383449373530433h5">
<div>
<div dir="ltr">I just added them to KStars. I used your name "John S." and email address. Please let me know if you want to change any of those as they appear in the download dialog. I'll try to add previews as well since we do not have previews for _any_ download
before.</div>
<div class="gmail_extra"><br>
<div class="gmail_quote">On Mon, Apr 17, 2017 at 7:44 PM, John S. <span dir="ltr">
<<a href="mailto:myxlflik@hotmail.com" target="_blank">myxlflik@hotmail.com</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div dir="ltr">
<div id="m_-8417383449373530433m_7160945877431352804m_7936534728735227365divtagdefaultwrapper" dir="ltr" style="font-size:12pt;color:#000000;font-family:Calibri,Arial,Helvetica,sans-serif">
<p>Did anyone have any further input on this? Is it worth pursuing and adding to Kstars?<br>
</p>
<div class="m_-8417383449373530433m_7160945877431352804hm m_-8417383449373530433m_7160945877431352804HOEnZb"></div>
<p></p>
<div class="m_-8417383449373530433m_7160945877431352804hm m_-8417383449373530433m_7160945877431352804HOEnZb"><br>
<br>
</div>
<div style="color:rgb(0,0,0)">
<div class="m_-8417383449373530433m_7160945877431352804hm m_-8417383449373530433m_7160945877431352804HOEnZb">
<hr style="display:inline-block;width:98%">
</div>
<div id="m_-8417383449373530433m_7160945877431352804m_7936534728735227365divRplyFwdMsg" dir="ltr"><font style="font-size:11pt" face="Calibri, sans-serif" color="#000000">
<div class="m_-8417383449373530433m_7160945877431352804hm m_-8417383449373530433m_7160945877431352804HOEnZb"><b>From:</b> John S. <<a href="mailto:myxlflik@hotmail.com" target="_blank">myxlflik@hotmail.com</a>><br>
<b>Sent:</b> Saturday, April 15, 2017 11:00 AM</div>
<div>
<div class="m_-8417383449373530433m_7160945877431352804h5"><br>
<b>To:</b> Hans<br>
<b>Cc:</b> KStars Development Mailing List<br>
<b>Subject:</b> Re: NGC Thumbnails</div>
</div>
</font>
<div> </div>
</div>
<div>
<div class="m_-8417383449373530433m_7160945877431352804h5">
<div>
<div id="m_-8417383449373530433m_7160945877431352804m_7936534728735227365divtagdefaultwrapper" dir="ltr" style="font-size:12pt;color:#000000;font-family:Calibri,Arial,Helvetica,sans-serif">
<p>Here is a link to the current NGC file tarball and the rudimentary install and removal scripts. This has only been tested on Linux Mint, but suspect it will be fine on all versions:</p>
<p><a href="https://1drv.ms/u/s!AnSnRFrNRtfXviEYxBIM2pNlmuc6" class="m_-8417383449373530433m_7160945877431352804m_7936534728735227365OWAAutoLink" id="m_-8417383449373530433m_7160945877431352804m_7936534728735227365LPlnk121453|2:odcLink" target="_blank">https://1drv.ms/u/s!AnSnRFrNRt<wbr>fXviEYxBIM2pNlmuc6</a></p>
<p><br>
</p>
<p>Here is a link to the current IC file tarball. Same caveats as the NGC file:</p>
<p><a href="https://1drv.ms/u/s!AnSnRFrNRtfXviLmrzlp6Ru6N7KZ" class="m_-8417383449373530433m_7160945877431352804m_7936534728735227365OWAAutoLink" id="m_-8417383449373530433m_7160945877431352804m_7936534728735227365LPlnk131504|2:odcLink" target="_blank">https://1drv.ms/u/s!AnSnRFrNRt<wbr>fXviLmrzlp6Ru6N7KZ</a><br>
</p>
<br>
<p>The images are all of the DSS2R (Red Plate) survey only. There is an ability to pull data into RGB using the DSS2R, DSS and DSS2B surveys (or really any other combination for that matter). I have found that in nearly all cases, the colors needed subsequent
adjustment in order to make the images look palatable. I honestly felt the red channel ones and gray scale worked out just find overall. I know there are some outright bad images in there and I haven't had the time or inclination to weed through the 13,000
objects I pulled to clean it up as of yet. I can certainly do it, but it would largely depend on how strongly this group felt about it's inclusion. I agree it should be an add-on package and not part of the base install. We will need to make sure to credit
the sources of the images as well.</p>
<p><br>
</p>
<p>One thing we may need to consider is directory management. Downloading all of these images puts 13,000+ files in the $HOME/.local/share/kstars directory. That's a pretty good chunk of files for a single directory. I may make sense to compile these into
some sort of database file or put them in a directory structure. I am not a developer though and have NO skill when it comes to that aspect of this project.</p>
<p><br>
</p>
<p>John<br>
</p>
<div style="color:rgb(0,0,0)">
<div>
<hr style="display:inline-block;width:98%">
<div id="m_-8417383449373530433m_7160945877431352804m_7936534728735227365x_divRplyFwdMsg" dir="ltr"><font style="font-size:11pt" face="Calibri, sans-serif" color="#000000"><b>From:</b> John S. <<a href="mailto:myxlflik@hotmail.com" target="_blank">myxlflik@hotmail.com</a>><br>
<b>Sent:</b> Saturday, April 15, 2017 10:15 AM<br>
<b>To:</b> Hans<br>
<b>Cc:</b> KStars Development Mailing List<br>
<b>Subject:</b> Re: NGC Thumbnails</font>
<div> </div>
</div>
</div>
<font size="2"><span style="font-size:10pt">
<div class="m_-8417383449373530433m_7160945877431352804m_7936534728735227365PlainText">I started this project for my own personal gratification. I personally don't mind that some of the objects are subpar quality. Most of those objects are very interesting to me anyway. However,
I would like to make sure that it meets certain quality levels. I am open to input for how to rectify the situation. I believe the limits of the survey itself will limit the outlet quality though. If you want I'll post the links to the two tarballs for the
NGC and IC objects and you can download them a try for yourself.<br>
<br>
John<br>
<br>
> On Apr 15, 2017, at 9:02 AM, Hans <<a href="mailto:hans@lambermont.dyndns.org" target="_blank">hans@lambermont.dyndns.org</a>> wrote:<br>
> <br>
> Agreed, this is something very nice to have. And it is tedious work too. For<br>
> images that don't look too good I expect we'll even get negative remarks, but<br>
> that should not inhibit this project. To me having a skimpy image is far better<br>
> than no image at all.<br>
> <br>
> Is the idea to have an image library or to dynamically download them on demand ?<br>
> <br>
> -- Hans<br>
> <br>
> Jasem Mutlaq wrote on 20170415:<br>
> <br>
>> I'm attaching a few examples so you can see why we can't use them as is in<br>
>> KStars.<br>
>> <br>
>>> On Sat, Apr 15, 2017 at 9:43 AM, Akarsh Simha <<a href="mailto:akarshsimha@gmail.com" target="_blank">akarshsimha@gmail.com</a>> wrote:<br>
>>> <br>
>>> Hi<br>
>>> <br>
>>> This is something very nice to have!<br>
>>> <br>
>>> A caveat to consider is the licensing for DSS imagery. They are not<br>
>>> available for commercial use, so we must ship this as an add-on through<br>
>>> KNewStuff ("Get New Data")<br>
>>> <br>
>>> Other sources of images are SDSS, the Hubble Legacy Archive (<a href="http://hla.stsci.edu" target="_blank">hla.stsci.edu</a>)<br>
>>> and the recently released PanStarrs 1 survey. I think the PanStarrs 1<br>
>>> survey has a large sky coverage (possibly even all sky -- I haven't<br>
>>> checked). SDSS has a somewhat small footprint, and the Hubble only has<br>
>>> objects of interest.<br>
>>> <br>
>>> I didn't quite get what the problem involved is. The DSS is made from<br>
>>> digitizing scanned plates mostly from the Palomar Observatory and UKSTU<br>
>>> telescope. The result is that many plates have artefacts, and they are<br>
>>> completely uncalibrated. Planetary nebulae and bright emission nebulae tend<br>
>>> to be overexposed. There is no way around these problems other than going<br>
>>> to other surveys.<br>
>>> <br>
>>> Regards<br>
>>> Akarsh<br>
>>> <br>
>>> <br>
>> <br>
>> <br>
>> -- <br>
>> Best Regards,<br>
>> Jasem Mutlaq<br>
> <br>
> <br>
> <br>
> <br>
> <br>
</div>
</span></font></div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</blockquote>
</div>
<br>
<br clear="all">
<div><br>
</div>
-- <br>
<div class="m_-8417383449373530433m_7160945877431352804gmail_signature">
<div dir="ltr">
<div>Best Regards,<br>
Jasem Mutlaq<br>
</div>
<div><br>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</blockquote>
</div>
<br>
<br clear="all">
<div><br>
</div>
-- <br>
<div class="m_-8417383449373530433gmail_signature">
<div dir="ltr">
<div>Best Regards,<br>
Jasem Mutlaq<br>
</div>
<div><br>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div></div></div>
</div>
</div>
</blockquote></div><br><br clear="all"><div><br></div>-- <br><div class="gmail_signature" data-smartmail="gmail_signature"><div dir="ltr"><div>Best Regards,<br>Jasem Mutlaq<br></div><div><br></div></div></div>
</div>