[Kst] Trending from daily CSV Files KST-Plot Windows Version
Huber, Jörg
Huber.Joerg at herrenknecht.de
Tue Sep 22 14:33:59 UTC 2015
Hello Barth,
Thanks a lot for your answers and help!
I was on holiday, so sorry for the delay in my reply.
I did some more tests and I must correct my statement:
If data vector(s) is/are configured "read from start = 0 to end"
=> 1. plots are updated if one or more files are deleted in KstPlot “list of files”
e.g. 1st entry = oldest file of 30 files is deleted at the beginning of "list of files"
=> 2. the same happens if one file is add to "list of files"
“list of files”
[cid:image002.png at 01D0F554.7BCBB4B0]
The difference between case 1 + 2 is as described below:
case 2: plot update is fast as additional data are added to existing plot (<10sec) which is perfect!
case 1: plot update is slow as additional data are delete from existing plot
Depending on how many files in “list of files” and data points (here: 30files à 80.000 data points)
Window of KstPlot is frozen as data curve / plot must be updated or re-arranged from the beginning.
This takes in my case about 10/20/30 min with 30/60/90 files.
At this time user interface of KstPlot and online charts will be frozen and no longer actualized.
Is there a possibility to solve this problem? Maybe using additional “task/background worker” for data vector update?
I’m not familiar with phyton scripting but please let me know, if and how the problem could be managed by phyton script in a later release of KstPlot.
Regarding: file dialog messages: it seems that "clean up non existing files" fixed it!
Thanks a lot
Best regards
Jörg
Best regards
Jörg Huber
Graduate Engineer
electrical engineering
____________________________________________________
Herrenknecht AG
Schlehenweg 2
77963 Schwanau-Allmannsweier
Germany
(+49 (7824) 302 5440
7+49 (7824) 302 2940
mailto:huber.joerg at herrenknecht.de
http://www.herrenknecht.de<http://www.herrenknecht.de/>
-----Ursprüngliche Nachricht-----
Von: Barth Netterfield [mailto:barth.netterfield at utoronto.ca]
Gesendet: Mittwoch, 2. September 2015 17:28
An: kst at kde.org; Huber, Jörg
Betreff: Re: [Kst] Trending from daily CSV Files KST-Plot Windows Version
Jörg,
Sorry for the slow reply. I have been very busy with getting a payload ready to fly - and will be for another month - so I may not be particularly responsive...
I think we should be able to do what you want using python scripting, which we have just recently got working under windows. Though I also suspect that the attempt to do so will produce a fair number of opportunities to fix some bugs :-)
Regarding file dialog messages: does File->Recent Data Files -> Clean up non- existent data files fix it?
We are looking forward to the new subway lines :-)
On Wed, Aug 19, 2015 at 10:03 AM, Huber, Jörg <Huber.Joerg at herrenknecht.de>
wrote:
> Hello Barth,
>
> I hope you are doing fine!
>
> I have been in contact with you almost one year ago.
>
> As I already told you (see correspondence below) - I really like
> Kst2Plot which is a great tool
>
> and we successfully use it for CSV Real Time Trends & Data Analysis.
>
>
>
> With a normal PC (8GB Ram, Intel core I5, 2,6GHz, SSD drive) Kst2Plot
> still manages to open data of
>
> 90 days (each day = 1 file, size of ~100MB, 80.000 datasets/rows)
> which are in total around 7 million datasets!!!
>
> If the program starts it will take some while (up to 30minutes), but
> after data are loaded it still can be operate
>
> with adequate response due to the amount of datasets- absolutely
> impressing!
>
>
>
> Now my request:
>
> The Kst2Plot “list of files” looks like below.
>
> …..
>
> *C:\Data\P109C1b\P109C1b_2015_07_01.CSV*
>
> *C:\Data\P109C1b\P109C1b_2015_07_02.CSV*
>
> *C:\Data\P109C1b\P109C1b_2015_07_03.CSV*
>
> *C:\Data\P109C1b\P109C1b_2015_07_04.CSV*
>
> *C:\Data\P109C1b\P109C1b_2015_07_05.CSV*
>
> *C:\Data\P109C1b\P109C1b_2015_07_06.CSV*
>
> *C:\Data\P109C1b\P109C1b_2015_07_07.CSV*
>
> *C:\Data\P109C1b\P109C1b_2015_07_08.CSV*
>
> *C:\Data\P109C1b\P109C1b_2015_07_09.CSV*
>
> *C:\Data\P109C1b\P109C1b_2015_07_10.CSV*
>
> *C:\Data\P109C1b\P109C1b_2015_07_11.CSV*
>
> *C:\Data\P109C1b\P109C1b_2015_07_12.CSV*
>
> *C:\Data\P109C1b\P109C1b_2015_07_13.CSV*
>
> *C:\Data\P109C1b\P109C1b_2015_07_14.CSV*
>
> *C:\Data\P109C1b\P109C1b_2015_07_15.CSV*
>
> *C:\Data\P109C1b\P109C1b_2015_07_16.CSV*
>
> *C:\Data\P109C1b\P109C1b_2015_07_17.CSV*
>
> *C:\Data\P109C1b\P109C1b_2015_07_18.CSV*
>
> *C:\Data\P109C1b\P109C1b_2015_07_19.CSV*
>
> *C:\Data\P109C1b\P109C1b_2015_07_20.CSV*
>
> *C:\Data\P109C1b\P109C1b_2015_07_21.CSV*
>
> *C:\Data\P109C1b\P109C1b_2015_07_22.CSV*
>
> *C:\Data\P109C1b\P109C1b_2015_07_23.CSV*
>
> *C:\Data\P109C1b\P109C1b_2015_07_24.CSV*
>
> *C:\Data\P109C1b\P109C1b_2015_07_25.CSV*
>
> *C:\Data\P109C1b\P109C1b_2015_07_26.CSV*
>
> *C:\Data\P109C1b\P109C1b_2015_07_27.CSV*
>
> ð *Each day new created CSV-file added here*
>
>
>
> The datalogger adds each day a new file which will be display in Kst2Plot.
> This works absolutely great.
>
> To limit the period of days Kst2Plot “list of files” is limited to
> e.g. 30
> /60 or 90 days.
>
> Days older than 30 /60 / 90 days will be automatically deleted from
> the Kst2Plot “list of files” when a new file is added.
>
> If a file is deleted from the list the data shown in plots of Kst2Plot
> should be also updated and deleted.
>
> The problem is that Kst2Plot must be manually restarted to have an
> updated plot.
>
> Is there any other (automated) way to solve this problem?
>
> Restarting of the program should be avoided as this takes too long in
> case of ~60-90 files/days listed in Kst2Plot “list of files”.
>
> Please be aware that we are using Windows compiled version of Kst2Plot!
>
>
>
> Another request
>
> If Data Wizard is opened fault messages shown below pop up
>
> No disc in drive \device\harddisk4\DR4
>
> No disc in drive \device\harddisk4\DR3
>
> No disc in drive \device\harddisk4\DR2
>
> No disc in drive \device\harddisk4\DR1
>
>
>
> After confirm “Cancel/Quit/Try again” 4 times for each drive
> configuration can be done.
>
> Is there any way to avoid this messages?
>
Registergericht / Register Court: Freiburg HRB 390485
Vorsitzender des Aufsichtsrates / Chairman of the Supervisory Board:
Hans-Jörg Vetter
Vorstand / Board of Management:
Dr.-Ing. E. h. Martin Herrenknecht, Vorsitzender / Chairman
Dipl.-Ing. Gebhard Lehmann, Stellvertreter / Vice Chairman
Betriebswirt (VWA) Kurt Stiefel, CFO
Dipl.-Ing. (FH) Günter Richter
Dipl.-Ing. (FH) Ulrich Schaffhauser
Dipl.-Wirtsch.-Ing. Michael Sprang
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.kde.org/pipermail/kst/attachments/20150922/684774e2/attachment-0001.html>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image002.png
Type: image/png
Size: 44721 bytes
Desc: image002.png
URL: <http://mail.kde.org/pipermail/kst/attachments/20150922/684774e2/attachment-0001.png>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: HK_logo.jpg
Type: image/jpeg
Size: 28598 bytes
Desc: not available
URL: <http://mail.kde.org/pipermail/kst/attachments/20150922/684774e2/attachment-0001.jpg>
More information about the Kst
mailing list