[Kst] Trending from daily CSV Files KST-Plot Windows Version

Wed Aug 19 14:03:24 UTC 2015

Hello Barth,

I hope you are doing fine!

I have been in contact with you almost one year ago.

As I already told you (see correspondence below) - I really like Kst2Plot which is a great tool

and we successfully use it for CSV Real Time Trends & Data Analysis.

With a normal PC  (8GB Ram, Intel core I5, 2,6GHz, SSD drive) Kst2Plot still manages to open data of

90 days (each day = 1 file, size of ~100MB, 80.000 datasets/rows) which are in total around 7 million datasets!!!

If the program starts it will take some while (up to 30minutes), but after data are loaded it still can be operate

with adequate response due to the amount of datasets- absolutely impressing!

Now my request:

The Kst2Plot "list of files" looks like below.

.....

C:\Data\P109C1b\P109C1b_2015_07_01.CSV

C:\Data\P109C1b\P109C1b_2015_07_02.CSV

C:\Data\P109C1b\P109C1b_2015_07_03.CSV

C:\Data\P109C1b\P109C1b_2015_07_04.CSV

C:\Data\P109C1b\P109C1b_2015_07_05.CSV

C:\Data\P109C1b\P109C1b_2015_07_06.CSV

C:\Data\P109C1b\P109C1b_2015_07_07.CSV

C:\Data\P109C1b\P109C1b_2015_07_08.CSV

C:\Data\P109C1b\P109C1b_2015_07_09.CSV

C:\Data\P109C1b\P109C1b_2015_07_10.CSV

C:\Data\P109C1b\P109C1b_2015_07_11.CSV

C:\Data\P109C1b\P109C1b_2015_07_12.CSV

C:\Data\P109C1b\P109C1b_2015_07_13.CSV

C:\Data\P109C1b\P109C1b_2015_07_14.CSV

C:\Data\P109C1b\P109C1b_2015_07_15.CSV

C:\Data\P109C1b\P109C1b_2015_07_16.CSV

C:\Data\P109C1b\P109C1b_2015_07_17.CSV

C:\Data\P109C1b\P109C1b_2015_07_18.CSV

C:\Data\P109C1b\P109C1b_2015_07_19.CSV

C:\Data\P109C1b\P109C1b_2015_07_20.CSV

C:\Data\P109C1b\P109C1b_2015_07_21.CSV

C:\Data\P109C1b\P109C1b_2015_07_22.CSV

C:\Data\P109C1b\P109C1b_2015_07_23.CSV

C:\Data\P109C1b\P109C1b_2015_07_24.CSV

C:\Data\P109C1b\P109C1b_2015_07_25.CSV

C:\Data\P109C1b\P109C1b_2015_07_26.CSV

C:\Data\P109C1b\P109C1b_2015_07_27.CSV

ð  Each day new created CSV-file added here

The datalogger adds each day a new file which will be display in Kst2Plot. This works absolutely great.

To limit the period of days Kst2Plot "list of files" is limited to e.g. 30 /60 or 90 days.

Days older than 30 /60 / 90 days will be automatically deleted from the Kst2Plot "list of files" when a new file is added.

If a file is deleted from the list the data shown in plots of Kst2Plot should be also updated and deleted.

The problem is that Kst2Plot must be manually restarted to have an updated plot.

Is there any other (automated) way to solve this problem?

Restarting of the program should be avoided as  this takes too long in case of  ~60-90 files/days listed in Kst2Plot "list of files".

Please be aware that we are using Windows compiled version of Kst2Plot!

Another request

If Data Wizard is opened fault messages shown below pop up

No disc in drive \device\harddisk4\DR4

No disc in drive \device\harddisk4\DR3

No disc in drive \device\harddisk4\DR2

No disc in drive \device\harddisk4\DR1

After confirm  "Cancel/Quit/Try again"  4 times for each drive configuration can be done.

Is there any way to avoid this messages?

[tzav4ojm.s4g]

Thanks in advance for your help and looking forward to your reply!

FYI:

Herrenknecht/H+E delivered 2 tunnel conveyor belts for transit  Eglinton Crosstown LRT - Toronto,

which seems not be far from University Toronto - see also attached PDF.

Advance will start end of September. TBM (Tunnel Boring Machine) is from company Lovat.

Data of conveyor belts will be analyzed with Kst2Plot.

[cid:image006.png at 01D0DA98.93396240]

Best regards

Jörg

Best regards
Jörg Huber
Graduate Engineer
electrical engineering
____________________________________________________
Herrenknecht AG
Schlehenweg 2
77963 Schwanau-Allmannsweier
Germany
(+49 (7824) 302 5440
7+49 (7824) 302 2940
mailto:huber.joerg at herrenknecht.de
http://www.herrenknecht.de<http://www.herrenknecht.de/>

-----Ursprüngliche Nachricht-----
Von: Barth Netterfield [mailto:barth.netterfield at utoronto.ca]
Gesendet: Montag, 4. August 2014 16:35
An: Huber, Jörg
Betreff: Re: AW: [Kst] Trending from daily CSV Files KST-Plot Windows Version

On August 4, 2014 2:17:02 PM you wrote:

> Hello Barth,

>

> Yes you are right, the files in the list needs full path name.

Wonderful.  This capability has not been extensively tested, so be on the lookout for bugs.  Let me know if things don't behave as they should.

> Thanks a lot for your help!

> Have a nice week

> Best regards

> Jörg

>

>

> -----Ursprüngliche Nachricht-----

> Von: Barth Netterfield [mailto:barth.netterfield at utoronto.ca]

> Gesendet: Freitag, 1. August 2014 14:21

> An: kst at kde.org<mailto:kst at kde.org>

> Cc: Huber, Jörg

> Betreff: Re: [Kst] Trending from daily CSV Files KST-Plot Windows

> Version

>

> On August 1, 2014 8:47:03 AM Huber, Jörg wrote:

> > Hello Barth,

> >

> > thanks for your quick answer.

> > I've tried your suggestion but still have following questions

> >

> > - Attached is an example of "list of files".  Does extension must be .txt.

> > or .csv? Is file attached OK?

>

> The extension on the list file can be anything.  However, the files in

> the list may need the full path name.

> > - I tried both (.csv/.txt) but I couldn't  figure out how to define

> > data source as "list of files".

>

> It should do it automatically, if it can determine that each of the

> files exist.

>

> You should be using the very latest kst (2.0.8) or it may not work.

>

> > I've tried to configure data source via data wizard, but then it

> > will be imported as a normal single  .csv file. I would appreciate

> > if you can send me a short description or some screenshots how to do

> > this. - If in "list of files" will be added a new CSV- file, does

> > Kst2Plot will automatically online switch to the newest file and

> > read datasets from this file?

>

> It should be automatic.  To kst, it should appear as a single large file.

>

> > Or must the application be restarted?

>

> It shouldn't.

>

> > Many thanks for your help.

> >

> > Best Regards

> >

> > Jörg

> >

> >

> > -----Ursprüngliche Nachricht-----

> > Von: Barth Netterfield [mailto:barth.netterfield at utoronto.ca]

> > Gesendet: Donnerstag, 31. Juli 2014 18:51

> > An: kst at kde.org<mailto:kst at kde.org>

> > Cc: Huber, Jörg

> > Betreff: Re: [Kst] Trending from daily CSV Files KST-Plot Windows

> > Version

> >

> > Yes, this can be done.

> >

> > Make a file which is a list of file you want to append:

> >

> > file1.csv

> > file2.csv

> > file3.csv

> >

> > No blank lines.

> >

> > Use this file which is the list of files as the data source instead

> > of any of the individual files.  Kst will monitor if the last file

> > in the list is growing, as normal.

> >

> > Additionally, it will monitor the list of files.  If you append a

> > new file to the list, it will add it, and start monitoring it for

> > new data instead.

> >

> > makes sense?

> >

> > cbn

> >

> > On July 31, 2014 3:28:27 PM Huber, Jörg wrote:

> > > Dear Support-Team of KST-Plot,

> > >

> > >

> > >

> > > After a long search I have become aware of your absolutely great

> > > software tool "Kst2 Plot"!

> > >

> > > Congratulation!!! I'm totally impressed. It's a superb tool which

> > > is really easy to use and plots very fast, even with big CSV files.

> > >

> > >

> > >

> > > I've got one questions:

> > >

> > > For some of our applications we are using a data logger software,

> > > that reads and logs all important PLC-data.

> > >

> > > Every day (at midnight 00:00) there will be created a new

> > > CSV-file, named e.g. 2014-07-31.csv, 2014-08-01.csv.

> > >

> > >

> > >

> > > I've installed last version of KST2Plot (Windows Version) which is

> > > able to trend real times plots of the actual CSV file at the same

> > > time

> > >

> > > as the data logger software writes new datasets to it. That works

> > > absolutely great.

> > >

> > > Now my question:

> > >

> > > In case of "next" day (new csv file will be created) it would be

> > > great to read automatically from the new created csv-file and not

> > > to stop the real time plot.

> > >

> > > Is there any way to manage this with Kst2Plot Window version?

> > >

> > >

> > >

> > > I hope you understand what I've tried to describe.

> > >

> > >

> > >

> > > In advance thanks for your reply.

> > > Best regards

> > > Jörg Huber

> > > Graduate Engineer

> > > electrical engineering

> > > ____________________________________________________

> > > Herrenknecht AG

> > > Schlehenweg 2

> > > 77963 Schwanau-Allmannsweier

> > > Germany

> > > (+49 (7824) 302 5440

> > > 7+49 (7824) 302 2940

> > > mailto:huber.joerg at herrenknecht.de

> > > http://www.herrenknecht.de<http://www.herrenknecht.de/<http://www.herrenknecht.de%3chttp:/www.herrenknecht.de/>>

Registergericht / Register Court: Freiburg HRB 390485
Vorsitzender des Aufsichtsrates / Chairman of the Supervisory Board: 
Hans-Jörg Vetter
Vorstand / Board of Management: 
Dr.-Ing. E. h. Martin Herrenknecht, Vorsitzender / Chairman
Dipl.-Ing. Gebhard Lehmann, Stellvertreter / Vice Chairman
Betriebswirt (VWA) Kurt Stiefel, CFO
Dipl.-Ing. (FH) Günter Richter
Dipl.-Ing. (FH) Ulrich Schaffhauser
Dipl.-Wirtsch.-Ing. Michael Sprang
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.kde.org/pipermail/kst/attachments/20150819/c4038c30/attachment-0001.html>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image002.png
Type: image/png
Size: 98297 bytes
Desc: image002.png
URL: <http://mail.kde.org/pipermail/kst/attachments/20150819/c4038c30/attachment-0002.png>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image006.png
Type: image/png
Size: 108338 bytes
Desc: image006.png
URL: <http://mail.kde.org/pipermail/kst/attachments/20150819/c4038c30/attachment-0003.png>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: HK_logo.jpg
Type: image/jpeg
Size: 28598 bytes
Desc: not available
URL: <http://mail.kde.org/pipermail/kst/attachments/20150819/c4038c30/attachment-0001.jpg>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: Bildersammlung.pdf
Type: application/pdf
Size: 1688712 bytes
Desc: Bildersammlung.pdf
URL: <http://mail.kde.org/pipermail/kst/attachments/20150819/c4038c30/attachment-0001.pdf>