Our full technical support staff does not monitor this forum. If you need assistance from a member of our staff, please submit your question from the Ask a Question page.


Log in or register to post/reply in the forum.

Download data files from CRD using LoggerNet


artyb Oct 30, 2022 06:48 PM

Hi,

I'm working on a project that generates a lot of data (needs logging every 1s), so I'm using a CF card with a CR1000. It seems to be very slow (much slower than from logger memory) to download a file from the CF card. Is that to be expected? 

I read that the currently open file on the CRD mustn't be downloaded using LoggerNet or it can corrupt the data. There doesn't seem to be any way in Loggernet to set which one to download automatically by either timestamp or a dynamically generated filename to prevent automatic download of the most recent file. Am I missing something?

I've not been able to find a way of sending these large files very reliably, see my other recent posts where I've tried FTP and emailrelay, with issues with both approaches.

Best Wishes,

A


smile Nov 1, 2022 07:34 AM

Hi

I don't understand if there are many files generated every second or a file with data per second.

Smile


artyb Nov 1, 2022 01:19 PM

Hi

A file with data per second.

Cheers,
A


JDavis Nov 1, 2022 06:14 PM

If your program uses CardOut(), regular data collection will grab data from the card in addition to data in RAM. No special consideration in that case.

If the datalogger program uses TableFile(), Loggernet needs to grab files apart from scheduled data collection. There is a file retrieval tab in Setup that allows configuration. A binary file format, such as option 64, is recommended for fastest possible download.

Using Loggernet to collect data or retrieve files will use Pakbus data transfers. It is reliable, but has noticeable throughput limits mostly based on connection latency. FTP transfers are more efficient for large files.

General practice for the IRGASON stations is TableFile() with Option 64 to save binary data. Then, use FTP to transfer those files. Daily file sizes are commonly chosen.


artyb Nov 1, 2022 06:44 PM

Hi,

Thank you for the reply. I've used FTP previously, but in this case the client didn't want to pay for an FTP site. I've also had some issues with sending data using FTPS (for security), as in my other post.

I am using TableFile and option 64 as that seemed most appropriate when reading the documentation. Is there any way for LoggerNet to automate downloading eg the penultimate file from the CRD, but not the current one?

BW,
A


Nico Nov 3, 2022 07:55 AM

Is there any way for LoggerNet to automate downloading eg the penultimate file from the CRD, but not the current one?

The logger code is capable of renaming files. The Loggernet File Retrieval Tab has got file pattern recognition. Between those two features you should be able to work something out that lets Loggernet download the penultimate file only?


artyb Nov 3, 2022 11:09 AM

Hi Nico,

Yeah, true, another cunning work around. Not as straightforward as a built-in function though! ;-)

Cheers,
A

Log in or register to post/reply in the forum.