开发者

Way to store large amount of experiments and corresponding results

I have an experiment setup that produces a few csv and text files every run. In my research I run a number of these in parallel each day and trying to store and organized them in a directory heir-achy is getting rather inefficient and tedious.

One idea I thought of doing was using MySQL or something to store the the run descripti开发者_如何学Pythonon along with the associated output. This however has the inefficiency in that I am storing a number of gigantic Strings in the table fields.

Basically I would like to know if a system exists that can automatically organize the output of runs. Such that it would give a list of the run descriptions, and upon choosing this you can request the corresponding outputs. This wouldn't have to be in any particular language as I can hopefully just add the step to a shell script.


I assume that the csv and txt files are identically named for each run minus the extensions. Have you considered a simple java or python script that could take all of the csv and txt files in a folder and put them into a single XML file where all of the information would be saved and with the data from the linked csv file and txt file together, meaning that for hundreds of file pairs (csv and txt) you could end up with a single XML file that could be opened to see the separate run results?

0

上一篇:

下一篇:

精彩评论

暂无评论...
验证码 换一张
取 消

最新问答

问答排行榜