Embedding git commit into the resulting data
Our pipeline works something like that:
- Collect bunch of raw data (10-100 GB) from microscope
- Process data using MATLAB scripts
- Change few parameters based on raw data, as well as add new features to the scripts
- Commit the scripts with new features to git repo
- Re-run processing, save results as figures and CSV data (1-10 MBs)
Are there tools available for seamlessly linking MATLAB figures or tabulated data with the code version (git commit hash) that was used to produce it?
I know that MATLAB is aware of git, as well as we can call system commands
Topic matlab version-control
Category Data Science