Automating data reduction and archival workflows using Apache NiFi
Traditional data reduction pipelines are run on local or remote machines and depend on user interaction for execution. This approach can lead to reproducibility and discoverability issues, as processing decisions made by the user go undocumented and are made in a single instance leading to difficulty in reproduction. O...