1.2.0 - Improved OPUS File Prefiltering, Additional Retrieval Job Options

📦  New Features

• Add option to pass custom ILS values
• Add option to specify output folder suffixes
• Add ETA to jobs watcher

🧵  Refactoring and Updates

• Upgrade to new OPUS file prefiltering based on Proffast 2.4. This OPUS file validator can be used standalone using the tum-esm-utils library

1.1.0 - Proffast 2.4 Support and Other Improvements

This release adds a lot of minor improvements and bugfixes as well as support for Proffast2.4.

📦  New Features

• Store VMR and pT profiles for all Proffast retrievals
• Support storing binary spectra in Proffast 1.0 retrievals too (only 2.X support until now)
• Add support for Proffast 2.4

🧵  Refactoring and Updates

• Update ILS parameter list for all retrieval algorithms
• Improve documentation
• Improve the pipeline watcher (#93)
• Update paths in GGG2020 downloader after the ginput paths have changed

🪲  Bugfixes

• Fix bugs in Proffast 1.0 wrapper
• Fix bugs in GGG2014 profiles downloader
• Don't run CI container tests in parallel (CI nodes were running out of memory)

1.0.0 - Initial Public Release

We retrieve a lot of EM27/SUN data, produced mainly by MUCCnet (Dietrich et al., 2021), and have used this pipeline since end of 2021.

This codebase provides an automated data pipeline for Proffast 1 and 2.X. Under the hood, it uses the Proffast Pylot to interact with Proffast 2 and an in-house connector to interact with Proffast 1. Whenever using this pipeline for Proffast retrievals, please make sure to also cite Proffast and the Proffast Pylot (for Proffast 2.X retrievals).

📚 Read the documentation at em27-retrieval-pipeline.netlify.app.
💾 Get the source code at github.com/tum-esm/em27-retrieval-pipeline.
🐝 Report Issues or discuss enhancements using issues on GitHub.

v1.0.0-rc.1

The next release candidates will still implement some features and a lot of documentation. Everything that is tracked by the milestone v1.0.0 will be realised by v1.0.0. I will just have release candidates now to better keep track of the progress.