Summary
This is a major cleanup release, mostly thanks to @HealthyPear who put it in a reasonable state to be maintained by others in the future! It has been tested against CTA Prod3b and CTA Prod5b for CTA-North point-like on-axis sources and should work as a baseline for analysis optimization.
This release will brings huge improvements to the performance of the pipeline and the software package.
Some of the changes are related to the improvements in the interface to the DIRAC grid. Please, consult that for more details about its latest release.
The performance of the pipeline has been validated successfully on a Prod5b simulation for the Alpha configuration at the North site under specific observational settings. Tests on a similar configuration for the South site are ongoing. From now on, performance results will be showcased at this website.
The benchmarking has become a package module (protopipe.benchmarking) and a new protopipe-BENCHMARK script has been added to the suite of available commands.
The pipeline makes now use of ctapipe v0.11.0 and pyirf v0.5.0. For more details, please consult the merged Pull Requests listed below.
Please, remember that protopipe and its interface are open-source projects and anyone can contribute to it. It is possible to perform full-scale analyses and contribute to the production of CTA performances for different science cases or perform studies that require big amounts of data.
Contributors
- Michele Peresano (@HealthyPear)
- Karl Kosack (@kosack)
What is changed since v0.4.0.post1
Pull-requests containing changes of multiple nature are repeated.
🚀 General features
- Add benchmarking notebook template (#181) @HealthyPear
- Add book template material (#174) @HealthyPear
- Add new script for benchmarking (#157) @HealthyPear
- Update the entire benchmark suite (#166) @HealthyPear
- Improve data scripts output and update analysis default settings (#165) @HealthyPear
- Improve protopipe.mva and protopipe-MODELS (#164) @HealthyPear
- Add image extraction status for TwoPassWindowSum (#163) @HealthyPear
- Add support for prod5N files (#167) @HealthyPear
- Add I/O functions to simplify benchmarking (#147) @HealthyPear
- Apply CALIB_SCALE directly from ctapipe.io.SimtelEventSource (#145) @HealthyPear
- Add progress bar to both TRAINING and DL2 production scripts (#150) @HealthyPear
- Add option to enable/disable charge integration integration correction (#146) @HealthyPear
- Calculate impact parameter always in the tilted frame (#143) @HealthyPear
- Add support for calibscale (#140) @HealthyPear
- Add optional LST stereo trigger requirement (#131) @HealthyPear
- Update to ctapipe 0.11.0 (#136) @HealthyPear
- Add configuration option to choose which cleaning to use to get training data (#135) @HealthyPear
- Add choice of estimation weigths and standard deviation for RandomForestRegressor models (#134) @HealthyPear
- Add concentration (#133) @HealthyPear
- Improve models generation (#96) @HealthyPear
- Support for ctapipe 0.10.5 (#124) @HealthyPear
- Small improvements to modeling script (#114) @HealthyPear
🔭 Pipeline applications
- Add support for prod5N files (#167) @HealthyPear
🌐 GRID support
- Update README and documentation (grid interface) (#152) @HealthyPear
- Make progress bar optional and add it also to DL2 script (#154) @HealthyPear
🐛 Bug Fixes
- fixed missing import of QTable (#188) @kosack
- try to fix build (mamba error) (#189) @kosack
- correctly count SSTs, MSTs, and LSTs. (#184) @kosack
- Add book template material (#174) @HealthyPear
- Set effective area HDU name as gammapy wants (#144) @HealthyPear
- Update CameraFrame-to-TelescopeFrame transformation and HillasReconstructor (#151) @HealthyPear
- Fix shower's core transformation to TiltedFrame (#160) @HealthyPear
- Fix CTAMARS-like energy estimation (#156) @HealthyPear
- Make progress bar optional and add it also to DL2 script (#154) @HealthyPear
- Output NaN concentrations in case of HillasParameterizationError or similar (#155) @HealthyPear
- Fix CALIB_SCALE key in analysis.yaml (#153) @HealthyPear
- Ensure that estimated energy is always recorded in linear scale (#141) @HealthyPear
- Add pandas to pip installation (#138) @HealthyPear
- Fix classifier integration test (#120) @HealthyPear
- Bugfixes and improvements to protopipe-MODELS (#122) @HealthyPear
- Fix pipeline integration test workflow (#118) @HealthyPear
- Fix documentation development version in docs (#112) @HealthyPear
🧰 Maintenance
- Update documentation for release 0.5.0 (#175) @HealthyPear
- Add Pull Request template (#187) @HealthyPear
- Add new script for benchmarking (#157) @HealthyPear
- Update README and documentation (grid interface) (#152) @HealthyPear
- Fix documentation build (#158) @HealthyPear
- Add integration test for DL2-to-DL3 step (#137) @HealthyPear
- Add pandas to pip installation (#138) @HealthyPear
- Implement DL2 integration tests (#126) @HealthyPear
- Add issue templates (#121) @HealthyPear
- Fix classifier integration test (#120) @HealthyPear
- Improve debugging of integration testing (#119) @HealthyPear
- Fix pipeline integration test workflow (#118) @HealthyPear
- Setup of pipeline integration testing up to modeling (#116) @HealthyPear
- Update training integration tests (#113) @HealthyPear
- Fix documentation development version in docs (#112) @HealthyPear
- Versioning, packaging and continuous deployment on PyPI (#105) @HealthyPear
- Update TRAINING integration tests (#111) @HealthyPear
- Update DOIs after latest release (#109) @HealthyPear
