Related Works#
Here are some related packages that may be of interest.
Scoringrules
Open source Python package that provides verification metrics with backends for
NumPy
,JAX
,PyTorch
andTensorFlow
.Reference: Zanetta and Allen (2024)
xskillscore
Open source Python package that provides verification metrics of deterministic (and probabilistic from
properscoring
) forecasts with xarray.Reference: Bell et al. (2021)
climpred
Open source Python package for verification of weather and climate forecasts.
Reference: Brady and Spring (2021)
Verif
Open source command-line tool for forecast verification. Generates verification plots. Can evaluate deterministic and probabilistic predictions.
Reference: Nipen et al. (2023)
METplus
METplus
includes a database and visualisation system, with Python and shell script wrappers to utilise theMET
package. Verification scores inMET
are implemented in C++.Reference: Brown et al. (2021)
Pysteps
Open source Python library for short-term ensemble prediction systems, focusing on probabilistic nowcasting of radar precipitation fields. Includes a significant verification submodule.
References: Pulkkinen et al. (2019); Imhoff et al. (2023)
PyForecastTools
Open source Python module for model validation, forecast verification and plot generation. Uses dmarray data structures from
SpacePy
.Reference: Morley and Burrell (2020)