Related Works

Here are some related packages that may be of interest.

• Scoringrules

  • Open source Python package that provides verification metrics with backends for NumPy, JAX, PyTorch and TensorFlow.

  • Software Repository; Documentation

  • Reference: Zanetta and Allen (2024)

• xskillscore

  • Open source Python package that provides verification metrics of deterministic (and probabilistic from properscoring) forecasts with xarray.

  • Software Repository; Documentation

  • Reference: Bell et al. (2021)

• climpred

  • Open source Python package for verification of weather and climate forecasts.

  • Software Repository; Documentation

  • Reference: Brady and Spring (2021)

• Verif

  • Open source command-line tool for forecast verification. Generates verification plots. Can evaluate deterministic and probabilistic predictions.

  • Software Repository; Wiki

  • Reference: Nipen et al. (2023)

• METplus

  • METplus includes a database and visualisation system, with Python and shell script wrappers to utilise the MET package. Verification scores in MET are implemented in C++.

  • Software Repository; Documentation; Website

  • Reference: Brown et al. (2021)

• Pysteps

  • Open source Python library for short-term ensemble prediction systems, focusing on probabilistic nowcasting of radar precipitation fields. Includes a significant verification submodule.

  • Software Repository; Documentation; Website

  • References: Pulkkinen et al. (2019); Imhoff et al. (2023)

• PyForecastTools

  • Open source Python module for model validation, forecast verification and plot generation. Uses dmarray data structures from SpacePy.

  • Software Repository; Documentation

  • Reference: Morley and Burrell (2020)