Communication Dans Un Congrès Année : 2023

Flexible and Systematic Uncertainty Estimation with Conformal Prediction via the MAPIE library

Résumé

Conformal prediction (CP) is an attractive theoretical framework for estimating the uncertainties of any predictive algorithms as its methodology is general and systematic with few assumptions. CP methods can be abstracted into building blocks that can be deployed on any type of data, model, or task. In this work, we contribute to the wide diffusion of the CP framework by developing the library MAPIE 1 that implements such principles and can address seamlessly different tasks (e.g. classification, regression, time-series) and in different settings (split and cross-conformal). All these concepts are under a common umbrella with an emphasis on readability, transparency, and reliability, hence supporting the principles of trustworthy AI. An original feature of MAPIE is to offer the possibility of designing tailored-made non-conformity scores in particular p-normalized residual non-conformal scores that can be defined to account for asymmetric errors. We show theoretically the marginal coverage guarantee in several settings. We highlight through applications the interest of choosing different non-conformity scores for tabular data when considering local coverage.

Fichier principal
Vignette du fichier
cordier23a.pdf (3) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-04895257 , version 1 (17-01-2025)

Identifiants

  • HAL Id : hal-04895257 , version 1

Citer

Nicolas J-B. Brunel, Thibault Cordier, Vincent Blot, Louis Lacombe, Thomas Morzadec, et al.. Flexible and Systematic Uncertainty Estimation with Conformal Prediction via the MAPIE library. The 12th Symposium on Conformal and Probabilistic Prediction with Applications (COPA 2023), Sep 2023, Limassol, Cyprus. ⟨hal-04895257⟩
0 Consultations
0 Téléchargements

Partager

More