Awesome Conformal Prediction
LIMITED FASTTRACK PROMOTION ON MAVEN - Save 25% through Sunday 24 November 2024 ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
My course 'Applied Conformal Prediction is now opened for enrollment on Maven ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ enroll into the next cohort here, register interest for upcoming cohorts and information here
My book 'Practical Guide to Applied Conformal Prediction: Learn and apply the best uncertainty frameworks to your industry applications' can be ordered on Amazon Amazon USA ๐บ๐ธ, Amazon UK ๐ฌ๐ง, Amazon India ๐ฎ๐ณ, Amazon Germany ๐ฉ๐ช, Amazon France ๐ซ๐ท, Amazon Spain ๐ช๐ธ, Amazon Canada ๐จ๐ฆ, Amazon Japan ๐ฏ๐ต Amazon Brazil ๐ง๐ท Amazon Australia ๐ฆ๐บ Amazon Singapore ๐ธ๐ฌ Amazon Sweden ๐ธ๐ช
The book has reached #1 in Amazon Hot New Releases in multiple categories: "Probability and Statistics", "Machine Theory", "Python Programming" ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ๐๐๐๐๐ Please rate the book on Amazon if you liked it.
Due to free tier limits of Slack, Slack for Awesome Conformal Prediction is in general application-only. Send me a message on LinkedIn or X/Twitter to request access explaining why you need access and your email. Slack policy: real names only as per LinkedIn / academic profile.
Preference is given to Conformal Prediction researchers or practitioners who have published papers, articles, tutorials, code or made YouTube videos about Conformal Prediction.
Discover the Ultimate Conformal Prediction Resource: All-in-One and Expertly Curated ๐ ๐ ๐ ๐ ๐
Explore the most extensive professionally curated collection on Conformal Prediction, featuring top-notch tutorials, videos, books, papers, articles, courses, websites, conferences, and open-source libraries in Python, R, and Julia. Uncover the hidden gems and master the art of Conformal Prediction with this all-encompassing guide. Experience the Pinnacle of Conformal Prediction Expertise: A Resource Crafted by a Pro.
This exceptional resource is the culmination of my PhD journey in Machine Learning, specializing in Conformal Prediction under the supervision of its creator, Prof. Vladimir Vovk. Since 2015, I have painstakingly gathered these invaluable resources, and upon completing my PhD (my thesis, "Machine Learning for Probabilistic Prediction," can be found in the "Theses" section), I am thrilled to share my expertise with the global machine learning community. Immerse yourself in a professionally curated collection that has been honed through years of dedication and experience.
Conformal Prediction goes back to Kolmogorov's notion of randomness described in two papers : 1) Andrei Kolmogorov (1968). "Logical basis for information theory and probability theory." IEEE Transactions on Information Theory IT-14:662-664 and 2) Andrei Kolmogorov (1983). "Combinatorial foundations of information theory and the calculus of probabilities." Russian Mathematical Surveys 38(4):29-4.
Conformal Prediction has transcended its niche status in just a few years, experiencing exponential growth thanks to the tireless efforts of renowned ambassadors like Prof. Larry Wasserman in academia. It has taken center stage with dedicated tracks at ICML2021 and ICML2022, as well as a captivating keynote address 'Conformal Prediction in 2022' at NeurIPS2022 by Professor Emmanuel Candes. Furthermore, the main conference on Conformal Prediction (COPA) has enjoyed a successful run for over 11 years. Join the vibrant community at the forefront of this rapidly evolving field.
Connect and Share the Excitement of Conformal Prediction
I'm enthusiastically promoting the wonderful world of Conformal Prediction (because it truly is awesome) across various social media platforms, including LinkedIn and Twitter. You can find all my research on ResearchGate, and I occasionally share insights from the data science trenches in the industry on Medium. I warmly invite you to connect with me and help spread the word about the fascinating field of Conformal Prediction.
A Warm Invitation to Support and Share: Star the Repo and Spread the Word
Please consider starring ๐ the repo and sharing it with others who might be interested.
Terms and conditionc fo academic papers to be listed on Awesome Conformal Prediction
Academic papers that cite the repo will be automatically listed on the repo, whilst those that do not might be delisted at any time for breach of T&C. If your paper cites the repo but is missing from the list, please reach out to me directly.
By using this repository for academic research or publications, you agree to comply with the terms of the CC BY-NC-ND 4.0 license. As part of these terms, any academic or research work that benefits from this repository must appropriately cite it. Failure to provide proper attribution violates the license. Citations should follow the guidelines provided in the CITATION.cff
file included in this repository. This ensures that credit is given to the authors and contributors, and the repository's use is properly recognized in scientific and scholarly work.
Your support is invaluable in advancing the awareness and appreciation of Conformal Prediction:
Manokhin, Valery. (2022). Awesome Conformal Prediction (v1.0.0). Zenodo. https://zenodo.org/record/6467205 https://doi.org/10.5281/zenodo.6467205
Bibtex entry export https://zenodo.org/record/6467205/export/hx
@software{manokhin_valery_2022_6467205,
author = {Manokhin, Valery},
title = {Awesome Conformal Prediction},
month = apr,
year = 2022,
note = {{"If you use Awesome Conformal Prediction, please
cite it as below."}},
publisher = {Zenodo},
version = {v1.0.0},
doi = {10.5281/zenodo.6467205},
url = {https://doi.org/10.5281/zenodo.6467205}
}
Why Conformal Prediction?
One of the most influential and celebrated machine learning researchers - Professor Michael I. Jordan:
'๐๐ผ๐ป๐ณ๐ผ๐ฟ๐บ๐ฎ๐น ๐ฃ๐ฟ๐ฒ๐ฑ๐ถ๐ฐ๐๐ถ๐ผ๐ป ๐ถ๐ฑ๐ฒ๐ฎ๐ ๐ฎ๐ฟ๐ฒ ๐ง๐๐ ๐ฎ๐ป๐๐๐ฒ๐ฟ ๐๐ผ ๐จ๐ค (๐๐ป๐ฐ๐ฒ๐ฟ๐๐ฎ๐ถ๐ป๐๐ ๐พ๐๐ฎ๐ป๐๐ถ๐ณ๐ถ๐ฐ๐ฎ๐๐ถ๐ผ๐ป), ๐ ๐๐ต๐ถ๐ป๐ธ ๐ถ๐'๐ ๐๐ต๐ฒ ๐ฏ๐ฒ๐๐ ๐ ๐ต๐ฎ๐๐ฒ ๐๐ฒ๐ฒ๐ป - ๐ถ๐๐ ๐๐ถ๐บ๐ฝ๐น๐ฒ, ๐ด๐ฒ๐ป๐ฒ๐ฟ๐ฎ๐น๐ถ๐๐ฎ๐ฏ๐น๐ฒ ๐ฒ๐๐ฐ.' (ICML 2021 UQ workshop). ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
One the most influential statistics Professors - Larry Wasserman (Carnegie Mellon):
'๐ฆ๐ผ ๐๐ต๐ฒ ๐ฏ๐ฒ๐ฎ๐๐๐ ๐ผ๐ณ ๐๐ต๐ฒ ๐ฐ๐ผ๐ป๐ณ๐ผ๐ฟ๐บ๐ฎ๐น ๐๐ต๐ถ๐ป๐ด ๐ถ๐ ๐ต๐ผ๐ ๐๐ถ๐บ๐ฝ๐น๐ฒ ๐ถ๐ ๐ถ๐ ๐๐ผ ๐ฑ๐ผ ๐ถ๐ ๐ฎ๐ป๐ฑ ๐ต๐ผ๐ ๐ด๐ฒ๐ป๐ฒ๐ฟ๐ฎ๐น ๐ถ๐ ๐ถ๐. ๐ฆ๐ผ ๐ ๐๐ต๐ถ๐ป๐ธ ๐๐ผ๐ ๐ธ๐ป๐ผ๐ ๐ถ๐ฑ๐ฒ๐ฎ๐ ๐๐ต๐ฎ๐ ๐ฐ๐ฎ๐๐ฐ๐ต ๐ผ๐ป, ๐ด๐ฒ๐ป๐ฒ๐ฟ๐ฎ๐น ๐ถ๐ฑ๐ฒ๐ฎ๐ ๐๐ต๐ฎ๐ ๐ฎ๐ฟ๐ฒ ๐ฝ๐ฟ๐ฒ๐๐๐ ๐ด๐ฒ๐ป๐ฒ๐ฟ๐ฎ๐น ๐ฎ๐ป๐ฑ ๐๐๐ฌ๐ฒ ๐ญ๐จ ๐ข๐ฆ๐ฉ๐ฅ๐๐ฆ๐๐ง๐ญ ๐ญ๐ก๐๐ญ ๐ฒ๐จ๐ฎ ๐๐๐ง ๐ฉ๐ข๐๐ญ๐ฎ๐ซ๐ ๐ฒ๐จ๐ฎ๐ซ๐ฌ๐๐ฅ๐ ๐ฎ๐ฌ๐ข๐ง๐ ๐ข๐ง ๐ซ๐๐๐ฅ ๐๐ฉ๐ฉ๐ฅ๐ข๐๐๐ญ๐ข๐จ๐ง๐ฌ ๐๐ซ๐ ๐ญ๐ก๐ ๐ซ๐๐๐ฌ๐จ๐ง ๐ญ๐ก๐๐ญ ๐ฉ๐๐จ๐ฉ๐ฅ๐ ๐ฎ๐ฌ๐ข๐ง๐ ๐๐จ๐ง๐๐จ๐ซ๐ฆ๐๐ฅ ๐ฉ๐ซ๐๐๐ข๐๐ญ๐ข๐จ๐ง.' ๐๐๐๐๐
Prof. Emmanual Candes (Stanford) - Neurips 2022 key talk.
'๐๐ธ๐ท๐ฏ๐ธ๐ป๐ถ๐ช๐ต ๐ฒ๐ท๐ฏ๐ฎ๐ป๐ฎ๐ท๐ฌ๐ฎ ๐ถ๐ฎ๐ฝ๐ฑ๐ธ๐ญ๐ผ ๐ช๐ป๐ฎ ๐ซ๐ฎ๐ฌ๐ธ๐ถ๐ฒ๐ท๐ฐ ๐ช๐ต๐ต ๐ฝ๐ฑ๐ฎ ๐ป๐ช๐ฐ๐ฎ ๐ฒ๐ท ๐ช๐ฌ๐ช๐ญ๐ฎ๐ถ๐ฒ๐ช ๐ช๐ท๐ญ ๐ฒ๐ท๐ญ๐พ๐ผ๐ฝ๐ป๐ ๐ช๐ต๐ฒ๐ด๐ฎ. ๐๐ท ๐ช ๐ท๐พ๐ฝ๐ผ๐ฑ๐ฎ๐ต๐ต, ๐ฝ๐ฑ๐ฎ๐ผ๐ฎ ๐ถ๐ฎ๐ฝ๐ฑ๐ธ๐ญ๐ผ ๐ญ๐ฎ๐ต๐ฒ๐ฟ๐ฎ๐ป ๐ฎ๐๐ช๐ฌ๐ฝ ๐น๐ป๐ฎ๐ญ๐ฒ๐ฌ๐ฝ๐ฒ๐ธ๐ท ๐ฒ๐ท๐ฝ๐ฎ๐ป๐ฟ๐ช๐ต๐ผ ๐ฏ๐ธ๐ป ๐ฏ๐พ๐ฝ๐พ๐ป๐ฎ ๐ธ๐ซ๐ผ๐ฎ๐ป๐ฟ๐ช๐ฝ๐ฒ๐ธ๐ท๐ผ ๐๐ฒ๐ฝ๐ฑ๐ธ๐พ๐ฝ ๐ถ๐ช๐ด๐ฒ๐ท๐ฐ ๐ช๐ท๐ ๐ญ๐ฒ๐ผ๐ฝ๐ป๐ฒ๐ซ๐พ๐ฝ๐ฒ๐ธ๐ท๐ช๐ต ๐ช๐ผ๐ผ๐พ๐ถ๐น๐ฝ๐ฒ๐ธ๐ท ๐๐ฑ๐ช๐ฝ๐ผ๐ธ๐ฎ๐ฟ๐ฎ๐ป ๐ธ๐ฝ๐ฑ๐ฎ๐ป ๐ฝ๐ฑ๐ช๐ท ๐ฑ๐ช๐ฟ๐ฒ๐ท๐ฐ ๐ฒ๐ฒ๐ญ, ๐ช๐ท๐ญ ๐ถ๐ธ๐ป๐ฎ ๐ฐ๐ฎ๐ท๐ฎ๐ป๐ช๐ต๐ต๐, ๐ฎ๐๐ฌ๐ฑ๐ช๐ท๐ฐ๐ฎ๐ช๐ซ๐ต๐ฎ ๐ญ๐ช๐ฝ๐ช.'
https://slideslive.com/icml-2021/workshop-on-distributionfree-uncertainty-quantification
Konrad Banachewicz, Principal Data Scientist | Kaggle Grandmaster | Author of the "Kaggle book" and "Machine Learning using Tensorflow Cookbook"
'๐๐๐๐ค ๐ฃ๐๐ก๐ ๐๐ค ๐ข๐ฆ๐๐ฅ๐, ๐ข๐ฆ๐๐ฅ๐ ๐ค๐ก๐๐๐ฅ๐๐๐ฆ๐๐๐ฃ ๐๐๐๐๐๐.'
An Impressive Endorsement: Conformal Prediction's Growing Appeal in Academia and Industry
When highly respected professors from top research labs worldwide express their support for conformal prediction, it speaks volumes about its credibility and potential.
As for its industry applications, Conformal Prediction has already been powering Microsoft Azure's primary anomaly detection offering for several years. With exponential growth in academia during 2021-2022 and the increasing availability of open-source libraries, it's clear that the industry is poised for a similar surge in adoption.
๐ข๐ข Attention, industry professionals: The revolution in Uncertainty Quantification, Probabilistic Prediction, and Forecasting is here, and it's making waves! ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ Embrace the future of machine learning with Conformal Prediction.
What about the industry one might ask - Conformal Prediction already for several years powers the main anomaly detection proposition in Microsoft Azure.
[Table of Contents]()
Events
- Applied Conformal Prediction course starts in May 2024! ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Kaggle competition - probabilistic forecasting I: Temperature ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
Books
- Practical Guide to Applied Conformal Prediction: Learn and apply the best uncertainty frameworks to your industry applications by Valeriy Manokhin (2024) ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ Amazon USA ๐บ๐ธ, Amazon UK ๐ฌ๐ง, Amazon India ๐ฎ๐ณ, Amazon Germany ๐ฉ๐ช, Amazon France ๐ซ๐ท, Amazon Spain ๐ช๐ธ, Amazon Canada ๐จ๐ฆ, Amazon Japan ๐ฏ๐ต ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ๐๐๐๐๐
- Algorithmic Learning in a Random World by Vladimir Vovk and Alex Gammerman, also Glenn Shafer (2022). Second edition. ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ great theory based book, very math heavy, no applications, no code
- Conformal Prediction for Reliable Machine Learning by Vineeth Balasubramanian, Shen-Shyang Ho, Vladimir Vovk (2014) OLD BOOK, largely out of date, no code
Theses
- Machine Learning for Probabilistic Prediction, PhD Thesis, Valery Manokhin (Royal Holloway, UK, 2022) ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ (over 6K reads on Researchgate alone)
- Conformal and Venn Predictors for large, imbalanced and sparse chemoinformatics data, PhD Thesis, Paolo Toccaceli (Royal Holloway, UK, 2021)
- Competitive online algorithms for probabilistic prediction, PhD Thesis, Raisa Dzhamtyrova (Royal Holloway, UK, 2020)
- Conformal Prediction and Testing under On-line Compression Models, PhD Thesis, Valentina Fedorova (Royal Holloway, UK, 2014) ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Adaptive Online Learning, PhD Thesis, Dmitry Adamskiy (Royal Holloway, UK, 2013)
- Black-box Security Measuring Black-box Information Leakage via Machine Learning, PhD Thesis, Giovanni Cherubin (Royal Holloway, UK, 2019) ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Small and Large Scale Probabilistic Classifiers with Guarantees of Validity, PhD Thesis, Ivan Petej (Royal Holloway, UK, 2019) ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Confidence and Venn Machines and Their Applications to Proteomics by Devetyarov, Dmitry (Royal Holloway, UK, 2019)
- Conformal Anomaly Detection - detecting abnormal trajectories in surveillance applications by Rikard Laxhammar (University of Skoeve, Sweden, 2014) ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Inductive Confidence Machine for Pattern Recognition - is it the next step towards AI by David Surkov (Royal Holloway, UK, 2004)
- Distribution Free Prediction Intervals for Multiple Functional Regression by Ryan Kelly (University of Pittsburgh, 2020).
- Probabilistic Load Forecasting with Deep Conformalized Quantile Regression by Vilde Jensen (Artcic University of Norway, 2021)
- Model-free methods for multiple testing and predictive inference, PhD Thesis, Zhimei Ren (Stanford, 2021) ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Comparison of Support Vector Machines and Deep Learning For QSAR with Conformal Prediction by Deligianni Maria, MSc thesis, Universit of Uppsala (2022)
- Predictive Maintenance with Conformal and Probabilistic Prediction: A Commercial Case Study by James Gammerman (2022)
- Risk-Sensitive Decision-Making for Autonomous-Driving by Hardy Hasan (University of Uppsala, 2022)
- Distribution-Free Finite-Sample Guarantees and Split Conformal Prediction, MSc thesis by Roel Hulsman, University of Oxford (2022)
- Coreset-based Protocols for Machine Learning Classification, PhD thesis by Nery Riquelme Granada (Royal Holloway, University of London, 2022)
- Conformal survival predictions at a user-controlled time point by
Jelle Van Miltenburg (KTH ROYAL INSTITUTE OF TECHNOLOGY, 2018)
- Reliable Machine Learning with ConformalPrediction: A Review with Contributions by Martim Sousa (2022) ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Nonconformity Measures and Ensemble Strategies - An Analysis of Conformal Predictor Efficiency and Validity, PhD thesis by Henrik Linusson (Stockholm University, 2021) ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Determine and explain confidence in predicting violations on inland ships in the Netherlands by Bakker, Paul (TU Delft, 2020)
- Machine Learning with Conformal Prediction for Predictive Maintenance tasks in Industry 4.0 by Shuzhou Liu, Mulahuko Mpova (Jรถnkรถping University, 2023).
- Benchmarking conformal prediction methods for time series regression by Derck W.E. Prinzhorn (2023) code ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Conformal Prediction Methods in Finance by Finance Joรฃo Vitor Romano (Instituto de Matemรกtica Pura e Aplicada, Brazil, 2022) ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- An Active Learning Approach for Reject Inference in Credit Scoring using Conformal Prediction Intervals on Real and Semi-Artificial Data by Maximilian Suliga (Humboldt University of Berlin, 2023)
- Confidence Predictions in Pharmaceutical Sciences by Staffan Arvidsson McShane (Uppsala University, Sweden, 2023) ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Conform With the Wind Processing short-term ensemble forecasts with conformal based methods
for probabilistic wind-speed forecasting, MSc thesis by Simon Althoff (Lund University, 2023)
- Trustworthy explanations: Improved decision support through well-calibrated uncertainty quantification, PhD thesis by Helena Lรถfstrรถm (Jรถnkรถping Universitu, 2023) ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Data Augmentation and Conformal Prediction, MSc thesis by Helen Lu (MIT, 2023)
- Conformal prediction and copula based methods for profile monitioring, MSc Thesis by Niccolo' Donadini (Politecnico di Milano, 2023)
- Training Machine Learning-based QSAR models with Conformal Prediction on Experimental Data from DNA-Encoded Chemical Libraries Uppsala University (2021)
- Conformal prediction and beyond, MSc thesis by Gerard CASTRO CASTILLO (University of Barcelona, 2024)
- A New Perspective on Uncertainty Techniques in Regression, MSc thesis by Alexander Krauck (Johannes Kepler University of Linz, 2024)
- Robust Conformal Prediction Using Privileged Information by Shai Feldman, Yaniv Romano (Technion, 2024)
- CONFINE: Conformal Prediction for Interpretable Neural Networks by Linhui Huang, Sayeri Lala, Niraj K. Jha (Princeton University, 2024)
- Conformal prediction and beyond, MSc thesis by Gerard CASTRO CASTILLO (University of Barcelona, 2024) code
- Conformal prediction and uncertainty quantification in recommender systems MSc thesis by Roberto Alvarado Chamatrin (University of Barcelona, 2024) code ๐ฅ๐ฅ๐ฅ๐ฅ
- Machine learning-based anti-cancer drug treatment optimization PhD thesis by Kerstin Lenhof (Saarland University, 2024)
- Towards Uncertainty-Aware Hardware Trojan Detection MSc thesis by Rahul Vishwakarma (2024)
- A Diagnostic and Prescriptive Conformal Prediction Framework: Applied to Sleep Disorders MSc thesis by Faduma Khalif (MIT, 2024)
- Reliable Time Series Forecasting Interval Forecasting for Time Series with Machine Learning Models and EnbPI, Independent thesis Advanced level, Wang, Xuanq (KTH,2024)
- Conformal Prediction in Limit Order Books: Calibration and Uncertainty Quantification of DeepLOB by Fabio Rossi, Imperial College (2024)
- On uncertainty in natural language processing by Dennis Ulmer, Uiversity of Copenhagen (2024)
- Improving Uncertainty Quantification in Regression Problems through Conformal Training by Johannes Vallikivi, Cambridge (2023)
Tutorials
- A Conformal Prediction tutorial, an introductive review of the basics by Margaux Zaffran ๐ฅ๐ฅ๐ฅ๐ฅ (2024)
- Conformal Prediction Tutorial by Henrik Linusson (2021) ๐ฅ๐ฅ๐ฅ๐ฅ
- Predicting with Confidence - Henrik Bostrรถm by Henrik Bostrรถm (2016) ๐ฅ๐ฅ๐ฅ๐ฅ
- Henrik Linusson: Conformal Prediction by Henrik Linusson (2020) ๐ฅ๐ฅ๐ฅ๐ฅ
- Conformal Prediction: a Unified Review of Theory and New Challenges by Gianluca Zeni, Matteo Fontana1 and Simone Vantini (Politecnico di Milano, Italy, 2021) ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Conformal Prediction: How to quantify uncertainty of machine learning models? ECAS-ENBIS courseโ ENBIS 2023 Annual conference by Margaux Zaffran ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ (2023)
- A Tutorial on Conformal Prediction by Glenn Shafer and Vladimir Vovk (2008) ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Tutorial on Venn-ABERS prediction by Paolo Toccaceli (Royal Holloway, UK, 2019) ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- An Introduction to Conformal Prediction by Henrik Linusson (2017)
๐ฅ๐ฅ๐ฅ๐ฅ
- Conformal prediction A Tiny Tutorial on Predicting with Confidence by Henrik Linusson and Ulf Johansson (2014) ๐ฅ๐ฅ๐ฅ๐ฅ
- Tutorial on Conformal Prediction Claire Boyer Assistant Professor, LPSM, Paris Sorbonne Universitรฉ ; Margaux Zaffran PhD Candidate, EDF, Inria, CMAP, รcole Polytechnique ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- A Tutorial on Conformal Predictive Distributions by Paolo Toccaceli (2020) ๐ฅ๐ฅ๐ฅ
- Venn Predictors Tutorial by Ulf Johansson, Cecilia Sรถnstrรถd, Tuve Lรถfstrรถm, and Henrik Bostrรถm (2021) ๐ฅ๐ฅ๐ฅ๐ฅ
- Ulf Johansson: Venn Predictors by Ulf Johansson (2020) ๐ฅ๐ฅ๐ฅ๐ฅ
- Conformal prediction A Tiny Tutorial on Predicting with Confidence by Henrik Linusson and Ulf Johansson (2014)
- Conformal Prediction and Venn Predictors A Tutorial on Predicting with Confidence by Ulf Johansson, Henrik Linusson, Tuve Lรถfstrรถm, Henrik Bostrรถm, Alex Gammerman (2019) ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- A Gentle Introduction to Conformal Prediction and Distribution-Free Uncertainty Quantification by Anastasios N. Angelopoulos and Stephen Bates (2021) Video Code ๐ฅ๐ฅ๐ฅ๐ฅ
- Introduction to Conformal Prediction by Vineeth N Balasubramanian (Indian Institue of Technology, Hyderabad, 2015)
- Conformal Prediction in Spark by Marco Capuccini (Uppsala University, 2017)
- Getting predictions intervals with conformal inference by Rajiv Shah (2022) YouTube Code ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Uncertainty estimation in NLP by Tal Schuster, Adam Fisch (MIT, USC, 2022) ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Regression prediction intervals with MAPIE on Kaggle by Carl McBride Ellis, PhD
- Distribution-free inference tutorial At the IFDS 2021 Summer School Video 1 Video 2
- Conformal Inference Tutorial by Ben Kompa (2020)
- Prediction intervals for any machine learning model - How to construct prediction intervals with the Jackknife+ using the MAPIE package by Kjell Jorner (ETH, 2022)
- Uncertainty Quantification (1): Enter Conformal Predictors by Mahdi Torabi Rad (2023) ๐ฅ๐ฅ๐ฅ
- Uncertainty Quantification (2): Full Conformal Predictors by Mahdi Torabi Rad (2023) ๐ฅ๐ฅ๐ฅ๐ฅ
- Uncertainty Quantification (3): From Full to Split Conformal Methods by Mahdi Torabi Rad (2023) ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Conformal Prediction in Genomics by BiolApps (2023)
- Conformal Prediction: A Visual Introduction in VISxAI by Mihir Agarwal, Lalit Chandra Routhu, Zeel B Patel and Nipun Batra (IIT Gandhinagar, IIT Patna, 2023)
- Conformal Predictions from Scratch in Numpy by Jones Wacker (2023) ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
Courses
- Applied Conformal Prediction course starts in May 2024! ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Uncertain: Modern topics in uncertainty estimation YouTube Course notes by Aaron Roth (University of Pennsylvania, 2022) ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Topics in Modern Statistical Learning by Edgar Dobriban (Wharton School, University of Pennsylvania, 2022) ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Theory of Statistics Stanford Statistics course by Prof Emmanuel Candes (2022) ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- 36-708 Statistical Methods for Machine Learning Carnegie-Mellon course by Prof Larry Wasserman (2022)
- Course on Conformal Prediction by Christoph Molnar (2022)
- Conformal Prediction - Advanced Topics in Statistical Learning, Spring 2023 by Ryan Tibshirani (2023) ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Conformal Methods for Efficient and Reliable Deep Learning by Adam, Fisch (MIT, 2023) ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Conformal Prediction 101 - in Portuguese ๐ต๐น by Gustavo Bruschi (2023) ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
Videos
- Treatment of Uncertainty in the Foundations of Probability by Vladimir Vovk (Royal Holloway, UK, 2017)
- Large-Scale Probabilistic Prediction With and Without Validity Guarantees by Vladimir Vovk (Royal Holloway, UK, NeurIPS 2015) ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Conformal testing in a binary model situation by Vladimir Vovk (Royal Holloway, UK, 2021)
- Protected probabilistic classification by Vladimir Vovk (Royal Holloway, UK, 2021)
- Retrain or not retrain: conformal test martingales for change-point detection by Vladimir Vovk (Royal Holloway, UK, 2021) ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- A Tutorial on Conformal Prediction by Anastasios Angelopoulos and Stephen Bates (Berkeley, ICML 2021) ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Steps Toward Trustworthy Machine Learning by Tom Dietterich (2021)
- A Tutorial on Conformal Predictive Distributions by Paolo Toccaceli (Royal Holloway, UK, 2020) ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Conformal Prediction Tutorial by Henrik Linusson (2021) ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Henrik Linusson: Conformal Prediction by Henrik Linusson (2020)
- Predicting with Confidence - Henrik Bostrรถm by Henrik Bostrรถm (2016)
- How to increase certainty in predictive modeling by Emmanuel Candes (Stanford, 2021) ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Recent Progress in Predictive Inference by Emmanuel Candes (Stanford, 2020) ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Some recent progress in predictive inference" (Stanford) @ MAD+ by Emmanuel Candes (Stanford, 2020)
- Conformal Prediction in 2020 by Emmanuel Candes (Stanford, 2020) ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Assumption-free prediction intervals for black-box regression algorithms by Aaditya Ramdas (Carnegie Mellon, 2020) ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Maria Navarro: Quantifying uncertainty in Machine Learning predictions | PyData London 2019 by Maria Navarro (2019)
- Conformal Prediction: Enhanced Method for Understanding the Prediction Quality by Artem Ryasik and Greg Landrum
- Venn Predictors Tutorial by Ulf Johansson, Cecilia Sรถnstrรถd, Tuwe Lรถfstrรถm, and Henrik Bostrรถm (2021)
- Mondrian conformal predictive distributions by Henrik Bostrรถm, Ulf Johansson, and Tuwe Lรถfstrรถm (2021) ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Calibrating Multi-Class Models by Ulf Johansson, Tuwe Lรถfstrรถm, and Henrik Bostrรถm (2021)
- Conformal testing in a binary model situation by Vladimir Vovk (Royal Holloway, UK, 2021)
- Conformal prediction in Orange by Tomaลพ Hoฤevar and Blaลพ Zupan (2021)
- Distribution-Free, Risk-Controlling Prediction Sets by Anastasios Angelopoulos Berkeley, 2021) ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Conformal Prediction and Distribution-Free Calibration by Aaditya Ramdas (Carnegie Mellon, 2021) ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Reliable Diagnostics by Conformal Predictors by Alexander Gammerman (Royal Holloway, UK, 2015)
- Conformal Inference of Counterfactuals and Time-to-event Outcomes by Lihua Lei (Stanford, 2021)
- Algo Hour โ Conformal Inference of Counterfactuals and Individual Treatment Effect by Lihua Lei (Stanford, 2021)
- Conformal Inference of Counterfactuals and Individual Treatment effects(Stanford) by Lihua Lei (Stanford, 2021)
- Approximation to object conditional validity with inductive conformal predictors by Anthony Bellotti (University of Nottingham Ningbo, China, 2021)
- Ulf Johansson: Venn Predictors by Ulf Johansson (Jรถnkรถping University, Sweden, 2021) ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Transformer-based conformal predictors for paraphrase detection by Patrizio Giavannotti and Prof. Alexander Gammerman (Royal Holloway, UK, 2021)
- Conformal Inference of Counterfactuals and Individual Treatment Effects by Lihua Lei (Stanford, 2020)
- Model-Free Predictive Inference by Larry Wasserman (Carnegie Mellon, 2020) ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Shapley-value based inductive conformal prediction by William Lopez Jaramillo (2021)
- Conformal Training: Learning Optimal Conformal Classifiers | DeepMind by David Stutz (2021) ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Distribution-Free, Risk-Controlling Prediction Sets by Anastasios Angelopoulos (2021) ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Assumption-Free, High-Dimensional Inference by Larry Wasserman (2016)
- Neural Predictive Monitoring under Partial Observability by Francesca Cairolli (2021)
- Conformalized Kernel Ridge Regression and Its Efficiency by Evgeny Burnaev (Skolkovo, Russia, 2015)
- Fast conformal classification using influence functions by Giovanni Cherubin (Alan Turing Institute, UK, 2021)
- Valid inferential models and conformal prediction by Ryan Martin (North Carolina State University, USA, 2021)
- Mondrian conformal predictive distributions by Henrik Bostrรถm, Ulf Johansson and Tuwe Lรถfstrรถm (KTH Royal Institute of Technology, Sweden, 2021) ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Evaluation of updating strategies for conformal predictive systems in the presence of extreme events by Hugo Werner, Lars Carlsson, Ernst Ahlberg and and Henrik Bostrรถm (KTH Royal Institute of Technology, Sweden, 2021)
- Exact and Robust Conformal Inference Methods for Predictive Machine Learning With Dependent Data by Victor Chernozhukov (MIT, USA, 2019) ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Ulf Johansson: Venn Predictors by Ulf Johansson (Jรถnkรถping University, Sweden, 2020) ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Class-wise confidence for debt prediction in real estate management by Soundouss Messoudi (2021)
- How Nonconformity Functions and Difficulty of Datasets Impact the Efficiency of Conformal Classifiers by Marharyta Aleksandrova (2021)
- Nested conformal prediction and quantile out-of-bag ensemble methods by Chirag Gupta (Carnegie Mellon, 2020) ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Panel with Michael I. Jordan, Vladimir Vovk, and Larry Wasserman, moderated by Aaditya Ramdas by Vladimir Vovk, Larry Wasserman, Michael I. Jordan, Aaditya Ramdas, ICML 2021 ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Black-box uncertainty - Anastasios Angelopoulos by Anastasios Angelopoulos (Berkeley, USA, 2021) ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- P.C. Mahalanobis Memorial Lectures 2020-21 by Vladimir Vovk (Royal Holloway, UK, 2021)
- Rahul Vishwakarma: New Perspective on Machine Learning Predictions Under Uncertainty | SNIA Storage Developer Conference, Santa Clara 2019 by Rahul Vishwakarma (2019)
- Fast conformal classification using influence functions by Umang Bhatt, Adrian Weller and Giovanni Cherubin (Cambridge / Alan Turinig Institute, 2021).
- Adaptive Conformal Predictions for Time Series | ISDFS by Margaux Zaffran (2022) TIME SERIES ๐๐๐๐๐ ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅCode
- Recent progress in predictive inference by Emmanuel Candes, Stanford University (2022)
- Conformalized Survival Analysis with Adaptive Cutoffs by Rina Foygel Barber, Zhimei Ren, Yu Gui and Rohan Hore, University of Chicago (2022)
- Calibrating probabilistic hierarchical forecasts with conformal predictions by Daan Ferdinandusse (University of Amsterdam, 2022)
- Michael I. Jordan on Conformal Prediction by Michael I. Jordan (Berkeley, 2022)
- Distribution-free Prediction: Exchangeability and Beyond by Rina Foygel Barber (University of Chicago, 2022)
- Purdue Statistics Theme Seminar, Conformal Prediction in 2022 by Emmanuel Candes (Stanford, 2022)
- WILL MY ROBOT ACHIEVE MY GOALS? PREDICTING THE PROBABILITY THAT AN MDP POLICY REACHES A USER-SPECIFIED BEHAVIOR TARGET by Alexander Guyer and Thomas G. Dietterich (University of Oregon, 2022)
- Robust and Equitable Uncertainty Estimation by Aaron Roth(2022)
- Conformal prediction under feedback covariate shift for biomolecular design by Clara Wong-Fannjiang (Berkeley, 2022)
- Conformal prediction in 2022 invited talk by Emmanuel Candes at NeurIPS2022 ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Broadening the Scope of Conformal Inference by Michael I. Jordan (University of Berkeley, 2022) ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Paper Reading Group - Fortuna, a Library for Uncertainty Quantification
- CLIMB Evergreen talk with Emmanuel Candรจs: Conformal Inference when Data is not Exchangeable TIME SERIES ๐๐๐๐๐ ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Algo Hour โ Conformal Inference of Counterfactuals and Individual Treatment Effects | Lihua Lei
- 'MoroccoAI webinar - Dr. Soundouss Messoudi - 'Confidence learning using conformal prediction'
- Emmanuel Candes - A Taste of Conformal Prediction by Emmanuel Candes (2023)
- Foundations of Conformal Prediction - Full Conformal Predictors by Mahdi Torabi Rad (2023) ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Max Mergenthaler and Fede Garza - Quantifying Uncertainty in Time Series Forecasting by Max Mergenthaler and Fede Garza (Nixtla, 2023) TIME SERIES ๐๐๐๐๐ ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Uncertainty Quantification with the Fortuna library by Gianluca Detommaso (AWS) by Gianluca Detommaso (Amazon, 2023)
- Quantifying Uncertainty in Time Series Forecasting by Max Mergenthaler and Fede Garza (Nixtla, 2023)
- NISS/Merck Meetup on Conformal Inference: Advancing the Boundaries of Machine Learning 4.19.2023 (2023) ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Max Kuhn - The Post-Modeling Model to Fix the Model by Max Kuhn (2023)๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- ISDFS Talk: Robots that ask for help: Conformal Prediction for LLM Planners by Anirudha Majumdar (Princeton/DeepMind) ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ(2023)
- Robots That Ask For Help: Uncertainty Alignment for Large Language Model Planners by Allen Z Ren (2023) ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- [Conformal Prediction & Complex Data Analytics] (https://www.youtube.com/watch?v=PbHsmPupFak) by Matteo Fontana (2023) ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Three Easy Steps to Understand Conformal Prediction (CP), Conformity Score, Python Implementation by (Dr. Data Science 2023) ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Rising Stars #8: Clara Wong-Fannjiang (Genentech) - Prediction-Powered Inference
- Rising Stars #10 - Special Series on Conformal Prediction: Isaac Gibbs (Stanford University) Conformal Inference with Conditional Guarantees
- Conformal Prediction for Time Series with Modern Hopfield Networks by Andreas Auer TIME SERIES ๐๐๐๐๐ ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Introducing Sequential Predictive Conformal Inference (SPCI) by Chen Xu (2023) TIME SERIES ๐๐๐๐๐ ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Conformal Prediction Intervals: Empowering Executives for Informed Decision by Matthew Kolakowski (2023) ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Conformal Inference with Tidymodels - posit::conf(2023) by Max Kuhn (2023)
- ACon^2: Adaptive Conformal Consensus for Provable Blockchain Oracles by Sangdon Park (2023)
- Leveraging conformal prediction for calibrated probabilistic time series forecast by Inge van den Ende (Dexter Energy, 2023) TIME SERIES ๐๐๐๐๐ ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Uncertainty Quantification over Graph with Conformalized Graph Neural Networks by Kexin Huang (Stanford, 2023) ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Selection by Prediction with Conformal p-values by Ying Jin (Stanford, 2023)
- Trustworthy Retrieval Augmented Chatbots Utilizing Conformal Predictors by Shuo Li (UPenn, 2023).
- An introduction to conformal prediction - PyLadies Amsterdam by Inge van den Ende (2024) ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅcode
- Anushri Dixit - Planning with Confidence: Uncertainty Quantification for Safety-Critical Tasks (2024) ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Analรญtica acelerada con Shapelets y conformal prediction, ~48 mins onwards by Carl McBride Ellis (2024) code ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Conformal Quantile Estimation in Economics by Martin Fankhauser (Bocconi, 2024)
- Big Data: 4th lecture (uncertainty in learning, big data for NLP) by Prof. Patrick Glauner (2024)
- Unveiling Precision: A Novel ML Framework for Accurate Probability Estimates by Abel and Edgar, not CP per se, showing the critical importance of calibration in finance (2024)
- Autonomy Talks - Somil Bansal: Safety Assurances for Learning-Enabled Autonomous Systems by Somil Bansal (USC, 2024) ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Interview with Vladimir Vovk on Conformal Inference (2024)
- Error Embraced: Making Trustworthy Scientific Decisions with Imperfect Predictions by Clara Wong-fannjiang (Genentech) (2024)
- Conformalized Interval Arithmetic with Symmetric Calibration by Rui Luo, Zhixin Zhou (City University of Hong Kong, 2024)
- Robust Yet Efficient Conformal Prediction Sets by Soroush H. Zargarbash (2024)
- Applications of Conformal Prediction in Medicine | CGSI 2024 by Ahmed Alaa (2024)
- Mojtaba Farmanbar - Uncertainty quantification: How much can you trust your machine learning model? by Mojtaba Farmanbar (2024)
- Cordier & Lacombe - Boosting AI Reliability: Uncertainty Quantification with MAPIE by Thibault Cordier and Louis Lacombe (2024)
- Understanding, Generating, and Evaluating Prediction Intervals - posit conf 2024 by Bryan Shalloway (2024)
Papers
- Introducing Conformal Prediction in Predictive Modeling. A Transparent and Flexible Alternative to Applicability Domain Determination by Ulf Norinder, Lars Carlsson, Scott Boyer, and Martin Eklund (2014)
- Uncertainty Sets for Image Classifiers using Conformal Prediction by Anastasios N. Angelopoulos, Stephen Bates, Jitendra Malik, & Michael I. Jordan (Berkeley, 2021) ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Conformal Prediction Under Covariate Shift by Ryan Tibshirani, Rina Foygel Barber, Emmanuel Candes, Aaditya Ramdas (Carnegie Mellon, Stanford, Chicago, 2019) ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Regression Conformal Prediction with Nearest Neighbours by Harris Papadopoulos, Vladimir Vovk and Alex Gammerman (Royal Holloway, UK, 2014) ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Nested conformal prediction and quantile out-of-bag ensemble methods by Chirag Gupta, Arun Kuchibhotla and Aaditya Ramdas (Carnegie Mellon, 2021) ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Cross-conformal predictive distributions by Vladimir Vovk, Ilia Nouretdinov, Valery Manokhin and Alexander Gammerman (Royal Holloway, UK, 2018) ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Criteria of Efficiency for Conformal Prediction by Vladimir Vovk, Ilia Nouretdinov, Valentina Fedorova,
Ivan Petej, and Alex Gammerman ((Royal Holloway, UK, 2016)
- Conformal Prediction for Simulation Models by Benjamin LeRoy and Chad Schafer (Carnegie Mellon, 2021)
- Distribution-free, risk-controlling prediction sets Stephen Bates, Anastasios Angelopoulos, Lihua Lei, Jitendra Malik and Michael I Jordan (Berkeley, 2021) ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Conditional calibration for false discovery rate control under dependence by William Fithian and Lihua Lei (Stanford, 2021)
- Conformal Prediction: a Unified Review of Theory and New Challenges by Gianluca Zeni, Matteo Fontana and S. Vantini (2021) ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Regression conformal prediction with random forests by Ulf Johansson, Henrik Bostrรถm, Tuve Lรถfstrรถm and Henrik Linusson (2014)
- A conformal prediction approach to explore functional data by Jing Lei, Alessandro Rinaldo, Larry Wasserman (Carnegie Mellon, 2013)
- An electronic nose-based assistive diagnostic prototype for lung cancer detection with conformal prediction by Xianghao Zhana,c, Zhan Wanga, Meng Yangb, Zhiyuan Luod, You Wanga, Guang Li (2020)
- Predicting the Rate of Skin Penetration Using an Aggregated Conformal Prediction Framework by Martin Lindh, A. Karlรฉn, Ulf Norinder (2017)
- The application of conformal prediction to the drug discovery process by Martin Eklund, Ulf Norinder, Scott Boyer & Lars Carlsson (2014) ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Distributional conformal prediction by Victor Chernozhukov, Kaspar Wรผthrich, Yinchu Zhu (2021) ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Anomaly Detection of Trajectories with Kernel Density Estimation by Conformal Prediction by James Smith, Ilia Nouretdinov, Rachel Craddock, Charles Offer, and Alexander Gammerman (2009)
- Conformal prediction interval estimation and applications to day-ahead and intraday power markets by Christopher Kath, Florian Ziel (2019) ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- The application of conformal prediction to the drug discovery process by Martin Eklund, Ulf Norinder, Scott Boyer & Lars Carlsson (2013)
- Anomaly Detection of Trajectories with Kernel Density Estimation by Conformal Prediction by James Smith, Ilia Nouretdinov, Rachel Craddock, Charles Offer, Alexander Gammerman (Royal Holloway, UK, 2014)
- Conformal Prediction: a Unified Review of Theory and New Challenges by Gianluca Zeni, Matteo Fontana1 and Simone Vantini (Politecnico di Milano, Italy, 2021)
- Exchangeability, Conformal Prediction, and Rank Tests by Arun Kuchibhotla (Carnegie Mellon, 2021)
- Conformal prediction with localization by Leying Guan (Yale, 2020)
- Predicting skin sensitizers with confidence - Using conformal prediction to determine applicability domain of GARD by Andy Forreryd, Ulf Norinder, Tim Lindberg, Malin Lindstedt (2018)
- Binary classification of imbalanced datasets using conformal prediction by
Ulf Norinder, Scott Boyer (2017)
- Discretized conformal prediction for efficient distribution-free inference by Wenyu Chen, Kelli-Jean Chun, and Rina Foygel Barber (2017)
- Validity, consonant plausibility measures, and conformal prediction by Leonardo Cella. and Ryan Martin (2021)
- Conformal Prediction Classification of a Large Data Set of Environmental Chemicals from ToxCast and Tox21 Estrogen Receptor Assays by Ulf Norinder, Scott Boyer (2016)
- Conformal prediction to define applicability domain โ A case study on predicting ER and AR binding by U. Norinder, A. Rybacka, P.Andersson (2016)
- Conformal prediction of biological activity of chemical compounds by Paolo Toccaceli, Ilia Nouretdinov, Alex Gammerman (Royal Holloway, UK, 2017) ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Introducing conformal prediction in predictive modeling for regulatory purposes. A transparent and flexible alternative to applicability domain determination by Ulf Norinder, Lars Carlsson, Scott Boyer, Martin Eklund (2015)
- Aggregated Conformal Prediction by Lars CarlssonMartin EklundUlf Norinder (2014)
- Interpretation of Conformal Prediction Classification Models by Ernst Ahlberg, Ola Spjuth, Catrin Hasselgren, Lars Carlsson (2015)
- Cross-Conformal Prediction with Ridge Regression by Harris Papadopoulos (2015)
- Sparse conformal prediction for dissimilarity data by Frank-Michael Schleif, Xibin Zhu and Barbara Hammer (2015)
- Effective utilization of data in inductive conformal prediction using ensembles of neural networks by Tuve Lรถfstrรถm, Ulf Johansson and Henrik Bostrรถm (2013)
- Beyond the Basic Conformal Prediction Framework by Vladimir Vovk (2014)
- An electronic nose-based assistive diagnostic prototype for lung cancer detection with conformal prediction by Xianghao Zhan, Zhan Wang, Meng Yang, Zhiyuan Luo, You Wang, Guang Li (Stanford, Royal Holloway, China University of Mining and Technology, 2020)
- Predicting with confidence: Using conformal prediction in drug discovery by Jonathan Alvarsson, Staffan Arvidsson McShane, Ulf Norinder, Ola Spjuth (2021) ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Inductive conformal prediction for silent speech recognition by Ming Zhang, You Wang, Zhang Wei, Meng Yang, Zhiyuan Luo, Guang Li (2020)
- Large scale comparison of QSAR and conformal prediction methods and their applications in drug discovery by Nicolas Bosc, Francis Atkinson, Eloy Felix, Anna Gaulton, Anne Hersey and Andrew R. Leach (2019)
- Deep Conformal Prediction for Robust Models by Soundouss Messoudi, Sylvain Rousseau and Sรฉbastien Destercke (2020)
- Strong validity, consonance, and conformal prediction by Leonardo Cella and Ryan Martin (2020)
- Skin Doctor CP: Conformal Prediction of the Skin Sensitization Potential of Small Organic Molecules by Anke Wilm, U. Norinder, M. Agea, Christina de Bruyn Kops, Conrad Stork, J. Kรผhnl, J. Kirchmair (2020)
- Conformal prediction based active learning by linear regression optimization by Sergio Matiz, Kenneth E.Barner (2020)
- Conformal prediction intervals for the individual treatment effect by Danijel Kivaranovic, Robin Ristl, Martin Poschb, Hannes Leeb (2020)
- Nearest neighbor based conformal prediction by Lรกszlรณ Gyรถrfi and Harro Walk (2020)
- Concepts and Applications of Conformal Prediction in Computational Drug Discovery by Isidro Cortรฉs-Ciriano and Andreas Bender (2019) ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Predicting Ames Mutagenicity Using Conformal Prediction in the Ames/QSAR International Challenge Project by Ulf Norinder, Ernst Ahlberg, Lars Carlsson (2018)
- Nested Conformal Prediction and the Generalized Jackknife by Arun Kuchibhotla and Aaditya Ramdas (Carnegie Mellon, 2019)
- Predictive inference with the jackknife+ by Rina Foygel Barber, Emmanuel Candรจs, Aaditya Ramdas, and Ryan Tibshirani (2020) ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Nonparametric predictive distributions based on conformal prediction by Vladimir Vovk, Jieli Shen, Valery Manokhin and Min-ge Xie (Royal Holloway, UK, Rutgers, USA, 2018) ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- A Distribution-Free Test of Covariate Shift Using Conformal Prediction by Xiaoyu Hu and Jing Lei (Peking Univerity, China and Carnegie Mellon, USA, 2020) ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Exchangeability, Conformal Prediction, and Rank Tests by Arun Kuchibhotla (Carnegie Mellon, 2021)
- Conformal prediction with localization by Leying Guan (2020)
- Multitask Modeling with Confidence Using Matrix Factorization and Conformal Prediction by Ulf Norinder, Fredrik Svensson
- Conformal prediction of HDAC inhibitors by U. Norinder, J.J.Navaka, E. Lopez-Lopez, D. Mucs & J.L. Medina-Franco (2019)
- Computing Full Conformal Prediction Set with Approximate Homotopy by Eugene Ndiaye, Ichiro Takeuchi (2019)
- Conformal Prediction Based on Raman Spectra for the Classification of Chinese Liquors by
Jiao Gu, Huaibo Liu, Chaoqun Ma, Lei Li, Chun Zhu, Christ Glorieux, Guoqing Chen (2019)
- Efficient and minimal length parametric conformal prediction regions by Daniel Eck and Forrest Crawford (2019)
- Conformal Prediction for Students' Grades in a Course Recommender System by Raphael Morsomme and Evgueni Smirnov (2019)
- Efficient iterative virtual screening with Apache Spark and conformal prediction by Laeeq Ahmed, Valentin Georgiev, Marco Capuccini, Salman Toor, Wesley Schaal, Erwin Laure and Ola Spjuth (2018)
- Predicting Off-Target Binding Profiles With Confidence Using Conformal Prediction by Samuel Lampa, Jonathan Alvarsson, Staffan Arvidsson Mc Shane, Arvid Berg, Ernst Ahlberg, Ola Spjuth (2018)
- Maximizing gain in high-throughput screening using conformal prediction by Fredrik Svensson, Avid M. Afzal1, Ulf Norinder and Andreas Bender (2018)
- Conformalized Survival Analysis by Emmanuel Candรจs, Lihua Lei and Zhimei Ren (2021) R-Code ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Random Forest Prediction Intervals by Haozhe Zhangโ , Joshua Zimmermanโ , Dan Nettletonโ and Daniel J. Nordmanโ (Iowa State University, USA, 2019)
- Conformal Training: Learning Optimal Conformal Classifiers | DeepMind by David Stutz (DeepMind), Krishnamurthy Dvijotham, Ali Taylan Cemgil and Arnaud Doucet (2021)
- Comparing the Bayes and typicalness frameworks by Thomas Melluish, Craig Saunders, Ilia Nouretdinov, and Volodya Vovk (Royal Holloway, UK, 2001). ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Large-scale probabilistic predictors with and without guarantees of validity by Vladimir Vovk, Ivan Petej, and Valentina Fedorova (Royal Holloway, Yandex, NeurIPS) ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Inductive conformal prediction for silent speech recognition by Ming Zhang, You Wang, Wei Zhang, Meng Yang, Zhiyuan Luo and Guang Li (2020)
- Conformal Prediction using Conditional Histograms by Matteo Sesia and Yaniv Romano (NeurIPS 2021 paper). code ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Valid prediction intervals for regression problems by Nicolas Dewolf, Bernard De Baets, Willem Waegeman (2021) ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Application of conformal prediction interval estimations to market makersโ net positions by Wojciech Wisniewski, David Lindsay, Sian Lindsay (Royal Holloway, UK, 2020)
- Locally Valid and Discriminative Prediction Intervals for Deep Learning Models by Zhen Lin, Shubhendu Trivedi, Jimeng Sun (NeurIPS, 2021) ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Distribution-Free Federated Learning with Conformal Predictions by Charles Lu and Jayashree Kalpathy-Cramer (2022)
- Coreset-based Conformal Prediction for Large-scale Learning by Nery Riquelme-Granada, Khuong Nguyen, Zhiyuan Luo (Royal Holloway, UK, 2019)
- Fast probabilistic prediction for kernel SVM via enclosing balls by Nery Riquelme-Granada, Khuong Nguyen, Zhiyuan Luo (Royal Holloway, UK, 2020)
- Conformalized density- and distance-based anomaly detection in time-series data by Evgeny Burnaev, Vladislav Ishimtsev (2016)
- Predictive Inference with Weak Supervision by Maxime Cauchois, Suyash Gupta, Alnur Ali and John Duchi (Stanford, 2022)
- Conformal Prediction in Clinical Medical Sciences by Janette Vazquez and Julio C. Facelli University of Utah, 2022)
- Provably Improving Expert Predictions with Conformal Prediction by Eleni Straitouri, Lequng Wang, Nastaran Okati and Manuel Gomez Rodriguez (Max Planck Institute for Software Systems / Cornell University, 2021).
- Conformal predictive distributions with kernels by Vladimir Vovk, Ilia Nouretdinov, Valery Manokhin, Alex Gammerman (Royal Holloway, UK, 2017)
- Multi-class probabilistic classification using inductive and cross VennโAbers predictors by Valery Manokhin (Royal Holloway, UK, 2017). ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Computationally efficient versions of conformal predictive distributions by Vladimir Vovk, Ivan Petej, Ilia Nouretdinov, Valery Manokhin, Alex Gammerman (Royal Holloway, UK, 2019).
- Cover your cough: detection of respiratory events with confidence using a smartwatch by Khuong An Nguyen, Zhiyuan Luo (Royal Holloway, 2019).
- Predicting Amazon customer reviews with deep confidence using deep learning and conformal prediction by Ulf Norinder and Petra Norinder (2022)
- Conformal Prediction for the Design Problem by Clara Fannjianga, Stephen Batesa, Anastasios Angelopoulosa, Jennifer Listgartena and Michael I. Jordan (Berkeley, 2022) ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Image-to-Image Regression with Distribution-Free Uncertainty Quantification and Applications in Imaging by Anastasios N. Angelopoulos, Amit Kohli, Stephen Bates, Michael I. Jordan, Jitendra Malik, Thayer Alshaabi, Srigokul Upadhyayula, Yaniv Romano (Berkeley and Technion, 2022) ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Conformal predictive decision making by Vladimir Vovk and Claus Bendtsen (2018).
- The Lifecycle of a Statistical Model: Model Failure Detection, Identification, and Refitting by Alnur Ali1, Maxime Cauchois and John C. Duchi (Stanford, 2022)
- E-values: Calibration, combination, and applications by Vladimir Vovk (Royal Holloway) and Ruodu Wang (University of Waterloo) (2019)
- Conformal Prediction Sets with Limited False Positives by Adam Fisch, Tal Schuster, Tommi Jaakkola and Regina Barzilay code (MIT / Google Research, 2022) ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Adaptive Conformal Predictions for Time Series by Margaux Zaffran, Aymeric Dieuleveut, Olivier Fe ฬron, Yannig Goude, and Julie Josse (EDF / INRIA / CMAP, France, 2022) ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ Code
- Ensemble Conformalized Quantile Regression for
Probabilistic Time Series Forecasting by Vilde Jensen, Filippo Maria Bianchi, Stian Norman Anfinsen (Arctic University of Norway, 2022) TIME SERIES ๐๐๐๐๐ ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ Python Code
- Prediction of Metabolic Transformations using Cross Venn-ABERS Predictors by Staffan Arvidsson, Ola Spjuth, Lars Carlsson and Paolo Toccaceli (University of Uppsala, Astra Zeneca, Royal Holloway, 2017)
- Probabilistic Prediction in scikit-learn by Sweidan, Dirar and Ulf Johansson. ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Conformalized Online Learning: Online Calibration Without a Holdout Set by Shai Feldman, Stephen Bates and Yaniv Romano (2022). TIME SERIES ๐๐๐๐๐ ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Valid model-free spatial prediction by Huiying Mao, Ryan Martin and Brian J Reich (2020)
- Conformal Prediction with Temporal Quantile Adjustments by Zhen Lin, Shubhendu Trivedi, Jimeng Sun (2022) TIME SERIES ๐๐๐๐๐ ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Calibration of Natural Language Understanding Models with VennโABERS Predictors by Patrizio Giovannotti (Royal Holloway, UK, 2022) NLP
- Conformal prediction interval for dynamic time-series by Chen Xu, Yao Xie (Georgia Tech, 2021) TIME SERIES ๐๐๐๐๐ ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Conformal prediction set for time-series by Chen Xu, Yao Xie (Georgia Tech, 2022) TIME SERIES ๐๐๐๐๐ ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Adaptive Conformal Predictions for Time Series by Margaux Zaffran, Aymeric Dieuleveut, Olivier Fe ฬron, Yannig Goude, and Julie Josse (2022) TIME SERIES ๐๐๐๐๐ ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅCode
- Conformal Time-Series Forecasting by Kamile Stankeviciu te and Ahmed M. Alaa (2021) TIME SERIES ๐๐๐๐๐ ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Efficient Conformal Prediction via cascaded inference with expanded admission by Adam Fisch, Tal Schuster, Tommi Jaakkola, Regina Barzilay (MIT 2021]. Python Code
- Split Localized Conformal Prediction by Xing Han, Ziyang Tang, Joydeep Ghosh, Qiang Liu (University of Texas, 2022). Python Code
- Three Applications of Conformal Prediction for Rating Breast Density in Mammography by Charles Lu, Ken Chang, Praveer Singh, Jayashree Kalpathy-Crame (2022)
- Conformal prediction set for time-series by Chen Xu, Yao Xie (Georgia Tech, 2022) Python Code TIME SERIES ๐๐๐๐๐ ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Recommendation systems with distribution-free reliability guarantees) by Anastasious Angelopolous, Karl Krauth, Stephen Bates, Yixin Wang and Michael I. Jordan (Berkeley 2022)
- Model Agnostic Conformal Hyperparameter Optimization by Riccardo Doyle (Spotify, 2022)
- Improving Trustworthiness of AI Disease Severity Rating in Medical Imaging with Ordinal Conformal Prediction Sets by Charles Lu, Anastasios N. Angelopoulos, Stuart Pomerantz (2022) code ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Conformal Off-Policy Prediction in Contextual Bandits by Muhammad Faaiz Taufiq, Jean-Franรงois Ton, Rob Cornish, Yee Whye Teh, Arnaud Doucet (Oxford, 2022) Video presentation
- Training Uncertainty-Aware Classifiers with Conformalized Deep Learning by Bat-Sheva Einbinder, Yaniv Romano, Matteo Sesia, Yanfei Zhou (Technion, USCLA 2022) Video presentation; Code
- Semantic uncertainty intervals for disentangled latent space by Swami Sankaranarayanan, Anastasios N. Angelopoulos, Stephen Bates, Yaniv Romano, and Phillip Isola (Unversity of Berkeley, Technion, 2022) ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- MAPIE: an open-source library for distribution-free uncertainty quantification by Vianney Taquet, Vincent Blot, Thomas Morzadec, Louis Lacombe, Nicolas Brunel (Quantmetry, France, 2022)
- CODiT: Conformal Out-of-Distribution Detection in Time- Series Data by Ramneet Kaur et.al., Unibersity of Pensylvania (2022). Code TIME SERIES ๐๐๐๐๐ ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Confident Adaptive Language Modeling by Tal Schuster, Adam Fisch, Jai Gupta, Mostafa Dehghani, Dara Bahri, Vinh Q. Tran, Yi Tay, Donald Metzler (Google, MIT, 2022j
- Probabilistic Conformal Prediction Using Conditional Random Samples by Zhendong Wang, Ruijiang Gao, Mingzhang Yin, Mingyuan Zhou, David M. Blei (Columbia University, 2020) Code
- A general framework for multi-step ahead adaptive conformal heteroscedastic time series forecasting by Martim Sousa, Ana Maria Tome and Jose Moreira (University of Aveiro, 2022) TIME SERIES ๐๐๐๐๐ ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- A novel Deep Learning approach for one-step Conformal Prediction approximation by Julia A. Meister, Khuong An Nguyen, Stelios Kapetanakis and Zhiyuan Luo (University of Brighton, UK, 2022) ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Conformal Risk Control by Anastasious Angelopolous, Stephen Bates, Adam Fisch, Lihua Lei and Tal Schuster (Berkeley, Stanford, MIT and Google Research, 2022) ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- CD-split and HPD-split: Efficient Conformal Regions in High Dimensions by Rafael Izbicki, Gilson Shimizu, Rafael B. Stern (San Carlos University Brazil, 2022)
- Flexible distribution-free conditional predictive bands using density estimators by Rafael Izbicki, Gilson Shimizu, and Rafael B. Stern (San Carlos University Brazil, 2020)
- Split Conformal Prediction for Dependent Data by Roberto I. Oliveira, Paulo Orenstein, Thiago Ramos, Joรฃo Vitor Romano (IMPA, Rio de Janeiro, Brazil, 2022)
- Conformal Inference for Online Prediction with Arbitrary Distribution Shifts by Isaac Gibbs and Emmanual Candes (Stanford, 2022) ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- A General Framework For Multi-step Ahead Adaptive Conformal Heteroscedastic Time Series Forecasting by Martim Sousa, Ana Maria Tomรฉ, University of Aveiro (2022) Code TIME SERIES ๐๐๐๐๐ ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Cough-based COVID-19 detection with audio quality clustering and confidence measure based learning by Alice E. Ashby, Julia A. Meister, Khuong An Nguyen, Zhiyuan Luo, Werner Gentzk (University of Brighton, 2022)
- Assessing Explanation Quality by Venn Prediction by Amr Alkhatib, Henrik Bostroem and Ulf Johansson (2022)
- Conformal prediction for hypersonic flight vehicle classification by Zepu Xi, Xuebin Zhuang, Hongbo Chen (Yat-sen University, Guangzhou, China, 2022) Slides
- Robust Gas Demand Forecasting With Conformal Prediction by Mouhcine Mendil, Luca Mossina, Marc Nabhan, Kevin Pasini (2022)
- Conformal Prediction Interval Estimations with an Application to Day-Ahead and Intraday Power Markets by Christopher Kath and Florian Ziel (2020)
- Conformal Prediciton beyond exchangeability by Rina Foygel Barber, Emmanuel J. Candes, Aaditya Ramdas, Ryan J. Tibshirani (2022)
- Robust Gas Demand Forecasting with Conformal Prediction by Mouhcine Mendil, Luca Mossina, Marc Nabhan, Kevin Pasini (2022)
- Split conformal prediction for dependant data by Roberto I. Oliveira, Paulo Orenstein, Thiago Ramos and Joรฃo Vitor Romano (2022)
- Integrative conformal p-values for powerful out-of-distribution testing with labeled outliers by Ziyi Liang, Matteo Sesia, Wenguang Sun (UCLA, 2022)
- Conformal Prediction Bands for Two-Dimensional Functional Time Series by
Niccolo` Ajroldia, Jacopo Diquigiovannib, Matteo Fontanac, Simone Vantinia (2022)
- Conformal prediction of small-molecule drug resistance in cancer cell lines by Saiveth Hernandez-Hernandez, Sachin Vishwakarma and Pedro Ballester (2022)
- Ellipsoidal conformal inference for Multi-Target Regression by Soundouss Messoudi, Sebastien Destercke, Sylvain Rousseau (2022) Slides
- Conformal Methods for Quantifying Uncertainty in Spatiotemporal Data: A Survey by Sophia Sun (UCLA, 2022)
- Deep Learning With Conformal Prediction for Hierarchical Analysis of Large-Scale Whole-Slide Tissue Images by Hรฅkan Wieslander , Philip J. Harrison, Gabriel Skogberg, Sonya Jackson, Markus Fridรฉn, Johan Karlsson, Ola Spjuth, and Carolina Wรคhlby (2021)
- Audioโvisual domain adaptation using conditional semi-supervised Generative Adversarial Networks by Christos Athanasiadis, Enrique Hortal, Stylianos Asteriadis (2022)
- Conformal Prediction is Robust to Label Noise by Bat-Sheva Einbinder, Stephen Bates, Anastasios N. Angelopoulos, Asaf Gendler, Yaniv Romano (2022)
- Copula Conformal Prediction for Multi-step Time Series Forecasting TIME SERIES ๐๐๐๐๐ ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Batch Multivalid Conformal Prediction by Christopher Jung, Georgy Noarov, Ramya Ramalingam, Aaron Roth (Stanford, university of Pensylvania, 2022)
- Selection by Prediction with Conformal p-values by Ying Jin1 and Emmanuel J. Candes, (Stanford, 2022) Video code
- Few-Shot Calibration of Set Predictors via Meta-Learned Cross-Validation-Based Conformal Prediction by Sangwoo Park, Kfir M. Cohen, Osvaldo Simeone (2022)
- Conformalized Fairness via Quantile Regression by Meichen Liu, Lei Ding,
Dengdeng Yu, Wulong Liu, Linglong Kong, Bei Jiang (University of Alberta, Noah Arc Huawei, 2022)
- Test-time recalibration of conformal predictors under distribution shift based on unlabeled examples by Fatih Furkan Yilmaz, and Reinhard Heckel (Rice University / University of Munuch, 2022)
- Extending Conformal Prediction to Hidden Markov Models with Exact Validity via de Finetti's Theorem for Markov Chains by Buddhika Nettasinghe, Samrat Chatterjee, Ramakrishna Tipireddy, Mahantesh Halappanavar (2022)
- Predictive inference with feature conformal prediction by Jiaye Teng, Chuan Wen, Dinghuai Zhang,
Yoshua Bengio, Yang Gao, Yang Yuan (Tsinghua University, Mila - Quebec AI Institute, Shanghai Artificial Intelligence Laboratory, Shanghai Qi Zhi Institute, 2022) code ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Constructing Prediction Intervals with Neural Networks: An Empirical Evaluation of Bootstrapping and Conformal Inference Methods by Alex Contarino, Christine Schubert Kabban, Chancellor Johnstone and Fairul Mohd-Zaid (2022)
- Spatio-Temporal Wildfire Prediction using Multi-Modal Data by Chen Xu1, Yao Xie,
Daniel A. Zuniga Vazquez, Rui Yao, and Feng Qiu (2022)
- Calibrating AI models for few-shot demodulation via conformal prediction Kfir M. Cohen1, Sangwoo Park, Osvaldo Simeone, Shlomo Shamai (2022)
- Test-time recalibration of conformal predictors under distribution shift based on unlabeled examples
Code
- Nonparametric Quantile Regression: Non-Crossing Constraints and Conformal Prediction by Wenlu Tang, Guohao Shen, Yuanyuan Lin and Jian Huang (The Hong Kong Polytechnic University, 2022)
- Safe Planning in Dynamic Environments using Conformal Prediction by
Lars Lindemann, Matthew Cleavelandโ, Gihyun Shim, and George J. Pappas (University of Pensylvania, 2022)
- Conformal prediction under feedback covariate shift for biomolecular design by Clara Fannjiang, Stephen Bates, Anastasios N. Angelopoulos,and Michael I. Jordan (2022) ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Conformal Predictor for Improving Zero-shot Text Classification Efficiency by Prafulla Kumar Choubey, Yu Bai, Chien-Sheng Wu, Wenhao Liu, Nazneen Rajani (Saleforce AI Research and Hugging Face, 2022)
- Bayesian Optimization with Conformal Coverage Guarantees by Samuel Stanton, Wesley Maddox and Andrew Gordon Wilson (Genentech, New York University, 2022) Code ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Measuring the Confidence of Traffic Forecasting Models: Techniques, Experimental Comparison and Guidelines towards Their Actionability by Ibai Lanaa, Ignacio (In ฬaki) Olabarrietaa, Javier Del Sera (2022)
- Training Uncertainty-Aware Classifiers with Conformalized Deep Learning by Bat-Sheva Einbinder, Yaniv Romano, Matteo Sesia and Yanfei Zhou (Technion/UCLA, NeurIPS 2022 paper) ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Conformalized Fairness via Quantile Regression by Meichen Liu, Lei Ding, Dengdeng Yu, Wulong Liu, Linglong Kong, Bei Jiang (University of Alberta, Huawei Noahโs Ark Lab Canada, NeurIPS 2022 paper) Code ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Engineering Uncertainty Representations to Monitor Distribution Shifts by Thomas Bonnier and Benjamin Bosch (Sociรฉtรฉ Gรฉnรฉrale, 2022)
- CONffusion: CONFIDENCE INTERVALS FOR DIFFUSION MODELS ProjectCode by Eliahu Horwitz, Yedid Hoshen (Hebrew University of Jerusalem, 2022) ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Semantic uncertainty intervals for disentangled latent spaces by Swami Sankaranarayanan, Anastasios N. Angelopoulos, Stephen Bates, Yaniv Romano, Phillip Isola (MIT, Berkeley, Technion, 2022) ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- But are you sure? An uncertainty-aware perspective on explainable AI by Charlie Marx, Youngsuk Park, Hilaf Hasson, Yuyang (Bernie) Wang, Stefano Ermon, Jun Huan (2022)
- Calibrating AI Models for Wireless Communications via Conformal Prediction by Kfir M. Cohen, Sangwoo Park, Osvaldo Simeone and Shlomo Shamai (2022)
- Predicting Endocrine Disruption Using Conformal Prediction โ Aย Prioritization Strategy to Identify Hazardous Chemicals with Confidence by Maria Sapounidou, Ulf Norinder and Patrick Andersson (2022)
- Conformal Loss-Controlling Prediction by Di Wang, Ping Wang, Zhong Ji, Xiaojun Yang, Hongyue Li (2023)
- ROBUST AND SCALABLE UNCERTAINTY ESTIMATION WITH CONFORMAL PREDICTION FOR MACHINE-LEARNED INTERATOMIC POTENTIALS Code by Yuge Hu, Joseph Musielewicz, Zachary Ulissi, Andrew J. Medford (Georgia Institute of Technology/Carnegie Mellon University, 2022)
- Clustering of Trajectories using Non-Parametric Conformal DBSCAN Algorithm by Haotian Wang, Jie Gao, Min-ge Xie Rutgers University, 2022)
- But Are You Sure? An Uncertainty-Aware Perspective on Explainable AI by Charlie Marx, Youngsuk Park, Hilaf Hasson, Yuyang Wang, Stefano Ermon, Jun Huan (2022)
- Prediction-Powered Inference by Anastasios N. Angelopoulos, Stephen Bates, Clara Fannjiang, Michael I. Jordan, Tijana Zrnic (Universify of Berkeley, 2022) code ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Conformal Prediction for Trustworthy Detection of Railway Signals by Leo Andeol, Thomas Fel, Florence de Grancey, Luca Mossina (Institute de Mathematiques de Toulouse, SCNF, 2022)
- Conformal inference is (almost) free for neural networks trained with early stopping by Ziyi Liang, Yanfei Zhouโ , Matteo Sesia (University of Southern California, 2022)
- PAC Prediction Sets for Large Language Models of Code by Adam Khakhar, Stephen Mell, Osbert Bastani (University of Pennsylvania, 2023)
- Physics Constrained Motion Prediction with Uncertainty Quantification by
Renukanandan Tumu, Lars Lindemannโ , Truong Nghiem, Rahul Mangharam, (2023)
- Accelerating difficulty estimation for conformal regression forests by Henrik Bostroem, Henrik Linusson, Tuve Loefstroem, Ulf Johansson (2017)
- Conformal prediction for exponential families and generalized linear models
- How to Trust Your Diffusion Model: A Convex Optimization Approach to Conformal Risk Control by Jacopo Teneggi, Matt Tivnan, J Webster Stayman, Jeremias Sulam (John Hopkins University, 2023) Code
- Localized Conformal Prediction: A Generalized Inference Framework to Conformal Prediction Code R package
- From Group-Differences to Single-Subject Probability: Conformal Prediction-based Uncertainty Estimation for Brain-Age Modeling by Ernsting et.al. (2023)
- Conformal prediction for STL runtime verification by Lars Lindemann, Xin Qin, Jyotirmoy V. Deshmukh, George J. Pappas (University of Pennsylvania/University of Southern California, 2022)
- Adaptive Conformal Prediction for Motion Planning among Dynamic Agents by Anushri Dixit, Lars Lindemann, Skylar Wei, Matthew Cleaveland, George J Pappas, Joel W Burdick (California Institute of Technology/University of Pennsylvania, 2022)
- Classification with Valid and Adaptive Coverage Code by Yaniv Romano, Matteo Sesia, Emmanuel Candes (Neurips, 2020) ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Risk Control for Online Learning Models by Shai Feldman, Liran Ringel, Stephen Bates, Yaniv Romano (2023)
- Derandomized novelty detection with FDR control via conformal e-values by Meshi Bashari, Amir Epstein, Yaniv Romano, and Matteo Sesia (2023) code
- Sensititivty analysis of individual treatment effects: A robust conformal inference approach Code by Ying Jin, Zhimei Ren and Emmanual Candes (2023)
- Improving Adaptive Conformal Prediction Using Self-Supervised Learning by Nabeel Seedat, Alan Jeffares, Fergus Imrie and Mihaela van der Schaar (Cambridge, 2023) Video Code
- [Learning by Transduction - of the of earliest conformal prediction papers] (https://dl.acm.org/doi/10.5555/2074094.2074112#sec-comments) by Alex Gammerman, Vladimir Vovk and Vladimir Vapnik (Royal Holloway, University of London, 1998) ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Hedging Predictions in Machine Learning by
Alexander Gammerman and Vladimir Vovk (2008) ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Predicting Aromatic Amine Mutagenicity with Confidence: A Case Study Using Conformal Prediction by Ulf Norinder, Glenn Myatt and Ernst Ahlberg
- Improved Online Conformal Prediction via Strongly Adaptive Online Learning by Aadyot Bhatnagar, Huan Wang, Caiming Xiong, Yu Bai (2023) TIME SERIES ๐๐๐๐๐ ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Fortuna: A Library for Uncertainty Quantification in Deep Learning by Gianluca Detommaso, Alberto Gasparin, Michele Donini, Matthias Seeger, Andrew Gordon Wilson, Cedric Archambeau (2023)
- Conformal inference is (almost) free for neural networks trained with early stopping by Ziyi Liang, Yanfei Zhou, Matteo Sesia (2023)
- Intervening With Confidence: Conformal Prescriptive Monitoring of Business Processes by Mahmoud Shoush and Marlon Dumas (University of Tartu,2022)
- Machine-Learning Applications of Algorithmic Randomness by Vladimir Vovk, Alex Gammerman and Craig Saunders (1999) ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- On the universal distribution of the coverage in split conformal prediction by Paulo C. Marques F. (2023)
- Lightweight, Uncertainty-Aware Conformalized Visual Odometry by Alex C. Stutts, Danilo Erricolo, Theja Tulabandhula, and Amit Ranjan Trivedi (University of Illinois Chicago, 2023)
- Group conditional validity via multi-group learning by Samuel Deng, Navid Ardeshir, Daniel Hsu (Columbia University, 2023)
- Improving Uncertainty Quantification of Deep Classifiers via Neighborhood Conformal Prediction: Novel Algorithm and Theoretical Analysis by Subhankar Ghosh, Taha Belkhouj, Yan Yan, Janardhan Rao Doppa (Washington State University, 2023)
- Mondrian conformal regressors by Henrik Bostrรถm, Ulf Johansson (2020)
- Mondrian Conformal Predictive Distributions by Henrik Bostrรถm, Ulf Johansson,
Tuwe Lรถfstrรถm (2021) ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Adaptive Conformal Prediction by Reweighting Nonconformity Score by Salim I. Amoukou, Nicolas J.B Brunel (2023) Code
- Object Pose Estimation with Statistical Guarantees: Conformal Keypoint Detection and Geometric Uncertainty Propagation by Heng Yang and Marco Pavone (NVIDIA, 2023)
- A Two-Sample Conditional Distribution Test Using Conformal
Prediction and Weighted Rank Sum by Xiaoyu Hu and Jing Lei (Peking University and Carnegie Mellon University, 2023)
- Conformalized Semi-Supervised Random Forest For Classification and Abnormality Detection (2023)
- How to Trust Your Diffusion Model: A Convex Optimization Approach to Conformal Risk Control Jacopo Teneggi, Matt Tivnan, J Webster Stayman, Jeremias Sulam (John Hopkins University, 2023)
- Safe Perception-Based Control under Stochastic Sensor
Uncertainty using Conformal Prediction by Shuo Yang, George J. Pappas, Rahul Mangharam, and Lars Lindemann (University of Pennsylvania, 2023)
- Conformal Prediction Regions for Time Series using Linear Complementarity Programming by Matthew Cleaveland, Insup Lee, George J. Pappasโ , and Lars Lindemann (University of Pennsylvania, 2023)
- Development and Evaluation of Conformal Prediction Methods for QSAR by Yuting Xua, Andy Liawa, Robert P. Sheridan (Merck, 2023)
- Multi-Agent Reachability Calibration with Conformal Prediction by Anish Muthali1, Haotian Shen, Sampada Deglurkar, Michael H. Lim, Rebecca Roelofs, Aleksandra Faust, Claire Tomlin (University of Berkeley, 2023)
- Conformalized Unconditional Quantile Regression by Ahmed M. Alaa, Zeshan Hussain, David Sontag (Berkeley/MIT, 2023).
- Conformal Off-Policy Evaluation in Markov Decision Processes by
Daniele Foffano, Alessio Russo and Alexandre Proutiere (KTH, 2023) ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ ๐๐๐๐๐
- Quantum Conformal Prediction for Reliable Uncertainty Quantification in Quantum Machine Learning by Sangwoo Park and Osvaldo Simeone (2023) Code QuantumML ๐๐๐๐๐ ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Probabilistic prediction with locally weighted jackknife predictive system by Di Wang, Ping Wang, Pingping Wang, Cong Wang, Zhen He, Wei Zhang ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Post-selection Inference for Conformal Prediction: Trading off Coverage for Precision by Siddhaarth Sarkar, Arun Kumar Kuchibhotla (2023)
- Conformal Regression in Calorie Prediction for Team Jumbo-Visma by Kristian van Kuijk, Mark Dirksen, Christof Seiler (2023) ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅslides
- Design-based conformal prediction by Jerzy Wieczorek (2023) code ๐๐๐๐๐
- Inductive Confidence Machines for Regression by
Harris Papadopoulos, Kostas Proedrou, Volodya Vovk, and Alex Gammerman (2002) ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ๐๐๐๐๐
- Model-Agnostic Nonconformity Functionsfor Conformal Classification by Ulf Johansson, Henrik Linusson, Tuve Lรถfstrรถm, Henrik Bostrรถm (2017) ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ๐๐๐๐๐
- Impact of model-agnostic nonconformity functions on efficiency of conformal classifiers: an extensive study by Marharyta Aleksandrova, Oleg Chertov (2021) ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ๐๐๐๐๐
- Inductive Conformal Prediciton: A Straightforward Introduction with examples in Python by Martim Sousa (2022) Code ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ๐๐๐๐๐
- Closing the Loop on Runtime Monitors with Fallback-Safe MPC by Rohan Sinha, Edward Schmerling, and Marco Pavone (Standord, 2023)
- Calibrated Explanations: with Uncertainty Information and Counterfactuals by Helena Lรถfstrรถm, Tuwe Lรถfstrรถm, Ulf Johansson, Cecilia S ฬonstr ฬod (2023) Code ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Optimizing Hyperparameters with Conformal Quantile Regression by David Salinas, Jacek Golebiowski, Aaron Klein, Matthias Seeger, Cedric Archambeau (Amazon Science, 2023) ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Rapid Traversal of Ultralarge Chemical Space using Machine Learning Guided Docking Screens by Andreas Luttens, Israel Cabeza de Vaca, Leonard Sparring, Ulf Norinder, Jens Carlsson (2023) Code Datasets ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Predicting skin sensitizers with confidence โ Using conformal prediction to determine applicability domain of GARD by Andy Forreryd, Ulf Norinder, Tim Lindberg, Malin Lindstedt (2018) ๐๐๐๐๐
- Confidence-based Prediction of Antibiotic Resistance at the Patient-level Using Transformers by J.S. Inda-Diaz, A. Johnning, M. Hessel, A. Sjo ฬberg, A. Lokrantz, L. Hellda, M. Jirstrand, L. Svensson and E. Kristiansson (Chalmers University of Technology and University of Gothenburg/Centre for Antibiotic Resistance Research (CARe), 2023) ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Framework based on conformal predictors and power martingales for detection of fixed football matches by I. Zhuk, O. Chertov (2023)
- Principal Uncertainty Quantification with Spatial Correlation for Image Restoration Problems by Omer Belhasin, Yaniv Romano, Daniel Freedman, Ehud Rivlin, Michael Elad (2023) ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Conformalized matrix completion by Yu Gui, Rina Foygel Barber, and Cong Ma (University of Chicago, 2023) ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ code
- Conformal Prediction With Conditional Guarantees by Isaac Gibbs, John Cherian, Emmanuel Candes (Stanford, 2023) code
- Uncertainty Quantification over Graph with Conformalized Graph Neural Networks by Kexin Huang, Ying Jin, Emmanuel Candes, Jure Leskovec (Stanford, 2023) code ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Federated Conformal Predictors for Distributed Uncertainty Quantification by Charles Lu, Yaodong Yu, Sai Praneeth Karimireddy, Michael I. Jordan, Ramesh Raskar (MIT/Berkeley, 2023) code video ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Conformal Prediction with Large Language Models for Multi-Choice Question Answering by Bhawesh Kumar, Charlie Lu, Gauri Gupta, Anil Palepu, David Bellamy, Ramesh Raskar, Andrew Beam (Harvard/MIT, 2023) ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Conformal Predictive Distribution Trees by Ulf Johansson, Tuwe Lรถfstrรถm, Henrik Bostrรถm (2023) ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- CONFORMAL PREDICTION WITH PARTIALLY LABELED DATA by Alireza Javanmardi, Yusuf Sale, Paul Hofman, Eyke Hรผllermeier (2023)
- Conformal Prediction for Federated Uncertainty Quantification Under Label Shift by Vincent Plassie, Mehdi Makni, Aleksandr Rubashevskii, Eric Moulines, Maxim Panov (2023)
- Conformalizing Machine Translation Evaluation by Chrysoula Zerva, Andrรฉ F. T. Martins (2023)
- Class-Conditional Conformal Prediction With Many Classes by Tiffany Ding, Anastasios N. Angelopoulos, Stephen Bates, Michael I. Jordan, Ryan J. Tibshirani ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ (Berkeley, 2023)
- Conformal Prediction Sets for Graph Neural Networks by Soroush Zargarbashi, Simone Antonelli, Aleksandar Bojchevski Code
- Conformal link prediction to control the error rate by Ariane Marandon (2023)
- JAWS-X: Addressing Efficiency Bottlenecks of Conformal Prediction
Under Standard and Feedback Covariate Shift Drew Prinster, Suchi Saria, Anqi Liu (John Hopkins University, 2023) Code ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Bayesian Optimization with Formal Safety Guarantees via Online Conformal Prediction by Yunchuan Zhang, Sangwoo Park and Osvaldo Simeone (2023)
- Robots That Ask For Help: Uncertainty Alignment for Large Language Model Planners by Allen Z. Ren, Anushri Dixit, Alexandra Bodrova, Sumeet Singh, Stephen Tu, Noah Brown, Peng Xu, Leila Takayama, Fei Xia, Jake Varley, Zhenjia Xu, Dorsa Sadigh, Andy Zeng, Anirudha Majumdar (Princeton/DeepMind, 2023) Website ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Large scale comparison of QSAR and conformal prediction methods and their applications in drug discovery by Nicolas Bosc, Francis Atkinson, Eloy Felix, Anna Gaulton, Anne Hersey and Andrew R. Leach (Cambridge, 2019) ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Efficiency Comparison of Unstable Transductive and Inductive Conformal Classifiers by Henrik Linusson, Ulf Johansson, Henrik Bostroem, and Tuve Loefstroem (2014)
- How to Trust Your Diffusion Model: A Convex Optimization Approach to Conformal Risk Control Code (John Hopkins University, 2023) ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Conformal Test Martingale-Based Change-Point Detection for Geospatial Object Detectors by Gang Wang, Zhiying Lu, Ping Wang, Shuo Zhuang and Di Wang (2023)
- Plug-in martingales for testing exchangeability on-line by Valentina Fedorova, Alex Gammerman, Ilia Nouretdinov, Vladimir Vovk (Royal Holloway, UK, ICML 2012) ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Testing Exchangeability On-Line by Vladimir Vovk, Ilia Nouretdinov and Alex Gammerman (Royal Holloway, UK, ICML 2003) ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Predictive Inference Is Free with the Jackknife+-after-Bootstrap by Byol Kim, Chen Xu, Rina Foygel Barber (University of Chicago, 2020) ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Conformal Prediction with Large Language Models for Multi-Choice Question Answering by Bhawesh Kumar, Charles Lu, Gauri Gupta, Anil Palepu, David Bellamy, Ramesh Raskar, Andrew Beam (MIT, 2023) code ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- CONFORMAL PREDICTIONS ENHANCED EXPERT-GUIDED MESHING WITH GRAPH NEURAL NETWORKS code by Amin Heyrani Nobari, Justin Rey, Suhas Kodali and Matthew Jones (MIT, 2023) website ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Approximating Full Conformal Prediction at Scale via Influence Functions by Javier Abad, Umang Bhatt, Adrian Weller, Giovanni Cherubin (Cambridge, Alan Turing Institute, ETH, Microsoft Research, 2023) code video ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Robust Uncertainty Quantification using Conformalised Monte Carlo Prediction Code by Daniel Bethell, Simos Gerasimou, Radu Calinescu (University of York, 2023) article code ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- I do not know! but why?โโ Local Model-Agnostic Example-based explanations of reject code by Andre Artelt, Roel Visser and Barbara Hammer (University of Bielefeld, 2023)
- Approximating Score-based Explanation Techniques Using Conformal Regression by Amr Alkhatib, Henrik Bostroem, Sofiane Ennadir and Ulf Johansson (KTH/Joenkoeping University, 2023) ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Quantile Risk Control: A Flexible Framework for Bounding the Probability of High-Loss Predictions by Jake C. Snell, Thomas P. Zollo, Zhun Deng, Toniann Pitassi, Richard Zemel (Princeton University, Columbia University, Harvard University, University of Toronto, 2023) ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Improving Deep Learning-Based Defect Classification in Solar Cells using Conformal Prediction by Vitus Bรธdker Thomsen, Claire Mantel, Gisele Benatto, Sรธren Forchhammer (DTU - Technical University of Denmark, 2023) ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Adaptive Conformal Prediction by Reweighting Nonconformity Scores by Salim I. Amoukou and Nicolas J-B. Brunel and Nicolas J-B. Brunel (University Paris Saclay, Stellantis Paris, Quantmetry Paris, 2023) code ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Copula-based conformal prediction for Multi-Target Regression by Soundouss Messoudi, Sรฉbastien Destercke, Sylvain Rousseau (2021) code ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Conformal Meta-learners for Predictive Inference of Individual Treatment Effects by Ahmed Alaa, Zaid Ahmad, and Mark van der Laan (2023) code ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Adaptive conformal classification with noisy labels by Matteo Sesia, Y. X. Rachel Wangโ , Xin Tong code ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Heteroskedastic conformal regression by NICOLAS DEWOLF, BERNARD DE BAETS AND WILLEM WAEGEMAN (2023) ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ (UGent, 2023)
- Closing the Loop on Runtime Monitors with Fallback-Safe MPC by Rohan Sinha, Edward Schmerling, and Marco Pavone (Stanford, 2023) ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Conformal Temporal Logic Planning using Large Language Models: Knowing When to Do What and When to Ask for Help project website by Jun Wang, Jiaming Tong, Kaiyuan Tan, Yevgeniy Vorobeychik, Yiannis Kantaros (Washington University in St.Louis and University of Zurich, 2023) ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Simultaneous regression and classification for drug sensitivity prediction using an advanced random forest method code by Kerstin Lenhof, Lea Eckhart, Nico Gerstner, Tim Kehl & Hans-Peter Lenhof (Saarland University, 2022) ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Conformalized Quantile Regression by Yaniv Romano, Evan Patterson, Emmanuel J. Candรจs (Stanford, 2019) [code](Conformalized Quantile Regression](https://github.com/yromano/cqr) project ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Fast nonlinear vector quantile regression by Aviv A. Rosenberg, Sanketh Vedula, Yaniv Romano and Alex M. Bronstein (Technion, 2023) code ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Testing for Outliers with Conformal p-values by Stephen Bates, Emmanuel Candes,Lihua Lei, Yaniv Romano,Matteo Sesia (Berkeley/Stanford/Technion, 2022) code ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Achieving Risk Control in Online Learning Settings by Shai Feldman, Liran Ringel, Stephen Bates, Yaniv Romano (Technion/Berkeley, 2021) code
- Reliable assessment of uncertainty for appliance recognition in NILM using conformal prediction by Lorin Werthen-Brabants, Tom Dhaene, Dirk Deschrijver (Ghent University, 2023) ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Online NoVaS Conformal Volatility Prediction slides by Alejandro Canete (University of Chicago) ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ (2023)
- Market Implied Conformal Volatility Intervals slides by Alejandro Canete (University of Chicago) ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ (2023)
- PUNCC: a Python Library for Predictive Uncertainty Calibration and Conformalization slides code ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- The Venn-ABERS Testing for Change-Point Detection slides by Ilia Nouretdinov and Alex Gammerman (Royal Holloway, 2023) ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- A Review of Nonconformity Measures for Conformal Prediction in Regression slides by Yuko Kato, David M.J. Tax, Marco Loog (Delft University of Technology, Radboud University, Nijmegen, Netherlands, 2023)
- Approximating Score-based Explanation Techniques Using Conformal Regression slides by Amr Alkhatib, Henrik Bostroem, Sofiane Ennadir, Ulf Johansson (KTH, Joenkoeping University, 2023).
- Mondrian Predictive Systems for Censored Data slides by Henrik Bostroem, Henrik Linusson, Anders Vesterberg (KTH, Ekkono Solutions AB, Scania CV AB, Sweden 2023).
- Evaluating Machine Translation Quality with Conformal Predictive Distributions slides by Patrizio Giovannotti (Royal Holloway, UK) ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Confidence Calibration for Systems with Cascaded Predictive Modules by Yunye Gong, Yi Yao, Xiao Lin, Ajay Divakaran, Melinda Gervasio (SRI International, 2023)
- TriadNet: Sampling-free predictive intervals for lesional volume in 3D brain MR images by Benjamin Lambert, Florence Forbes, Senan Doyle, and Michel Dojat (Grenoble Institut Neurosciences / Univ. Grenoble Alpes, Pixyl, 2023) ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Conformal Predictions for longitudinal data by Devesh Batra, Salvatore Mercuri and Raad Khraishi (Data Science & Innovation - NatWest Group, Institute of Finance and Technology, UCL, UK, 2023) TIME SERIES ๐๐๐๐๐ ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Distribution-free risk assessment of regression-based machine learning algorithms by Sukrita Singh, Neeraj Sarna, Yuanyuan Li, Yang Lin, Agni Orfanoudaki (University of Oxford / MunichRe, 2023).
- CONFORMAL PREDICTION FOR DEEP CLASSIFIER VIA LABEL RANKING by Jianguo Huang, Huajun Xi, Linjun Zhang, Huaxiu Yao, Yue Qiu, Hongxin Wei (Southern University of Science and Technology, ShanghaiTech University, Rutgers University, University of North Carolina at Chapel Hill, Chongqing University) ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ code
- On the Expected Size of Conformal Prediction Sets by Guneet S. Dhillon, George Deligiannidis, Tom Rainforth (University of Oxford, 2023) code๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Clinical AI tools must convey predictive uncertainty for each individual patient (2023)๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Group-Conditional Conformal Prediction via Quantile Regression Calibration for Crop and Weed Classification by Paul Melki, Lionel Bombrun, Boubacar Diallo, Jรฉrรดme Dias, Jean-Pierre Da Costa by EXXACT Robotics (2023) ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Guaranteed Coverage Prediction Intervals with Gaussian Process Regression by Harris Papadopoulos (2023) ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Conformal prediction with missing values by Margaux Zaffran, Aymeric Dieuleveut, Julie Joss, Yaniv Romano (2023) Video summary code ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- TRIAGE: Characterizing and auditing training data for improved regression by Nabeel Seedat, Jonathan Crabbรฉ, Zhaozhi Qian, Mihaela van der Schaar (University of Cambridge, 2023) code) ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Conformal PID Control for Time Series Prediction by Anastasios N. Angelopoulos, Emmanuel J. Candes, Ryan J. Tibshirani (Berkeley/Stanford, NeurIPS2023) code
- Conformal Prediction for Uncertainty-Aware Planning with Diffusion Dynamics Model by Jiankai Sun, Jiankai_Sun, Yiqi Jiang, Jianing Qiu, Parth Talpur Nobel, Mykel Kochenderfer, Mac Schwager (Staford, Imperial College, 2023)
- CoDrug: Conformal Drug Property Prediction with Density Estimation under Covariate Shift by Siddhartha Laghuvarapu, Zhen Lin, Jimeng Sun (University of Illinois Urbana-Champaign, 2023)
- PAC-Bayes Generalization Certificates for Learned Inductive Conformal Prediction Apoorva Sharma, Sushant Veer, Asher Hancock, Heng Yang, Marco Pavone, Anirudha Majumdar (NVIDIA Research, Harvard, Princeton, Stanford 2023) ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Conformal Prediction Sets for Ordinal Classification by Prasenjit Dey, Srujana Merugu, Sivaramakrishnan Kaveri (Amazon, 2023) ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Beyond Confidence: Reliable Models Should Also Consider Atypicality by Mert Yuksekgonul, Linjun Zhang, James Zou, Carlos Guestrin (Stanford/Rutgers) code ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- On the Out-of-Distribution Coverage of Combining Split Conformal Prediction and Bayesian Deep Learning by Paul Scemama, Ariel Kapusta (The Mitre Corporation, 2023)
- A powerful rank-based correction to multiple testing under positive dependency by Alexander Timans, Christoph-Nikolas Straehle, Kaspar Sakmann, Eric Nalisnick (Bosch AI, 2023)
- Prompt Risk Control: A Rigorous Framework for Responsible Deployment of Large Language Models by Thomas P. Zollo, Todd Morrill, Zhun Deng, Jake C. Snell, Toniann Pitassi, Richard Zemel (Columbia University, 2023) ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Risk-Aware and Explainable Framework for Ensuring Guaranteed Coverage in Evolving Hardware Trojan Detection by Rahul Vishwakarma, Amin Rezaei (California State University, 2023) ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Uncertainty quantification in automated valuation models with locally weighted conformal prediction by Anders Hjort, Gudmund Horn Hermansen, Johan Pensar, Jonathan P. Williams (University of Oslo, North Carolina State University, 2023) ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Multi-Modal Conformal Prediction Regions by Optimizing Convex Shape Templates by Renukanandan Tumu, Matthew Cleaveland, Rahul Mangharam, George J. Pappas, Lars Lindemann code (University of Pennsylvania, 2023) ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Verification of Neural Reachable Tubes via Scenario Optimization and Conformal Prediction by Albert Lin, Somil Bansal (University of Southern California, 2023) ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Kandinsky Conformal Prediction: Efficient Calibration of Image Segmentation Algorithms code by Joren Brunekreef, Eric Marcus, Ray Sheombarsing, Jan-Jakob Sonke, Jonas Teuwen (The Netherlands Cancer Institute, University of Amsterdam) (2023)
- Forecasting CPI inflation under economic policy and geo-political uncertainties by Shovon Sengupta, Tanujit Chakraborty, Sunny Kumar Singh (Fidelity Investments, Sorbonne University, BITS Pilani Hyderabad). (2023) ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅcode
- Conformal prediction of option prices by Bastas Joao (University of Lisbon, 2023) ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Towards Modeling Uncertainties of Self-explaining Neural Networks via Conformal Prediction by Wei Qian, Chenxu Zhao, Yangyi Li, Fenglong Ma, Chao Zhang, Mengdi Huai (Iowa University, Pennsylvania State University, Georgia Institute of Technology (2024).
- Greek Proverbs: Computational Spatial Attribution by John Pavlopoulos and Panos Louridas, Athens University of Economics and Business, Greece (2024)
- Conformal causal inference for cluster randomized trials: model-robust inference without asymptotic approximations by Bingkai Wang, Fan Li and Mengxin (University of Michigan, Yale, University of Pennsylvania)
- Distribution-Free Conformal Joint Prediction Regions for Neural Marked Temporal Point Processes by Victor Dheur, Tanguy Bosser, Rafael Izbicki, Souhaib Ben Taieb (Universidade Federal de Sao Carlos, Brazil and University of Mons, Belgium, 2024) code TIME SERIES ๐๐๐๐๐ ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Predicting Random Walks and a Data-Splitting Prediction Region by Mulubrhan G. Haile, Lingling Zhang, and David J. Olive (Westminster College, University of Albany, Southern Illinois University)
- [Conformal Prediction via Regression-as-Classification](Conformal Prediction via Regression-as-Classification](https://openreview.net/forum?id=eKrYMGpXVY) by Etash Guha, Thomas Moellenhoff, Eugene Ndiaye, Shlok Natarajan (RIKEN Center for AI Project Tokyo, Japan, Salesforce, Apple, 2024)
- Conformal Approach To Gaussian Process Surrogate Evaluation With Coverage Guarantees by Edgar Jaber, Vincent Blot, Nicolas Brunel, Vincent Chabridon, Emmanuel Remy, Bertrand Iooss, Didier Lucor, Mathilde Mougeot, Alessandro Leite (EDF R&D, Quantmetry, Paris-Saclay University, ENSIIE, Institut de Math ฬematiques de Toulouse, TAU, INRIA, 2024) code ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Integrating Uncertainty Awareness into Conformalized Quantile Regression code by Raphael Rossellini, Rina Foygel Barber and Rebecca Willett (University of Chicago, 2023) code ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Conformal Prediction Sets Improve Human Decision Making by Jesse C. Cresswell, Yi Sui, Bhargava Kumar, Noel Vouitsis (Layer 6 AI, TD Securities, 2024)
- Benchmarking LLMs via Uncertainty Quantification by Fanghua Ye, Mingming Yang, Jianhui Pang, Longyue Wang, Derek F. Wong, Emine Yilmaz, Shuming Shi, Zhaopeng Tu (Tencent AI Lab, University College London, University of Macau 2024).
- ACHO: Adaptive Conformal Hyperparameter Optimization by Ricardo Doyle (2023) ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ code
- Characterizing Water Composition with an Autonomous Robotic Team Employing Comprehensive In-Situ Sensing, Hyperspectral Imaging, Machine Learning, and Conformal Prediction by John Waczak, Adam Aker, Lakitha O. H. Wijeratne, Shawhin Talebi, Bharana Fernando, Prabuddha Hathurusinghe, Mazhar Iqbal, David Schaefer, David J. Lary (University of Texas Dallas, 2024)
- Non-Exchangeable Conformal Language Generation with Nearest Neighbors by Dennis Ulmer, Chrysoula Zerva, Andrรฉ F.T. Martins (IT University of Copenhagen, Instituto Superior Tรฉcnico, Universidade de Lisboa, 2024) code ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Group-Weighted Conformal Prediction by Aabesh Bhattacharyya, Rina Foygel Barber (University of Chicago, 2024)
- Conformal Monte Carlo Meta-learners for Predictive Inference of Individual Treatment Effects by Jef Jonkers, Jarne Verhaeghe, Glenn Van Wallendael, Luc Duchateau, Sofie Van Hoecke (Ghent University, 2024) code
- Bellman Conformal Inference: Calibrating Prediction Intervals For Time Series by Zitong Yang, Emmanuel Candรจs, Lihua Lei (Stanford, 2024) TIME SERIES ๐๐๐๐๐ ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ code
- TISSUE (Transcript Imputation with Spatial Single-cell Uncertainty Estimation) by James Zou, Eric Sun, Rong Ma, Anne Brunet, and Paloma Navarro Negredo (Stanford, Harvard, 2024) code
- Conformal Predictive Programming for Chance Constrained Optimization by Yiqi Zhao, Xinyi Yu, Jyotirmoy V. Deshmukh and Lars Lindemann (University of Southern California. 2024) ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Introspective Planning: Guiding Language-Enabled Agents to Refine Their Own Uncertainty by Kaiqu Liang, Zixu Zhang, Jaime Fernandez Fisac(Princeton, 2024) ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Regression Trees for Fast and Adaptive Prediction Intervals by Luben M. C. Cabezasa, Mateus P. Ottoa, Rafael Izbicki, Rafael B. Sternc (Federal University of Sรฃo Carlos, University of Sรฃo Paulo,2024) code ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Self-Consistent Conformal Prediction by Lars van der Laan, Ahmed M. Alaa (University of Southern California, 2024) ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Conformal Prediction via Regression-as-Classification by Etash Guha, Shlok Natarajan, Thomas Mรถllenhoff, Mohammad Emtiyaz Khan, Eugene Ndiaye (RIKEN AIP, Salesforce, Apple, SambaNova Systems, 2023) code ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Safe Task Planning for Language-Instructed Multi-Robot Systems using Conformal Prediction by Jun Wang, Guocheng He, and Yiannis Kantaros (Washington University in St Louis, 2024).
- Conformalized-DeepONet: A Distribution-Free Framework for Uncertainty Quantification in Deep Operator Networks by Christian Moya, Amirhossein Mollaali, Zecheng Zhang, Lu Lu, Guang Lin (Purdue University, Florida State University, Yale, 2024) ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- API Is Enough: Conformal Prediction for Large Language Models Without Logit-Access by Jiayuan Su, Jing Luo, Hongwei Wang, Lu Cheng (Zhejiang University, University of Illinois Urbana-Champaign Institute, University of Illinois Chicago, 2024) ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Conformal Language Modeling) by Victor Quach, Adam Fisch, Tal Schuster, Adam Yala, Jae Ho Sohn, Tommi S. Jaakkola, Regina Barzilay (MIT, Berkeley, Google Research, UC San Francisco, 2023) ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- A Safety-Critical Framework for UGVs in Complex Environments: A Data-Driven Discrepancy-Aware Approach by Skylar X. Wei, Lu Gan, Joel W. Burdick (California Institute of Technology,Georgia Institute of Technology, 2024) ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Conformal prediction for multi-dimensional time series by ellipsoidal sets by Chen Xu, Hanyang Jiang, and Yao Xie (Georgia Tech, 2024) code TIME SERIES ๐๐๐๐๐ ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Conformal prediction of molecule-induced cancer cell growth inhibition challenged by strong distribution shifts by Saiveth Hernandez-Hernandez, Qianrong Guo, Pedro Ballester (Imperial College, 2024) ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Robust Conformal Prediction under Distribution Shift via Physics-Informed Structural Causal Model by Rui Xu, Yue Sun, Chao Chen, Parv Venkitasubramaniam, Sihong (The Hong Kong University of Science and Technology (Guangzhou), Lehigh University, Bethlehem, 2024) ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Conformal link prediction for false discovery rate control by Ariane Marandon (Sorbonne Universitรฉ, 2024)
- Risk-Calibrated Human-Robot Interaction via Set-Valued Intent Prediction by Justin Lidard, Ariel Bachman, Bryan Boateng, Anirudha Majumdar (Princeton, 2024) ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Predictive Inference in Multi-environment Scenarios by John C. Duchi, Suyash Gupta, Kuanhao Jiang, Pragya Sur (Stanford, Harvard, Amazon, 2024)
- Conformal online model aggregation by Matteo Gasparin, Aaditya Ramdas (Carnegie Mellon University, University of Padova, 2024)
- Conformal Intent Classification and Clarification for Fast and Accurate Intent Recognition by Floris den Hengst, Ralf Wolter, Patrick Altmeyer, Arda Kaygan (University of Amsterdam, ING, 2024) ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Coverage-Guaranteed Prediction Sets for Out-of-Distribution Data by Xin Zou, Weiwei Liu (Wuhan University. 2024)
- Conformal Prediction for Stochastic Decision-Making of PV Power in Electricity Markets by Yvet Renkema, Nico Brinkel & Tarek Alskaif (Wageningen University, Utrecht University, 2024). ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- FDR control and FDP bounds for conformal link prediction by Gilles Blanchard, Guillermo Durand, Ariane Marandon-Carlhian, Romain Pรฉrier (University of Paris-Saclay, The Allan Turing Institute).
- Postprocessing of point predictions for probabilistic forecasting of electricity prices: Diversity matters by Arkadiusz Lipiecki, Bartosz Uniejewski, Rafaล Weron (Wrocลaw University of Science and Technology, 2024)
- Conformal Prediction Interval Estimations with an Application to Day-Ahead and Intraday Power Markets by Christopher Katha, Florian Ziel (University Duisburg-Essen, 2020)
- On-line conformalized neural networks ensembles for probabilistic forecasting of day-ahead electricity prices by Alessandro Brusaferria, Andrea Ballarinoa, Luigi Grossib, Fabrizio Laurini (CNR, Institute of Intelligent Industrial Technologies and Systems for Advanced Manufacturing, Universoty of Parma 2024) ๐ฅ๐ฅ๐ฅ๐ฅ
- Conformal Prediction Interval Estimations with an Application to Day-Ahead and Intraday Power Markets by Christopher Katha, Florian Ziel (University Duisburg-Essen, 2020)
- A novel day-ahead regional and probabilistic wind power forecasting framework using deep CNNs and conformalized regression forests by Jef Jonkers, Diego Nieves Avendano, Glenn Van Wallendael, Sofie Van Hoecke (Ghent University, 2024)
- CONFLARE: CONFormal LArge language model REtrieval by Pouria Rouzrokh, Shahriar Faghani,
Cooper Gamble, Moein Shariatnia, Bradley J. Erickson (Mayo Clinic Artificial Intelligence Laboratory; Orthopedic Surgery Artificial Intelligence Laboratory, Mayo Clinic, MN, USA; Tehran University of Medical Sciences) code video ๐ฅ๐ฅ๐ฅ๐ฅ
- WaveCatBoost for Probabilistic Forecasting of Regional Air Quality Data by Jintu Borah, Tanujit Chakraborty, Md. Shahrul Md. Nadzir, Mylene G. Cayetano, Shubhankar Majumdar (Sorbonne University, NIT Meghalaya, Universiti Kebangsaan, University of Philippines, 2024) code ๐ฅ๐ฅ๐ฅ๐ฅ
- Pricing Catastrophe Bonds --- a Probabilistic Machine Learning Approach by Xiaowei Chen, Hong Li, Yufan Lu, Rui Zhou (Nankai University, University of Guelph, The University of Melbourne, 2024)
- Adaptive Conformal Prediction Intervals Using Data-Dependent Weights With Application to Seismic Response Prediction by Parisa Hajibabaee; Farhad Pourkamali-Anaraki; Mohammad Amin Hariri-Ardebili (Parisa Hajibabaee; Farhad Pourkamali-Anaraki; Mohammad Amin Hariri-Ardebili (Florida Polytechnic University, University of Colorado Denver, University of Maryland, 2024)
- Ensemble Predictors: Possibilistic Combination of Conformal Predictors for Multivariate Time Series Classification
- Enhancing the reliability of probabilistic PV power forecasts using conformal prediction by Yvet Renkema, Lennard Visser, Tarek AlSkaif (Wageningen University, Utrecht University, 2024)
- Random Projection Ensemble Conformal Prediction for High-Dimensional Classification by Xiaoyu Qian, Jinru Wu, Ligong Wei, Youwu Lin )Guilin University of Electronic Technology, Guangxi Academy of Sciences, Guilin University of Electronic Technology, 2024)
- Conformal Predictive Systems Under Covariate Shift by Jef Jonkers, Glenn Van Wallendael, Luc Duchateau, Sofie Van Hoecke (hent University, Belgium) code ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Metric-guided Image Reconstruction Bounds via Conformal Prediction by Matt Y Cheung, Tucker J Netherton, Laurence E Court, Ashok Veeraraghavan, Guha Balakrishnan (The University of Texas MD Anderson Cancer Cente, 2024)
- Training-Conditional Coverage Bounds for Uniformly Stable Learning Algorithms by Mehrdad Pournaderi, Yu Xiang (University of Utah, 2024)
- Safe POMDP Online Planning among Dynamic Agents via Adaptive Conformal Prediction by Shili Sheng, Pian Yu, David Parker, Marta Kwiatkowska, Lu Feng (University of Oxford, 2024)
- Conformal Prediction of Motion Control Performance for an Automated Vehicle in Presence of Actuator Degradations and Failures by Richard Schubert, Marvin Loba, Jasper Sรผnnemann, Torben Stolte, Markus Maurer (TU Braunschweig, 2024)
- Towards Robust Ferrous Scrap Material Classification with Deep Learning and Conformal Prediction by Paulo Henrique dos Santos, Valรฉria de Carvalho Santos, Eduardo Josรฉ da Silva Luz (Universidade Federal de Ouro Preto e Instituto Tecnolยดogico Vale, Universidade Federal de Ouro Preto, Brazil ๐ง๐ท, 2024)
- From Data Imputation to Data Cleaning โ Automated Cleaning of Tabular Data Improves Downstream Predictive Performance by Sebastian Jรคger, Felix Biessmann (Berlin University of Applied Sciences and Technology (BHT), Einstein Center Digital Future ๐ฉ๐ช, 2024) code ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Online Calibrated and Conformal Prediction Improves Bayesian Optimization Shachi Deshpande, Charles Marx, Volodymyr Kuleshov (Cornell University, Stanford, ๐บ๐ธ, 2024)
- Evaluating the Utility of Conformal Prediction Sets for AI-Advised Image Labeling by Dongping Zhang, Angelos Chatzimparmpas, Negar Kamali, Jessica Hullman (Northwestern University, ๐บ๐ธ, 2024) code ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Adaptive Conformal Regression with Split-Jackknife+ Scores by Nicolas Deutschmann, Mattia Rigotti, Marรญa Rodrรญguez Martรญnez (IBM Research, 2023)
- Comparison of Scaling Methods to Obtain Calibrated Probabilities of Activity for ProteinโLigand Predictions by Lewis H. Mervin, Avid M. Afzal, Ola Engkvist, and Andreas Bender (2020)
- Conformal Prediction for Natural Language Processing: A Survey by Margarida Campos, Antรณnio Farinhas, Chrisoula Zerva, Mario Figueiredo, Andre Martins (Instituto de Telecomunicaรงรตes, Instituto Superior Tรฉcnico, LUMLIS (Lisbon ELLIS Unit), Unbabel, Portugal, 2024) ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Mitigating LLM Hallucinations via Conformal Abstention by Yasin Abbasi Yadkori, Ilja Kuzborskij, David Stutz, Andrรกs Gyรถrgy, Adam Fisch, Arnaud Doucet, Iuliya Beloshapka, Wei-Hung Weng, Yao-Yuan Yang, Csaba Szepesvรกri, Ali Taylan Cemgil, Nenad Tomasev (2024)
- CarbonCP: Carbon-Aware DNN Partitioning with Conformal Prediction for Sustainable Edge Intelligence by Hongyu Ke, Wanxin Jin, Haoxin Wang (Georgia State University, Arizona State University, 2024)
- Conformalized Ordinal Classification with Marginal and Conditional Coverage by Subhrasish Chakraborty, Chhavi Tyagi, Haiyan Qiao, Wenge Guo (New Jersey Institute of Technology, California State University San Bernardino, 2024)
- An Information Theoretic Perspective on Conformal Prediction by Alvaro H.C. Correia, Fabio Valerio Massoli, Christos Louizos, Arash Behboodi (Qualcomm AI Research, 2024)
- Conformal Prediction with Learned Features by Shayan Kiyani, George Pappas, Hamed Hassani (University of Pennsylvania, 2024)
- Onboard Out-of-Calibration Detection of Deep Learning Models using Conformal Prediction by Protim Bhattacharjee, Peter Jung (Optical Sensor Systems, German Aerospace Center, 2024)
- A Conformal Prediction Score that is Robust to Label Noise by Coby Penso, Jacob Goldberger (Bar-Ilan University, Israel, 2024)
- Building consumption anomaly detection: A comparative study of two probabilistic approaches by Davor Stjelja, Vladimir Kuzmanovski, Risto Kosonen, Juha Jokisalo (Aalto University, Granlund Oy, Vaisala Oyj, Nanjing Tech University,2024)
- Robust Route Planning under Uncertain Pickup Requests for Last-mile Delivery by Hua Yan, Heng Tan, Desheng Zhang, Haotian Wang, Yu Yang (Lehigh University, Rutgers University, USA; JD Logistics, Beijing, China)
- Improve robustness of machine learning via efficient optimization and conformal prediction by Yan Yan (Washington State University, 2024)
- Conformalized Survival Distributions: A Generic Post-Process to Increase Calibration by Shi-ang Qi, Yakun Yu, Russell Greiner (University of Alberta, 2024)
- Conformal Online Auction Design by Jiale Han, Xiaowu Dai (University of California, 2024)
- Conformal Validity Guarantees Exist for Any Data Distribution by Drew Prinster, Samuel Stanton, Anqi Liu, Suchi Saria (John Hopkins University Genentech, 2024) code ๐๐๐๐๐๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Kernel-based optimally weighted conformal prediction intervals by Jonghyeok Lee, Chen Xu, Yao Xie (Georgia Tech, 2024) TIME SERIES ๐๐๐๐๐ ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Reliable anti-cancer drug sensitivity prediction and prioritization by Kerstin Lenhof, Lea Eckhart, Lisa-Marie Rolli, Andrea Volkamer & Hans-Peter Lenhof (Saarland University, 2024)
- Robust Conformal Prediction Using Privileged Information by Shai Feldman, Yaniv Romano (2024)
- Conformal Inference for Online Prediction with Arbitrary Distribution Shifts by Isaac Gibbs, Emmanuel J. Candรจs code (2024) ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Adaptive Uncertainty Quantification for Trajectory Prediction Under Distributional Shift by Huiqun Huang, Sihong He, Fei Miao (University of Connecticut, 2024)
- Conditional Shift-Robust Conformal Prediction for Graph Neural Network by Akansha Singh (Manipal Academy of Higher Education (MAHE) - Manipal Institute of Technology, 2024)
- Conformal Inference for Online Prediction with Arbitrary Distribution Shifts by Isaac Gibbs, Emmanuel J. Candรจs (Stanford, 2024) ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Conformal prediction for multi-dimensional time series by ellipsoidal sets by Chen Xu, Hanyang Jiang, Yao Xie (Georgia Tech, 2024) TIME SERIES ๐๐๐๐๐ ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Kernel-based optimally weighted conformal prediction intervals Jonghyeok Lee, Chen Xu, Yao Xie (Georgia Tech, 2024) TIME SERIES ๐๐๐๐๐ ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Transformer Conformal Prediction for Time Series by Junghwan Lee, Chen Xu, Yao Xie (Georgia Tech, 2024) TIME SERIES ๐๐๐๐๐ ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ code
- Identifying Homogeneous and Interpretable Groups for Conformal Prediction by Natalia Martinez, Dhaval C Patel, Chandra Reddy, Giridhar Ganapavarapu, Roman Vaculin, Jayant Kalagnanam (IBM Research, 2024)
- Guaranteeing Robustness Against Real-World Perturbations In Time Series Classification Using Conformalized Randomized Smoothing by Nicola Franco, Jakob Spiegelberg, Jeanette Miriam Lorenz, Stephan Gรผnnemann (Fraunhofer Institute for Cognitive Systems IKS, Munich, Germany; Volkswagen Group Innovation; Technical Univ. of Munich, 2024)
- [Conformalized Teleoperation: Confidently Mapping Human Inputs to High-Dimensional Robot Actions](Michelle Zhao, Reid Simmons, Henny Admoni, Andrea Bajcsy) by Michelle Zhao, Reid Simmons, Henny Admoni, Andrea Bajcsy (Robotics Institute, Carnegie Mellon University, 2024)
- Conformal Load Prediction with Transductive Graph Autoencoders by Rui Luo, Nicolo Colombo (City University of Hong Kong; Royal Holloway, University of London, 2024) code
- Conformal Recursive Feature Elimination by Marcos Lopez-De-Castro, Alberto Garcฤฑa-Galindo, Ruben Armananzas (Universidad de Navarra, 2024)
- Enhancing reliability in prediction intervals using point forecasters: Heteroscedastic Quantile Regression and Width-Adaptive Conformal Inference Carlos Sebastiana,Carlos E. Gonzalez-Guillenc, Jesus Juane (Fortia Energฤฑa, Universidad Politecnica de Madrid, Instituto de Ciencias Matematicas, Madrid) code (2024) TIME SERIES ๐๐๐๐๐ ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Conformal time series decomposition with component-wise exchangeability by Derck W. E. Prinzhorn, Thijmen Nijdam, Putri A. van der Linden, Alexander Timans (University of Amsterdam, 2024) TIME SERIES ๐๐๐๐๐ ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ code
- Safe Task Planning for Language-Instructed Multi-Robot Systems using Conformal Prediction Jun Wang, Guocheng He, Yiannis Kantaros (Washington University in St Louis, 2024)
- Online Calibrated and Conformal Prediction Improves Bayesian Optimization by Shachi Deshpande, Charles Marx, Volodymyr Kuleshov (Cornell Tech and Cornell University, Stanford, 2024)
- An Information Theoretic Perspective on Conformal Prediction by Alvaro H.C. Correia Fabio Valerio Massoli Christos Louizosโ Arash Behboodi (Qualcomm AI Research, 2024)
- Conformal Prediction for Natural Language Processing: A Survey by Margarida M. Campos, Antรณnio Farinhas, Chrysoula Zerva, Mรกrio A.T. Figueiredo, Andrรฉ F.T. Martins (Instituto de Telecomunicaรงรตes, Instituto Superior Tรฉcnico, LUMLIS (Lisbon ELLIS Unit), Unbabel, 2024)
- Conformal Prediction for Causal Effects of Continuous Treatments by Maresa Schrรถder, Dennis Frauen, Jonas Schweisthal, Konstantin Heร, Valentyn Melnychuk, Stefan Feuerriegel (LMU Munich, 2024) ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Uncertainty-Aware Decarbonization for Datacenters by Amy Li, Sihang Liu, Yi Ding (Uiversity of Waterloo, 2024)
- Conditionally valid Probabilistic Conformal Prediction by Vincent Plassier, Alexander Fishkov, Maxim Panov, Eric Moulines (Lagrange Mathematics and Computing Research Center, Mohamed bin Zayed University of Artificial Intelligence, CMAP, Ecole Polytechnique, Skolkovo Institute of Science and Technology (2024)
- Reliable Confidence Intervals for Information Retrieval Evaluation Using Generative A.I. by Harrie Oosterhuis,Zhen Qin, Xuanhui Wang, Rolf Jagerman, Michael Bendersky, (Radbound University, Google Research, 2024)
- Trustworthy Classification through Rank-Based Conformal Prediction Sets by Rui Luo, Zhixin Zhou (City University of Hong Kong, 2024)
- Distributionally robust risk evaluation with an isotonic constraint by Yu Gui, Rina Foygel Barber, Cong Ma (University of Chicago, 2024) code
- Split Conformal Prediction under Data Contamination by Jase Clarkson, Wenkai Xu, Mihai Cucuringu, Gesine Reinert code
- Weighted Aggregation of Conformity Scores for Classification by Rui Luo, Zhixin Zhou (2024)
- Meta-Analysis with Untrusted Data by Shiva Kaul, Geoffrey J. Gordon (Carnegie Mellon, 2024)
- Robust Yet Efficient Conformal Prediction Sets by Soroush H. Zargarbashi, Mohammad Sadegh Akhondzadeh, Aleksandar Bojchevski (University of Cologne, 2024)
- Learning Cellular Network Connection Quality with Conformal by Hanyang Jiang, Elizabeth Belding, Ellen Zegure, Yao Xie (Universiry of Georgia, 2024)
- Conformal Thresholded Intervals for Efficient Regression by Rui Luo, Zhixin Zhou (City University of Hong Kong, 2024)
- Conformal Predictions under Markovian Data by Frรฉdรฉric Zheng, Alexandre Proutiere (KTH, 2024)
- Entropy Reweighted Conformal Classification by Rui Luo, Nicolo Colombo (City University of Hong Kong, Hong Kong, Royal Holloway, University of London). ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- SoNIC: Safe Social Navigation with Adaptive Conformal Inference and Constrained Reinforcement Learning by Jianpeng Yao, Xiaopan Zhang, Yu Xia, Zejin Wang, Amit K. Roy-Chowdhury, Jiachen Li (University of California, Riverside) project
- Conformal Validity Guarantees Exist for Any Data Distribution (and How to Find Them) by Drew Prinster, Samuel Stanton, Anqi Liu, Suchi Saria (John Hopkins University, Genentech, 2024) video
- Robust Conformal Volume Estimation in 3D Medical Images by Benjamin Lambert, Florence Forbes, Senan Doyle, Michel Dojat (University Grenoble Alps, 2024) code
- A CONFORMALIZED LEARNING OF A PREDICTION SET WITH APPLICATIONS TO MEDICAL IMAGING CLASSIFICATION by Roy Hirsch, Jacob Goldberger (Bar-Ilan University, Ramat-Gan, Israel, 2024)
- Quantifying uncertainty in climate projections with conformal ensembles by Trevor Harris, Ryan Sriver (Texas A&M University, University of Illinois at Urbana Champaign, 2024) ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- CONFORMALIZED INTERVAL ARITHMETIC WITH SYMMETRIC CALIBRATION by Rui Luo and Zhixin Zhoi (City University of Hong Kong, 2024) code ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Split Conformal Prediction and Non-Exchangeable Data by Roberto I. Oliveira, Paulo Orenstein, Thiago Ramos, Joรฃo Vitor Romano (IMPA, Brazil, 2024) code
- PersonalizedUS: Interpretable Breast Cancer Risk Assessment with Local Coverage Uncertainty Quantification by Alek Frohlic, Thiago Ramos, Gustavo Cabello, Isabela Buzatto, Rafael Izbicki, Daniel
Tiezzi (UFSC, Florianopolis, UFSCar, Sao Carlos, USP, Ribeirao Preto, Brazil) (2024)
- Conformal Prediction in Dynamic Biological Systems by Alberto Portela, Julio R. Banga, Marcos Matabuena (Spanish National Research Council, Harvard University) (2024)
- Spatial-Aware Conformal Prediction for Trustworthy Hyperspectral Image Classification by Kangdao Liu, Tianhao Sun, Hao Zeng, Yongshan Zhang, Chi-Man Pun, Chi-Man Vong (University of Macau, Southern University of Science and Technology, China University of Geosciences, 2024)
- Formal Verification and Control with Conformal Prediction by Lars Lindemann, Yiqi Zhao, Xinyi Yu, George J. Pappas, Jyotirmoy V. Deshmukh (University of Southern California, University of Pennsylvania) (2024)
- Segmentation uncertainty with statistical guarantees in prostate MRI Kevin Mekhaphan Nguyen, Alvaro Fernandez-Quilez, University of Stavanger, Norway. Stavanger University Hospital, Stavanger, Norway (2024)
- Making Deep Learning Models Clinically Useful - Improving Diagnostic Confidence in Inherited Retinal Disease with Conformal Prediction by Biraja Ghoshal, William Woof, Bernardo Mendes et al (University College London Institute of Ophthalmology, Moorfields Eye Hospital, Oxford Eye Hospital, Oxford, United Kingdom, Laboratory of Visual Physiology, Division of Vision Research, National Institute of Sensory Organs, National Hospital Organization Tokyo Medical Center, Japan, St Paulโs Eye Unit, Liverpool University Hospitals NHS Foundation Trust,Liverpool, United Kingdom, Department of Ophthalmology and Visual Sciences, Escola Paulista de Medicina, Federal University of Sao Paulo, Sรฃo Paulo, SP, Brazil, Department of Ophthalmology, University Hospital Bonn,
Rheinische-Friedrich-Wilhelms Universitรคt Bonn, Germany, 2024). ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Measuring the Confidence of Single-Point Traffic Forecasting Models: Techniques, Experimental Comparison, and Guidelines Toward Their Actionability ๐ฅ๐ฅ๐ฅ๐ฅ
- Conformal Multilayer Perceptron-Based Probabilistic Net-Load Forecasting for Low-Voltage Distribution Systems with Photovoltaic Generation by Anthony Faustine and Lucas Pereira, Center for Intelligent Power (CIP), Eaton Corporation, Dublin, Ireland; โ ITI, LARSyS, Tecnico Lisboa, Lisbon, Portugal (2024)
- Conformal Diffusion Models for Individual Treatment Effect Estimation and Inference by Hengrui Cai, Huaqing Jin, Lexin Li (University of California Irvine, University of California San Francisco, University of California Berkeley, 2024).
- Quantifying Aleatoric and Epistemic Dynamics Uncertainty via Local Conformal Calibration by Luรญs Marques, Dmitry Berenson (University of Michigan, Ann Arbour, USA) project
- On the uncertainty of real estate price predictions by Joรฃo A. Bastos, Jeanne Paquette (University of Lisbon, Portugal, 2024)
- Adaptive Uncertainty Quantification for Generative AI by Jungeum Kim, Sean O'Hagan, Veronika Rockova (University of Chicago, 2024) code
- Localized Conformal Prediction: A Generalized Inference Framework to Conformal Prediction by Leying Guan (Yale University, 2022) ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Split Localized Conformal Prediction by Xing Han Ziyang Tang Joydeep Ghosh Qiang Liu
(University of Texas at Austin, 2022) code
- Conformalized Semi-supervised Random Forest for Classification and Abnormality Detection by Yujin Han, Mingwenchan Xu, Leying Guan (Universtity of Hong Kong, Northwestern University, Yale University, 2024) code
- Length Optimization in Conformal Prediction by Shayan Kiyani, George Pappas, Hamed Hassani (University of Pennsylvania,2024) code ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Adjusting Regression Models for Conditional Uncertainty Calibration by Ruijiang Gao, Mingzhang Yin, James McInerney, Nathan Kallus (Naveen Jindal School of Management, University of Texas at Dallas, University of Florida, Gainesville, Netflix, Cornell University, 2024) code ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Task-Driven Uncertainty Quantification in Inverse Problems via Conformal Prediction by Jeffrey Wen, Rizwan Ahma. Philip Schniter (The Ohio State University) code
- Adaptive Bounding Box Uncertainties via Two-Step Conformal Prediction by Alexander Timans, Christoph-Nikolas Straehle, Kaspar Sakmann, Eric Nalisnick (University of Amsterdam, Bosch Centre for AI, 2024)
- Robust Conformal Prediction Using Privileged Information by Shai Feldman, Yaniv Romano (Technion, 2024) NeurIPS2024
- Self-Consistent Conformal Prediction by Lars van der Laan, Ahmed M. Alaa (University of Washington, Berkeley, 2024) ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Similarity-Navigated Conformal Prediction for Graph by Jianqing Song, Jianguo Huang,Wenyu Jiang, Baoming Zhang, Shuangjie Li, Chongjun Wang (Nanjing University, Southern University of Science and Technology, ShanghaiTech University, 2024)
- Conformal Prediction for Class-wise Coverage via Augmented Label Rank Calibration by Yuanjie Shi, Subhankar Ghosh, Taha Belkhouja, Janardhan Rao Doppa, Yan Yan (Washington State University, 2024)
- Detecting Railway Track Irregularities Using Conformal Prediction by Andreas Plesner, Allan P. Engsig-Karup, Hans True (ETH Zurich, Technical University of Denmark, 2024)
- CoPAL: Conformal Prediction for Active Learning with Application to Remaining Useful Life Estimation in Predictive Maintenance by Zahra Kharazian, Tony Lindgren, Sindri Magnusson, Henrik Bostrom (KTH Royal Institute of Technology, Stockholm University, Sweden, 2024)
- ConForME: Multi-horizon conformal time series forecasting by Aloysio Galvao Lopes, Eric Goubault, Sylvie Putot, Laurent Pautet (Institut Polytechnique de Paris, LTCI, Telecom Paris, 2024) TIME SERIES ๐๐๐๐๐ ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- [PersonalizedUS: Interpretable Breast Cancer Risk Assessment with Local Coverage Uncertainty Quantification]
- Unsupervised radiometric change detection from synthetic aperture radar images
Thomas Bultingaire , Inรจs Meraoumia, Christophe Kervazo, Loรฏc Denis, Florence Tupin (LTCI, Telยด ecom Paris, Institut Polytechnique de Paris, Universite Jean Monnet Saint-Etienne, CNRS, Institut dโOptique Graduate School, Laboratoire Hubert Curien, France 2024)
- Conformal Distributed Remote Inference in Sensor Networks Under Reliability and Communication Constraints by Meiyi Zhu, Matteo Zecchin, Sangwoo Park, Caili Guo, Chunyan Feng, Petar Popovski, Osvaldo Simeone (King's College London, UK, Aaborg University, Denmark).
- Task-Driven Uncertainty Quantification in Inverse Problems via Conformal Prediction by Jeffrey Wen, Rizwan Ahmad, Phillip Schniter code
- Self-Calibrating Conformal Prediction by Lars van der Laan, Ahmed M. Alaa (University of Washington, Berkeley, 2024)
- Boosted Conformal Prediction Intervals by Ran Xie, Rina Foygel Barber, Emmanuel J. Candรจs (Stanford, University of Chicago, 2024)
- Verifiably Robust Conformal Prediction by Linus Jeary, Tom Kuipers, Mehran Hosseini, Nicola Paoletti (Kingโs College London, UK, 2024)
- Similarity-Navigated Conformal Prediction for Graph Neural Networks by Jianqing Song, Jianguo Huang, Wenyu Jiang, Baoming Zhang, Shuangjie Li, Chongjun Wang (Nanjing University, Southern University of Science and Technology, ShanghaiTech University, 2024)
- Estimating Quality of Approximated Shapley Values Using Conformal Prediction by Amr Alkhatib, Henrik Bostrom, Ulf Johansson (KTH Royal Institute of Technology, Jonkoping University, Sweden, 2024)
- Clustered Conformal Prediction for the Housing Market by Anders Hjort,Jonathan P. Williams, Johan Pensar (University of Oslo,North Carolina State University, 2024)
- Conformal Stability Measure for Feature Selection Algorithms by Marcos Lopez-De-Castro, Alberto Garcฤฑa-Galindo, Ruben Armananzas (Universidad de Navarra, Spain, 2024)
- The Uncertain Object: Application of Conformal Prediction to Aerial and Satellite Images Vicky Copley, Greg Finlay, Ben Hiett (DSTL, UK, 2024)
- Conformal prediction for regression models with asymmetrically distributed errors: application to aircraft navigation during landing maneuver by Solรจne Vilfroy, Lionel Bombrun, Thierry Urruty, Thierry Urruty, Philippe Carrรฉ (Thales, France, 2024)
- Multi-Class Classification With Reject Option and Performance Guarantees Using Conformal Prediction by Alberto Garcฤฑa-Galindo, Marcos Lopez-De-Castro, Rubeen Armananzas (Universidad de Navarra, Spain, 2024)
- Multi-label Conformal Prediction with a Mahalanobis Distance Nonconformity Measure by Kostas Katsios, Harris Papadopoulos (Frederick University, Cyprus, Albourne Partners Ltd, London, UK, 2024)
- Conformal Prediction for Semantically-Aware Autonomous Perception in Urban Environments
by Achref Doula, Tobias Gรผdelhรถfer, Max Mรผhlhรคuser, Alejandro Sanchez Guinea (Technische Universitรคt Darmstadt, Germany, 2024)
- Conformal prediction with local weights: randomization enables robust guarantees by Rohan Hore, Rina Foygel Barber (University of Chicago, 2024) code ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Posterior Conformal Prediction by https://arxiv.org/abs/2409.19712 (Standord, 2024) code ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Conformal Semantic Image Segmentation: Post-hoc Quantification of Predictive Uncertainty by Luca Mossina, Joseba Dalmau, Lรฉo Andรฉol (IRT Saint Exupery, Toulouse; Institut de Mathe ฬmatiques de Toulouse; Toulouse, SNCF,France) code
- Conformal Prediction: A Data Perspective by Xiaofan Zhou, Baiting Chen, Yu Gui, Lu Cheng (University of illinois, UCLA, University of Chicago, 2024)
- Conformal Structured Prediction by Botong Zhang, Shuo Li, Osbert Bastani (University of Pennsylvania, 2024)
- [Online conformal inference for multi-step time series forecasting](Online conformal inference for multi-step time series forecasting) by Xiaoqian Wang, Rob J Hyndman (Monash Universify, 2024) code TIME SERIES ๐๐๐๐๐ ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ paper code conformalForecast R package
- Optimizing Probabilistic Conformal Prediction with Vectorized Non-Conformity Scores by
Minxing Zheng, Shixiang Zhu (University of Southern California, Carnegie Mellon University, 2024) ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- C-Adapter: Adapting Deep Classifiers for Efficient Conformal Prediction Sets by Kangdao Liu, Hao Zeng, Jianguo Huang, Huiping Zhuang, Chi-Man Vong, Hongxin Wei (Southern University of Science and Technology 2Department of Computer and Information Science, University of Macau, Nanyang Technological University, South China University of Technology, 2024)
- Distribution-free uncertainty quantification for inverse problems: application to weak lensing mass mapping by Leterme, Fadili and Starck (Universitรฉ Caen Normandie, Universitรฉ Paris-Saclay, Universitรฉ Paris Citรฉ, France; Institutes of Computer Science and Astrophysics, Greece, 2024)
- Conformal Predictive Portfolio Selection by Masahiro Kato (Mizuho-DL Financial Technology, 2024) ๐ฅ๐ฅ๐ฅ๐ฅ
- Conformal Prediction in Finance by Miquel Noguer i Alonso
Artificial Intelligence in Finance Institute (2024)
- Reliable Multi-View Learning with Conformal Prediction for Aortic Stenosis Classification in Echocardiography by Ang Nan Gu, Michael Tsang, Hooman Vaseli, Teresa Tsang, Purang Abolmaesumi (University of British Columbia, Vancouver; Division of Cardiology, Vancouver General Hospital,2024) code
- Target Strangeness: A Novel Conformal Prediction Difficulty Estimator by Alexis Bose, Jonathan Ethier, Paul Guinand (Alexis Bose, Jonathan Ethier, Paul Guinand, 2024) [code](https://arxiv.org/src/2410.19077v1/anc/cp_mm_targ_strg.tar.xz see arXiv for more details)
- Neural networks pipeline for quality management in IVF laboratory by Sergei Sergeev, Iuliia Diakova, Lasha Nadirashvili (Georgian-German Reproductive Center, Tbilisi, Georgia; IVF, IVF and Genetic Center, Moscow, Russian Federation, IVF, ART-IVF Clinic, Moscow, Russian Federation)
- Self-Consistent Conformal Prediction by Lars van der Laan, Ahmed M. Alaa (University of Washington, UC Berkeley and UCSF, 2024) code ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Semiparametric conformal prediction by Ji Won Park, Robert Tibshirani, Kyunghyun Cho (Genentech, Stanford, 2024)
- Strategic Conformal Prediction by Daniel Csillag, Claudio Josรฉ Struchiner, Guilherme (School of Applied Mathematics Fundacao Getulio Vargas, Brazil, 2024)
- Uncertainty measurement for complex event prediction in safety-critical systems by Maria J. P. Peixoto, Akramul Azim (Ontario Tech University)
- Conformal-in-the-Loop for Learning with Imbalanced Noisy Data by John Brandon Graham-Knight, Jamil Fayyad, Nourhan Bayasi, Patricia Lasserre, Homayoun Najjaran (University of British Columbia, University of Victoria, University of British Columbia, Canada) code
- Reliable Central Nervous System Tumor Differentiation on MRI Images with Deep Neural Networks and Conformal Prediction bu Luis Balderas, Marรญa Moreno de Castro, Miguel Lastra, Jose P. Martรญnez, Francisco J. Pรฉrez, Antonio Laรญnez, Antonio Arauzo-Azofra5 and Josรฉ M. Benรญtez (University of Granada, Hospital Universitario โVirgen de las Nievesโ, Granada; Instituto Biosanitario de Granada, University of Cรณrdoba, Spain)
Papers Time Series
- Conformal prediction interval for dynamic time-series by Chen Xu, Yao Xie (Georgia Tech, 2021) TIME SERIES ๐๐๐๐๐ ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ Python Code Video Video ICML2021
- Conformal prediction set for time-series by Chen Xu, Yao Xie (Georgia Tech, 2022) Python Code TIME SERIES ๐๐๐๐๐ ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Conformal Time-Series Forecasting by Kamile Stankeviciu te and Ahmed M. Alaa (2021) Video NeurIPS2021 Video TIME SERIES ๐๐๐๐๐ ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Ensemble Conformalized Quantile Regression for Probabilistic Time Series Forecasting by Vilde Jensen, Filippo Maria Bianchi, Stian Norman Anfinsen (2022). TIME SERIES ๐๐๐๐๐ ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Adaptive Conformal Predictions for Time Series by Margaux Zaffran, Aymeric Dieuleveut, Olivier Fe ฬron, Yannig Goude, and Julie Josse (2022) Python Code TIME SERIES ๐๐๐๐๐ ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ Video
- Conformalized Online Learning: Online Calibration Without a Holdout Set by Shai Feldman, Stephen Bates and Yaniv Romano (2022). TIME SERIES ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ Code
- Conformal Prediction with Temporal Quantile Adjustments by Zhen Lin, Shubhendu Trivedi, Jimeng Sun (2022) TIME SERIES ๐๐๐๐๐ ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Exact and Robust Conformal Inference Methods for Predictive Machine Learning with Dependent Data by Victor Chernozhukov (MIT), Kaspar Wuethrich (University of California, San Diego) and Yinchu Zhu (University of Oregon) (2018) Video
- Distributional Conformal Prediction by Chernozhukov (MIT), Kaspar Wuethrich (University of California, San Diego) and Yinchu Zhu (University of Oregon) (2022) Code Python code R
- Distribution-Free Prediction Bands for Multivariate Functional Time Series: an Application to the Italian Gas Market by Jacopo Diquigiovanni (University of Padua) Matteo Fontana (Joint Research Centre - European Commission) Simone Vantini (Politecnico di Milano) (2021)
- CODiT: Conformal Out-of-Distribution Detection in Time- Series Data by Ramneet Kaur et.al., Unibersity of Pensylvania (2022). Code TIME SERIES ๐๐๐๐๐ ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- A General Framework For Multi-step Ahead Adaptive Conformal Heteroscedastic Time Series Forecasting by Martim Sousa, Ana Maria Tomรฉ, University of Aveiro (2022) Code TIME SERIES ๐๐๐๐๐ ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Conformal Prediction Interval Estimations with an Application to Day-Ahead and Intraday Power Markets by Christopher Kath and Florian Ziel (2020)
- Robust Gas Demand Forecasting With Conformal Prediction by Mouhcine Mendil, Luca Mossina, Marc Nabhan, Kevin Pasini (2022)
- Conformal Prediction Bands for Two-Dimensional Functional Time Series by
Niccolo` Ajroldia, Jacopo Diquigiovannib, Matteo Fontanac, Simone Vantinia (2022)
- Copula Conformal Prediction for Multi-step Time Series Forecasting by Sophia Sun, Rose Yu (University of California, San Diego, 2022) code TIME SERIES ๐๐๐๐๐ ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- [Conformal prediction set for time-series](Conformal prediction set for time-series) by Chen Xu, Yao Xie (Georgia Tech, 2022) Code
- Amazon Fortuna
- Improved Online Conformal Prediction via Strongly Adaptive Online Learning by Aadyot Bhatnagar, Huan Wang, Caiming Xiong, Yu Bai (2023) code TIME SERIES ๐๐๐๐๐ ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Conformal Prediction for Time Series with Modern Hopfield Networks by Andreas Auer, Martin Gauch, Daniel Klotz, Sepp Hochreiter (Johannes Kepler University, Linz, 2023) code blogpost TIME SERIES ๐๐๐๐๐ ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Sequential Predictive Conformal Inference for Time Series by Chen Xu, Yao Xie (Georgia Tech) code TIME SERIES ๐๐๐๐๐ ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Conformal Predictions for longitudinal data by Devesh Batra, Salvatore Mercuri and Raad Khraishi (Data Science & Innovation - NatWest Group, Institute of Finance and Technology, UCL, UK, 2023) TIME SERIES ๐๐๐๐๐ ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Conformal PID Control for Time Series Prediction by Anastasios N. Angelopoulos, Emmanuel J. Candes, Ryan J. Tibshirani (Berkeley/Stanford, NeurIPS2023) code TIME SERIES ๐๐๐๐๐ ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Distribution-Free Conformal Joint Prediction Regions for Neural Marked Temporal Point Processes by Victor Dheur, Tanguy Bosser, Rafael Izbicki, Souhaib Ben Taieb (Universidade Federal de Sao Carlos, Brazil and University of Mons, Belgium, 2024) code TIME SERIES ๐๐๐๐๐ ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Bellman Conformal Inference: Calibrating Prediction Intervals For Time Series by Zitong Yang, Emmanuel Candรจs, Lihua Lei (Stanford, 2024) TIME SERIES ๐๐๐๐๐ ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅcode
- Conformal prediction for multi-dimensional time series by ellipsoidal sets by Chen Xu, Hanyang Jiang, and Yao Xie (Georgia Tech, 2024) code TIME SERIES ๐๐๐๐๐ ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Conformalized predictive simulations for univariate time series by Thierry Moudiki (2024)
- Kernel-based optimally weighted conformal prediction intervals by Jonghyeok Lee, Chen Xu, Yao Xie (Georgia Tech, 2024) TIME SERIES ๐๐๐๐๐ ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Transformer Conformal Prediction for Time Series by Jonghyeok Lee, Chen Xu, Yao Xie (Georgia Tech, 2024) TIME SERIES ๐๐๐๐๐ ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ code
- Conformal prediction for multi-dimensional time series by ellipsoidal sets by Chen Xu, Hanyang Jiang, Yao Xie (Georgia Tech, 2024) TIME SERIES ๐๐๐๐๐ ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Conformal time series decomposition with component-wise exchangeability by Derck W. E. Prinzhorn, Thijmen Nijdam, Putri A. van der Linden, Alexander Timans (University of Amsterdam, 2024) TIME SERIES ๐๐๐๐๐ ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ code
- Enhancing reliability in prediction intervals using point forecasters: Heteroscedastic Quantile Regression and Width-Adaptive Conformal Inference Carlos Sebastiana,Carlos E. Gonzalez-Guillenc, Jesus Juane (Fortia Energฤฑa, Universidad Politecnica de Madrid, Instituto de Ciencias Matematicas, Madrid) code (2024) TIME SERIES ๐๐๐๐๐ ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- JANET: Joint Adaptive predictioN-region Estimation for Time-series by Eshant English, Eliot Wong-Toi, Matteo Fontana, Stephan Mandt, Padhraic Smyth, Christoph Lippert (2024) TIME SERIES ๐๐๐๐๐ ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Split Conformal Prediction and Non-Exchangeable Data by Roberto I. Oliveira, Paulo Orenstein, Thiago Ramos, Joรฃo Vitor Romano (IMPA, Brazil, 2024) code
- ConForME: Multi-horizon conformal time series forecasting by Aloysio Galvao Lopes, Eric Goubault, Sylvie Putot, Laurent Pautet (Institut Polytechnique de Paris, LTCI, Telecom Paris, 2024) TIME SERIES ๐๐๐๐๐ ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- [Online conformal inference for multi-step time series forecasting](Online conformal inference for multi-step time series forecasting) by Xiaoqian Wang, Rob J Hyndman (Monash Universify, 2024) code TIME SERIES ๐๐๐๐๐ ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ paper code conformalForecast R package
- Conformal Prediction for Hierarchical Data by Guillaume Principato, Yvenn Amara-Ouali, Yannig Goudee, Bachir Hamrouche, Jean-Michel Poggi, Gilles Stolz (EDF R&D, Laboratoire de mathe ฬmatiques dโOrsay, INRIA, France)
Presentation Slides
- Machine Learning for Probabilistic Prediction, Seattle Artificial Intelligence Workshops Meetup by Valery Manokhin, 2023 ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Machine Learning for Probabilistic Prediction by Valery Manokhin, 2022 ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Adaptive Conformal Anomaly Detection for Time-series by Evgeny Burnaev, Alexander Bernstein, Vlad Ishimtsev and Ivan Nazarov (Skoltech, Moscow, Russia, 2017)
- Nonparametric predictive distributions based on conformal prediction by Vladimir Vovk, Jieli Shen, Valery Manokhin, Min-ge Xie, Ilia Nouretdinov and Alex Gammerman (Royal Holloway, University of London Rutgers University, 2017)
- What Can Conformal Inference Offer to Statistics? by Lihua Lei, Stanford University
- Conformal Regressors and Predictive Systems โ a Gentle Introduction by Henrik Bostroem (KTH, Sweden, 2022)
- Applications of Conformal Predictors by Ernst Ahlberg and Lars Carlsson (Stena Line, 2022)
- crepes: a Python Package for Conformal Regressors and Predictive Systems by Henrik Bostroem (KTH, Sweden, 2022)
- Assessing Explanation Quality by Venn Prediction by Amr Alkhatib, Henrik Bostrรถm and Ulf Johansson (2022)
- Well-Calibrated Rule Extractors by Ulf Johansson, Tuwe Lรถfstrรถm, Niclas Stรฅhl (2022)
- [Calibration of Natural Language Understanding Models with Venn-ABERS Predictors](Calibration of Natural Language Understanding Models with Venn-ABERS Predictors](https://copa-conference.com/presentations/patrizio.pdf) by Patrizio Giovannotti (2022)
- Reinforcement Learning Prediction Intervals with Guaranteed Fidelity by Thomas Dietterich (University of Oregon, 2022)
- Conformal Prediction beyond exchangeability by Rina Foygel Barber (University of Chicago, 2022) ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Split conformal prediction for dependant data by Roberto I. Oliveira, Paulo Orenstein, Thiago Ramos and Joรฃo Vitor Romano (2022)
- Conformal prediction of small-molecule drug resistance in cancer cell lines by Saiveth Hernandez-Hernandez, Sachin Vishwakarma and Pedro Ballester
- Sequential Predictive Conformal Inference for Time Series by Chen Xu, Yao Xie (Georgia Tech, 2022) TIME SERIES ๐๐๐๐๐ ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Copula Conformal Prediction for Multi-step Time Series Forecasting by Sophia Sun, Rose Yu (University of California, San Diego, 2022)
- Uncertainty estimation in NLP by Tal Schuster, Adam Fisch (MIT, 2022)
- Conformal Prediction: an Introduction by Leo Andeol (2022)
- Adaptive Conformal Predictions for Time Series by Margaux Zaffran (ICML,2021)
- EnbPI poster by Chen Xu, Yao Xie (2021)
- Machine Learning for Probabilistic Prediction by Valery Manokhin (2023) ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Conformal Inference with Tidymodels by Max Kuhn (posit conference 2023) ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Graceful handling of large imbalanced datasets using Conformal Prediction by Ulf Norinder and Fredrik Svensson ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Conformalized Quantile Regression by Yaniv Romano, Evan Patterson, Emmanuel J. Candรจs (Stanford, 2019)
- Leveraging Conformal Prediction for Calibrated Probabilistic Time Series Forecasts to Accelerate the Renewable Energy Transition by Inge van den Ende (Dexter Energy, 2023). TIME SERIES ๐๐๐๐๐ ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Application of Conformal Inference in High Energy Physics by Jiri Franc (CTU Prague,Czech Republic)
Researchers
- Vladimir Vovk, Royal Holloway, United Kingdom
- Alexander Gammerman, Royal Holloway, United Kingdom
- Glenn Shafer, Rutgers University, USA
- Emmanuel Candรจs, Stanford, USA
- Ryan Tibshiriani, Carnegie Mellon, USA
- Yaniv Romano, TechnionโIsrael Institute of Technology
- Michael I. Jordan, Berkeley, USA
- Jitendra Malik, Berkeley, USA
- Anastasios Angelopoulos, Berkeley, USA
- Lihua Lei, Stanford, USA
- Henrik Bostrรถm, KTH, Sweden
- Ulf Johansson, Jรถnkรถping University, Sweden
- Henrik Linusson, University of Borรฅs, Sweden
- Harris Papadopoulos, Frederick University, Cyprus
- Vladimir V'yugin, Institute for Information Transmission Problems (IITP), Russia
- Evgeny Burnaev, Skoltech, Russia
- Aaditya Ramdas, Carnegie Mellon, USA
- Benjamin LeRoy, Carnegie Mellon, USA
- Victor Chernozhukov, MIT, USA
- Ulf Norinder, Stockholm University, Sweden
- Ola Spjuth, Uppsala University, Sweden
- Ilia Nouretdinov, Royal Holloway, United Kingdom
- Matteo Fontana, Royal Holloway, University of London, United Kingdom
- Yao Xie, Georgia Institute of Technology
- Zhimeo Ren, University of Chicago
- Rafael Izbicki, Federal University of Sรฃo Carlos (UFSCar) Brazil
- Rina Foygel Barber University of Chicago
- Matteo Sesia University of Southern California, Marshall School of Business
- Simone Vantini MOX - Department of Mathematics, Politecnico di Milano
Articles
- Measuring Models' Uncertainty: Conformal Prediction by
Leo Dreyfus-Schmidt (Dataiku, 2020). ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Conformal Prediction for Neural Regression Model by Pranab Ghosh (2021). ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- How to Handle Uncertainty in Forecasts by Michael Berk (2021)
- How to Add Uncertainty Estimation to your Models with Conformal Prediction by Zachary Warnes (2021)
- nonconformist: An easy way to estimate prediction intervals by Maria Jesus Ugarte (2021).
- Detecting Weird Data: Conformal Anomaly Detection by Matthew Burruss (2020).
- โMAPIEโ Explained Exactly How You Wished Someone Explained to You by Samuele Mazzanti (2022). ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- With MAPIE, uncertainties are back in machine learning by Vianney Taquet (2021) ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- How to Predict Risk-Proportional Intervals with Conformal Quantile Regression by Samuele Mazzanti (2022). ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Stanford statisticians and Washington Post data scientists build more honest prediction models Stanford (2021) ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- How to Detect Anomalies โ state-of-the-art methods using Conformal Prediction by Valery Manokhin (2021) ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- How to calibrate your classifier in an intelligent way by Valery Manokhin (2022) ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Conformal Prediction forecasting with MAPIE by Valery Manokhin (2022) TIME SERIES ๐๐๐๐๐ ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- How to predict full probability distribution using machine learning Conformal Predictive Distributions by Valery Manokhin (2022) ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- How to predict quantiles in a more intelligent way (or โBye-bye quantile regression, hello Conformal Quantile Regression by Valery Manokhin (2022) ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Conformal Prediction in Julia, Part I - Introduction by Patrick Altmeyer (2022)
- Getting predictions intervals with conformal inference by Rajiv Shah (2022)
- How to Conformalize a Deep Image Classifier by Patrick Altmeyer (2022)
- Time Series Forecasting with Conformal Prediction Intervals: Scikit-Learn is All you Need by Marco Cerliani (2022)
- Conformal Prediction in Julia, Part II - How to conformalize a deep image classifier by Patrick Altmeyer (2022)
- Conformal Prediction in Julia, Part III - Prediction intervals for any regression model by Patrick Altmeyer (2022)
- Probabilistic Forecasting with Conformal Prediction and NeuralProphet by Valery Manokhin (2022) TIME SERIES ๐๐๐๐๐ ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Time Series Forecasting with Conformal Prediction Intervals: Scikit-Learn is All you Need by Marco Cerliani (2022) TIME SERIES ๐๐๐๐๐ ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- TQA: Creating Valid Prediction Intervals for Cross-sectional Time Series Regression by Zhen Lin (UIUC, NeurIPSโ22 paper) TIME SERIES ๐๐๐๐๐ ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Conformal Prediction: A Critic to Predictive Models (2023)
- Multi-horizon Probabilistic Forecasting with Conformal Prediction and NeuralProphet by Valery Manokhin TIME SERIES ๐๐๐๐๐ ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Putting clear bounds on uncertainty (MIT, 2023)
- Conformal prediction theory explained by Artem Ryasik (2023)
- Easy Distribution-Free Conformal Intervals for Time Series by Michael Keith (2023)
- Another (Conformal) Way to Predict Probability Distributions by Harrison Hoffman (2023) ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- [How to use full (transductive) Conformal Prediction])(https://valeman.medium.com/how-to-use-full-transductive-conformal-prediction-7ed54dc6b72b) by Valery Manokhin (2023) ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Conformal Prediction for Regression (using KNIME) by Artem Ryasik (2023)
- Dynamic Conformal Intervals for any Time Series Model by Michael Keith (2023) TIME SERIES ๐๐๐๐๐ ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Hitting Time Forecasting: The Other Way for Time Series Probabilistic Forecasting by Marco Cerliani (2023) TIME SERIES ๐๐๐๐๐ ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Series of Medium articles about Conformal Prediciton (in Portuguese) by Gustavo Bruschi (2023) ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Stanford statisticians and Washington Post data scientists build more honest prediction models Code ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Jackknife+ โ a Swiss knife of Conformal Prediction for regression by Valeriy Manokhin (2023) ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Clinical AI tools must convey predictive uncertainty for each individual patient (2023)๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- How to use Conformal Prediction by Yannick Kรคlber (2023) ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Model Diagnostics: Prediction Uncertainty by PiML team, Wells Fargo (2023).
- Make any predictor uncertainty-aware via conformal prediction by Lorenzo Maggi (2023)
- Conformal predictive systems - A hands-on codeless example with KNIME by Artem Ryasik (2023) ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Conformal prediction for classification - A hands-on codeless example with KNIME by Artem Ryasik (2023) ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Conformalized quantile regression by Lorenzo Maggi (2024)
- Leveraging conformal prediction in Python to accelerate the renewable energy transition by Inge van den Ende (2024)
- Fifty (four, actually) shades of conformal prediction by Lorenzo Maggi (2024)
- Use case adapted prediction intervals by means of conformal predictions and a custom non conformity score by Arnaud Capitaine (2024) ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Prediction Intervals using Conformalized Quantile Regression by Vincent Wauters (2024).
- Conformalized Quantile Regression for Time Series Probabilistic Forecasting by Chris Kuo (2024) ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Uncertainty Quantification and Why You Should Care by Jonte Dancker (2024)
- Probabilistic forecasting I: Temperature by Stephane Degeye (2024)
- Predict CO2 emissions by vehicles with Conformal Prediction by Claudio Giorgio Giancaterino (2024)
- Exploring Adaptive and Weighted Conformal Prediction Methods in the Presence of Covariate Shift by Peter Tettey Yamak (2024) ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Embracing Uncertainty with Conformal Prediction by Robbert van Kortenhof (2024)
- Tidymodels and conformal prediction by Prasanna Bhogale (2024)
- Basics of conformal prediction in time series data by Prasanna Bhogale (2024)
Kaggle
- Kaggle Notebook showcasing Conformal Predictive Distributions on Playground Series Season 3, Episode 1 (California Housing data) competition by Valeriy Manokhin (2022)
- Kaggle Notebook showcasing Venn-ABERs Conformal Prediction on Playground Series Season 3, Episode 2 (Stroke prediction) competition by Valeriy Manokhin (2022)
- Regression prediction intervals with MAPIE by Carl McBride Ellis (2022)
- Lgbm & Mapie & birth weight, oh my! by Patrick Blackwill (2023) ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Classifier calibration using Venn-ABERS by Carl McBride Ellis (2024) ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
Websites
- Main website with research from Prof. Vladimir (Volodya) Vovk ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Conformal Prediction - Prediction with guaranteed performance Royal Holloway, United Kingdom
- A Gentle Introduction to Conformal Prediction and Distribution-Free Uncertainty Quantification by Anastasios N. Angelopoulos ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Reliable Predictive Inference by Yaniv Romano ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
Twitter
- Title: What Can Conformal Inference Offer to Statistics? by Lihua Lei, Stanford, 2022
- Conformalized survival analysis by Lihua Lei, Stanford, 2021
- Conformal Risk Control by Anastasious Angelopolous, Berkeley, 2022
- Stable Conformal Prediction Sets by Eugene Ndiaye (Georgia Tech, 2022)
- Machine learning sucks at uncertainty quantification. But there is a solution that almost sounds too good to be true: conformal prediction by Cristoph Molnar (2022).
- How to correctly, yet efficiently model the uncertainty on predictions by Nico Wolf (2022)
- Top 10 Github libraries for Conformal Prediction by Valeriy Manokhin (2022)
- Robots That Ask For Help by Allen Z. Ren (2023) ๐พ๐พ๐พ๐พ๐พ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
TikTok
- Getting prediction intervals with conformal prediction by Rajiv Shah (Hugging Face,2022)
- Why you want prediction intervals instead of point predictions by Rajiv Shah (Hugging Face,2022)
- Itโs important to make sure your model is well calibrated by Rajiv Shah (Hugging Face,2022)
Conferences & Workshops
- 11th Symposium on Conformal and Probabilistic Prediction with Applications
- IFDS Workshop on Conformal Prediction ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Workshop on Distribution-Free Uncertainty Quantification at ICML 2022 ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Workshop on Distribution-Free Uncertainty Quantification at ICML 2021๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- 10th Symposium on Conformal and Probabilistic Prediction with Applications ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- 9th Symposium on Conformal and Probabilistic Prediction with Applications ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- 8th Symposium on Conformal and Probabilistic Prediction with Applications ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- 7th Symposium on Conformal and Probabilistic Prediction with Applications ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- 6th Symposium on Conformal and Probabilistic Prediction with Applications ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
Python
- Conformal Tights - A scikit-learn meta-estimator that adds conformal prediction of coherent quantiles and intervals to any scikit-learn regressor by Laurent Sorber (Radix AI) (2024) ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- 'Crรชpes' - Conformal regressors and predictive systems by Henrik Bostrรถm (2021) Paper ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ Presentation by Henrik Bostroem (KTH, Sweden, 2022) paper
- Python implementation of binary and multi-class Venn-ABERS calibration by Ivan Petej (2023) [Paper] ๐ฅ๐ฅ๐ฅ๐ฅ
- TorchCP - A library for conformal prediction ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Puncc (Predictive uncertainty calibration and conformalization) paper slides ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Nixtla mlforecast TIME SERIES ๐๐๐๐๐ ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Nixtla statsforecast TIME SERIES ๐๐๐๐๐ ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Conformal Impact by Tyler Blume (2024) ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
10.Nonconformist by Henrik Linusson (2015) ๐จ The library does not seem to be actively maintained
- Venn-ABERS Predictor by Paolo Toccaceli (2019) Paper ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Conformalized Quantile Regression by Yaniv Romano (2019) ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Orange3 Conformal PredictionMulti-class-probabilistic-classification using Venn-ABERS (Conformal) prediction by Valery Manokhin (Royal Holloway, 2022)
- Copula Conformal Multi Target Regression by Soundouss Messoudi (2021)
- Conformal Histogram Regression: efficient conformity scores for non-parametric regression problems by Mateo Sesia and Yaniv Romano (NeurIPS 2021). ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Conformalized density- and distance-based anomaly detection in time-series data (KNN-CAD) by Evgeny Burnaev, Vladislav Ishimtsev (2016). Top #3 winning solution in Numenta competition ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Conformal time-series forecasting by Kamile ฬ Stankeviciute (Cambridge, NeurIPS 2021) TIME SERIES ๐๐๐๐๐ ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- EnbPI by Chen Xu (2021) TIME SERIES ๐๐๐๐๐ ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ Paper
- Adaptive Conformal Predictions for Time Series](https://proceedings.mlr.press/v162/zaffran22a/zaffran22a.pdf) by Margaux Zaffran, Aymeric Dieuleveut, Olivier Fe ฬron, Yannig Goude, and Julie Josse (2022) TIME SERIES ๐๐๐๐๐ ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ Video Code
- Conformal learning from scratch by Marharyta Aleksandrova (2021)
- Ensemble Conformalized Quantile Regression for Probabilistic Time Series Forecasting Vilde Jensen, Filippo Maria Bianchi and Stian Norman Anfinsen (2022) TIME SERIES ๐๐๐๐๐ ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Conformalized Online Learning: Online Calibration Without a Holdout Set by Shai Feldman, Stephen Bates and Yaniv Romano (2022). TIME SERIES ๐๐๐๐๐ ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- PySloth - Python package for Probabilistic Prediction by Valery Manokhin ๐๐๐๐๐ ๐ฅ๐ฅ๐ฅ๐ฅ
- Conformal Prediction in KNIME by Tuwe Lรถfstrรถm and Redfield AB (2022)
- Nonconformist by Henrik Linusson (2015) ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- SKTime by Franz Kiraly (2022)
- NeuralProphet (2022) ๐๐๐๐๐ ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- River 2022
- TorchUQ (2022)
- https://github.com/mikekeith52/scalecast TIME SERIES ๐๐๐๐๐ ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- plot_utils - Plotting library for conformal prediction metrics, intended to facilitate fast testing in e.g. notebooks ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- calibrated-explanations - Calibrated Explanations for Machine Learning Models using Venn-Abers and Conformal Predictive Systems by Helena Lรถfstrรถm (2023)
- Conformers - Unofficial Conformal Language Modelling library ๐๐๐๐
- Conformal Predictions from Scratch in Numpy by Jones Wacker (2023) ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Conformal Prediction for Digital Soil Mapping by Nafiseh Kakhani (2023)
- conformal-prediction-jan2024 - PyLadies Amsterdam by Inge van den Ende (2024) ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- MFLES - Gradient Boosted Decomposition for time series forecasting by Tyler Blume (2024) TIME SERIES ๐๐๐๐๐ ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- confopt - A Library for Conformal Hyperparameter Tuning by Ricardo Doyle (2024) paper ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- [crepes-weighted Extension of crepes package, to enable weighted conformal prediction and conformal predictive systems that can handle covariate shifts](https://github.com/predict-idlab/crepes-weighted ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
R
- Conformal Prediction ih tidymodels by Max Kuhn (Posit/RStudio, 2023) video ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Modeltime (2023) by Matt Dancho (Business Science, 2023) TIME SERIES ๐๐๐๐๐ ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Conformal prediction for 80+ classes of
R
models with the marginaleffects
package by Vincent Arel-Bundock (2023) ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- conformalForecast TIME SERIES ๐๐๐๐๐ ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ (2024)
- AdaptiveConformal (2023) paper ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Conformal Inference R Project maintained by Ryan Tibshirani (2016) ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Prediction Bands by Rafael Izbicki and Benjamin LeRoy (2019)
- Conformal: an R package to calculate prediction errors in the conformal prediction framework by Isidro Cortes, 2019
- Online Time Series Anomaly Detectors by Alaine Iturria, 2021 ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- piRF - Prediction Intervals for Random Forests by Chancellor Johnstone and Haozhe Zhang (2019)
- conformalClassification: Transductive and Inductive Conformal Predictions for Classification Problems by Niharika Gauraha and Ola Spjuth (2019)
- R Package for Spatial Conformal Prediction
- conformalInference.multi: Conformal Inference Tools for Regression with Multivariate Response by Jacopo Diquigiovanni, Matteo Fontana, Aldo Solari, Simone Vantini, Paolo Vergottini, Ryan Tibshirani (2021) ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Conformal: an R package to calculate prediction errors in the conformal prediction framework by Isidro Cortes, 2019
- cfsurvival - An R package that implements the conformalized survival analysis methodology Paper
- ClusTorus: An R Package for Prediction and Clustering on the Torus by Conformal Prediction by Seungki Hong and Sungkyu Jung (2022)
- conformal glm - conformal prediction for generalized linear regression models by Daniel Eck (2019)
- caretForecast - Conformal Time Series Forecasting Using State of Art Machine Learning Algorithms
- Localized Conformal Prediction - LCP
- conformalbayes - Jackknife(+) Predictive Intervals for Bayesian Models (2022)
- conformal.fd Conformal inference prediction regions for Multiple Functional response regression (2021)
Julia
- ConformalPrediction.jl by Patrick Altmeyer (2022) Article - Conformal Prediction in Julia, Part I - Introduction Article - Conformal Prediction in Julia, Part II - How to conformalize a deep image classifier Article - Conformal Prediction in Julia, Part III - Prediction intervals for any regression model
- RandomForest by Henrik Bostrรถm (2017) ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
Other Languages
- LibCP -- A Library for Conformal Prediction ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- An Implementation of Venn-ABERS predictor ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- LibVM -- A Library for Venn Machine
- Scala-CP by Marco Capuccini (2017)' ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ (see tutorial section 'Conformal Prediction in Spark')
AI platforms
- Conformal Prediction in Knime Presentation ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Data Robot - Prediction Intervals via Conformal Inference
- AWS Fortuna by Amazon, (2022) ๐ฅ๐ฅ๐ฅ๐ฅ๐ฅ
- Microsoft Azure
Patents
- Rahul Vishwakarma, Method and system for reliably forecasting storage disk failure. US 2021/0034450 A1 United States Patent and Trademark Office, Feb 2021
- Rahul Vishwakarma, Analyzing Time Series Data for Sets of Devices Using Machine Learning Techniques. US 2021/0241929 A1 United States Patent and Trademark Office, Aug 2021
- Rahul Vishwakarma, System and method for prioritizing and preventing backup failures. US 2021/0374568 A1 United States Patent and Trademark Office, Dec 2021