Disaggregated model evaluation and comparison

This video is an introduction to disaggregated model evaluation and comparison in Machine Learning. Throughout this video we will describe the main concepts of disaggregated evaluation, how these concepts relate to Responsible AI approaches of scoring and evaluating a ML model, and how they can be used in practice.

Date:: January 23, 2023

Research Area
- Artificial intelligence
Research Lab
- Microsoft Research Lab - Redmond
Group
- Adaptive Systems and Interaction Group

Watch Next

World and Human Action Models towards gameplay ideation (Supplementary Video 1)
March 3, 2025
Speakers:

Linda Wen
Magma: A foundation model for multimodal AI Agents | Microsoft Research Forum
February 25, 2025
Speakers:

Jianwei Yang
Research Forum 4 | Keynote: Phi-3-Vision: A highly capable and "small" language vision model
September 3, 2024
Speakers:

Jianfeng Gao
Combining Machine Learning and Bayesian networks for Decision Support in Arrythmia Diagnosis
March 20, 2024
Speakers:

Tezira Wanyana
Using Archai to search for best Face Segmentation model on Azure ML
March 5, 2024
Speakers:

Chris Lovett
Evaluation and Understanding of Foundation Models
January 30, 2024
Speakers:

Besmira Nushi
MEGA: Multi-lingual Evaluation of Generative AI
June 29, 2023
Speakers:

Kabir Ahuja,

Millicent Ochieng
Multilingual Evaluation of Generative AI (MEGA)
June 28, 2023
Speakers:

Kabir Ahuja,

Millicent Ochieng
Synapse Espresso: Data Quality Checking with OpenAI GPT-3 in Azure Synapse Spark!
February 16, 2023
Synapse Espresso: Using OpenAI GPT-3 in Synapse!
February 2, 2023