15–18 Dec 2026
Duke University
America/New_York timezone
Artificial Intelligence for the Electron Ion Collider (2026)

Scaling ML Workflows with PanDA and iDDS

Not scheduled
20m
LSRC B101 Love Auditorium (Duke University)

LSRC B101 Love Auditorium

Duke University

Durham, NC 27710
AI/ML in Production and Distributed ML AI/ML in Production, Distributed ML

Speaker

Wen Guan (BNL)

Description

Training and tuning ML models for the EIC needs computation spread across grid, HPC and cloud sites, and running that work takes a lot of operator effort. This talk shows how PanDA and iDDS run and increasingly automate distributed ML workflows. iDDS describes training and hyperparameter optimization (HPO) campaigns as workflows of dependent steps, and PanDA runs those steps on GPU resources at many sites. PanDA MCP, a Model Context Protocol server, gives LLM agents permission-controlled access to PanDA and iDDS. Agents built on it monitor jobs, diagnose failures from logs and source code, and propose fixes for a human to approve. Agentic warm start lets new HPO campaigns begin from the best trials of similar past jobs stored in a knowledge base, so they don't waste their first trials on random points. We close with lessons learned and how the EIC community can adopt these tools.

Author

Presentation materials

There are no materials yet.