Workshop on Harmonizing Python Workflows


Workshop on Harmonizing Python Workflows

Monday - Sep 15, 2025
Chicago, IL, USA

An increasing number of large scale scientific workflow applications are expressed or managed using the Python language. Such workflows consist of large graphs of complex tasks combining data gathering, data processing, simulation, training, inference, validation, and visualization. While there have been many successes, large scale deployments still encounter many barriers due to the need to integrate many different technologies: applications, workflow systems, software environments, cluster technologies, interactive notebooks, visualization systems, and more. The POSE-HARMONY Project seeks to "harmonize" common practices surrounding Python-based workflows, considering issues such as workflow management, technology integration, software deployment, building and testing, documentation, and other matters of common concern. This workshop will be organized in an interactive manner to enable participants to collectively define the common space of challenges in Python workflow deployment, propose resources and solutions of common interest, and point the way towards a common open source ecosystem.

 

Attendees

 

Workshop registration and attendance is by invitation as part of the POSE-Harmony project, please contact the organizers to request an invitation.

 

Agenda

Time Event
9:00-9:15am CDT Introduction and Objectives
9:15-9:30am CDT Introductions at Your Table
9:30-10:30am CDT Lightning Talks
10:30-11:00am CDT Coffee Break
11:00-12:30pm CDT Small Groups: Discuss Inherent Challenges
Report Back 12:00pm CDT
12:30-1:30pm CDT Lunch
1:30-2:00pm CDT Lightning Talk
2:00-3:30pm CDT Small Groups: Discuss OSE Activitiess
Report Back 3:00pm CDT
3:30-4:00pm CDT Coffee Break
4:00-4:45pm CDT Small Groups: Brainstorm Ideas for OSE Structure
Report Back 4:30pm CDT
4:45-5:00pm CDT Open Floor, Conclusion, and Next Steps

 

Attendees are encouraged to stay and participate in the full IEEE Conference on eScience following this workshop.

 

In conjunction with:


Organizers

Douglas Thain (U Notre Dame)
TaskVine Project

Kyle Chard (U Chicago)
Parsl Project

Shantenu Jha (Rutgers/PPPL)
RADICAL CyberTools

Rafael Ferreira da Silva (ORNL)
Workflows Community Initiative



This work is supported by National Science Foundation grant TIP-2346119: POSE Phase I: HARMONY: Harmonizing the High Performance Python Workflow Ecosystem.