Workshop on Harmonizing Python Workflows

Workshops / Workshop on Harmonizing Python Workflows

Workshop on Harmonizing Python Workflows

Date Monday - Sep 15, 2025
Location Chicago, IL, USA
Time
In conjunction with In conjunction with

An increasing number of large scale scientific workflow applications are expressed or managed using the Python language. Such workflows consist of large graphs of complex tasks combining data gathering, data processing, simulation, training, inference, validation, and visualization. While there have been many successes, large scale deployments still encounter many barriers due to the need to integrate many different technologies: applications, workflow systems, software environments, cluster technologies, interactive notebooks, visualization systems, and more. The POSE-HARMONY Project seeks to "harmonize" common practices surrounding Python-based workflows, considering issues such as workflow management, technology integration, software deployment, building and testing, documentation, and other matters of common concern. This workshop will be organized in an interactive manner to enable participants to collectively define the common space of challenges in Python workflow deployment, propose resources and solutions of common interest, and point the way towards a common open source ecosystem.

 

Attendees

 

Workshop registration and attendance is by invitation as part of the POSE-Harmony project, please contact the organizers to request an invitation.

 

Agenda

Time Event
9:00-9:15am CDT Introduction and Objectives
9:15-9:30am CDT Introductions at Your Table
9:30-10:30am CDT Lightning Talks
10:30-11:00am CDT Coffee Break
11:00-12:30pm CDT Small Groups: Discuss Inherent Challenges
Report Back 12:00pm CDT
12:30-1:30pm CDT Lunch
1:30-2:00pm CDT Lightning Talk
2:00-3:30pm CDT Small Groups: Discuss OSE Activitiess
Report Back 3:00pm CDT
3:30-4:00pm CDT Coffee Break
4:00-4:45pm CDT Small Groups: Brainstorm Ideas for OSE Structure
Report Back 4:30pm CDT
4:45-5:00pm CDT Open Floor, Conclusion, and Next Steps

 

Attendees are encouraged to stay and participate in the full IEEE Conference on eScience following this workshop.

 

Organizers

Douglas Thain (U Notre Dame)
Douglas Thain (U Notre Dame) TaskVine Project
Kyle Chard (U Chicago)
Kyle Chard (U Chicago) Parsl Project
Shantenu Jha (Rutgers/PPPL)
Shantenu Jha (Rutgers/PPPL) RADICAL CyberTools
Rafael Ferreira da Silva (ORNL)
Rafael Ferreira da Silva (ORNL) Workflows Community Initiative

Support

NSF

This work is supported by National Science Foundation grant TIP-2346119: POSE Phase I: HARMONY: Harmonizing the High Performance Python Workflow Ecosystem.