Workshop on Harmonizing Python Workflows
Monday - Sep 15, 2025
Chicago, IL, USA
An increasing number of large scale scientific workflow applications are expressed or managed using the Python language. Such workflows consist of large graphs of complex tasks combining data gathering, data processing, simulation, training, inference, validation, and visualization. While there have been many successes, large scale deployments still encounter many barriers due to the need to integrate many different technologies: applications, workflow systems, software environments, cluster technologies, interactive notebooks, visualization systems, and more. The POSE-HARMONY Project seeks to "harmonize" common practices surrounding Python-based workflows, considering issues such as workflow management, technology integration, software deployment, building and testing, documentation, and other matters of common concern. This workshop will be organized in an interactive manner to enable participants to collectively define the common space of challenges in Python workflow deployment, propose resources and solutions of common interest, and point the way towards a common open source ecosystem.
Attendees
Workshop registration and attendance is by invitation as part of the POSE-Harmony project, please contact the organizers to request an invitation.
Agenda (tentative)
| Time | Event |
|---|---|
| 9:00-9:30am CDT | Welcome and Overview |
| 9:30-9:45am CDT | Meet Your Neighbors |
| 9:45-10:30am CDT | Discussion of Challenges and Report Back |
| 10:30-10:45am CDT | Coffee Break |
| 10:45-12:00pm CDT | Complex Integration Successes and Challenges |
| 12:00-1:00pm CDT | Lunch |
| 1:00-2:00pm CDT | Elements of an Open Source Ecosystem |
| 2:00-3:00pm CDT | Detail Work on New Opportunities |
| 3:00-3:15pm CDT | Coffee Break |
| 3:15-4:00pm CDT | Building an Open Source Ecosystem |
| 4:00-4:30pm CDT | Next Steps and Final Report |
Attendees are encouraged to stay and participate in the full IEEE Conference on eScience following this workshop.
In conjunction with:
Organizers
Douglas Thain (U Notre Dame)
TaskVine Project
Kyle Chard (U Chicago)
Parsl Project
Shantenu Jha (Rutgers/PPPL)
RADICAL CyberTools
Rafael Ferreira da Silva (ORNL)
Workflows Community Initiative
This work is supported by National Science Foundation grant TIP-2346119: POSE Phase I: HARMONY: Harmonizing the High Performance Python Workflow Ecosystem.