Workflows Community Summits

In collaboration with the workflowsRI project we are organizing a series of Workflows Community Summits. These events gather workflows stakeholders (researchers, developers, users, facility representatives) to identify crucial challenges in the workflow community.

Participants span the following facilities, supercomputing centers, and large-scale computing providers: Argonne Leadership Computing Facility, Oak Ridge Leadership Computing Facility, National Energy Research Scientific Computing Center, San Diego Supercomputer Center, Pittsburgh Supercomputing Center, Open Science Grid, and others.

Third Workflows Community Summit (Nov 8, 2021)

Tightening the Integration between Computing Facilities and Scientific Workflows

The third Workflows Community Summit will explore workflows challenges and opportunities from the perspective of computing centers and facilities. The summit is the third in the series organized by the NSF workflowsRI and DOE ExaWorks projects, and builds on two prior workshops that 1) established a high level vision for workflows research; and 2) explored technical approaches for realizing that vision.

A summary of the previous workshops is available in two technical reports (https://doi.org/10.5281/zenodo.4606958 and https://doi.org/10.5281/zenodo.4915801) and an invited paper (https://arxiv.org/abs/2110.02168) at the WORKS workshop describing the community roadmap.

The third workshop will bring together a small group of facilities representatives (one per facility) with the aim to understand how workflows are currently being used at each facility, how facilities would like to interact with workflow developers and users, how workflows fit with facility roadmaps, and what opportunities there are for tighter integration between facilities and workflows.



Second Workflows Community Summit (Apr 7, 2021)

Advancing the State-of-the-art of Scientific Workflows Management Systems Research and Development

The workflowsRI and ExaWorks projects held a very productive Workflows Community Summit in January. The focus was to identify broad challenges for the workflows community and to propose a vision for community activities to address these challenges.

While the first summit focused on Establishing a high level vision, this second summit will explore technical approaches for realizing (part of) that vision. Consequently, we hope to engage participants who are actively involved in workflow system development.

Based on the outcomes of the first summit, we have identified four technical topics for discussion (some align with a single theme of the first summit, while others are cross-cutting):

  • Definition of common workflow patterns and benchmarks (both for determining workflow system functionality and for providing users with tutorial examples);
  • Identifying paths toward interoperability of workflow systems; and
  • Improving workflow systems' interface with legacy and emerging HPC software and hardware stacks

Agenda

Wednesday, Apr 7 2021 10:00-13:00 PST (18:00 - 21:00 UTC)

10:00 am - Welcome and introductions (Rafael Ferreira da Silva, USC) Youtube
10:05 am - Workflows Community Summit Report and Key Findings (Henri Casanova, University of Hawaii at Manoa) Youtube
10:15 am - Lightning Talk
  • Theme 1: Definition of common workflow patterns and benchmarks, Dan Laney (Lawrence Livermore National Laboratory), Dorran Howell (Tweag I/O) Youtube
  • Theme 2: Identifying paths toward interoperability of workflow systems, Ilkay Altintas (UC San Diego), Stian Soiland-Reyes (The University of Manchester) Youtube
  • Theme 3: Improving workflow systems' interface with legacy and emerging HPC software and hardware stacks, Douglas Thain (University of Notre Dame), Rosa Filgueira (Heriot-Watt University) Youtube
10:30 am - Break
10:35 am - Project Development Sessions
  • Theme 1: Definition of common workflow patterns and benchmarks
  • Theme 2: Identifying paths toward interoperability of workflow systems
  • Theme 3: Improving workflow systems' interface with legacy and emerging HPC software and hardware stacks
11:15 am - Break
11:30 am - Project Roadmap Write Up Sessions
  • Theme 1: Definition of common workflow patterns and benchmarks
  • Theme 2: Identifying paths toward interoperability of workflow systems
  • Theme 3: Improving workflow systems' interface with legacy and emerging HPC software and hardware stacks
12:10 am - Break
12:25 am - Reports: Project Roadmap Sessions
12:40 am - Final remarks and moving forward (Kyle Chard, ANL/UChicago)


First Workflows Community Summit (Jan 13, 2021)

Bringing the Scientific Workflows Community Together

In collaboration with the workflowsRI project we are organizing the Workflows Community Summit. This unique event will gather a select group of lead researchers from distinct workflow management systems, and will seek to identify crucial challenges in the workflow community. This event will be the first of a series of workflows meetings, and will serve to bring the workflows community together.

Videos of the summit presentations are avaialble on YouTube

Agenda

Wednesday, Jan 13 2021 9:00-12:00 PST (17:00 - 20:00 UTC)

9:00 am - Welcome and introductions
9:05 am - WorkflowsRI project overview (Rafael Ferreira da Silva, USC) Youtube
9:15 am - ExaWorks project overview (Dan Laney, LLNL) Youtube
9:25 am - Lightning talks
  • Theme 1: FAIR computational workflows (Carole Goble, Manchester) Youtube
  • Theme 2: Training and education for workflow users (Lavanya Ramakrishnan, LBNL) Youtube
  • Theme 3: AI workflows (Luc Peterson, LLNL) Youtube
  • Theme 4: Exascale challenges and beyond (Bjoern Enders, LBNL) Youtube
  • Theme 5: APIs, interoperability, reuse, and standards (Douglas Thain, Notre Dame) Youtube
  • Theme 6: Building a workflows community (Ilkay Altintas, San Diego) Youtube
9:55 am - Break
10:00 am - Breakout Session 1
  • Theme 1: FAIR computational workflows
  • Theme 2: Training and education for workflow users
  • Theme 3: AI workflows
10:30 am - Reports: Breakout Session 1
10:45 am - Break
10:55 am - Breakout Session 2
  • Theme 4: Exascale challenges and beyond
  • Theme 5: APIs, interoperability, reuse, and standards
  • Theme 6: Building a workflows community
11:25 am - Reports: Breakout Session 2
11:40 am - Final remarks and next steps (Kyle Chard, ANL/UChicago)