12-13 May 2022
Max Planck Institute for Evolutionary Biology
Europe/Berlin timezone

Accessing HPC resources via RESTful API

12 May 2022, 19:10
Lecture Hall (Max Planck Institute for Evolutionary Biology)

Lecture Hall

Max Planck Institute for Evolutionary Biology

August Thienemann Strasse 2 24306 Plön Germany
remote Session 3


Christian Köhler (GWDG)


The usual mode of accessing High Performance Computing (HPC) resources involves
interactively connecting to the command-line interface and submitting job
scripts to a job scheduler.

Some services which provide a user interface by themselves (e.g. when working
with graphical data) or services which require HPC resources as a compute
backend for an already existing workflow engine, can benefit from the
integration of HPC resources via an API.

In our prototype for such a solution, external services authenticate against
this backend via RESTful API which then submits jobs to the HPC system's job
scheduler on behalf of the user. Moreover, the job status and outcome is tracked
and can be queried by the service and reflected back to the user.

We showcase our architecture and prototype implementation as well as two usage
scenarios, namely GitLab CI/CD workflows requiring a HPC toolchain and HPC
integration with the workflow engine Flowable.

Presentation Materials

There are no materials yet.