Speaker
Description
The usual mode of accessing High Performance Computing (HPC) resources involves
interactively connecting to the command-line interface and submitting job
scripts to a job scheduler.
Some services which provide a user interface by themselves (e.g. when working
with graphical data) or services which require HPC resources as a compute
backend for an already existing workflow engine, can benefit from the
integration of HPC resources via an API.
In our prototype for such a solution, external services authenticate against
this backend via RESTful API which then submits jobs to the HPC system's job
scheduler on behalf of the user. Moreover, the job status and outcome is tracked
and can be queried by the service and reflected back to the user.
We showcase our architecture and prototype implementation as well as two usage
scenarios, namely GitLab CI/CD workflows requiring a HPC toolchain and HPC
integration with the workflow engine Flowable.
