Bringing HPC clusters into Science Mesh

Abstract

Data transfers to and from High Performance Computing (HPC) clusters are a rather well established mechanism since standard Linux file transfer tools like scp and rsync can be used. Nowadays, users are not always familiar with these command-line based mechanisms and prefer more user friendly, and web based solutions. In this article we present a system to use the protocols of enterprise file sync and share systems (EFSS) for data transfers utilizing components of Science Mesh. In addition, this offers a technique to transfer data between different HPC sites without the need for commercial software or exposing the rather vulnerable port 22 to the outside world.