Setup

The typical Gladier Flow is composed of two major parts

  • Transfer data into a location where execution can be performed (usually a super computer)

  • Perform the execution

The first part is solved by Globus Transfer, and the second by FuncX Endpoints. In order for your computer to be accessible by Globus, it needs to be running a Globus Endpoint. See the Globus Connect Personal section below. For the second part, you will need to setup a FuncX Endpoint to tell FuncX where it should execute functions. See the FuncX Endpoint section below for details.

Globus Connect Personal

To run tools like gladier_tools.globus.Transfer, we need access to Globus endpoints. One can use Globus Tutorial Endpoint 1 and Globus Tutorial Endpoint 2. However, setting up your own endpoint gives you more control over the data you transfer, which brings us to Globus Connect Personal. Follow the Globus Connect Personal instructions to set up your own GCP endpoint, then navigate to Globus Web App endpoints to see details about the endpoint.

Your Globus endpoint should be accessible on the same machine you install your FuncX endpoint.

FuncX Endpoint

Another thing we need to run flows are an endpoint to run the funcx-functions on. There is a tutorial endpoint that can be used but it is generally preferred to set up a funcx-endpoint. Follow the FuncX Endpoint instructions to set up your own endpoint. Once an endpoint has been configured, you can list all the endpoints you have using funcx-endpoint list. To start an endpoint, use funcx-endpoint start <endpoint-name>.