Using Globus Online with LRZ resources

In this tutorial we are showing you how to transfer files to and from LRZ resources using the Globus Online service.
In order to transfer data, you need two GridFTP endpoints. One of them is provided by LRZ on one of the LRZ resources (SuperMIG, Linux Cluster, etc.), the other endpoint is somewhere outside the LRZ. Often supercomputing centers provide these endpoints already and then you can just use them. Or, if you want to exchange data with a machine without GridFTP (e.g., your laptop or desktop), simply install Globus Connect there. In the following tutorial we assume that you will be using Globus Connect.

Prerequisites

1. You need a Globus Online account. If you don't have one, just go to https://www.globusonline.org/SignUp and follow the instructions from there.
2. You need to setup Globus Connect on your PC. This will enable you to transfer files from your PC to any other endpoint you have access to. If you want to set it up follow the instructions here: https://www.globusonline.org/globus_connect/. You should follow the installation instructions there and setup an endpoint for your PC.
   

Initial Setup

Before we start the transfer we need to make sure our proxy credentials are available to Globus Online so it can authenticate us to the various resources we have available.

1. One way to do that is by using MyProxy. It's really easy for users to upload their proxy credentials. You can use the GSISSH-Term tool to do this. Instructions can be found in the GSISSH-Term user guide here: http://www.grid.lrz.de/de/mware/globus/client/gsissh_term.html#userguide
   
2. Make sure the Globus Connect application is up and running!

Transferring data

1. Go to the Globus Connect application and click on "Start Transfer". You will be redirected to the file transfer page of the Globus Online website. If you haven't signed in yet you will be asked to do so.
   Note: Alternatively you can go to https://www.globusonline.org/, sign in and click on "Start Transfer".
   
   
   
   
2. Now we are ready to select our files! On the left pane click on the textbox next to the endpoint tag. You can use there the endpoint name you assigned for your PC while setting up Globus Connect. Wait for the file list to populate and then navigate to the folder where you data resides.
   Note: You can use any endpoint you have access to as a source of your transfer as well.
   
   
   
   
3. On the right part of the screen choose the preset endpoint for the lrz resource you want to use. Typing 'lrz' will provide you with a list of the LRZ endpoints available. For this example we'll choose "lrz#SuperMIG". After you have selected the endpoint you will be presented with a popup where you can specify your myproxy credential information. As myproxy server use "myproxy.lrz.de" and username and passphrase are those used for uploading your proxy to the myproxy service. You can then click on authenticate.
   
   
   
4. Wait for the file list on the right to populate and then navigate to the folder where you want your data stored. Click on the files/folders you want to transfer on the left file list. You will see that the arrow pointing to the right endpoint is activated which means that a transfer can be issued. Clicking on the arrow will start the file transfer. Alternatively, you can select a file in the right pane and click the arrow pointing to the left and thus download the file from LRZ to your laptop.
   Note: Optionally you can label the transfer so that you can identify it later using the textbox in the bottom of the page.
   
   
   
   
   
5. After you successfully submit the file transfer you will get a notification on top of the screen with the unique ID of the transfer. The green color signifies that everything is as it should be.
   
   
   
   
6. Click on "View Transfer Activity". You will be taken to a new page where information of all your jobs is listed. The white status bar indicates transfers that are going on and the green transfers that have finished. A red bar would indicate failed transfers. The numbers indicate how many files have been transferred so far, out of the total number of files to be transferred during this job.
   Note: Clicking on the transfer name will provide a popup with more information about the status of the transfer.
   
   
   
7. Once the transfer is finished, the status bar turns green and you will soon receive an e-mail containing detailed information about the transfer.