Getting hold of GridFTP client software

The clients, globus-url-copy and uberftp described here can be installed as part of VDT (the Virtual Data Toolkit). See here for a script that helps you install these.

globus-url-copy

The official documentation can be found here

The globus-url-copy client program is a GridFTP client for transfering files from the command line. It is not an interactive command. Because it is a command line client, no feedback is provided after the command is executed. It is the client of choice for embedding transfers in job scripts.

Usage

    % globus-url-copy <source_url> <destination_url>

where <source> or <destination> is of the format:

• if local file, file:<full path>
• if remote file, gsiftp://<hostname>/<full path>

Optimisation Parameters

To optimise performance of data transfers using this client:

• specify the size (in bytes) of the buffer to be used by the underlying ftp data channels

-tcp-bs | -tcp-buffer-size

• specify the number of streams to be used in the ftp transfer

-p | -parallel

• show verbose output including transfer rate

-vb

If you want to optimise a particular transfer use the verbose option and test a typical transfer increasing the -tcp-bs parameter till the transfer rate doesn't get any better. Then try increasing the -p parameter till the transfer rate doesn't get any better.

UberFTP

The official documentation for UberFTP can be found here.

UberFTP is an interactive GridFTP file transfer client. In addition to standard FTP client mechanics, UberFTP supports GSI authentication, parallel data channels and striping. Using UberFTP opens a session within which files may be transferred and directories and files may be manipulated.

Usage

       uberftp [-?] [-d]
               [ host [-P port] [-a auth] [-c N] [-t type] ]

       uberftp [-?] [-d]  host  [-P port] [-a auth]
               [-c N] [-t type] "cmd"

       uberftp -v

Options

       host      Connect to host
       -P port   Connect to port (default 2811 for GSI)
       -a auth   Use auth authentication (default is GSI)
       -c N      Use N parallel data connections. Defaults to 1.
       -t type   Use ASCII or BINARY transfer type. Valid type options
                 are 'a' (ASCII) or 'b' (BINARY). Default is BINARY.
       cmd       This specifies the FTP commands to run once the control
                 connection is establish. This list must be enclosed
                 in quotes. Multiple commands are semicolon delimited
                 uberftp will execute these commands and then exit
       -v        Print version information and exit
       -?        Print this help message
       -d        Turn on debug (verbose) output

A few commands are listed below for convenient reference.

• put - send a single file to the remote service
• get - retrieve a single file from the remote service
• mput - send multiple files that match the given expression
• mget - retrieve multiple files that match the expression
• ascii==/==binary - change transfer type
• blksize - change the block size used with extended block mode
• passive - toggle between active (PORT) and passive (PASV)
• parallel N - set N number of parallel data streams
• tcpbuf - change the TCP buffer size

GridFTP.NET

This is a Windows GridFTP client made available by the University of Virginia's Grid Computing Group.

It can be downloaded from here.

NOTE This doesn't use VOMS proxy certificates so you can only connect to GridFTP resources as a single user.

Steps for setting up your certificates:

1. Import the certificate authority certificate by clicking on this link in Internet Explorer.
2. You will be warned about the website's security certificate. Click "continue to this website".
3. Click "open" when asked do you want to open or save this file?
4. Click "Install Certificate ...", next, next, finish.
5. When asked do you want to install this certificate click "Yes"
6. Get your APACGrid certificate into the PKCS12 format to allow Windows Certificate Store to be able to import. This can be done using Grix.
7. After setting up Grix click "Export for browser".
8. Enter your certificate's pass phrase and click "OK".
9. A message at the bottom of the main window contains a link to "P12" version of your certificate. Click on this.
10. Click next, next. Enter your pass phrase and select "mark this certificate as exportable". Click next, next, finish.

Adding a host:

1. Start GridFTP.NET
2. Click on the "Add Site" button
3. Enter the Host Name
4. Where it says "client certificate" click "Select".
5. Details about your certificate should be listed. Click on it and then click "OK"
6. Try it out by selecting the new site from the list and clicking the "Connect" button

SGGC

SGGC is a multi-platform GridFTP graphical user interface.

Hermes

Hermes is a multi-platform graphical user interface which currently supports GridFTP as well as SRB. It can move data between these and a local filesystem. It also has as an architecture supporting the addition of custom metadata interfaces specific to institutional metadata repositories.

If you wish to use Hermes with the ARCS Data Fabric see here

-- StephenMcMahon - 19 Mar 2008

GridFTP Client of WISENT

An Eclipse-based, cross-platform, open-source GridFTP Client with focus on user-friendliness and fault tolerance features for long-running, high-volume third-party transfers. Compatible with the GridFTP implementations of Globus and dCache Storage Manager. You can view an interactive Flash demo of the GridFTP Client before installing.

-- JanPloski - 20 Apr 2008