Data transfer options in a research environment

This presentation discusses how to efficiently transfer data between sites. Unfortunately transferring data is not always trivial, it very much depends on the size of the files to be transferred, how many of them are there are, where it is located, and where it is supposed to go. Also: who is allowed to see it. We present an overview of several options that are available for researchers in New Zealand. Transfer protocols we will compare include: samba shares, ssh/scp/sftp, irods, and gridftp. After comparing these we will give recommendations when to use which option (and why), stressing again that for non-trivial transfers, choosing the best solution is very much dependent on the factors mentioned above. To conclude we will show how easy/hard it is to transfer files by demonstrating the most common client applications that are used to transfer files using the above protocols.

eResearch NZ 2013 session type: 


Submitted by Tim McNamara on