Skip to content

Data transfers and sharing

The best way to transfer files between systems or to share data with colleagues depends on the context. For example, you might want to move or copy data that you own from the GLADE system to a university storage resource or from GLADE to NSF NCAR Campaign Storage. At another time, you might want to share data that you have on GLADE with someone who does not have access to NSF NCAR systems.

There are several ways of accomplishing these transfer and sharing tasks. Review the descriptions of each below and follow the links provided for details.

Transferring files between systems

Globus

CISL recommends using Globus to transfer files between systems – for example, between non-NSF NCAR facilities and the resources that CISL manages. The Globus platform also enables users to transfer files between their GLADE file spaces and the NSF NCAR Campaign Storage file system.

Globus has both web and command line interfaces, and its Globus Connect feature enables users to move files to and from laptop or desktop computers and other systems. Globus has a typical transfer rate that ranges from 100 to 200 MBps. More information.

SSH Based Tools

For users that cannot use Globus there are a number of alternative tools based on SSH that can be used to transfer data to and from GLADE file spaces on CISL systems. More information.

  • SCP / SFTP - Standard SSH file transfer utilities. Suitable for small transfers.

  • PSCP / PSFTP – PuTTY utilities including a Windows version

  • WinSCP – SCP and SFTP transfers with a graphical user interface for Windows users

  • rsync - A standard Linux data synchronization tool capable of data transfers between remote systems using SSH.

  • rclone - A command line tool to manage files and data on cloud and remote storage systems. Supports parallel transfers via multiple SFTP streams.

Sharing data with colleagues

Globus

In addition to the features described above, Globus enables users to share files with colleagues and others who do not have NSF NCAR user accounts. More information.

Sharing via Google Drive and other services

Individuals who have GLADE access can copy files from GLADE and then share them with others via Google Drive or services such as DropBox and Amazon Web Services. More information.