Skip to main content
  • Data /
  • Globus Collections for Download

Accessing IODP Files through Globus

We make certain collections of IODP, ODP, and DSDP files available for download through the IODP_GUEST Collection of the Globus Web app. Globus is a platform which handles file transfers of large datasets securely and reliably across the internet. Data available through the Globus Web app are organized in Collections (collections of files) available at designated Endpoints (file system locations). The IODP_GUEST collection data is publicly visible and may be downloaded at will. The data are still hosted on our servers at Texas A&M University, Globus acts as an orchestrator to schedule data transfers to your personal endpoint.

The data IODP currently offers are high-resolution linescan, core table, thin section and closeup images of drill cores and samples from DSDP, ODP, and IODP projects. Files are typically organized by leg or expedition then by site and drillhole. Image datasets are generally 200 GB to 1 TB per expedition depending on core recovery. Follow the steps below to perform the first time setup and for instructions on how to transfer data.

Accessing Files

How to download individual files

Users must have a Globus account (free) to access files. The contents of the IODP_GUEST Collection can be viewed by logging into the Globus Web app at https://www.globus.org/ and searching for the collection “IODP_GUEST” in the File Manager. The File Manager displays files in a directory structure. A single file may be downloaded by selecting it then clicking Download on the right-hand menu. Files accessed in this manner are downloaded via HTTPS to a folder specified by your browser (e.g., downloads in Chrome or Firefox). To download the contents of a folder or a set of hand-picked files simultaneously you must use the Transfer or Sync to option on the right-hand menu and select an endpoint available on your local computer (see below). File transfers are performed with GridFTP and are generally quicker than HTTPS.

How to perform multi-file data transfers

  • Install and set up Globus Connect Personal (GCP) on your local machine (see below).
  • Ensure GCP is running. The icon should be visible in the bottom (Windows) or top (macOS) desktop menu bars. If you have restarted your PC you may need to locate the executable and restart it manually.
  • Log into the Globus Web app at https://www.globus.org/
  • Navigate to the IODP_GUEST Collection in the Globus File Manager. Select a folder(s) or series of files. Select the Transfer or Sync to option on the right hand menu.
  • The user interface will open a second File Manager to the right for you to specify the destination for the file copies. In the Search field search for your collection at your endpoint. If your endpoint has files/folders already present you will see them listed below in the directory contents. Note: Globus allows you to navigate up the directory tree of your endpoint, however any attempt to copy files to these locations will fail because GCP only has permissions to copy files to your endpoint folder (and subfolders within it).
  • Click the Start > button on the left-hand side (underneath the IODP_GUEST Collection) to tell Globus to send the selected files from IODP_GUEST to your endpoint.
  • The transfer begins immediately. A popup will appear on the user interface indicating Transfer request submitted successfully. Click view details for more information. Use the Overview and Event Log tabs to see additional information. Files will begin to appear in the endpoint folder on your local system.
  • An email will be sent from Globus Notification to the email associated with your account when the transfer has completed or if an error was encountered (e.g., lack of local storage space). Note: Depending on how many expeditions worth of data you have selected and your internet speed, the time required to transfer may be minutes to hours (or longer). You can view statistics of your transfer using the Activity menu in the Globus Web App.
  • If the transfer succeeded all the requested files should now be accessible in the local computer directory specified at your GCP endpoint.

Additional Notes:

  • You can specify additional properties of the data transfer by using the Transfer & Timer Options dropdown menu.
  • You can use the Activity tab in the Globus Web app to see a history of your requests.
  • Your account does not have the ability to alter the IODP_GUEST collection by uploading, renaming or deleting files.

Installing Globus Connect Personal Setup and Setting up a Local Endpoint

An endpoint on your local machine is the destination to which Globus copies files. Setup of Globus Connect Personal only needs to be done once, your endpoint will continue to be available for future transfers. Once a transfer is queued it runs without any further user interaction necessary. Globus will automatically pause and continue transfers if you lose or have a spotty internet connection. A notification email will be sent to the email associated with your user account when a transfer has completed.

How to install Globus Connect Personal (GCP)

  • Navigate to https://www.globus.org/globus-connect-personal and select the appropriate installer for your target system under the Install Globus Connect Personal section.
  • Follow the steps on the install page to download and launch the application installer. The installer may prompt for an administrator login.
    • The installer will open a splash page prompting you to Log In. If you do not have an account then create one here. It is recommended to use your organization credentials if your organization has a Globus subscription. If not, you may also use an ORCID, Github, or Google account, or a Globus only account. During first time setup Globus may prompt you to specify if you are using the platform for non-profit or commercial purposes. Agree to the terms of service. Select Continue.
    • Log in and then click Allow to grant GCP the required consents. Read about each consent using the “I” hover overs.
    • A popup will appear to set details for your Collection. Verify the owner identity is your username email. Enter a custom name in the “Collection Name” field (e.g., IODP-personal-collection) and an optional description of what your collection is (e.g., “Endpoint for receiving IODP data”). Click Save.
    • The Globus Connect Personal installer will proceed with the install. After installation GCP will automatically run and the Globus icon will appear in the desktop menu bar.
  • Right-click the Globus icon and select either Options (Windows) or Preferences (Mac). Click the “Access” tab and add or create a directory that will be used to transfer files into. It is recommended to create a new empty folder in a public location on your computer (e.g., C:\users\userA\Desktop\Globus). Ensure the Writeable checkbox for the directory is checked. Leave the Shareable option unchecked. Click Save. Note: Keeping the Shareable option unchecked is one safeguard to ensure any files within the resident folder are not exposed and accessible to any other Globus users.
  • Log into the Globus Web app at https://www.globus.org/. Select the Collections tab on the left-hand menu. Select the Administered By You menu option. You should see a collection with the name you specified earlier. Underneath its name your collection should list Private Mapped Collection (GCP) indicating that the endpoint exists and you are the only one with access. You can click on the collection for more details.