Page tree
Skip to end of metadata
Go to start of metadata

Downloading Large Collections (Public, AAF, CSIRO Partners)

Large collections in the DAP are any collections with a combined file size of 1GB or more.

The Access or Download Data page contains a list of Estimated Data Download Times for various download speeds.

Please note that you will not be able to select files in the "Select" column unless the collection is ready to be accessed.  If the collection is not ready, there will be no checkboxes to allow selection of files. The "Select" column is only applicable for downloading files via the web browser (see Common Issues with Downloading).

All ATNF Collections provide the same methods for downloading files as large collections.

This page details the options available for accessing large collections for the Public, Australian Access Federation (AAF) users and CSIRO Partners. If you are a CSIRO Staff Member, you have other options for downloading large collections.

Web browser limits for downloading files vary. To avoid problems with these limits, CSIRO provides other methods for downloading large collections. Large collections in the DAP can be accessed by:

 

Download using your Browser

You may download small files (up to maximum of 2GB in total size) using your web browser, but first the data needs to be retrieved from tape and prepared for download.  Follow the steps below to initiate the preparation.

Please note that if there are already select checkboxes visible for the file, the collection is ready to be accessed. You may then proceed to select and download your files.

You will need to enter an email address. The email address is used to notify you when a collection is ready and to provide links to the data.

Your email address will not be passed on to any third parties or used for any other purpose.

 

Click on the "request files" link. 

You will be asked do you accept the licence terms for this collection. If you do, click on the "Accept" button and the process for creating the file structure and making the collection available for download will begin. 

Once the collection is ready to be accessed, an email will be sent to you. Non-logged in, public users will receive in the email a link to the collection landing page to download the files.

In order to prevent email messages sent from the DAP being blocked, you may need to add the "@csiro.au" domain to the "Safe Senders" list in your email client's preferences.

If you requested the data as a logged in Australian Access Federation (AAF) member or a CSIRO Partner, the email will contain a link to the Collection Data Tab in the DAP. Click on this link and log in to the DAP to securely access the data. This step is required to ensure that access to restricted material is secure.

The data will be available for 48 hours from when the email is sent.  If you require longer access, you can request the data again and it will be available for a further 48 hours from when that request is processed.

Click on the link in the email to open the collection landing page. When the collection landing page opens, select the Data tab.

Select the file(s) you wish to download (up to 2GB) and select the download selected files as ZIP archive link. ATNF Collections will have the additional option to download a TAR file.

When the selection checkbox for a file has been replaced by an asterisk ("*"), it means the file is too large to be downloaded using a browser.  You should use the WebDAV download option for large files such as this.

 

Download via WebDAV

You can work with files individually using WebDAV with your default web browser. If you use a WebDAV client, you will be able to select multiple files at once to copy or move.

The WebDAV protocol can be used without a WebDAV client installed on the machine you are using to access the collection. Without a client installed, this method will use your default web browser to display the downloaded files. This will limit you to working with the files individually. To be able to select multiple files and use drag-and-drop functionality we recommend installing the WinSCP client. WinSCP can be downloaded at: https://winscp.net (external link).

You will need to enter an email address. The email address is used to notify you when a collection is ready and to provide links to the data.

Your email address will not be passed on to any third parties or used for any other purpose.

Enter the Preferred data location.  Choosing a location closer to you should minimise the network activity required to access the data.

Select the "Download via WebDAV" option.

Click on the "request files" link. This will initiate the process of making the large collection accessible.

Once the collection is ready to be accessed, an email will be sent to you. Public users will receive in the email a link to access the collection.

In order to prevent email messages sent from the DAP being blocked, you may need to add the "@csiro.au" domain to the "Safe Senders" list in your email client's preferences.

If you requested the data as a logged in Australian Access Federation (AAF) member or a CSIRO Partner, you will receive a link to the Collection Data Tab in the DAP. Click on this link and log in to the DAP to securely access the data. This step is required to ensure that access to restricted material is secure.  Further detail on this step can be found on the Restricted collection access help page.

You then have two options for accessing the data files in the collection:

  1. using your default web browser
  2. using a WebDAV client
Option 1: Using your default web browser for WebDAV

This process has been tested using the following browsers: Internet Explorer 8, Firefox 15.0.1, Google Chrome 22.0.1229.94 m and Safari (Windows) 5.1.7. If you experience problems with access using your default web browser we recommend downloading a webDAV client.

 

1.Click on the link in the email.


2. Your web browser will open the page and prompt you to enter the authentication details listed in the email.


3. Your web browser will display the list of files.  Click the links to the files the begin the download.  If there are many files, or the files are organised in folders, you should use a WebDAV client to download the files instead.

 

 


Option 2: Using a WebDAV client

 

The following step by step instructions refer to the WinSCP WebDAV client

  1. Open the WinSCP software from the Start Menu.
  2. A Login window should appear when you open the software.
  3. Select New Site
  4. Select "WebDAV" under the File protocol option
  5. Copy and paste the full URL into the Host name value.


    It's easy to accidentally copy and paste the bullet point that precedes the URL.  You might need to check this and delete the text preceding "https://" if necessary

    WinSCP will automatically resolve this address, which will automatically complete the Encryption and Port number values, as well as making the URL look different.

  6. Enter the email address and password from the email you received, then click "Login".
  7. WinSCP will display the files from the collection.  You can drag and drop them to your local storage.