Page tree
Skip to end of metadata
Go to start of metadata

See our quick tips for Common Issues with Downloading.

Data Tab- How to download files

Once the Data Tab has been opened, the Data files for the Collection will be displayed. Access to the data is set by the data owner and will affect who has access to download the data.

The licence agreement only needs to be accepted once per session. After accepting the licence, you can view the data files contained within the selected Data Collection.

There will be different views depending on the files in the data collection:

Estimated Data Download Times

The following table provides an indication of the download times you may expect at various download speeds:

Size

ADSL 2

(500 KB/s)

Inter Agency

(3 MB/s)

CSIRO Desktop

(10 MB/s)

Within Data Centre

(100 MB/s)

1 GB

34 minutes

6 minutes

2 minutes

20 seconds

10 GB

6 hours

1 hour

20 minutes

2 minutes

100 GB

3 days

10 hours

3 hours

17 minutes

1 TB

24 days

4 days

28 hours

3 hours

10 TB

232 days

39 days

12 days

1.5 days

100 TB

6.5 years

386 days

116 days

12 days

 

Data Collections with Restricted Access

Some data collections have restrictions on who can access the data within them. The restrictions have been added by the owner of the data collection. The collection can be restricted to a certain set of users or for a set period of time. A padlock icon on the data tab indicates that the data is restricted. If you do not have the permissions,you will not be able to access the data.

Clicking on this data tab will display the following message:

To inquire about being given access to the data collection, contact the designated contact person for the data collection, as shown on the Description tab.

 

Search For Files

 

Collections containing a large number of files will automatically display a "Search For Files" section above the file list.

Clicking "Show File Details" will list the collection size, the number of files, the various file extensions used and the count of files using those extensions.

Entering a search string and clicking "Search" will filter the list of files to only those that contain the search string in the file name.  The folders that contain these files will also be displayed, and automatically expanded to view the matching files contained therein.

 

 

 

'Standard' Collections

 

For most Collection types, you will see the following screen:


Selecting Files

Clicking the checkbox next to the file selects the corresponding file to download.
Clicking the select all link selects all of the data files displayed on the page.

Downloading selected files

You can choose to download the selected files as a ZIP file by selecting the 'download selected files as a zip archive' link at the bottom of the window. CSIRO logged in users will have some additional options when downloading Large collections. They will be able to choose the protocol they want to use and will be able to choose the geographic location to "mount" the data for access, to minimise network issues. CSIRO users will have the option to mount the data on a selected machine if they only need to access the data, rather than making a copy of the data via the download option.

For consecutive downloads, refresh the screen before you download the next series of files

View Images (if applicable)

You will see this option if there are any images attached to the Collection. Select this function to view the Search Results as an image gallery instead of viewing the information in the table format. The Gallery has several views which display the images in different sizes, and various levels of metadata: from none to all. See the Image Gallery for additional information.


 

ATNF Collections

Please note that Data Files marked with a  are not currently available for download.

 Please refer to the Large Collections section for instructions on how to download ATNF files.

Files marked with a in the selection column are are under embargo. Please phone or email the Contact Person (located on the Description tab) to be given access to the restricted file(s).

 

For ATNF Collections, you will see the following screen (the options displayed show the download methods available to public users):


Please note that all ATNF Collections provide the same methods for downloading files as Large collections.

File Types

All files are in PSRFITS format. The file types are:

  • ".rf" - Raw data file (folded data)
  • ".cf" - Calibration data file (folded data)
  • ".sf" - Raw data file (search mode data)
  • ".FTp" - Pulsar total intensity profile (averaged over time and frequency)
  • ".f8Tp" - Total intensity pulsar profiles for Pulse@Parkes (P595), an innovative project for high-school students.
Selecting and Downloading files

Please refer to the Large Collections section for instructions on how to download ATNF files.

Preview Files

If a file has a Preview File, the word view will appear in the Preview column. Selecting view will display the Preview File.


 

AAHL Collections

Files marked with a in the selection column are are under embargo. Please phone or email the Contact Person (located on the Description tab) to be given access to the restricted file(s)

 

For AAHL Collections, you will see data displayed in a similar manner to the following screen:


Selecting Files

Clicking the checkbox next to the file selects the corresponding file to download.
Select ALL files by clicking the checkbox in the column header.

Downloading selected files

You can choose to download the selected files in either a ZIP or a TAR file by selecting the appropriate link at the bottom of the window.

Configure Results Columns

This button allows the user to configure which columns will be displayed in the search results.

View Images

Select this function to view the Search Results as an image gallery instead of viewing the information in the table format. The Gallery has several views which display the images in different sizes, and various levels of metadata: from none to all. See the Image Gallery for additional information.

Export to Excel

This option exports the metadata from the search result or a collection to an Excel spreadsheet. All metadata fields, not only those displayed currently, will be included in the spreadsheet.

 


 

CASDA Collections

 

For CASDA collections, you will see data products contained by the collection in a similar format to the following screen:

Collections for ASKAP projects are typically broken into two. One collection will cover catalogue based data products, and the other image based data products (images, cubes, visibilities etc.). If you can't find the data you're looking for, it may be in the "sibling" collection.

You can use the "Search Data" feature in DAP to look for all collections (try searching on the project name) or you can conduct a domain specific "CASDA Observation Search" then use the Project links from the tabs of different data product types. Try opening the Collection from the "Catalogues" tab, then the "Image Cubes" or "Visibilities" tab.


Data Filter

The data filter allows you to filter the results to display:

  • Only released data
  • Only unreleased data
  • Released data products encapsulated by a Digital Object Identifier (DOI)

DOI's are applied periodically and capture all the collection's data products released at that point in time (a "snapshot"). They are useful for citations. Read more at www.doi.org.

Access Data

For details on downloading CASDA data products through DAP, see the following page: CASDA Data Access and Download.

 


 

Large Collections

See our quick tips for Common Issues with Downloading.

Large collections in the DAP are any collections with a combined file size of 1GB or more.

Please note that all ATNF Collections provide the same methods for downloading files as large collections.

 

Various web browsers have differing size limits for downloading files. To avoid this problem the DAP provides other methods for downloading large collections.

Public , OPAL, Australian Access Federation (AAF) and Partner users will find an explanation of access methods available to them on the Large Collection Access (non-CSIRO Users) page.
CSIRO staff with a Nexus login will find an explanation of access methods available to them on the Large Collection Access (CSIRO Users) page.

 

 

 

Dataset Index

 

When “Dataset Index “ appears on the Data tab it means you are looking at a data collection in the Data Access Portal that is hosted elsewhere. For example the MDBSY Scenario C collection collection:


NetCDF Files are hosted using a THREDDS Server (Thematic Real-time Environmental Distributed Data Services). The THREDDS Server operates similarly to a file browser. The initial page, known as the dataset index, provides access to a set of directories and files.

Upon clicking on a specific file, a page will be displayed that provides some further information about that file and enables you to choose your preferred method for accessing the file.

TROUBLESHOOTING: Some web browsers will block "mixed content", so that the data tab on these collections will appear blank rather than looking like the screen above.  The solution depends on which web browser you are using:

Safari: Currently Safari is unaffected by this issue.

Internet Explorer 9 and above: Internet Explorer displays a temporary pop up at the bottom of the browser window when first loading a page with secure content. Click on "Show all content" to display the data. If you miss the pop up just select the Description tab and then the Data tab again to reload and look for the pop up.

 

 

Firefox version 23 and above: To the left of address bar will be a "mixed content" icon.  Click on this to reveal the option to "Disable Protection on This Page" and select it.


Chrome version 30* and above: Look for an icon to the far right of the address bar. Hovering over it or clicking on it will give you the message "This page includes script from unauthenticated sources." Click on it and click on "Load unsafe script" link.

*Please note that version 34 has a known bug, and clicking the "Load unsafe script" link will not work; more information here (Google product forum)