Blog
Skip to end of metadata
Go to start of metadata

IMT formed the Data Management Capability Enhancement Program (DMCEP) to further develop the DAP and related data management services across CSIRO and build an integrated data management ecosystem servicing the needs of CSIRO and the Australian Innovation System.

To date the DMCEP has delivered 6 development sprints and 4 production releases including approximately 100 enhancements (new functionality and bug fixes) to the DAP.

These enhancements have included:

Changes for depositors:

    • Removed the need for further approval for metadata edits to records already published. This means that any edits that depositors have been wanting to make to records, for example, incorrect spatial coordinates, or typos, can now be done without an addtional approval step. Any changes to the data will still require re-approval.
    • Changes to the attribution statement to make it easier to reuse
      • all contributors are now listed
      • contributor name order has been changed to last name, first name
      • the DOI is a full link
    • CSIRO Groups can be used as Contacts
    • Corporate Names can be included in the Contributors list
    • Related materials 
      • can now include a relevant Attribution Statement
      • now have a type: website, publication, collection
      • drag and drop to reorder
    • New section added for tracking Funding Sources
    • Added search for Field of Research (FOR) codes
    • Co-ordinates entry section in Location details now a spatial representation
    • Start and end dates can now be a year, or a month and a year
    • Files display in order on the data tab
    • Image metadata is no longer mandatory
    • The Collaborating Organisations element and Rights Statement are co-located and it can now be seen how they relate
      • Collaborating Organisations can be reordered using drag and drop
    • Project Leader is now auto-populated
    • Can add documentation for approvers-eyes only
    • A record submitted to an approver can be changed to another approver by the depositor
    • Shareable persistent link is now on the description tab and the data tab

Changes for Approvers:

    • Reminder emails are now sent monthly
    • Removed mandatory Data Deposit Checklist question
    • A record submitted to an approver can be changed to another approver by the depositor
    • Approval process for metadata only updates are not required
    • Can receive documentation from depositors

Changes for Data Users:

    • Improved interface for requesting large collections
    • Shareable persistent link now on the description tab and the data tab

Large collection changes:

    • Increased the default large collection mount time from 48 Hours to 1-2 weeks
    • Large collections can be now mounted for extended periods on request to RDS

Web services enhancements:

Other:

    • Improvements to the feed to ANDS Research Data Australia
    • Better support for notification for outages etc for example a banner on the header of the DAP which will be used for notifications

CASDA:

CASDA version 1.1 has now been released.

The enhancements in version 1.1 over version 1.0 (released Nov 2015) are:

  • Scripted access to large data files via Virtual Observatory (VO) protocols, including authenticated access
  • 3-d image cube cut-outs including spatial, spectral and polarisation filtering
  • Example script for producing bulk image cut-outs based on a catalogue
  • Team member access to unreleased data products via VO protocols
  • Support for direct transfers within Pawsey Supercomputing Centre for users with Pawsey accounts
  • Administration of project roles (e.g. allocation of validation rights for a project)

More to come ...

We have also been working on analyses and precursor work for:

  • more improvements to large data collection capabilities
  • enabling linking to data hosted externally
  • support for file/object level metadata (investigating implementation of MongoDB)
  • development of a Data Management Plan online tool
  • better indexing to support improved discovery, and discovery via web services (investigating moving from Solr to Elasticsearch)
  • better reliability and stability monitoring
  • more enhancements to web services
  • better statistical reports for depositors
  • Provenance capabilities.
  • Semantic capabilities.

More information and getting involved

For more information about the program including details on the program's outcomes, deliverables please visit the DMCEP Wiki.

The DMCEP program is highly Researcher driven regarding what new capabilities are developed and when and feedback and improvement suggestions are welcome.

Please contact the RDS team via researchdatasupport@csiro.au :

  • If you would like a demonstration or further information about any of these changes
  • If you have a particular use case that you think would be suitable for extending our data management capabilities.
  • Or you have any other comment or feedback to make.
  • No labels