Depositing Data

Dashboard

Upon logging into FRDR, you are presented with the Data Publication Dashboard. It shows the status of your dataset submissions: In Progress; Submitted; and Complete. For those datasets that are In Progress, you have the options to Resume, View, or Remove the submission. Those datasets that have been Submitted are waiting for curation. Those that are Complete have been accepted into FRDR and are discoverable through search.

A new submission can be initiated at any time.

Overview of Depositing

Steps involved in making a submission in FRDR:

You can stop the submission process, save your work, and resume your submission at any time. A Digital Object Identifier (DOI) is assigned as soon as you start a dataset deposit. The DOIs for all in-progress deposits will be shown in your list of incomplete deposits. This will enable you to share a DOI for your dataset with a funder or publisher immediately. Please note that the links for the DOIs will not work until after a data deposit is approved by a curator. Once submitted, you will not be able to make changes to the data or metadata. Any change to data or metadata after submitting will need to be done by contacting a curator at curators@frdr.ca.

Selecting a Storage Group

Datasets in FRDR are organized in collections, known as Storage Groups. There are two types of Storage Groups: the Default Storage Group and Special Storage Groups. The default group, General / Général, will be preselected upon initiating a data deposit.

Special Storage Groups allow institutions, research groups, or special projects to create a collection for their datasets in FRDR. Each Special Storage Group will appear as a repository in the list of Canadian Research Data Repositories indexed by FRDR. Special Storage Groups may be able to use a personalized deposit template which could, for example, pre-fill metadata elements or make use of additional metadata fields other than the default Dublin Core/DataCite elements. The option to deposit to Special Storage Groups will be limited to authorized users. If you would like a Special Storage Group, or believe you should have access to an existing Special Storage Group, please contact support@frdr-dfdr.ca.

Data usage licenses

Users submitting a dataset will have a choice of licensing terms regarding the use of their data by others. The license terms will be displayed on the landing page of FRDR datasets and included in the metadata record.

Submitters will be required to choose a license. The following are the default options:

The following additional licenses may also be selected from the "Advanced" tab:

Note that a Curator may ask why you are unable to make use of the default licenses. For other licensing terms not found here, or for customized data use licenses, contact support@frdr-dfdr.ca.

Add Collaborators

Adding collaborators is a great way for multiple people to enter metadata and upload files for a submission. You can only invite someone to contribute to a submission if they have logged into FRDR at least once. You will need the email address they used to register with FRDR, which they can find on their profile page.

Screenshot showing Profile page under Account at top of page and where email is on the profile page

To add a collaborator, start or resume a submission from the Data Publication Dashboard. Navigate to the Collaborate step, enter their email address, and click on the "Invite" button. They will receive an email notification with a link to accept your invitation.

By default they will be able to edit metadata and upload files. You can change their permissions by changing the check boxes below their email address.

Screenshot highlighting where to add collaborators

Collaborators can also accept your invitation from their own Data Publication Dashboard by logging in and clicking "Accept" next to the dataset title. You will receive an email when your invitation has been accepted or rejected.

Screenshot showing accept button on publication dashboard that will accept an invite

After accepting the invitation, collaborators will be able to resume the submission from the Data Publication Dashboard and edit the submission. Although multiple collaborators can work on the same submission, only one person should add or edit metadata at a time. The last person to save will overwrite any metadata changes made by others.

You can invite additional collaborators or remove collaborators at any point during the submission process. To do so, click on the "Collaborate" button at the top of the page after resuming an in-progress submission. Please note that collaborators cannot invite additional people to collaborate, only the original submission creator can add and remove people via the Collaborate tab.

Screenshot showing Collaborate tab at the top of the screen during submitting to return to the Collaborate step

Contact Information

A contact name and email address for the dataset administrator is required for every submission. This information is not shown publicly. It is used for two purposes:

You may optionally supply instructions on when or why people should use the public contact form.

Entering metadata

Metadata, such as title, authors and their affiliations, keywords, dates, and description, are used to describe your dataset. Metadata helps others to discover and reuse the data. The more metadata that you provide, the easier it will be for someone else to discover and reuse the data.

A metadata submission form is provided to guide you through the process of entering metadata. Please refer to the section Describing your data for detailed information on how to fill out the contents of each field. While working in the submission form, you can view more information about each metadata field by hovering your mouse pointer over the label.

You can navigate forward and backwards through the metadata submission form by using the buttons at the bottom or top of the page. When you navigate to another screen within the metadata submission form, the metadata from your current page will be automatically saved.

Screenshot showing menu bar at top of submitting that lets you save metadata when switching to different tabs

Screenshot buttons at bottom of submitting that lets you save metadata

Required fields are marked with an asterisk.

Some metadata fields are repeatable. For these fields, you can add additional entries by clicking “Add More” and remove entries by clicking “Remove Entry”.

Screenshot showing Contributors field that lets you add more contributors with add more button

Other fields will allow you to add multiple values within the field by entering a semicolon (;) or pressing the Enter key. For example, you can add multiple author affiliations for the same author:

Screenshot with author affiliations tag that can have none, one or multiple entries

Specifying an embargo period

If a dataset needs to be protected for a period of time, perhaps due to restrictions from a publisher or funding agency, you can set an embargo and specify the date on which the data will automatically become accessible. During the embargo period, your data files will not be visible or available for download.

An embargo will always protect your data files from view and download, but you can choose whether the metadata that describes your dataset (title, authors, description, etc.) is publicly accessible or not. Under Advanced → Metadata Access, you can choose whether the metadata is:

Submitters will receive a notification one month before the embargo expires. This includes an option to request an extension. Failure to respond results in the automatic release of the embargoed dataset on the specified date.

FRDR allows embargoes of up to one year. All other embargo requests must be approved by FRDR’s service manager. Please contact support@frdr-dfdr.ca if you need to request an extended embargo.

Transferring the dataset

Using Browser Upload (Small datasets)

This section covers the following activities:

How to upload files using your web browser

Upload with File Browser

Screenshot of button to click on to upload files

Screenshot showing progress bar of file still being uploaded

Screenshot of file being processed after upload

Screenshot of file finished uploading and processing

Uploading folders or many files using drag and drop

Screenshot of drag and drop area for uploading files

Screenshot progress bar after file drag and drop

Screenshot showing processing status of file after drag and drop

Screenshot of file being finished uploading

Using Globus to Upload Dataset

This section covers the following activities:

If you have a very large dataset (greater than a few Gigabytes) or many files (several thousand files) we would recommend using Globus Connect to efficiently and reliably manage these larger datasets.

Note: If you are transferring from your notebook or desktop you will need to install Globus Connect Personal. Ensure that Globus Connect Personal is running so that you will have access to your data.

Globus moves files and directories between two endpoints: the source endpoint running at your end and FRDR, the destination endpoint.

How to transfer files using Globus

  1. On the "Transfer Data" tab, click "Globus File Transfer" button to access the Globus file transfer page
    Screenshot of highlighting Globus File Transfer button on Transfer Data tab

  2. Click on the "Transfer or Sync to" link on the right side of the screen.
    Screenshot Globus Web UI with Transfer or Sync to button highlighted

  3. FRDR is on the left, we need to choose a source for files on the right. Click on the top right textbox by the magnifying glass to search for an endpoint to find files.
    Screenshot of Globus Web UI showing Collection Search text field in top right

  4. Start typing the name of the Globus endpoint containing your files. This could be the name you gave your notebook or desktop, a Compute Canada hosting site (e.g. Cedar, Graham, Niagra or Beluga) or another Globus endpoint location (e.g. a lab or institutional server)
    Screenshot of Globus Web UI showing results of search for collection

  5. Find and select the files necessary for your dataset. You can Shift-click or Ctrl-click to build your selection of files.
    Screenshot of Globus Web UI showing files highlighted and ready for transfer

  6. Click on the Transfer and Sync Options button at the bottom middle of the screen.
    Screenshot of Globus Web UI with Transfer & Sync Options highlighted at bottom of screen

  7. Label this Transfer: enter a name for the transfer activity that will make it easy to identify.
    Screenshot of Globus Web UI showing Transfer & Sync options at the bottom of the screen

  8. Select Transfer Settings: provides various options to control file checking and security. In many cases, the default settings will be appropriate. Contact support@frdr-dfdr.ca if you require assistance understanding which additional transfer settings may be needed for your dataset.

  9. Initiate the transfer by clicking on the blue start button at the bottom of the page. You can initiate as many transfers as needed during a single session. This may be required if, for example, you want to transfer files that live in different folders or source endpoints.
    Screenshot of Globus Web UI with Start button highlighted in bottom right

  10. The status of the transfer will be indicated on the left hand side under activity, but the transfer will proceed independently and you can close that window and return to FRDR to verify and complete your submission.
    Screenshot of Globus Web UI with Activity button highlighted on left hand side

Check status of transfer

  1. Go to the Activity page.
  2. Click on the transfer in the list (its title will be the label if you gave it one).
  3. This page will give you the current status of the transfer (i.e., the number of files transferred, how much data has been transferred, or whether an error has occurred ).
  4. For a timeline click on the "Event Log" tab.
    Screenshot of Globus Web UI showing the details of a transfer in the Event Log

Canceling an in-progress transfer

  1. Go to the Activity page.
  2. In the list of transfers, find the correct transfer based on the label
  3. Click on the X button
    Screenshot of Globus Web UI list of transfers with a X button highlighted on right hand side to cancel transfer
  4. Click on the red terminate transfer button.

Deleting a file that has already been transferred

  1. Navigate to the dataset submission, located in the "In Progress" tab of the Data Publication Dashboard. Click "Resume" to get into the submission.
  2. Click on the "Transfer Data" tab (if not already on it.)
  3. Click the "Transfer Dataset" button to open the transfer window.
  4. Locate the file or directory that you want to delete. Click once on the file or directory to highlight it.
  5. Click the “Delete Selected” button on the right hand side of the screen (or middle if both the source and destination are open) and confirm it by clicking on the delete button on the resulting screen.
    Screenshot of Globus Web UI with button Delete Selected highlighted in the middle of the screen
  6. Repeat as needed until all of the files or folders have been deleted.

Submitting a dataset is not an instantaneous process. Several of the steps can take a significant amount of time:

If possible, it is a good idea to retain a copy of your data after submitting. While FRDR does automatically create backups for all datasets, this process may take up to 24 hours to complete.

Finalizing the Submission

After the data transfer is complete, you have an opportunity to review the metadata and list of files before submitting the dataset for publication. Return to any of the previous tabs if you want to make changes to the metadata or data files. Once you finalize the submission, changes to metadata and files can only be done by a curator.

To submit the dataset, click the “Finish” button. Your submission will be reviewed by a curator before it is published in FRDR. Once a curator has finished reviewing your submission, you will be notified by email and the status will update to ‘Complete’ in your Publication Dashboard.

We recommend that any publication or reference to your dataset includes the DOI.

DOIs

DOIs are reserved at the beginning of the submission process. You may share your DOI with journal publishers or research offices at any point; however, the DOI will not be a registered, active link until your dataset is reviewed by FRDR curators and approved for publication.