1.4 Data levels and Best Practice Recommendations

You are here:

Data Levels

Modified from GLEON Best Practice Recommendations for Data Management and ODM2 core: Processing Levels

Level 0 – Raw data: unprocessed data and data products that have not undergone quality control. Depending on the data type and data transmission system, raw data may be available within seconds or minutes after real-time. Examples include real-time precipitation, streamflow, and water quality measurements

Level 0.1 – First pass QC: A first quality control pass has been performed to remove out of range and obviously erroneous values. These values are deleted from the record.

Level 0.2 – Second pass QC: A second quality control pass has been performed to adjust values for instrument drift, routine estimation of timing and sensor calibration or visual inspection and removal of obvious errors. E.g: Online Environment Canada streamflow data, laboratory data

Level 1Quality Controlled Data: Quality controlled data have passed quality assurance procedures such as 0.1 and 0.2. Data are reviewed by data managers, flagged, versioned and harmonized. E.g. Data submitted to CanWIN

Level 2Derived Products: Derived products require scientific and technical interpretation and can include multiple collection types. E.g.: watershed average stream runoff derived from streamflow gages using an interpolation procedure.

Level 3 – Interpreted Products: These products require researcher (PI) driven analysis and interpretation and/or model-based interpretation using other data and/or strong prior assumptions. E.g.: watershed average stream runoff and flow using streamflow gauges and radarsat imagery

Level 4Knowledge Products: These products require researcher (PI) driven scientific interpretation and multidisciplinary data integration and include model-based interpretation using other data and/or strong prior assumptions. E.g.: watershed average nutrient runoff concentrations derived from the combination of streamflow gauges and nutrient values.

Data Processing Best Management Practices

  1. Get Level 0 (raw) data (e.g. downloaded instrument data ), Level 0.1, Level 0.2 OR Level 1 data (e.g. from lab) from platform (Figure 1)
  2. Store and archive level 0 or 1 data as raw format or ASCII file if possible. You can use your own hard drive and/or CanWIN’s GitLab, DataHub or Alfresco servers for this
  3. Process Level 0 data to produce Level 1 data if possible OR 
  4. Share Level 0, 0.1 or 0.2 data through CanWIN. It will be archived and a dataset which had been quality controlled to CanWIN standards  (Level 1) will be produced
  5. If you produce additional results from the original dataset (level 0, 0.1 or 0.2), you can also add this to CanWIN under the same project as Levels 2,3 or 4 products. This helps showcase your work

 

Canwin Workflow

Canwin Workflow

Last Updated On November 23, 2017