[LTER-im] Fwd: EDI Date time and funding elements to go into production May 16

Margaret O'Brien margaret.obrien at ucsb.edu
Tue May 1 16:23:18 PDT 2018


Margaret O'Brien
ORCID: 0000-0002-1693-8322
Information Management
Marine Science Institute, UCSB
Santa Barbara, CA 93106
805-893-2071 (voice)
http://environmentaldatainitiative.org
http://sbc.marinebon.org
http://sbc.lternet.edu



---------- Forwarded message ----------
From: EDI <info at environmentaldatainitiative.org>
Date: Tue, May 1, 2018 at 4:18 PM
Subject: EDI Date time and funding elements to go into production May 16
To: margaret.obrien at ucsb.edu


View this email in your browser
<https://mailchi.mp/34ec485ba7af/edi-date-time-and-funding-elements-to-go-into-production-may-16?e=99cddc3b2b>

Hi all -
You will recall that when time permits, EDI works on EML data package
checks for the EML Congruence Checker (ECC), and our protocol is to
accumulate checks for semi-annual release in November and May. Recently, we
finalized three checks: two related to date-times (in dataTable
attributes), and one for an optional element in the project tree. Below is
a description of the checks we plan to release May 16. Until then, the
checks can be tested in the staging environment, https://portal-s.
edirepository.org

For more information, contact EDI. Feel free to visit our git repository,
below, to find meeting notes and more details of these checks (under
practices/community_updates).

best,
ECC Working Group, https://github.com/EDIorg/ECC
Margaret O'Brien, Duane Costa, Sven Bohm, Stevan Earl, Jason Downing,
Gastil-Buhl

*Overview*
*Date-time checks*
Date-times are complex. As labels for points in time, they have features of
other types of measurements, and when correctly parsed, can be used in
computations (e.g., to compute duration). Users have requested the ability
to query, filter or plot data values by date and time. But before data
values can be effectively used, they must be parsed and interpreted. Many
programming languages have libraries for date-time parsing, and may also
layer on their own interpretations. The simplest solution would have been
to accept the dateTime interpretation of a single processing language, but
this was not consistent with the language-agnostic spirit of EML.

There are two parts to EML date-time checking, and consequently, two
checks, which work together.

1. examine dateTimeFormatString: EML uses a formatString in metadata to
specify how date time values will appear in data. For this check, the
working group created a list of preferred dateTime formats
<https://environmentaldatainitiative.us14.list-manage.com/track/click?u=c258a774cbd4d34290410d1ea&id=003f2701a8&e=99cddc3b2b>,
which generally reflect ISO-accepted date times. Code reads this list and
creates regular expressions, to which EML dateTime formatStrings can be
compared, that is, a match between the format string and every individual
data value in that column.

2. dateFormatMatches: Only datetimes with preferred formatStrings can be
checked for congruence.

Both dateTime checks return a "warn" if their conditions are not met. With
this setting, non-passing data packages are still accepted, but the
submitter is aware of the potential problems. Datasets that meet ECC
standards will be the most easily reused for synthesis.

*Funding element check*
Increasingly, funders (e.g., NSF) are asking for datasets to be searchable
by a funding code. In EML 2.1.x the funding element in the project tree
holds that information, and is unstructured. A planned addition to EML 2.2
will have additional fields for structuring award information. Currently,
the fundingPresence check simply looks for the element's presence, although
this is likely to be revisited after the EML 2.2 release.


<https://environmentaldatainitiative.us14.list-manage.com/track/click?u=c258a774cbd4d34290410d1ea&id=593abc0957&e=99cddc3b2b>
<https://environmentaldatainitiative.us14.list-manage.com/track/click?u=c258a774cbd4d34290410d1ea&id=39a29b4a0a&e=99cddc3b2b>
<https://environmentaldatainitiative.us14.list-manage.com/track/click?u=c258a774cbd4d34290410d1ea&id=55c727de43&e=99cddc3b2b>
*Copyright © 2018 Environmental Data Initiative, All rights reserved.*
You were added to the EDI contact list because you expressed interest in
hearing from us.

*Our mailing address is:*
Environmental Data Initiative
Center for Limnology - University of Wisconsin
680 North Park Street
<https://maps.google.com/?q=680+North+Park+Street+Madison+,++Wisconsin+53706&entry=gmail&source=g>
Madison
<https://maps.google.com/?q=680+North+Park+Street+Madison+,++Wisconsin+53706&entry=gmail&source=g>,
<https://maps.google.com/?q=680+North+Park+Street+Madison+,++Wisconsin+53706&entry=gmail&source=g>
Wisconsin
<https://maps.google.com/?q=680+North+Park+Street+Madison+,++Wisconsin+53706&entry=gmail&source=g>
53706
<https://maps.google.com/?q=680+North+Park+Street+Madison+,++Wisconsin+53706&entry=gmail&source=g>

Add us to your address book
<//environmentaldatainitiative.us14.list-manage.com/vcard?u=c258a774cbd4d34290410d1ea&id=da346b264c>


Want to change how you receive these emails?
You can update your preferences
<https://environmentaldatainitiative.us14.list-manage.com/profile?u=c258a774cbd4d34290410d1ea&id=da346b264c&e=99cddc3b2b>
or unsubscribe from this list
<https://environmentaldatainitiative.us14.list-manage.com/unsubscribe?u=c258a774cbd4d34290410d1ea&id=da346b264c&e=99cddc3b2b&c=eb91bcc9aa>

[image: Email Marketing Powered by MailChimp]
<http://www.mailchimp.com/monkey-rewards/?utm_source=freemium_newsletter&utm_medium=email&utm_campaign=monkey_rewards&aid=c258a774cbd4d34290410d1ea&afl=1>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.lternet.edu/pipermail/im/attachments/20180501/2b8c5809/attachment-0001.html>


More information about the im mailing list