<div dir="ltr">John,<div><br></div><div><br></div><div>I like the idea of using a methodstep and no matter what else I do or don't' do I'm definitely doing that.</div><div><br></div><div>Jonathan</div></div><div class="gmail_extra"><br><div class="gmail_quote">On Wed, Sep 20, 2017 at 3:37 PM, Porter, John Henderson (jhp7e) <span dir="ltr"><<a href="mailto:jhp7e@eservices.virginia.edu" target="_blank">jhp7e@eservices.virginia.edu</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div>
<div dir="auto">Interesting distinction.....
<div dir="auto"><br>
</div>
<div dir="auto">We have our local catalog, the LTER Data Portal/EDI, to which we send our metadata (and PASTA then fetches the data). DataONE gets the metadata from PASTA, then links back to PASTA for the data itself. </div>
<div dir="auto"><br>
</div>
<div dir="auto">It looks as if NSF will be increasingly emphasizing having data on EDI/PASTA, and deemphasizing the local catalog. And as we showed at ESIP, you can also implement a local view of the metadata/data in PASTA as a local catalog.</div>
<div dir="auto"><br>
</div>
<div dir="auto">Back to the original subject, we generally try to avoid serving data that is also served by others because we want to avoid the headaches of keeping it updated, and the potential confusion of users over who to cite.</div>
<div dir="auto"><br>
</div>
<div dir="auto">-JP</div>
<div dir="auto"><br>
</div>
<div dir="auto"><br>
</div>
</div>
<div class="gmail_extra"><br>
<div class="gmail_quote">On Sep 20, 2017 1:46 PM, Jonathan Walsh <<a href="mailto:walshjcaryinstitute@gmail.com" target="_blank">walshjcaryinstitute@gmail.com</a><wbr>> wrote:<br type="attribution">
<blockquote class="m_-4648091403384078115quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div>
<div dir="ltr">Thank you for replying. One clarification:
<div>>>>><span style="font-size:12.8px">For LTER data, of course, we are the "best source" so we document that data and share it via PASTA, DataONE etc.</span><span style="font-size:12.8px"> </span></div>
<div><span style="font-size:12.8px">Does that mean you submit a copy of that data to PASTA, DataONE, etc, or just some documentation of what data it is and how to find it?</span></div>
<div><span style="font-size:12.8px"><br>
</span></div>
<div><span style="font-size:12.8px">Thanks!</span></div>
<div><span style="font-size:12.8px"><br>
</span></div>
</div>
<div><br>
<div class="m_-4648091403384078115elided-text">On Wed, Sep 20, 2017 at 1:12 PM, John Porter <span dir="ltr">
<<a href="mailto:jhp7e@eservices.virginia.edu" target="_blank">jhp7e@eservices.virginia.edu</a>></span> wrote:<br>
<blockquote style="margin:0 0 0 0.8ex;border-left:1px #ccc solid;padding-left:1ex">
<div>
<p>Jonathan,</p>
<p>That sounds similar to our approach. <br>
</p>
<p>Generally speaking there is a "best source" for data - the place where updated data is reliably available - and in the case of USGS that is their web site, so we just point people there. For LTER data, of course, we are the "best source" so we document
that data and share it via PASTA, DataONE etc. <br>
</p>
<p>There are a few cases where we do maintain "local" copies of external data, either because the availability at the source is unreliable (not the case for USGS), the data volume is best dealt with on a local network (e.g., large LiDAR datasets), the data
is really hard to locate and extract, or where there is a reason that you want to maintain a particular static version of the data (e.g., for a series of analyses conducted over a period of time where you don't want the underlying data to change). However,
we DON'T include them in the data catalog. <br>
</p>
<p>Don't forget that for your derived products you can include references to the USGS source in a "methodStep" in EML. For referring to source data already documented in EML and stored in PASTA via the "provenance" web service (e.g.,
<a href="https://pasta.lternet.edu/package/provenance/eml/knb-lter-bes/332/580" target="_blank">https://pasta.lternet.edu/pack<wbr>age/provenance/eml/knb-lter-<wbr>bes/332/580</a>) which will produce a methodStep "stub" that can easily be included in your metadata. For USGS
you'll need to generate your own methodStep - but you can use the example produced by the provenance web service to do that....</p>
<p>Hope that helps!</p>
<p> -John Porter<br>
</p><span class="">
<div>
<div><br>
<div>On 9/20/2017 11:11 AM, Jonathan Walsh wrote:<br>
</div>
</div>
</div>
<blockquote>
<div>
<div>
<div dir="ltr">Hi IMs!
<div><br>
</div>
<div>I have a question on how to best represent data that your study uses, but is provided by others. If you use such data, we could use your insights on how you make that portion of your data available to the community and the LTER.</div>
<div><br>
</div>
<div>Baltimore Ecosystem Study gets its stream flow data from the USGS. We in turn use this flow data to calculate our daily loads and other results that we track. The USGS data are kept on their website and we incorporate them into our work.</div>
<div><br>
</div>
<div>For the purposes of making our data available to the larger community, (LTER, PASTA, DataONE, etc.) we have historically just pointed to the USGS data on the USGS site. (example: <a href="https://waterdata.usgs.gov/usa/nwis/uv?01589197" target="_blank">https://waterdata.usgs.gov/us<wbr>a/nwis/uv?01589197</a> )
as opposed to collecting our own copy and providing it ourselves.</div>
<div><br>
</div>
<div>The above precludes us from providing a direct link to the data such as that that would be PASTA "type 1".</div>
<div><br>
</div>
<div>If you have any suggestions as to how, if differently, we should represent these data, which are integral to our work, but not provided by us, I would very much appreciate hearing them.</div>
<div><br>
</div>
<div>Thank you!</div>
<div><br>
</div>
<div>Jonathan</div>
<div><br>
</div>
<div>- </div>
<div>
<div>
<div dir="ltr">
<div>
<div dir="ltr">
<div>
<div dir="ltr">
<div>
<div dir="ltr">
<div>
<div dir="ltr">
<div>
<div dir="ltr">Jonathan Walsh</div>
<div dir="ltr"><a href="http://orcid.org/0000-0002-0658-0814" style="color:rgb(17,85,204);font-size:12.8px" target="_blank"><span style="font-size:11.5pt;font-family:'helvetica',sans-serif;background:rgb(255,238,148)">orcid</span><span style="font-size:11.5pt;font-family:'helvetica',sans-serif">.org/0000-0002-0658-0814</span></a><br>
Information Manager, Baltimore Ecosystem Study<br>
Cary Institute of Ecosystem Studies<br>
Box AB; Route 44A<br>
Millbrook, NY 12545-0129<br>
P: <a href="tel:845%2F677%2F7600%20Extension%20103" target="_blank">845/677/7600 Extension 103</a><br>
F: <a href="tel:845%2F677%2F5976" target="_blank">845/677/5976</a><br>
E: <a href="mailto:WalshJ@caryinstitute.org" target="_blank">WalshJ@caryinstitute.org</a></div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
<br>
<fieldset></fieldset> <br>
</div>
</div>
<pre>______________________________<wbr>_________________
Long Term Ecological Research Network
im mailing list
<a href="mailto:im@lternet.edu" target="_blank">im@lternet.edu</a>
</pre>
<font color="#888888"></font></blockquote>
</span><span class="HOEnZb"><font color="#888888"><font color="#888888"><br>
<pre>--
John H. Porter
Dept. of Environmental Sciences
University of Virginia
<a href="https://maps.google.com/?q=291+McCormick+Road&entry=gmail&source=g" target="_blank">291 McCormick Road</a>
PO Box 400123
Charlottesville, VA 22904-4123
ORCID: <a href="http://orcid.org/0000-0003-3118-5784" target="_blank">http://orcid.org/0000-0003-311<wbr>8-5784</a></pre>
</font></font></span></div><span class="HOEnZb"><font color="#888888">
</font></span></blockquote><span class="HOEnZb"><font color="#888888">
</font></span></div><span class="HOEnZb"><font color="#888888">
<br>
<br clear="all">
<div><br>
</div>
-- <br></font></span><span class="">
<div>
<div dir="ltr">
<div>
<div dir="ltr">
<div>
<div dir="ltr">
<div>
<div dir="ltr">
<div>
<div dir="ltr">
<div>
<div dir="ltr">Jonathan Walsh</div>
<div dir="ltr"><a href="http://orcid.org/0000-0002-0658-0814" style="color:rgb(17,85,204);font-size:12.8px" target="_blank"><span style="font-size:11.5pt;font-family:'helvetica',sans-serif;background:rgb(255,238,148)">orcid</span><span style="font-size:11.5pt;font-family:'helvetica',sans-serif">.org/0000-0002-0658-0814</span></a><br>
Information Manager, Baltimore Ecosystem Study<br>
Cary Institute of Ecosystem Studies<br>
Box AB; Route 44A<br>
Millbrook, NY 12545-0129<br>
P: <a href="tel:845%2F677%2F7600%20Extension%20103" target="_blank">845/677/7600 Extension 103</a><br>
F: <a href="tel:845%2F677%2F5976" target="_blank">845/677/5976</a><br>
E: <a href="mailto:WalshJ@caryinstitute.org" target="_blank">WalshJ@caryinstitute.org</a></div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</span></div>
</div>
</blockquote>
</div>
<br>
</div>
</div>
</blockquote></div><br><br clear="all"><div><br></div>-- <br><div class="gmail_signature" data-smartmail="gmail_signature"><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr">Jonathan Walsh</div><div dir="ltr"><a href="http://orcid.org/0000-0002-0658-0814" style="color:rgb(17,85,204);font-size:12.8px" target="_blank"><span><span style="font-size:11.5pt;font-family:Helvetica,sans-serif;background:rgb(255,238,148)"><span>orcid</span></span></span><span style="font-size:11.5pt;font-family:Helvetica,sans-serif">.org/0000-0002-0658-0814</span></a><br>Information Manager, Baltimore Ecosystem Study<br>
Cary Institute of Ecosystem Studies<br>
Box AB; Route 44A<br>
Millbrook, NY 12545-0129<br>
P: <a href="tel:845%2F677%2F7600%20Extension%20103" value="+18456777600" target="_blank">845/677/7600 Extension 103</a><br>
F: <a href="tel:845%2F677%2F5976" value="+18456775976" target="_blank">845/677/5976</a><br>
E: <a href="mailto:WalshJ@caryinstitute.org" target="_blank">WalshJ@caryinstitute.org</a></div></div></div></div></div></div></div></div></div></div></div></div>
</div>