mikejohnson51 / nwmTools

Set of tools to work with National Water Model output
https://mikejohnson51.github.io/nwmTools/
Creative Commons Zero v1.0 Universal
17 stars 5 forks source link

NetCDF: Malformed or inaccessible DAP2 DDS or DAP4 DMR response #10

Open tungttnguyen opened 4 months ago

tungttnguyen commented 4 months ago

Hello Mike,

I tried one example from here but got this error message. Do you know what went wrong? Thank you very much for your help!

pst = readNWMdata(comid = 101, 
                  startDate = "2010-01-01", 
                  endDate = "2010-01-31", 
                  tz = "US/Pacific")
syntax error, unexpected WORD_WORD, expecting SCAN_ATTR or SCAN_DATASET or SCAN_ERROR

context: <!doctype^ html><html itemscope itemtype=http://schema.org/WebPage lang=en class=no-js><head><meta charset=utf-8><meta name=viewport content="width=device-width,initial-scale=1,shrink-to-fit=no"><meta name=generator content="Hugo 0.111.3"><link rel="shortcut icon" href=/blog/favicons/favicon.ico><title>USGS Geo Data Portal and THREDDS Data Server Retirement | Water Data For The Nation Blog</title><meta property="og:title" content="USGS Geo Data Portal and THREDDS Data Server Retirement"><meta property="og:description" content="The GDP web interface, processing service, and THREDDS data server are being retired."><meta property="og:type" content="article"><meta property="og:url" content="https://waterdata.usgs.gov/blog/gdp-moving/"><meta property="article:section" content><meta property="article:published_time" content="2024-04-10T00:00:00+00:00"><meta property="article:modified_time" content="2024-04-11T12:34:19-05:00"><meta itemprop=name content="USGS Geo Data Portal and THREDDS Data Server Retirement"><meta itemprop=description content="The GDP web interface, processing service, and THREDDS data server are being retired."><meta itemprop=datePublished content="2024-04-10T00:00:00+00:00"><meta itemprop=dateModified content="2024-04-11T12:34:19-05:00"><meta itemprop=wordCount content="410"><meta itemprop=keywords content="cloud-transition,"><meta name=twitter:card content="summary"><meta name=twitter:title content="USGS Geo Data Portal and THREDDS Data Server Retirement"><meta name=twitter:description content="The GDP web interface, processing service, and THREDDS data server are being retired."><link rel=preload href=/blog/scss/main.min.a50c6c9b533b99783624948c3928413a3770d9d03cd912e10894831189cfebcd.css as=style><link href=/blog/scss/main.min.a50c6c9b533b99783624948c3928413a3770d9d03cd912e10894831189cfebcd.css rel=stylesheet integrity><script src=https://code.jquery.com/jquery-3.6.0.min.js integrity=sha384-vtXRMe3mGCbOeY7l30aIg8H9p3GdeSe4IFlP6G8JMa7o7lXvnz3GFKzPxzJdPfGK crossorigin=anonymous></script><script src=/blog/wdfn-viz/uswds-init.min.js></script><link rel=stylesheet href=/blog/css/prism.css><link rel=stylesheet href=/blog/wdfn-viz/wdfnviz-all.css><script>(function(e,t,n,s,o){e[s]=e[s]||[],e[s].push({"gtm.start":(new Date).getTime(),event:"gtm.js"});var a=t.getElementsByTagName(n)[0],i=t.createElement(n),r=s!="dataLayer"?"&l="+s:"";i.async=!0,i.src="https://www.googletagmanager.com/gtm.js?id="+o+r,a.parentNode.insertBefore(i,a)})(window,document,"script","dataLayer","GTM-TTF8M2Z")</script><script type=application/javascript>var doNotTrack=!1;doNotTrack||(function(e,t,n,s,o,i,a){e.GoogleAnalyticsObject=o,e[o]=e[o]||function(){(e[o].q=e[o].q||[]).push(arguments)},e[o].l=1*new Date,i=t.createElement(n),a=t.getElementsByTagName(n)[0],i.async=1,i.src=s,a.parentNode.insertBefore(i,a)}(window,document,"script","https://www.google-analytics.com/analytics.js","ga"),ga("create","UA-25350863-1","auto"),ga("send","pageview"),ga("require","outboundLinkTracker"),ga("require","eventTracker"))</script><script type=application/javascript src=https://www2.usgs.gov/scripts/analytics/usgs-analytics.js></script></head><body class="post page"><noscript><iframe src="//www.googletagmanager.com/ns.html?id=GTM-TTF8M2Z" height=0 width=0 style=display:none;visibility:hidden></iframe></noscript><section class=usa-banner aria-label="Official website of the United States government"><div class=usa-accordion><header class=usa-banner__header><div class=usa-banner__inner><div class=grid-col-auto><img class=usa-banner__header-flag aria-hidden=true src=/blog/wdfn-viz/img/us_flag_small.png alt="U.S. flag"></div><div class="grid-col-fill tablet:grid-col-auto" aria-hidden=true><p class=usa-banner__header-text>An official website of the United States government</p><p class=usa-banner__header-action>Here’s how you know</p></div><button class="usa-accordion__button usa-banner__button" aria-expanded=false aria-controls=gov-banner><span class=usa-banner__button-text>Here’s how you know</span></button></div></header><div class="usa-banner__content usa-accordion__content" id=gov-banner><div class="grid-row grid-gap-lg"><div class="usa-banner__guidance tablet:grid-col-6"><img class="usa-banner__icon usa-media-block__img" src=/blog/wdfn-viz/img/icon-dot-gov.svg alt="Dot gov"><div class=usa-media-block__body><p><strong>Official websites use .gov</strong><br>A <strong>.gov</strong> website belongs to an official government organization in theUnited States.</p></div></div><div class="usa-banner__guidance tablet:grid-col-6"><img class="usa-banner__icon usa-media-block__img" src=/blog/wdfn-viz/img/icon-https.svg alt=Https><div class=usa-media-block__body><p><strong>Secure .gov websites use HTTPS</strong><br>A <strong>lock</strong> (<span class=icon-lock><svg xmlns="http://www.w3.org/2000/svg" width="52" height="64" viewBox="0 0 52 64" class="usa-banner__lock-image" role="img" aria-labelledby="banner-lock-description"><title id="banner-lock-title">Lock</title><desc id="banner-lock-description">Locked padlock</desc><path fill="#000" fill-rule="evenodd" d="M26 0c10.493.0 19 8.507 19 19v9h3a4 4 0 014 4v28a4 4 0 01-4 4H4a4 4 0 01-4-4V32a4 4 0 014-4h3v-9C7 8.507 15.507.0 26 0zm0 8c-5.979.0-10.843 4.77-10.996 10.712L15 19v9h22v-9c0-6.075-4.925-11-11-11z"/></svg></span>) or <strong>https://</strong> means you’ve safely connected to the .gov website. Sharesensitive information only on official, secure websites.</p></div></div></div></div></div></section><div class=usa-overlay></div><header class="usa-header usa-header--extended usgs-header" role=banner><a class=usa-skipnav href=#main-content>Skip to main content</a><div class=usgs-header-container><div class=usa-navbar><div class=usa-logo id=extended-logo><a href=https://www.usgs.gov><img alt="USGS Home" src=/blog/wdfn-viz/img/USGS_logo.svg></a></div><button class=usa-menu-btn>Menu</button></div></div><nav role=navigation class=usa-nav><div class=usa-nav__inner><button class=usa-nav__close><img src=/blog/wdfn-viz/img/usa-icons/close.svg alt=close></button><ul class="usa-nav__primary usa-accordion"><li class=usa-nav__primary-item><a class=usa-nav__link href=https://waterdata.usgs.gov/blog/>Water Data For The Nation Blog</a></li><li class=usa-nav__primary-item><a class=usa-nav__link href=/blog/introduction><span>About</span></a></li><li class=usa-nav__primary-item><button class="usa-accordion__button usa-nav__link" aria-expanded=false aria-controls=section-categories><span>Categories</span></button><ul id=section-categories class=usa-nav__submenu><li class=usa-nav__submenu-item><a href=https://waterdata.usgs.gov/blog/categories/water-information>water-information</a></li><li class=usa-nav__submenu-item><a href=https://waterdata.usgs.gov/blog/categories/data-science>data-science</a></li><li class=usa-nav__submenu-item><a href=https://waterdata.usgs.gov/blog/categories/web-communication>web-communication</a></li><li class=usa-nav__submenu-item><a href=https://waterdata.usgs.gov/blog/categories/applications>applications</a></li><li class=usa-nav__submenu-item><a href=https://waterdata.usgs.gov/blog/categories/news>news</a></li><li class=usa-nav__submenu-item><a href=https://waterdata.usgs.gov/blog/categories/software-development>software-development</a></li><li class=usa-nav__submenu-item><a href=https://waterdata.usgs.gov/blog/categories/data-visualization>data-visualization</a></li><li class=usa-nav__submenu-item><a href=https://waterdata.usgs.gov/blog/categories/events>events</a></li><li class=usa-nav__submenu-item><a href=https://waterdata.usgs.gov/blog/categories/analytics>analytics</a></li><li class=usa-nav__submenu-item><a href=https://waterdata.usgs.gov/blog/categories/api>api</a></li></ul></li><li class=usa-nav__primary-item><button class="usa-accordion__button usa-nav__link" aria-expanded=false aria-controls=section-keywords><span>Keywords</span></button><ul id=section-keywords class=usa-nav__submenu><li class=usa-nav__submenu-item><a href=https://waterdata.usgs.gov/blog/keywords/data>data</a></li><li class=usa-nav__submenu-item><a href=https://waterdata.usgs.gov/blog/keywords/water>water</a></li><li class=usa-nav__submenu-item><a href=https://waterdata.usgs.gov/blog/keywords/r>r</a></li><li class=usa-nav__submenu-item><a href=https://waterdata.usgs.gov/blog/keywords/water-information>water-information</a></li><li class=usa-nav__submenu-item><a href=https://waterdata.usgs.gov/blog/keywords/generation>generation</a></li><li class=usa-nav__submenu-item><a href=https://waterdata.usgs.gov/blog/keywords/next>next</a></li><li class=usa-nav__submenu-item><a href=https://waterdata.usgs.gov/blog/keywords/water-data>water-data</a></li><li class=usa-nav__submenu-item><a href=https://waterdata.usgs.gov/blog/keywords/data-science>data-science</a></li><li class=usa-nav__submenu-item><a href=https://waterdata.usgs.gov/blog/keywords/data-visualization>data-visualization</a></li><li class=usa-nav__submenu-item><a href=https://waterdata.usgs.gov/blog/keywords/update>update</a></li></ul></li><li class=usa-nav__primary-item><button class="usa-accordion__button usa-nav__link" aria-expanded=false aria-controls=section-tags><span>Tags</span></button><ul id=section-tags class=usa-nav__submenu><li class=usa-nav__submenu-item><a href=https://waterdata.usgs.gov/blog/tags/water-data-for-the-nation>water-data-for-the-nation</a></li><li class=usa-nav__submenu-item><a href=https://waterdata.usgs.gov/blog/tags/public-communication>public-communication</a></li><li class=usa-nav__submenu-item><a href=https://waterdata.usgs.gov/blog/tags/r>r</a></li><li class=usa-nav__submenu-item><a href=https://waterdata.usgs.gov/blog/tags/water-data>water-data</a></li><li class=usa-nav__submenu-item><a href=https://waterdata.usgs.gov/blog/tags/nextgen>nextgen</a></li><li class=usa-nav__submenu-item><a href=https://waterdata.usgs.gov/blog/tags/monitoring-location-pages>monitoring-location-pages</a></li><li class=usa-nav__submenu-item><a href=https://waterdata.usgs.gov/blog/tags/data-science>data-science</a></li><li class=usa-nav__submenu-item><a href=https://waterdata.usgs.gov/blog/tags/news>news</a></li><li class=usa-nav__submenu-item><a href=https://waterdata.usgs.gov/blog/tags/dataretrieval>dataretrieval</a></li><li class=usa-nav__submenu-item><a href=https://waterdata.usgs.gov/blog/tags/hiring>hiring</a></li></ul></li></ul><div class=usa-nav__secondary><form action=/blog/search method=get data-search-index=https://waterdata.usgs.gov/blog/index.json class="usa-search usa-search--small margin-bottom-1" role=search><label class=usa-sr-only for=search-query>Search NOW</label><input class=usa-input id=search-query type=search name=q><button class=usa-button type=submit><img src=/blog/wdfn-viz/img/usa-icons-bg/search--white.svg class=usa-search__submit-icon alt=Search></button></form><ul class=usa-nav__secondary-links><li class=usa-nav__secondary-item><a class=usa-link href=https://dashboard.waterdata.usgs.gov/ target=_blank>Water Dashboard</a><li class=usa-nav__secondary-item><a class=usa-link href=https://www.usgs.gov/mission-areas/water-resources target=_blank>Water Resources</a></li></ul></div></div></nav></header><div class=grid-col-fill><main id=main-content role=main class=main-content><article class="single grid-container-desktop"><h1 class="text-ls-neg-2 padding-bottom-0 margin-bottom-0">USGS Geo Data Portal and THREDDS Data Server Retirement</h1><h3 class=text-normal>The GDP web interface, processing service, and THREDDS data server are being retired.</h3><div class="grid-row display-flex flex-justify border-y padding-y-1"><div><span class="display-block text-uppercase">Date Posted</span><span class=text-bold>April 10, 2024</span><span class="display-block text-uppercase margin-top-1">Last Updated</span><span class=text-bold>April 11, 2024</span></div><div><span class="display-block text-uppercase">Author</span><span class=text-bold>David Blodgett</span><br><a href=mailto:dblodgett@usgs.gov class=text-no-underline target=blank><i class="fas fa-envelope-square text-primary-darker social-icon"></i></a><a href=https://github.com/dblodgett-usgs class=text-no-underline target=blank><i class="fab fa-github-square text-primary-darker social-icon"></i></a><a href=https://twitter.com/D_Blodgett class=text-no-underline target=blank><i class="fab fa-twitter-square text-primary-darker social-icon"></i></a><a href=https://www.usgs.gov/staff-profiles/david-l-blodgett class=text-no-underline target=blank><i class="fas fa-user text-primary-darker social-icon"></i></a></div><div><span class="display-block text-uppercase">Reading Time</span><span class=text-bold>2 minutes</span><span class="display-block text-uppercase margin-top-1">Share</span><a href="http://www.facebook.com/sharer.php?src=bm&u=https%3a%2f%2fwaterdata.usgs.gov%2fblog%2fgdp-moving%2f&t=USGS%20Geo%20Data%20Portal%20and%20THREDDS%20Data%20Server%20Retirement" class="text-no-underline margin-right-1" onclick='return window.open(this.href,"PCwindow","width=550, height=350, menubar=no, toolbar=no, scrollbars=yes"),!1'><i class="fab fa-facebook text-primary-darker social-icon" aria-hidden=true></i></a><a href="https://twitter.com/intent/tweet?url=https%3a%2f%2fwaterdata.usgs.gov%2fblog%2fgdp-moving%2f&text=USGS%20Geo%20Data%20Portal%20and%20THREDDS%20Data%20Server%20Retirement&tw_p=tweetbutton" class="text-no-underline margin-right-1" rel=nofollow target=_blank><i class="fab fa-twitter text-primary-darker social-icon" aria-hidden=true></i></a><a href="https://www.reddit.com/submit?url=https%3a%2f%2fwaterdata.usgs.gov%2fblog%2fgdp-moving%2f&title=USGS%20Geo%20Data%20Portal%20and%20THREDDS%20Data%20Server%20Retirement" class=text-no-underline onclick='return window.open(this.href,"PCwindow","width=550, height=350, menubar=no, toolbar=no, scrollbars=yes"),!1'><i class="fab fa-reddit-alien text-primary-darker social-icon" aria-hidden=true></i></a></div></div><p><strong>UPDATED April 2024</strong></p><p>The USGS Geo Data Portal (GDP) and THREDDS Data Server have provided access to numerous datasets, including gridded data for climate and land use. Datasets can be subsetted or summarized before download using several algorithms, and these algorithms can also be applied to other datasets hosted elsewhere.</p><p>The system has been hosted via <code>cida.usgs.gov</code> since its original release in 2011. See this report for more information on GDP: Blodgett, David L., Nathaniel L. Booth, Thomas C. Kunicki, Jordan I. Walker, and Roland J. Viger. Description and testing of the Geo Data Portal: Data integration framework and Web processing services for environmental science collaboration. <a href=https://pubs.usgs.gov/of/2011/1157/>No. 2011-1157. US Geological Survey, 2011.</a></p><p><em>As of April 2024, most of the datasets the GDP supports are no longer accessible. See the THREDDS Data Server section below for more information.</em></p><p>All components of the GDP were migrated to a new hosting environment in 2022. Due to a lack of resources to maintain the software, the GDP will be retired in Summer 2024. It will be replaced by analysis ready cloud optimized direct data access via methods <a href=https://water.usgs.gov/catalog/usecases/71a9ec77-a83f-4f14-92eb-d7c3266078ce/>(such as those described here)</a> and an in development processing service based on the <a href=https://code.usgs.gov/wma/nhgf/toolsteam/gdptools>gdptools</a> python package.</p><h1 id=thredds-data-server>THREDDS Data Server</h1><p>The GDP THREDDS Data Server (<a href=https://cida.usgs.gov/thredds/>https://cida.usgs.gov/thredds/</a>) was retired due to a lack of resources to remedy a security vulnerability in April 2024. We apologize for the abrupt retirement of the system. Research and development aiming to migrate THREDDS to a cloud-based infrastructure in 2022-2023 led to the conclusion that migration away from the THREDDS data server toward cloud optimized analysis ready data access methods was necessary. This work is nearing completion and all data that were available are or will soon be available in zarr format via a freely available object store. Information regarding how to <a href=https://water.usgs.gov/catalog/usecases/8df9f64f-0f38-4849-9c6f-3d931fd2b2ba/>access the object store can be found here</a>. A Spatio Temporal Asset Catalog will be released soon to aid discovery of these datasets and OPeNDAP access (as was provided by THREDDS) to the datasets should be available again soon.</p><p>To keep up with development on STAC, see <a href=https://code.usgs.gov/wma/nhgf/stac>this repository</a>.</p><p>In the coming months, new APIs and processing capabilities will become available via api.water.usgs.gov to replace the Geo Data Portal. Stay tuned for more user friendly APIs, more cloud-ready data access options, and a generally refined ecosystem of data, services and tools. No release date is set, but please check back here for more information or reach out to <a href=mailto:dblodgett@usgs.gov>dblodgett@usgs.gov</a> with questions.</p><div class="grid-row border-y display-flex flex-align-center padding-y-1"><div class="display-flex flex-12"><div class=taxo-categories><h3 class=margin-y-0>Categories:</h3><ul class="usa-list usa-list--unstyled margin-right-1"><li class="display-inline-block margin-right-05"><a class="usa-tag text-no-underline" href=https://waterdata.usgs.gov/blog/categories/news/ data-taxonomy-term=news><span>News</span></a></li></ul></div><div class=taxo-keywords><h3 class=margin-y-0>Keywords:</h3><ul class="usa-list usa-list--unstyled margin-right-1"><li class="display-inline-block margin-right-05"><a class="usa-tag text-no-underline" href=https://waterdata.usgs.gov/blog/keywords/geoprocessing/ data-taxonomy-term=geoprocessing><span>Geoprocessing</span></a></li><li class="display-inline-block margin-right-05"><a class="usa-tag text-no-underline" href=https://waterdata.usgs.gov/blog/keywords/geo-data-portal/ data-taxonomy-term=geo-data-portal><span>Geo Data Portal</span></a></li><li class="display-inline-block margin-right-05"><a class="usa-tag text-no-underline" href=https://waterdata.usgs.gov/blog/keywords/thredds/ data-taxonomy-term=thredds><span>THREDDS</span></a></li></ul></div><div class=taxo-tags><h3 class=margin-y-0>Tags:</h3><ul class="usa-list usa-list--unstyled margin-right-1"><li class="display-inline-block margin-right-05"><a class="usa-tag text-no-underline" href=https://waterdata.usgs.gov/blog/tags/cloud-transition/ data-taxonomy-term=cloud-transition><span>cloud-transition</span></a></li></ul></div></div></div><div class="grid-row flex-justify-end flex-align-center"><h3 class=margin-right-1>Share:</h3><a href="http://www.facebook.com/sharer.php?src=bm&u=https%3a%2f%2fwaterdata.usgs.gov%2fblog%2fgdp-moving%2f&t=USGS%20Geo%20Data%20Portal%20and%20THREDDS%20Data%20Server%20Retirement" class="text-no-underline margin-right-1" onclick='return window.open(this.href,"PCwindow","width=550, height=350, menubar=no, toolbar=no, scrollbars=yes"),!1'><i class="fab fa-facebook text-primary-darker social-icon" aria-hidden=true></i></a><a href="https://twitter.com/intent/tweet?url=https%3a%2f%2fwaterdata.usgs.gov%2fblog%2fgdp-moving%2f&text=USGS%20Geo%20Data%20Portal%20and%20THREDDS%20Data%20Server%20Retirement&tw_p=tweetbutton" class="text-no-underline margin-right-1" rel=nofollow target=_blank><i class="fab fa-twitter text-primary-darker social-icon" aria-hidden=true></i></a><a href="https://www.reddit.com/submit?url=https%3a%2f%2fwaterdata.usgs.gov%2fblog%2fgdp-moving%2f&title=USGS%20Geo%20Data%20Portal%20and%20THREDDS%20Data%20Server%20Retirement" class=text-no-underline onclick='return window.open(this.href,"PCwindow","width=550, height=350, menubar=no, toolbar=no, scrollbars=yes"),!1'><i class="fab fa-reddit-alien text-primary-darker social-icon" aria-hidden=true></i></a></div></div></main></div><footer class="usa-footer usa-footer--slim" role=contentinfo><nav class=usgs-footer-container aria-label="Footer Navigation"><div class=usgs-footer-nav><a class=usgs-footer-link href=https://www.doi.gov/privacy>DOI Privacy Policy</a><span>|</span><a class=usgs-footer-link href=https://www.usgs.gov/laws/policies_notices.html>Legal</a><span>|</span><a class=usgs-footer-link href=https://www2.usgs.gov/laws/accessibility.html>Accessibility</a><span>|</span><a class=usgs-footer-link href=https://www.usgs.gov/sitemap.html>Site Map</a><span>|</span><a class=usgs-footer-link href=https://answers.usgs.gov/>Contact USGS</a><div class=social-media-links><span>Follow</span><a href=https://twitter.com/usgs class=text-no-underline title="USGS Twitter" target=_blank rel=noopener><svg class="usa-icon usa-icon--size-3" aria-label="USGS Twitter" role="img"><use xlink:href="/blog/wdfn-viz/img/sprite.svg#twitter"/></svg></a><a href=http://facebook.com/usgeologicalsurvey class=text-no-underline title="USGS Facebook" target=_blank rel=noopener><svg class="usa-icon usa-icon--size-3" aria-label="USGS Facebook" role="img"><use xlink:href="/blog/wdfn-viz/img/sprite.svg#facebook"/></svg></a><a href=http://github.com/usgs class=text-no-underline title="USGS Github" target=_blank rel=noopener><svg class="usa-icon usa-icon--size-3" aria-label="USGS Github" role="img"><use xlink:href="/blog/wdfn-viz/img/sprite.svg#github"/></svg></a><a href=http://flickr.com/usgeologicalsurvey class=text-no-underline title="USGS Flickr" target=_blank rel=noopener><svg class="usa-icon usa-icon--size-3" aria-label="USGS Flickr" role="img"><use xlink:href="/blog/wdfn-viz/img/sprite.svg#flickr"/></svg></a><a href=http://youtube.com/usgs class=text-no-underline title="USGS You Tube" target=_blank rel=noopener><svg class="usa-icon usa-icon--size-3" aria-label="USGS You Tube" role="img"><use xlink:href="/blog/wdfn-viz/img/sprite.svg#youtube"/></svg></a><a href=http://instagram.com/usgs class=text-no-underline title="USGS Instagram" target=_blank rel=noopener><svg class="usa-icon usa-icon--size-3" aria-label="USGS Instagram" role="img"><use xlink:href="/blog/wdfn-viz/img/sprite.svg#instagram"/></svg></a></div></div><div class=usgs-footer-nav><a class=usgs-footer-link href=https://www.doi.gov/>U.S. Department of the Interior</a><span>|</span><a class=usgs-footer-link href=https://www.doioig.gov/>DOI Inspector General</a><span>|</span><a class=usgs-footer-link href=https://www.whitehouse.gov/>White House</a><span>|</span><a class=usgs-footer-link href=https://www.whitehouse.gov/omb/management/egov/>E-gov</a><span>|</span><a class=usgs-footer-link href=https://www.doi.gov/pmb/eeo/no-fear-act>No Fear Act</a><span>|</span><a class=usgs-footer-link href=https://www2.usgs.gov/foia>FOIA</a></div></nav></footer><a id=back-to-top class="scroll-top scroll-top-link"><i class="fa fa-arrow-circle-up text-sub"></i></a><script src=https://cdn.jsdelivr.net/npm/mermaid@8.13.4/dist/mermaid.min.js integrity="sha512-JERecFUBbsm75UpkVheAuDOE8NdHjQBrPACfEQYPwvPG+fjgCpHAz1Jw2ci9EXmd3DdfiWth3O3CQvcfEg8gsA==" crossorigin=anonymous></script><style>.markmap>svg{width:100%;height:300px}</style><script>window.markmap={autoLoader:{manual:!0}}</script><script src=https://cdn.jsdelivr.net/npm/markmap-autoloader></script><script src=https://waterdata.usgs.gov/blog/js/tabpane-persist.js></script><script src=/blog/js/deflate.js></script><link rel=stylesheet href=https://cdn.jsdelivr.net/npm/katex@0.15.1/dist/katex.min.css integrity="sha512-vJqxkZ+Sugf/6WRlpcxN01qVfX/29hF6qc33eHF1va3NgoV+U+wCi+uTAsQ10sDoGyBxHLdaHvGwDlV3yVYboA==" crossorigin=anonymous><script defer src=https://cdn.jsdelivr.net/npm/katex@0.15.1/dist/katex.min.js integrity="sha512-5ufNcHqOYgilGEHPfuRIQ5B/vDS1M8+UC+DESZ5CwVgGTg+b2Ol/15rYL/GiCWJ/Sx8oVo0FPFok1dPk8U9INQ==" crossorigin=anonymous></script><script defer src=https://cdn.jsdelivr.net/npm/katex@0.15.1/dist/contrib/mhchem.min.js integrity="sha512-HWb6LyQhO6UkmYLjdSblpgiOvvbdkoMRjln0POPhOVbZu3l4QdqwZnMJ/cuwKScU5pWARejB495TAAAz0WNsXQ==" crossorigin=anonymous></script><script defer src=https://cdn.jsdelivr.net/npm/katex@0.15.1/dist/contrib/auto-render.min.js integrity='sha512-ZA/RPrAo88DlwRnnoNVqKINnQNcWERzRK03PDaA4GIJiVZvGFIWQbdWCsUebMZfkWohnfngsDjXzU6PokO4jGw==' crossorigin=anonymous onload=renderMathInElement(document.body,null)></script><script src=/blog/js/main.min.92bb1db09a8caf94ac434942c94d211cc6978a107f2ecbe7b2c13f83839feaf4.js integrity="sha256-krsdsJqMr5SsQ0lCyU0hHMaXihB/LsvnssE/g4Of6vQ=" crossorigin=anonymous></script><script src=/blog/js/prism.js></script><script src=/blog/wdfn-viz/wdfnviz.js></script></body></html>

Error in open.nc(meta.obj$url) : 
  NetCDF: Malformed or inaccessible DAP2 DDS or DAP4 DMR response

Session Information

R version 4.3.3 (2024-02-29 ucrt)
Platform: x86_64-w64-mingw32/x64 (64-bit)
Running under: Windows 10 x64 (build 19045)

Matrix products: default

locale:
[1] LC_COLLATE=English_United States.utf8  LC_CTYPE=English_United States.utf8    LC_MONETARY=English_United States.utf8
[4] LC_NUMERIC=C                           LC_TIME=English_United States.utf8    

time zone: America/Los_Angeles
tzcode source: internal

attached base packages:
[1] stats     graphics  grDevices datasets  utils     methods   base     

other attached packages:
 [1] nwmTools_0.0.4       nhdplusTools_1.0.0   dataRetrieval_2.7.15 AOI_0.3.0            lubridate_1.9.3      forcats_1.0.0       
 [7] stringr_1.5.1        dplyr_1.1.4          purrr_1.0.2          readr_2.1.5          tidyr_1.3.1          tibble_3.2.1        
[13] ggplot2_3.5.1        tidyverse_2.0.0      scales_1.3.0        

loaded via a namespace (and not attached):
 [1] gtable_0.3.5        lattice_0.22-5      tzdb_0.4.0          vctrs_0.6.5         tools_4.3.3         generics_0.1.3     
 [7] curl_5.2.1          parallel_4.3.3      proxy_0.4-27        fansi_1.0.6         pkgconfig_2.0.3     Matrix_1.6-5       
[13] KernSmooth_2.23-22  data.table_1.15.4   assertthat_0.2.1    lifecycle_1.0.4     compiler_4.3.3      munsell_0.5.1      
[19] terra_1.7-71        codetools_0.2-19    fst_0.9.8           class_7.3-22        yaml_2.3.8          pillar_1.9.0       
[25] classInt_0.4-10     hydroloom_1.0.2     RNetCDF_2.9-2       tidyselect_1.2.1    rvest_1.0.4         zip_2.3.1          
[31] stringi_1.8.3       tidygeocoder_1.0.5  sf_1.0-16           arrow_15.0.1        rnaturalearth_1.0.1 fastmap_1.1.1      
[37] grid_4.3.3          colorspace_2.1-0    cli_3.6.2           magrittr_2.0.3      utf8_1.2.4          e1071_1.7-14       
[43] withr_3.0.0         bit64_4.0.5         timechange_0.3.0    httr_1.4.7          bit_4.0.5           reticulate_1.36.1  
[49] RANN_2.6.1          hms_1.1.3           png_0.1-8           fstcore_0.9.18      pbapply_1.7-2       rcartocolor_2.1.1  
[55] rlang_1.1.3         Rcpp_1.0.12         glue_1.7.0          DBI_1.2.2           xml2_1.3.6          renv_1.0.7         
[61] rstudioapi_0.16.0   jsonlite_1.8.8      R6_2.5.1            fipio_1.1.2         units_0.8-5  
mikejohnson51 commented 4 months ago

Hi @tungttnguyen! Thanks for reaching out. Unfortunately the USGS CIDA server was hacked and is not expected to be restored :/ That puts us in a bit of a struggle until the OSN system is back up. I can help get you access to 1.2 and 2.0 but we lost 2.1 temporarily. Are you interested?

tungttnguyen commented 4 months ago

Hi @tungttnguyen! Thanks for reaching out. Unfortunately the USGS CIDA server was hacked and is not expected to be restored :/ That puts us in a bit of a struggle until the OSN system is back up. I can help get you access to 1.2 and 2.0 but we lost 2.1 temporarily. Are you interested?

Yes please. Thanks Mike!

csimeone-usgs commented 4 months ago

@mikejohnson51, if its not too much trouble, would it be possible for me to get access to versions 1.2 and 2.0 as well? Thank for your help!

mikejohnson51 commented 4 months ago

Certainly! I will get this set this week and update you both when its done.

lindsayplatt commented 3 months ago

Hello! I am also looking for this fix. I was just trying with version = 2.0 and version = 1.2 but both failed. I am using nwmTools v0.0.4.

library(nwmTools)
nwm_output <- readNWMdata(comid = 6078267, 
                          startDate = "1993-01-01",
                          endDate = "2017-12-31",
                          version = 1.2)
syntax error, unexpected WORD_WORD, expecting SCAN_ATTR or SCAN_DATASET or SCAN_ERROR
context: <!doctype^ html><html itemscope itemtype=http://schema.org/WebPage lang=en class=no-js><head><meta charset=utf-8><meta name=viewport content="width=device-width,initial-scale=1,shrink-to-fit=no"><meta name=generator content="Hugo 0.111.3"><link rel="shortcut icon" href=/blog/favicons/favicon.ico><title>USGS Geo Data Portal and THREDDS Data Server Retirement | Water Data For The Nation Blog</title><meta property="og:title" content="USGS Geo Data Portal and THREDDS Data Server Retirement"><meta property="og:description" content="The GDP web interface, processing service, and THREDDS data server are being retired."><meta property="og:type" content="article"><meta property="og:url" content="https://waterdata.usgs.gov/blog/gdp-moving/"><meta property="article:section" content><meta property="article:published_time" content="2024-04-10T00:00:00+00:00"><meta property="article:modified_time" content="2024-04-23T15:19:19-07:00"><meta itemprop=name content="USGS Geo Data Portal and THREDDS Data Server Retirement"><meta itemprop=description content="The GDP web interface, processing service, and THREDDS data server are being retired."><meta itemprop=datePublished content="2024-04-10T00:00:00+00:00"><meta itemprop=dateModified content="2024-04-23T15:19:19-07:00"><meta itemprop=wordCount content="410"><meta itemprop=keywords content="cloud-transition,"><meta name=twitter:card content="summary"><meta name=twitter:title content="USGS Geo Data Portal and THREDDS Data Server Retirement"><meta name=twitter:description content="The GDP web interface, processing service, and THREDDS data server are being retired."><link rel=preload href=/blog/scss/main.min.a50c6c9b533b99783624948c3928413a3770d9d03cd912e10894831189cfebcd.css as=style><link href=/blog/scss/main.min.a50c6c9b533b99783624948c3928413a3770d9d03cd912e10894831189cfebcd.css rel=stylesheet integrity><script src=https://code.jquery.com/jquery-3.6.0.min.js integrity=sha384-vtXRMe3mGCbOeY7l30aIg8H9p3GdeSe4IFlP6G8JMa7o7lXvnz3GFKzPxzJdPfGK crossorigin=anonymous></script><script src=/blog/wdfn-viz/uswds-init.min.js></script><link rel=stylesheet href=/blog/css/prism.css><link rel=stylesheet href=/blog/wdfn-viz/wdfnviz-all.css><script>(function(e,t,n,s,o){e[s]=e[s]||[],e[s].push({"gtm.start":(new Date).getTime(),event:"gtm.js"});var a=t.getElementsByTagName(n)[0],i=t.createElement(n),r=s!="dataLayer"?"&l="+s:"";i.async=!0,i.src="https://www.googletagmanager.com/gtm.js?id="+o+r,a.parentNode.insertBefore(i,a)})(window,document,"script","dataLayer","GTM-TTF8M2Z")</script><script type=application/javascript>var doNotTrack=!1;doNotTrack||(function(e,t,n,s,o,i,a){e.GoogleAnalyticsObject=o,e[o]=e[o]||function(){(e[o].q=e[o].q||[]).push(arguments)},e[o].l=1*new Date,i=t.createElement(n),a=t.getElementsByTagName(n)[0],i.async=1,i.src=s,a.parentNode.insertBefore(i,a)}(window,document,"script","https://www.google-analytics.com/analytics.js","ga"),ga("create","UA-25350863-1","auto"),ga("send","pageview"),ga("require","outboundLinkTracker"),ga("require","eventTracker"))</script><script type=application/javascript src=https://www2.usgs.gov/scripts/analytics/usgs-analytics.js></script></head><body class="post page"><noscript><iframe src="//www.googletagmanager.com/ns.html?id=GTM-TTF8M2Z" height=0 width=0 style=display:none;visibility:hidden></iframe></noscript><section class=usa-banner aria-label="Official website of the United States government"><div class=usa-accordion><header class=usa-banner__header><div class=usa-banner__inner><div class=grid-col-auto><img class=usa-banner__header-flag aria-hidden=true src=/blog/wdfn-viz/img/us_flag_small.png alt="U.S. flag"></div><div class="grid-col-fill tablet:grid-col-auto" aria-hidden=true><p class=usa-banner__header-text>An official website of the United States government</p><p class=usa-banner__header-action>Here’s how you know</p></div><button class="usa-accordion__button usa-banner__button" aria-expanded=false aria-controls=gov-banner><span class=usa-banner__button-text>Here’s how you know</span></button></div></header><div class="usa-banner__content usa-accordion__content" id=gov-banner><div class="grid-row grid-gap-lg"><div class="usa-banner__guidance tablet:grid-col-6"><img class="usa-banner__icon usa-media-block__img" src=/blog/wdfn-viz/img/icon-dot-gov.svg alt="Dot gov"><div class=usa-media-block__body><p><strong>Official websites use .gov</strong><br>A <strong>.gov</strong> website belongs to an official government organization in theUnited States.</p></div></div><div class="usa-banner__guidance tablet:grid-col-6"><img class="usa-banner__icon usa-media-block__img" src=/blog/wdfn-viz/img/icon-https.svg alt=Https><div class=usa-media-block__body><p><strong>Secure .gov websites use HTTPS</strong><br>A <strong>lock</strong> (<span class=icon-lock><svg xmlns="http://www.w3.org/2000/svg" width="52" height="64" viewBox="0 0 52 64" class="usa-banner__lock-image" role="img" aria-labelledby="banner-lock-description"><title id="banner-lock-title">Lock</title><desc id="banner-lock-description">Locked padlock</desc><path fill="#000" fill-rule="evenodd" d="M26 0c10.493.0 19 8.507 19 19v9h3a4 4 0 014 4v28a4 4 0 01-4 4H4a4 4 0 01-4-4V32a4 4 0 014-4h3v-9C7 8.507 15.507.0 26 0zm0 8c-5.979.0-10.843 4.77-10.996 10.712L15 19v9h22v-9c0-6.075-4.925-11-11-11z"/></svg></span>) or <strong>https://</strong> means you’ve safely connected to the .gov website. Sharesensitive information only on official, secure websites.</p></div></div></div></div></div></section><div class=usa-overlay></div><header class="usa-header usa-header--extended usgs-header" role=banner><a class=usa-skipnav href=#main-content>Skip to main content</a><div class=usgs-header-container><div class=usa-navbar><div class=usa-logo id=extended-logo><a href=https://www.usgs.gov><img alt="USGS Home" src=/blog/wdfn-viz/img/USGS_logo.svg></a></div><button class=usa-menu-btn>Menu</button></div></div><nav role=navigation class=usa-nav><div class=usa-nav__inner><button class=usa-nav__close><img src=/blog/wdfn-viz/img/usa-icons/close.svg alt=close></button><ul class="usa-nav__primary usa-accordion"><li class=usa-nav__primary-item><a class=usa-nav__link href=https://waterdata.usgs.gov/blog/>Water Data For The Nation Blog</a></li><li class=usa-nav__primary-item><a class=usa-nav__link href=/blog/introduction><span>About</span></a></li><li class=usa-nav__primary-item><button class="usa-accordion__button usa-nav__link" aria-expanded=false aria-controls=section-categories><span>Categories</span></button><ul id=section-categories class=usa-nav__submenu><li class=usa-nav__submenu-item><a href=https://waterdata.usgs.gov/blog/categories/water-information>water-information</a></li><li class=usa-nav__submenu-item><a href=https://waterdata.usgs.gov/blog/categories/data-science>data-science</a></li><li class=usa-nav__submenu-item><a href=https://waterdata.usgs.gov/blog/categories/web-communication>web-communication</a></li><li class=usa-nav__submenu-item><a href=https://waterdata.usgs.gov/blog/categories/applications>applications</a></li><li class=usa-nav__submenu-item><a href=https://waterdata.usgs.gov/blog/categories/news>news</a></li><li class=usa-nav__submenu-item><a href=https://waterdata.usgs.gov/blog/categories/software-development>software-development</a></li><li class=usa-nav__submenu-item><a href=https://waterdata.usgs.gov/blog/categories/data-visualization>data-visualization</a></li><li class=usa-nav__submenu-item><a href=https://waterdata.usgs.gov/blog/categories/events>events</a></li><li class=usa-nav__submenu-item><a href=https://waterdata.usgs.gov/blog/categories/analytics>analytics</a></li><li class=usa-nav__submenu-item><a href=https://waterdata.usgs.gov/blog/categories/api>api</a></li></ul></li><li class=usa-nav__primary-item><button class="usa-accordion__button usa-nav__link" aria-expanded=false aria-controls=section-keywords><span>Keywords</span></button><ul id=section-keywords class=usa-nav__submenu><li class=usa-nav__submenu-item><a href=https://waterdata.usgs.gov/blog/keywords/data>data</a></li><li class=usa-nav__submenu-item><a href=https://waterdata.usgs.gov/blog/keywords/r>r</a></li><li class=usa-nav__submenu-item><a href=https://waterdata.usgs.gov/blog/keywords/water>water</a></li><li class=usa-nav__submenu-item><a href=https://waterdata.usgs.gov/blog/keywords/water-information>water-information</a></li><li class=usa-nav__submenu-item><a href=https://waterdata.usgs.gov/blog/keywords/water-data>water-data</a></li><li class=usa-nav__submenu-item><a href=https://waterdata.usgs.gov/blog/keywords/data-science>data-science</a></li><li class=usa-nav__submenu-item><a href=https://waterdata.usgs.gov/blog/keywords/generation>generation</a></li><li class=usa-nav__submenu-item><a href=https://waterdata.usgs.gov/blog/keywords/next>next</a></li><li class=usa-nav__submenu-item><a href=https://waterdata.usgs.gov/blog/keywords/data-visualization>data-visualization</a></li><li class=usa-nav__submenu-item><a href=https://waterdata.usgs.gov/blog/keywords/update>update</a></li></ul></li><li class=usa-nav__primary-item><button class="usa-accordion__button usa-nav__link" aria-expanded=false aria-controls=section-tags><span>Tags</span></button><ul id=section-tags class=usa-nav__submenu><li class=usa-nav__submenu-item><a href=https://waterdata.usgs.gov/blog/tags/water-data-for-the-nation>water-data-for-the-nation</a></li><li class=usa-nav__submenu-item><a href=https://waterdata.usgs.gov/blog/tags/public-communication>public-communication</a></li><li class=usa-nav__submenu-item><a href=https://waterdata.usgs.gov/blog/tags/r>r</a></li><li class=usa-nav__submenu-item><a href=https://waterdata.usgs.gov/blog/tags/water-data>water-data</a></li><li class=usa-nav__submenu-item><a href=https://waterdata.usgs.gov/blog/tags/nextgen>nextgen</a></li><li class=usa-nav__submenu-item><a href=https://waterdata.usgs.gov/blog/tags/monitoring-location-pages>monitoring-location-pages</a></li><li class=usa-nav__submenu-item><a href=https://waterdata.usgs.gov/blog/tags/data-science>data-science</a></li><li class=usa-nav__submenu-item><a href=https://waterdata.usgs.gov/blog/tags/news>news</a></li><li class=usa-nav__submenu-item><a href=https://waterdata.usgs.gov/blog/tags/dataretrieval>dataretrieval</a></li><li class=usa-nav__submenu-item><a href=https://waterdata.usgs.gov/blog/tags/hiring>hiring</a></li></ul></li></ul><div class=usa-nav__secondary><form action=/blog/search method=get data-search-index=https://waterdata.usgs.gov/blog/index.json class="usa-search usa-search--small margin-bottom-1" role=search><label class=usa-sr-only for=search-query>Search NOW</label><input class=usa-input id=search-query type=search name=q><button class=usa-button type=submit><img src=/blog/wdfn-viz/img/usa-icons-bg/search--white.svg class=usa-search__submit-icon alt=Search></button></form><ul class=usa-nav__secondary-links><li class=usa-nav__secondary-item><a class=usa-link href=https://dashboard.waterdata.usgs.gov/ target=_blank>Water Dashboard</a><li class=usa-nav__secondary-item><a class=usa-link href=https://www.usgs.gov/mission-areas/water-resources target=_blank>Water Resources</a></li></ul></div></div></nav></header><div class=grid-col-fill><main id=main-content role=main class=main-content><article class="single grid-container-desktop"><h1 class="text-ls-neg-2 padding-bottom-0 margin-bottom-0">USGS Geo Data Portal and THREDDS Data Server Retirement</h1><h3 class=text-normal>The GDP web interface, processing service, and THREDDS data server are being retired.</h3><div class="grid-row display-flex flex-justify border-y padding-y-1"><div><span class="display-block text-uppercase">Date Posted</span><span class=text-bold>April 10, 2024</span><span class="display-block text-uppercase margin-top-1">Last Updated</span><span class=text-bold>April 23, 2024</span></div><div><span class="display-block text-uppercase">Author</span><span class=text-bold>David Blodgett</span><br><a href=mailto:dblodgett@usgs.gov class=text-no-underline target=blank><i class="fas fa-envelope-square text-primary-darker social-icon"></i></a><a href=https://github.com/dblodgett-usgs class=text-no-underline target=blank><i class="fab fa-github-square text-primary-darker social-icon"></i></a><a href=https://twitter.com/D_Blodgett class=text-no-underline target=blank><i class="fab fa-twitter-square text-primary-darker social-icon"></i></a><a href=https://www.usgs.gov/staff-profiles/david-l-blodgett class=text-no-underline target=blank><i class="fas fa-user text-primary-darker social-icon"></i></a></div><div><span class="display-block text-uppercase">Reading Time</span><span class=text-bold>2 minutes</span><span class="display-block text-uppercase margin-top-1">Share</span><a href="http://www.facebook.com/sharer.php?src=bm&u=https%3a%2f%2fwaterdata.usgs.gov%2fblog%2fgdp-moving%2f&t=USGS%20Geo%20Data%20Portal%20and%20THREDDS%20Data%20Server%20Retirement" class="text-no-underline margin-right-1" onclick='return window.open(this.href,"PCwindow","width=550, height=350, menubar=no, toolbar=no, scrollbars=yes"),!1'><i class="fab fa-facebook text-primary-darker social-icon" aria-hidden=true></i></a><a href="https://twitter.com/intent/tweet?url=https%3a%2f%2fwaterdata.usgs.gov%2fblog%2fgdp-moving%2f&text=USGS%20Geo%20Data%20Portal%20and%20THREDDS%20Data%20Server%20Retirement&tw_p=tweetbutton" class="text-no-underline margin-right-1" rel=nofollow target=_blank><i class="fab fa-twitter text-primary-darker social-icon" aria-hidden=true></i></a><a href="https://www.reddit.com/submit?url=https%3a%2f%2fwaterdata.usgs.gov%2fblog%2fgdp-moving%2f&title=USGS%20Geo%20Data%20Portal%20and%20THREDDS%20Data%20Server%20Retirement" class=text-no-underline onclick='return window.open(this.href,"PCwindow","width=550, height=350, menubar=no, toolbar=no, scrollbars=yes"),!1'><i class="fab fa-reddit-alien text-primary-darker social-icon" aria-hidden=true></i></a></div></div><p><strong>UPDATED April 2024</strong></p><p>The USGS Geo Data Portal (GDP) and THREDDS Data Server have provided access to numerous datasets, including gridded data for climate and land use. Datasets can be subsetted or summarized before download using several algorithms, and these algorithms can also be applied to other datasets hosted elsewhere.</p><p>The system has been hosted via <code>cida.usgs.gov</code> since its original release in 2011. See this report for more information on GDP: Blodgett, David L., Nathaniel L. Booth, Thomas C. Kunicki, Jordan I. Walker, and Roland J. Viger. Description and testing of the Geo Data Portal: Data integration framework and Web processing services for environmental science collaboration. <a href=https://pubs.usgs.gov/of/2011/1157/>No. 2011-1157. US Geological Survey, 2011.</a></p><p><em>As of April 2024, most of the datasets the GDP supports are no longer accessible. See the THREDDS Data Server section below for more information.</em></p><p>All components of the GDP were migrated to a new hosting environment in 2022. Due to a lack of resources to maintain the software, the GDP will be retired in Summer 2024. It will be replaced by analysis ready cloud optimized direct data access via methods <a href=https://water.usgs.gov/catalog/usecases/71a9ec77-a83f-4f14-92eb-d7c3266078ce/>(such as those described here)</a> and an in development processing service based on the <a href=https://code.usgs.gov/wma/nhgf/toolsteam/gdptools>gdptools</a> python package.</p><h1 id=thredds-data-server>THREDDS Data Server</h1><p>The GDP THREDDS Data Server (<a href=https://cida.usgs.gov/thredds/>https://cida.usgs.gov/thredds/</a>) was retired due to a lack of resources to remedy a security vulnerability in April 2024. We apologize for the abrupt retirement of the system. Research and development aiming to migrate THREDDS to a cloud-based infrastructure in 2022-2023 led to the conclusion that migration away from the THREDDS data server toward cloud optimized analysis ready data access methods was necessary. This work is nearing completion and all data that were available are or will soon be available in zarr format via a freely available object store. Information regarding how to <a href=https://water.usgs.gov/catalog/usecases/8df9f64f-0f38-4849-9c6f-3d931fd2b2ba/>access the object store can be found here</a>. A Spatio Temporal Asset Catalog will be released soon to aid discovery of these datasets and OPeNDAP access (as was provided by THREDDS) to the datasets should be available again soon.</p><p>To keep up with development on STAC, see <a href=https://code.usgs.gov/wma/nhgf/stac>this repository</a>.</p><p>In the coming months, new APIs and processing capabilities will become available via api.water.usgs.gov to replace the Geo Data Portal. Stay tuned for more user friendly APIs, more cloud-ready data access options, and a generally refined ecosystem of data, services and tools. No release date is set, but please check back here for more information or reach out to <a href=mailto:dblodgett@usgs.gov>dblodgett@usgs.gov</a> with questions.</p><div class="grid-row border-y display-flex flex-align-center padding-y-1"><div class="display-flex flex-12"><div class=taxo-categories><h3 class=margin-y-0>Categories:</h3><ul class="usa-list usa-list--unstyled margin-right-1"><li class="display-inline-block margin-right-05"><a class="usa-tag text-no-underline" href=https://waterdata.usgs.gov/blog/categories/news/ data-taxonomy-term=news><span>News</span></a></li></ul></div><div class=taxo-keywords><h3 class=margin-y-0>Keywords:</h3><ul class="usa-list usa-list--unstyled margin-right-1"><li class="display-inline-block margin-right-05"><a class="usa-tag text-no-underline" href=https://waterdata.usgs.gov/blog/keywords/geoprocessing/ data-taxonomy-term=geoprocessing><span>Geoprocessing</span></a></li><li class="display-inline-block margin-right-05"><a class="usa-tag text-no-underline" href=https://waterdata.usgs.gov/blog/keywords/geo-data-portal/ data-taxonomy-term=geo-data-portal><span>Geo Data Portal</span></a></li><li class="display-inline-block margin-right-05"><a class="usa-tag text-no-underline" href=https://waterdata.usgs.gov/blog/keywords/thredds/ data-taxonomy-term=thredds><span>THREDDS</span></a></li></ul></div><div class=taxo-tags><h3 class=margin-y-0>Tags:</h3><ul class="usa-list usa-list--unstyled margin-right-1"><li class="display-inline-block margin-right-05"><a class="usa-tag text-no-underline" href=https://waterdata.usgs.gov/blog/tags/cloud-transition/ data-taxonomy-term=cloud-transition><span>cloud-transition</span></a></li></ul></div></div></div><div class="grid-row flex-justify-end flex-align-center"><h3 class=margin-right-1>Share:</h3><a href="http://www.facebook.com/sharer.php?src=bm&u=https%3a%2f%2fwaterdata.usgs.gov%2fblog%2fgdp-moving%2f&t=USGS%20Geo%20Data%20Portal%20and%20THREDDS%20Data%20Server%20Retirement" class="text-no-underline margin-right-1" onclick='return window.open(this.href,"PCwindow","width=550, height=350, menubar=no, toolbar=no, scrollbars=yes"),!1'><i class="fab fa-facebook text-primary-darker social-icon" aria-hidden=true></i></a><a href="https://twitter.com/intent/tweet?url=https%3a%2f%2fwaterdata.usgs.gov%2fblog%2fgdp-moving%2f&text=USGS%20Geo%20Data%20Portal%20and%20THREDDS%20Data%20Server%20Retirement&tw_p=tweetbutton" class="text-no-underline margin-right-1" rel=nofollow target=_blank><i class="fab fa-twitter text-primary-darker social-icon" aria-hidden=true></i></a><a href="https://www.reddit.com/submit?url=https%3a%2f%2fwaterdata.usgs.gov%2fblog%2fgdp-moving%2f&title=USGS%20Geo%20Data%20Portal%20and%20THREDDS%20Data%20Server%20Retirement" class=text-no-underline onclick='return window.open(this.href,"PCwindow","width=550, height=350, menubar=no, toolbar=no, scrollbars=yes"),!1'><i class="fab fa-reddit-alien text-primary-darker social-icon" aria-hidden=true></i></a></div></div></main></div><footer class="usa-footer usa-footer--slim" role=contentinfo><nav class=usgs-footer-container aria-label="Footer Navigation"><div class=usgs-footer-nav><a class=usgs-footer-link href=https://www.doi.gov/privacy>DOI Privacy Policy</a><span>|</span><a class=usgs-footer-link href=https://www.usgs.gov/laws/policies_notices.html>Legal</a><span>|</span><a class=usgs-footer-link href=https://www2.usgs.gov/laws/accessibility.html>Accessibility</a><span>|</span><a class=usgs-footer-link href=https://www.usgs.gov/sitemap.html>Site Map</a><span>|</span><a class=usgs-footer-link href=https://answers.usgs.gov/>Contact USGS</a><div class=social-media-links><span>Follow</span><a href=https://twitter.com/usgs class=text-no-underline title="USGS Twitter" target=_blank rel=noopener><svg class="usa-icon usa-icon--size-3" aria-label="USGS Twitter" role="img"><use xlink:href="/blog/wdfn-viz/img/sprite.svg#twitter"/></svg></a><a href=http://facebook.com/usgeologicalsurvey class=text-no-underline title="USGS Facebook" target=_blank rel=noopener><svg class="usa-icon usa-icon--size-3" aria-label="USGS Facebook" role="img"><use xlink:href="/blog/wdfn-viz/img/sprite.svg#facebook"/></svg></a><a href=http://github.com/usgs class=text-no-underline title="USGS Github" target=_blank rel=noopener><svg class="usa-icon usa-icon--size-3" aria-label="USGS Github" role="img"><use xlink:href="/blog/wdfn-viz/img/sprite.svg#github"/></svg></a><a href=http://flickr.com/usgeologicalsurvey class=text-no-underline title="USGS Flickr" target=_blank rel=noopener><svg class="usa-icon usa-icon--size-3" aria-label="USGS Flickr" role="img"><use xlink:href="/blog/wdfn-viz/img/sprite.svg#flickr"/></svg></a><a href=http://youtube.com/usgs class=text-no-underline title="USGS You Tube" target=_blank rel=noopener><svg class="usa-icon usa-icon--size-3" aria-label="USGS You Tube" role="img"><use xlink:href="/blog/wdfn-viz/img/sprite.svg#youtube"/></svg></a><a href=http://instagram.com/usgs class=text-no-underline title="USGS Instagram" target=_blank rel=noopener><svg class="usa-icon usa-icon--size-3" aria-label="USGS Instagram" role="img"><use xlink:href="/blog/wdfn-viz/img/sprite.svg#instagram"/></svg></a></div></div><div class=usgs-footer-nav><a class=usgs-footer-link href=https://www.doi.gov/>U.S. Department of the Interior</a><span>|</span><a class=usgs-footer-link href=https://www.doioig.gov/>DOI Inspector General</a><span>|</span><a class=usgs-footer-link href=https://www.whitehouse.gov/>White House</a><span>|</span><a class=usgs-footer-link href=https://www.whitehouse.gov/omb/management/egov/>E-gov</a><span>|</span><a class=usgs-footer-link href=https://www.doi.gov/pmb/eeo/no-fear-act>No Fear Act</a><span>|</span><a class=usgs-footer-link href=https://www2.usgs.gov/foia>FOIA</a></div></nav></footer><a id=back-to-top class="scroll-top scroll-top-link"><i class="fa fa-arrow-circle-up text-sub"></i></a><script src=https://cdn.jsdelivr.net/npm/mermaid@8.13.4/dist/mermaid.min.js integrity="sha512-JERecFUBbsm75UpkVheAuDOE8NdHjQBrPACfEQYPwvPG+fjgCpHAz1Jw2ci9EXmd3DdfiWth3O3CQvcfEg8gsA==" crossorigin=anonymous></script><style>.markmap>svg{width:100%;height:300px}</style><script>window.markmap={autoLoader:{manual:!0}}</script><script src=https://cdn.jsdelivr.net/npm/markmap-autoloader></script><script src=https://waterdata.usgs.gov/blog/js/tabpane-persist.js></script><script src=/blog/js/deflate.js></script><link rel=stylesheet href=https://cdn.jsdelivr.net/npm/katex@0.15.1/dist/katex.min.css integrity="sha512-vJqxkZ+Sugf/6WRlpcxN01qVfX/29hF6qc33eHF1va3NgoV+U+wCi+uTAsQ10sDoGyBxHLdaHvGwDlV3yVYboA==" crossorigin=anonymous><script defer src=https://cdn.jsdelivr.net/npm/katex@0.15.1/dist/katex.min.js integrity="sha512-5ufNcHqOYgilGEHPfuRIQ5B/vDS1M8+UC+DESZ5CwVgGTg+b2Ol/15rYL/GiCWJ/Sx8oVo0FPFok1dPk8U9INQ==" crossorigin=anonymous></script><script defer src=https://cdn.jsdelivr.net/npm/katex@0.15.1/dist/contrib/mhchem.min.js integrity="sha512-HWb6LyQhO6UkmYLjdSblpgiOvvbdkoMRjln0POPhOVbZu3l4QdqwZnMJ/cuwKScU5pWARejB495TAAAz0WNsXQ==" crossorigin=anonymous></script><script defer src=https://cdn.jsdelivr.net/npm/katex@0.15.1/dist/contrib/auto-render.min.js integrity='sha512-ZA/RPrAo88DlwRnnoNVqKINnQNcWERzRK03PDaA4GIJiVZvGFIWQbdWCsUebMZfkWohnfngsDjXzU6PokO4jGw==' crossorigin=anonymous onload=renderMathInElement(document.body,null)></script><script src=/blog/js/main.min.92bb1db09a8caf94ac434942c94d211cc6978a107f2ecbe7b2c13f83839feaf4.js integrity="sha256-krsdsJqMr5SsQ0lCyU0hHMaXihB/LsvnssE/g4Of6vQ=" crossorigin=anonymous></script><script src=/blog/js/prism.js></script><script src=/blog/wdfn-viz/wdfnviz.js></script></body></html>
Error in open.nc(meta.obj$url) : 
  NetCDF: Malformed or inaccessible DAP2 DDS or DAP4 DMR response
RizaJamshidi commented 3 months ago

Hello! I just wanted to follow up and see if there is access to any version of NWM reanalysis data. I tried, but I got the same error.

mmalish commented 3 weeks ago

Hi Mike, Is there a way that I could also get access to 1.2 and 2.0? Thanks for your help!

lindsayplatt commented 3 weeks ago

Just following up on my adventure with accessing NWM data as I needed a solution fairly quickly. I ended up not using nwmTools (though I hope I can switch back to it in the future) and accessed the raw Zarr files from Amazon S3. It was most certainly slower than what I imagine nwmTools could do for me but if you need a solution, this could work for you. Here is my tiny code example.