We’re passionate about Earth Science Data and helping to solve the challenges in that field. At this year’s ESIP Summer Meeting, we have five E84 team members speaking and moderating across six different sessions, with an additional four of us out there to chat and support the event.
Here’s where you can find us if you want to chat!
Cloud Security and Compliance in Public Sector Archives
- When? July 16 @ 10:15 AM – 11:45 AM
- Who? Andrew Pawloski, Patrick Quinn (Moderator)
- What? Panel
- Where? Ballroom A
Increasing user adoption of and applications for cloud technologies as well as exponential growth in data volumes demands our public sector data archives accommodate cloud computing. Simultaneously, government-funded computing environments have constraints that present unique challenges in providing archives in the cloud, including Trusted Internet Connection mandates, funding models and legislation which do not allow unbounded costs, and security policies inherited from a pre-cloud world. Join us to discuss the progress members of the ESIP community have made in overcoming these hurdles toward moving large public sector archives to the cloud for valuable science applications.
https://2019esipsummermeeting.sched.com/event/PtOU
Using Pangeo JupyterHubs to work with large public datasets
- When? July 16 @ 12:45 PM – 2:15 PM
- Who? Andrew Pawloski
- What? Workshop
- Where? Ballroom D
Bring your laptop to this hands-on workshop! Participants will learn about open-source scientific python ecosystem for analytic workflows with big data in Earth Science. Pangeo is first and foremost a community promoting open, reproducible, and scalable science (read more at https://pangeo.io). This community provides documentation, develops and maintains software, and deploys computing infrastructure to make scientific research and programming easier. The Pangeo software ecosystem involves open source tools such as xarray, iris, dask, jupyter, and many other packages. In brief workshop, participants will familiarize themselves with writing code in Jupyter Notebooks that can be run on scalable computing clusters running on the Cloud, bypassing a common bottleneck of downloading ever-increasing volumes of remote sensing or modeling data. We will introduce key Python tools and have participants write simple code to work with large public datasets hosted on Amazon Web Services and Google Cloud.
https://2019esipsummermeeting.sched.com/event/PtOj/using-pangeo-jupyterhubs-to-work-with-large-public-datasets
Toward Better Earth Science UX
- When? July 16 @ 12:45 PM – 2:15 PM
- Who? Mark Reese, Jeff Siarto (Moderator)
- What? Panel
- Where? Ballroom BC
The “order and download” paradigm is dying. NASA and other organizations are moving their data holdings to the cloud and future missions will be producing so much data–petabytes per year in some cases–that the old way of viewing, subsetting, and analyzing this information needs to adapt. As this data grows in size and complexity, it demands more usable, accessible, and thoughtful designs and user interfaces that support science and help researchers answer important questions. This session will focus on how we’re developing better user interfaces that utilize remote sensing data–especially in a cloud environment, and the impact user experience plays on the search, discovery, and analysis of Earth science data.
https://2019esipsummermeeting.sched.com/event/PtOp
Cloud Data Optimization: Emerging Best Practices I
- When? July 16 @ 2:45 PM – 4:15 PM
- Who? Dan Pilone
- What? STAC, sat-utils, and Open Data – Prioritizing Data Use
- Where? Ballroom A
Searching for and using remote sensing data can be difficult and time consuming for scientists and analysts. Different sources of data can have different formats, metadata fields, and ways of searching and accessing the underlying assets. This has led to sets of one-off tools for working with subsets of data rather than an ecosystem of generalized tools. The SpatioTemporal Asset Catalog (STAC) specification is an emerging standard for cataloging geospatial data from different sources and a specification for serving that data in an API. STAC is aimed at improving search and discovery of geospatial data; it is not intended to replace data provider archival metadata. We’ll provide a brief overview of the STAC spec to illustrate its utility for data discovery and integration with cloud-based processing workflows. A summary of the core metadata fields along with some common extensions for EO, SAR, and Point Cloud data will be provided. Finally, a brief tour of the open-source infrastructure available to support STAC will be given, along with information on publicly available catalogs containing open data that can be used by these tools.
https://2019esipsummermeeting.sched.com/event/PtP1
Cloud Engineering in Practice
- When? July 17 @ 1:30 PM – 3:00 PM
- Who? Patrick Quinn
- What? Cumulus Lessons Learned: Building, testing, and sharing a cloud archive
- Where? Ballroom D
Cumulus is a scalable, extensible cloud-based archive system which is capable of ingesting, archiving, and distributing data from both existing on-prem sources and new cloud-native missions. As we have built and evolved the system with contributions from seven NASA EOSDIS organizations, we have learned several lessons about how to build a robust, broadly-applicable, microservices-based cloud system for geospatial data which we will share in this talk.
https://2019esipsummermeeting.sched.com/event/PtPq
Geospatial Data Analytics and Visualization for Sustainability in the Cloud
- When? July 18 @ 1:30 PM – 3:00 PM
- Who? Dan Pilone
- What? Improving Information and Communications in a Disaster Scenario with AWS Snowball Edge
- Where? Ballroom BC
Volunteers and emergency personnel carefully coordinate their response to natural disasters. This coordination requires data and making data actionable and accessible at the tactical edge remains a challenge. We’ll give a quick overview of the results of our disaster response user needs study and demonstrate a prototype disaster response pipeline for field data management. The serverless, cloud-based pipeline combines public and private data sources with open source software. It can provide the field with a ruggedized remote data center (AWS Snowball Edge), preloaded with critical information, including reach-back capabilities. You’ll see how this works and learn ways first responders can update data from in-situ sources such as drones.
https://2019esipsummermeeting.sched.com/event/PtQc