HDF EOS

HDF-EOS Workshop IV Final Agenda

September 19 - 21, 2000

Updated Saturday August 25, 2001

The first word of the "Presentation Title" section for each presenter is linked to the Powerpoint presentation they provided. These are best viewed with Internet Explorer 4 or higher, for they will simply display the Powerpoint presentation as if it was running on your computer. Netscape will either ask you where to download the file, or execute and display the Powerpoint presentation if your machine has Powerpoint installed, depending on how you have configured the Netscape browser. You can also download the free "Powerpoint Viewer" from Microsoft.

Tuesday September 19 "News and Tools"

Time Length	Name Organization	Presentation Title
	Description
8:30 15 min	Richard Ullman NASA ESDIS Project	Welcome and EOSDIS status overview

8:45 20 min	Larry Klein Emergent Information Technologies, Inc	HDF-EOS 2.x Description (point, swath, grid)
	Overview of the baseline HDF-EOS structures for the current HDF-EOS library
9:05 15 min	Larry Klein Emergent Information Technologies, Inc	HDF-EOS Status Update
	Current development status and schedule of HDF-EOS 3.0, based on HDF5. Coordination with current HDF4-based libraries and ECS plans to support both HDF4 and HDF5, will be discussed.
9:20 30 min	Mike Folk NCSA	HDF4 and HDF5 Update
	An overview of HDF4 and HDF5 activities at NCSA during the past year, and plans for the future.
9:50 15 min	Break
10:05 30 min	David Wynne Emergent Information Technologies, Inc	HDF-EOS 3.0 Functional and Structural Design
	Details on the functional specification of the HDF-EOS 3.0 API including functional differences from the heritage HDF-EOS 2.x API. Explanation of the structural foundation of HDF-EOS 3.0 including the HDF5 structures and relationships among them.
10:35 15 min	Elena Pourmal NCSA	Results of HDF4 vs. HDF5 performance study
	Performance tests are being conducted to compare HDF4 and HDF5 on a number of criteria for common file I/O operations, such as hyperslab subsetting, access to large datasets, access to large numbers of objects. Also file size requirements being be compared.
10:50 20 min	R. Suresh	HDF-EOS Vector Profile and HDF-EOS WMT Implementation

11:10 30 min	Robert E. McGrath NCSA	HDF4-to-HDF5 conversion (mappings, tools, gotchas)
	HDF4 users who are interested in switching to HDF5 with legacy face the problem of what to do with legacy HDF4 data and software. Mappings have been created to show how HDF4 objects can be converted to HDF5, and tools are in the works for converting between the two formats. Nevertheless, converting data of software from HDF4 to HDF5 can be challenging, and how (or whether) it should be done depends on many variables, which will be addressed in this talk.

11:40
80 min

Lunch

Time Length	Name Organization	Presentation Title
	Description
1:00 20 min	Ray Milburn Emergent Information Technologies, Inc	HDF-EOS Grid and Swath command line translator and H5Eview
	hdfeos4to5 is a command line utility for converting standard HDF-EOS files from HDF4 based to HDF5 based. H5EOSView is the EOSView equivalent for HDF-EOS files using HDF5. JEB is a Java based tool for browsing both HDF4 and HDF5 - based HDF-EOS files.
1:20 20 min	Linda Hunt, Kam-Pui Lee NASA Langley Atmospheric Sciences Data Center	view_hdf
	A software package, view_hdf, has been developed for the CERES project that is generally useful for analysis and plotting of HDF and HDF-EOS formatted data. Many features have been added to this package since it was last presented.
1:40 20 min	Pedro Vicente Space Research Software	HDF Explorer Ver 1.1
	A version 1.1 of HDF Explorer is a new version that will support HDF5 and HDF-EOS.
2:00 20 min	Matt Smith University of Alabama in Huntsville	subsetting HDF-EOS data
	I'll be discussing the status of subsetting HDF-EOS data and our plans for the future. Those plans include incorporating the HEW subsetting appliance into the ECS, increasing the visibility of the Subsetting Testbed, and installing HEW at data centers.
2:20 20 min	Bill Okubo Research Systems, Inc	Commercial HDF Tools through RSI
	Presentation, demonstration and round-table discussion of: IDL, ENVI and Noesys - a brief overview and latest version updates
2:40 20 min	Alla Lake Ecologic	HDF-EOS DataBlade
	The HDF-EOS DataBlade is a data management tool for HDF-EOS files based on Informix DataBlade constructs.
3:00 20 min	Break
3:20 40 min	Lee Elson Caltech/JPL	Webwinds (a link to the JPL Webwinds site, not the actual presentation)
	WebWinds (http://webwinds.jpl.nasa.gov) is a freely available, multi-platform (PC, Mac, Unix) visualization and analysis tool, written in Java, that can read, sub-set, combine, analyze and display most HDF-EOS files. Several new capabilities, including 3D (volume rendering, lighting, perspective) display, animation, overlays, non-regular data and subsetting using arbitrary bounding curves will be discussed and demonstrated. An automatic scripting capability can reduce user workload for repetitive analysis of similar data files. Several scripts for Terra data will be discussed.
4:00 20 min	Siri Jodha Singh Khalsa National Snow and Ice Data Center	The Polar HDF-EOS Data Imaging and Subsetting (PHDIS) Tool
	The Polar HDF-EOS Data Imaging and Subsetting (PHDIS) Tool - An IDL-based tool for working with polar-gridded data. I will discuss conversions at the DAAC of pathfinder data sets to HDF-EOS and work with MODIS snow and ice products using this tool.
4:20 20 min	Ken Stone University of Colorado - CLAS	A Validation Toolkit for Atmospheric Profile Data Stored in the Aura HDF-EOS Swath Format.
	We will present an overview of an IDL-based toolkit for analysis and viewing of atmospheric profile data. The toolkit was developed for UARS/HALOE and has a heritage back to the LIMS project. It includes utilities for creating maps, cross sections, line plots, coincidence and difference statistics. Here we focus on the recent modifications which allow input from Aura HDF-EOS Swath files.
4:40 20 min	Dr. John Weiss South Dakota School of Mines and Technology (SDSM&T)	MODIS Map Re-Projection Tool.
	The MODIS Re-Projection Tool will enable transforming and resampling MODIS data products from the Integerized Sinusoidal Projection to other user-specified map projections. A demo of this tool will be presented.
5:00 30 min	Richard Ullman NASA ESDIS Project	Day One wrap-up discussion

Wednesday September 20 "Products and Applications"

Time Length	Name Organization	Presentation Title
	Description
8:30 25 min	Michael R. Reid Computer Sciences Corporation	A description of the initial Landsat 7 Processing System (LPS) HDF-EOS output products and how they are created.
	A description of the initial Landsat 7 Processing System (LPS) HDF-EOS output products and how they are created. The LPS creates subinterval-based Landsat 7 Level 0R science data products primarily in HDF-EOS format, which are later subsetted and further processed by the ECS. The LPS Image Data Processing Subsystem (IDPS) creates the HDF-EOS band files, which contain the science data. These contain geolocated Swaths and ancillary data. They also make use of the Landsat-specific Index Map feature of HDF-EOS.
8:55 25 min	Bjorn Eng ASTER PGS Development Team	Design of EOS Terra ASTER products: Usability and other features

9:20 15 min	TBA	TBA

9:35 15 min	Break
9:50 20 min	Mike Bull NASA JPL MISR Project	Use of HDF and HDF-EOS in MISR Standard Data Products.
	The standard and ancillary data products of the Multi-angleImaging SpectroRadiometer (MISR) project (part of NASA's Terra spacecraft), make very heavy use of HDF-EOS and native HDF file structures. HDF-EOS swath and grid formats are used as a basis, with additional native HDF structures incorporated where needed. This presentation gives an overview of the HDF / HDF-EOS file structures used, reasons for the design decisions made, and some of the lessons learned.
10:10 20 min	Kathleen Crean NASA JPL MISR Project	Use of HDF and HDF-EOS in MISR Summary Data Products and Ancillary Datasets

10:30 20 min	Robert Wolfe	MODIS Land Products
	The MODIS Land Group has also generated products in HDF-EOS format using the ECS SDP Toolkit HDF-EOS interface routines. The Land products have data structures only in 2 dimensions; thus the subsetting capabilities expected are not as extensive as for MODIS Atmosphere products. The Land Group has been using the University of Alabama Subsetting Tool for subsetting by geographical area. The tool is working well and is available for use throughout the EOS associated groups.
10:50 20 min	Richard Hucek	MODIS Atmospheres Products
	The MODIS Atmosphere Group has generated products in HDF-EOS format. The Atmosphere software opens and creates the MODIS product files using the HDF-EOS interface routines in the ESC SDP Toolkit. These interface routines are used to provide both swath names for Level 2 products and grid names for Level 3 products. The HDF-EOS utility software provides HDF-EOS file IDs and links them to HDF file IDs that are then used to create objects for the data using standard HDF software. The HDF-EOS routines set up structures in the product files called structural metadata. These may be viewed in the product files. HDF-EOS maps spatial locations to the geolocation of data for the purpose of subsetting. The HDF-EOS interface allows subsetting of planes within 3-D data arrays, such as height above the Earth's surface. HDF-EOS requires a monotonic sequence of values.
11:10 30 min	Cheryl Craig NCAR (HIRDLS project)	HDF-EOS Aura File Format Proposed Guidelines
	While HDF-EOS constrains HDF with its POINT, SWATH and GRID implementations, it is still possible to create two files which are completely different and would require dramatically different readers. To ease cross-platform use of Aura data sets, the Aura teams have agreed to make their files match as closely as reasonably possible. This presentation will present these guidelines.
11:40 20 min	Richard Chinman UCAR-IITA	DODS
	HDF-EOS data are now being distributed using DODS server technologies which make those data directly accessible by programs (e.g., Ferret, GrADS, IDL, MatLab, Web browsers, Microsoft Excel, ...) that are network aware, some enabled by DODS client technologies, others (Excel) that do not use specific DODS client technologies, but are still able to access DODS servers. These network aware programs can all issue a data request, via http, to a DODS server in the form of a fully constrained URL. DODS comes with a powerful constraint expression evaluator - a client may request a subset of the data which is generated by the server and delivered to the client. Data served by any type DODS server (in addition to HDF-EOS, there are servers for CEDAR, DSP, FreeForm, JGOFS, Matlab, and netCDF data) are directly accessible by any DODS client. As Ferret and GrADS demonstrate, virtually any netCDF program can be relinked with the DODS-netCDF client library to create a network aware client program. This capability is not available to HDF programs due to the lack of a DODS-DHF client library. DODS technologies are freely available from Unidata (http://www.unidata.ucar.edu/packages/dods/).

12:00
70 min

Lunch

Time Length	Name Organization	Presentation Title
	Description
1:10 90 min		Ask the experts discussion
	Open discussion about HDF, HDF-EOS function, application, development and products.
2:40 20 min	Break
3:00 20 min.	Jerry A. Clarke US Army Research Laboratory	The Distributed Interactive Computing Environment ( DICE )
	The Distributed Interactive Computing Environment ( DICE ) has recently added a developed a distributed data hub that takes advantage of a DSM system, XML, and HDF5. Using this hub, DICE adds runtime visualization and analysis capabilities to existing HPC codes. This presentation will describe, DICE, the data hub, and it's uses.
3:20 20 min	Andrew S. Jones Colorado State University / CIRA	Overview of the Data Processing Error Analysis System (DPEAS)
	Overview of the Data Processing Error Analysis System (DPEAS) - a near-real-time HDF-EOS-based parallel computing environment for multisensor satellite data merger on the Windows OS. Current applications include near real-time transfer of AMSU data sets to the National Weather Service / Satellite Analysis Branch. Typical data rates exceed 6 TB/yr using a 4 node (8 processor) PC cluster serving 5 simultaneous near-real-time satellite sensor feeds, including GOES-08, GOES-10, NOAA-15 AVHRR, NOAA-15 AMSU-A, and AMSU-B.
3:40 20 min.	Aishwarya Narain India Space Applications Centre (ISRO)	HDF-EOS at ISRO
	Activities related to the IRS P4 OCM - Ocean Colour Monitor (Oceansat-1) Announcement of Opportunity. Data from OCM is more or less like that of SeaWiFS but has a fine resolution of 360 m and once in 2 day coverage.
4:00 20 min.	Doug Moore and Huan Meng NESDIS/NOAA and QSS Group, Inc.	HDF-EOS at NOAA/NESDIS
	Two years of experience producing operational real-time products in HDF-EOS at NOAA/NESDIS/ORA and plans for the future.
4:20 20 min	Michael Manyin SSAI	The Distributed Image SpreadSheet (DISS) project
	The Distributed Image SpreadSheet (DISS) project has plans to incorporate HDF-EOS as a natively supported file format over the next few months. We would like to demonstrate the software with this important extension, to show the added capability which it offers. DISS is a software tool for the visualization and analysis of large 2 and 3-dimensional, multispectral scientific data sets, particularly for remotely sensed data. It extends the basic spreadsheet paradigm to include image calculation among cells, and interactive roaming, zooming and animation, synchronously across cells. DISS currently accepts HDF SDS data as a native format, and lets the user subset with all the standard HDF methods. DISS was originally developed in Goddard's Laboratory for atmospheres, and currently is funded as an ESTO/ESDIS Prototype.
4:40 20 min	Liping Di and R. Suresh Raytheon ITSS	Development of a Prototype Web GIS Server for HDF-EOS Data based on OGC Web Map Specifications
	The OGC Web Mapping Testbed can access HDF-EOS data from the DIAL map server and other types of data from diverse sources. A user using the client can overlay and manipulate HDF-EOS data with other types of data.
5:00 30 min	Richard Ullman NASA ESDIS Project	Day Two Wrap Up

Thursday September 21 "Hands on Demonstrations and Tutorials"

Location Length Time	Name Organization	Tutorial or Demonstration Title
	Description
UNIX Lab 110 min 8:30 - 10:15	Barbara Jones, Elena Pourmal, Mike Folk NCSA	HDF5 Hands-on Tutorial
	An introductory tutorial to HDF5, covering how to use the HDF5 application programming interface (API) to read and write simple HDF5 files, and NCSA-supported tools and utilities for working with HDF5 files. Both Fortran and C API will be covered.
Auditorium 40 min 8:30 - 9:10	Robert P. Comer The MathWorks, Inc.	MATLAB hands-on demonstration and tutorial
	Our presentation will cover relevant capabilities in the MATLAB/Image Processing Toolbox and will include examples based on recently-available data from TERRA.
Auditorium 30 min 9:15 - 9:45	Bill Okubo Research Systems, Inc	IDL Tools hands on demonstration and tutorial
	How can we get more people using HDF-EOS data? Audience will view demonstration on a large screen projection display.
Auditorium 30 min 10:00 - 10:30	Richard Chinman UCAR-IITA	DODS
	The level of effort to distribute and access data via DODS technologies depends on the form in which the data are stored - if stored as HDF, then making those data accessible is VERY easy. DODS HDF servers are adept at making n-file and n-dimensional Earth data sets accessible. DODS servers and clients are currently operating in a number of data systems, some of which will be presented in a real-time network demonstration.
UNIX Lab 30 min 10:30 - 11:00	Linda Hunt, Kam-Pui Lee NASA Langley Atmospheric Sciences Data Center	view_hdf hands on demonstration and tutorial
	A software package, view_hdf, has been developed for the CERES project that is generally useful for analysis and plotting of HDF and HDF-EOS formatted data. Many features have been added to this package since it was last presented.
PC Lab 45 min 11:10 - 11:55	R. Suresh Raytheon ITSS	The Distributed Interactive Access Link (Dial)
	DIAL is a WWW based data distribution system. It allows data providers to easily serve their Earth science data directly to their users. DIAL provides traditional catalog services like metadata search, while also providing extended interactive data services like browsing, subsetting, subsampling, reformatting and direct downloading. The power of DIAL has recently been enhanced by the addition of the EOSDIS "Version 0" protocol, which enables a project to set up a distributed system of DIAL servers. DIAL supports Hierarchical Data Format (HDF) and HDF for EOS (HDF-EOS) formatted datasets. DIAL also provides interoperability with GIS systems through translators
PC Lab 45 min 1:00 - 1:45	Mark Nestler Raytheon ITSS	The EOS Data Gateway (EDG)
	EDG is a WWW interface to EOSDIS data located at all DAACs. EOSDIS data holdings include data in HDF-EOS from the TRMM and Terra missions and will include data from the future Aqua and Aura spacecraft as well. The EDG is also a gateway to other datasets distributed by EOSDIS DAACs and International partners. Some of these are in unique or heritage format and some are in HDF. This overview tutorial will demonstrate how to use the EDG.