GES DISC Data Operations and Services Mike Theobald GES DISC - - PowerPoint PPT Presentation
GES DISC Data Operations and Services Mike Theobald GES DISC Production Highlights Completed V5.0 Reprocessing with a net rate of 13X. Integrated V5.2 algorithms and reprocessed from start of AMSU Ch. 4 degradation. Integrated L3
Completed V5.0 Reprocessing with a net
Integrated V5.2 algorithms and
Integrated L3 Support Algorithm Starting to replace/upgrade some hardware
3 6 9 12 15 18 21 24 27 30 33 36 39 0% 10% 20% 30%
NRT vs Standard
Standard NRT
1 2 3 4 5 0% 20% 40% 60% 80% 100%
NRT AIRI2CCF Latency
24 26 28 30 32 34 36 38 40 0% 20% 40% 60% 80% 100%
Standard AIRI2CCF Latency
Hours since Observation
S4PA archive and distribution system
6 separate servers
100 TB 8,000,000 granules
All data backed up on tape
Redundant disk copies of L0 data Disk files and tapes verified regularly
Additional capacity is planned
Technology refresh of L0 servers underway
L0 L1 L2 L3 5 10 15 20
Data Years
Free In Use
Product Level In Use Free 20 40 60 80 100
Terabytes
L3 L2 L1 L0
TB Years
146 TB Net Volume
L1: 106.3 TB L2: 26.4 TB L3: 0.4 TB NRT: 6.6 TB L0: 6.6 TB
Peak Distribution
2 TB/day 220,000 granules
10 Million Granules
L1: 2,700,000 L2: 6,500,000 L3: 7,000 NRT: 500,000 L0: 100,000
1477 distinct network
50+ different top-level
Jan Feb Mar Apr May Jun Jul Aug Sep Oct 0.5 1 1.5 2 2.5 L0 L1 L2 L3 NRT
TB
Jan Feb Mar Apr May Jun Jul Aug Sep Oct 50 100 150 200 250 L0 L1 L2 L3 NRT
Granules (Thousands)
AIRIBRAD AIRABRAD AIRVBRAD AIRXBCAL AIRX2RET AIRX2SUP AIRI2CCF AIRX3STD AIRX2RET_NRT AIRIBRAD_NRT AIRX2SUP_NRT All Others 20 40 60 80 100 120 1 2 3 4 5 6
Volume (TB) Granules (Millions)
37.7 37.5 25.3 18.4 6.4 5.3 5.2 15.2
Volume (TB)
noaa.gov umbc.edu wisc.edu nasa.gov princeton.edu umich.edu ac.jp all others
2.8 1.8 1.4 2.6 1.6 0.3 2.4 5.3
Granules (Millions)
Data portals
Direct ftp/http Mirador WHOM ECHO OPeNDAP
Subsetting
Channel Parameter
Format conversion
NetCDF for L2, L3 L1 soon
Granule and global
Science support
ARCTAS CEOP SO2 Map