Shinsuke Satoh, F. Isoda, T. Sano, H. Hanado (NICT), T. Ushio (Tokyo - - PowerPoint PPT Presentation

shinsuke satoh f isoda t sano h hanado nict t ushio tokyo
SMART_READER_LITE
LIVE PREVIEW

Shinsuke Satoh, F. Isoda, T. Sano, H. Hanado (NICT), T. Ushio (Tokyo - - PowerPoint PPT Presentation

Shinsuke Satoh, F. Isoda, T. Sano, H. Hanado (NICT), T. Ushio (Tokyo Metropolitan Univ), S. Otsuka and T. Miyoshi (RIKEN) 7 th International Symposium on Data Assimilation (ISDA2019) @RIKEN-CCS, Jan. 24, 2019 1 Introduction In recent years,


slide-1
SLIDE 1

1

Shinsuke Satoh, F. Isoda, T. Sano, H. Hanado (NICT),

  • T. Ushio (Tokyo Metropolitan Univ), S. Otsuka and T. Miyoshi (RIKEN)

7th International Symposium on Data Assimilation (ISDA2019) @RIKEN-CCS, Jan. 24, 2019

slide-2
SLIDE 2

2

Flash flood at Toga River in Kobe city (28 July 2008)

Tsukuba Tornado (6 May 2012)

・ In recent years, severe weather disasters caused by localized heavy rainfalls or tornadoes have occurred frequently in various parts of Japan. ・ We developed a X-band Phased Array Weather Radar (PAWR) to watch and predict the severe weather. The PAWR measures 3-dim fine structure of precipitation with 100 m range resolution and 100 elevation angles every 30 seconds. ・ The first PAWR was installed at Osaka University, Suita in 2012. The second and third PAWRs were install at NICT Kobe and NICT Okinawa in 2014, respectively.

Suita

in 2012

Kobe

in 2014

Okinawa

in 2014

MRI@

Tsukuba

in 2015

MP-PAWR

Saitama

in 2017

Introduction

The observation area of MLIT C-band radar and X-band MP radar (small blue circles).

slide-3
SLIDE 3

3

Phased Array Weather Radar (PAWR)

3-dim. dense

  • bservation

every 30 sec.

3-dim measurement using a parabolic antenna (150 m, 15 EL angles in 5 min) 3-dim measurement using 128 slot-array antennas with fan-beam transmitting and DBF receiving. (100 m, 100 EL angles in 30 sec)

slide-4
SLIDE 4

4

PAWR web page

(https://pawr.nict.go.jp/)

Retrieve archived past data Google maps display Rainfall Summary

Real time display

(within 1 min of obs)

slide-5
SLIDE 5

5

RIKEN real-time weather forecast

30-second update nowcasting for 10 minutes started on July 3, 2017.

http://weather.riken.jp

Otsuka et al. Wea. Forecast, 2016

Real-time demonstration of

3D nowcasting

slide-6
SLIDE 6

6

PAWR smartphone application

  • Real-time 3D rainfall display every 30 sec.
  • Heavy rainfall forecast by push notification

Free app. for Android and iPhone

http://pawr.life-ranger.jp

3D rainfall display (2nd year ver.) (3rd year ver.)

slide-7
SLIDE 7

7

Request for faster QC algorithm

blocked by topography clutter

2nd EL 7th EL

clutter map contour 20 dBZ

Ruiz et al. SOLA, 2015

Perform QC calculation and data transfer within 10 seconds for BDA and 3D nowcast

Data quality control (QC) such as clutter removal is essential in order to use PAWR observation data for data assimilation (BDA) and 3D-nowcasting. The Ruiz 's QC algorithm (SOLA, 2015) used for the BDA experiment requires calculation time of 40 seconds. However, it is necessary to develop a faster and general-purpose QC algorithm to perform real-time processing on the various observation data.

slide-8
SLIDE 8

8

Surface clutter and interference echoes

Clutter echoes by ships

Add another data at 2016/12/01, 10:03:30 Airplane echo +RangeSL

Ground clutter echoes

Interference echoes

Ground clutter

Suita PAWR (fine weather) Kobe PAWR (fine weather)

slide-9
SLIDE 9

9

Contents and overview of QC flag file

QC flag < 8 bit > [0]Valid data, [1]Shadow, [2]Clutter possible, [3]Clutter certain, [4]Noise, [5]RainAttn., [6]RangeSL, [7](Reserve)

l A new file of 1-byte QC flag data is provided in the same format of the same polar-coordinates as Ze and Vr data. (e.g. 20150808-160021.all_pawr_qcf.dat, kobe_20150808160000_A08_pawr_qcf.dat ) l The QC flag file will be created in NICT Koganei in real-time (within 10 sec.) < CONTENTS > [0] Valid data: if ( Ze > -327.68 & Vr > -327.68 ) then (1) [1] Shadow: if ( ASL(Dem) > beamHT using 4/3 equiv. earth radius) then (1) [2] Clutter possible (clutter map): if (statistical Ze_PD > 20%) then (1) [3] Clutter certain: if (Ze_PD>20% & -1.5<Vr<1.5ms-1 & ZeText > 3.0) then (1) [4] Noise (Interference): if (rng_num > 500 & Ze_std/Ze_avg < 0.5 ) then (1) [5] Rain attenuation: if (Ze_inetg > 50 dBZ & delta_Ze < -2 dB/km ) then (1) [6] Range Side Lobe:if (Ze > 40 dBZ & ZeText < 1.5 & ZrTextAz < 0.8) then (1) [7] (Reserve): future use (e.g. abnormal Vr., uncorrected aliased velocity)

slide-10
SLIDE 10

10

Ze and QC flag in PPIs (EL=2.0 deg)

Ze QC flag Ze QC flag

Valid >1 Shadow >2 Clutter map >4 Clutter certain >8 Interference noise >16

2015/12/18,10:40:34 JST 2015/08/08,16:00:21JST

Convective Rain Interference Noise

(fine weather)

Ze QC flag

2015/07/17,08:30:19 JST

Stratiform Rain

determined by ZeStd/ZeAvg < 0.5

120 km 120 km

slide-11
SLIDE 11

11

Range side-lobe contamination

EL=3.9

Ze

AZ=33.6

Ze

2016/08/14, 14:50:16

HEIGHT (km) RANGE (km)

2016/08/14, 14:50:16

False echoes at the forth and back of a strong echo

EL=3.9

QCF

AZ=33.6

QCF

HEIGHT (km) RANGE (km)

RangeSL flags are determined by ZeMax, ZeText, and ZeTextAZ 60 km

slide-12
SLIDE 12

12

00 03 06 09 12 15 18 21 2018/07/05

800 600 400 200 5 4 3 2 1

2018/07/05

100 80 60 40 20 10 8 6 4 2

00 03 06 09 12 15 18 21 00 03 06 09 12 15 18 21 JST 00 03 06 09 12 15 18 21 00 03 06 09 12 15 18 21 00 03 06 09 12 15 18 21 JST 2018/07/06 2018/07/06 2018/07/07 2018/07/07

Strong echoes are embedded in wide-spread stratiform rain

Record breaking heavy rainfall in July 2018

Rainfall summary for 3 days by Kobe PAWR Rainfall distributions observed by Kobe PAWR (CAPPI of 3 km in height)

2018/07/06 11:00 JST 2018/07/06 12:00 JST 2018/07/06 13:00 JST

slide-13
SLIDE 13

13

A B C D E F

  • (f)

(e)

Vertical section of the heavy rainfall

(a) (b) (c) (d) A B C D E

  • F

DISTANCE from PAWR (km)

HEIGHT(km) HEIGHT(km)

DISTANCE from PAWR (km)

HEIGHT(km) HEIGHT(km) HEIGHT(km) HEIGHT(km) 2018/07/06 12:00 JST

Bright band (stratiform) convective convective convective ?

slide-14
SLIDE 14

14

Incorrectly determined QC flags

DISTANCE from PAWR (km)

HEIGHT(km)

EL=1.0 12:00 JST 06Jul18

Original Ze QC flag QCed Ze

DISTANCE from PAWR (km)

HEIGHT(km)

A B A A A

  • EL=1.0

12:00 JST 06Jul18 EL=1.0 12:00 JST 06Jul18

  • B

B B

  • Valid >1

Shadow >2 Clutter map >4 Clutter certain >8 Rain attenuation >32 Range sidelobe >64

slide-15
SLIDE 15

15

<< original without Interference Noise and Rng SL >> ## Input file: 20150717-083019.all. 10000000.dat, and .20000000.dat # Total make qc flag real time = 7.000 proc time = 7.890 # Input data read: real time = 0.000 proc time = 0.550 # Calc Ze_ave, rinteg: real time = 1.000 proc time = 0.500 # Calc Ze_texture: real time = 5.000 proc time = 5.250 # Make QC flag: real time = 1.000 proc time = 1.570 # Output QC flag: real time = 0.000 proc time = 0.020 << Single core CPU >> ## Input file: 2015-0717/20150717-083019.all. 10000000.dat, and .20000000.dat # Total create qc flag real time = 34.000 proc time = 34.410 # Input data read: real time = 0.000 proc time = 0.470 # Calc Ze_ave, rinteg: real time = 15.000 proc time = 14.820 # Calc Ze_texture: real time = 17.000 proc time = 17.160 # Judgement of QCF: real time = 2.000 proc time = 1.930 # Output QC flag: real time = 0.000 proc time = 0.030 << -O3 & -fopenmp & OMP_NUM_THREADS=8 >> MOP_NUM_THREADS= 8 ## Input file: 2015-0717/20150717-083019.all. 10000000.dat, and .20000000.dat # Total create qc flag real time = 9.000 proc time = 15.490 # Input data read: real time = 1.000 proc time = 0.470 # Calc Ze_ave, rinteg: real time = 1.000 proc time = 7.270 # Calc Ze_texture: real time = 5.000 proc time = 6.390 # Judgement of QCF: real time = 2.000 proc time = 1.330 # Output QC flag: real time = 0.000 proc time = 0.030

7 sec.

(single CORE)

Only clutter detection (v0.8) after 19 June Current operational ver (v1.1) after 15 Sep

  • penMP (8 threads)

Computation time for creating QC flag

34 sec.

(single CORE)

9 sec.

(4 CORE)

slide-16
SLIDE 16

16

l The PAWR measures dense 3-dim precipitation data (100 m, 100 EL angles) every 30 seconds. l The PAWR data QC is essential for DA and 3D-nowcasting, because the observation data includes various unnecessary echoes. l We have developed real-time data QC within 10 seconds. l The correct QC flags were calculated in most

  • f convective and stratiform echoes, but

incorrect QC flags were also seen in the case

  • f record-breaking heavy rainfall.

Summary

slide-17
SLIDE 17

17

BACKUP

slide-18
SLIDE 18

18

QC flag of stratiform rain echo

Vr Ze Texture Ze QC flag

Valid >1 Shadow >2 Clutter map >4 Clutter certain >8

ms-1 dBZ dB

2015/07/17 08:30:19JST

PPI

(EL=1.0 deg)

120 km 120 km

1/n Σ [Ze(i,j)-Ze(i-1,j)] in 11 range x 5 az

slide-19
SLIDE 19

19

QC flag of convective rain echo

Vr Ze Texture Ze QC flag

ms-1 dBZ dB

PPI

(EL=1.0 deg)

2015/08/08 16:00:21JST

Valid >1 Shadow >2 Clutter map >4 Clutter certain >8

120 km 120 km

slide-20
SLIDE 20

20

PAWR web page (http://pawr.nict.go.jp/)

Retrieve archived past data

24 hours

Google maps display

Monthly Rainfall Summary 7 days Daily Rainfall Summary

Aug 4 6

Area of Rain (Blue)

  • Avg. Rain Rate (Red)
  • Max. Rain Rate (Green)

[ x 0.01 mm/hr ]

Jul.16 Jul.23 Jul.30 Aug.6

July 2017 5

slide-21
SLIDE 21

21

DISTANCE from PAWR (km)

Application of AI for rain type classification using PAWR obs data

A B

  • HEIGHT(km)

HEIGHT(km)

A

B

  • 2018/07/06

12:00 JST

bright band

convective stratiform

DISTANCE from PAWR (km) Valid >1, Shadow >2. Clutter map >4, Clutter certain >8 Rain attenuation >32, Range sidelobe >64

QC flag A B

  • HEIGHT(km)

HEIGHT(km)

vertical section of radar reflectivity (Z) Classification of rain type (conv/strat) is important for (1) real-time data QC (2) radar observation simulator

QC flag

Simulation in cyber-space Sensing in physical-space

larger droplets in convective cloud

Z=ΣD6

slide-22
SLIDE 22

22

Labeling of rain types/shapes

conv_strong _isolated

AVG>3.0mm || AREA<=50% & MAX>50mm & AREA < 10%

2340

conv_strong _line

AVG>3.0mm || AREA<=50% & MAX>50mm

924

conv_strong _mass

AVG>3.0mm || AREA<=50% & MAX>50mm

900

conv_weak _isolated

AVG>3.0mm || AREA<=50% & MAX<=50mm & AREA < 10%

1593

conv_weak _line

AVG>3.0mm || AREA<=50% & MAX<=50mm

1974

conv_weak _mass

AVG>3.0mm || AREA<=50% & MAX<=50mm

4116

Strat_cover

AVG<=3.0mm & AREA>50%

683

Strat_embeded _line

AVG<=3.0mm & AREA>50% & MAX>50mm

150

Strat_embeded _mass

AVG<=3.0mm & AREA>50% & MAX>50mm

414

no_rain

AVG<0.6mm & MAX<10mm & AREA<5%

2871

Total 15965 echo images in Jun, Jul, Aug, 2016, 50 rainy days

1247

6 times the num of data by rotation strong convective rain weak convective rain stratiform rain

slide-23
SLIDE 23

23

Preliminary result of rain type classification by CNN