Remote Sensing and Optical Imaging/Sensing -- Applications on - - PowerPoint PPT Presentation

▶
remote sensing and optical imaging sensing
SMART_READER_LITE
LIVE PREVIEW

Remote Sensing and Optical Imaging/Sensing -- Applications on - - PowerPoint PPT Presentation

Oct 03, 2022 551 likes •1.14k views

Remote Sensing and Optical Imaging/Sensing -- Applications on Sericulture and Shrimp Farm -- Sarun Sumriddetchkajorn NSTDA Research Fellow National Electronics and Computer Technology Center (NECTEC) National Science and Technology Development

slide-1
SLIDE 1

Sarun Sumriddetchkajorn, Feb. 14, 2019: Winter College on Applications of Optics and Photonics in Food Science

1

Remote Sensing and Optical Imaging/Sensing

  • - Applications on Sericulture and Shrimp Farm --

Sarun Sumriddetchkajorn

NSTDA Research Fellow

National Electronics and Computer Technology Center (NECTEC) National Science and Technology Development Agency (NSTDA) Ministry of Science and Technology, Thailand

E-mail: sarun.sumriddetchkajorn@nectec.or.th

slide-2
SLIDE 2

Sarun Sumriddetchkajorn, Feb. 14, 2019: Winter College on Applications of Optics and Photonics in Food Science

2

We We w would like to to ac acknowledge al all s sta taff of Se Sericultu ture D Depar artm tment an and Federat ation o

  • f Thai

ai Shrimp F Far armers A Associat ation

  • n in T

Thai ailan and

slide-3
SLIDE 3

Sarun Sumriddetchkajorn, Feb. 14, 2019: Winter College on Applications of Optics and Photonics in Food Science

3

Silk

Sogdian silk, 8th century

Chinese knew about silk between 4000 and 3000 BCE

  • Silk has been utilized around the world for several

purposes (e.g., clothing, optical materials).

  • Today sericulture industry has played a significant

role in economic growth for several countries. For example, silk related products in Thailand showed an export value of USD22.6 millions

slide-4
SLIDE 4

Sarun Sumriddetchkajorn, Feb. 14, 2019: Winter College on Applications of Optics and Photonics in Food Science

4

http://www.silkwormshop.com/images/lifecycle.jpg

Silkworm (Bombyx mori)

Egg counter Stage of eggs Suitable number of female and male leads to better quality of eggs and cocoons

slide-5
SLIDE 5

Sarun Sumriddetchkajorn, Feb. 14, 2019: Winter College on Applications of Optics and Photonics in Food Science

5

Br Breeders: s: Sh Sheets s of

  • f Si

Silkw kwor

  • rm Egg

ggs s

slide-6
SLIDE 6

Sarun Sumriddetchkajorn, Feb. 14, 2019: Winter College on Applications of Optics and Photonics in Food Science

6

Sheets s of

  • f Silkw

kwor

  • rm Egg

ggs s for

  • r Selling

g to

  • Fa

Farmers

1 mm in diameter… About 20,000 eggs/sheet…how do you know?

Stage of each egg?

Therefore…Si Silkwor

  • rm Egg C

Counti ting Sy Syste tem is N Needed

slide-7
SLIDE 7

Sarun Sumriddetchkajorn, Feb. 14, 2019: Winter College on Applications of Optics and Photonics in Food Science

7

NECTEC’s KhaiMai: Silkworm Egg Counter

1 mm dia Area Filtering Template Matching Edge Detection Noise Reduction (Median Filtering)

slide-8
SLIDE 8

Sarun Sumriddetchkajorn, Feb. 14, 2019: Winter College on Applications of Optics and Photonics in Food Science

8

  • Silkworm egg counting: within 2 minutes (fastest) depended on type of silkworm eggs
  • Identification of stages of silkworm eggs: fresh, almost hatching, egg shell, bad eggs
  • Overall system accuracy: 87.9%

Deploye yed in 5 Si Silkworm rm Research ch Centers s in Thailan land

slide-9
SLIDE 9

Sarun Sumriddetchkajorn, Feb. 14, 2019: Winter College on Applications of Optics and Photonics in Food Science

9

  • To achieve high quality raw silk thread
  • To obtain high quality breeders
  • To conserve high quality breeders

Needs

It is highly desirable to be able to separate male and female silkworms

slide-10
SLIDE 10

Sarun Sumriddetchkajorn, Feb. 14, 2019: Winter College on Applications of Optics and Photonics in Food Science

10

http://www.silkwormshop.com/images/lifecycle.jpg

Silkworm (Bombyx mori)

1 2 3

slide-11
SLIDE 11

Sarun Sumriddetchkajorn, Feb. 14, 2019: Winter College on Applications of Optics and Photonics in Food Science

11

Silkworm Gender Separation Methods

  • Visual inspection at the ventral surface of

the 8th abdomen segment

Low cost Slow Requires highly skilled people

  • Mass analysis
  • Shape analysis

Need reference weight/shape High error rates

  • Magnetic Resonance Imaging
  • Near Infrared Spectroscopy
  • Fluorescent imaging under UVA

High accuracy Very expensive Suitable for limited varieties of silkworms

slide-12
SLIDE 12

Sarun Sumriddetchkajorn, Feb. 14, 2019: Winter College on Applications of Optics and Photonics in Food Science

12

Silkworm Gender Separation System via Mass Analysis

slide-13
SLIDE 13

Sarun Sumriddetchkajorn, Feb. 14, 2019: Winter College on Applications of Optics and Photonics in Food Science

13

Silkworm Gender Separation via Size/Shape

Nov 1972

slide-14
SLIDE 14

Sarun Sumriddetchkajorn, Feb. 14, 2019: Winter College on Applications of Optics and Photonics in Food Science

14

Silkworm Gender Separation via Spectroscopy

slide-15
SLIDE 15

Sarun Sumriddetchkajorn, Feb. 14, 2019: Winter College on Applications of Optics and Photonics in Food Science

15

Science China, Vol. 53, Nov. 2010.

Silkworm Gender Separation via Fluorescence

slide-16
SLIDE 16

Sarun Sumriddetchkajorn, Feb. 14, 2019: Winter College on Applications of Optics and Photonics in Food Science

16

Our Target

  • Lower Cost
  • Faster Response
  • High Accuracy

How ?

Optical Penetration Image Processing

+

Silkworm Gender Identification- Separation System

slide-17
SLIDE 17

Sarun Sumriddetchkajorn, Feb. 14, 2019: Winter College on Applications of Optics and Photonics in Food Science

17

NECTEC Light Penetration-based Silkworm Pupa Sex Identification Structure

Silkworm Pupa Transparent Support Array of Light Sources Camera Electronic Controlling and Processing Unit Array of Light Sources Silkworm Pupa TOP VIEW SIDE VIEW

  • S. Sumriddetchkajorn and C. Kamtongdee, Applied Optics, Vol. 51, No. 4, pp. 408-412, February 2012.
slide-18
SLIDE 18

Sarun Sumriddetchkajorn, Feb. 14, 2019: Winter College on Applications of Optics and Photonics in Food Science

18

Female Male

In average, female silkworm pupae are just 0.08 mm wider and 0.19 mm longer than male High accuracy in silkworm sex separation via weight and size is hard to accomplish.

slide-19
SLIDE 19

Sarun Sumriddetchkajorn, Feb. 14, 2019: Winter College on Applications of Optics and Photonics in Food Science

19

Female le Male 468 nm 565 nm nm 639 nm 940 nm nm White te LED

Important Organ

Silkworm pupa under Five Spectra are Investigated

High Image Contrast High Image Contrast

slide-20
SLIDE 20

Sarun Sumriddetchkajorn, Feb. 14, 2019: Winter College on Applications of Optics and Photonics in Food Science

20

Shift invariant, Rotation invariant,

Template Matching Process

Shift invariant Female: 20/25 = 80% Male: 20/20 = 100% Total accuracy: 88% Processing time 46 ms Rotation invariant Female: 14/25 = 56% Male: 20/20 = 100% Total accuracy: 71% Processing time 56 ms

slide-21
SLIDE 21

Sarun Sumriddetchkajorn, Feb. 14, 2019: Winter College on Applications of Optics and Photonics in Food Science

21

Template Matching Results

slide-22
SLIDE 22

Sarun Sumriddetchkajorn, Feb. 14, 2019: Winter College on Applications of Optics and Photonics in Food Science

22

22

Issues from the Use of Template Matching

  • Less flexible template
  • Low image contrast
  • Loss of important feature
slide-23
SLIDE 23

Sarun Sumriddetchkajorn, Feb. 14, 2019: Winter College on Applications of Optics and Photonics in Food Science

23

set at 70-255

Removes unwanted image noises Live Image Global Image Thresholding Blob Filtering #1 Blob Filtering #2 Image Inversion Sex Identification

area filtering (10-30%) + image inversion

Small black dots appear

area filtering (3000-10000 pixels)

Location of the chitin gland is pinpointed

Measured average identification time is 38 ms

Blob (Area) Filtering Approach

slide-24
SLIDE 24

Sarun Sumriddetchkajorn, Feb. 14, 2019: Winter College on Applications of Optics and Photonics in Food Science

24

Original Image Red Image Plane Global Thresholding Blob Filtering #1 Image Inversion Blob Filtering #2 Sex Identification

To Total 92.8% Ac Accuracy

F M

slide-25
SLIDE 25

Sarun Sumriddetchkajorn, Feb. 14, 2019: Winter College on Applications of Optics and Photonics in Food Science

25

Female

High Accuracy: 20/22 = 90.9%

Problem: Shrinkage in the posterior area

slide-26
SLIDE 26

Sarun Sumriddetchkajorn, Feb. 14, 2019: Winter College on Applications of Optics and Photonics in Food Science

26

Male

High Accuracy: 23/23 = 100%

slide-27
SLIDE 27

Sarun Sumriddetchkajorn, Feb. 14, 2019: Winter College on Applications of Optics and Photonics in Food Science

27

Gender Separator for Silkworm Pupa

  • Non-destructive separation
  • Accuracy: 95%
  • Speed: 20 silkworms/minute

Key specifications:

  • With optimized positions of LED,

camera, and software

  • With the investigation of the silkworm

pupa at the correct stage

slide-28
SLIDE 28

Sarun Sumriddetchkajorn, Feb. 14, 2019: Winter College on Applications of Optics and Photonics in Food Science

28

Si Silk Thread ad 1st

st Grade

de: : 600-1000 meter

0.10-0.15 mm diameter with small variation Good color uniformity

slide-29
SLIDE 29

Sarun Sumriddetchkajorn, Feb. 14, 2019: Winter College on Applications of Optics and Photonics in Food Science

29

Si Silk Thread ad 2nd

nd Grade

de: 600-1000 meter

0.20-0.40 mm diameter with medium variation Medium color uniformity

slide-30
SLIDE 30

Sarun Sumriddetchkajorn, Feb. 14, 2019: Winter College on Applications of Optics and Photonics in Food Science

30

Si Silk Thread ad 3rd

rd Grade

de: : 600-1000 meter

0.30-0.40 mm diameter with rough variation Rough color uniformity

slide-31
SLIDE 31

Sarun Sumriddetchkajorn, Feb. 14, 2019: Winter College on Applications of Optics and Photonics in Food Science

31

5cm 5cm 10 10cm cm

Black plastic ic sheet 100 silk threads ds Knots, s, Nodes

slide-32
SLIDE 32

Sarun Sumriddetchkajorn, Feb. 14, 2019: Winter College on Applications of Optics and Photonics in Food Science

32

Laser Beam Shadow of Silk Thread

  d

                               b g r i h g f e d c b a B G R

                              

3 2 1 3 3 3 2 2 2 1 1 1

R R R B G R B G R B G R c b a

M M M M M M M M M

                              

3 2 1 3 3 3 2 2 2 1 1 1

G G G B G R B G R B G R f e d

M M M M M M M M M

                              

3 2 1 3 3 3 2 2 2 1 1 1

B B B B G R B G R B G R i h g

M M M M M M M M M

From Known Color Chart Obtained from Camera

Diameter Measurement Color Analysis

slide-33
SLIDE 33

Sarun Sumriddetchkajorn, Feb. 14, 2019: Winter College on Applications of Optics and Photonics in Food Science

33

Quality Assessment System for Hand-Reeled Silk Yarn

  • Analyzes the smoothness and

evenness of the silk yarn at speeds

  • f 15 cm/s, 45 cm/s or 75 cm/s with

repetition rates of 1 cm, 5 cm, or 10 cm

  • Analyzes the color level of the whole

silk yarn in HSL and RGB formats

เพิ่ม icon ตรงนี้

Key specifications:

slide-34
SLIDE 34

Sarun Sumriddetchkajorn, Feb. 14, 2019: Winter College on Applications of Optics and Photonics in Food Science

34

Silk thread feeder Optical Sensor Camera Color Chart

slide-35
SLIDE 35

Sarun Sumriddetchkajorn, Feb. 14, 2019: Winter College on Applications of Optics and Photonics in Food Science

35

Snapshots of the signal obtained during diameter measurement

along 600 meters 60,000 points within 20 minutes

slide-36
SLIDE 36

Sarun Sumriddetchkajorn, Feb. 14, 2019: Winter College on Applications of Optics and Photonics in Food Science

36

slide-37
SLIDE 37

Sarun Sumriddetchkajorn, Feb. 14, 2019: Winter College on Applications of Optics and Photonics in Food Science

37

Cl Concentr trat ation in w wat ater should be 0 0 for bab aby s y shrimps

Quick and Cheap Way is to drop solution of a test kit (e.g., O-toluidine)

slide-38
SLIDE 38

Sarun Sumriddetchkajorn, Feb. 14, 2019: Winter College on Applications of Optics and Photonics in Food Science

38 0.6 ppm 0.8 ppm 1.0 ppm 2.5 ppm 3.0 ppm 0 ppm 0.1 ppm 4.0 ppm 5.0 ppm 0.2 ppm 0.3 ppm 0.5 ppm 1.5 ppm 2.0 ppm

How the color is changed under different Cl concentration

slide-39
SLIDE 39

Sarun Sumriddetchkajorn, Feb. 14, 2019: Winter College on Applications of Optics and Photonics in Food Science

39

Top Cover Bottom Cover Mobile Device with ClApp White Light Sources Object Diffuser Reflective Surface ON/OFF Switch Batteries Observing Window Object Holder

  • S. Sumriddetchkajorn, K. Chaitavon, and Y. Intaravanne Sensors and Actuators B: Chemical, Vol. 182, pp. 592-597,

2013.

slide-40
SLIDE 40

Sarun Sumriddetchkajorn, Feb. 14, 2019: Winter College on Applications of Optics and Photonics in Food Science

40

White light LED White Plastic as a reference Mirror ON/OFF Switch Observing Window AA Bateries

slide-41
SLIDE 41

Sarun Sumriddetchkajorn, Feb. 14, 2019: Winter College on Applications of Optics and Photonics in Food Science

41

y = 14.021x2 - 29.99x + 15.616 R2 = 0.9983 0.5 1 1.5 2 2.5 0.6 0.65 0.7 0.75 0.8 0.85 0.9 0.95

Color Visibility Chlorine Concentration (ppm)

ClApp (Embedded Relationship)

>0.4ppm 0.05-0.4ppm < 0.05 ppm

Baby Shrimps in the pond

s: glass tube, r: reference white background

slide-42
SLIDE 42

Sarun Sumriddetchkajorn, Feb. 14, 2019: Winter College on Applications of Optics and Photonics in Food Science

42

slide-43
SLIDE 43

Sarun Sumriddetchkajorn, Feb. 14, 2019: Winter College on Applications of Optics and Photonics in Food Science

43

Field Test Operation

President of Thai Eastern Shrimp Association Farm Owner

slide-44
SLIDE 44

Sarun Sumriddetchkajorn, Feb. 14, 2019: Winter College on Applications of Optics and Photonics in Food Science

44

Not Suitable for Baby Shrimps Almost Suitable Ready for Baby Shrimps

Light Box Smartphone

slide-45
SLIDE 45

Sarun Sumriddetchkajorn, Feb. 14, 2019: Winter College on Applications of Optics and Photonics in Food Science

45

How Can We Monitor?

Early Mortality Syndrome (EMS)

Shrimp Export downs

From Main to Small Shrimp Exporter

slide-46
SLIDE 46

Sarun Sumriddetchkajorn, Feb. 14, 2019: Winter College on Applications of Optics and Photonics in Food Science

46

  • Phage stays inside one kind of bacteria

“Vibrio Parahaemolyticus (V.para.)”

  • Phage releases Toxin to the environmental

condition (high pH, high salinity) where V.para. grows better * If Phage Toxin is too much and reaches the level of Infection Dose, EMS occurs especially for 10-40 day-old shrimp babies *

What are the Causes EMS ??

Normal Shrimp Shrimp with EMS

slide-47
SLIDE 47

Sarun Sumriddetchkajorn, Feb. 14, 2019: Winter College on Applications of Optics and Photonics in Food Science

47

Total Time of Operation: 2-3 Days

Determine V.para

Soil, Water, Shrimp from Shrimp Farm High pH High Salinity Culture medium for V.para

Typical approach for checking V.para

Raise in Incubator Shaker

37o C 150 rpm for 1 day

slide-48
SLIDE 48

Sarun Sumriddetchkajorn, Feb. 14, 2019: Winter College on Applications of Optics and Photonics in Food Science

48

Turbidity of these medium cultures changes differently over time

New Approach: NECTEC’s Minimal Lab

Can easily y be measu sured red by optical al transmi smitta ttance ce

Normal al Normal pH Low Salinity High pH High pH Low Salinity High Salini nity Normal pH High Salinity V.Para ara Loves es High pH High Salinity

slide-49
SLIDE 49

Sarun Sumriddetchkajorn, Feb. 14, 2019: Winter College on Applications of Optics and Photonics in Food Science

49

Ta Take ke a loo

  • ok

k insi side M Minimal Lab (V. V.1)

24 tubes arrangement

RPM Test with Tachometer Temperature Test

slide-50
SLIDE 50

Sarun Sumriddetchkajorn, Feb. 14, 2019: Winter College on Applications of Optics and Photonics in Food Science

50

Field Test at Banjong Farm in the Eastern Part of Thailand

Number of shrimps: 90,000 Shrimps Shrimp size: p-12 Size of shrimp pond: 1 acre

slide-51
SLIDE 51

Sarun Sumriddetchkajorn, Feb. 14, 2019: Winter College on Applications of Optics and Photonics in Food Science

51

During Preparation of Shrimp Pond

There is only microbe under normal pH and high salinity in soil 3 1 2 3 4 Soil Water 1 2 3 4

Low V.para High V.para Low V.para High V.para

slide-52
SLIDE 52

Sarun Sumriddetchkajorn, Feb. 14, 2019: Winter College on Applications of Optics and Photonics in Food Science

52

  • Change in microbe in soil
  • Detect the growth of microbe under the

Condition that supports ONLY V.para

About 150 shrimps died

1 2 3 4 1 2 3 4

Low V.para High V.para Low V.para High V.para

Soil Water

During 15-day old Shrimps

Inform farm owner and do some bio-treatment

slide-53
SLIDE 53

Sarun Sumriddetchkajorn, Feb. 14, 2019: Winter College on Applications of Optics and Photonics in Food Science

53

1 2 3 4 4 1 2 3

Low V.para High V.para

Soil Water

Low V.para High V.para

After 5-day of Bio-treatment

  • Soil has good growth conditions for

All kind of microbes

  • Shrimps grow in good condition
  • Water condition is good for two

kinds of microbes (ones love normal

salinity and pH and ones love high salinity and normal pH)

Equili libri brium um No EMS

slide-54
SLIDE 54

Sarun Sumriddetchkajorn, Feb. 14, 2019: Winter College on Applications of Optics and Photonics in Food Science

54

Local seminars: 25 times

slide-55
SLIDE 55

Sarun Sumriddetchkajorn, Feb. 14, 2019: Winter College on Applications of Optics and Photonics in Food Science

55

Got Attentions to International Visitors

slide-56
SLIDE 56

Sarun Sumriddetchkajorn, Feb. 14, 2019: Winter College on Applications of Optics and Photonics in Food Science

56 https://www.youtube.com/watch?v=u23UEqoJzRM

slide-57
SLIDE 57

Sarun Sumriddetchkajorn, Feb. 14, 2019: Winter College on Applications of Optics and Photonics in Food Science

57

Conclusion

Multidisciplinary Approach Applied to Answer Demands in Agriculture Photonics Electronics Computer Science Chemistry Biology Mechanics Prototype Design UI/UX