An Architecture for Seamless Integration of UAS-based Wildfire - - PowerPoint PPT Presentation

an architecture for seamless integration of uas based
SMART_READER_LITE
LIVE PREVIEW

An Architecture for Seamless Integration of UAS-based Wildfire - - PowerPoint PPT Presentation

An Architecture for Seamless Integration of UAS-based Wildfire Monitoring Missions UNIVERSITAT POLITCNICA DE CATALUNYA ICARUS Research Group Cristina.Barrado@upc.edu April'08 Outline Presentation of ICARUS Research Group


slide-1
SLIDE 1

An Architecture for Seamless Integration of UAS-based Wildfire Monitoring Missions

UNIVERSITAT POLITÈCNICA DE CATALUNYA

ICARUS Research Group Cristina.Barrado@upc.edu April'08

slide-2
SLIDE 2

2

Remote Sensing, Salt Lake City, April 2008

Outline

Presentation of ICARUS Research Group Motivation System Technologies and Architecture Application Scenario: Wildfire Conclusions

slide-3
SLIDE 3

3

Remote Sensing, Salt Lake City, April 2008

ICARUS Research Group

Technical University of Catalonia at

Barcelona

15 schools: EPSC

40 departments: DAC

30.000 students

2.500 PDI

Castelldefels School of Tech.

Electrical Engineering

Aeronautic Engineering

3.000 students

Computer Architecture Dep.

120 PDI

High Performance Computes (BSC)‏

Network Distributed Applications

slide-4
SLIDE 4

4

Remote Sensing, Salt Lake City, April 2008

ICARUS Research Group

ICARUS – Intelligent Communications and Avionics for

Robust Unmanned aerial Systems

E.Pastor (Ph.D.), C.Barrado (Ph.D.), M.A. Peña(Ph.D.), J.López, X.Prats, J.Ramírez, P.Royo E.Santamaria

slide-5
SLIDE 5

5

Remote Sensing, Salt Lake City, April 2008

ICARUS Research Group

Computer Sciences – web services – embedded programming and compilers – GIS – formal methods and verification Electrical Engineering – WiFi, WiMax, RC, Satellite – Electronic board design Aeronautics Engineering – navigation – aeronavigation procedures – certification

slide-6
SLIDE 6

6

Remote Sensing, Salt Lake City, April 2008

ICARUS Research Group

Shadow UAV 5,5m Megastar RC 2,5m AP04 Flir A320

slide-7
SLIDE 7

7

Remote Sensing, Salt Lake City, April 2008

ICARUS Research Group

Main resources

slide-8
SLIDE 8

8

Remote Sensing, Salt Lake City, April 2008

Outline

Presentation of ICARUS Research Group Motivation System Architecture and technologies Application Scenario: Wildfire Conclusions

slide-9
SLIDE 9

9

Remote Sensing, Salt Lake City, April 2008

Motivation

State of the Art in application of UAS: – Firebird 2001: Fire Fighting Management

Support System

– ERAST / FiRE: NASA Project Design – WRAP: NASA / US Forest Service Project – Fire detection by Szendro Fire Department,

Hungary

– NASA Dryden Flight Research Center

slide-10
SLIDE 10

10

Remote Sensing, Salt Lake City, April 2008

Firebird 2001

MALAT Division of Israel Aircraft Industries – Demonstrated a system capable of fire

monitoring during 1996 based on the Firebird and Heron platforms:

– Firebird: Payload 25 kg, endurance 5 h cruise 60

KIAS, operating altitude 15,000ft.

– Heron: Payload 250 kg, endurance 40 h cruise 80

KIAS, operating altitude 35,000ft.

slide-11
SLIDE 11

11

Remote Sensing, Salt Lake City, April 2008

ERAST / FiRE NASA Project

ERAST (Environmental Research Aircraft and

Sensor Technology) / FiRE

– Develop and flight-demonstrate UAVs for cost-

effective science missions

– ALTUS-II Payload 150 kg, endurance 12 h cruise 65

KIAS, operating altitude 30,000ft.

– ALTAIR scientific variant of the PREDATOR-B Payload 340 kg, endurance 32 h cruise 151

KIAS, operating altitude 50,000ft.

slide-12
SLIDE 12

12

Remote Sensing, Salt Lake City, April 2008

WRAP NASA Project

WRAP (Wildfire Research and Applications

Partnership )

– Real fire monitoring missions over the USA

west-coast

– Airborne InfraRed System (AIRDAS)‏ – Thermal scan bands: 1 (0.61 - 0.68)‏

2 (1.57 -1.70)‏ 3 (3.60 -5.50)‏ 4 (5.50 -13.0)‏

– Calibration: IR +600 C. FOV: 108 degrees. Scan

Rate: 4-23 scn / sec., Resolution: 8m at 10Kf

slide-13
SLIDE 13

13

Remote Sensing, Salt Lake City, April 2008

Szendro Fire Department, Hungary

Small UAS used for early fire detection: – Low cost, simple approach – Fire department integrated UAV

slide-14
SLIDE 14

14

Remote Sensing, Salt Lake City, April 2008

Motivation

“Market will be driven by the end user requirements and applications” “Operational and acquisition costs when compared with an alternate method of completing the same mission will determine the level of success for civil applications” “Access to NAS no expected until 2015”

Earth Observation and the Role of UAVs, a

Capability Assessment, NASA DFRC, Ago'06

slide-15
SLIDE 15

15

Remote Sensing, Salt Lake City, April 2008

Motivation

“Market will be driven by the end user requirements and applications”

  • -> Requirements

“Operational and acquisition costs when compared with an alternate method of completing the same mission will determine the level of success for civil applications”

  • -> Small UAV and Open Architecture

“Access to NAS no expected until 2015”

  • -> Remote operations: Wildfire missions
  • -> and... collaboration with local firemen
slide-16
SLIDE 16

16

Remote Sensing, Salt Lake City, April 2008

Outline

Presentation of ICARUS Research Group Motivation System Technologies and Architecture Application Scenario: Wildfire Conclusions

slide-17
SLIDE 17

17

Remote Sensing, Salt Lake City, April 2008

System Technologies

Firemen requirements: GRAF System Architecture Communication Gateway Mission: HMI and End User Procedures

slide-18
SLIDE 18

18

Remote Sensing, Salt Lake City, April 2008

Geographical situation

  • Fire extinction responsibility is

decentralized by regions.

  • Inter-region / central government

cooperation available if necessary. Area: 31 932 km2 Population: 6.704.146 Fires during 2006: 629 Burnt area: 3.404 ha Worst year (1994): 76.125 ha

slide-19
SLIDE 19

19

Remote Sensing, Salt Lake City, April 2008

Available aerial resources

slide-20
SLIDE 20

20

Remote Sensing, Salt Lake City, April 2008

Aircraft operation schemes

Surveillance and attack

airplanes follow predefined routes around the clock during daytime.

In case of detection first

retardant attack is executed

Rest of available units are used

  • n demand.

No flying during night time.

slide-21
SLIDE 21

21

Remote Sensing, Salt Lake City, April 2008

Conditionings

Geographical application area:

– Relatively small area; operations under responsibility of local

government and therefore with limited budget.

– Externalized aerial resources except C&C helicopters. – UAS to be operated by external providers.

Integration with fire fighters own systems:

– Aerial operators see opportunities but do not want to see a

UAS mixed in their airspace!!

– Ground firefighters are eager to receive any available

technology innovation.

– Even though existing legal limitations and pilots opposition,

ground firefighters suggest several application scenarios with strict manned/unmanned separation.

slide-22
SLIDE 22

22

Remote Sensing, Salt Lake City, April 2008

Proposed lines of work

Identify effective application scenarios

– Contacts with many fire fighter organizations – Application scenarios change depending on user

capabilities and geographical conditions

– Human-Machine Interface critical for non-IT users

Identify operational and information flow and

implement the technology to support

– Highly dependent on the selected autopilot – Information flow – management – exploitation: key

points to create an usable system for non-IT users

slide-23
SLIDE 23

23

Remote Sensing, Salt Lake City, April 2008

Proposed system architecture

Oriented to mission management and information

flow.

Real Time Data Acquired and Distribution System divided into four components:

– UAS: designed for data acquisition and autonomous

  • peration.

– Mobile Control Station: responsible for UAS tactical control

(flight operations), data gathering and processing.

– Squad Information Terminal: provides information to the

ground crew.

– Data Processing Center: strategic control of multiple

  • ngoing operations, data storage for post-fire analysis, high-

level coordination and decision center.

slide-24
SLIDE 24

24

Remote Sensing, Salt Lake City, April 2008

Proposed system architecture

UAS components: – Airframe – Flight Control System – Payload – Payload/Mission

Control System

– Communication System

slide-25
SLIDE 25

25

Remote Sensing, Salt Lake City, April 2008

UAS Architecture

Network Centric with data Publish/Subscribe Services may be producers and/or consumers

slide-26
SLIDE 26

26

Remote Sensing, Salt Lake City, April 2008

GCS and Squad Systems

slide-27
SLIDE 27

27

Remote Sensing, Salt Lake City, April 2008

CPD System

slide-28
SLIDE 28

28

Remote Sensing, Salt Lake City, April 2008

UAV Service Abstraction Layer

slide-29
SLIDE 29

29

Remote Sensing, Salt Lake City, April 2008

Communication Gateway

makes service location is irrelevant monitors links to provide cost effective QoS

slide-30
SLIDE 30

30

Remote Sensing, Salt Lake City, April 2008

Example of Mission Services

Mission is formally specified through visual tools:

– Relations between services are specified by flow diagrams – Dynamic activities through event-based systems.

slide-31
SLIDE 31

31

Remote Sensing, Salt Lake City, April 2008

Benefits of network centric / SOA

Dynamic service discover

– Services can be identified when the system goes online or

later during operation. Remote execution

– Consumer simply sends a service request and its parameters.

Later on it will get results. Self-description

– Each module provides a description of the services that it can

  • provide. Services may shut down or be set up dynamically.

Multiple equivalent services may be available adding a level

  • f redundancy.

Data streaming

– Semantic publish/subscription mechanisms for high change

rate data

slide-32
SLIDE 32

32

Remote Sensing, Salt Lake City, April 2008

Mission

The mission is a set of services that orchestrate

the whole operation of the UAS.

Link the flight plan that the UAS follows and the

  • peration executed by the payload.

Mission may dynamically change as fire evolves,

therefore updated flight plans should be computed.

Given that operational requirements change from

mission to mission, additional or improved quality payload can be added just by including new or inherited services.

slide-33
SLIDE 33

33

Remote Sensing, Salt Lake City, April 2008

Mission procedures

Previous to flight: mission definition During flight (in parallel): – Exploration (flight area redefinition)‏ – Data processing – Data Presentation – Data Storage After flight: Data post-processing

slide-34
SLIDE 34

34

Remote Sensing, Salt Lake City, April 2008

Mission procedures

Previous to flight: mission definition During flight (in parallel): – Exploration (flight area redefinition)‏ – Data processing – Data Presentation – Data Storage After flight: Data post-processing

Man in the loop: HMI functionalities

scientific tactical

slide-35
SLIDE 35

35

Remote Sensing, Salt Lake City, April 2008

Mission Roles

Responsible: Decision maker – Data Presentation Mission Operator – Definition – Exploration Others – Pilot-in-command – Maintenance

slide-36
SLIDE 36

36

Remote Sensing, Salt Lake City, April 2008

Parametric Flight Plan Definition

Continuous scan is necessary to follow fire perimeter.

slide-37
SLIDE 37

37

Remote Sensing, Salt Lake City, April 2008

Parametric Flight Plan Definition

Mission control allows to design a service that identifies fire perimeter Exploration area is dynamically changed by updating a few flight plan parameters.

slide-38
SLIDE 38

38

Remote Sensing, Salt Lake City, April 2008

HMI Flight Plan Definition

slide-39
SLIDE 39

39

Remote Sensing, Salt Lake City, April 2008

Intelligent Flight Plan Service

Dynamic adaptation

slide-40
SLIDE 40

40

Remote Sensing, Salt Lake City, April 2008

Intelligent Flight Plan Service

Dynamic adaptation

slide-41
SLIDE 41

41

Remote Sensing, Salt Lake City, April 2008

Intelligent Flight Plan Service

Dynamic adaptation

slide-42
SLIDE 42

42

Remote Sensing, Salt Lake City, April 2008

HMI Flight Plan Exploration / Presentation

slide-43
SLIDE 43

43

Remote Sensing, Salt Lake City, April 2008

Outline

Presentation of ICARUS Research Group Motivation System Technologies and Architecture Application Scenario Conclusions

slide-44
SLIDE 44

44

Remote Sensing, Salt Lake City, April 2008

Application Scenarios

GRAF identified three viable fire missions: – Monitoring of prescribed burnings for security

and fire behaviour post analysis

– Final fire mop-up with hot-spots detection – Fire monitoring during night Based on the following characteristics: – Detection is not a goal in populated areas – No interference with standard air-planes – High cost of alternate solutions – Progressive complexity

slide-45
SLIDE 45

45

Remote Sensing, Salt Lake City, April 2008

Some numbers

Mean of burned surface per wildfire is 6Ha FLIR A320 camera characteristics: – 320 x 200 pixels – At 100 AGL: image is 40 x 30 m

  • --> 1 pixel = 0.02 square meters

– Frequency rate up to 9Hz UAV flight characteristics – 100 meters AGL – speed 60Km/h

  • --> Aprox. 3 minutes flight to scan 6Ha
slide-46
SLIDE 46

46

Remote Sensing, Salt Lake City, April 2008

Conclusions

ICARUS group research topics and proposals for

(small) UAS

– Hardware/Software embedded architecture – Human-Machine Interfaces – End Users Requirements and Procedures – Integration of UAV in air space (future)‏ Forest fire is an target civil application for: – Segregated airspace – UAS operation is cost effective – Commercially viable

slide-47
SLIDE 47

47

Remote Sensing, Salt Lake City, April 2008

Conclusions

Not all geographical scenarios are equivalent;

countries with large unpopulated areas may require emphasis in “detection”

Other applications (fire perimeter detection, crop

monitoring, rescue of lost people, ...) need a previous successful stories

slide-48
SLIDE 48

48

Remote Sensing, Salt Lake City, April 2008

Muchas gracias