Ev Evolutionary Automation of Coordinated Aut Autono nomous us - - PowerPoint PPT Presentation

ev evolutionary automation of coordinated aut autono
SMART_READER_LITE
LIVE PREVIEW

Ev Evolutionary Automation of Coordinated Aut Autono nomous us - - PowerPoint PPT Presentation

Ev Evolutionary Automation of Coordinated Aut Autono nomous us Vehi hicles Chien-Lun Huang (Allen) and Dr Geoff Nitsschke Increased research in adaptive control systems for autonomous vehicles. Existing research focuses on autonomous


slide-1
SLIDE 1

Ev Evolutionary Automation of Coordinated Aut Autono nomous us Vehi hicles

Chien-Lun Huang (Allen) and Dr Geoff Nitsschke

slide-2
SLIDE 2

Motivation

  • Increased research in adaptive control

systems for autonomous vehicles.

  • Existing research focuses on autonomous

control of single vehicle or limited noise in the environment

  • Little research into comparison between

various evolutionary search methods for autonomous vehicle behaviour

slide-3
SLIDE 3

Methods

Neuro-Evolution of Augmenting Topologies (NEAT) directed evolutionary search. We compared three different search methods: 1. Objective-based 2. Behaviour-based (Novelty Search) 3. Hybrid (Objective + Behaviour) Goal: evolve effective and efficient coordinated driving behaviour through given roads

slide-4
SLIDE 4

Methods

Neuro-Evolution of Augmenting Topologies (NEAT) directed evolutionary search. We compared three different search methods: 1. Objective-based

slide-5
SLIDE 5

Methods

Neuro-Evolution of Augmenting Topologies (NEAT) directed evolutionary search. We compared three different search methods: 1. Objective-based 2. Behaviour-based (Novelty Search)

k – k-Nearest Neighbours in generation + archive dist – Euclidean Distance μ – ith nearest neighbour X – behaviour w.r.t novelty metric Behaviour Characterisation: Speed and Cohesion, Speed* and Location

*experimentally determined

slide-6
SLIDE 6

Methods

Neuro-Evolution of Augmenting Topologies (NEAT) directed evolutionary search. We compared three different search methods: 1. Objective-based 2. Behaviour-based (Novelty Search) 3. Hybrid (Objective + Behaviour)

ρ = 0.5, equally combining fitness and novelty Fitness and Novelty score normalised before combination

slide-7
SLIDE 7

Experiments

Two sets of Experiments:

  • Evolution Experiment
  • Fitness, Novelty and Hybrid to determine

which performs the best in evolving vehicle driving behaviour.

  • Generalisation Test Experiments
  • Highest-performance evolved controllers were

tested with various different configurations (including unseen configurations [vehicle pool sizes] and environments [tracks])

  • Non-evolutionary, evaluation of evolved

controllers.

slide-8
SLIDE 8

Experiments

Simulation Environment

  • UnityNEAT
  • 3D hi-fidelity game engine
  • Vehicles
  • Modelled after pedestrian vehicle BMW M3
  • Pooled in groups of 1, 3 and 5
  • Task
  • 1 track for evolution with static and dynamic
  • bstacles
  • 3 additional unseen tracks for evaluation

experiments – each with static obstacles and varying altitude

  • Checkpoints placed equally spaced along track
slide-9
SLIDE 9

Vehicle configuration

  • 5 Pyramidal Sensors fanning out the front of

vehicle

  • Each sensor input into Neural Network + bias,

angle to next waypoint and current velocity

slide-10
SLIDE 10

Vehicle configuration

  • Hidden Layer (H1 in this diagram)
  • Output for steer and acceleration
slide-11
SLIDE 11

Vehicle Configuration

  • 1 vehicle
  • 3 vehicles
  • 5 vehicles
slide-12
SLIDE 12

Evolution Track

slide-13
SLIDE 13

Evaluation Track 1

slide-14
SLIDE 14

Evaluation Track 2

slide-15
SLIDE 15

Evaluation Track 3

slide-16
SLIDE 16

Results

Evolution Results: Hybrid > Objective (Fitness) and Hybrid All Methods achieved > 60% task performance. Supports existing research that hybrid approach can improve task performance in this type of task

slide-17
SLIDE 17

Evolution Results

Search space exploration heatmaps for each method indicates:

  • O: 60% of all evolved controllers in range between 0.2

and 0.4 task performance for all generations

  • N: Wider spread of controller behavior – expected from

novelty search since it’s a behavior maintenance technique, but low task performance overall. 80% within 0.0 and 0.3 task performance.

  • H: Even-spread of solutions, broader search space than

both O and N, was able to achieve higher task performance due to this.

Objective-based (fitness) Behaviour-based (novelty search) Hybrid

slide-18
SLIDE 18

Results

Evaluation Results: Objective (Fitness)-evolved controllers generalized the best Hybrid-evolved controllers generalized the worst

slide-19
SLIDE 19

Evaluation Results

Visualization of fittest controllers by each method (O, N, H) helps explain hybrid’s high task-performance on evolution track but inability to generalize as well as O and N. Both O and N evolved higher neural complex controllers whereas Hybrid evolved reactive networks that performed well on the evolution track only.

slide-20
SLIDE 20

Thank you

Please send questions to: allen@allenhuang.net / gnitschke@cs.uct.ac.za