remote control interface for robots The Universal Robot Controller - - PowerPoint PPT Presentation

remote control interface for robots
SMART_READER_LITE
LIVE PREVIEW

remote control interface for robots The Universal Robot Controller - - PowerPoint PPT Presentation

Design of an intuitive and responsive remote control interface for robots The Universal Robot Controller Master Thesis Presentation by La Spada Luca The 03 February 2016 ------------------------------------------------------------- Ijspeert


slide-1
SLIDE 1

Design of an intuitive and responsive remote control interface for robots

The Universal Robot Controller

Master Thesis Presentation by La Spada Luca The 03 February 2016

  • Ijspeert Auke Jan - Master Project supervisor

Crespi Alessandro - Assistant Estier Thomas - External expert

1

slide-2
SLIDE 2

Outline

Introduction Architecture Results Conclusion

2

slide-3
SLIDE 3

Outline

Introduction

3

slide-4
SLIDE 4

Motivation

  • Remote-controllers
  • Non-autonomous robots and fully autonomous robots
  • Lack of evolutions
  • Ascertainment
  • Almost each robot has its dedicated remote-controller
  • Majority of people possess a mobile device (smartphone, tablet, etc.)
  • One remote-controller to rule them all
  • Custom GUIs for each robot
  • Access to sensors data

Introduction

4

slide-5
SLIDE 5

Goal

  • Developing a versatile remote-controller application
  • Run on various mobile devices
  • Compatible with various robots
  • Represent the same information differently
  • Providing a framework to design GUIs
  • Targeting B2B
  • Reusability of components
  • Several layouts for the same robot
  • Intuitive & Responsive

Introduction

5

slide-6
SLIDE 6

Proof of concept

Introduction

AmphiBot III by BioRob ROVéo Mini by Rovenso Absolem by Bluebotics

6

slide-7
SLIDE 7

Outline

Architecture

7

slide-8
SLIDE 8

Choices

  • Android
  • Reduce the complexity by supporting one OS
  • 80% of the market share worldwide
  • Hybrid Apps
  • External: Native App
  • Internal: Web App
  • Web technologies

(JavaScript, HTML5, CSS)

  • Multi-platform
  • Flexibility
  • Intuitive & Responsive

Introduction Architecture

Platform affinity Access to device capabilities

Native Apps  Single platform affinity  Platform SDK  Access to all native APIs Mobile Web Apps  Cross-platform affinity  Web technologies  Runs on web server Hybrid Apps  Cross-platform affinity  Web technologies  Runs locally  Access to native APIs

8

slide-9
SLIDE 9

Communications Protocol

AmphiBot III

Android Application (URC) Amphibot ISM radio bands 866-868 MHz TCP/IP Request TCP/IP Response

Introduction Architecture

9

slide-10
SLIDE 10

Communications Protocol

ROVéo Mini

Introduction Architecture

RoveoMini

SSH

Arduino Yún Android Application (URC)

Telnet

10

slide-11
SLIDE 11

Communications Protocol

Absolem

Absolem Android Application (URC) Websocket using library roslibjs

Introduction Architecture

11

slide-12
SLIDE 12

External

Introduction Architecture

Android Application WebView Robots Website Websocket Xhr Response Bridges (TCP/IP, SSH) Javascript Interface Universal Robot Repository

Xhr = XMLHttpRequest

12

slide-13
SLIDE 13

Internal

Introduction Architecture

Robots Website Bridges (TCP/IP, SSH)

GUI Page

Settings Page Menu Page Widget 1 Widget ... Widget N Interface Driver Websocket Xhr Request Xhr Response

Javascript Interface

(a) (a) (a) (b)

Drivers Manager Page

(and Interfaces Manager)

Storage IndexedDB Package Manager

(2) (4)

Universal Robot Repository Widgets Interfaces Drivers Xhr Request Xhr Response

13

slide-14
SLIDE 14

Internal

Introduction Architecture

Robots Bridges (TCP/IP, SSH)

GUI Page

Widget 1 Widget ... Widget N Interface Driver Websocket Xhr Request Xhr Response

Javascript Interface

(a) (a) (a) (b)

r Page Package Manager

(2) (4)

Universal Robot Repository Widgets Interfaces Drivers Xhr Request Xhr Response

14

slide-15
SLIDE 15

Internal

Menu

Introduction Architecture

15

slide-16
SLIDE 16

Internal

Driver Manager

Introduction Architecture

16

slide-17
SLIDE 17

Internal

Settings

Introduction Architecture

17

slide-18
SLIDE 18

Internal

GUI

Introduction Architecture

18

slide-19
SLIDE 19

Outline

Results

19

slide-20
SLIDE 20

AmphiBot III

Introduction Architecture Results

20

slide-21
SLIDE 21

ROVéo Mini

Introduction Architecture Results

21

slide-22
SLIDE 22

Absolem (1)

Introduction Architecture Results

22

slide-23
SLIDE 23

Absolem (2)

  • Laser range finder

Introduction Architecture Results

23

slide-24
SLIDE 24

Absolem (3)

  • Mobile device motion sensor

Introduction Architecture Results

24

slide-25
SLIDE 25

URC in action

Introduction Architecture Results

25

slide-26
SLIDE 26

Outline

Conclusion

26

slide-27
SLIDE 27

Now

  • Control a wide variety of robots
  • Reusability widgets
  • Use existing JavaScript component
  • Several interfaces for a robot
  • Debug
  • Consumer
  • Adaptability & Accessibility
  • Easily portable to other support (iOS, Windows Phone, PC)

Introduction Architecture Benchmark Conclusion

27

slide-28
SLIDE 28

Improvement

  • Create an UDP bridge
  • Improve settings webpage
  • Universal Robot Repository is a proof of concept

Introduction Architecture Benchmark Conclusion

28