User-Assisted Creation of Semantic Indoor Models for Smarter - - PowerPoint PPT Presentation

user assisted creation of semantic indoor models for
SMART_READER_LITE
LIVE PREVIEW

User-Assisted Creation of Semantic Indoor Models for Smarter - - PowerPoint PPT Presentation

Fakultt fr Informatik Technische Universitt Mnchen User-Assisted Creation of Semantic Indoor Models for Smarter Applications Matthias Mgerle Advisors: Dr. Marc-Oliver Pahl, Stefan Liebald Supervisor: Prof. Dr.-Ing. Georg Carle Chair


slide-1
SLIDE 1

Fakultät für Informatik

Technische Universität München

User-Assisted Creation of Semantic Indoor Models for Smarter Applications

Matthias Mögerle

Advisors: Dr. Marc-Oliver Pahl, Stefan Liebald Supervisor: Prof. Dr.-Ing. Georg Carle Chair of Network Architectures and Services Department of Informatics Technical University of Munich (TUM)

27.11.2017

slide-2
SLIDE 2

2 27.11.2017 Matthias Mögerle

Imagine: Using the microphone of your smartphone to turn on the light in a smart environment.

Motivation: Location in Smart Environments

Questions:

  • All lights?
  • Which light?
  • Location of the user?

According [1] [WiFi] can deliver room-level accuracy, which is good enough for many applications, including asset-tracking, location-based advertising, location-based information for users, etc. ”People are going to want everyday applications to have location-awareness that goes beyond simple numerical latitude and longitude [..] - places like ’my home’ or ’Ed’s office’ which are within room-level granularity” [2]

[1] T. Gallagher, B. Li, A. G. Dempster, and C. Rizos, “Database updating through user feedback in fingerprint-based Wi-Fi location systems,” UPINLBS 2010, 2010. [2] D. H. Kim, K. Han, and D. Estrin, “Employing user feedback for semantic location services,” in Proceedings of UbiComp ’11, 2011, p. 217.

slide-3
SLIDE 3

3 27.11.2017 Matthias Mögerle

Motivation: Location in Smart Environments

Lisa‘s Room Max‘s Room Master Bedroom Bath Kitchen Living Room Deck

Closet

Parasitic use of Sensor Data

Sensors

  • No installation of

additional infra- structure

  • Using available

mobile phone sensors Clustered Locations via ML

  • Location recognition
  • Continuous adaptions
  • Robust against changes
  • Cryptic Identifier

Home

  • Lisa’s Room
  • Max’s Room
  • Kitchen
  • Master Bedroom
  • Bath
  • Closet
  • Living Room
  • Deck

Labelled Locations

  • Detected Rooms
  • Human natural identifiers
  • User feedback mechanism
  • Minimal intrusive and

maximal accurate Provide Data via API

  • Third Parties
  • Smart Environments
  • History about the location
  • Current Location
  • Available Locations

Sensor Input Clustering Labelling API

slide-4
SLIDE 4

4 27.11.2017 Matthias Mögerle

Outline

Motivation

Research Goal

Related Work for Indoor Positioning Systems

Analysis and Requirements

State of The Art (Sensors, Clustering, Labelling)

Design and Implementation

Evaluation

Project Status

slide-5
SLIDE 5

5 27.11.2017 Matthias Mögerle

[3] Andreas Haeberlen, Eliot Flannery, Andrew M. Ladd, Algis Rudys, Dan S. Wallach, and Lydia E. Kavraki. Practical robust localization over large-scale 802.11 wireless networks. Mobile computing and networking - MobiCom ’04 [4] Moustafa A Youssef, Ashok Agrawala, A Udaya Shankar, A Udaya Shankar, and A Udaya Shankar. WLAN location determination via clustering and probability distributions. Pervasive Computing and Communications, 2003.(PerCom 2003) [5] V. C. Ta, D. Vaufreydaz, T. K. Dao, and E. Castelli, “Smartphone-based user location tracking in indoor environment,” 2016 Int. Conf. Indoor Position. Indoor Navig. IPIN 2016, no. October, pp. 4–7, 2016. [6] Philipp Bolliger. Redpin - Adaptive, Zero-Con guration Indoor Localization through User Collaboration. Melt’08, pages 55–60, 2008. [7] Philipp Bolliger, Kurt Partridge, Maurice Chu, and Marc Langheinrich. Improving Location Fingerprinting through motion detection and asynchronous interval labeling. Lecture Notes in Computer, 5561 LNCS:37–51, 2009. [8] https://www.ekahau.com/

Research Goal and Related Work

The goal of this thesis is to enhance state of the art research on indoor positioning and combine it with an application for real world use. a) provide accurate indoor location in private smart environments without adding hardware b) focus on measurable results on usability, feasibility and accuracy

Research Goal

Related Work Sensors Clustering Labelling Comments

Gaussian Fit [3] Joint Clustering [4] IPIN Tracking Competition [5] RedPin [6] PILS [7] Ekahau Real-Time Location Systems [8] WiFi WiFi WiFi, GPS, IMU Sensors, Cameras WiFi WiFi, Accelerometer WiFi, RFID (active) Bayesian Inference & Signal Intensity Distr. Pre-processing k-Strongest Fingerprints Sensor fusion, Extreme gradient boost, dead reckoning Least square error to identify error between old and new locations Signal Intensity Distr. Probabilistic model na Initial Expert Labelling Topological Map Initial Expert Labelling Individual room-labels No floor plan required Floor Plan, Hierarchical Map No initial training Labelling by user during use Individual labels Individual labels No floor plan required Initial Expert Labelling Floor plan required Room-Level Accuracy Focus on performance gains Training on one explicit case Labelling by user Identifies user movements for feedback requests Industrialized solution RFID increase accuracy

slide-6
SLIDE 6

6 27.11.2017 Matthias Mögerle

Analysis and Requirements

<R.1> Sensors to gather location data

  • No additional infrastructure
  • Using smartphone sensors

<R.2> Clustering to recognize relevant locations

  • Continuous learning
  • Room-level accuracy
  • Accuracy & Robustness

The goal of this thesis is to enhance state of the art research on indoor positioning and combine it with an application for real world use. a) provide accurate indoor location in private smart environments without adding hardware b) focus on measurable results on usability, feasibility and accuracy Research Goal <R.3> Labelling with user-feedback

  • User intrusiveness
  • Accuracy & Robustness
  • Environment representation
  • Hierarchical (e.g. Home/Living

Room) <R.4> API for other applications − Labelled indoor positioning information for home environments. − Quantifiable results must be comparable to further research. Requirements Results

slide-7
SLIDE 7

7 27.11.2017 Matthias Mögerle

Sensors – State of The Art

Technology Indoor

  • Pos. Use

Transmission Range Available Infrastructure Reliability GPS GSM WiFi Bluetooth (LE) RFID Vision Based Optically Auditive IMU Low Medium High High Medium Medium Medium Medium Low (IMU

  • nly)

Globally

  • Max. 35 km per cell

50-100 meter 10 – 15 meter 1m (passive) and up to 100m (active) Camera dependent Requires LOS Range of sound Unlimited with increasing error Not required Not required High Medium Low Low Low Low Not required Relies on GPS satellites Depending on GSM cells Depending on WiFi infrastructure Depending on Bluetooth infrastructure Depending on RFID infrastructure Depending on camera infrastructure Depending on light infrastructure Depending on audio infrastructure Depending on sensors

slide-8
SLIDE 8

8 27.11.2017 Matthias Mögerle

Clustering – Semi-Supervised Learning – State of The Art

  • Cell Proximity (Cell ID)

(simple, but inaccurate)

  • Triangulation

(difficult, can be accurate)

  • Fingerprinting

(passive, room-level accurate) Localization - Methods

  • K-Nearest Neighbours
  • As default
  • Label of fingerprints with least error
  • Quick
  • K-Means
  • Quick
  • Neural Networks
  • Expensive Training Phase

Clustering - Methods

  • SVM (Support Vector Machine)
  • Supervised Learning
  • Expensive Training Phase
  • DBSCAN/OPTICS
  • Cluster separation
  • Cluster density variation
  • Expensive Training Phase
slide-9
SLIDE 9

9 27.11.2017 Matthias Mögerle

Labelling – State of The Art

  • Geocoordinates (Longitude, Latitude)
  • Semantic Labelling
  • Hierarchical Representation

Environment Representation

  • (Initial) expert labelling
  • User labelling on map
  • User labelling on movement status (still/moving)

State of the Art

  • Active Feedback requests
  • Passive Feedback

 As accurate as required and as minimal intrusive as possible.

User Feedback

slide-10
SLIDE 10

10 27.11.2017 Matthias Mögerle

My Android Positioning App – Design

Sensor Inputs Indoor Positioning (Clustering) Semantic Labelling API to Smart Env. Quantified Self Smart Environment

slide-11
SLIDE 11

11 27.11.2017 Matthias Mögerle

Current Status: Framework to test different clustering and labelling algorithms

  • Accelerometer
  • WiFi Fingerprinting

My Android Positioning App – Implementation

  • k-Nearest Neighbours
  • Planned:
  • k-Means
  • Support Vector Machines
  • OPTICS
  • For Evaluation: Evaluation Unit
  • Hierarchical environment Representation
  • Notification for User Feedback
  • Notification, Vibration,…
  • UI to administrate locations
  • For Evaluation: Evaluation Unit

API to 3rd Party Apps API to Smart Environments Sensors Clustering Labelling API Database

  • Raw Inputs
  • Movements
  • Aggregated Fingerprints
  • Identified Locations
  • Labels of Locations

Event Handler and Listener

  • Handling Sensor Events
  • Handling Location Detections
  • Handling Location Labelling

Background Process

  • Android Process

My Android Positioning App User Interface

  • UI Elements

Done To be done

slide-12
SLIDE 12

12 27.11.2017 Matthias Mögerle

Evaluation

− Number of notifications vs. accuracy − User-Feedback (SUS Test, Interviews) − Average duration per room labelling − Feedback requests per time and location − Ratio of labelled clusters (dependent on identified clusters) − How motivated has the user been to provide feedback?

Labelling – Quality of labelling method

− Accuracy − Number of Samples vs. Accuracy − Calculation Time/Calculation Cycles

  • vs. Number of Measurements/Number of Locations

− Robustness against changes (reducing available networks, adding additional networks)

Clustering – Quality of different clustering algorithms

slide-13
SLIDE 13

13 27.11.2017 Matthias Mögerle

Project Status

Schedule

slide-14
SLIDE 14

14 27.11.2017 Matthias Mögerle

Discussion

Further interesting measurements?

More ideas on the evaluation process?

Anything else?