cDeepArch: A Compact Deep Neural Network Architecture for Mobile - PowerPoint PPT Presentation
cDeepArch: A Compact Deep Neural Network Architecture for Mobile Sensing Kang Yang 1 , Xiaoqing Gong 1 , Yang Liu 2 , Zhenjiang Li 2 , Tianzhang Xing 1 , Xiaojiang Chen 1 , Dingyi Fang 1 1 Northwest University, China 2 City University of Hong Kong
cDeepArch: A Compact Deep Neural Network Architecture for Mobile Sensing Kang Yang 1 , Xiaoqing Gong 1 , Yang Liu 2 , Zhenjiang Li 2 , Tianzhang Xing 1 , Xiaojiang Chen 1 , Dingyi Fang 1 1 Northwest University, China 2 City University of Hong Kong 1
Motivation … Camera + Learning Gyro. Technology Acc.
Application ? Cognitive decline
Application First-person view Cognitive aid system Recognizing pot cup open open close
Common design principle . . . Rich sensor data Recognized by learning Applications
Challenges Large targets . . .
Challenges • Deep Learning Too large Big deep neural network Resource-limited
Challenges • Deep Learning inaccurate Original Shrunk No quantitative measure on model model available resource conditions
Any countermeasure? 0101… Server • Long and uncontrollable latency • High Service cost Potential privacy leakage •
Our solution Context (office) Large targets . . .
Our solution compact network (Office) Context recognition + Object recognition Context-oriented (computer, large and deep network target recognition mouse…) compact network adequate storage computation resource
Our solution energy Context recognition computation + Available resource conditions Context-oriented target recognition • not based on designer’s experience • Formulation facilitated configuration
Convolutional Neural Network Image data Conv1 Pool1 Conv2 Pool2 FC1 • Convolutional layer (dominant) • Pooling layer • Full connected layer
Formulation facilitated configuration Selected W F W o *W o S P C (W+2P)*(W+2P)
From computation to resource cost Conv1:64 fc:5 Conv2:128 computation resource(energy) designed network Conv1:16 Conv2:32 fc:5 : computation : actual resource consumption a small scale network
Now… Context recognition + Object recognition Context-oriented target recognition Recognition task decomposition • • Formulation facilitated configuration From formulation to estimate the resource consumption •
Enhancement: Convolutional layer Original Conv1 Conv2 Conv3 model Separated Conv1a Conv1b Conv2 Conv3 model #$ % − ⁄ 1 ) ⁄ ! ≤ ) 2
Evaluation
Experiments setup Dataset: • o Context recognition : § MIT Place2 (related to the daily contexts ) Object recognition : o § Cifar10 § Cifar100 (20 classes associated contexts)
Evaluation results • Overall performance 10 targets 20 targets
Conclusion 1, 2, 3 1. Large targets Decompose recognition task 2. Systematic way to configure network Execution overhead formulation facilitated configuration 3. Enhancement techniques
Recommend
More recommend
Explore More Topics
Stay informed with curated content and fresh updates.