The End-of-End- to-End: A Video Understanding Pentathlon CVPR - - PowerPoint PPT Presentation

▶

Jan 15, 2023 240 likes •352 views

The End-of-End- to-End: A Video Understanding Pentathlon CVPR workshop, Monday 15 th June 2020 Goal: develop systems that can achieve higher-level comprehension of videos (not just objects, but complex actions, events and long-lasting

SLIDE 1

The End-of-End- to-End: A Video Understanding Pentathlon

CVPR workshop, Monday 15th June 2020

SLIDE 2

Big Picture Motivation

Goal: develop systems that can achieve “higher-level” comprehension of videos (not just objects, but complex actions, events and long-lasting narratives) Computer vision has made tremendous progress at core tasks with CNNs trained end- to-end for classification, detection, segmentation etc. BUT….extending these methods for higher- level tasks is computationally expensive

SLIDE 3

Why use pretrained experts?

One way forwards is to use frozen “experts” – representations that have been pretrained on large-scale datasets Enables focus on key questions for higher-level tasks while dramatically reducing compute.

how to make best use of temporal information?
how to exploit multiple modalities?
how to achieve robustness across different domains?

Potential for broader participation outside industry

SLIDE 4

Workshop

bjectives

A video pentathlon challenge – exploring different ways to use pretrained features to solve the retrieval task A forum for discussing ideas for video understanding

SLIDE 5

Schedule

https://www.robots.ox.ac.uk/~vgg/challenges/video-pentathlon/#schedule

SLIDE 6

Schedule

https://www.robots.ox.ac.uk/~vgg/challenges/video-pentathlon/#schedule

SLIDE 7

Schedule

https://www.robots.ox.ac.uk/~vgg/challenges/video-pentathlon/#schedule

SLIDE 8

Workshop Virtual Protocol

Your mic will be muted (except when asking questions) Use the chat to indicate that you would like to ask a question (we will also try to monitor YouTube)

SLIDE 9

Recording

We are recording this workshop to allow researchers in different timezones to access it later. If you would prefer not to be visible, please turn off your video (and mute) If you want to ask a question, but would prefer not to be in the recording, please let us know afterwards (we will remove this part from the released footage)

SLIDE 10

Questions for the organisers

2. Email: albanie@robots.ox.ac.uk
1. Use the chat