Dima Damen

News

Aug 2019: We release pretrained models and technical report for action recognition on EPIC-Kitchens

July 2019: Our paper "Learning Visual Actions Using Multiple Verb-Only Labels" accepted for presentation at BMVC2019 is available on Arxiv

July 2019: Two papers accepted at ICCV 2019, "EPIC-Fusion: Audio-Visual Temporal Binding for Egocentric Action Recognition" with Evangelos Kazakos (Bristol), Arsha Nagrani and Andrew Zisserman (Oxford), and "Fine-Grained Action Retrieval through Multiple Parts-of-Speech Embeddings" with Mike Wray (Bristol), Gabriela Csurka and Diane Larlus (Naver Labs)

July 2019: I'll be giving keynotes at the ICCV2019 workshop YouTube8M, ICCV2019 workshop ACVR, and at the BMVC2019 workshop EgoApp

July 2019: CFP BMVA symposium on Video Understanding in London - 25 Sep

June 2018: Slides from my tutorial at North African Summer School in Machine Learning (NASSMA) are now online

Apr 2019: Camera ready version and details of our paper Dual-Domain LSTM for Cross-Dataset Action Recognition - CVPR 2019 now online

Apr 2019: Camera ready version and details of our paper The Pros and Cons: Rank-aware Temporal Attention for Skill Determination in Long Videos - CVPR 2019 now online

Apr 2019: Fifth EPIC workshop accepted - EPIC@ICCV2019 will be held in Seoul this Oct/Nov

Apr 2019: Will be giving a keynote at the 7th Workshop on Assistive Computer Vision and Robotics alongside ICCV in Seoul this October.

Apr 2019: Camera ready version and details of our paper Action Recognition from Single Timestamp Supervision in Untrimmed Videos - CVPR 2019 now online and on Arxiv

Mar 2019: Looking forward to returning as a speaker for the 2019 BMVA summer school in Lincoln this June

Mar 2019: Slides for my keynote at VISAPP now online

Older news...

Mar 2019: Invited as one of the speakers at the First North African summer school in Machine Learning NASSMA

Feb 2019: Three papers accepted at CVPR 2019 (coming soon on Arxiv)

Feb 2019: Keynote at VISAPP 2019 in Prague

Dec 2018: EPIC@CVPR2019 Workshop to take place in Long Beach

Oct 2018: Scheduled talk at MPI Tubingen - details

Sep 2018: EPIC-KITCHENS presented as Oral at ECCV 2018 - camera ready available Arxiv, Webpage

Sep 2018: Leaderboards for the EPIC-KITCHENS challenges on CodaLab are now open

Sep 2018: Two papers presented at BMVC 2018. Action Completion (Dataset) and CaloriNet

Aug 2018: EPIC-SKILLS dataset, for our CVPR2018 paper is now online

Aug 2018: Programme for EPIC@ECCV2018 workshop is now available. Join us in Munich on Sep 9th

July 2018: Looking forward to giving a tutorial on egocentric vision as part of the BMVA Summer School on July 5th, University of East Anglia.

Apr 2018: EPIC-KITCHENS 2018 goes live today: 11.5M Frames, full HD, 60fps, head-mounted, 32 kitchens from 4 cities (in North America and Europe), 10 nationalities. FULLY annotated: 40K action segments, 454K object bounding boxes. Dataset: http://epic-kitchens.github.io Details at: Arxiv

Apr 2018: Our paper "Human Routine Change Detection using Bayesian Modelling" accepted at ICPR2018, to be presented in Beijing this August. Details

Feb 2018: Our paper "Who's Better, Who's Best" accepted at CVPR2018, to be presented in Salt Lake city this June. Details

Feb 2018: Congrats to Yangdi Xu for passing his PhD viva with minor corrections

Jan 2018: Serving on the High Performance Computing exec board at UoB

Oct 2017: Selected as outstanding reviewer at ICCV 2017

Oct 2017: Well-attended Second Int. Egocentric Perception Interaction and Computing (EPIC) workshop alongside ICCV in Venice

Oct 2017: Our paper "Trespassing the Boundaries: Labeling Temporal Bounds for Object Interactions in Egocentric Video" was presented in ICCV - details

Oct 2017: Our paper "Recurrent Assistance: Cross-Dataset Training of LSTMs on Kitchen Tasks" was presented at ACVR - pdf

Sep 2017: Unit details for the new Applied Deep Learning M level unit - Uni Catalogue

Sep 2017: Serving as associate editor for Pattern Recognition

Aug 2017: Happy to be working as a consultant with Bristol's Cookpad on developing their Computer Vision and Machine Learning agenda

Apr 2017: 6 July - Lincoln, BMVA summer school, will be giving a tutorial on Egocentric Vision

Apr 2017: 15 May - Bristol, will be giving a public talk on 'What can a wearable camera know about me?'

Mar 2017: Slides from my talk on Challenges and Opportunities for Action and Activity Recognition using RGBD Data, BMVA Symposium are now available

Feb 2017: Videos from BMVA symposium on Transfer Learning now available

Dec 2016: Final programme for BMVA Symposium on Transfer Learning now available

Oct 2016: Code Released for 3DV paper on acquisition and registration of point clouds using two facing Kinects

Sep 2016: 3D Data Acquisition and Registration Using Two Opposing Kinects - Paper accepted at 3DV

Aug 2016: Action Completion paper accepted at BMVC and dataset released - Project Webpage

Aug 2016: Nokia Technologies donation of €50K Press release

Aug 2016: Action Completion paper accepted at BMVC, York, Sep 2016. project

July 2016: PhD students Michael Wray and Davide Moltisanti awarded second poster prize at BMVA summer school news

July 2016: CFP: Transfer Learning in Computer Vision - BMVA Symposium [details, dates and submission]

Jun 2016: PhD opening in Computer Vision and Machine Learning (Home/EU students) - Open Until , ad on jobs.ac.uk

Jun 2016: CVPR 2016 Demo for GlaciAR

May 2016: EPIC@ECCV2016 Workshop (Egocentric Perception, Interaction and Computing) Accepted.

Apr 2016: EPSRC Project LOCATE to be funded starting July 2016

Mar 2016: You-Do, I-Learn: Egocentric Unsupervised Discovery of Objects and their Modes of Interaction Towards Video-Based Guidance accepted at CVIU

Nov 2015: EPSRC Project GLANCE to be funded starting March 2016

Sep 2015: Paper "Unsupervised Daily Routine Modelling from a Depth Sensor using Bottom-Up and Top-Down Hierarchies" accepted at ACPR

Sep 2015: Paper "Estimating Visual Attention from a Head Mounted IMU" presented at ISWC in Okasa, Japan

Sep 2015: Paper "Real-time RGB-D Tracking with Depth Scaling Kernelised Correlation Filters and Occlusion Handling" Presented at BMVC

Aug 2015: PhD Student Vahid Soleiman publishes paper on Remote Pulmonary Function Testing using a Depth Sensor at BIOCAS 2015. Demo Video

June 2015: PLOSONE article available online

June 2015: SI on cognitive robotics systems: concepts and applications at the Journal of Intelligent & Robotic Systems is online

Mar 2015: Interdisciplinary research internship awarded for CS student Hazel Doughty.

Sep 2014: Paper "You-Do, I-Learn: Discovering Task Relevant Objects and their Modes of Interaction from Multi-User Egocentric Video" presented at BMVC

Sep 2014: Paper "Online quality assessment of human movement from skeleton data" presented at BMVC

Sep 2014: Paper "Multi-user egocentric Online System for Unsupervised Assistance on Object Usage" presented at ECCVW (ACVR 2014)

Aug 2014: C++ code (improved performance v 1.2) and Android apk for real-time object detector available.

July 2014: The Bristol Egocentric Object Interactions Dataset has now been released

July 2014: Book review published in IAPR newsletter

July 2014: Video lectures from BMVC 2013 are now available online.

July 2014: Sphere project's website irc-sphere.ac.uk has now been released (2013-2018).

May 2014: Project Ideas for 3G403 and 2G400 students available.

Feb 2014: PhD Opening in Ego-centric Vision - apply as soon as possible...

Nov 2013: Project GlaciAR is starting funded by Samsung's GRO 2013 Awards

Nov 2013: Cognitive Robotics Systems (CRS 2013) (IROS 2013 workshop), successfully concludes at Tokyo, Japan.

Sep 2013: BMVC 2013 successfully concluded at Bristol

Aug 2013: Outstanding Reviewer award at IEEE AVSS 2013.

June 2013: Outstanding Reviewer award at IEEE CVPR 2013.

May 2013: New bug-fixed version (v1.1) of our Multi-Object Detector (MOD) code is now available online

Research Projects

Fine-Grained Action Retrieval

Video

Fine-Grained Action Retrieval through Multiple Parts-of-Speech Embeddings. Michael Wray, Diane Larlus, Gabriela Csurka, Dima Damen. ICCV (2019). ArXiv Preprint, Project Details

Audio-Visual Temporal Binding for Egocentric Action Recognition

Video

EPIC-Fusion: Audio-Visual Temporal Binding for Egocentric Action Recognition. Evangelos Kazakos, Arsha Nagrani, Andrew Zisserman, Dima Damen. ICCV (2019). Project Details, PDF, Arxiv

Learning Visual Actions Using Multiple Verb-Only Labels

Video

Learning Visual Actions Using Multiple Verb-Only Labels. M Wray, D Damen. BMVC (2019). ArXiv Preprint, Project Details

DDLSTM: Dual-Domain LSTM

Video

DDLSTM: Dual-Domain LSTM for Cross-Dataset Action Recognition. T Perrett and D Damen. CVPR (2019). pdf preprint, Arxiv Project Details

The Pros and Cons: Rank-Aware Attention Modules

Teaser Video

Results Video

The Pros and Cons: Rank-aware Temporal Attention for Skill Determination in Long Videos. H Doughty, W Mayol-Cuevas, D Damen. CVPR (2019). pdf preprint, Arxiv, Project Details

Action Recognition from Single Timestamps

Results Video

Action Recognition from Single Timestamp Supervision in Untrimmed Videos. D Moltisant, S Fidler and D Damen. CVPR (2019). pdf preprint, Project Details

Scaling Egocentric Vision: EPIC-KITCHENS 2018

Video

Scaling Egocentric Vision: The EPIC-KITCHENS Dataset. D Damen, H Doughty, G Farinella, S Fidler, A Furnari, E Kazakos, D Moltisanti, J Munro, T Perrett, W Price, M Wray. ECCV (2018). Webpage | Dataset | arxiv

An Evaluation of Action Recognition Models on EPIC-Kitchens. W Price, D Damen. Arxiv (2019) Arxiv | Github | PDF

Skill Determination in Video

Video

Who's Better? Who's Best? Pairwise Deep Ranking for Skill Determination. H Doughty, D Damen, W Mayol-Cuevas. CVPR (2018). PDF | arxiv | Dataset

Action Completion: A Temporal Model for Moment Detection

Video2018, Video2016

Action Completion: A Temporal Model for Moment Detection. F Heidarivincheh, M Mirmehdi, D Damen. British Machine Vision Conference (BMVC), Sep 2018. Arxiv PDF | Dataset

Beyond Action Recognition: Action Completion in RGB-D Data. F Heidarivincheh, M Mirmehdi, D Damen. British Machine Vision Conference (BMVC), Sep 2016. pdf | abstract | Dataset

Human Routine Modelling and Change Detection

Human Routine Change Detection using Bayesian Modelling. Y Xu, D Damen. ICPR (2018). PDF

Unsupervised Long-Term Routine Modelling using Dynamic Bayesian Networks. Y Xu, D Bull, D Damen. DICTA (2017). PDF

Trespassing the Boundaries of Object Interactions

Video

Trespassing the Boundaries: Labeling Temporal Bounds for Object Interactions in Egocentric Video. D Moltisanti, M Wray, W Mayol-Cuevas, D Damen. International Conference on Computer Vision (ICCV), 2017. pdf (camera ready) | arxiv

Semantic Embedding for Egocentric Actions

Video

SEMBED: Semantic Embedding of Egocentric Action Videos. M Wray, D Moltisanti, W Mayol-Cuevas, D Damen. Egocentric Interaction, Perception and Computing (EPIC), European Conference on Computer Vision Workshops (ECCVW), Oct 2016. pdf | Dataset

You-Do, I-Learn

Video1 (2014), Video2 (2017)

Automated capture and delivery of assistive task guidance with an eyewear computer: The GlaciAR system. T Leelasawassuk, D Damen, W Mayol-Cuevas. Augmented Human, Mar 2017 pdf

You-Do, I-Learn: Discovering Task Relevant Objects and their Modes of Interaction from Multi-User Egocentric Video. D Damen, T Leelasawassuk, O Haines, A Calway, W Mayol-Cuevas. British Machine Vision Conference (BMVC), Sep 2014. PDF | Abstract | Dataset

Multi-user egocentric Online System for Unsupervised Assistance on Object Usage. D Damen, O Haines, T Leelasawassuk, A Calway, W Mayol-Cuevas. ECCV Workshop on Assistive Computer Vision and Robotics (ACVR), Sep 2014. PDF Preprint

Estimating Visual Attention from a Head Mounted IMU. T Leelasawassuk, D Damen, W Mayol-Cuevas. International Symposium on Wearable Computers (ISWC), Sep 2015. PDF

DS-KCF: Depth-Based Real-Time Single Object Tracker

Video 1 | Video 2 | Code

Real-time RGB-D Tracking with Depth Scaling Kernelised Correlation Filters and Occlusion Handling. M Camplani, S Hannuna, M Mirmehdi, D Damen, L Tao, T Burghardt and A Paiment. British Machine Vision Conference (BMVC), Sep 2015. PDF.

Real-time Learning and Detection of 3D Texture-minimal Objects

Video | Code

Real-time Learning and Detection of 3D Texture-minimal Objects: A Scalable approach. D Damen, P Bunnun, A Calway, W Mayol-Cuevas. British Machine Vision Conference (BMVC), Sep 2012. PDF | Abstract | Code | Video | Dataset.

Efficient Texture-less Object Detection for Augmented Reality Guidance. T Hodan, D Damen, W Mayol-Cuevas, J Matas. IEEE Int. Symposium on Mixed and Augmented Reality (ISMAR) Workshop on Visual Recognition and Retrieval for Mixed and Augmented Reality, Sep 2015.

Egocentric Real-time Industrial Workflow

Video 1 | Video 2

Cognitive Learning, Monitoring and Assistance of Industrial Workflows Using Egocentric Sensor Networks. G Bleser, D Damen, A Behera, et al. PLOSONE, June 2015 PDF.

Egocentric Real-time Workspace Monitoring using an RGB-D Camera. D Damen, A Gee, W Mayol-Cuevas, A Calway. Intelligent Robotics and Systems (IROS), Oct 2012. PDF | Video.

Online Quality Assessment for Human Motion

Code

Online quality assessment of human movement from skeleton data. A Paiment, L Tao, S Hannuna, M Camplani, D Damen and M Mirmehdi. British Machine Vision Conference (BMVC), Sep 2014. PDF | Dataset.

The Bicycle Problem

Explaining Activities as Consistent Groups of Events - A Bayesian Framework using Attribute Multiset Grammars. D Damen and D Hogg International Journal of Computer Vision (IJCV), 2012. PDF.

Recognizing Linked Events: Searching the Space of Feasible Explanations. D Damen and D Hogg. Computer Vision and Pattern Recognition (CVPR), Miami, Florida, June 2009. PDF | Poster

Detecting Carried Objects from Walking Pedestrians

Video | Code

Detecting Carried Objects from Sequences of Walking Pedestrians. D Damen and D Hogg. Pattern Analysis and Machine Intelligence (PAMI), 2012. PDF.

Detecting Carried Objects in Short Video Sequences. D Damen and D Hogg. European Conference on Computer Vision (ECCV), Marseille, France, Oct 2008 PDF | Poster

Current Students and Postdocs

Previous Students, and Postdocs