approved
EASG - Action Scene Graphs for Long-Form Understanding of Egocentric Videos

We present Egocentric Action Scene Graphs (EASGs), a new representation for long-form understanding of egocentric videos. EASGs extend standard manually-annotated representations of egocentric videos, such as verb-noun action labels, by providing a temporally evolving graphbased description of the actions performed by the camera wearer, including interacted objects, their relationships, and how actions unfold in time. Through a novel annotation procedure, we extend the Ego4D dataset by adding manually labeled Egocentric Action Scene Graphs offering a rich set of annotations designed for long-from egocentric video understanding. We hence define the EASG generation task and provide a baseline approach, establishing preliminary benchmarks. Experiments on two downstream tasks, egocentric action anticipation and egocentric activity summarization, highlight the effectiveness of EASGs for long-form egocentric video understanding. We will release the dataset and the code to replicate experiments and annotations.

Tags
Data and Resources
To access the resources you must log in
  • Action Scene Graphs for Long-Form ...

    Official repository of the work "Action Scene Graphs for Long-Form...

    The resource: 'Action Scene Graphs for ...' is not accessible as guest user. You must login to access it!
Personal Data Attributes

Description: Personal Data related Information

Field Value
Anonymised Anonymized
ChildrenData No
General Data No
Personal Data No
Personal data was manifestly made public by the data subject No
Sensitive Data No
Additional Info
Field Value
Accessibility OnLine
Associate Project FAIR
Basic rights Download
Creation Date 2025-03-24
Creator Farinella, Giovanni, giovanni.farinella@unict.it, orcid.org/0000-0002-6034-0432
Data sharing agreement no
Dataset Citation @inproceedings{rodin2023action, primaryclass = { cs.CV }, archiveprefix = { arXiv }, eprint = { 2312.03391 }, pdf = { https://arxiv.org/pdf/2312.03391.pdf }, year = { 2024 }, booktitle = { Conference on Computer Vision and Pattern Recognition (CVPR) }, title = { Action Scene Graphs for Long-Form Understanding of Egocentric Videos }, author = { Ivan Rodin and Antonino Furnari and Kyle Min and Subarna Tripathi and Giovanni Maria Farinella }, }
Field/Scope of use Any use
Group Others
License term 2025-03-24
Processing Degree Primary
SoBigData Node SoBigData IT
Sublicense rights No
Territory of use World Wide
Thematic Cluster Other
system:type Dataset
Management Info
Field Value
Author Farinella Giovanni Maria
Maintainer Farinella Giovanni Maria
Version 1
Last Updated 22 June 2025, 01:05 (CEST)
Created 22 June 2025, 01:05 (CEST)