approved
EgoISM-HOI - Exploiting Multimodal Synthetic Data for Egocentric Human-Object Interaction Detection in an Industrial Scenario

We tackle the problem of Egocentric Human-Object Interaction (EHOI) detection in an industrial domain. To overcome the lack of public datasets in this context, we propose a pipeline and a tool able to generate synthetic images of EHOIs paired with several annotations and data signals. Using the proposed pipeline, we present EgoISM-HOI a new multimodal dataset composed of synthetic EHOI images in an industrial environment with rich annotations of hands and objects. To demonstrate the utility of synthetic data, we designed an EHOI detection method that uses the different multimodal signals available within our dataset. Our study shows that exploiting synthetic data to pre-train the proposed system significantly improves performance when tested on real-world data. Additional experiments show that the proposed approach outperforms classic baseline approaches based on state-of-the-art class agnostic methods.

Tags
Data and Resources
To access the resources you must log in
Additional Info
Field Value
Accessibility OnLine
AccessibilityMode Download
Associate Project FAIR
Basic rights Download
CreationDate 2025-03-24
Creator Farinella, Giovanni, giovanni.farinella@unict.it, orcid.org/0000-0002-6034-0432
Field/Scope of use Any use
Group Others
Owner Farinella, Giovanni, giovanni.farinella@unict.it, orcid.org/0000-0002-6034-0432
Programming Language Python
SoBigData Node SoBigData IT
Sublicense rights No
Territory of use World Wide
Thematic Cluster Other
system:type Method
Management Info
Field Value
Author Farinella Giovanni Maria
Maintainer Farinella Giovanni Maria
Version 1
Last Updated 22 June 2025, 01:11 (CEST)
Created 22 June 2025, 01:11 (CEST)