Egocentric Video Dataset
This egocentric dataset contains 4,050 hours of first-person videos capturing daily activities in home environments, designed for Physical AI, robotic systems, manipulation tasks, and egocentric vision research. The videos were captured using two hardware configurations — Pico + Motion Trackers (2,321 hours, 57.3%) and Zed + Pico + Motion Trackers (1,729 hours, 42.7%). Quaternion-based orientation from onboard sensor fusion supports 3D pose estimations and egocentric tracking across first-person perspectives.
-
- Hours
- 4,050
-
- Scenarios
- 13
- Computer Vision
- Human Activity Recognition
- Robot Learning
- Motion Analysis
- Egocentric Vision
- Computer Vision
- Human Activity Recognition
- Robot Learning
- Motion Analysis
- Egocentric Vision
This egocentric dataset contains 4,050 hours of first-person videos capturing daily activities in home environments, designed for Physical AI, robotic systems, manipulation tasks, and egocentric vision research. The videos were captured using two hardware configurations — Pico + Motion Trackers (2,321 hours, 57.3%) and Zed + Pico + Motion Trackers (1,729 hours, 42.7%). Quaternion-based orientation from onboard sensor fusion supports 3D pose estimations and egocentric tracking across first-person perspectives.
- Computer Vision
- Human Activity Recognition
- Robot Learning
- Motion Analysis
- Egocentric Vision
-
- Hours
- 4,050
-
- Scenarios
- 13
Dataset Info
| Characteristic | Data |
| Description | Egocentric video recordings of daily activities in home environments |
| Data types | Video |
| Tasks | Hand Activity Recognition Egocentric Action Recognition Hand-Object Interaction |
| Hours of recordings | 4,050 |
| Hardware setups | 2 |
| Setup 1 (Pico + Motion Trackers) | 2,321 hours (57.3%) — natural speed, slow-motion, and real-speed object transferring |
| Setup 2 (Zed + Pico + Motion Trackers) | 1,729 hours (42.7%) — scripted object transfer tasks with spatial depth + egocentric view |
| Scenarios | 13 (sorting unsorted items, arranging products by category, collecting items into a container, transferring from drawer to table, wardrobe & table & bag, transport box & display table, folding fabric items, lids & cookware & drawers, transferring with a spoon, transferring with tongs, packing into containers, two-handed sorting, assembly & disassembly) |
| Environments | Kitchen, bathroom, living room, and other home settings |
| Activities | Sorting, transferring, folding, assembly/disassembly, tool use, two-handed manipulation |
Technical
Characteristics
| Characteristic | Data |
| Video source | Pico 4 Ultra VR headset (egocentric) + 4 Zed stereo cameras (spatial depth) |
| Recording speed | Real-time / Slow-motion |
| Hand visibility | As needed / Both hands always in frame (slow-motion recordings) |
| Extension of labeling file | .txt per recording |
| Orientation format | Quaternions (from onboard sensor-fusion) |
| Sensor data | IMU signals — accelerometer, gyroscope, magnetometer |
Statistics
-
- Hardware configuration distribution
Scenarios
Scenarios
| i | Variable | Hours | % |
| 1 | Sorting unsorted items | 800 | 19.8% |
| 2 | Arranging products by category | 800 | 19.8% |
| 3 | Collecting items into a container | 400 | 9.9% |
| 4 | Transferring from drawer to table | 400 | 9.9% |
| 5 | Wardrobe, table & bag | 400 | 9.9% |
| 6 | Transport box & display table | 400 | 9.9% |
| 7 | Folding fabric items | 400 | 9.9% |
| 8 | Lids, cookware & drawers | 200 | 4.9% |
| 9 | Transferring with a spoon | 50 | 1.2% |
| 10 | Transferring with tongs | 50 | 1.2% |
| 11 | Packing into containers | 50 | 1.2% |
| 12 | Two-handed sorting | 50 | 1.2% |
| 13 | Assembly & disassembly | 50 | 1.2% |
| 14 | Total | 4,050 | 100% |
Dataset Use Cases
FAQ
Unidata Cases
Similar Datasets
Why Companies Trust Unidata's Datasets
Share your project requirements, we handle the rest. Every service is tailored, executed, and compliance-ready, so you can focus on strategy and growth, not operations.
What our clients are saying
UniData
Our Clients Love Us
Ready to get started?
Tell us what you need — we’ll reply within 24h with a free estimate
- Andrew
- Head of Client Success
— I'll guide you through every step, from your first
message to full project delivery
Thank you for your
message
We use cookies to enhance your experience, personalize content, ads, and analyze traffic. By clicking 'Accept All', you agree to our Cookie Policy.

