Skip to content

CaptainCook4D/annotations

Repository files navigation

CaptainCook4D: A Dataset for Understanding Errors in Procedural Activities

(This page is under continuous update and construction.)

DISCLAIMER: The proposed data splits showcase the ways in which our dataset can be used. We do not claim that these splits are the best or the only way to use the dataset. We encourage the community to explore other ways to use the dataset and share their findings with us.


Update

Dec 2023: Released dataset version 1.0


Overview

Overview


Annotations

Task Graphs
task_graph_blender_banana_pancakes.mp4

Step/Coarse Grained Action Annotations Overview

Annotation Overview


Data Collection and Annotation Illustration

data_collection.mp4

Error Categories

Error Categories


Dataset Statistics

Step Duration Statistics

Video Duration Statistics

Normal/Error Recording Statistics

NormalErrorRecordingStatistics

Error Recipe Count

ErrorRecipeCount


License & Consent

Our dataset is licensed under the Apache license 2.0: License.

Our dataset is approved by the Institutional Review Board (IRB) at the University of Florida: IRB Approval

All participants provided written consent for the data collection: Consent


Citation

If you have found our work to be useful in your research, please leave us a star and consider citing our work:

@misc{peddi2023captaincook4d,
  title={{CaptainCook4D: A dataset for understanding errors in procedural activities}}, 
  author={Rohith Peddi and Shivvrat Arya and Bharath Challa and Likhitha Pallapothula and Akshay Vyas and Jikai Wang and Qifan Zhang and Vasundhara Komaragiri and Eric Ragan and Nicholas Ruozzi and Yu Xiang and Vibhav Gogate},
  year={2023},
  eprint={2312.14556},
  archivePrefix={arXiv},
  primaryClass={cs.CV}
}

About

[NeurIPS 2024]

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published