Launching 2024 Ego4D Challenge & Dataset Update

Dear friends of Ego4D,

We are thrilled to announce the launch of the 2024 Ego4D Challenge. This competition calls on the research community to advance the state of the art on 16 Ego4D tasks, focused on Episodic Memory, Hand and Object Interactions, Forecasting, Audio-Visual Diarization, and Social Understanding. Two new challenges are joining the effort this year – Ego4D Goalsteps and EgoSchema!

Our challenge builds on the v2.1 update to the Ego4D dataset. Ego4D v2.1 includes Ego4D GoalSteps (a dataset identifying the temporal action segment corresponding to a natural language description of the step). This updates builds on the addition of the 2x annotations for Forecasting, Hands & Objects (243 hrs vs 120 hrs) and Natural Language Queries (27k vs 17.3k queries) provided last year. Please read more about our v2.1 release here.

Prize funding for our challenges this year is offered in the amounts of $1,500 (1st), $1,000 (2nd), and $500 (3rd) for each of our 16 challenge tracks. Top performing teams will also be invited to participate in our accepted CVPR workshop on June 17th.

We thank our partners at EvalAI for helping to host our challenge. Please reach out with any question on the Ego4D Forum and we encourage you all to join the effort and advance understanding of first-person visual experiences.

The challenge launched on March 15th and the leaderboard is closing on May 30, 2024. Please ask any questions below.

Best regards,


1 Like