# How do we deal with multiple annotations for the Moments Queries task?

**URL:** <https://discuss.ego4d-data.org/t/how-do-we-deal-with-multiple-annotations-for-the-moments-queries-task/71>\
**Category:** Ego4D Challenges\
**Tags:** moments\
**Created:** [July 14, 2022, 4:02pm UTC](https://discuss.ego4d-data.org/t/how-do-we-deal-with-multiple-annotations-for-the-moments-queries-task/71 "2022-07-14T16:02:58Z")\
**Posts on this page:** 3\
**Page:** 1

<div class="post-metadata">

**Author:** ![luio](https://avatars.discourse-cdn.com/v4/letter/l/c37758/32.png) [@luio](https://discuss.ego4d-data.org/u/luio)\
**Post date:** [July 14, 2022, 4:02pm UTC](https://discuss.ego4d-data.org/t/how-do-we-deal-with-multiple-annotations-for-the-moments-queries-task/71/1 "2022-07-14T16:02:58Z")

</div>

I’ve noticed that there are multiple annotations per clip, from different annotators.

Also I see no “primary” field used in the benchmark, am I missing something?

> <https://github.com/EGO4D/episodic-memory/blob/main/MQ/Convert_annotation.py#L68>

---

<div class="post-metadata">

**Author:** ![Chen](https://avatars.discourse-cdn.com/v4/letter/c/3d9bf3/32.png) [@Chen](https://discuss.ego4d-data.org/u/Chen)\
**Post date:** [July 20, 2022, 10:28am UTC](https://discuss.ego4d-data.org/t/how-do-we-deal-with-multiple-annotations-for-the-moments-queries-task/71/2 "2022-07-20T10:28:06Z")

</div>

Currently, we treat all annotations as ground-truth even if they are overlapped and from different annotators.

---

<div class="post-metadata">

**Author:** ![Chen](https://avatars.discourse-cdn.com/v4/letter/c/3d9bf3/32.png) [@Chen](https://discuss.ego4d-data.org/u/Chen)\
**Post date:** [July 20, 2022, 10:30am UTC](https://discuss.ego4d-data.org/t/how-do-we-deal-with-multiple-annotations-for-the-moments-queries-task/71/3 "2022-07-20T10:30:18Z")

</div>

In the most recent annotations, there should be the field of primary. Please try updating your data from the server if you are not using the latest version.
