How do we deal with multiple annotations for the Moments Queries task?

I’ve noticed that there are multiple annotations per clip, from different annotators.

Also I see no “primary” field used in the benchmark, am I missing something?

Currently, we treat all annotations as ground-truth even if they are overlapped and from different annotators.

In the most recent annotations, there should be the field of primary. Please try updating your data from the server if you are not using the latest version.