# Submission Results

**URL:** <https://discuss.ego4d-data.org/t/submission-results/229>\
**Category:** Ego4D Challenges\
**Tags:** visual-queries\
**Created:** [March 13, 2023, 10:54pm UTC](https://discuss.ego4d-data.org/t/submission-results/229 "2023-03-13T22:54:58Z")\
**Posts on this page:** 9\
**Page:** 1

<div class="post-metadata">

**Author:** ![asjad.s](https://avatars.discourse-cdn.com/v4/letter/a/c6cbf5/32.png) [@asjad.s](https://discuss.ego4d-data.org/u/asjad.s)\
**Post date:** [March 13, 2023, 10:54pm UTC](https://discuss.ego4d-data.org/t/submission-results/229/1 "2023-03-13T22:54:58Z")

</div>

Hi,

I just made a submission to test if my submission structure was correct for the VQ2D challenge. I do not see the results on how accurate it is (obviously it will be 0 since it is a set of empty bounding boxes). It had passed the submission structure checker.

I wanted to know if the results for our submissions would be immediately visible to us before they become available on the leaderboard? I wish to verify that my submission structure is indeed correct before I make an actual submission.

Regards

---

<div class="post-metadata">

**Author:** ![suyogjain](https://avatars.discourse-cdn.com/v4/letter/s/7ab992/32.png) [@suyogjain](https://discuss.ego4d-data.org/u/suyogjain)\
**Post date:** [March 14, 2023, 6:35pm UTC](https://discuss.ego4d-data.org/t/submission-results/229/2 "2023-03-14T18:35:45Z")

</div>

Hi,

If I understand your question correctly, you want to verify your results before having them visible on the leaderboard. That is certainly the case. Please refer to this page: [Make Submission Public — EvalAI 1.1 documentation](https://evalai.readthedocs.io/en/latest/make_submission_public_private_baseline.html)

Unless you mark them to appear on the leaderboard, they won’t be shown.

---

<div class="post-metadata">

**Author:** ![asjad.s](https://avatars.discourse-cdn.com/v4/letter/a/c6cbf5/32.png) [@asjad.s](https://discuss.ego4d-data.org/u/asjad.s)\
**Post date:** [March 14, 2023, 7:03pm UTC](https://discuss.ego4d-data.org/t/submission-results/229/3 "2023-03-14T19:03:01Z")

</div>

@suyogjain  
That is correct. However, my execution time comes out to be “None”. I am unsure if that is because the submission is incorrect or just an EvalAI problem. I have made them allowed to appear on the leaderboard yet they continue to not being shown.

P.S. I see that usually the screenshots in the EvalAI documentation have a numeric execution time so I am unsure if my structure is incorrect (which is why it says None) or just a bug at the end of EvalAI

 ![Screenshot from 2023-03-14 15-00-19](https://canada1.discourse-cdn.com/flex007/uploads/ego4d_data/original/1X/384f8812bc17efd2b0bc8043a0da018fed7a21c6.png)

---

<div class="post-metadata">

**Author:** ![suyogjain](https://avatars.discourse-cdn.com/v4/letter/s/7ab992/32.png) [@suyogjain](https://discuss.ego4d-data.org/u/suyogjain)\
**Post date:** [March 15, 2023, 3:57am UTC](https://discuss.ego4d-data.org/t/submission-results/229/4 "2023-03-15T03:57:23Z")

</div>

On my end it shows the status for your submission as “Cancelled”. Also, I am not able to download your submission file, so hard to say if it is a format issue vs evalAI issue. For some reason, I also see that you submitted a “.gz” file but the eval script expects a json file.

---

<div class="post-metadata">

**Author:** ![asjad.s](https://avatars.discourse-cdn.com/v4/letter/a/c6cbf5/32.png) [@asjad.s](https://discuss.ego4d-data.org/u/asjad.s)\
**Post date:** [March 15, 2023, 5:24pm UTC](https://discuss.ego4d-data.org/t/submission-results/229/5 "2023-03-15T17:24:41Z")

</div>

@suyogjain  
I figured the “.json.gz” format may be a problem so cancelled it and submitted a “.json” file. The submission still says submitted with “None” as an execution time and no results showing on the leaderboard.

Can you please check once more for me?

---

<div class="post-metadata">

**Author:** ![asjad.s](https://avatars.discourse-cdn.com/v4/letter/a/c6cbf5/32.png) [@asjad.s](https://discuss.ego4d-data.org/u/asjad.s)\
**Post date:** [March 15, 2023, 5:34pm UTC](https://discuss.ego4d-data.org/t/submission-results/229/6 "2023-03-15T17:34:31Z")

</div>

Just checked, it says “failed” this time. My json file does pass the validate\_challenge\_predictions.py . Can you still take a look at it please?"

---

<div class="post-metadata">

**Author:** ![srama2512](https://avatars.discourse-cdn.com/v4/letter/s/eb9ed0/32.png) [@srama2512](https://discuss.ego4d-data.org/u/srama2512)\
**Post date:** [March 15, 2023, 6:26pm UTC](https://discuss.ego4d-data.org/t/submission-results/229/7 "2023-03-15T18:26:26Z")

</div>

@asjad.s - Thank you for reaching out. It seems that at least one of your response-track predictions has no bounding boxes. The evaluation code fails because it expects each prediction to have at least one bounding box.

---

<div class="post-metadata">

**Author:** ![asjad.s](https://avatars.discourse-cdn.com/v4/letter/a/c6cbf5/32.png) [@asjad.s](https://discuss.ego4d-data.org/u/asjad.s)\
**Post date:** [March 15, 2023, 8:45pm UTC](https://discuss.ego4d-data.org/t/submission-results/229/8 "2023-03-15T20:45:20Z")

</div>

That might be it yes because I ran my code to debug a smaller set of videos.  
Thankyou!!

---

<div class="post-metadata">

**Author:** ![srama2512](https://avatars.discourse-cdn.com/v4/letter/s/eb9ed0/32.png) [@srama2512](https://discuss.ego4d-data.org/u/srama2512)\
**Post date:** [March 15, 2023, 9:00pm UTC](https://discuss.ego4d-data.org/t/submission-results/229/9 "2023-03-15T21:00:24Z")

</div>

Now that I think about it, maybe this wasn’t the best solution here:

> <https://github.com/EGO4D/episodic-memory/blob/497ba9214ac3ba1120b3cefeacde6f807dc2802a/VQ2D/perform_vq_inference.py#L383>

Maybe you can try setting `bboxes: []` to `bboxes: [BBox(0, 0, 0, 5, 5)]`, where you can import BBox from here:

> <https://github.com/EGO4D/episodic-memory/blob/497ba9214ac3ba1120b3cefeacde6f807dc2802a/VQ2D/vq2d/structures.py#L4-L31>
