# The submission result to EvalAI is not evaluated automatically

**URL:** <https://discuss.ego4d-data.org/t/the-submission-result-to-evalai-is-not-evaluated-automatically/82>\
**Category:** Ego4D Challenges\
**Tags:** natural-language-queries\
**Created:** [August 9, 2022, 2:18am UTC](https://discuss.ego4d-data.org/t/the-submission-result-to-evalai-is-not-evaluated-automatically/82 "2022-08-09T02:18:17Z")\
**Posts on this page:** 12\
**Page:** 1

<div class="post-metadata">

**Author:** ![hzj5978](https://avatars.discourse-cdn.com/v4/letter/h/a698b9/32.png) [@hzj5978](https://discuss.ego4d-data.org/u/hzj5978)\
**Post date:** [August 9, 2022, 2:18am UTC](https://discuss.ego4d-data.org/t/the-submission-result-to-evalai-is-not-evaluated-automatically/82/1 "2022-08-09T02:18:17Z")

</div>

Hi, I submitted the result to the leaderboard two days ago, but I have not received any evaluation feedback.

I would appreciate it if anyone could solve this issue.

---

<div class="post-metadata">

**Author:** ![awestbury](https://avatars.discourse-cdn.com/v4/letter/a/ba8739/32.png) [@awestbury](https://discuss.ego4d-data.org/u/awestbury)\
**Post date:** [August 10, 2022, 7:26pm UTC](https://discuss.ego4d-data.org/t/the-submission-result-to-evalai-is-not-evaluated-automatically/82/2 "2022-08-10T19:26:15Z")

</div>

Hi, we are assessing this issue. It appears related to the compute capacity assigned to us at EvalAI. We hope to resolve quickly.

---

<div class="post-metadata">

**Author:** ![ego4d-info](https://avatars.discourse-cdn.com/v4/letter/e/7993a0/32.png) [@ego4d-info](https://discuss.ego4d-data.org/u/ego4d-info)\
**Post date:** [August 10, 2022, 8:40pm UTC](https://discuss.ego4d-data.org/t/the-submission-result-to-evalai-is-not-evaluated-automatically/82/3 "2022-08-10T20:40:49Z")

</div>

It looks like it was an OOM that should be resolved now. Could you submit and advise if you’re successful this time?

Appreciate the flag, and we look forward to your submission!

---

<div class="post-metadata">

**Author:** ![hzj5978](https://avatars.discourse-cdn.com/v4/letter/h/a698b9/32.png) [@hzj5978](https://discuss.ego4d-data.org/u/hzj5978)\
**Post date:** [August 11, 2022, 2:55am UTC](https://discuss.ego4d-data.org/t/the-submission-result-to-evalai-is-not-evaluated-automatically/82/4 "2022-08-11T02:55:03Z")

</div>

Yes, it works now. Thanks for your quick response.

---

<div class="post-metadata">

**Author:** ![dejie](https://yyz1.discourse-cdn.com/flex007/user_avatar/discuss.ego4d-data.org/dejie/32/10_2.png) [@dejie](https://discuss.ego4d-data.org/u/dejie)\
**Post date:** [August 13, 2022, 4:27am UTC](https://discuss.ego4d-data.org/t/the-submission-result-to-evalai-is-not-evaluated-automatically/82/5 "2022-08-13T04:27:47Z")

</div>

I also encountered this problem.

> **[EvalAI: Evaluating state of the art in AI](https://eval.ai/web/challenges/challenge-page/1622/evaluation)**
>
> EvalAI is an open-source web platform for organizing and participating in challenges to push the state of the art on AI tasks.

---

<div class="post-metadata">

**Author:** ![Esteve](https://avatars.discourse-cdn.com/v4/letter/e/41988e/32.png) [@Esteve](https://discuss.ego4d-data.org/u/Esteve)\
**Post date:** [August 19, 2022, 9:41am UTC](https://discuss.ego4d-data.org/t/the-submission-result-to-evalai-is-not-evaluated-automatically/82/6 "2022-08-19T09:41:27Z")

</div>

I am also encountering this problem

---

<div class="post-metadata">

**Author:** ![awestbury](https://avatars.discourse-cdn.com/v4/letter/a/ba8739/32.png) [@awestbury](https://discuss.ego4d-data.org/u/awestbury)\
**Post date:** [August 20, 2022, 7:09pm UTC](https://discuss.ego4d-data.org/t/the-submission-result-to-evalai-is-not-evaluated-automatically/82/7 "2022-08-20T19:09:23Z")

</div>

We understand that this is resolved for Long Term Forecasting. Please let us know if otherwise. Sorry for the inconvenience.

---

<div class="post-metadata">

**Author:** ![takfate](https://avatars.discourse-cdn.com/v4/letter/t/85f322/32.png) [@takfate](https://discuss.ego4d-data.org/u/takfate)\
**Post date:** [August 27, 2022, 6:48am UTC](https://discuss.ego4d-data.org/t/the-submission-result-to-evalai-is-not-evaluated-automatically/82/8 "2022-08-27T06:48:59Z")

</div>

Hello, short-term forecasting also seems to suffer from this issue at present.

---

<div class="post-metadata">

**Author:** ![takfate](https://avatars.discourse-cdn.com/v4/letter/t/85f322/32.png) [@takfate](https://discuss.ego4d-data.org/u/takfate)\
**Post date:** [August 29, 2022, 8:05am UTC](https://discuss.ego4d-data.org/t/the-submission-result-to-evalai-is-not-evaluated-automatically/82/9 "2022-08-29T08:05:14Z")

</div>

Hello, now I can not upload the results file successfully.  
Is there some problem with the server?

---

<div class="post-metadata">

**Author:** ![awestbury](https://avatars.discourse-cdn.com/v4/letter/a/ba8739/32.png) [@awestbury](https://discuss.ego4d-data.org/u/awestbury)\
**Post date:** [August 29, 2022, 1:28pm UTC](https://discuss.ego4d-data.org/t/the-submission-result-to-evalai-is-not-evaluated-automatically/82/10 "2022-08-29T13:28:29Z")

</div>

We will work to resolve this right away. Sorry for the inconvenience.

---

<div class="post-metadata">

**Author:** ![awestbury](https://avatars.discourse-cdn.com/v4/letter/a/ba8739/32.png) [@awestbury](https://discuss.ego4d-data.org/u/awestbury)\
**Post date:** [August 30, 2022, 7:38pm UTC](https://discuss.ego4d-data.org/t/the-submission-result-to-evalai-is-not-evaluated-automatically/82/11 "2022-08-30T19:38:16Z")

</div>

Hello, we don’t see any pending submissions for the STA challenge at the moment. EvalAI restarted the worker just in case if there is any issue. Can you let us know if you are still experiencing issues?

---

<div class="post-metadata">

**Author:** ![takfate](https://avatars.discourse-cdn.com/v4/letter/t/85f322/32.png) [@takfate](https://discuss.ego4d-data.org/u/takfate)\
**Post date:** [September 3, 2022, 4:46am UTC](https://discuss.ego4d-data.org/t/the-submission-result-to-evalai-is-not-evaluated-automatically/82/12 "2022-09-03T04:46:21Z")

</div>

Everything is ok now.
