# Evaluation submission status staying at "submitted"

**URL:** <https://discuss.ego4d-data.org/t/evaluation-submission-status-staying-at-submitted/107>\
**Category:** Q&A\
**Created:** [September 13, 2022, 5:03am UTC](https://discuss.ego4d-data.org/t/evaluation-submission-status-staying-at-submitted/107 "2022-09-13T05:03:24Z")\
**Posts on this page:** 4\
**Page:** 1

<div class="post-metadata">

**Author:** ![hworang77](https://avatars.discourse-cdn.com/v4/letter/h/898d66/32.png) [@hworang77](https://discuss.ego4d-data.org/u/hworang77)\
**Post date:** [September 13, 2022, 5:03am UTC](https://discuss.ego4d-data.org/t/evaluation-submission-status-staying-at-submitted/107/1 "2022-09-13T05:03:24Z")

</div>

Hi, I submitted results to the AV-ASR eval server and the server has not shown the scores until now for hours. Its status stays at “submitted” and never changes. Could you please fix it?

---

<div class="post-metadata">

**Author:** ![ego4d-info](https://avatars.discourse-cdn.com/v4/letter/e/7993a0/32.png) [@ego4d-info](https://discuss.ego4d-data.org/u/ego4d-info)\
**Post date:** [September 13, 2022, 2:52pm UTC](https://discuss.ego4d-data.org/t/evaluation-submission-status-staying-at-submitted/107/2 "2022-09-13T14:52:39Z")

</div>

That looks to be an issue on the server side we’ve seen before. We’ve asked to have it rebooted and will confirm when it picks it up. Appreciate your patience!

---

<div class="post-metadata">

**Author:** ![hworang77](https://avatars.discourse-cdn.com/v4/letter/h/898d66/32.png) [@hworang77](https://discuss.ego4d-data.org/u/hworang77)\
**Post date:** [September 13, 2022, 3:09pm UTC](https://discuss.ego4d-data.org/t/evaluation-submission-status-staying-at-submitted/107/3 "2022-09-13T15:09:16Z")

</div>

> [@ego4d-info](#):
>
> That looks to be an issue on the server side we’ve seen before. We’ve asked to have it rebooted and will confirm when it picks it up. Appreciate your patience!

Hi,

Thank you for your answer. It seems like the eval code has run but failed. However, the error message seems like the failure is from the setting of the server. It does not find the eval tool. The error message is as follows:

Traceback (most recent call last):  
File “/code/scripts/workers/submission\_worker.py”, line 491, in run\_submission  
submission\_metadata=submission\_serializer.data,  
File “/tmp/tmpfca929hb/compute/challenge\_data/challenge\_1637/main.py”, line 244, in evaluate  
wer = compute\_wer(ref\_stm, hyp\_ctm, submission\_name)  
File “/tmp/tmpfca929hb/compute/challenge\_data/challenge\_1637/main.py”, line 59, in compute\_wer  
env={\*\*os.environ, ‘PATH’: ‘:’.join(sys.path)}  
File “/usr/local/lib/python3.7/subprocess.py”, line 358, in check\_call  
retcode = call(\*popenargs, \*\*kwargs)  
File “/usr/local/lib/python3.7/subprocess.py”, line 339, in call  
with Popen(\*popenargs, \*\*kwargs) as p:  
File “/usr/local/lib/python3.7/subprocess.py”, line 800, in **init**  
restore\_signals, start\_new\_session)  
File “/usr/local/lib/python3.7/subprocess.py”, line 1551, in \_execute\_child  
raise child\_exception\_type(errno\_num, err\_msg, err\_filename)  
FileNotFoundError: [Errno 2] No such file or directory: ‘/code/SCTK/bin/sclite’: ‘/code/SCTK/bin/sclite’

---

<div class="post-metadata">

**Author:** ![hworang77](https://avatars.discourse-cdn.com/v4/letter/h/898d66/32.png) [@hworang77](https://discuss.ego4d-data.org/u/hworang77)\
**Post date:** [September 13, 2022, 3:12pm UTC](https://discuss.ego4d-data.org/t/evaluation-submission-status-staying-at-submitted/107/4 "2022-09-13T15:12:06Z")

</div>

Also, could you please share the json\_2\_ctm and json\_2\_stm scripts and the sclite command so that I can use them for evaluating models on val sets? Currently what’s shared is the scripts to convert jsons into trn, which is not really needed for the actual eval pipeline.