Speech transcription challenge submission issues

Ego4D Challenges
1

Hi, I tried to submit my results to Speech transcription challenge in audio-visual and it failed with stderr, which does not seem to be my file issue. Could you take a look when you have time?

I’ll attach the stdout and stderr below.

STDOUT

Starting Evaluation.....
Evaluating for Test Phase
Ref: JSON 2 STM
Hyp: JSON 2 CTM
Compute WER...
Current time: 04-18-2023-17-46-27

STDERR

Traceback (most recent call last):
  File "/code/scripts/workers/submission_worker.py", line 500, in run_submission
    submission_metadata=submission_serializer.data,
  File "/tmp/tmp4bq4smxs/compute/challenge_data/challenge_1637/main.py", line 244, in evaluate
    wer = compute_wer(ref_stm, hyp_ctm, submission_name)
  File "/tmp/tmp4bq4smxs/compute/challenge_data/challenge_1637/main.py", line 59, in compute_wer
    env={**os.environ, 'PATH': ':'.join(sys.path)}
  File "/usr/local/lib/python3.7/subprocess.py", line 358, in check_call
    retcode = call(*popenargs, **kwargs)
  File "/usr/local/lib/python3.7/subprocess.py", line 339, in call
    with Popen(*popenargs, **kwargs) as p:
  File "/usr/local/lib/python3.7/subprocess.py", line 800, in __init__
    restore_signals, start_new_session)
  File "/usr/local/lib/python3.7/subprocess.py", line 1551, in _execute_child
    raise child_exception_type(errno_num, err_msg, err_filename)
FileNotFoundError: [Errno 2] No such file or directory: '/code/SCTK/bin/sclite': '/code/SCTK/bin/sclite'
2

Hi Jaesung,

We have identified the issue and working with EvalAI on resolving it. Will post an updated asap.

Suyog

3

Hi,

is there an update on this? The deadline is approaching.

Jaesung

4

Hi Jaesung,

Can you try and submit again. This issue was resolved by EvalAI and your previous submission ran successfully.

5

Hi,

Seems like it’s sorted out.

Thank you!!