# TTM submission failed

**URL:** <https://discuss.ego4d-data.org/t/ttm-submission-failed/221>\
**Category:** Ego4D Challenges\
**Tags:** audio-visual\
**Created:** [March 5, 2023, 3:45pm UTC](https://discuss.ego4d-data.org/t/ttm-submission-failed/221 "2023-03-05T15:45:40Z")\
**Posts on this page:** 5\
**Page:** 1

<div class="post-metadata">

**Author:** ![LCJ](https://avatars.discourse-cdn.com/v4/letter/l/87869e/32.png) [@LCJ](https://discuss.ego4d-data.org/u/LCJ)\
**Post date:** [March 5, 2023, 3:45pm UTC](https://discuss.ego4d-data.org/t/ttm-submission-failed/221/1 "2023-03-05T15:45:40Z")

</div>

Hello,

Thank you for holding this challenge again this year! I just try my  
first submission on the TTM challenge and I got the following error

 ![image](https://canada1.discourse-cdn.com/flex007/uploads/ego4d_data/original/1X/912fa89859fba1da918d5e38aad6516a5ca92e14.png)

It seems that my value for the “label” field is illegal. However, I can’t  
tell from the submission guideline what a acceptable file should  
look like. Here’s what I submitted (posting my exact answer may  
violate rules so I censored the video id)

```json
{
    "version": "1.0",
    "cahllenge": "ego4d_talking_to_me",
    "results": [
        {
            "video_id": "xxxxxxxxxxxxxxxxxxxx", // folder name in test data (a str)
            "frame_id": 0, // file name of a image in test data (a int)
            "label": 0, // 1 for TTM; 0 for not TTM (a int)
            "score": 0.3 // a floating point number between 0 and 1
        },
        ...
        ]
}

```

I’ve checked the total number of prediction is the same as the total  
number images in the test data, and there is no repeated frame\_id  
for the same video\_id. More detailed submission guideline or a  
sample submission file may be helpful. Thank you!

---

<div class="post-metadata">

**Author:** ![gene](https://avatars.discourse-cdn.com/v4/letter/g/43a26b/32.png) [@gene](https://discuss.ego4d-data.org/u/gene)\
**Post date:** [March 7, 2023, 4:21pm UTC](https://discuss.ego4d-data.org/t/ttm-submission-failed/221/2 "2023-03-07T16:21:46Z")

</div>

> [@LCJ](#):
>
> `cahllenge`

challenge is mispelled there.

For the ValueError, that looks to be an error with the evaluation script. (It’s comparing a list to a value!) We’ll check with the challenge POC there and will come back shortly with an update.

---

<div class="post-metadata">

**Author:** ![gene](https://avatars.discourse-cdn.com/v4/letter/g/43a26b/32.png) [@gene](https://discuss.ego4d-data.org/u/gene)\
**Post date:** [March 7, 2023, 4:25pm UTC](https://discuss.ego4d-data.org/t/ttm-submission-failed/221/3 "2023-03-07T16:25:04Z")

</div>

The actual error is here:

raise ValueError(“Predictions CSV must contain only SPEAKING\_AUDIBLE label.”)

Please confirm on your label value submissions.

---

<div class="post-metadata">

**Author:** ![zcxu-eric](https://avatars.discourse-cdn.com/v4/letter/z/779978/32.png) [@zcxu-eric](https://discuss.ego4d-data.org/u/zcxu-eric)\
**Post date:** [March 8, 2023, 12:57pm UTC](https://discuss.ego4d-data.org/t/ttm-submission-failed/221/4 "2023-03-08T12:57:33Z")

</div>

Hello, please fill all the “label” field with 1 in your submission, and the “score” field should indicate the probability for predicting the frame as _label=1_.

---

<div class="post-metadata">

**Author:** ![LCJ](https://avatars.discourse-cdn.com/v4/letter/l/87869e/32.png) [@LCJ](https://discuss.ego4d-data.org/u/LCJ)\
**Post date:** [March 8, 2023, 1:24pm UTC](https://discuss.ego4d-data.org/t/ttm-submission-failed/221/5 "2023-03-08T13:24:12Z")

</div>

Yeah, I submitted successfully yesterday by doing this (I found from the inference code in their repo). Thank you so much!