# FHO State Change Object Detection Test Annotations Released **URL:** \ **Category:** Ego4D Challenges\ **Created:** [September 8, 2022, 11:43pm UTC](https://discuss.ego4d-data.org/t/fho-state-change-object-detection-test-annotations-released/101 "2022-09-08T23:43:38Z")\ **Posts on this page:** 8\ **Page:** 1
**Author:** ![ego4d-info](https://avatars.discourse-cdn.com/v4/letter/e/7993a0/32.png) [@ego4d-info](https://discuss.ego4d-data.org/u/ego4d-info)\ **Post date:** [September 8, 2022, 11:43pm UTC](https://discuss.ego4d-data.org/t/fho-state-change-object-detection-test-annotations-released/101/1 "2022-09-08T23:43:38Z")
We have released the long overdue SCOD test annotations, fho\_scod\_test\_unannotated.json. Please download via the CLI for challenge submission, e.g. `ego4d --output_directory="~/ego4d_data" --datasets annotations -y` See the challenge page for further instructions on submissions: [https://eval.ai/web/challenges/challenge-page/1632/overview](https://eval.ai/web/challenges/challenge-page/1632/overview) And please post any issues either here or via github: [Issues · EGO4D/hands-and-objects · GitHub](https://github.com/EGO4D/hands-and-objects/issues) Thanks for your patience here if you were looking to submit, and we look forward to your entry! ---
**Author:** ![takfate](https://avatars.discourse-cdn.com/v4/letter/t/85f322/32.png) [@takfate](https://discuss.ego4d-data.org/u/takfate)\ **Post date:** [September 12, 2022, 2:34pm UTC](https://discuss.ego4d-data.org/t/fho-state-change-object-detection-test-annotations-released/101/2 "2022-09-12T14:34:58Z")
Hello, I have downloaded the latest annotations for SCOD. But I find fho\_scod\_test\_unannotated.json is about 480MB. this file contains about 2000000 frames. Is this file consistent with to test set in the paper? ---
**Author:** ![ego4d-info](https://avatars.discourse-cdn.com/v4/letter/e/7993a0/32.png) [@ego4d-info](https://discuss.ego4d-data.org/u/ego4d-info)\ **Post date:** [September 13, 2022, 3:47pm UTC](https://discuss.ego4d-data.org/t/fho-state-change-object-detection-test-annotations-released/101/3 "2022-09-13T15:47:56Z")
Yes. To prevent information leakage, additional annotations have been included in the test set. Only the correct annotations from the test set used for the paper will be used to evaluate the final challenge submission. ---
**Author:** ![takfate](https://avatars.discourse-cdn.com/v4/letter/t/85f322/32.png) [@takfate](https://discuss.ego4d-data.org/u/takfate)\ **Post date:** [September 14, 2022, 11:48am UTC](https://discuss.ego4d-data.org/t/fho-state-change-object-detection-test-annotations-released/101/4 "2022-09-14T11:48:17Z")
Hello, we have submitted the results for evaluation, but there are some errors. ```auto Traceback (most recent call last): File "/code/scripts/workers/submission_worker.py", line 491, in run_submission submission_metadata=submission_serializer.data, File "/tmp/tmp731rinei/compute/challenge_data/challenge_1632/main.py", line 91, in evaluate pred_coco = get_coco_detections(predictions, framesubpath2id) File "/tmp/tmp731rinei/compute/challenge_data/challenge_1632/main.py", line 29, in get_coco_detections x = box["x"] TypeError: string indices must be integers ``` Also, we have a question: can each image of the prediction result only contain one box prediction? Could you give me some help? @ego4d-info ---
**Author:** ![qichenfu](https://avatars.discourse-cdn.com/v4/letter/q/3ec8ea/32.png) [@qichenfu](https://discuss.ego4d-data.org/u/qichenfu)\ **Post date:** [September 16, 2022, 5:41pm UTC](https://discuss.ego4d-data.org/t/fho-state-change-object-detection-test-annotations-released/101/5 "2022-09-16T17:41:19Z")
Hi, every PNR frame could have multiple box predictions. The `bbox` under `"pnr_frame` should be a list of bounding box parameters (x, y, width, height, score). We also update the challenge page, please ensure your submission follows the format there: ---
**Author:** ![takfate](https://avatars.discourse-cdn.com/v4/letter/t/85f322/32.png) [@takfate](https://discuss.ego4d-data.org/u/takfate)\ **Post date:** [September 19, 2022, 6:25am UTC](https://discuss.ego4d-data.org/t/fho-state-change-object-detection-test-annotations-released/101/6 "2022-09-19T06:25:40Z")
Hi, we have submitted a new results file. But it has been evaluated for ten hours and has not been evaluated yet. @qichenfu ---
**Author:** ![awestbury](https://avatars.discourse-cdn.com/v4/letter/a/ba8739/32.png) [@awestbury](https://discuss.ego4d-data.org/u/awestbury)\ **Post date:** [September 19, 2022, 10:43pm UTC](https://discuss.ego4d-data.org/t/fho-state-change-object-detection-test-annotations-released/101/7 "2022-09-19T22:43:28Z")
Hello, we see that your submission was successfully run. Please see the below for more info on next steps > [@2022 Ego4D Challenge@ECCV – Next Steps](https://discuss.ego4d-data.org/t/2022-ego4d-challenge-eccv-next-steps/129): > > Dear entrants in the Ego4D Challenges, Thank you for your submissions!! We are thrilled to see so much interest in the challenges and are looking forward to culminating the process at the [2nd International Ego4D Workshop @ ECCV 2022](https://ego4d-data.org/workshops/eccv22/) on October 24th in Tel Aviv. We would like to ask now that all recipients of this email kindly submit a short validation report, describing your method and results. We ask that these reports not be longer than 4-pages (less is welcomed) and provide examples of bo… ---
**Author:** ![lmaooo](https://avatars.discourse-cdn.com/v4/letter/l/aca169/32.png) [@lmaooo](https://discuss.ego4d-data.org/u/lmaooo)\ **Post date:** [June 3, 2023, 9:39pm UTC](https://discuss.ego4d-data.org/t/fho-state-change-object-detection-test-annotations-released/101/8 "2023-06-03T21:39:53Z")
Hi, we have submitted a new results file. But it has been evaluating for over 12 hours and it still shows its running. @awestbury @qichenfu