Merge pull request #185 from mlcommons/arjunsuresh-patch-1

Update submission_rules.adoc | Remove TEST05 for Inference
mlcommons · Nov 19, 2024 · 586eaf9 · 586eaf9
2 parents b16bd20 + 2fdb3e6
commit 586eaf9
Showing 1 changed file with 9 additions and 7 deletions.
diff --git a/submission_rules.adoc b/submission_rules.adoc
@@ -607,18 +607,20 @@ The following compliance tests are required for each of the folliwing benchmarks
 
 |===
 | model | Required Compliance Tests
-| resnet50-v1.5 | TEST01, TEST04, TEST05
-| retinanet 800x800 | TEST01, TEST05
-| bert | TEST01, TEST05
-| dlrm-v2 | TEST01, TEST05
-| 3d-unet | TEST01, TEST05
-| rnnt | TEST01, TEST05
+| resnet50-v1.5 | TEST01, TEST04
+| retinanet 800x800 | TEST01
+| bert | TEST01
+| dlrm-v2 | TEST01
+| 3d-unet | TEST01
+| rnnt | TEST01
 | gpt-j | - 
-| stable-diffusion-xl | TEST01, TEST04, TEST05 
+| stable-diffusion-xl | TEST01, TEST04
 | Llama2-70b | TEST06 
 | mixtral-8x7b | TEST06 
 |===
 
+* TEST05 is removed from Inference submissions v5.0
+
 ## Review