Skip to content

Commit

Permalink
Merge pull request #182 from arjunsuresh/patch-6
Browse files Browse the repository at this point in the history
MLPerf inference v4.1 Postmortem item: Rename <system_desc_id>_<implementation_id>_<scenario>.json to model-info.json
  • Loading branch information
mrasquinha-g authored Nov 19, 2024
2 parents 586eaf9 + 92a374a commit 95d45cb
Showing 1 changed file with 5 additions and 4 deletions.
9 changes: 5 additions & 4 deletions submission_rules.adoc
Original file line number Diff line number Diff line change
Expand Up @@ -373,7 +373,7 @@ HPC training submissions follow the above Training directory structure except fo
*** <system_desc_id>/
**** <benchmark>/
***** <scenario>
****** <system_desc_id>_<implementation_id>_<scenario>.json
****** model-info.json or model-info_<implementation_id>.json
****** README.md
****** user.conf
****** mlperf.conf
Expand Down Expand Up @@ -427,7 +427,7 @@ Here is the list of mandatory files for all submissions in any division/category
* actual models if the models are not deterministically generated
* READMEs to enable users to replicate performance results
* code which interfaces with the loadgen
* <system_desc_id>_<implementation_id>_<scenario>.json
* model-info.json or model-info_<implementation_id>.json
* <system_desc_id>.json
For some models mlperf_log_accuracy.json can get very large. Because of this we truncate mlperf_log_accuracy.json in submissions
Expand Down Expand Up @@ -511,9 +511,9 @@ In the Network division for the inference datacenter the file <system_desc_id>.j



### <system_desc_id>_<implementation_id>_<scenario>.json metadata
### model-info_<implementation_id>.json metadata

The file <system_desc_id>_<implementation_id>.json should contain metadata describing use of the specified implementation on the specified system.
The file `model-info.json` or `model-info_<implementation_id>.json` should contain metadata describing use of the specified implementation on the specified system.


|===
Expand All @@ -523,6 +523,7 @@ The file <system_desc_id>_<implementation_id>.json should contain metadata descr
| Weight data type(s) | Yes | fp32 | bf16
| Input data type(s) | Yes | fp32 | bf16
| Retraining | Yes | No | Yes (URL_to_writeup)
| Notes | No | Run on only one GPU | DLA cores are used for the run
|===


Expand Down

0 comments on commit 95d45cb

Please sign in to comment.