Create TEST01 audit.conf for rgat (#2037)

* Create TEST01 audit.conf for rgat

* Update benchmark-checklist.md | RGAT checklist completed

compliance/nvidia/TEST01/rgat/audit.conf

@@ -0,0 +1,9 @@
+# The format of this config file is 'key = value'.
+# The key has the format 'model.scenario.key'. Value is mostly int64_t.
+# Model maybe '*' as wildcard. In that case the value applies to all models.
+# All times are in milli seconds
+
+# mode dictionary (0 = submission, 1 = accuracy, 2 = performance, 3 = find peak perf)
+*.*.mode = 2
+*.*.accuracy_log_rng_seed = 720381539243781796
+*.*.accuracy_log_sampling_target = 4096

graph/R-GAT/benchmark-checklist.md

@@ -48,11 +48,11 @@ Documented whether **Equal Issue Mode** is applicable in
 ---
 
 #### **9. Reference Implementation Dataset Coverage**
-- [ ] Reference implementation successfully processes the entire validation dataset during:
-  - [ ] Performance runs
-  - [ ] Accuracy runs
-  - [ ] Compliance runs  
-- [ ] Valid log files passing the submission checker are generated for all runs.
+- [X] Reference implementation successfully processes the entire validation dataset during:
+  - [X] Performance runs
+  - [X] Accuracy runs
+  - [X] Compliance runs  
+- [X] Valid log files passing the submission checker are generated for all runs - [link](https://github.com/mlcommons/mlperf_inference_unofficial_submissions_v5.0/tree/main/closed/MLCommons/results/mlc-server-reference-gpu-pytorch_v2.4.0-cu124/rgat/offline/performance/run_1).
 
 ---
 
@@ -81,7 +81,8 @@ Documented whether **Equal Issue Mode** is applicable in
 ---
 
 #### **14. Sample Log Files**
-- [ ] Include sample logs for all the applicable scenario runs:
-  - [ ] `mlperf_log_summary.txt`
-  - [ ] `mlperf_log_detail.txt`  
-- [ ] Ensure sample logs successfully pass the submission checker and applicable compliance runs.
+- [X] Include sample logs for all the applicable scenario runs:
+  - [X] Offline 
+    - [X] [`mlperf_log_summary.txt`](https://github.com/mlcommons/mlperf_inference_unofficial_submissions_v5.0/blob/main/closed/MLCommons/results/mlc-server-reference-gpu-pytorch_v2.4.0-cu124/rgat/offline/performance/run_1/mlperf_log_summary.txt)
+    - [X] [`mlperf_log_detail.txt`](https://github.com/mlcommons/mlperf_inference_unofficial_submissions_v5.0/blob/main/closed/MLCommons/results/mlc-server-reference-gpu-pytorch_v2.4.0-cu124/rgat/offline/performance/run_1/mlperf_log_detail.txt)  
+- [X] Ensure sample logs successfully pass the submission checker and applicable compliance runs. [Link](https://htmlpreview.github.io/?https://github.com/mlcommons/mlperf_inference_unofficial_submissions_v5.0/blob/refs/heads/auto-update/closed/MLCommons/results/mlc-server-reference-gpu-pytorch_v2.4.0-cu124/summary.html)

loadgen/test_settings_internal.cc

@@ -515,11 +515,14 @@ void TestSettingsInternal::LogSummary(AsyncSummary &summary) const {
   summary("performance_issue_same : ", performance_issue_same);
   summary("performance_issue_same_index : ", performance_issue_same_index);
   summary("performance_sample_count : ", performance_sample_count);
-  if (sample_concatenate_permutation){
-    summary("WARNING: sample_concatenate_permutation was set to true. \n"
-            "Generated samples per query might be different as the one in the setting.\n"
-            "Check the generated_samples_per_query line in the detailed log for the real\n"
-            "samples_per_query value");
+  if (sample_concatenate_permutation) {
+    summary(
+        "WARNING: sample_concatenate_permutation was set to true. \n"
+        "Generated samples per query might be different as the one in the "
+        "setting.\n"
+        "Check the generated_samples_per_query line in the detailed log for "
+        "the real\n"
+        "samples_per_query value");
   }
 }