Skip to content

Commit

Permalink
Update path to sample input text for inf2 opt benchmark model (#2617)
Browse files Browse the repository at this point in the history
* update path to sample input text for inf2 opt benchmark model

* test inf2 benchmark fix

* Revert "test inf2 benchmark fix"

This reverts commit 4679305.

---------

Co-authored-by: Naman Nandan <namannan@amazon.com>
  • Loading branch information
namannandan and Naman Nandan authored Sep 26, 2023
1 parent c3ca259 commit 3cb5a73
Showing 1 changed file with 4 additions and 4 deletions.
8 changes: 4 additions & 4 deletions benchmarks/models_config/opt_6.7b_neuronx.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -8,7 +8,7 @@ opt_6.7b_neuronx_batch_1:
batch_delay: 100
batch_size:
- 1
input: "./examples/large_models/inferentia2/sample_text.txt"
input: "./examples/large_models/inferentia2/opt/sample_text.txt"
requests: 2000
concurrency: 10
backend_profiling: False
Expand All @@ -25,7 +25,7 @@ opt_6.7b_neuronx_batch_2:
batch_delay: 100
batch_size:
- 2
input: "./examples/large_models/inferentia2/sample_text.txt"
input: "./examples/large_models/inferentia2/opt/sample_text.txt"
requests: 2000
concurrency: 10
backend_profiling: False
Expand All @@ -42,7 +42,7 @@ opt_6.7b_neuronx_batch_4:
batch_delay: 100
batch_size:
- 4
input: "./examples/large_models/inferentia2/sample_text.txt"
input: "./examples/large_models/inferentia2/opt/sample_text.txt"
requests: 2000
concurrency: 10
backend_profiling: False
Expand All @@ -59,7 +59,7 @@ opt_6.7b_neuronx_batch_8:
batch_delay: 100
batch_size:
- 8
input: "./examples/large_models/inferentia2/sample_text.txt"
input: "./examples/large_models/inferentia2/opt/sample_text.txt"
requests: 2000
concurrency: 10
backend_profiling: False
Expand Down

0 comments on commit 3cb5a73

Please # to comment.