Skip to content
New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

[benchmarks] enable TGI to use Hugging Face DLC #821

Open
annapendleton opened this issue Sep 17, 2024 · 0 comments
Open

[benchmarks] enable TGI to use Hugging Face DLC #821

annapendleton opened this issue Sep 17, 2024 · 0 comments

Comments

@annapendleton
Copy link
Collaborator

Validate and enable image use for ghcr.io/huggingface/text-generation-inference:1.4.2 to us-docker.pkg.dev/deeplearning-platform-release/gcr.io/huggingface-text-generation-inference-cu121.2-2.ubuntu2204.py310

We might also want to parameterize the image so that users can specify which image they want to benchmark, and offer the DLC image in a sample tfvars file for ease of deployment.

Conversation:
#816 (comment)

# for free to join this conversation on GitHub. Already have an account? # to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant