Skip to content
New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

llama2-7b gives error in terraform apply (Azure) #35

Open
AI-Zebra opened this issue Aug 22, 2023 · 1 comment
Open

llama2-7b gives error in terraform apply (Azure) #35

AI-Zebra opened this issue Aug 22, 2023 · 1 comment

Comments

@AI-Zebra
Copy link

Input to deploy-aks.sh
Model to deploy: llama2-7b or falcon7b (default: falcon7b): llama2-7b

Plan: 9 to add, 0 to change, 0 to destroy.

│ Error: Invalid index

│ on main.tf line 297, in resource "kubernetes_deployment" "rag_server":
│ 297: value = "http://${kubernetes_service.falcon7b_service[0].status[0].load_balancer[0].ingress[0].ip}"
│ ├────────────────
│ │ kubernetes_service.falcon7b_service is empty tuple

│ The given key does not identify an element in this collection value: the collection has no elements.

The apply searched for falcon7b service where as it wont be applicable for llama-2.
Did any one else try this?

@lancedouglas1
Copy link

I had the same issue but instead decided to ignore llama2 option and try to use falcon7b just to try and get it running.

# for free to join this conversation on GitHub. Already have an account? # to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants