Skip to content
New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

[BUG] Failed Groq API #901

Open
irosyadi opened this issue Aug 5, 2024 · 4 comments
Open

[BUG] Failed Groq API #901

irosyadi opened this issue Aug 5, 2024 · 4 comments
Assignees
Labels
bug Something isn't working

Comments

@irosyadi
Copy link

irosyadi commented Aug 5, 2024

Describe the bug / 描述问题

Groq API cannot respond to the prompt input.

To Reproduce / 复现步骤

  1. Enter Groq API key.
    2.Choose any Groq model: Llama3 8B, Llama3 70B, or Mixtral 8x7B.
  2. Input prompt.

Expected behavior / 期望行为

If selected, any Groq models should respond to the prompt input.

Screenshots / 截图

image

Devtools Info / 开发者工具信息

LangChainBot.js:56
POST https://api.groq.com/openai/v1/chat/completions 400 (Bad Request)
Bot.js:204 Error send prompt to Llama 3 70b@Groq API:
Error: 400 {"error":{"message":"'temperature' : value must be a number","type":"invalid_request_error"}}
at C.generate (error.mjs:36:20)
at Fe.makeStatusError (core.mjs:256:25)
at Fe.makeRequest (core.mjs:299:30)
at async t._fn (index.js:50:4)

OS and version / 操作系统版本

Windows 10

ChatALL version / ChatALL 版本

v1.82.107

Network / 网络

No

Additional context / 其它相关信息

No response

@irosyadi irosyadi added the bug Something isn't working label Aug 5, 2024
@PeterDaveHello PeterDaveHello self-assigned this Sep 27, 2024
@PeterDaveHello
Copy link
Collaborator

Tested it on my end, but didn't encounter the issue. Just sharing my findings.

image

@PeterDaveHello
Copy link
Collaborator

@irosyadi based on the error message, would you please help check if Groq API's temperature config is a number or not?

image

@irosyadi
Copy link
Author

irosyadi commented Oct 2, 2024

Yes, I believe this is the source of the problem. Solved.

@PeterDaveHello
Copy link
Collaborator

Thanks, I'll see if that's something happening for every new user or clean installation.

# for free to join this conversation on GitHub. Already have an account? # to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

2 participants