query without interactive shell broken ?

[fredmo]

On the example :
client = Client()
response = client.chat.completions.create(
model="llama-3.1-405b",
messages=[{"role": "user", "content": QUERY}],
)
return(response.choices[0].message.content)

It sounds as a regression :
1/ if QUERY is a text message, there is no answser. there is an infinity wait , without answer.
2/ if QUERY is empty , you have a shell , you do a question, you do Ctrl+D , you have the answer.

Could you re allow the mode 1/ without the interactive shell ? or update / explain in your wiki.

[hlohaus]

Query Empty:
Blackbox: ResponseStatusError: Response 403: Query blocked
Jmuz: ResponseStatusError: Response 429: Rate limit

Query Hello:
Hello! How can I assist you today?

[github-actions]

Bumping this issue because it has been open for 7 days with no activity. Closing automatically in 7 days unless it becomes active again.