Allow change base_url

[rcherukuri12]

allow base_url to be set ...just not that but all other OpenAI config params.
This would make it flexible to switch and work as client for non-OpenAI local LLM servers that support OpenAI interface(s).

Adding more details:
I have a local LLM server LiteLLM running that honors OpenAPI calls.
I had to find out a round-about way of doing things like:
o = OpenAI.OpenAIProvider("junk", "http://localhost:8000", "")
and then passing this to the second create_chat(...) method to make it work.
would be great if the API is a bit more cleaner.

[roryl23]

allow base_url to be set

My suggestion is to override the base_url parameter like you did, however that works for your implementation. That's part of the intended purpose of the Provider structs.

all other OpenAI config params

Do you mean parameters like OpenAI-Organization?

would be great if the API is a bit more cleaner

By cleaner API, are you referring to the base_url problem, or something more general?

[rcherukuri12]

Thank you, my comment on the cleaner api just meant that the Azure Provider ( it doesn't have to be part of the main src, but can be provided as an example of override ).

[roryl23]

That seems like a reasonable refactor

[rcherukuri12]

Here is the example code for a local LLM that I run using OpenAI.jl :

https://github.com/rcherukuri12/ollama_julia_code_generator/blob/main/LiteLLM_Ollama_client.jl

[cpfiffer]

Sorry to revive a dead issue -- was there a good way to set the OpenAI organization key for requests?

[roryl23]

There isn't a canonical way implemented, I think