LLaMA Server combines the power of LLaMA C++ with the beauty of Chatbot UI

[nuance1979]

Hi folks, I wrote LLaMA Server, a small http server to mimic the OpenAI APIs so that you can use Chatbot UI, an open source implementation of ChatGPT UI, to interact with a LLaMA C++ instance. Here is a demo:

demo.mov

Hope you enjoy it! Cheers!

[gaemus]

In order to run the Llama version, you first need to input your OpenAI API key - then you can switch the Model to Llama. This should be mentioned in the README. It would be better if you could access the Llama model without an OpenAI API key.