Skip to content

v0.1.3
Compare
Choose a tag to compare
@c0sogi c0sogi released this 09 Aug 13:40
· 79 commits to master since this release
v0.1.3
178fe3e
This commit was created on github.com and signed with GitHub’s verified signature. The key has expired.
GPG key ID: 4AEE18F83AFDEB23
Expired
Learn about vigilant mode.

This release encompasses several enhancements to usability and code refactoring. The primary changes include:

  1. Skip compilation: You can skip compilation of llama.cpp shared library when running server with --install-pkgs. Just add --skip-compile option.
  2. Removed auto process kill feature: Killing process when unloading model, was introduced to prevent the program from memory leak, but this sometimes make the program exit for no reason. So this feature is removed.
  3. API key checker: API key checker will be activated if you start the server with option --api-key YOUR_API_KEY. Client must include Authorization header with Bearer YOUR_API_KEY.
Assets 2
Loading