CPU Support by using ctransformers v0.2.0

• Support for CPU inference (GGML models)
• GPU Required for GPTQ models

12 GB VRAM recommended (GPTQ models 13B models)
8 GB VRAM recommended (GPTQ models 7B models)

The installer was generated with Inno Setup

Install only for your user (the software create model files in the installation directory, so do not install it at program files)

Version 0.1.0

The first release

• GPU Required

• 12 GB VRAM recommended

• The installer was generated with Inno Setup

• Install only for your user (the software create model files in the installation directory, so do not install it at program files)