| title | emoji | colorFrom | colorTo | sdk | pinned | app_port |
|---|---|---|---|---|---|---|
Template Node Llama Express |
🏗️ |
gray |
blue |
docker |
false |
7860 |
A minimalist Docker Space to help people getting started with Node, Express, node-llama and TypeScript
- Install NVM: https://github.com/nvm-sh/nvm
- Install Docker https://www.docker.com
You need to downloaded yourself airoboros-13b-gpt4.ggmlv3.q4_0.bin in the ./models/ folder.
If you plan to change the model, then edit the modelPath in `/src/index.mts`` acconrdingly.
nvm use
npm i
npm run startThen open the generator by passing a prompt in the query parameters:
http://localhost:7860?prompt=a webpage recipe for making chocolate chip cookies
Note: the model will be downloaded by Docker, see the last lines in the Dockerfile.
npm run dockerThis script is a shortcut executing the following commands:
docker build -t template-node-llama-express .
docker run -it -p 7860:7860 template-node-llama-express