From 7aa061a81c9f47f56f4bc85df28be8db054ea41f Mon Sep 17 00:00:00 2001 From: Lubos Zima Date: Fri, 29 Mar 2024 15:07:04 +0700 Subject: [PATCH] feat: update README.md --- README.md | 13 +++++++++---- 1 file changed, 9 insertions(+), 4 deletions(-) diff --git a/README.md b/README.md index 0efebb5..989eb25 100644 --- a/README.md +++ b/README.md @@ -43,12 +43,17 @@ make tg-apply This should create a server at hetzner cloud and install all necessary software on it. -After that you can ssh to the server and run ollama run llama2-uncensored model, which is already pulled. +After that you can run locally command to port-forward port from webui from remote server to your local machine: ```bash -make ssh -# on server -ollama run llama2-uncensored +task webui ``` +After that you can open in your browser: [http://localhost:8080](http://localhost:8080) + +If you want upload some of yours files to web ui, you can use this command: +```bash +task upload +``` +This command will upload files from `./RAG-docs` directory to the server /home/devops/data/docs, and WebUI will use it to browse your data and answer questions related to this documents. ## BE CAREFUL This is just a simple example of how to run private AI on Hetzner Cloud. It's not production ready and should be used only for educational purposes.