Giulio De Pasquale
d76ccbe564
feat(ollama): configure environment variables for ollama service
...
- Updated `services.ollama` to include `environmentVariables` object
- Configured `OLLAMA_ORIGINS`, `OLLAMA_FLASH_ATTENTION`, and `OLLAMA_NUM_PARALLEL` variables
- Changed the value of `OLLAMA_NUM_PARALLEL` to "2" from "3"
2024-06-04 22:50:49 +01:00
Giulio De Pasquale
86689e4bc6
ollama: removed commented-out docker
2024-05-27 13:39:06 +01:00
Giulio De Pasquale
3e2e530d49
llm: re-use ollama upstream
2024-05-23 23:45:48 +01:00
Giulio De Pasquale
404a53135c
ollama: use docker
2024-05-14 17:09:45 +01:00
Giulio De Pasquale
6a4c92334f
llm: fixed webui ollama uri
2024-04-28 01:29:48 +01:00
Giulio De Pasquale
0e82ac644b
llm: remove unused config arg
2024-04-17 17:01:45 +01:00
Giulio De Pasquale
57f5b0a4e2
ollama: fix proxying
2024-04-02 22:56:17 +01:00
Giulio De Pasquale
32dc2af002
ollama: use native ollama
2024-03-14 11:55:56 +00:00
Giulio De Pasquale
9b21c7d2ef
architect: use docker ollama
2024-02-21 11:33:54 +00:00
Giulio De Pasquale
a30d0f2e68
llm: fixed upstream image for big-agi. use ollama with GPU support
2024-01-09 14:59:25 +01:00
Giulio De Pasquale
b2cf092f78
architect: added LLM module
2023-11-16 13:25:58 +01:00