Commit Graph

18 Commits

Author SHA1 Message Date
Giulio De Pasquale
1542d67202 feat(llm): openwebui 2025-03-10 12:30:55 +00:00
Giulio De Pasquale
d7a3a3bcf3 refactor(architect/llm.nix): update configuration to use config for host and port 2025-03-09 14:31:50 +00:00
Giulio De Pasquale
15256e49d2 fix(architect/llm.nix): update ollamaPkg to use ollama-cuda 2025-01-15 17:20:07 +00:00
Giulio De Pasquale
29c2526e6a feat(architect/llm.nix): add OLLAMA_KV_CACHE_TYPE environment variable
- Added `OLLAMA_KV_CACHE_TYPE` with value `"q8_0"` to the environment variables in `llm.nix`
2024-12-08 12:01:01 +00:00
Giulio De Pasquale
2b17b0b463 refactor(architect/llm.nix): simplify and clean up configuration
- Removed unused frontend domain, port, and listen address variables
- Centralized `ollamaHost` and `ollamaPort` usage
- Cleaned up commented-out sections for future reference or removal
- Ensured consistent placement of `acceleration` in the `services.ollama` block
2024-11-18 19:56:48 +00:00
Giulio De Pasquale
48f370d9a4 refactor(architect/llm.nix): comment out frontend vhost and container configurations
- Commented out the `frontendDomain` vhost configuration
- Updated backend port to use `ollamaPort`
- Added `recommendedProxySettings = false;` for backend vhost
- Commented out the entire OCI containers section for `ollama-webui`
2024-11-17 20:29:57 +00:00
Giulio De Pasquale
2487717aaf fix(ollama): DNS resolution in LAN 2024-10-07 13:05:45 +01:00
Giulio De Pasquale
d76ccbe564 feat(ollama): configure environment variables for ollama service
- Updated `services.ollama` to include `environmentVariables` object
- Configured `OLLAMA_ORIGINS`, `OLLAMA_FLASH_ATTENTION`, and `OLLAMA_NUM_PARALLEL` variables
- Changed the value of `OLLAMA_NUM_PARALLEL` to "2" from "3"
2024-06-04 22:50:49 +01:00
Giulio De Pasquale
86689e4bc6 ollama: removed commented-out docker 2024-05-27 13:39:06 +01:00
Giulio De Pasquale
3e2e530d49 llm: re-use ollama upstream 2024-05-23 23:45:48 +01:00
Giulio De Pasquale
404a53135c ollama: use docker 2024-05-14 17:09:45 +01:00
Giulio De Pasquale
6a4c92334f llm: fixed webui ollama uri 2024-04-28 01:29:48 +01:00
Giulio De Pasquale
0e82ac644b llm: remove unused config arg 2024-04-17 17:01:45 +01:00
Giulio De Pasquale
57f5b0a4e2 ollama: fix proxying 2024-04-02 22:56:17 +01:00
Giulio De Pasquale
32dc2af002 ollama: use native ollama 2024-03-14 11:55:56 +00:00
Giulio De Pasquale
9b21c7d2ef architect: use docker ollama 2024-02-21 11:33:54 +00:00
Giulio De Pasquale
a30d0f2e68 llm: fixed upstream image for big-agi. use ollama with GPU support 2024-01-09 14:59:25 +01:00
Giulio De Pasquale
b2cf092f78 architect: added LLM module 2023-11-16 13:25:58 +01:00