Compare commits

...

4 Commits

Author SHA1 Message Date
Satya Devineni
5b9c6f42cc
Merge 9c4183df2b into 8452a1c5b1 2026-04-08 11:38:10 +08:00
GitLab CI
8452a1c5b1 chore: Regenerate all playbooks 2026-04-08 02:41:59 +00:00
GitLab CI
9414a5141f chore: Regenerate all playbooks 2026-04-07 04:13:30 +00:00
Satya Devineni
9c4183df2b
Fix directory path in README.md 2026-01-11 06:19:13 +00:00
3 changed files with 16 additions and 5 deletions

View File

@ -172,12 +172,15 @@ Verify the NVIDIA runtime works:
docker run --rm --runtime=nvidia --gpus all ubuntu nvidia-smi
```
If you get a permission denied error on `docker`, add your user to the Docker group and log out/in:
If you get a permission denied error on `docker`, add your user to the Docker group and activate the new group in your current session:
```bash
sudo usermod -aG docker $USER
newgrp docker
```
This applies the group change immediately. Alternatively, you can log out and back in instead of running `newgrp docker`.
> [!NOTE]
> DGX Spark uses cgroup v2. OpenShell's gateway embeds k3s inside Docker and needs host cgroup namespace access. Without `default-cgroupns-mode: host`, the gateway can fail with "Failed to start ContainerManager" errors.
@ -322,13 +325,21 @@ http://127.0.0.1:18789/#token=<long-token-here>
**If accessing the Web UI from a remote machine**, you need to set up port forwarding.
First, find your Spark's IP address. On the Spark, run:
```bash
hostname -I | awk '{print $1}'
```
This prints the primary IP address (e.g. `192.168.1.42`). You can also find it in **Settings > Wi-Fi** or **Settings > Network** on the Spark's desktop, or check your router's connected-devices list.
Start the port forward on the Spark host:
```bash
openshell forward start 18789 my-assistant --background
```
Then from your remote machine, create an SSH tunnel to the Spark:
Then from your remote machine, create an SSH tunnel to the Spark (replace `<your-spark-ip>` with the IP address from above):
```bash
ssh -L 18789:127.0.0.1:18789 <your-user>@<your-spark-ip>

View File

@ -27,8 +27,8 @@ services:
# Ollama configuration
- OLLAMA_BASE_URL=http://ollama:11434/v1
- OLLAMA_MODEL=llama3.1:8b
# Disable vLLM
- VLLM_BASE_URL=http://localhost:8001/v1
# vLLM disabled in default Ollama mode
# - VLLM_BASE_URL=http://localhost:8001/v1
- VLLM_MODEL=disabled
# Vector DB configuration
- QDRANT_URL=http://qdrant:6333

View File

@ -108,7 +108,7 @@ export class TextProcessor {
// Determine which LLM provider to use based on configuration
// Priority: vLLM > NVIDIA > Ollama
if (process.env.VLLM_BASE_URL) {
if (process.env.VLLM_BASE_URL && process.env.VLLM_MODEL && process.env.VLLM_MODEL !== 'disabled') {
this.selectedLLMProvider = 'vllm';
} else if (process.env.NVIDIA_API_KEY) {
this.selectedLLMProvider = 'nvidia';