LiteLLM

AI model gateway routing API calls with an edge-gated administrative dashboard.

KeyValue
Source dir/home/loca/dev/lllm
Runs aslllm-proxy
Restart commandcd /home/loca/dev/lllm && sudo docker compose restart proxy
Logs commandsudo docker logs --tail 50 lllm-proxy
Health probecurl -s -o /dev/null -w '%{http_code}' https://lllm.loca.zone/ (expected: 302)
Edge gate detaillllm.loca.zone:4,10,25,42,57 authelia-location + authrequest on UI routes
Cert lineage/etc/letsencrypt/live/lllm.loca.zone/fullchain.pem

Sources

  • /etc/nginx/sites-enabled/lllm.loca.zone:4,10,11,87
  • /home/loca/dev/lllm/docker-compose.yml:1-35