Back to home

    Attach Gateway – Quick Start 🚀

    Get secure, authenticated LLM endpoints running in 60 seconds

    Setup

    terminal
    # ① Install
pip install attach-dev

# ② Point Attach at your local model
export ENGINE_URL=http://localhost:11434      # Ollama default
export OIDC_ISSUER=https://<your-issuer>/     # Auth0, Descope, Okta…

# optional memory adapter
docker run -d -p 6666:8080 semitechnologies/weaviate

# ③ Run the gateway
attach-gateway --port 8080

    Test it

    terminal
    curl -H "Authorization: Bearer $JWT" \
     http://localhost:8080/api/generate \
     -d 'Hello!'

    What happens?

    Attach verifies the token, adds X-Attach-User & X-Attach-Session, and mirrors the prompt + completion to Weaviate.