Skip to content
NeoStack
Esc
↑↓navigate↵open⌘Jpreview
On this page

LocalAI

Use LocalAI with NeoStack AI.

LocalAI is a self-hosted OpenAI-compatible API server for local or on-prem models.

Setup

  1. Start LocalAI with your chosen model.
  2. Confirm the LocalAI server is reachable.
  3. In NeoStack AI, open Settings > Chat & Agents > Chat Providers.
  4. Click + Add Custom Provider.
  5. Name it LocalAI.
  6. Set the base URL:
http://localhost:8080/v1
  1. Turn off Require an API key for a local unauthenticated server.
  2. If you enabled LOCALAI_API_KEY, keep Require an API key on and paste that key.
  3. Leave Auto-discover models from /models endpoint enabled.

Use It

Start a chat with Local & BYOK Chat and choose your LocalAI model.

Notes

  • LocalAI is designed as an OpenAI-compatible replacement.
  • If you expose LocalAI beyond your machine, protect it with authentication.
  • Tool-call behavior depends on the model and backend you run.

Was this page helpful?