kong-plugin-nadir

Cost-aware LLM model routing for Kong via Nadir's decision API

$ luarocks install kong-plugin-nadir

A Kong plugin that turns a single virtual model name ("nadir-auto") into an
intelligent, cost-aware routing decision. In the access phase it asks
Nadir's decision-only endpoint (/v1/recommend, no LLM call) which real model
fits the prompt, rewrites the upstream request body, and fails open on any
error. Auth, provider keys, streaming, and logging stay with Kong.

Versions

0.1.1-11 hour ago1 download
0.1.0-11 day ago1 download

Dependencies

lua >= 5.1

Manifests