📝Prompt ComposerAuto-fit long prompts to any model's context window with priority-based sections and smart shrinkers.
🌊Streaming SSEReal-time Server-Sent Events streaming in 3 lines of code. Works with Nginx/Apache out of the box.
📊OpenTelemetry TracingIndustry-standard observability with automatic cost tracking, token usage, and OTLP export to Jaeger/Grafana.
🔍Context DiscoveryAd-hoc search over your database and CSV files with TNTSearch. No external services required.
🤖Multiple LLM ProvidersOpenAI, Anthropic Claude, and Mistral AI with a unified interface. Switch providers with one line.
🧠RAG & Vector SearchSemantic search with Pinecone, Qdrant, or Weaviate. Built-in document loaders for PDF, Word, and more.