Introduction

A modern template for agentic orchestration — built for rapid iteration and scalable deployment using highly customizable, community-supported tools like MCP, LangGraph, and more.

Visit the Github

Core Features

is an open protocol that standardizes how apps provide context to LLMs.

• Seamlessly integrates LLM with growing list of community integrations found here
• No LLM provider lock in

for Customizable Agentic Orchestration

• Native streaming for UX in complex Agentic Workflows
• Native persisted chat history and state management

Technology Stack and Features

• for Python backend API
• for Python SQL database interactions (ORM + Validation).
  • Wrapper of
• for Data Validation and Settings Management.
• for DB RBAC
  • Relational DB
  • Vector Store
• Reverse Proxy
• for development and production.

Planned Features

• for LLM Observability and LLM Metrics
• for scraping Metrics
• for visualizing Metrics
• SaaS for JWT authentication
• CI/CD via Github Actions
  • 💵 Deploy live demo to
  • Provision with IaC
  • Push built images to ECR and Dockerhub