Integration

  • Agent Frameworks
    Agent CI supports popular frameworks including LangChain, LangGraph, Pydantic AI, LlamaIndex, and more. Automatic detection and evaluation without code modifications.

  • LangChain
    AgentCI automatically discovers and evaluates LangChain agents and tools. Support for LangGraph create_react_agent, @tool decorator, StructuredTool, and BaseTool patterns.

  • LlamaIndex
    AgentCI automatically discovers and evaluates LlamaIndex agents and tools. Support for FunctionAgent, ReActAgent, FunctionTool.from_defaults, and plain function patterns.

  • Pydantic AI
    AgentCI automatically discovers and evaluates Pydantic AI agents and tools. Support for Agent class with model and system_prompt, plus plain function tools.

  • OpenAI Agents SDK
    AgentCI automatically discovers and evaluates OpenAI Agents SDK agents and tools. Support for Agent class with @function_tool decorator and plain functions.

  • Google ADK
    AgentCI automatically discovers and evaluates Google ADK (Agent Development Kit) agents and tools. Support for Agent, LlmAgent, FunctionTool, and plain function patterns.

  • Agno
    AgentCI automatically discovers and evaluates Agno agents and tools. Support for Agent class with OpenAI/Anthropic models, Toolkit classes, @tool decorator, and plain functions.

  • GitHub Integration
    Native GitHub integration for automated evaluation and monitoring. Install the GitHub App to run evals on pull requests and track agent performance in production.