LLaVA-Plus: Large Language and Vision Assistants that Plug and Learn to Use Skills

kani (カニ) is a highly hackable microframework for chat-based language models with tool use/function calling. (NLP-OSS @ EMNLP 2023)

TxAgent: An AI Agent for Therapeutic Reasoning Across a Universe of Tools

[ICLR'25] BigCodeBench: Benchmarking Code Generation Towards AGI

A working pattern for SSE-based MCP clients and servers

AvaTaR: Optimizing LLM Agents for Tool Usage via Contrastive Reasoning (NeurIPS 2024)

A multimodal chat interface with many tools.

ToolUniverse is a collection of biomedical tools designed for AI agents

VT.ai - Minimal multimodal AI chat app with dynamic conversation routing

SirChatalot is a Telegram bot leveraging ChatGPT, Claude or YandexGPT. It uses Whisper for speech-to-text and DALL-E, Stability AI or YandexART for image creation. It can use vision capabilities, tools and semantic search in vector DB.

tiny_fnc_engine is a minimal python library that provides a flexible engine for calling functions extracted from a LLM.

Tool-use Robotic Benchmark built with Drake Simulation

LLM Agents Making Agent Tools

Official code for AAAI2023 paper`Confucius: Iterative Tool Learning from Introspection Feedback by Easy-to-Difficult Curriculum`

Using LLMs and rules for a local personal agent

Chat application with multi-agents system supports multi-models and MCP

ToolRegistry for easier function calling

A travel agent based on Qwen2.5, fine-tuned by SFT + DPO/PPO/GRPO using traveling question-answer dataset, a mindmap can be output using the response. A RAG system is build upon the tuned qwen2, using Prompt-Template + Tool-Use + Chroma embedding database + LangChain

歇斯底里的双色球！But Chat with LLM

Gym tool use environments.