Ultrafast serverless GPU inference, sandboxes, and background jobs

🏗️ Fine-tune, build, and deploy open-source LLMs easily!

A holistic way of understanding how Llama and its components run in practice, with code and detailed documentation.

A highly efficient, secure, and stable application development platform with excellent performance, easy scalability, and deep integration of AI capabilities such as LLM, AI Chat, RAG, and Agents.高效、安全、稳定的服务研发平台，具备良好性能，同时易扩展，深度集成LLM、AIChat、RAG、Agent等AI能力

[deprecated] AI Gateway - core infrastructure stack for building production-ready AI Applications

A diverse, simple, and secure all-in-one LLMOps platform

Instant Messaging (IM) integrating GoZero microservices with AI large model applications 融合 GoZero 微服务和 AI 大模型应用的即时通讯 IM

Implement RAG (using LangChain and PostgreSQL) for Go applications to improve the accuracy and relevance of LLM outputs

An AI assisted kubectl helper

Interactive Fiction in the Age of AI

Go package and example utilities for using Ollama / LLMs

AWS Go SDK examples for Amazon Bedrock

Inference Llama 2 in one file of pure go

Type-safe AI agents for Go. Suricata combines LLM intelligence with Go’s strong typing, declarative YAML specs, and code generation to build safe, maintainable, and production-ready AI agents.

Go framework for language model-powered applications with composability and chaining. Inspired by LangChain.

A simple Read-It-Later and link collection tool, AI-powered for text and images, multi-platform, open-source. A browser extension available for one-click bookmarking. My undergraduate thesis at HUST.

LLM Prompt Injection Detection API Service PoC.

With an emphasis on pluggable architecture and platform flexibility, Thor is a highly modular chat engine integrated into Go.

This repository is a work in progress (WIP).

🧠 Cache implementation for storing and retrieving results of language model (LLM) requests