🤱🏻 Turn any webpage into a desktop app with Rust. 🤱🏻 利用 Rust 轻松构建轻量级多端桌面应用

All-in-one LLM CLI tool featuring Shell Assistant, Chat-REPL, RAG, AI Tools & Agents, with access to OpenAI, Claude, Gemini, Ollama, Groq, and more.

Postgres with GPUs for ML/AI apps.

[Unmaintained, see README] An ecosystem of Rust libraries for working with large language models

Blazingly fast LLM inference.

A high-performance LLM inference API and Chat UI that integrates DeepSeek R1's CoT reasoning traces with Anthropic Claude models.

TensorZero creates a feedback loop for optimizing LLM applications — turning production data into smarter, faster, and cheaper models.

⚙️🦀 Build portable, modular & lightweight Fullstack Agents

A blazing fast inference solution for text embeddings models

The AI framework that adds the engineering to prompt engineering (Python/TS/Ruby/Java/C#/Rust/Go compatible)

LSP-AI is an open-source language server that serves as a backend for AI-powered functionality, designed to assist and empower software engineers, not replace them.

All-in-one infrastructure for search, recommendations, RAG, and analytics offered via API

Scalable, Low-latency and Hybrid-enabled Vector Search in Postgres. Revolutionize Vector Search, not Database.

A fast Rust based tool to serialize text-based files in a repository or directory for LLM consumption

AICI: Prompts as (Wasm) Programs

Instant, controllable, local pre-trained AI models in Rust

A program that provides LLMs with the ability to complete complex tasks using plugins.

《构筑大语言模型应用：应用开发与架构设计》一本关于 LLM 在真实世界应用的开源电子书，介绍了大语言模型的基础知识和应用，以及如何构建自己的模型。其中包括Prompt的编写、开发和管理，探索最好的大语言模型能带来什么，以及LLM应用开发的模式和架构设计。

`llm-chain` is a powerful rust crate for building chains in large language models allowing you to summarise text and complete complex tasks

Korvus is a search SDK that unifies the entire RAG pipeline in a single database query. Built on top of Postgres with bindings for Python, JavaScript, Rust and C.