Repo AI đang lênCập nhật hằng ngày từ GitHub

The fastest path to AI-powered full stack observability, even for lean teams.

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Independent Auditing of AI Agents. Run by human or the agent itself, to answer the most crucial question in the AI Agent Economy. Is the agent doing what is supposed to do? With iFixAi you can have this answer in less than 120 seconds.

🪢 Open source AI engineering platform: AI Gateway, agent observability, evals, and prompt/skill management, built on OpenTelemetry. One open platform for every AI call and every agent. Self-host or use Langfuse Cloud.

SigNoz is an open-source, OpenTelemetry-native observability platform for your team and their AI agents. Get logs, metrics, and traces in one tool with features like APM, distributed tracing, log management, infra monitoring, etc. Combined with SigNoz MCP and a native AI teammate (in SigNoz Cloud) it helps you build more resilient apps.

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

Test your prompts, agents, and RAGs. Red teaming/pentesting/vulnerability scanning for AI. Compare performance of GPT, Claude, Gemini, DeepSeek, and more. Simple declarative configs with command line and CI/CD integration. Used by OpenAI and Anthropic.

eBPF-based Networking, Security, and Observability

APM, Application Performance Monitoring System

Prefect is a workflow orchestration framework for building resilient data pipelines in Python.

Self-Hosting Guide. Learn all about locally hosting (on premises & private web servers) and managing software applications by yourself or your organization. Including Cloud, LLMs, WireGuard, Automation, Home Assistant, and Networking.

CNCF Jaeger, a Distributed Tracing Platform

Debug, evaluate, and monitor your LLM applications, RAG systems, and agentic workflows with comprehensive tracing, automated evaluations, and production-ready dashboards.

Open source observability platform for logs, metrics, traces, RUM (web, android, ios), Session replay, pipelines, SLO and LLM observability. A sophisticated, simple and highly performant alternative to Datadog, Splunk, and Elasticsearch with 140x lower storage costs and single binary deployment.

Why is this running? Trace any process, port, container, or file back to what started it - CLI + TUI.

A high-performance observability data pipeline.

☁️ Build multimodal AI applications with cloud-native stack

Your window into all of your data

The LLM Evaluation Framework

Turns Data and AI algorithms into production-ready web applications in no time.

VictoriaMetrics: fast, cost-effective monitoring solution and time series database

Build production-ready applications in TypeScript

Zipkin is a distributed tracing system

Workflow Engine for Kubernetes

An orchestration platform for the development, production, and observation of data assets.

Apache Doris is a real-time analytics and hybrid search database for AI agents.

Free MLOps course from DataTalks.Club. Register here 👇🏼 to get notified about the next cohort

Capture SSL/TLS plaintext with eBPF—no MITM proxy or custom CA installation. Supports Linux and Android on x86_64\arm64 and loong64.

A curated list of references for MLOps

Highly available Prometheus setup with long term storage capabilities. A CNCF Incubating project.

AI Observability & Evaluation

eBPF-powered network observability for Kubernetes. Indexes L4/L7 traffic with full K8s context, decrypts TLS without keys. Queryable by AI agents via MCP and humans via dashboard.

Always know what to expect from your data.

An open-source framework for detecting, redacting, masking, and anonymizing sensitive data (PII) across text, images, and structured data. Supports NLP, pattern matching, and customizable pipelines.

Continuous Profiling Platform. Debug performance issues down to a single line of code

A booklet on machine learning systems design with exercises. NOT the repo for the book "Designing Machine Learning Systems", which is `dmls-book`

Build, Manage and Deploy AI/ML Systems

Resolve production issues, fast. An open source observability platform unifying session replays, logs, metrics, traces and errors powered by ClickHouse and OpenTelemetry.

the LLM vulnerability scanner

Open-source, low-code AutoML platform for Python. PyCaret 4.0: sklearn-native engine + React control plane.

A curated collection of publicly available resources on how technology and tech-savvy organizations around the world practice Site Reliability Engineering (SRE)

highlight.io: The open source, full-stack monitoring platform. Error monitoring, session replay, logging, distributed tracing, and more.

The easiest way to serve AI apps and models - Build Model Inference APIs, Job queues, LLM apps, Multi-model pipelines, and more!

Observability and enforcement for AI agent harnesses. Capture every run and runtime reliability with policy enforcement.

Evidently is ​​an open-source ML and LLM observability framework. Evaluate, test, and monitor any AI-powered system or data pipeline. From tabular data to Gen AI. 100+ metrics.

Coroot is an open-source observability and APM tool with AI-powered Root Cause Analysis. It combines metrics, logs, traces, continuous profiling, and SLO-based alerting with predefined dashboards and inspections.

Complete open-source monitoring and observability platform.

OpenTelemetry Collector

Open-source observability for your GenAI or LLM application, based on OpenTelemetry

NeMo Guardrails is an open-source toolkit for easily adding programmable guardrails to LLM-based conversational systems.