Trending AI reposUpdated daily from GitHub

Network inspector for your backend

Ultra-low-latency asynchronous C++17 logging and metrics library for performance-critical applications

Community maintained hardware plugin for vLLM on Huawei Ascend

An open-source data logging library for machine learning models and data pipelines. 📚 Provides visibility into data quality & model performance over time. 🛡️ Supports privacy-preserving data collection, ensuring safety & robustness. 📈

Apache Hamilton helps data scientists and engineers define testable, modular, self-documenting dataflows, that encode lineage/tracing and metadata. Runs and scales everywhere python does.

🕵️‍♂️ TUI for sniffing network traffic using eBPF on Linux

cubestudio开源云原生一站式机器学习/深度学习/大模型AI平台/MaaS/mlops/人工智能平台/训推平台，算法全链路流程，多租户，算力租赁平台，token中转，拖拉拽任务流pipeline编排，多机多卡分布式训练，超参搜索，推理服务，VGPU虚拟化，云边端协同，边缘计算，自动化标注平台，deepseek等大模型sft微调/奖励模型/强化学习训练，vllm/ollama/mindie大模型多机推理，私有知识库llmops智能体，AI模型市场，支持国产异构算力调度,昇腾/寒武纪/海光/摩尔/沐曦等，支持ib/roce/RDMA，信创支持

Build applications that make decisions (chatbots, agents, simulations, etc...). Monitor, trace, persist, and execute on your own infrastructure.

Parseable is an open source, unified infrastructure observability platform built in Rust on a data lake architecture. It tracks logs, metrics, traces, and events across apps, agents, and systems, reducing storage costs by up to 90% through columnar telemetry compression.

🦥 Easy and simple Prometheus SLO (service level objectives) generator

The CNCF sandbox for observability visualisation. Supports Prometheus, Tempo, Loki, Pyroscope, and more!

A curated list of awesome projects and resources related to Argo (a CNCF graduated project)

Fast and easy to use database for logs, which can efficiently handle terabytes of logs

LUPINE is a GPU over IP bridge allowing GPUs on remote machines to be attached to CPU-only machines.

UpTrain is an open-source unified platform to evaluate and improve Generative AI applications. We provide grades for 20+ preconfigured checks (covering language, code, embedding use-cases), perform root cause analysis on failure cases and give insights on how to resolve them.

🤖Self-Modifying Framework from the Future 🔮 World's First AMS

Open-source, end-to-end platform for evaluating, observing, and improving LLM and AI agent applications. Tracing · Evals · Simulations · Datasets · Gateway · Guardrails. Self-hostable. Apache 2.0.

🏕️ Reproducible development environment for humans and agents

Fast and Lightweight Observability Data Collector

eBPF-based autoinstrumentation of web applications and network metrics

MLOps examples

Monoscope lets you ingest and explore your logs, traces and metrics. We store these in S3 compatible buckets. Query in natural language via LLMs.

A log viewer for Kubernetes troubleshooting

Instant K8s service dependency map, right to your Grafana.

An extensible Java library for HTTP request and response logging

🐳 Elastic Stack (ELK) v9+ on Docker with Compose. Pre-configured out of the box to enable Logging, Metrics, APM, Alerting, ML, and SIEM features. Up with a Single Command.

Feathr – A scalable, unified data and AI engineering platform for enterprise

Digging through logs is not observability. It's hope — wide events, structured errors, TypeScript-first, every runtime.

:star: :star: Distributed tcpdump for cloud native environments :star: :star:

AI Infrastructure Engineer Learning Track - Production ML infrastructure curriculum (2-4 years experience)

0x.Tools: X-Ray vision for Linux systems

Safety-first guardrails for AI-driven cloud and Kubernetes operations

Real-time logging dashboard for Kubernetes. View logs in a terminal or a browser. Run anywhere - desktop, cluster, docker.

Tencent Server Web

100x Efficient Log Management than Splunk :rocket: Reduce your observability cost by 90%

Vendor-neutral programmable observability pipelines.

⭐️ The Open-Source Polyglot Observability Warehouse: Light, Fast, Cloud Native, Drop-in Grafana LGTMP alternative :rocket: Indie All-in-One Opentelemetry, Loki, Prometheus, Tempo, Pyroscope On-Prem Alternative :star:

Intelligence for Kubernetes. World's most promising Kubernetes Visualization Tool for Developer and Platform Engineering teams.

OpenMLDB is an open-source machine learning database that provides a feature platform computing consistent features for training and inference.

MLRun is an open source MLOps platform for quickly building and managing continuous ML applications across their lifecycle. MLRun integrates into your development and CI/CD environment and automates the delivery of production data, ML pipelines, and online applications.

The .NET/.NET Core instrument agent for Apache SkyWalking

Build, enrich, and transform datasets using AI models with no code

:closed_book: Clarity in the current fast-paced mess of Open Source innovation

Deterministic guardrails that don't break agents

TCP proxy for simulating variable, yet predictable network latency :globe_with_meridians::hourglass_flowing_sand:

Akto is the fastest growing AI Security platform for your teams to secure AI agents, MCPs, LLMs, Agent skills, Gen AI apps in your organization.

Open-source observability tool that uses AI agents to self-heal your software

Rapid development of self-documenting APIs

Qtap: An eBPF agent that captures pre-encrypted network traffic, providing rich context about egress connections and their originating processes.

ModelFox makes it easy to train, deploy, and monitor machine learning models.