RAGOps

English · Tiếng Việt · 日本語

Offline, reproducible release gates for RAG systems and AI agents.

%%{init: {"theme":"base","themeVariables":{"background":"#FFFFFF","fontFamily":"Arial, sans-serif","lineColor":"#667085","primaryTextColor":"#172B4D"}}}%%
flowchart LR
    S["Scenario<br/>Kịch bản / シナリオ"]:::yellow
    B["Accepted baseline<br/>Mốc chuẩn / 基準"]:::blue
    C["Candidate traces<br/>Ứng viên / 候補"]:::purple
    E["Evaluators & policy<br/>Đánh giá / 評価"]:::green
    G{"PASS / WARN / BLOCK"}:::pink
    S --> E
    B --> E
    C --> E --> G
    classDef yellow fill:#FFF4A3,stroke:#C9A227,stroke-width:2px,color:#172B4D
    classDef blue fill:#D9EAFD,stroke:#4C78A8,stroke-width:2px,color:#172B4D
    classDef purple fill:#E9DDF7,stroke:#8064A2,stroke-width:2px,color:#172B4D
    classDef green fill:#DDF5E3,stroke:#4F9D69,stroke-width:2px,color:#172B4D
    classDef pink fill:#FFE1E6,stroke:#C96A7B,stroke-width:2px,color:#172B4D

Loading

English

RAGOps compares recorded candidate behavior with an accepted baseline, applies a versioned release policy, and emits one canonical PASS, WARN, or BLOCK decision across JSON, Markdown, HTML, JUnit, SARIF, and GitHub Summary. The dependency-free core performs no network calls. Optional adapters import vendor exports; the API/workbench ships in the wheel through the api extra.

Requirements: Python 3.11+.

Current technical references: architecture, contracts, governance, operations, security, and v2.0.2 release notes.

The repository is also a skills-only plugin for ChatGPT, Codex, Claude Code and Cowork. It does not include a hosted MCP connector. See the directory submission package, privacy policy, terms, and support guidance.

pip install ragops
ragops demo --profile engineer --output ./demo-output
ragops evidence verify --bundle ./demo-output/evidence
open ./demo-output/release-report.html

On Windows PowerShell, replace the final command with Start-Process ./demo-output/release-report.html.

The credential-free demo intentionally returns BLOCK: citation coverage 1.0 -> 0.5, citation precision 1.0 -> 0.5, and lexical groundedness 1.0 -> 0.6. It is synthetic benchmark evidence, not production adoption evidence.

Install ragops[api] and run ragops serve for the local authenticated API/workbench. Use ragops adapter list for Phoenix, Ragas, DeepEval, LangSmith, MLflow, Promptfoo, custom JSON, and installed entry-point adapters.

Local CLI usage evidence is disabled by default. Set RAGOPS_USAGE_LOG to an explicit JSONL path to record only the UTC timestamp, RAGOps version, top-level command, and exit code; arguments and file paths are never recorded. Summarize the file with ragops usage-report --events usage.jsonl. Use the consent-aware pilot-report contract and the production pilot runbook for production adoption evidence.

Tiếng Việt

RAGOps so sánh trace ứng viên với baseline được chấp nhận, áp dụng release policy có version và xuất cùng một quyết định PASS, WARN hoặc BLOCK sang JSON/Markdown/HTML/JUnit/SARIF. Core không dependency, chạy offline; API/workbench là extra tùy chọn. Demo synthetic cố ý tạo BLOCK, không phải bằng chứng production adoption.

Yêu cầu: Python 3.11+. Dùng các lệnh ở phần English để cài đặt, kiểm tra scenario, lint và test.

日本語

RAGOps は記録済み候補を承認済みベースラインと比較し、バージョン管理された方針から一つの PASS・WARN・BLOCK 判定を JSON、Markdown、HTML、JUnit、SARIF に出力します。依存関係のない core はオフラインで動作し、API/workbench は任意の extra です。デモは synthetic evidence であり、本番導入実績ではありません。

必要環境は Python 3.11 以上です。セットアップ、lint、テストには English セクションのコマンドを使用してください。

Released under the MIT License.