awoooi

wooo/awoooi

Fork 0

Commit Graph

Author	SHA1	Message	Date
OG T	2f5986df5c	docs: ADR 整理與新增 (021-029) ADR 編號修正: - ADR-023 failure-auto-repair → ADR-028 - ADR-025 cicd-ai-integration → ADR-029 新增 ADR: - ADR-021: Playbook 更新驗證 - ADR-022: Sentry 整合架構 - ADR-027: Incident-Approval 同步 - ADR-028: 失敗自動修復閉環 - ADR-029: CI/CD AI 整合 (原 ADR-025) 更新: - ADR-018: LLM 測試策略狀態更新 Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>	2026-03-26 19:09:08 +08:00
OG T	fe7fd7a3e0	feat(tests): ADR-018 LLM 測試策略三層架構問題: LLM 測試因模型波動導致 CI 失敗解決方案: 三層測試策略 - Tier 1 (CI): Schema 驗證 + Golden Responses - Tier 2 (Nightly): 屬性測試 + Live LLM - Tier 3 (Weekly): 語意相似度測試新增檔案: - ADR-018-llm-testing-strategy.md - tests/llm_testing/ 框架 - schema_validators.py: Pydantic Schema 驗證 - property_validators.py: kubectl/風險等級驗證 - golden_responses.py: 預錄回應管理 - tests/test_llm_tier1_schema.py: 35 個 Tier 1 測試 Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>	2026-03-26 11:17:00 +08:00

Author

SHA1

Message

Date

OG T

2f5986df5c

docs: ADR 整理與新增 (021-029)

ADR 編號修正:
- ADR-023 failure-auto-repair → ADR-028
- ADR-025 cicd-ai-integration → ADR-029

新增 ADR:
- ADR-021: Playbook 更新驗證
- ADR-022: Sentry 整合架構
- ADR-027: Incident-Approval 同步
- ADR-028: 失敗自動修復閉環
- ADR-029: CI/CD AI 整合 (原 ADR-025)

更新:
- ADR-018: LLM 測試策略狀態更新

Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>

2026-03-26 19:09:08 +08:00

OG T

fe7fd7a3e0

feat(tests): ADR-018 LLM 測試策略三層架構

問題: LLM 測試因模型波動導致 CI 失敗

解決方案: 三層測試策略
- Tier 1 (CI): Schema 驗證 + Golden Responses
- Tier 2 (Nightly): 屬性測試 + Live LLM
- Tier 3 (Weekly): 語意相似度測試

新增檔案:
- ADR-018-llm-testing-strategy.md
- tests/llm_testing/ 框架
  - schema_validators.py: Pydantic Schema 驗證
  - property_validators.py: kubectl/風險等級驗證
  - golden_responses.py: 預錄回應管理
- tests/test_llm_tier1_schema.py: 35 個 Tier 1 測試

Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>

2026-03-26 11:17:00 +08:00

2 Commits