Commit Graph

379 Commits

Author SHA1 Message Date
AWOOOI CD
76aaaf480c chore(cd): deploy c1ac157 [skip ci] 2026-05-06 17:08:36 +08:00
AWOOOI CD
73d7e332a4 chore(cd): deploy 33f85ec [skip ci] 2026-05-06 16:58:49 +08:00
AWOOOI CD
38a4748e17 chore(cd): deploy 8f715fd [skip ci] 2026-05-06 16:50:14 +08:00
AWOOOI CD
a94435f143 chore(cd): deploy a7a9ba9 [skip ci] 2026-05-06 16:39:29 +08:00
AWOOOI CD
4e9981c182 chore(cd): deploy 7ed8c95 [skip ci] 2026-05-06 16:27:04 +08:00
AWOOOI CD
1e68d45659 chore(cd): deploy 60c00d7 [skip ci] 2026-05-06 16:15:52 +08:00
AWOOOI CD
72811b967e chore(cd): deploy 927c2a7 [skip ci] 2026-05-06 16:06:58 +08:00
AWOOOI CD
154aec849e chore(cd): deploy 2245316 [skip ci] 2026-05-06 15:35:05 +08:00
AWOOOI CD
6c4f8379ad chore(cd): deploy d441f70 [skip ci] 2026-05-06 07:00:07 +00:00
Your Name
d441f70693 fix(ai): add 188 ollama retirement gate
All checks were successful
Code Review / ai-code-review (push) Successful in 10s
CD Pipeline / tests (push) Successful in 1m2s
CD Pipeline / build-and-deploy (push) Successful in 9m2s
CD Pipeline / post-deploy-checks (push) Successful in 1m15s
2026-05-06 14:55:21 +08:00
AWOOOI CD
033ac8129b chore(cd): deploy 4111ea4 [skip ci] 2026-05-06 14:40:02 +08:00
Your Name
4111ea4f9f fix(ai): remove 188 ollama provider
All checks were successful
Code Review / ai-code-review (push) Successful in 12s
CD Pipeline / tests (push) Successful in 1m13s
CD Pipeline / build-and-deploy (push) Successful in 3m36s
CD Pipeline / post-deploy-checks (push) Successful in 1m20s
2026-05-06 14:34:48 +08:00
AWOOOI CD
eb71bc61ed chore(cd): deploy 8ae7789 [skip ci] 2026-05-06 13:31:01 +08:00
AWOOOI CD
56b4d8165b chore(cd): deploy c696b99 [skip ci] 2026-05-06 13:10:34 +08:00
OG T
c696b99ccf fix(awooop): authenticate approval decisions
All checks were successful
Code Review / ai-code-review (push) Successful in 11s
CD Pipeline / tests (push) Successful in 1m3s
CD Pipeline / build-and-deploy (push) Successful in 3m28s
CD Pipeline / post-deploy-checks (push) Successful in 1m25s
2026-05-06 13:05:51 +08:00
AWOOOI CD
072cc23a42 chore(cd): deploy 682c0b9 [skip ci] 2026-05-06 12:51:20 +08:00
AWOOOI CD
96ad3a18ee chore(cd): deploy 9ef9633 [skip ci] 2026-05-06 12:42:30 +08:00
Your Name
9ef9633aff fix(alerts): bypass proxy timeout for GCP Ollama 2026-05-06 08:55:14 +08:00
AWOOOI CD
df5e6c6626 chore(cd): deploy d2aebdd [skip ci] 2026-05-06 07:33:25 +08:00
Your Name
09256be62c fix(rag): use bge embeddings on GCP Ollama lane
Some checks failed
Code Review / ai-code-review (push) Successful in 11s
CD Pipeline / tests (push) Successful in 1m22s
CD Pipeline / build-and-deploy (push) Failing after 2h14m5s
CD Pipeline / post-deploy-checks (push) Has been cancelled
2026-05-06 05:49:37 +08:00
AWOOOI CD
a4fece11cc chore(cd): deploy c2c0b1e [skip ci] 2026-05-06 05:32:51 +08:00
Your Name
c2c0b1ec82 fix(alerts): let GCP Ollama finish before cloud fallback
All checks were successful
Code Review / ai-code-review (push) Successful in 10s
CD Pipeline / tests (push) Successful in 1m9s
CD Pipeline / build-and-deploy (push) Successful in 4m21s
CD Pipeline / post-deploy-checks (push) Successful in 1m16s
2026-05-06 05:27:55 +08:00
AWOOOI CD
1d0e80c091 chore(cd): deploy 3b64d66 [skip ci] 2026-05-06 03:38:45 +08:00
AWOOOI CD
eced8617d3 chore(cd): deploy a2c4b3d [skip ci] 2026-05-06 00:53:15 +08:00
AWOOOI CD
cb9551fb00 chore(cd): deploy 5ed396e [skip ci] 2026-05-06 00:24:17 +08:00
AWOOOI CD
87ce02f34d chore(cd): deploy 2aa31c2 [skip ci] 2026-05-06 00:10:42 +08:00
Your Name
2aa31c205a fix(ai): require 111 before alert cloud fallback
All checks were successful
CD Pipeline / tests (push) Successful in 54s
Code Review / ai-code-review (push) Successful in 10s
CD Pipeline / build-and-deploy (push) Successful in 3m21s
CD Pipeline / post-deploy-checks (push) Successful in 2m2s
2026-05-06 00:05:51 +08:00
AWOOOI CD
25b1923d2e chore(cd): deploy e208798 [skip ci] 2026-05-05 23:44:08 +08:00
AWOOOI CD
1ba36697ca chore(cd): deploy 405b8b8 [skip ci] 2026-05-05 23:34:17 +08:00
Your Name
405b8b8ef9 fix(ops): bring drift scanner under gitops
Some checks failed
CD Pipeline / tests (push) Successful in 59s
Code Review / ai-code-review (push) Successful in 11s
CD Pipeline / build-and-deploy (push) Successful in 8m52s
CD Pipeline / post-deploy-checks (push) Has been cancelled
2026-05-05 23:20:12 +08:00
Your Name
1cc215ec30 fix(ops): keep Ollama health checks on alert fast model
Some checks failed
CD Pipeline / tests (push) Successful in 52s
Code Review / ai-code-review (push) Successful in 9s
CD Pipeline / post-deploy-checks (push) Has been cancelled
CD Pipeline / build-and-deploy (push) Has been cancelled
2026-05-05 23:16:21 +08:00
AWOOOI CD
83daeb3f87 chore(cd): deploy c4854bb [skip ci] 2026-05-05 23:10:29 +08:00
AWOOOI CD
7baa316224 chore(cd): deploy e8f2792 [skip ci] 2026-05-05 22:48:02 +08:00
Your Name
bf847ad045 fix(ai): stabilize GCP Ollama alert lane
Some checks failed
Code Review / ai-code-review (push) Successful in 10s
CD Pipeline / build-and-deploy (push) Has been cancelled
CD Pipeline / post-deploy-checks (push) Has been cancelled
CD Pipeline / tests (push) Has been cancelled
2026-05-05 22:20:27 +08:00
Your Name
a4e9a04982 fix(ops): harden cold-start schedule recovery
Some checks failed
Code Review / ai-code-review (push) Successful in 10s
run-migration / migrate (push) Successful in 7s
CD Pipeline / build-and-deploy (push) Has been cancelled
CD Pipeline / post-deploy-checks (push) Has been cancelled
CD Pipeline / tests (push) Has been cancelled
2026-05-05 22:17:10 +08:00
AWOOOI CD
72a1d33f9d chore(cd): deploy bec8212 [skip ci] 2026-05-05 21:59:52 +08:00
Your Name
333c8a9cfd fix(cd): target k3s control plane for deploy
Some checks failed
CD Pipeline / tests (push) Failing after 1s
CD Pipeline / build-and-deploy (push) Has been skipped
CD Pipeline / post-deploy-checks (push) Has been skipped
Code Review / ai-code-review (push) Successful in 10s
2026-05-05 21:21:00 +08:00
Your Name
1baeb7ee61 chore(cd): deploy ee5e3bc [skip ci] 2026-05-05 21:09:09 +08:00
AWOOOI CD
7b0a4bce98 chore(cd): deploy 2221fd3 [skip ci] 2026-05-05 16:26:09 +08:00
AWOOOI CD
84a661beaf chore(cd): deploy 6b93c8f [skip ci] 2026-05-05 16:11:35 +08:00
AWOOOI CD
3a17a860a0 chore(cd): deploy 1cc9de5 [skip ci] 2026-05-05 15:41:33 +08:00
Your Name
209da7ba33 chore(ops): deploy docker limit alert image
Some checks failed
CD Pipeline / tests (push) Successful in 5m24s
CD Pipeline / post-deploy-checks (push) Has been cancelled
CD Pipeline / build-and-deploy (push) Has been cancelled
2026-05-05 15:05:23 +08:00
Your Name
df72c77880 chore(ops): deploy stale gitea job alert image
Some checks failed
CD Pipeline / tests (push) Successful in 5m29s
CD Pipeline / build-and-deploy (push) Has been cancelled
CD Pipeline / post-deploy-checks (push) Has been cancelled
2026-05-05 14:43:53 +08:00
Your Name
ab0f0a8a62 chore(ops): deploy runner classification image
Some checks failed
CD Pipeline / tests (push) Successful in 2m35s
CD Pipeline / build-and-deploy (push) Has been cancelled
CD Pipeline / post-deploy-checks (push) Has been cancelled
Code Review / ai-code-review (push) Successful in 26s
2026-05-05 14:29:55 +08:00
Your Name
a5192d4e03 chore(ops): deploy runner alert routing image
Some checks failed
CD Pipeline / build-and-deploy (push) Has been cancelled
CD Pipeline / post-deploy-checks (push) Has been cancelled
CD Pipeline / tests (push) Has been cancelled
Code Review / ai-code-review (push) Has been cancelled
2026-05-05 14:21:17 +08:00
Your Name
2b93975d37 chore(ops): deploy systemd runner baseline image
Some checks failed
CD Pipeline / tests (push) Successful in 2m6s
Code Review / ai-code-review (push) Successful in 26s
CD Pipeline / post-deploy-checks (push) Has been cancelled
CD Pipeline / build-and-deploy (push) Has been cancelled
2026-05-05 14:12:30 +08:00
Your Name
bb1995f349 fix(awooop): use naive utc for run lease timestamps
Some checks failed
CD Pipeline / tests (push) Failing after 1m48s
CD Pipeline / build-and-deploy (push) Has been skipped
CD Pipeline / post-deploy-checks (push) Has been skipped
Code Review / ai-code-review (push) Has been cancelled
2026-05-05 13:53:07 +08:00
Your Name
e8e6748f70 fix(ops): add docker host resource baseline guardrails
Some checks failed
CD Pipeline / tests (push) Failing after 1m50s
CD Pipeline / build-and-deploy (push) Has been skipped
CD Pipeline / post-deploy-checks (push) Has been skipped
Code Review / ai-code-review (push) Successful in 25s
Deploy Alert Rules / Deploy Prometheus Alert Rules (push) Successful in 38s
2026-05-05 13:45:09 +08:00
Your Name
0ebd0d8a92 fix(deploy): 緊急部署 API 2e17325c — governance skip cooldown + watchdog B4
All checks were successful
Code Review / ai-code-review (push) Successful in 54s
CI cancel-in-progress 導致 CD 未執行,手動更新 kustomization.yaml。

包含修復:
- governance_dispatcher skip 路徑 cooldown(消除 30s 重複處理)
- watchdog B4 A2/A3/W6 三層修復(消除 META SYSTEM 重複告警)
- Operator Console leWOOOgo 積木化修復(e22b8e7)

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
2026-05-05 12:09:29 +08:00
Your Name
aa4ccec429 fix(watchdog): ADR-092 B4 — 三層修復消除 META SYSTEM 重複告警 + Ollama 路由強化
All checks were successful
Code Review / ai-code-review (push) Successful in 7m16s
問題根因(debugger 全景徹查):
1. Prod 仍跑舊版代碼(ec013f66 後的修法未部署 → 告警字串仍含舊格式)
2. replicas=2 時 Pod 間 grace period 不共享 → violation_codes 分歧 → 不同 SHA256 → dedup 失效
3. 新 Pod 啟動立即執行 _check_once() → rollout 時多發一波
4. W6 violation_codes 含動態 low_count → count 微變繞過 dedup

修復(A2/A3/W6/C1/C2):
- A2:run_ai_slo_watchdog_loop 加 90s leading sleep,避免 rollout 立即觸發
- A3:_grace_active() 改為 Redis cluster-shared(watchdog:cluster_grace, ex=1800s, nx=True)
     消除 Pod 間 grace period 不一致;Redis 故障時 fallback 為 process-local monotonic
- W6:violation_codes 移除動態 low_count,改為穩定 "W6:trust_drift"
- C1:ollama_auto_recovery.py recovered_host 改動態 label(依 URL port 判斷 GCP-A/B/Local)
- C2:ConfigMap OLLAMA_FALLBACK_URL 改走 110:11437 nginx proxy,三層容災統一架構

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
2026-05-05 10:31:53 +08:00