新增市場情報 queue writer run receipt

This commit is contained in:
OoO
2026-05-19 12:04:28 +08:00
parent c55c74b999
commit 2d4a3a4bf9
10 changed files with 1297 additions and 190 deletions

View File

@@ -128,6 +128,7 @@
- V10.238 補業績圖表 runtime QA 與分析 tabs 窄版修正:新增 `quick_review --sales-charts` 檢查 `/daily_sales`、`/growth_analysis` 的 Chart.js ready、可繪製資料集與 canvas 非空白;同時把分析報表 tabs 手機版改為自適應 grid避免 Metabase/Grist 外部連結超出右側。
- Phase 60 candidate queue writer run package新增 `services/market_intel/candidate_queue_writer_run_package.py`、POST `/api/market_intel/manual_sample_review/candidate_queue_writer_run_package` 與 UI run package 按鈕,整理正式 CLI 小流量寫入前的 payload manifest、required artifacts、command bundle、operator signoff 與 rollback planAPI/UI 不產檔、不讀 approval token、不執行 CLI、不連 DB、不寫 queue、不 commit、不掛 scheduler版本同步至 V10.240。
- Phase 61 candidate queue writer run readiness新增 `services/market_intel/candidate_queue_writer_run_readiness.py`、POST `/api/market_intel/manual_sample_review/candidate_queue_writer_run_readiness` 與 UI readiness 按鈕,檢查 reviewed sample 檔案路徑、備份路徑、preflight 輸出、migration live smoke、shell-only token acknowledgement 與禁止 token 進 APIAPI/UI 不產檔、不讀 approval token、不執行 CLI、不連 DB、不寫 queue、不 commit、不掛 scheduler版本同步至 V10.245。
- Phase 62 candidate queue writer run receipt新增 `services/market_intel/candidate_queue_writer_run_receipt.py`、POST `/api/market_intel/manual_sample_review/candidate_queue_writer_run_receipt` 與 UI receipt 按鈕,審核 CLI 寫入後的 writer output、post-write smoke、dedupe key 一致性與 artifact 路徑API/UI 不回吐 receipt 原文、不讀 approval token、不執行 CLI、不連 DB、不寫 queue、不掛 scheduler版本同步至 V10.247。
- Schema smoke`tests/test_market_intel_skeleton.py` 檢查 `Base.metadata` 內含 ADR-035 八張 `market_*` tables。
- Desktop UI QA本機只註冊 `market_intel_bp` 的 Flask harness 載入 `/market_intel`,確認 Phase 15、候選預覽、writer preview、安全 flags、點陣暖紙視覺正常console error 0。
- API QA`/api/market_intel/schema_smoke` 通過 7 張表與 `market_platforms` 必要欄位檢查;`/api/market_intel/platform_seed_writer_plan` 回傳 4 筆 dry-run upsert preview`writes_executed=false`,四平台皆 `blocked_dry_run_only`。
@@ -138,7 +139,7 @@
- 補 UI preview panel 真 390px 截圖 QA本輪 in-app browser 不支援直接設定 viewport且 data URL iframe QA 被瀏覽器安全策略阻擋,不做繞過。
- 正式端 seed writer token-hardening drift優先白名單同步 main 的一次性環境 token 版本,避免 API 暴露固定 approval token hint。
- 正式推版前需實際執行 worktree scope review、`python backup_system.py`、commit/push 目標變更、讀 deployment SOP 與 ADR-011且只跑 `/health` 與市場情報頁 smoke。
- 下一步才可在明確批准且具備真實 reviewed sample JSON 後做正式 DB 的 queue writer CLI 小流量 operator run先用 run readiness、run package、operator drillpost-write smoke 做順序與只讀驗證,預設 API/UI 不得寫 DB也不得執行 migration。
- 下一步才可在明確批准且具備真實 reviewed sample JSON 後做正式 DB 的 queue writer CLI 小流量 operator run先用 run readiness、run package、operator drillpost-write smoke 與 run receipt 做順序與只讀驗證,預設 API/UI 不得寫 DB也不得執行 migration。
- 市場情報 UI 後續頁面必須沿用 V2 暖紙、暖墨、等寬數字與點陣風格,禁止複製巨型分析頁 template 模式。
================================================================================

View File

@@ -320,7 +320,7 @@ YOUTUBE_API_KEY = os.getenv('YOUTUBE_API_KEY', '')
# ==========================================
# 系統版本與路徑
# ==========================================
SYSTEM_VERSION = "V10.246"
SYSTEM_VERSION = "V10.247"
LOG_FILE_PATH = os.path.join(BASE_DIR, 'logs/system.log')
public_url = PUBLIC_URL # 用於模板顯示

View File

@@ -187,6 +187,7 @@ EwoooC 目前已有 MOMO EDM / 節慶活動資料、`promo_products`、PChome
- 2026-05-19 追加 candidate queue writer operator drill`services.market_intel.candidate_queue_writer_operator_drill``/api/market_intel/manual_sample_review/candidate_queue_writer_operator_drill` 組裝 reviewed sample、備份、read-only preflight、CLI writer、post-write smoke 的操作員順序與 gate。此 drill 只輸出可稽核操作計畫API/UI 不讀 approval token、不執行 CLI、不連 DB、不寫 queue、不 commit、不掛 scheduler。
- 2026-05-19 追加 candidate queue writer run package`services.market_intel.candidate_queue_writer_run_package``/api/market_intel/manual_sample_review/candidate_queue_writer_run_package` 整理正式 CLI 小流量寫入前的 payload manifest、required artifacts、command bundle、operator signoff 與 rollback plan。此 package 只輸出可稽核證據包預覽API/UI 不產檔、不讀 approval token、不執行 CLI、不連 DB、不寫 queue、不 commit、不掛 scheduler。
- 2026-05-19 追加 candidate queue writer run readiness`services.market_intel.candidate_queue_writer_run_readiness``/api/market_intel/manual_sample_review/candidate_queue_writer_run_readiness` 檢查正式 CLI 小流量寫入前的 reviewed sample 路徑、備份路徑、preflight 輸出、migration live smoke、shell-only token acknowledgement 與禁止 token 進 API。此 readiness 只輸出操作員證據缺口API/UI 不產檔、不讀 approval token、不執行 CLI、不連 DB、不寫 queue、不 commit、不掛 scheduler。
- 2026-05-19 追加 candidate queue writer run receipt`services.market_intel.candidate_queue_writer_run_receipt``/api/market_intel/manual_sample_review/candidate_queue_writer_run_receipt` 審核 CLI 小流量寫入後的 writer output、post-write smoke、dedupe key 一致性、artifact 路徑與 token 外洩風險。此 receipt 只輸出安全摘要API/UI 不回吐 receipt 原文、不讀 approval token、不執行 CLI、不連 DB、不寫 queue、不 commit、不掛 scheduler。
### Phase 4Coupang / Shopee Adapter

View File

@@ -19,7 +19,7 @@
| `edm_routes.py` | EDM 與節慶儀表板 | `/edm`, `/festival` |
| `monthly_routes.py` | 月結分析 | `/monthly_summary_analysis`, `/api/monthly_summary_data` |
| `daily_sales_routes.py` | 當日業績 | `/daily_sales`, `/daily_sales/export*` |
| `market_intel_routes.py` | 市場情報 Phase 61 candidate queue writer run readiness | `/market_intel`, `/market_intel/*`, `/api/market_intel/status`, `/api/market_intel/schema`, `/api/market_intel/schema_smoke`, `/api/market_intel/schema_db_probe`, `/api/market_intel/platform_seed_db_diff`, `/api/market_intel/legacy_source_bridge`, `/api/market_intel/mcp_readiness`, `/api/market_intel/mcp_tool_contract`, `/api/market_intel/mcp_deploy_preflight`, `/api/market_intel/mcp_activation_runbook`, `/api/market_intel/mcp_fetch_gate`, `/api/market_intel/scheduler_plan`, `/api/market_intel/manual_sample_plan`, `/api/market_intel/manual_sample_acceptance`, `/api/market_intel/manual_sample_review`, `/api/market_intel/manual_sample_review/evaluate`, `/api/market_intel/manual_sample_review/candidate_handoff`, `/api/market_intel/manual_sample_review/candidate_queue_draft`, `/api/market_intel/manual_sample_review/candidate_queue_approval`, `/api/market_intel/manual_sample_review/candidate_queue_transaction`, `/api/market_intel/manual_sample_review/candidate_queue_writer_status`, `/api/market_intel/manual_sample_review/candidate_queue_writer_preflight`, `/api/market_intel/manual_sample_review/candidate_queue_writer_postwrite_smoke`, `/api/market_intel/manual_sample_review/candidate_queue_writer_operator_drill`, `/api/market_intel/manual_sample_review/candidate_queue_writer_run_package`, `/api/market_intel/manual_sample_review/candidate_queue_writer_run_readiness`, `/api/market_intel/match_review_plan`, `/api/market_intel/opportunity_plan`, `/api/market_intel/opportunity_scoring_plan`, `/api/market_intel/opportunity_evidence_plan`, `/api/market_intel/opportunity_alert_plan`, `/api/market_intel/adapters`, `/api/market_intel/dry_run_plan`, `/api/market_intel/discovery_plan`, `/api/market_intel/manual_discovery`, `/api/market_intel/candidate_preview`, `/api/market_intel/platform_seed_plan`, `/api/market_intel/platform_seed_write_guard`, `/api/market_intel/platform_seed_writer_plan`, `/api/market_intel/migration_blueprint`, `/api/market_intel/migration_apply_drill`, `/api/market_intel/migration_catalog_review`, `/api/market_intel/migration_live_smoke`, `/api/market_intel/live_db_inventory`, `/api/market_intel/seed_writer_cli_status`, `/api/market_intel/write_approval_runbook`, `/api/market_intel/deployment_readiness` |
| `market_intel_routes.py` | 市場情報 Phase 62 candidate queue writer run receipt | `/market_intel`, `/market_intel/*`, `/api/market_intel/status`, `/api/market_intel/schema`, `/api/market_intel/schema_smoke`, `/api/market_intel/schema_db_probe`, `/api/market_intel/platform_seed_db_diff`, `/api/market_intel/legacy_source_bridge`, `/api/market_intel/mcp_readiness`, `/api/market_intel/mcp_tool_contract`, `/api/market_intel/mcp_deploy_preflight`, `/api/market_intel/mcp_activation_runbook`, `/api/market_intel/mcp_fetch_gate`, `/api/market_intel/scheduler_plan`, `/api/market_intel/manual_sample_plan`, `/api/market_intel/manual_sample_acceptance`, `/api/market_intel/manual_sample_review`, `/api/market_intel/manual_sample_review/evaluate`, `/api/market_intel/manual_sample_review/candidate_handoff`, `/api/market_intel/manual_sample_review/candidate_queue_draft`, `/api/market_intel/manual_sample_review/candidate_queue_approval`, `/api/market_intel/manual_sample_review/candidate_queue_transaction`, `/api/market_intel/manual_sample_review/candidate_queue_writer_status`, `/api/market_intel/manual_sample_review/candidate_queue_writer_preflight`, `/api/market_intel/manual_sample_review/candidate_queue_writer_postwrite_smoke`, `/api/market_intel/manual_sample_review/candidate_queue_writer_operator_drill`, `/api/market_intel/manual_sample_review/candidate_queue_writer_run_package`, `/api/market_intel/manual_sample_review/candidate_queue_writer_run_readiness`, `/api/market_intel/manual_sample_review/candidate_queue_writer_run_receipt`, `/api/market_intel/match_review_plan`, `/api/market_intel/opportunity_plan`, `/api/market_intel/opportunity_scoring_plan`, `/api/market_intel/opportunity_evidence_plan`, `/api/market_intel/opportunity_alert_plan`, `/api/market_intel/adapters`, `/api/market_intel/dry_run_plan`, `/api/market_intel/discovery_plan`, `/api/market_intel/manual_discovery`, `/api/market_intel/candidate_preview`, `/api/market_intel/platform_seed_plan`, `/api/market_intel/platform_seed_write_guard`, `/api/market_intel/platform_seed_writer_plan`, `/api/market_intel/migration_blueprint`, `/api/market_intel/migration_apply_drill`, `/api/market_intel/migration_catalog_review`, `/api/market_intel/migration_live_smoke`, `/api/market_intel/live_db_inventory`, `/api/market_intel/seed_writer_cli_status`, `/api/market_intel/write_approval_runbook`, `/api/market_intel/deployment_readiness` |
| `api_routes.py` | 通用任務與查詢 API | `/api/run_task`, `/api/history/*` |
| `export_routes.py` | 匯出功能 | `/api/export/*` |
| `import_routes.py` | 匯入功能 | `/api/import_excel`, `/api/import/monthly_summary` |

View File

@@ -27,6 +27,9 @@ from services.market_intel.candidate_queue_writer_run_package import (
from services.market_intel.candidate_queue_writer_run_readiness import (
build_candidate_queue_writer_run_readiness,
)
from services.market_intel.candidate_queue_writer_run_receipt import (
build_candidate_queue_writer_run_receipt,
)
TAIPEI_TZ = timezone(timedelta(hours=8))
@@ -412,123 +415,14 @@ def market_intel_manual_sample_candidate_queue_writer_postwrite_smoke():
return jsonify(data), status_code
@market_intel_bp.route(
"/api/market_intel/manual_sample_review/candidate_queue_writer_operator_drill",
methods=["POST"],
)
@login_required
def market_intel_manual_sample_candidate_queue_writer_operator_drill():
payload = request.get_json(silent=True)
limit = request.args.get("limit", default=20, type=int)
service = _service()
payload_error = None
if not isinstance(payload, dict):
sample_result = None
payload_error = "invalid_json_object"
else:
sample_result = payload.get("sample_result", payload)
transaction_preview = service.build_manual_sample_candidate_queue_transaction(
sample_result=sample_result,
payload_error=payload_error,
limit=limit,
)
writer_preflight = build_candidate_queue_writer_preflight(
transaction_preview=transaction_preview,
execute_requested=False,
)
writer_status = build_candidate_queue_writer_cli_plan(
transaction_preview=transaction_preview,
writer_preflight=writer_preflight,
approval_token=None,
approval_token_secret=None,
)
postwrite_smoke = build_candidate_queue_writer_postwrite_smoke(
transaction_preview=transaction_preview,
execute_requested=False,
)
data = build_candidate_queue_writer_operator_drill(
transaction_preview=transaction_preview,
writer_preflight=writer_preflight,
writer_status=writer_status,
postwrite_smoke=postwrite_smoke,
)
data["phase"] = service.phase
status_code = 400 if payload_error else 200
return jsonify(data), status_code
@market_intel_bp.route(
"/api/market_intel/manual_sample_review/candidate_queue_writer_run_package",
methods=["POST"],
)
@login_required
def market_intel_manual_sample_candidate_queue_writer_run_package():
payload = request.get_json(silent=True)
limit = request.args.get("limit", default=20, type=int)
service = _service()
payload_error = None
if not isinstance(payload, dict):
sample_result = None
payload_error = "invalid_json_object"
else:
sample_result = payload.get("sample_result", payload)
transaction_preview = service.build_manual_sample_candidate_queue_transaction(
sample_result=sample_result,
payload_error=payload_error,
limit=limit,
)
writer_preflight = build_candidate_queue_writer_preflight(
transaction_preview=transaction_preview,
execute_requested=False,
)
writer_status = build_candidate_queue_writer_cli_plan(
transaction_preview=transaction_preview,
writer_preflight=writer_preflight,
approval_token=None,
approval_token_secret=None,
)
postwrite_smoke = build_candidate_queue_writer_postwrite_smoke(
transaction_preview=transaction_preview,
execute_requested=False,
)
operator_drill = build_candidate_queue_writer_operator_drill(
transaction_preview=transaction_preview,
writer_preflight=writer_preflight,
writer_status=writer_status,
postwrite_smoke=postwrite_smoke,
)
data = build_candidate_queue_writer_run_package(
transaction_preview=transaction_preview,
writer_preflight=writer_preflight,
writer_status=writer_status,
postwrite_smoke=postwrite_smoke,
operator_drill=operator_drill,
)
data["phase"] = service.phase
status_code = 400 if payload_error else 200
return jsonify(data), status_code
@market_intel_bp.route(
"/api/market_intel/manual_sample_review/candidate_queue_writer_run_readiness",
methods=["POST"],
)
@login_required
def market_intel_manual_sample_candidate_queue_writer_run_readiness():
payload = request.get_json(silent=True)
limit = request.args.get("limit", default=20, type=int)
service = _service()
payload_error = None
operator_evidence = {}
if not isinstance(payload, dict):
sample_result = None
payload_error = "invalid_json_object"
else:
sample_result = payload.get("sample_result", payload)
operator_evidence = payload.get("operator_evidence", {})
def _build_candidate_queue_writer_stack(
*,
service,
sample_result,
payload_error,
limit,
operator_evidence=None,
):
transaction_preview = service.build_manual_sample_candidate_queue_transaction(
sample_result=sample_result,
payload_error=payload_error,
@@ -561,13 +455,147 @@ def market_intel_manual_sample_candidate_queue_writer_run_readiness():
postwrite_smoke=postwrite_smoke,
operator_drill=operator_drill,
)
data = build_candidate_queue_writer_run_readiness(
run_readiness = build_candidate_queue_writer_run_readiness(
transaction_preview=transaction_preview,
writer_preflight=writer_preflight,
writer_status=writer_status,
postwrite_smoke=postwrite_smoke,
operator_drill=operator_drill,
run_package=run_package,
operator_evidence=operator_evidence or {},
)
return {
"transaction_preview": transaction_preview,
"writer_preflight": writer_preflight,
"writer_status": writer_status,
"postwrite_smoke": postwrite_smoke,
"operator_drill": operator_drill,
"run_package": run_package,
"run_readiness": run_readiness,
}
@market_intel_bp.route(
"/api/market_intel/manual_sample_review/candidate_queue_writer_operator_drill",
methods=["POST"],
)
@login_required
def market_intel_manual_sample_candidate_queue_writer_operator_drill():
payload = request.get_json(silent=True)
limit = request.args.get("limit", default=20, type=int)
service = _service()
payload_error = None
if not isinstance(payload, dict):
sample_result = None
payload_error = "invalid_json_object"
else:
sample_result = payload.get("sample_result", payload)
stack = _build_candidate_queue_writer_stack(
service=service,
sample_result=sample_result,
payload_error=payload_error,
limit=limit,
)
data = stack["operator_drill"]
data["phase"] = service.phase
status_code = 400 if payload_error else 200
return jsonify(data), status_code
@market_intel_bp.route(
"/api/market_intel/manual_sample_review/candidate_queue_writer_run_package",
methods=["POST"],
)
@login_required
def market_intel_manual_sample_candidate_queue_writer_run_package():
payload = request.get_json(silent=True)
limit = request.args.get("limit", default=20, type=int)
service = _service()
payload_error = None
if not isinstance(payload, dict):
sample_result = None
payload_error = "invalid_json_object"
else:
sample_result = payload.get("sample_result", payload)
stack = _build_candidate_queue_writer_stack(
service=service,
sample_result=sample_result,
payload_error=payload_error,
limit=limit,
)
data = stack["run_package"]
data["phase"] = service.phase
status_code = 400 if payload_error else 200
return jsonify(data), status_code
@market_intel_bp.route(
"/api/market_intel/manual_sample_review/candidate_queue_writer_run_readiness",
methods=["POST"],
)
@login_required
def market_intel_manual_sample_candidate_queue_writer_run_readiness():
payload = request.get_json(silent=True)
limit = request.args.get("limit", default=20, type=int)
service = _service()
payload_error = None
operator_evidence = {}
if not isinstance(payload, dict):
sample_result = None
payload_error = "invalid_json_object"
else:
sample_result = payload.get("sample_result", payload)
operator_evidence = payload.get("operator_evidence", {})
stack = _build_candidate_queue_writer_stack(
service=service,
sample_result=sample_result,
payload_error=payload_error,
limit=limit,
operator_evidence=operator_evidence,
)
data = stack["run_readiness"]
data["phase"] = service.phase
status_code = 400 if payload_error else 200
return jsonify(data), status_code
@market_intel_bp.route(
"/api/market_intel/manual_sample_review/candidate_queue_writer_run_receipt",
methods=["POST"],
)
@login_required
def market_intel_manual_sample_candidate_queue_writer_run_receipt():
payload = request.get_json(silent=True)
limit = request.args.get("limit", default=20, type=int)
service = _service()
payload_error = None
operator_evidence = {}
writer_output = {}
postwrite_smoke_result = {}
if not isinstance(payload, dict):
sample_result = None
payload_error = "invalid_json_object"
else:
sample_result = payload.get("sample_result", payload)
operator_evidence = payload.get("operator_evidence", {})
writer_output = payload.get("writer_output", {})
postwrite_smoke_result = payload.get("postwrite_smoke_result", {})
stack = _build_candidate_queue_writer_stack(
service=service,
sample_result=sample_result,
payload_error=payload_error,
limit=limit,
operator_evidence=operator_evidence,
)
data = build_candidate_queue_writer_run_receipt(
transaction_preview=stack["transaction_preview"],
run_readiness=stack["run_readiness"],
writer_output=writer_output,
postwrite_smoke_result=postwrite_smoke_result,
operator_evidence=operator_evidence,
)
data["phase"] = service.phase

View File

@@ -0,0 +1,378 @@
"""候選審核 queue writer operator run receipt review preview。
本模組只審核 CLI 小流量寫入後由操作員貼回的 writer output 與
post-write smoke 結果;不讀 approval token、不執行 CLI、不開 DB
connection、不寫 queue、不 commit、不掛 scheduler。
"""
FORBIDDEN_TOKEN_KEYWORDS = (
"approval_token",
"approval-token",
"market_intel_queue_write_approval",
)
SAFE_TOKEN_METADATA_KEYS = {
"approval_token_present",
"approval_token_valid",
"approval_token_secret_configured",
}
SAFE_APPROVAL_ENV_VAR = "MARKET_INTEL_QUEUE_WRITE_APPROVAL"
def _as_dict(value):
return value if isinstance(value, dict) else {}
def _as_list(value):
if value is None:
return []
if isinstance(value, (list, tuple, set)):
return list(value)
return [value]
def _safe_int(value):
try:
return int(value or 0)
except (TypeError, ValueError):
return 0
def _has_text(value):
return bool(isinstance(value, str) and value.strip())
def _contains_forbidden_token_key(value):
if isinstance(value, dict):
for key, nested in value.items():
normalized_key = str(key).lower()
if normalized_key in SAFE_TOKEN_METADATA_KEYS and isinstance(nested, bool):
continue
if normalized_key == "approval_env_var" and nested == SAFE_APPROVAL_ENV_VAR:
continue
if any(token_key in normalized_key for token_key in FORBIDDEN_TOKEN_KEYWORDS):
return True
if _contains_forbidden_token_key(nested):
return True
elif isinstance(value, list):
return any(_contains_forbidden_token_key(item) for item in value)
return False
def _dedupe_keys_from_transaction(transaction_preview):
transaction_preview = _as_dict(transaction_preview)
keys = []
for statement in transaction_preview.get("statements") or []:
lookup = _as_dict(statement.get("lookup"))
parameter_preview = _as_dict(statement.get("parameter_preview"))
dedupe_key = lookup.get("dedupe_key") or parameter_preview.get("dedupe_key")
if dedupe_key:
keys.append(str(dedupe_key))
return sorted(set(keys))
def _keys_from_writer_output(writer_output):
execution_result = _as_dict(writer_output.get("execution_result"))
affected = (
writer_output.get("affected_dedupe_keys")
or execution_result.get("affected_dedupe_keys")
or []
)
skipped = (
writer_output.get("skipped_dedupe_keys")
or execution_result.get("skipped_dedupe_keys")
or []
)
return {
"affected": sorted(set(str(key) for key in _as_list(affected) if key)),
"skipped": sorted(set(str(key) for key in _as_list(skipped) if key)),
}
def _keys_match_expected(expected_keys, observed_keys):
if not expected_keys:
return False
return set(expected_keys).issubset(set(observed_keys))
def _operator_evidence_summary(operator_evidence):
return {
"provided_keys": sorted(operator_evidence.keys()),
"writer_output_json_path_recorded": _has_text(
operator_evidence.get("writer_output_json_path")
),
"postwrite_smoke_json_path_recorded": _has_text(
operator_evidence.get("postwrite_smoke_json_path")
),
"operator_confirmed_no_token_in_artifacts": bool(
operator_evidence.get("operator_confirmed_no_token_in_artifacts")
),
"receipt_notes_recorded": _has_text(operator_evidence.get("receipt_notes")),
"approval_token_submitted_to_api": _contains_forbidden_token_key(
operator_evidence
),
}
def _writer_summary(writer_output, expected_keys):
writer_output = _as_dict(writer_output)
writer_keys = _keys_from_writer_output(writer_output)
observed_keys = sorted(set(writer_keys["affected"] + writer_keys["skipped"]))
return {
"provided": bool(writer_output),
"mode": writer_output.get("mode"),
"exit_code": writer_output.get("exit_code"),
"writes_executed": bool(writer_output.get("writes_executed")),
"would_write_database": bool(writer_output.get("would_write_database")),
"database_connection_opened": bool(
writer_output.get("database_connection_opened")
),
"explicit_transaction_opened": bool(
writer_output.get("explicit_transaction_opened")
),
"database_write_executed": bool(writer_output.get("database_write_executed")),
"database_commit_executed": bool(writer_output.get("database_commit_executed")),
"database_rollback_executed": bool(
writer_output.get("database_rollback_executed")
),
"external_network_executed": bool(writer_output.get("external_network_executed")),
"scheduler_attached": bool(writer_output.get("scheduler_attached")),
"inserted_count": _safe_int(writer_output.get("inserted_count")),
"skipped_count": _safe_int(writer_output.get("skipped_count")),
"affected_dedupe_keys": writer_keys["affected"],
"skipped_dedupe_keys": writer_keys["skipped"],
"observed_dedupe_keys": observed_keys,
"dedupe_keys_match_expected": _keys_match_expected(expected_keys, observed_keys),
"approval_token_key_detected": _contains_forbidden_token_key(writer_output),
}
def _smoke_summary(postwrite_smoke_result, expected_keys):
postwrite_smoke_result = _as_dict(postwrite_smoke_result)
found_keys = sorted(
set(
str(key)
for key in _as_list(postwrite_smoke_result.get("found_dedupe_keys"))
if key
)
)
missing_keys = sorted(
set(
str(key)
for key in _as_list(postwrite_smoke_result.get("missing_dedupe_keys"))
if key
)
)
return {
"provided": bool(postwrite_smoke_result),
"mode": postwrite_smoke_result.get("mode"),
"postwrite_smoke_passed": bool(
postwrite_smoke_result.get("postwrite_smoke_passed")
),
"ready_for_operator_review": bool(
postwrite_smoke_result.get("ready_for_operator_review")
),
"read_only_query_executed": bool(
postwrite_smoke_result.get("read_only_query_executed")
),
"database_connection_opened": bool(
postwrite_smoke_result.get("database_connection_opened")
),
"database_write_executed": bool(
postwrite_smoke_result.get("database_write_executed")
),
"database_commit_executed": bool(
postwrite_smoke_result.get("database_commit_executed")
),
"external_network_executed": bool(
postwrite_smoke_result.get("external_network_executed")
),
"scheduler_attached": bool(postwrite_smoke_result.get("scheduler_attached")),
"expected_dedupe_key_count": _safe_int(
postwrite_smoke_result.get("expected_dedupe_key_count")
),
"found_count": _safe_int(postwrite_smoke_result.get("found_count")),
"missing_count": _safe_int(postwrite_smoke_result.get("missing_count")),
"found_dedupe_keys": found_keys,
"missing_dedupe_keys": missing_keys,
"dedupe_keys_match_expected": _keys_match_expected(expected_keys, found_keys)
and not missing_keys,
"approval_token_key_detected": _contains_forbidden_token_key(
postwrite_smoke_result
),
}
def _receipt_gates(
*,
expected_keys,
run_readiness,
writer_summary,
smoke_summary,
evidence_summary,
):
return [
{
"key": "run_readiness_passed_before_cli",
"label": "CLI 寫入前 run readiness 必須已通過",
"passed": bool(run_readiness.get("ready_for_cli_operator_run")),
},
{
"key": "expected_dedupe_keys_present",
"label": "transaction preview 必須有 dedupe key",
"passed": bool(expected_keys),
},
{
"key": "writer_output_provided",
"label": "操作員需貼回 CLI writer output",
"passed": writer_summary["provided"],
},
{
"key": "writer_output_executed_and_committed",
"label": "writer output 必須顯示 CLI 已寫入並 commit",
"passed": bool(
writer_summary["mode"] == "candidate_queue_writer_cli_executed"
and writer_summary["writes_executed"]
and writer_summary["database_write_executed"]
and writer_summary["database_commit_executed"]
),
},
{
"key": "writer_output_dedupe_keys_match_expected",
"label": "writer output 的 affected/skipped dedupe key 必須符合 transaction preview",
"passed": writer_summary["dedupe_keys_match_expected"],
},
{
"key": "writer_output_safe_runtime_boundaries",
"label": "writer output 不得顯示 scheduler、外部網路或 rollback error",
"passed": bool(
not writer_summary["scheduler_attached"]
and not writer_summary["external_network_executed"]
and not writer_summary["database_rollback_executed"]
),
},
{
"key": "writer_output_no_approval_token_key",
"label": "writer output 不得包含 approval token key",
"passed": not writer_summary["approval_token_key_detected"],
},
{
"key": "postwrite_smoke_result_provided",
"label": "操作員需貼回 post-write smoke 結果",
"passed": smoke_summary["provided"],
},
{
"key": "postwrite_smoke_read_only_passed",
"label": "post-write smoke 必須是只讀查詢且通過",
"passed": bool(
smoke_summary["mode"] == "candidate_queue_writer_postwrite_smoke_read_only"
and smoke_summary["read_only_query_executed"]
and smoke_summary["postwrite_smoke_passed"]
),
},
{
"key": "postwrite_smoke_no_database_write",
"label": "post-write smoke 不得寫 DB 或 commit",
"passed": bool(
not smoke_summary["database_write_executed"]
and not smoke_summary["database_commit_executed"]
),
},
{
"key": "postwrite_smoke_dedupe_keys_match_expected",
"label": "post-write smoke 找到的 queue row 必須符合 transaction preview",
"passed": smoke_summary["dedupe_keys_match_expected"],
},
{
"key": "postwrite_smoke_no_approval_token_key",
"label": "post-write smoke 結果不得包含 approval token key",
"passed": not smoke_summary["approval_token_key_detected"],
},
{
"key": "receipt_artifact_paths_recorded",
"label": "操作員需記錄 writer output 與 post-write smoke artifact 路徑",
"passed": bool(
evidence_summary["writer_output_json_path_recorded"]
and evidence_summary["postwrite_smoke_json_path_recorded"]
),
},
{
"key": "operator_confirmed_no_token_in_artifacts",
"label": "操作員確認 artifact 不含一次性 token",
"passed": bool(
evidence_summary["operator_confirmed_no_token_in_artifacts"]
and not evidence_summary["approval_token_submitted_to_api"]
),
},
]
def build_candidate_queue_writer_run_receipt(
*,
transaction_preview,
run_readiness,
writer_output=None,
postwrite_smoke_result=None,
operator_evidence=None,
):
"""建立 CLI 寫入後 receipt review不執行任何副作用。"""
expected_keys = _dedupe_keys_from_transaction(transaction_preview)
operator_evidence = _as_dict(operator_evidence)
evidence_summary = _operator_evidence_summary(operator_evidence)
writer_summary = _writer_summary(writer_output, expected_keys)
smoke_summary = _smoke_summary(postwrite_smoke_result, expected_keys)
gates = _receipt_gates(
expected_keys=expected_keys,
run_readiness=_as_dict(run_readiness),
writer_summary=writer_summary,
smoke_summary=smoke_summary,
evidence_summary=evidence_summary,
)
blocked_reasons = [gate["key"] for gate in gates if not gate["passed"]]
receipt_passed = bool(not blocked_reasons)
return {
"mode": "candidate_queue_writer_run_receipt_preview",
"target_table": "market_alert_review_queue",
"receipt_reviewed": True,
"receipt_passed": receipt_passed,
"ready_for_next_manual_review": receipt_passed,
"ready_for_api_database_write": False,
"ready_for_scheduler_attach": False,
"api_executes_cli": False,
"api_reads_approval_token": False,
"api_writes_file": False,
"api_writes_database": False,
"database_connection_opened": False,
"database_session_created": False,
"explicit_transaction_opened": False,
"database_write_executed": False,
"database_commit_executed": False,
"database_rollback_executed": False,
"external_network_executed": False,
"scheduler_attached": False,
"writes_executed": False,
"would_write_database": False,
"expected_dedupe_keys": expected_keys,
"blocked_reasons": blocked_reasons,
"gates": gates,
"operator_evidence_summary": evidence_summary,
"writer_output_summary": writer_summary,
"postwrite_smoke_summary": smoke_summary,
"next_operator_steps": [
"保存 writer output 與 post-write smoke artifact",
"人工確認 queue row review_state 是否進入 needs_review",
"只在確認 receipt 通過後才進入下一個人工審核與 dashboard read-only inventory",
"不得從 UI/API 補寫、重跑 CLI 或自動掛 scheduler",
],
"safe_boundaries": [
"do_not_execute_cli_from_receipt_preview",
"do_not_read_approval_token_from_api",
"do_not_echo_operator_receipt_payload",
"do_not_open_database_connection_from_receipt_preview",
"do_not_write_queue_from_receipt_preview",
"do_not_attach_scheduler_from_receipt_preview",
"no_remove_orphans",
"no_momo_db_lifecycle_change",
],
}

View File

@@ -3,24 +3,13 @@
本模組只組裝 preview payload不執行 git、部署、SSH、migration 或 DB write。
"""
from services.market_intel.candidate_queue_writer_cli import (
build_candidate_queue_writer_cli_plan,
)
from services.market_intel.candidate_queue_writer_preflight import (
build_candidate_queue_writer_preflight,
)
from services.market_intel.candidate_queue_writer_postwrite_smoke import (
build_candidate_queue_writer_postwrite_smoke,
)
from services.market_intel.candidate_queue_writer_operator_drill import (
build_candidate_queue_writer_operator_drill,
)
from services.market_intel.candidate_queue_writer_run_package import (
build_candidate_queue_writer_run_package,
)
from services.market_intel.candidate_queue_writer_run_readiness import (
build_candidate_queue_writer_run_readiness,
)
from services.market_intel.candidate_queue_writer_cli import build_candidate_queue_writer_cli_plan
from services.market_intel.candidate_queue_writer_preflight import build_candidate_queue_writer_preflight
from services.market_intel.candidate_queue_writer_postwrite_smoke import build_candidate_queue_writer_postwrite_smoke
from services.market_intel.candidate_queue_writer_operator_drill import build_candidate_queue_writer_operator_drill
from services.market_intel.candidate_queue_writer_run_package import build_candidate_queue_writer_run_package
from services.market_intel.candidate_queue_writer_run_readiness import build_candidate_queue_writer_run_readiness
from services.market_intel.candidate_queue_writer_run_receipt import build_candidate_queue_writer_run_receipt
def build_deployment_readiness_preview(
@@ -92,6 +81,10 @@ def build_deployment_readiness_preview(
operator_drill=candidate_queue_writer_operator_drill,
run_package=candidate_queue_writer_run_package,
)
candidate_queue_writer_run_receipt = build_candidate_queue_writer_run_receipt(
transaction_preview=manual_sample_candidate_queue_transaction,
run_readiness=candidate_queue_writer_run_readiness,
)
match_review_plan = service.build_match_review_plan()
opportunity_plan = service.build_opportunity_plan()
opportunity_scoring_plan = service.build_opportunity_scoring_plan()
@@ -311,6 +304,19 @@ def build_deployment_readiness_preview(
and not candidate_queue_writer_run_readiness["database_commit_executed"]
and not candidate_queue_writer_run_readiness["scheduler_attached"]
),
"candidate_queue_writer_run_receipt_preview_safe": bool(
candidate_queue_writer_run_receipt["mode"]
== "candidate_queue_writer_run_receipt_preview"
and not candidate_queue_writer_run_receipt["ready_for_api_database_write"]
and not candidate_queue_writer_run_receipt["ready_for_scheduler_attach"]
and not candidate_queue_writer_run_receipt["api_executes_cli"]
and not candidate_queue_writer_run_receipt["api_reads_approval_token"]
and not candidate_queue_writer_run_receipt["api_writes_file"]
and not candidate_queue_writer_run_receipt["database_connection_opened"]
and not candidate_queue_writer_run_receipt["database_write_executed"]
and not candidate_queue_writer_run_receipt["database_commit_executed"]
and not candidate_queue_writer_run_receipt["scheduler_attached"]
),
"match_review_plan_preview_safe": bool(
match_review_plan["mode"] == "match_review_plan_preview"
and not match_review_plan["review_queue_created"]
@@ -529,6 +535,7 @@ def build_deployment_readiness_preview(
"/api/market_intel/manual_sample_review/candidate_queue_writer_operator_drill",
"/api/market_intel/manual_sample_review/candidate_queue_writer_run_package",
"/api/market_intel/manual_sample_review/candidate_queue_writer_run_readiness",
"/api/market_intel/manual_sample_review/candidate_queue_writer_run_receipt",
],
"status": status.to_dict(),
"schema_smoke": schema_smoke,
@@ -575,6 +582,7 @@ def build_deployment_readiness_preview(
),
"candidate_queue_writer_run_package": candidate_queue_writer_run_package,
"candidate_queue_writer_run_readiness": candidate_queue_writer_run_readiness,
"candidate_queue_writer_run_receipt": candidate_queue_writer_run_receipt,
"match_review_plan": match_review_plan,
"opportunity_plan": opportunity_plan,
"opportunity_scoring_plan": opportunity_scoring_plan,

View File

@@ -108,7 +108,7 @@ class MarketIntelRuntimeStatus:
class MarketIntelService:
"""市場情報入口服務,先集中 feature gate 與安全狀態。"""
phase = "phase_61_candidate_queue_writer_run_readiness"
phase = "phase_62_candidate_queue_writer_run_receipt"
def get_runtime_status(self) -> MarketIntelRuntimeStatus:
return MarketIntelRuntimeStatus(

View File

@@ -606,6 +606,9 @@
<button class="market-intel-icon-button" type="button" title="檢查 queue writer run readiness" data-market-intel-sample-candidate-queue-run-readiness>
<i class="fas fa-clipboard-check" aria-hidden="true"></i>
</button>
<button class="market-intel-icon-button" type="button" title="審核 queue writer run receipt" data-market-intel-sample-candidate-queue-run-receipt>
<i class="fas fa-receipt" aria-hidden="true"></i>
</button>
</div>
</div>
@@ -940,6 +943,7 @@
const sampleCandidateQueueOperatorDrill = sampleReviewRoot ? sampleReviewRoot.querySelector('[data-market-intel-sample-candidate-queue-operator-drill]') : null;
const sampleCandidateQueueRunPackage = sampleReviewRoot ? sampleReviewRoot.querySelector('[data-market-intel-sample-candidate-queue-run-package]') : null;
const sampleCandidateQueueRunReadiness = sampleReviewRoot ? sampleReviewRoot.querySelector('[data-market-intel-sample-candidate-queue-run-readiness]') : null;
const sampleCandidateQueueRunReceipt = sampleReviewRoot ? sampleReviewRoot.querySelector('[data-market-intel-sample-candidate-queue-run-receipt]') : null;
const sampleReviewEndpoint = "{{ url_for('market_intel.market_intel_manual_sample_review') }}";
const sampleReviewEvaluateEndpoint = "{{ url_for('market_intel.market_intel_manual_sample_review_evaluate') }}";
const sampleCandidateHandoffEndpoint = "{{ url_for('market_intel.market_intel_manual_sample_candidate_handoff') }}";
@@ -952,6 +956,7 @@
const sampleCandidateQueueOperatorDrillEndpoint = "{{ url_for('market_intel.market_intel_manual_sample_candidate_queue_writer_operator_drill') }}";
const sampleCandidateQueueRunPackageEndpoint = "{{ url_for('market_intel.market_intel_manual_sample_candidate_queue_writer_run_package') }}";
const sampleCandidateQueueRunReadinessEndpoint = "{{ url_for('market_intel.market_intel_manual_sample_candidate_queue_writer_run_readiness') }}";
const sampleCandidateQueueRunReceiptEndpoint = "{{ url_for('market_intel.market_intel_manual_sample_candidate_queue_writer_run_receipt') }}";
const schedulerMeta = schedulerRoot ? schedulerRoot.querySelector('[data-market-intel-scheduler-meta]') : null;
const schedulerBody = schedulerRoot ? schedulerRoot.querySelector('[data-market-intel-scheduler-body]') : null;
const schedulerRefresh = schedulerRoot ? schedulerRoot.querySelector('[data-market-intel-scheduler-refresh]') : null;
@@ -2733,6 +2738,128 @@
}
};
const renderCandidateQueueRunReceipt = data => {
const blockers = (data.blocked_reasons || []).join(' / ');
const writer = data.writer_output_summary || {};
const smoke = data.postwrite_smoke_summary || {};
const evidence = data.operator_evidence_summary || {};
const gates = data.gates || [];
const steps = data.next_operator_steps || [];
sampleReviewMeta.innerHTML = [
`mode=${data.mode || 'unknown'}`,
`receipt=${data.receipt_passed ? 'pass' : 'blocked'}`,
`writer=${writer.mode || 'missing'}`,
`smoke=${smoke.postwrite_smoke_passed ? 'pass' : 'blocked'}`,
`api_write=${data.ready_for_api_database_write ? 'yes' : 'no'}`
].map(item => `<span class="market-intel-pill">${escapeHtml(item)}</span>`).join('');
sampleReviewBody.innerHTML = `
<div class="market-intel-empty mb-3">此卡只審核 CLI 寫入後的 writer output 與 post-write smoke receiptAPI/UI 不讀 token、不執行 CLI、不連 DB、不補寫 queue。${blockers ? `阻擋:${escapeHtml(blockers)}` : ''}</div>
<div class="market-intel-empty mb-3">expected=${escapeHtml((data.expected_dedupe_keys || []).join(', ') || 'none')} / observed=${escapeHtml((writer.observed_dedupe_keys || []).join(', ') || 'none')} / found=${escapeHtml((smoke.found_dedupe_keys || []).join(', ') || 'none')}</div>
<div class="market-intel-deploy-grid">
<div>
<p class="market-intel-deploy-section-title">RECEIPT GATES</p>
<div class="market-intel-check-list">${
gates.map(gate => `
<div class="market-intel-check">
<div>
<strong>${escapeHtml(gate.key)}</strong>
<small>${escapeHtml(gate.label)}</small>
</div>
<span>${gate.passed ? 'PASS' : 'BLOCK'}</span>
</div>
`).join('') || '<div class="market-intel-empty">尚未提供 receipt gates。</div>'
}</div>
</div>
<div>
<p class="market-intel-deploy-section-title">WRITER / SMOKE</p>
<div class="market-intel-check-list">
${[
['writer_committed', writer.database_commit_executed],
['writer_dedupe_match', writer.dedupe_keys_match_expected],
['writer_token_key_detected', writer.approval_token_key_detected],
['smoke_read_only', smoke.read_only_query_executed],
['smoke_passed', smoke.postwrite_smoke_passed],
['smoke_dedupe_match', smoke.dedupe_keys_match_expected]
].map(([key, value]) => `
<div class="market-intel-check">
<div>
<strong>${escapeHtml(key)}</strong>
</div>
<span>${value ? 'YES' : 'NO'}</span>
</div>
`).join('')}
</div>
</div>
<div>
<p class="market-intel-deploy-section-title">ARTIFACT EVIDENCE</p>
<div class="market-intel-check-list">
${[
['writer_output_json_path_recorded', evidence.writer_output_json_path_recorded],
['postwrite_smoke_json_path_recorded', evidence.postwrite_smoke_json_path_recorded],
['operator_confirmed_no_token_in_artifacts', evidence.operator_confirmed_no_token_in_artifacts],
['approval_token_submitted_to_api', evidence.approval_token_submitted_to_api]
].map(([key, value]) => `
<div class="market-intel-check">
<div>
<strong>${escapeHtml(key)}</strong>
</div>
<span>${value ? 'YES' : 'NO'}</span>
</div>
`).join('')}
</div>
</div>
<div>
<p class="market-intel-deploy-section-title">NEXT STEPS</p>
<div class="market-intel-check-list">${
steps.map((item, index) => `
<div class="market-intel-check">
<div>
<strong>${escapeHtml(`step_${index + 1}`)}</strong>
<small>${escapeHtml(item)}</small>
</div>
<span>MANUAL</span>
</div>
`).join('') || '<div class="market-intel-empty">尚未提供下一步。</div>'
}</div>
</div>
</div>
`;
};
const loadCandidateQueueRunReceipt = async () => {
if (!sampleReviewMeta || !sampleReviewBody || !sampleReviewInput) return;
let parsed;
try {
parsed = JSON.parse(sampleReviewInput.value || '{}');
} catch (error) {
sampleReviewMeta.innerHTML = '<span class="market-intel-pill">json_error</span>';
sampleReviewBody.innerHTML = `<div class="market-intel-empty">JSON 格式錯誤:${escapeHtml(error.message)}</div>`;
return;
}
const body = parsed && parsed.sample_result
? parsed
: { sample_result: parsed };
sampleReviewBody.innerHTML = '<div class="market-intel-empty">審核 queue writer run receipt 中...</div>';
try {
const response = await fetch(sampleCandidateQueueRunReceiptEndpoint, {
method: 'POST',
credentials: 'same-origin',
headers: {
'Content-Type': 'application/json',
'X-CSRFToken': csrfToken
},
body: JSON.stringify(body)
});
const data = await response.json();
if (!response.ok && !data.mode) throw new Error(`HTTP ${response.status}`);
renderCandidateQueueRunReceipt(data);
} catch (error) {
sampleReviewMeta.innerHTML = '<span class="market-intel-pill">error</span>';
sampleReviewBody.innerHTML = `<div class="market-intel-empty">queue writer run receipt 審核失敗:${escapeHtml(error.message)}</div>`;
}
};
const renderSchedulerMeta = data => {
schedulerMeta.innerHTML = [
`mode=${data.mode || 'unknown'}`,
@@ -4257,6 +4384,9 @@
if (sampleCandidateQueueRunReadiness) {
sampleCandidateQueueRunReadiness.addEventListener('click', loadCandidateQueueRunReadiness);
}
if (sampleCandidateQueueRunReceipt) {
sampleCandidateQueueRunReceipt.addEventListener('click', loadCandidateQueueRunReceipt);
}
if (schedulerRefresh) {
schedulerRefresh.addEventListener('click', loadScheduler);
}

File diff suppressed because it is too large Load Diff