Skip to content

Action Outcome SQL Replay 006 - Raw Research Artifact

Generated at: 2026-06-18T02:14:23Z Fixtures:

  • docs/research/fixtures/action_outcome_episodes.json
  • docs/research/fixtures/action_outcome_distractor_episodes.json
  • Quality labels: docs/research/fixtures/action_outcome_retrieval_quality_labels.json
TableRows
action_outcome_episodes32
action_outcome_episode_metrics101
action_outcome_retrieval_quality_labels26
action_outcome_replay_recommendations18
action_outcome_gate_suppressions21
VariantSourceTop-3 Hit RateFailed-Action AvoidanceCross-Family Top3Weak Cross-Family Top3Gate SuppressionsLabeled Top3 Quality
full_guardedSQL1.000.67000useful:8, superficial:5, misleading:5
context_gatedSQL1.001.000021useful:8, superficial:4, misleading:6
context_gatedJSON control1.001.000021useful:8, superficial:4, misleading:6
  • Match status: pass
  • Top-action mismatches: 0
QuerySQL Top ActionJSON Top ActionMatchSQL Top ActionsAvoids Failed Repeat
aoe_checkout_002rollbackrollbackyesrollback:1.03, scale_out:0.31, config_revert:0.16yes
aoe_payment_002traffic_draintraffic_drainyestraffic_drain:0.67, restart:0.16, scale_out:0.16yes
aoe_inventory_002config_revertconfig_revertyesconfig_revert:0.36, traffic_drain:0.36, scale_out:0.16yes
aoe_cache_002cache_purgecache_purgeyescache_purge:0.59, restart:0.16, rollback:0.16yes
aoe_queue_003scale_outscale_outyesscale_out:0.54, traffic_drain:0.17, restart:0.16yes
aoe_search_003rollbackrollbackyesrollback:0.56, restart:0.36, traffic_drain:0.07yes
SELECT episode_id, incident_type, action_class, human_outcome
FROM action_outcome_episodes
WHERE incident_type = 'order_queue_backlog'
ORDER BY action_ts_ns;
SELECT episode_id, metric_name, metric_value
FROM action_outcome_episode_metrics
WHERE metric_name IN ('cpu_pct', 'db_conn_used_pct', 'consumer_error_pct')
ORDER BY episode_id, metric_name;
SELECT query_id, candidate_id, action_class, reasons
FROM action_outcome_gate_suppressions
WHERE multiplier_micros < 1000000
ORDER BY query_id, candidate_id;

Experiment 006 validates the first SQL-backed research contract. The replay logic no longer consumes raw JSON fixtures directly; it reconstructs episodes from SQL tables and matches the JSON control result.

This is still a local SQL harness, not a live ZeptoDB server run. The next step is to execute the generated SQL through ZeptoDB’s HTTP SQL endpoint and compare live query results against this report.

  1. Run the generated SQL seed against a live ZeptoDB HTTP server.
  2. Add live SQL query checks for top actions and suppression rows.
  3. Promote the table schema into a design note if the live replay matches.