Structured JSON Output Conformance Tester with Retry and Repair Across Providers
Prompt Codex to build a test script that checks whether each model returns schema-valid JSON for your inputs, using each provider's native structured output feature, with measured retry and repair rates.
You getSchema compatibility notes table, files created and run commands for mock and live modes and results table
The prompt
mkdir -p .agents/skills/structured-json-output-conformance-tester-with-retry-and-repair && curl -sL "https://prompts-gpt.com/prompts/structured-json-output-conformance-tester-with-retry-and-repair-across-providers/raw" -o .agents/skills/structured-json-output-conformance-tester-with-retry-and-repair/SKILL.mdDashed parts are example values, so the prompt runs as copied. Change them in Fill in the blanks.
Start with a schema of modest size, then grow it. Some providers restrict schema keywords in strict modes, so expect a simplified schema variant. Use at least 30 sample inputs before drawing conclusions.
Keep exploring
More like this
Multi-Source Research Pipeline Script with Citation Table and Evidence Grading
Have Codex build a script workflow where Perplexity-style search tools surface candidate sources, you supply the real URLs or files, and the code produces a citation table, evidence grades, and a decision memo without claiming it browsed.
Model Routing Config and Router Script Based on Cost, Latency, and Data Sensitivity
Use Codex to produce a rules-based model router with YAML config, fallback chains, and tests, so each workload goes to a model that fits budget, latency, context needs, and data-handling rules.
Cross-Model Prompt Evaluation Harness with Rubric Scoring and Cost Report
Direct Codex to build a script that runs one prompt suite across multiple models, scores outputs against a rubric, and produces a CSV and Markdown report that helps you choose a model.
Provider-Agnostic LLM Client Adapter for OpenAI, Claude, and Gemini
Have Codex build a thin, config-driven client that normalizes requests, responses, errors, and token usage across several model providers, so switching models becomes a config change instead of a rewrite.
Strict JSON Handoff Schemas with Validation and Retry Rules for Agent Pipelines
Turns a pasted pipeline description into JSON schemas for every agent-to-agent handoff, plus validation checks and retry rules for bad output.
- Codex Exec CI Fixer: Diagnose, Minimal Fix, Rerun, Stop After 3 Attempts
- Codex Cloud Environment Setup: Setup Script, Env Vars and a Smoke Test
- Codex Characterization-Test-First Refactor with Verification Handoff
- Codex CI Failure Triage: Reproduce, Classify, Fix or Hand Off
- Codex Pre-Merge Diff Review with Severity-Ranked Findings
- Codex Read-Only Repo Investigation for a Bug Report