Cross-Model Prompt Evaluation Harness with Rubric Scoring and Cost Report
Direct Codex to build a script that runs one prompt suite across multiple models, scores outputs against a rubric, and produces a CSV and Markdown report that helps you choose a model.
You getDataset summary table, files created with one-line purposes and report template with sections
The prompt
mkdir -p .agents/skills/cross-model-prompt-evaluation-harness-with-rubric-scoring-and-co && curl -sL "https://prompts-gpt.com/prompts/cross-model-prompt-evaluation-harness-with-rubric-scoring-and-cost-report/raw" -o .agents/skills/cross-model-prompt-evaluation-harness-with-rubric-scoring-and-co/SKILL.mdDashed parts are example values, so the prompt runs as copied. Change them in Fill in the blanks.
Keep your dataset to 20 to 50 realistic cases for a first pass. Review the judge prompt manually and spot-check at least five judged outputs before trusting scores. Update the pricing config before each run.
Keep exploring
More like this
Multi-Source Research Pipeline Script with Citation Table and Evidence Grading
Have Codex build a script workflow where Perplexity-style search tools surface candidate sources, you supply the real URLs or files, and the code produces a citation table, evidence grades, and a decision memo without claiming it browsed.
Structured JSON Output Conformance Tester with Retry and Repair Across Providers
Prompt Codex to build a test script that checks whether each model returns schema-valid JSON for your inputs, using each provider's native structured output feature, with measured retry and repair rates.
Model Routing Config and Router Script Based on Cost, Latency, and Data Sensitivity
Use Codex to produce a rules-based model router with YAML config, fallback chains, and tests, so each workload goes to a model that fits budget, latency, context needs, and data-handling rules.
Provider-Agnostic LLM Client Adapter for OpenAI, Claude, and Gemini
Have Codex build a thin, config-driven client that normalizes requests, responses, errors, and token usage across several model providers, so switching models becomes a config change instead of a rewrite.
Two-to-Three Model Comparison Test Plan with 10 Prompts and Scoring Rubric
Creates a side-by-side test plan for choosing an AI model for your use case, with 10 test prompts, a scoring rubric and a blank results table.
Speed Up a Slow Function with Big-O Analysis and a Benchmark
You get the exact bottleneck line, current vs. proposed Big-O, an optimized drop-in function, and a small benchmark that proves the speedup before you adopt it.
- Codex Exec CI Fixer: Diagnose, Minimal Fix, Rerun, Stop After 3 Attempts
- Codex Cloud Environment Setup: Setup Script, Env Vars and a Smoke Test
- Codex Characterization-Test-First Refactor with Verification Handoff
- Codex CI Failure Triage: Reproduce, Classify, Fix or Hand Off
- Codex Pre-Merge Diff Review with Severity-Ranked Findings
- Codex Read-Only Repo Investigation for a Bug Report