Prompt Optimization

Self-Supervised Prompt Optimization

Most prompt optimizers need an answer key to score against. Self-Supervised Prompt Optimization, or SPO, does without one. It improves a prompt using only comparisons between the model's own outputs, an evaluator picks the better of two responses, and an optimizer rewrites the prompt to produce more like it. With no ground-truth labels and no human feedback required, it can optimize tasks where a reference answer simply does not exist.

*These are learning tools, not prompts. They teach you to write your own, think of them as training wheels that guide you while you learn, then fall away once you can ride on your own.

The Core Insight

Optimize Without an Answer Key

Prompt optimizers usually depend on an external signal: labeled examples, a metric, or human ratings that say how good each output is. That dependency is a real limit. For open-ended tasks, writing, design, analysis, there is often no single correct answer to score against, and gathering labels or human feedback is slow and expensive.

SPO removes the answer key. Its insight is that a capable model can judge which of two outputs is better even when neither is a labeled ground truth. So the optimization signal comes entirely from within: run the prompt to produce outputs, have an LLM evaluator compare them pairwise and choose the stronger, and have an LLM optimizer revise the prompt to make outputs more like the preferred ones.

Because the whole loop runs on the model's own comparisons, SPO needs no external reference and little cost. That makes it especially useful where labels are unavailable, and it means the optimization can target qualities that are easy to prefer but hard to score numerically, like clarity or persuasiveness.

Signal From Comparison, Not Labels

The key move is replacing "how close is this to the correct answer" with "which of these two outputs is better." Preference between the model's own outputs is a self-supervised signal, it requires no ground truth, so SPO can optimize tasks that label-based optimizers cannot touch.

The SPO Process

Generate, compare, optimize, and repeat, all without labels

1

Generate Outputs From Candidate Prompts

Run the current prompt, and variations of it, on the task to produce outputs. These outputs are the material the loop compares, no reference answers are needed.

Example

For a product-description task, two prompt variants each generate a description of the same item.

2

Compare Outputs Pairwise

An LLM evaluator looks at two outputs for the same input and picks the better one against the task's goals. This preference is the optimization signal, and it needs no labeled truth to produce.

Example

The evaluator prefers the description that leads with the concrete benefit over the one that opens with generic praise.

3

Optimize the Prompt

An LLM optimizer revises the prompt so that its outputs move toward the preferred style, incorporating what made the winning output better. The prompt, not the model, is what changes.

Example

The prompt is updated to instruct the model to open every description with the single most concrete customer benefit.

4

Repeat Until It Converges

The loop runs again with the improved prompt, comparing new outputs and refining further, until preferences stop favoring changes. The result is a prompt tuned entirely by the model's own judgment.

Example

After a few rounds, new descriptions are consistently preferred over the originals, and the prompt stabilizes.

See the Difference

Depending on labels versus learning from self-comparison

Label-Dependent Optimizers

Needs a Ground Truth

The optimizer scores each output against a reference answer or metric. Without labels, it cannot tell whether a change helped.

Limit

Open-ended tasks with no correct answer are out of reach, and collecting labels or human ratings is slow and costly.

Blocked when no reference answer exists
VS

Self-Supervised Prompt Optimization

Learns From Preference

An evaluator compares the model's own outputs and picks the better one. That preference drives the optimizer, so no ground truth is required.

Reach

Works on open-ended tasks with no correct answer, and targets qualities that are easy to prefer but hard to score numerically.

No labels needed, works on open-ended tasks

Practice Responsible AI

Always verify AI-generated content before use. AI systems can produce confident but incorrect responses. When using AI professionally, transparent disclosure is both best practice and increasingly a legal requirement.

Most US states are actively legislating AI transparency and accountability. Critical thinking remains your strongest tool against misinformation.

Self-Supervised Prompt Optimization in Action

See how self-comparison drives prompt improvement

Task

"Write a short welcome email for new subscribers." There is no single correct email, so no label to score against.

SPO Loop

Compare: the evaluator prefers the version that states one clear next step over the one that lists five links.

Optimize: the prompt is revised to require a single, clear call to action.

Result: subsequent emails consistently open with one focused next step, learned purely from preference.

Task

"Summarize a meeting transcript for busy executives." Quality is a matter of judgment, not a fixed answer.

SPO Loop

Compare: the evaluator prefers the summary that leads with decisions and owners over the one that recounts the discussion chronologically.

Optimize: the prompt is updated to put decisions, owners, and deadlines first.

Result: summaries become consistently decision-first, a style the model learned to favor without any labeled examples.

Setting

A new internal tool has no labeled dataset yet, but a prompt still needs tuning before launch.

SPO Loop

Instead of waiting for labels, SPO runs on the raw task, comparing the model's own outputs and refining the prompt from those preferences.

Result: a usable, improved prompt is produced before any ground-truth data exists, which label-based optimizers could not do.

When to Use SPO

Best when labels are missing or the task has no single right answer

Perfect For

Open-Ended Tasks

Writing, ideation, and design have no single correct output, so preference between outputs is the natural signal, exactly what SPO uses.

No Labeled Data Yet

When a task is new and no ground-truth set exists, SPO can still tune a prompt from the model's own comparisons.

Low-Cost Optimization

Because it avoids labeling and human feedback, SPO keeps the cost of a tuning pass low, which suits fast iteration.

Hard-to-Score Qualities

Clarity, tone, and persuasiveness are easy to prefer but hard to put a number on; comparison captures them where a metric would not.

Skip It When

A Reliable Metric Exists

When there is a trustworthy ground-truth score, a label-based optimizer can target it directly and precisely.

The Evaluator Is Unreliable

SPO trusts the model's preferences; if the evaluator judges poorly on the task, the optimization can drift in the wrong direction.

Objective Correctness Is Critical

For tasks where being factually right is the whole point, preference alone can favor a fluent but wrong answer, so validation against truth is safer.

Use Cases

Where Self-Supervised Prompt Optimization delivers the most value

Content Generation

Tune prompts for emails, descriptions, and posts where quality is a matter of preference, learning a house style from self-comparison.

Assistant Tone Tuning

Shape the voice of a chatbot toward preferred responses without needing a labeled dataset of ideal replies.

Early-Stage Prototyping

Improve a prompt before any labeled data is available, so a new feature can launch with a tuned prompt from day one.

Subjective Quality Goals

Optimize for clarity, warmth, or persuasiveness, qualities that resist a numeric metric but are easy to prefer in a comparison.

Budget-Limited Teams

Get optimization gains without the expense of labeling or human review, which matters for small teams and fast cycles.

Complement to Labeled Tuning

Use SPO for a first pass on preference-driven qualities, then apply label-based checks where objective correctness matters.

Where SPO Fits

The label-free corner of the optimizer family

APE Search Instructions Score on held-out data
OPRO LLM as Optimizer Score-guided proposals
SPO Self-Supervised Preference, no labels
Self-Refine Self-Critique Improve one output
Chain These

Where APE and OPRO lean on a scored held-out set, SPO removes that dependency by optimizing from the model's own pairwise preferences. Reach for it when labels are missing or the task's quality lives in judgment rather than a metric.

Optimize Without Labels

Explore how comparing outputs can improve a prompt in the Prompt Builder, or see how SPO relates to the wider family of prompt optimizers.