A/B Compare

Edit two prompt variants side by side with the same target model. Compare tokens, swap panes, and export each side as ChatML JSON — all local.

All processing for core tools runs locally in your browser. Privacy policy

Same catalog model for fair A/B token comparison.

Variant A

0tok
Context0.0%

Variant B

0tok
Context0.0%

How to use

  1. Pick one target model so both panes use the same tokenizer and context window.
  2. Edit A and B independently (text or ChatML). Token bars update per side.
  3. Use Swap to flip variants, or load from / send a side to the Editor.
  4. Copy or download ChatML JSON for each side before shipping to an API.

FAQ

Do A and B share one draft with the Editor?

No. Compare keeps its own localStorage draft. Use “Editor → A/B” or “A/B → Editor” to transfer intentionally.

Why is the model shared?

A fair A/B token comparison needs the same encoding and context window. Edit each side’s content independently.

What does Copy ChatML export?

ChatML mode exports the message array. Text mode wraps the plain text as a single user message JSON payload.

Related tools