Aller au contenu

Methodology

Sources and methodology: three independent benchmarks, speed first, no combined score

All three benchmarks read on October 22, 2026. TTS for Voice Agents compares 119 text-to-speech (TTS) models for real-time voice agents. It runs no tests of its own: this page says where every number comes from, how it was read, and the rules applied to it.

The three benchmarks

SourceWhat it measuresHowModelsUsed for
CovalTime to first audio, word error rateCalls each hosted API every 30 minutes from US East; publishes percentiles over 30 days32Speed (median and P95), speed tiers, feature tags (multilingual), some prices
SpekoNaturalness, time to first audio, pronunciation of numbers and dates, cost, voice driftBlind A/B votes on phone-agent lines; latency sweeps from US East45Naturalness, number pronunciation, the speed and naturalness frontier
Artificial AnalysisListener preference (Elo), list priceBlind listening arena with a 95% interval per model; votes can be filtered by category98Listener Elo, the second frontier, the customer service table, prices

Rules applied

RuleDefinitionReason
Speed firstModels are grouped by speed before anything else is compared.The site is written for real-time voice agents. This is an editorial choice, stated at the top of the speed page.
Two percentilesMedian (P50) and P95, both from Coval's 30-day window.The median is the typical wait, P95 the slow turn. Showing one alone would favour whichever model leads on it.
Tie rule, latencyTwo latencies within 10 ms are a tie.The order among the leaders changes from week to week on gaps of a few milliseconds.
Tie rule, ratingsTwo Elo scores are a tie when their published 95% intervals overlap.The source's own measure of uncertainty.
Speed tiersHeadroom: P95 at or under 101 ms; Fast enough: P95 from 138 ms to 263 ms; Visible delay: P95 of 320 ms or more.The breaks follow gaps in the data: no model sits between two tiers. They are recomputed at each reading.
FrontierA model is on the frontier when no other model is both faster and better rated.Compares two measures without weights or score cut-offs.
No thresholdsEach comparison includes every model the sources involved both list.A cut-off can be placed to include or exclude a given model.
No combined scoreRanks and scores from different benchmarks are never added or averaged.The three sources test different model sets under different conditions.
Accuracy measureSpeko's number and date test, not Coval's word error rate.On Coval's 30-day table, 25 of 32 models fall between 1.8% and 2.8%: too close to rank.
PricesList price per 1M characters as each source prints it; a range when sources or plans differ.Plans differ; Gradium's plans are read on gradium.ai/pricing and converted at one credit per character.

How each source was read

SourceSettingsWhat was taken
Coval dashboard and APIWindow 30 days; percentiles P50 and P95; no other filterAll 32 models measured
Coval model registry and pagesNoneFeature tags (multilingual, voice cloning, emotion control), licensing, creator and host
Coval pricingText-to-speech tableList price per 1M characters and the date it applies from
Speko TTS boardRegion US East; all models shownNaturalness, time to first audio (board chart), pronunciation score, cost; 41 models have both latency and naturalness
Artificial Analysis, Provider VoiceAccent All; Category AllElo, 95% interval, rank and price for the 98 models rated
Artificial Analysis, Provider VoiceCategory Customer ServiceRank, Elo and interval for the 93 models rated in that category
gradium.aiNonePlans and credits, converted to a price per 1M characters

Each source is captured by script on the date of the reading; the raw files are kept with a checksum, so every number can be traced back to the page it was read from.

Model matching

Models are matched across sources by vendor and model name. When a benchmark measures a model through another company's API, the host is named on the model page and the latency is the host's (5 models).

Some matches are inferred rather than stated by any source, and the model page says so. Gradium TTS is matched across the three sources from the date in each name: Coval's “Default” model (gradium-tts-beta-202609), Speko's gradium:default and Artificial Analysis's “Gradium TTS (Sep 2026)”.

Known limits of the data

Questions and answers

Does this site run its own tests?
No. Every number is copied from one of three public benchmarks, Coval, Speko and Artificial Analysis, read on the date shown, with a link to the source.
Why is there no overall score?
The three benchmarks test different models under different conditions. Adding or averaging their ranks would hide that, so models are grouped by speed first and every other measure is shown side by side.
What happens when a benchmark does not measure a model?
Nothing is estimated. The model page lists the missing measure under “Not collected”, with the reason. A model Coval does not measure has no speed tier.
How often is the data read again?
The three sources are captured again by script; each capture is kept with its date and checksum, and every page shows the date of the reading it uses (currently October 22, 2026).

Change log

Published by Rank-ly. Corrections: contact. Data from Coval, Speko and Artificial Analysis belongs to its publishers.

Get benchmark updates

An occasional email when the sources are read again.

Benchmark updates only. Unsubscribe at any time. See our privacy policy.