Skip to main content
Glama

Published receptionist benchmark: real test calls, scored in public

get_receptionist_benchmark
Read-onlyIdempotent

Odile Labs' published benchmark of AI phone receptionists: real test calls placed to public lines, scored against stated measures. Use it when someone asks how AI receptionists actually handle calls, or to compare named products; call it with no arguments first, then filter. Needs no sign-in and changes nothing. Returns { source, date, calls, minutes, run_by, limitations, fairness_note, scenarios[{id,name,brief}], lines[{id, vendor, business, kind, answers_as, list_price, ranked, points, possible, by_scenario{:{points, possible, answered, first_words_s, ai_disclosed_unprompted, reply_language, price_quoted, measures}}}], read_more }. An unknown line_id or scenario_id returns an error listing the valid ids. Vendor-run by Odile Labs (which sells After Hours and Dusklin), not independent. It does not test the caller's own line (for that, see read_more.free_line_check); to set up an After Hours line billed per minute, see get_answering_line_offer.

Input Schema

TableJSON Schema
NameRequiredDescriptionDefault
line_idNoOnly this tested line, e.g. 'afterhours-plumbing', 'afterhours-vet', 'rosie', 'myaifrontdesk' or 'dialzara'. Omit for every line.
scenario_idNoOnly this scenario: 'emergency' (leak after hours), 'booking' (book a slot), 'price' (price probe), 'disclosure' (are you real?) or 'spanish' (caller in Spanish). Omit for all.
include_evidenceNoDefault false: each scenario's measures come back as strings like 'yes: <measure>'. true: measures come back as [{measure, score (0 or 1), evidence (quoted transcript)}] (much longer output).

Schema Changelog

Changes observed during successful MCP inspections.

  1. Changed4 schema fields changed
    • addedInput schema / properties / include_evidence / default
      Added value: +false
    • addedInput schema / properties / include_evidence / description
      Added value: +"Default false: each scenario's measures come back as strings like 'yes: <measure>'. true: measures come back as [{measure, score (0 or 1), evidence (quoted transcript)}] (much longer output)."
    • addedInput schema / properties / line_id / description
      Added value: +"Only this tested line, e.g. 'afterhours-plumbing', 'afterhours-vet', 'rosie', 'myaifrontdesk' or 'dialzara'. Omit for every line."
    • addedInput schema / properties / scenario_id / description
      Added value: +"Only this scenario: 'emergency' (leak after hours), 'booking' (book a slot), 'price' (price probe), 'disclosure' (are you real?) or 'spanish' (caller in Spanish). Omit for all."
  2. Added

TDQS

Score is being calculated.

Try in Browser

Glama MCP Gateway

Add one secure layer between your agents and this server.