check_compound_familiarity
Detects translationese in Estonian compound nouns by analyzing fastText neighbor similarity and vocabulary coverage, flagging coinages for review.
Instructions
fastText-based diagnostic for compound-noun familiarity in Estonian.
For each compound noun (root_tokens length >= 2), returns its top
fastText neighbours, a top_score similarity, a neighbour_quality
breakdown, and is_suspect: true + human-readable reasons when the
compound is out-of-vocab AND its top similarity is below 0.60 OR its
neighbours are mostly scrape-artifact tokens. This catches both
toortõlkeoht (OOV, top 0.571 — over the old 0.55 gate but a coinage)
and mõtteliin (literal English "train of thought"; real Estonian is
mõttekäik).
Output is diagnostic, not authoritative. Even with the 100K-vocab
medium model, some legitimate but rare compounds (e.g.
tervisekindlustus) can still be OOV; the rule favours recall, so a
flagged real compound just earns a second look. Judge by the included
neighbours: semantically coherent neighbours (related real words) mean
the compound is fine; neighbours that recycle the input's morphemes or
are junk tokens mean a likely coinage.
Input capped at 100,000 characters.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| text | Yes | Estonian text whose compound nouns are checked for calque / translationese risk. |
Output Schema
| Name | Required | Description | Default |
|---|---|---|---|
| note | No | ||
| text | No | ||
| all_compounds | No | ||
| summary_estonian | No | ||
| suspect_compounds | No | ||
| compounds_analysed | No |