mcp-arxiv-research-server

Abstract. Large language models are good at reading papers and bad at remembering which papers exist. This Model Context Protocol server gives Claude seven tools over the arXiv API and the Semantic Scholar Graph API. It returns search results in about one fifth of the tokens of the raw arXiv feed, obeys arXiv's one request every three seconds rule and caches answers, which cut a 16-call research session from 36.1 s to 21.1 s, and exports BibTeX that compiled 105 of 105 real arXiv records with zero LaTeX errors, where copying the fields as they are produced two errors and silently lower-cased acronyms in 28 titles. Every number below is reproducible offline from recorded API responses.

1 · Introduction

Ask a model for "five papers on X" and some of them will not exist. The fix is not a better prompt; it is a tool that can only return what the library returned. With this server, Claude cites by arXiv id, and every id came from arXiv itself.

All read tools carry readOnlyHint; library_remove carries destructiveHint, so a client can ask before using it.

Related MCP server: arXiv Reader MCP

2 · Installation

git clone https://github.com/jafarSalim/mcp-arxiv-research-server.git
cd mcp-arxiv-research-server
npm install          # also compiles to dist/

Claude Desktop (claude_desktop_config.json):

{
  "mcpServers": {
    "arxiv": {
      "command": "node",
      "args": ["/absolute/path/to/mcp-arxiv-research-server/dist/src/index.js"],
      "env": { "S2_API_KEY": "optional, raises the Semantic Scholar rate limit" }
    }
  }
}

Claude Code: claude mcp add arxiv -- node /absolute/path/to/mcp-arxiv-research-server/dist/src/index.js

Then, for example: "Find recent arXiv papers on deep-learning channel estimation for OFDM, read the three most relevant abstracts, tell me who cites the best one, and give me BibTeX for all three."

3 · Method

%%{init: {"theme":"base","themeVariables":{"actorBkg":"#ffffff","actorBorder":"#B31B1B","actorTextColor":"#1a1a1a","signalColor":"#1a1a1a","signalTextColor":"#1a1a1a","noteBkgColor":"#f6f1e6","noteTextColor":"#1a1a1a","noteBorderColor":"#B31B1B","fontFamily":"Georgia, serif"}}}%%
sequenceDiagram
    participant C as Claude
    participant S as this server
    participant K as cache (disk)
    participant A as export.arxiv.org
    C->>S: search_arxiv("channel estimation", category eess.SP)
    S->>K: same URL in the last 24 h?
    K-->>S: no
    Note over S,A: wait until 3 s after the previous arXiv request
    S->>A: GET /api/query?search_query=(all:channel AND all:estimation) AND cat:eess.SP
    A-->>S: Atom XML (about 2.5 KB per paper)
    S->>K: store
    S-->>C: compact list, about 120 tokens per paper
    C->>S: same question later
    S->>K: hit
    S-->>C: answer, no request sent

Politeness. Requests to each host are queued one at a time with a minimum gap (3 s for arXiv, 1 s or 3 s for Semantic Scholar). 429 and 5xx answers are retried with back-off, honouring Retry-After.

Parsing. arXiv's Atom feed is parsed with every field kept as text, so a paper whose title is literally 0 (2104.12255) stays "0" instead of becoming a number. arXiv's own error feeds (for example incorrect id format for abc) become readable error messages.

BibTeX. One @misc entry per paper in the form arXiv recommends (eprint, archivePrefix, primaryClass), plus howpublished and note for classic BibTeX styles that ignore eprint:

@misc{gould2006frequency,
  title         = {Frequency of Hot Jupiters and Very Hot Jupiters from the {OGLE-III} Transit Surveys Toward the Galactic Bulge and Carina},
  author        = {Andrew Gould and Susan Dorsher and B. Scott Gaudi and Andrzej Udalski},
  year          = {2006},
  month         = jan,
  eprint        = {astro-ph/0601001},
  archivePrefix = {arXiv},
  primaryClass  = {astro-ph},
  url           = {https://arxiv.org/abs/astro-ph/0601001},
  howpublished  = {arXiv:astro-ph/0601001 [astro-ph]},
  note          = {Published in ActaAstron.56:1-50,2006}
}

4 · Experiments

Data. The arXiv service is not reachable from the machine these measurements ran on, so every experiment replays real recorded responses: 105 arXiv papers recorded by the arxiv.py project in April 2026 (a 100-result search for testing, its pages, and single-id lookups), and the Semantic Scholar record of Turing's Computing Machinery and Intelligence (1950) with 1,000 of its citing papers, recorded by the semanticscholar project. Both are MIT-licensed; their licences are in test/fixtures. A small replay server plays them back on localhost, and the server under test talks to it over real HTTP, launched as a child process and driven by the official MCP TypeScript client.

The recordings had stored arXiv's UTF-8 as Latin-1 (Wübben saved as Wübben, because arXiv sends no charset). The replay server repairs that; the server itself always decodes UTF-8.

4.1 · Tokens the model has to read

Even with complete abstracts the compact format is half the size, because the XML repeats namespaces, links and tags for every paper. The usual flow (scan 10 results, then get_paper on the two or three that matter) costs about 1,200 + 3 × 350 tokens instead of 6,000.

What the model actually sees (first three of ten):

214,881 arXiv results for "testing" (showing 1–10).

1. [2202.12139v1] Testing Deep Learning Models: A First Comparative Study of Multiple Testing Techniques (2022)
   Mohit Kumar Ahuja, Arnaud Gotlieb, Helge Spieker · cs.SE · Artificial Intelligence in Software Testing @ 2022 IEEE …
   Deep Learning (DL) has revolutionized the capabilities of vision-based systems (VBS) in critical applications such as …
2. [2405.13786v1] Towards Explainable Test Case Prioritisation with Learning-to-Rank Models (2024)
   Aurora Ramírez, Mario Berrios, José Raúl Romero et al. (4 authors) · cs.SE · Proc. 2023 IEEE International Conference …
   Test case prioritisation (TCP) is a critical task in regression testing to ensure quality as software evolves. …
3. [2005.14124v2] Active Fuzzing for Testing and Securing Cyber-Physical Systems (2020)
   Yuqi Chen, Bohan Xuan, Christopher M. Poskitt et al. (5 authors) · cs.SE · In Proc. ACM SIGSOFT International …

Lines shortened here for width. Token counts use the open Llama 4 tokenizer as a stand-in, since Claude's tokenizer is not public; the ratios are what matter.

4.2 · A research session, with and without the cache

A scripted session of 16 tool calls of the kind a conversation produces: two result pages, three abstracts, a repeated question, BibTeX for three papers, citations of one paper (twice, sorted two ways), two reading-list additions, a 15-result search, a second BibTeX export, and the reading list as BibTeX. arXiv's 3-second gap was enforced in both runs.

Five arXiv requests are saved: the repeated search, two papers that were looked up and then added to (or looked up again from) the reading list, and two BibTeX exports for papers already fetched; the second citation query saves both Semantic Scholar requests. Against the real API the saving is larger, because each skipped request also skips the network round trip. The cache is on disk, so it also survives restarting Claude.

4.3 · Does the BibTeX compile?

All 105 recorded papers were exported through the export_bibtex tool and compiled with pdfLaTeX and BibTeX (TeX Live 2023) in two styles, plain and plainnat with natbib, by scripts/compile_bib.sh. The baseline writes the same fields as they are, which is what a quick script, or a model writing BibTeX from the metadata, usually does.

Both styles gave the same counts. The two LaTeX errors stop a strict build; the lower-cased acronyms are worse, because nothing reports them:

4.4 · Citations

find_citations("10.1093/mind/lix.236.433") on the recorded Semantic Scholar data returns:

Computing Machinery and Intelligence (1950)
Cited by 10,059 papers (530 "influential" according to Semantic Scholar), cites 14 papers.
The analysis below uses the 1,000 citing papers returned in one request, not all 10,059.
Citing papers per year (sample, last 8 years present): 2022: 353, 2023: 499, 2024: 148

Most-cited citing papers:
1. LLaMA: Open and Efficient Foundation Language Models (2023) — Hugo Touvron, Thibaut Lavril et al. (14 authors) · cited 5,708× · arXiv:2302.13971
2. A Survey of Large Language Models (2023) — Wayne Xin Zhao, Kun Zhou et al. (22 authors) · cited 1,114× · arXiv:2303.18223
3. What if the devil is my guardian angel: ChatGPT as a case study of using chatbots in education (2023) — A. Tlili, Boulus Shehata et al. (7 authors) · cited 409×
…

The tool says plainly when it is working from a sample, so Claude does not present 1,000 as the total. Citing papers that are on arXiv carry their id, so the next step can be get_paper on them.

4.5 · What the recorded search covers

%%{init: {"theme":"base","themeVariables":{"pie1":"#B31B1B","pie2":"#1a1a1a","pie3":"#8c8c8c","pie4":"#d9a3a3","pie5":"#6b5a45","pie6":"#e9e4da","pieStrokeColor":"#ffffff","pieSectionTextColor":"#ffffff","pieTitleTextColor":"#1a1a1a","pieOuterStrokeColor":"#1a1a1a","fontFamily":"Georgia, serif"}}}%%
pie showData
    title Primary category of the 100 results for "testing"
    "cs.SE software engineering" : 64
    "cs.LG machine learning" : 4
    "cs.IT information theory" : 4
    "math.ST statistics" : 4
    "cs.DS data structures" : 3
    "18 other categories" : 21

Two thirds are software engineering; the other third is spread over 22 categories, from statistics to information theory. A one-word query is ambiguous; category: "cs.SE" or ti: narrows it, and the tool description tells Claude so.

5 · Tests

npm test     # 18 tests: 11 unit, 7 end-to-end over stdio with the official MCP client

%%{init: {"theme":"base","themeVariables":{"primaryColor":"#ffffff","primaryBorderColor":"#B31B1B","primaryTextColor":"#1a1a1a","lineColor":"#1a1a1a","fontFamily":"Georgia, serif"}}}%%
flowchart LR
    F["recorded responses<br/>arxiv.py · semanticscholar<br/>MIT"] --> R["replay server<br/>localhost HTTP"]
    R <--> S["this server<br/>child process"]
    S <-- "stdio JSON-RPC" --> C["official MCP client<br/>@modelcontextprotocol/sdk"]
    C --> T["18 assertions<br/>tools · paging · ids · errors<br/>503 retry · cache · library"]

They cover every id spelling, all 105 recorded entries parsing, the paper titled 0, arXiv error feeds, LaTeX escaping and case protection, unique keys and balanced braces across all 105 entries, the per-host request gap and 503 retry (with a fake clock), the disk cache surviving a new process, the reading list surviving a reload, and an unknown paper giving a useful message instead of a stack trace.

npm run bench                 # → results/bench.json, results/outputs/, results/bibtex/all.bib   (about 1 minute)
./scripts/compile_bib.sh      # → results/bibtex/compile.txt and the PDFs
python3 scripts/charts.py     # → results/fig*.png   (needs: pip install tiktoken matplotlib pillow)

6 · Limitations

• Recorded, not live, in this repository's measurements. The live code path is the same one the tests use, with different base URLs, but the numbers above come from April 2026 recordings. Real latency adds network time on top.

• arXiv only for search and BibTeX. Papers that never appeared on arXiv are reachable through find_citations (by DOI) but not through get_paper.

• Case protection covers acronyms and CamelCase, not ordinary proper nouns: Android and Markov still come out lower-case in plain. Add braces by hand for those, or use a style that keeps title case.

• find_citations reads one page of up to 1,000 citing papers. For heavily cited papers it is a sample, and it says so.

• Without an API key, Semantic Scholar shares a public rate limit; under load it may answer 429 even after retries.

7 · Layout

mcp-arxiv-research-server/
├── src/
│   ├── server.ts     the seven tools, configuration, error messages written for the model
│   ├── arxiv.ts      id parsing, query building, Atom parsing
│   ├── s2.ts         Semantic Scholar ids, URLs, citation summary
│   ├── bibtex.ts     keys, LaTeX escaping, math, Greek, case protection
│   ├── http.ts       per-host queue, minimum gap, retries, disk cache
│   ├── library.ts    the reading list
│   ├── format.ts     what the model reads
│   └── index.ts      stdio entry point
├── test/             unit + end-to-end tests, replay server, recorded fixtures (with their licences)
├── bench/run.ts      the experiments in section 4
└── scripts/          compile_bib.sh, charts.py