<!--
Planning Center Online MCP Server — Evaluation Questions
=========================================================
These 10 questions test whether an LLM can effectively use the PCO MCP server
to answer realistic, complex church-management questions.
IMPORTANT: Answers marked with [FILL_IN] are placeholders.
Before running evaluations, you must:
1. Run each question against your real PCO account using the MCP server tools.
2. Record the verified answer.
3. Replace [FILL_IN] with the correct answer string.
All questions are READ-ONLY and require multiple sequential tool calls.
Run with the evaluation harness:
python scripts/evaluation.py \
-t stdio \
-c node \
-a dist/index.js \
-e PCO_APP_ID=your_app_id \
-e PCO_SECRET=your_secret \
evaluation.xml
-->
<evaluation>
<!-- ── MODULE: People ─────────────────────────────────────────────────────── -->
<qa_pair>
<question>
Search for all people in Planning Center who have a status of "inactive" and
were marked inactive before January 1, 2023. Among those people, find the one
whose record was most recently updated. What is that person's full name
(first name followed by last name)?
</question>
<answer>[FILL_IN]</answer>
</qa_pair>
<qa_pair>
<question>
Find the household in Planning Center that contains the greatest number of
individual member records. What is the name of that household?
</question>
<answer>[FILL_IN]</answer>
</qa_pair>
<qa_pair>
<question>
Look at all the smart lists (saved people lists) available in Planning Center.
Identify the list whose name suggests it targets people who are children
(i.e., the list name contains the word "child" or "children" or "kids",
case-insensitively). What is the exact name of that list?
If multiple such lists exist, give the name of the one that appears first
alphabetically.
</question>
<answer>[FILL_IN]</answer>
</qa_pair>
<!-- ── MODULE: Services ───────────────────────────────────────────────────── -->
<qa_pair>
<question>
Examine all service types defined in Planning Center Services. Find the service
type that has the largest number of plans scheduled in the past (i.e., plans with
dates before today). How many past plans does that service type have?
Provide the count as a whole number.
</question>
<answer>[FILL_IN]</answer>
</qa_pair>
<qa_pair>
<question>
In the Planning Center song library, find the song whose title comes first
alphabetically (A-Z). What is that song's title?
</question>
<answer>[FILL_IN]</answer>
</qa_pair>
<qa_pair>
<question>
Look at all sermon series defined across all service types in Planning Center.
Find the series with the most recent creation date. What is the name of
that series?
</question>
<answer>[FILL_IN]</answer>
</qa_pair>
<!-- ── MODULE: Giving ─────────────────────────────────────────────────────── -->
<qa_pair>
<question>
List all giving funds currently defined in Planning Center Giving.
Which fund has the lowest ID number (i.e., the fund that was created first)?
Provide the name of that fund exactly as it appears in Planning Center.
</question>
<answer>[FILL_IN]</answer>
</qa_pair>
<qa_pair>
<question>
Retrieve all donation batches recorded in Planning Center Giving.
Find the batch whose description or commit date indicates it was committed
(or created) earliest — i.e., the oldest batch in the system.
What is the description (name) of that batch?
If no description is available, provide the batch's ID.
</question>
<answer>[FILL_IN]</answer>
</qa_pair>
<!-- ── MODULE: Groups ─────────────────────────────────────────────────────── -->
<qa_pair>
<question>
List all group types defined in Planning Center Groups. Among those group types,
find the one whose name comes last alphabetically (Z-A). What is the name of
that group type?
</question>
<answer>[FILL_IN]</answer>
</qa_pair>
<!-- ── MODULE: Calendar ───────────────────────────────────────────────────── -->
<qa_pair>
<question>
Retrieve the list of approved calendar events in Planning Center Calendar.
Find the event whose name comes first alphabetically (A-Z) among all
approved events. What is the exact name of that event?
</question>
<answer>[FILL_IN]</answer>
</qa_pair>
</evaluation>
