femtech-radar
by ChanMeng666
README.md
<!-- AGENT-FIRST NOTICE -->
> [!IMPORTANT]
> ### π€ Read this with your AI agent β don't read it by hand.
> This repo is written agent-first. Point Claude Code, GitHub Copilot, Cursor, or any agent at it:
> *"Read the README and AGENTS.md, then help me run / extend this."*
> Structure + [`AGENTS.md`](AGENTS.md) are optimized for agent comprehension.
<!-- /AGENT-FIRST NOTICE -->
<div align="center"><a name="readme-top"></a>
<a href="https://femtech-weekend.com" target="_blank">
<img src="./.github/brand/femtech-weekend-logo.svg" alt="FemTech Weekend" width="200" />
</a>
# π femtech-radar
### FemTech intelligence as a GitHub-native, agent-driven pipeline
<sub>A project of <a href="https://femtech-weekend.com"><strong>FemTech Weekend</strong></a> β the live site shares the org's brand identity.</sub>
Agent-first FemTech intelligence: an MCP server that fetches, dedupes, and scores women's-health & FemTech research and industry news, designed to feed GitHub Agentic Workflows and an auto-updating Astro + RSS site.
[Live Demo][demo-link] Β· [Documentation][docs-link] Β· [Changelog](CHANGELOG.md) Β· [Report Bug](https://github.com/ChanMeng666/femtech-radar/issues) Β· [Request Feature](https://github.com/ChanMeng666/femtech-radar/issues)
<!-- SHIELD GROUP -->
[](LICENSE)
[](https://github.com/ChanMeng666/femtech-radar/actions)
[](https://github.com/ChanMeng666/femtech-radar/graphs/contributors)
[](https://github.com/ChanMeng666/femtech-radar/network/members)
[](https://github.com/ChanMeng666/femtech-radar/stargazers)
[](https://github.com/ChanMeng666/femtech-radar/issues)
[](https://github.com/sponsors/ChanMeng666)
<!-- Tech stack badges β replace with your real stack:


-->
</div>
<details>
<summary><kbd>π Table of Contents</kbd></summary>
- [π Introduction](#-introduction)
- [β¨ Key Features](#-key-features)
- [π οΈ Tech Stack](#-tech-stack)
- [ποΈ Architecture](#-architecture)
- [π Getting Started](#-getting-started)
- [π³ Project Status & Roadmap](#-project-status--roadmap)
- [π Usage Guide](#-usage-guide)
- [β¨οΈ Development](#-development)
- [π€ Contributing](#-contributing)
- [β€οΈ Sponsor](#-sponsor)
- [π License](#-license)
- [πββοΈ Author](#-author)
</details>
## π Introduction
The FemTech and women's-health world produces a scattered firehose of signal β research preprints, funding and product news, community opportunities, technical discussion β across dozens of sources. **femtech-radar** turns that noise into a curated, deduplicated, ranked digest, using only GitHub-native primitives plus a reusable [Model Context Protocol (MCP)](https://modelcontextprotocol.io) server.
It's a complete, live **three-unit pipeline** β `scrape β curate β publish`:
1. an **MCP server** (the deterministic "brain") fetches from multiple sources, normalizes into one shape, dedupes, and scores each item by **relevance Γ popularity Γ freshness**, exposing the result over MCP;
2. a weekly [GitHub Agentic Workflow (`gh aw`)](https://github.github.com/gh-aw/) drives the MCP, lets Copilot curate the digest, and commits the week's `data/*.json` via a review-gated PR;
3. an **Astro + RSS site** reads that data and auto-deploys to GitHub Pages.
It's built for **FemTech / women-in-tech practitioners** who want signal without the noise β and as a reference implementation of the `gh aw Γ MCP Γ GitHub Pages` pattern. **The product is live:** a subscribable weekly intelligence site at **https://chanmeng666.github.io/femtech-radar/** that updates itself for free on a public GitHub repo.
## β¨ Key Features
`1` **One MCP tool, a whole radar** β `radar_collect` returns normalized, deduped, scored items per section. All five sections are live: **industry** (Google News), **research** (arXiv), **opportunities** (LinkedIn, with opt-in SerpAPI Google Jobs), **discussions** (Hacker News + Mastodon), and **china** β a China-focused "China Watch" lens on Chinese women's-health / FemTech + ζθθ΅ (funding) news (Google News δΈζ + 36ζ°ͺ + ζ°ζ΅ͺθ΄’η») plus China-scoped research (PubMed + ClinicalTrials.gov).
`2` **Deterministic, testable core** β `fetch β normalize β dedupe β score`. The server makes no editorial judgment; that's left to the agent that drives it. 46 unit tests, and **zero real network calls in tests** (all I/O is injected).
`3` **Pluggable source adapters** β each source is one file behind a uniform `Adapter` interface. Add a feed by writing a `collect()` that returns `RadarItem[]`.
`4` **Resilient by construction** β every source failure degrades to an empty result **plus a warning**; a malformed URL or date never throws out of a run.
`5` **GitHub-native, near-zero cost** β designed to run inside GitHub Actions on a **public** repo, where Actions and Pages are free; the only metered resource is a few Copilot credits per week.
`6` **Reusable anywhere MCP runs** β drop it into Claude Desktop or any MCP client; it isn't coupled to this project.
`7` **Live, self-updating, subscribable** β a weekly `gh aw` workflow curates the digest into a review-gated `data/*.json` PR, and an [Astro + RSS site](https://chanmeng666.github.io/femtech-radar/) rebuilds itself on GitHub Pages. Readers subscribe via the [full RSS feed](https://chanmeng666.github.io/femtech-radar/rss.xml) or per-section feeds at `/rss/<section>.xml` β no manual scraping, no server to run.
## π οΈ Tech Stack
- **Language / Runtime:** TypeScript 5 (strict, ESM) Β· Node.js β₯ 20
- **MCP:** [`@modelcontextprotocol/sdk`](https://github.com/modelcontextprotocol) (stdio server)
- **Parsing / validation:** [Zod](https://zod.dev) (schema & runtime validation) Β· [fast-xml-parser](https://github.com/NaturalIntelligence/fast-xml-parser) (Atom/RSS)
- **Tooling:** pnpm workspaces (monorepo) Β· [Vitest](https://vitest.dev) (tests) Β· [tsup](https://tsup.egoist.dev) (build)
- **Orchestration:** [GitHub Agentic Workflows (`gh aw`)](https://github.github.com/gh-aw/) Β· engine `copilot`, model `gpt-4.1` Β· weekly schedule β review-gated data PR
- **Site:** [Astro 5](https://astro.build) (`femtech-radar-site`) Β· [`@astrojs/rss`](https://docs.astro.build/en/recipes/rss/) Β· GitHub Pages deploy via `deploy-pages.yml`
- **Design:** vanilla CSS design system (`site/src/styles/global.css`) aligned to the **FemTech Weekend** brand β warm-brown editorial palette, Georgia serif + system sans, sharp corners, light mode only. Full reference: [`docs/design-system.md`](docs/design-system.md)
- **Built on:** the `opportunities` adapter ports LinkedIn guest-endpoint logic from the owner's `linkedin-jobs-search` project (inspired by `linkedin-jobs-api`); the opt-in SerpAPI Google Jobs path is ported from `server-google-jobs`
## ποΈ Architecture
<details>
<summary><kbd>System overview</kbd></summary>
```mermaid
graph TD
subgraph Sources
A1[arXiv API]
A2[Google News RSS<br/>+ δΈζ]
A3[LinkedIn Jobs]
A4[Hacker News + Mastodon]
A5[36ζ°ͺ Β· ζ°ζ΅ͺθ΄’η»]
A6[PubMed Β· ClinicalTrials.gov]
end
A1 --> AD[Source adapters<br/>normalize β RadarItem]
A2 --> AD
A3 --> AD
A4 --> AD
A5 --> AD
A6 --> AD
AD --> P["collect()<br/>dedupe β score β sort β since-filter"]
P --> T[MCP tools<br/>radar_collect Β· radar_sources]
T --> C[MCP clients]
C --> W[Weekly gh aw workflow<br/>Copilot curates Β· writes why_it_matters]
W --> D[(data/YYYY-Www.json<br/>review-gated PR)]
D --> S[Astro + RSS site<br/>GitHub Pages Β· live]
```
All three units are built and live; all five source sections are active.
</details>
**Separation of determinism vs judgment:** the MCP server does only deterministic work (fetch, normalize, dedupe, score). Editorial choices β which items to feature, how to summarize β belong to the agent (`gh aw` + Copilot) that drives it. This keeps the core unit-testable and reusable.
## π Getting Started
### Prerequisites
- **Node.js β₯ 20** (the server uses global `fetch`)
- **pnpm β₯ 9** (`npm i -g pnpm`)
- _(optional)_ an MCP client such as Claude Desktop, or the `gh aw` CLI
### Installation
```bash
git clone https://github.com/ChanMeng666/femtech-radar.git
cd femtech-radar
pnpm install
# Build the MCP server
pnpm --filter @chanmeng666/femtech-radar-mcp build
# Run the test suite (46 tests)
pnpm --filter @chanmeng666/femtech-radar-mcp test
```
The built server is an executable stdio MCP server at `packages/mcp-server/dist/index.js`. It's also published to npm, so any MCP client can run it with `npx -y @chanmeng666/femtech-radar-mcp`.
### Run the site locally
```bash
# Dev server (reads data/*.json)
pnpm --filter femtech-radar-site dev
# Production build + preview
pnpm --filter femtech-radar-site build
pnpm --filter femtech-radar-site preview
```
The published site is live at **https://chanmeng666.github.io/femtech-radar/** (RSS: `/rss.xml`); it rebuilds automatically whenever a new weekly `data/*.json` lands on `master`.
## π³ Project Status & Roadmap
All three planned layers are built and live in production (see [`docs/superpowers/specs`](docs/superpowers/specs) for the full design and [`docs/superpowers/plans`](docs/superpowers/plans) for the per-unit implementation plans):
- β
**v1 β MCP server**: industry (Google News) + research (arXiv) adapters, dedupe/score pipeline, `radar_collect` / `radar_sources` tools, resilient error handling, 46 tests. Published to npm as `@chanmeng666/femtech-radar-mcp`.
- β
**v2 β orchestration**: a weekly `gh aw` workflow (engine `copilot`, model `gpt-4.1`) that drives the MCP, curates a digest, and emits a review-gated data PR plus a summary issue β proven end-to-end in production (first digest: `data/2026-W27.json`).
- β
**v3 β publishing** *(live)*: Astro 5 site auto-deployed to GitHub Pages at https://chanmeng666.github.io/femtech-radar/ with a subscribable RSS feed at https://chanmeng666.github.io/femtech-radar/rss.xml; rebuilds automatically on every weekly data update.
- β
**vNext β 4-section pipeline**: `opportunities` (LinkedIn, with opt-in SerpAPI Google Jobs) and `discussions` (Hacker News + Mastodon) adapters now active; per-section RSS feeds at `/rss/<section>.xml`; site polish (favicon, numeric-entity decode, sources chip); weekly workflow updated to collect all four sections.
- β
**China Watch β 5th section** *(npm `0.4.1`)*: a China-focused `china` section merging Chinese women's-health / ζθθ΅ news (**Google News δΈζ** + **36ζ°ͺ** + **ζ°ζ΅ͺθ΄’η»**) and China-scoped research (**PubMed** + **ClinicalTrials.gov**); Chinese titles with English `why_it_matters`. Live on the site as `05 Β· CHINA` with a `/rss/china.xml` feed. Includes a CJK-aware dedupe fix and a women's-health-specific filter for the general Chinese feeds. Structured funding-round data (paid databases) is intentionally out of scope. See [`docs/operations.md`](docs/operations.md).
**Deferred to a future version:** ChatOps slash commands (`/deep-dive`), full bilingual support (i18n routing is reserved), a newsletter, `femtech-weekend.com` domain integration, and a structured funding-round database.
## π Usage Guide
femtech-radar is consumed as an **MCP server**. It exposes two tools:
| Tool | Parameters | Returns |
|------|------------|---------|
| `radar_collect` | `section` (`"industry"` \| `"research"` \| `"opportunities"` \| `"discussions"` \| `"china"`), optional `since` (ISO date, default 7 days ago), optional `limit` (default 15) | `{ items: RadarItem[], warnings: string[] }` β deduped, scored, sorted, date-filtered |
| `radar_sources` | _none_ | the configured source list per section |
> All five sections are live. `industry` (Google News) and `research` (arXiv) require no API key. `opportunities` uses LinkedIn by default (opt-in SerpAPI Google Jobs when `SERP_API_KEY` is set). `discussions` merges Hacker News Algolia + Mastodon hashtag timelines (both free, no key). `china` merges Google News δΈζ + 36ζ°ͺ + ζ°ζ΅ͺθ΄’η» (Chinese women's-health / ζθθ΅ news, keyword-filtered) + PubMed + ClinicalTrials.gov (China-scoped research) β all free, no key. Every source degrades gracefully to `[]` if unavailable.
**Subscribe via RSS:** the weekly digest is published at [`https://chanmeng666.github.io/femtech-radar/rss.xml`](https://chanmeng666.github.io/femtech-radar/rss.xml) and works in any feed reader.
### Use with GitHub Agentic Workflows (`gh aw`)
```yaml
mcp-servers:
femtech-radar:
command: npx
args: ["-y", "@chanmeng666/femtech-radar-mcp"]
```
### Use with Claude Desktop
```json
{
"mcpServers": {
"femtech-radar": {
"command": "node",
"args": ["/absolute/path/to/femtech-radar/packages/mcp-server/dist/index.js"]
}
}
}
```
> The package is published to npm, so `npx -y @chanmeng666/femtech-radar-mcp` works out of the box (current version `0.4.1`). The local `dist/index.js` path above is an alternative for development.
See [`packages/mcp-server/README.md`](packages/mcp-server/README.md) for the full tool reference.
## β¨οΈ Development
```bash
pnpm install # install workspace deps
pnpm --filter @chanmeng666/femtech-radar-mcp test # run tests (Vitest)
pnpm --filter @chanmeng666/femtech-radar-mcp build # build with tsup
```
**Project layout**
```
packages/mcp-server/src/
βββ schema.ts # Zod RadarItem / WeeklyData (the shared data contract)
βββ dedup.ts # URL canonicalization + title-similarity dedupe
βββ score.ts # relevance Γ popularity Γ freshness scoring
βββ adapters/ # one file per section (industry = Google News, research = arXiv, opportunities = LinkedIn/SerpAPI, discussions = HN + Mastodon, china = Google News δΈζ + 36ζ°ͺ + Sina + PubMed + ClinicalTrials)
βββ collect.ts # orchestration: adapter β dedupe β score β sort β since-filter
βββ tools.ts # radar_collect / radar_sources handlers
βββ index.ts # stdio MCP server entry
```
**Adding a source adapter:** implement the `Adapter` interface in `adapters/`, return `RadarItem[]` from `collect(opts)` using the injected `fetcher` (never call `fetch` directly β that keeps it testable), then wire it into `ADAPTERS` in `collect.ts`.
See [`AGENTS.md`](AGENTS.md) for AI-agent-oriented project conventions and gotchas, and
[`docs/operations.md`](docs/operations.md) for the operational runbook (weekly workflow, Copilot
credits/quota, engine choices, npm publish, and manual data seeding).
## π€ Contributing
Contributions make the open-source community an amazing place to learn and create. Please read the
[Contributing Guide](CONTRIBUTING.md) and the [Code of Conduct](CODE_OF_CONDUCT.md) before you start,
and use the provided issue / pull-request templates.
## β€οΈ Sponsor
If this project helps you, please consider supporting its development:
[](https://github.com/sponsors/ChanMeng666)
[](https://buymeacoffee.com/chanmeng66u)
For questions and help, see [SUPPORT.md](SUPPORT.md). For security issues, see [SECURITY.md](SECURITY.md).
## π License
This project is released under the [MIT](LICENSE) license.
## πββοΈ Author
**Chan Meng**
[](mailto:chanmeng.dev@gmail.com)
[](https://github.com/ChanMeng666)
<div align="right">
[](#readme-top)
</div>
<!-- Link definitions -->
[demo-link]: https://chanmeng666.github.io/femtech-radar/
[docs-link]: ./packages/mcp-server/README.md
---
<!-- CHAN MENG PERSONAL BRAND -->
<div align="center">
<a href="https://github.com/ChanMeng666" target="_blank">
<img src="./.github/brand/chan-meng-logo.svg" alt="Chan Meng" width="160" />
</a>
<p><strong>Chan Meng</strong><br/>Need a custom app like this one? I build them β let's talk.</p>
<a href="mailto:chanmeng.dev@gmail.com"><img src="https://img.shields.io/badge/Email-chanmeng.dev@gmail.com-EA4335?style=flat-square&logo=gmail&logoColor=white" alt="Email Chan Meng"/></a>
<a href="https://github.com/ChanMeng666"><img src="https://img.shields.io/badge/GitHub-ChanMeng666-181717?style=flat-square&logo=github&logoColor=white" alt="Chan Meng on GitHub"/></a>
</div>
<!-- /CHAN MENG PERSONAL BRAND -->
This server cannot be deployed
Maintenance
ActivityInactive
ResponsivenessResponsive