# Plugin Feasibility & Feature Matrix
This document provides a comprehensive comparison of all proposed plugins to help
prioritize implementation efforts.
## Executive Summary
```
┌─────────────────────────────────────────────────────────────────────────────────┐
│ PLUGIN PRIORITY RECOMMENDATION │
├─────────────────────────────────────────────────────────────────────────────────┤
│ │
│ PHASE 1 (Build Now) PHASE 2 (Consider) PHASE 3 (If Demanded) │
│ ────────────────── ───────────────── ──────────────────── │
│ ┌─────────────────┐ ┌─────────────────┐ ┌─────────────────┐ │
│ │ azure │ │ cloudflare │ │ vercel │ │
│ │ (telemetry) │ │ (telemetry) │ │ (helpers) │ │
│ │ Score: 92/100 │ │ Score: 75/100 │ │ Score: 55/100 │ │
│ └─────────────────┘ └─────────────────┘ └─────────────────┘ │
│ │
│ ┌─────────────────┐ │
│ │ cloudflare-ai │ │
│ │ (models) │ │
│ │ Score: 88/100 │ │
│ └─────────────────┘ │
│ │
│ ┌─────────────────┐ │
│ │ observability │ ← NEW │
│ │ (3rd party) │ │
│ │ Score: 89/100 │ │
│ └─────────────────┘ │
│ │
└─────────────────────────────────────────────────────────────────────────────────┘
```
---
## Part 1: Model/AI Plugins
### Feature Comparison
| Feature | aws-bedrock ❶ | google-genai ❶ | msfoundry ❶ | cloudflare-ai ❷ |
|---------|---------------|----------------|-------------|-----------------|
| **Text Generation** | ✅ | ✅ | ✅ | ✅ |
| **Streaming (SSE)** | ✅ | ✅ | ✅ | ✅ |
| **Tool/Function Calling** | ✅ | ✅ | ✅ | ✅ (Llama 3+) |
| **Embeddings** | ✅ | ✅ | ✅ | ✅ (BGE) |
| **Image Generation** | ✅ (Nova) | ✅ (Imagen) | ✅ (DALL-E) | ✅ (Flux, SD) |
| **Image Understanding** | ✅ | ✅ | ✅ | ✅ (Llama 4) |
| **Speech-to-Text** | ✅ | ✅ | ✅ (Whisper) | ✅ (Whisper) |
| **Text-to-Speech** | ✅ | ✅ | ✅ | ❌ |
| **Video Generation** | ❌ | ✅ (Veo) | ❌ | ❌ |
| **Audio Generation** | ❌ | ✅ (Lyria) | ❌ | ❌ |
❶ = Already implemented
❷ = Proposed
### Model Availability
| Provider | Models | Notable Models |
|----------|--------|----------------|
| **AWS Bedrock** | 20+ | Claude 3.5, Llama 3, Nova, Titan |
| **Google GenAI** | 10+ | Gemini 2, Imagen, Veo, Lyria |
| **MS Foundry** | 11,000+ | GPT-4o, Claude, Llama, Mistral |
| **Cloudflare AI** | 50+ | Llama 4, Mistral, Flux, Whisper |
| **Vercel AI Gateway** | Pass-through | Any via OpenAI/Anthropic API |
### Implementation Complexity
| Plugin | API Type | Auth | SDK | Complexity |
|--------|----------|------|-----|------------|
| **aws-bedrock** ❶ | Converse API | IAM/Keys | boto3 | Medium |
| **google-genai** ❶ | REST/gRPC | API Key/ADC | google-genai | Medium |
| **msfoundry** ❶ | OpenAI-compat | API Key | openai | Low |
| **cloudflare-ai** ❷ | REST | API Token | httpx | Low-Medium |
### Cloudflare AI Feasibility Score
| Factor | Score | Notes |
|--------|-------|-------|
| **API Documentation** | 9/10 | Excellent, clear examples |
| **Python Support** | 7/10 | REST API, no official SDK |
| **Model Variety** | 9/10 | 50+ models across categories |
| **Streaming Support** | 9/10 | Native SSE for all LLMs |
| **Tool Calling** | 8/10 | Supported on Llama 3+ |
| **Community Demand** | 7/10 | Growing edge AI market |
| **Maintenance Burden** | 8/10 | Simple REST, few breaking changes |
| **Strategic Value** | 9/10 | Edge computing differentiator |
| **TOTAL** | **88/100** | ✅ **BUILD** |
---
## Part 2: Telemetry Plugins
### Architecture Overview
```
┌─────────────────────────────────────────────────────────────────────────────────┐
│ TELEMETRY PLUGIN ARCHITECTURE │
├─────────────────────────────────────────────────────────────────────────────────┤
│ │
│ NATIVE PLATFORM BACKENDS THIRD-PARTY BACKENDS │
│ ──────────────────────── ──────────────────── │
│ │
│ ┌─────────┐ ┌─────────┐ ┌─────────────────────────┐ │
│ │ aws │ │ google- │ │ observability │ │
│ │ │ │ cloud │ │ │ │
│ │ • SigV4 │ │ • ADC │ │ • Sentry │ │
│ │ • X-Ray │ │ • Trace │ │ • Honeycomb │ │
│ │ • CW │ │ • Logs │ │ • Datadog │ │
│ └────┬────┘ └────┬────┘ │ • Grafana │ │
│ │ │ │ • Axiom │ │
│ ▼ ▼ │ • Custom OTLP │ │
│ ┌─────────┐ ┌─────────┐ └───────────┬─────────────┘ │
│ │ X-Ray │ │ Cloud │ │ │
│ │ Console │ │ Trace │ ▼ │
│ └─────────┘ └─────────┘ ┌─────────────────────────┐ │
│ │ Any OTLP Backend │ │
│ ┌─────────┐ │ (Sentry, Honeycomb, │ │
│ │ azure │ │ Datadog, etc.) │ │
│ │ │ └─────────────────────────┘ │
│ │ • Distro│ │
│ │ • Live │ CAN'T BE REPLICATED CAN BE REPLICATED │
│ │ • Map │ WITH GENERIC OTLP WITH GENERIC OTLP │
│ └────┬────┘ │
│ │ │
│ ▼ │
│ ┌─────────┐ │
│ │ App │ │
│ │Insights │ │
│ └─────────┘ │
│ │
└─────────────────────────────────────────────────────────────────────────────────┘
```
### When to Use What
```
┌─────────────────────────────────────────────────────────────────────────────────┐
│ TELEMETRY PLUGIN DECISION GUIDE │
├─────────────────────────────────────────────────────────────────────────────────┤
│ │
│ "I'm on AWS and want X-Ray" → aws plugin (SigV4, X-Ray format) │
│ "I'm on GCP and want Cloud Trace" → google-cloud plugin (ADC) │
│ "I'm on Azure and want App Insights" → azure plugin (Live Metrics, Map) │
│ │
│ "I'm on AWS but want Honeycomb" → observability plugin (just OTLP) │
│ "I'm on GCP but want Sentry" → observability plugin (just OTLP) │
│ "I'm multi-cloud, want Datadog" → observability plugin (just OTLP) │
│ "I don't care, just give me traces" → observability plugin (just OTLP) │
│ │
└─────────────────────────────────────────────────────────────────────────────────┘
```
### Feature Comparison
| Feature | aws ❶ | google-cloud ❶ | azure ❷ | observability ❷ | cloudflare ❷ | vercel ❷ |
|---------|-------|----------------|---------|-----------------|--------------|----------|
| **Distributed Tracing** | ✅ X-Ray | ✅ Cloud Trace | ✅ App Insights | ✅ Any OTLP | ⚠️ 3rd party | ⚠️ 3rd party |
| **Structured Logging** | ✅ CloudWatch | ✅ Cloud Logging | ✅ App Insights | ⚠️ Via backend | ✅ Logpush | ⚠️ 3rd party |
| **Metrics** | ✅ CloudWatch | ✅ Cloud Monitoring | ✅ App Insights | ⚠️ Via backend | ⚠️ Workers Analytics | ⚠️ 3rd party |
| **Live Metrics** | ❌ | ❌ | ✅ Built-in | ❌ | ❌ | ❌ |
| **Application Map** | ❌ | ❌ | ✅ Built-in | ❌ | ❌ | ❌ |
| **Log-Trace Correlation** | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ |
| **Auto-Instrumentation** | ⚠️ Manual | ⚠️ Manual | ✅ Distro | ⚠️ Manual | ⚠️ AI Gateway | ⚠️ Manual |
| **Sentry Support** | ✅ OTLP | ✅ OTLP | ✅ OTLP | ✅ Native | ✅ Native | ✅ OTLP |
| **Honeycomb Support** | ✅ OTLP | ✅ OTLP | ✅ OTLP | ✅ Native | ✅ Native | ✅ OTLP |
| **Datadog Support** | ✅ OTLP | ✅ OTLP | ✅ OTLP | ✅ Native | ✅ Native | ✅ OTLP |
❶ = Already implemented
❷ = Proposed
### Third-Party Backend Support
| Backend | aws | google-cloud | azure | cloudflare | vercel |
|---------|-----|--------------|-------|------------|--------|
| **Sentry** | ✅ OTLP | ✅ OTLP | ✅ OTLP | ✅ Native | ✅ OTLP |
| **Honeycomb** | ✅ OTLP | ✅ OTLP | ✅ OTLP | ✅ Native | ✅ OTLP |
| **Datadog** | ✅ OTLP | ✅ OTLP | ✅ OTLP | ✅ Native | ✅ OTLP |
| **Grafana Cloud** | ✅ OTLP | ✅ OTLP | ✅ OTLP | ✅ Native | ✅ OTLP |
| **Axiom** | ✅ OTLP | ✅ OTLP | ✅ OTLP | ✅ Native | ✅ OTLP |
### Implementation Approach
| Plugin | Approach | SDK | Setup Complexity |
|--------|----------|-----|------------------|
| **aws** ❶ | Custom OTLP + SigV4 | opentelemetry-* | Medium |
| **google-cloud** ❶ | Custom OTLP | opentelemetry-* | Medium |
| **azure** ❷ | Official Distro | azure-monitor-opentelemetry | **Very Low** |
| **cloudflare** ❷ | Presets for 3rd party | opentelemetry-* | Low |
| **vercel** ❷ | Standard OTLP | opentelemetry-* | Low |
### Azure Telemetry Feasibility Score
| Factor | Score | Notes |
|--------|-------|-------|
| **API Documentation** | 10/10 | Microsoft official docs |
| **Python Support** | 10/10 | Official SDK with distro |
| **Setup Simplicity** | 10/10 | One-liner `configure_azure_monitor()` |
| **Feature Richness** | 9/10 | Live Metrics, App Map included |
| **Community Demand** | 9/10 | Enterprise Azure users |
| **Maintenance Burden** | 9/10 | Microsoft maintains SDK |
| **Strategic Value** | 9/10 | Pairs with msfoundry plugin |
| **TOTAL** | **92/100** | ✅ **BUILD NOW** |
### Cloudflare Telemetry Feasibility Score
| Factor | Score | Notes |
|--------|-------|-------|
| **API Documentation** | 8/10 | Good Workers OTEL docs |
| **Python Support** | 6/10 | REST API, standard OTEL |
| **Setup Simplicity** | 7/10 | Dashboard config + code |
| **Feature Richness** | 8/10 | AI Gateway auto-traces |
| **Community Demand** | 7/10 | Growing edge users |
| **Maintenance Burden** | 8/10 | Standard OTEL patterns |
| **Strategic Value** | 8/10 | Pairs with cloudflare-ai |
| **TOTAL** | **75/100** | ⚠️ **CONSIDER** |
### Observability Plugin Feasibility Score
| Factor | Score | Notes |
|--------|-------|-------|
| **API Documentation** | 9/10 | Standard OTLP, well-documented |
| **Python Support** | 10/10 | Official opentelemetry-python |
| **Setup Simplicity** | 9/10 | One function call with preset |
| **Feature Coverage** | 8/10 | Traces + basic metrics |
| **Community Demand** | 9/10 | Common request for 3rd party |
| **Maintenance Burden** | 9/10 | Stable OTLP protocol |
| **Strategic Value** | 8/10 | Platform-agnostic option |
| **TOTAL** | **89/100** | ✅ **BUILD** |
### Vercel Telemetry Feasibility Score
| Factor | Score | Notes |
|--------|-------|-------|
| **API Documentation** | 6/10 | Node.js focused |
| **Python Support** | 5/10 | No Vercel-specific SDK |
| **Setup Simplicity** | 7/10 | Standard OTEL works |
| **Feature Richness** | 5/10 | No unique features |
| **Community Demand** | 6/10 | Python on Vercel growing |
| **Maintenance Burden** | 8/10 | Standard OTEL patterns |
| **Strategic Value** | 5/10 | No Vercel AI plugin needed |
| **TOTAL** | **55/100** | ⚠️ **IF DEMANDED** |
---
## Part 3: Effort vs Impact Matrix
```
IMPACT
Low High
┌───────────┬───────────┐
Low │ │ azure │ ← Quick wins
│ vercel │cloudflare │
EFFORT │ │ (both) │
├───────────┼───────────┤
High │ │ │
│ │ │
│ │ │
└───────────┴───────────┘
```
### Effort Estimates
| Plugin | Estimated Days | Dependencies |
|--------|---------------|--------------|
| **azure** | 5-7 days | azure-monitor-opentelemetry (official) |
| **observability** | 5-7 days | opentelemetry-* |
| **cloudflare-ai** | 10-15 days | httpx, pydantic |
| **cloudflare** (telemetry) | 5-7 days | opentelemetry-* |
| **vercel** | 3-5 days | opentelemetry-* |
### Impact Factors
| Plugin | New Users | Ecosystem Fit | Differentiation |
|--------|-----------|---------------|-----------------|
| **azure** | High (enterprise) | Pairs with msfoundry | Good |
| **cloudflare-ai** | Medium (edge) | New market | High |
| **cloudflare** | Medium | Pairs with cloudflare-ai | Medium |
| **vercel** | Low | Standalone | Low |
---
## Part 4: Dependencies & Risk Analysis
### External Dependencies
| Plugin | Key Dependencies | Risk Level |
|--------|-----------------|------------|
| **azure** | azure-monitor-opentelemetry | ✅ Low (Microsoft maintained) |
| **cloudflare-ai** | httpx | ✅ Low (stable library) |
| **cloudflare** | opentelemetry-* | ✅ Low (CNCF standard) |
| **vercel** | opentelemetry-* | ✅ Low (CNCF standard) |
### API Stability Risk
| Plugin | API Stability | Breaking Change Risk |
|--------|--------------|---------------------|
| **azure** | ✅ Stable | Low - versioned SDK |
| **cloudflare-ai** | ⚠️ Evolving | Medium - new models added |
| **cloudflare** | ✅ Stable | Low - standard OTEL |
| **vercel** | ✅ Stable | Low - standard OTEL |
### Maintenance Burden
| Plugin | Ongoing Maintenance | Reason |
|--------|-------------------|--------|
| **azure** | Low | Microsoft maintains SDK |
| **cloudflare-ai** | Medium | New models, config updates |
| **cloudflare** | Low | Standard OTEL patterns |
| **vercel** | Very Low | Just URL helpers |
---
## Part 5: Final Recommendations
### Priority Order
| Priority | Plugin | Score | Action | Timeline |
|----------|--------|-------|--------|----------|
| **1** | azure (telemetry) | 92/100 | ✅ Build Now | 1 week |
| **2** | observability (3rd party) | 89/100 | ✅ Build Now | 1 week |
| **3** | cloudflare-ai (models) | 88/100 | ✅ Build Now | 2-3 weeks |
| **4** | cloudflare (telemetry) | 75/100 | ⚠️ Consider | 1 week |
| **5** | vercel (helpers) | 55/100 | ⚠️ If Demanded | 3-5 days |
### Rationale
**1. Azure Telemetry (Priority 1)**
- Official Microsoft SDK with one-liner setup
- Pairs naturally with existing `msfoundry` plugin
- High enterprise demand
- Very low implementation effort
**2. Observability Plugin (Priority 2)**
- Platform-agnostic third-party backend support
- One plugin for Sentry, Honeycomb, Datadog, Grafana, Axiom
- Common user request
- Uses stable OTLP protocol
**3. Cloudflare AI (Priority 3)**
- Growing edge AI market
- 50+ models including latest Llama 4
- Clear REST API
- Differentiates Genkit in edge computing space
**4. Cloudflare Telemetry (Priority 4)**
- Pairs with cloudflare-ai plugin
- Good third-party backend support (via observability plugin)
- AI Gateway auto-traces are valuable
- Lower priority since observability plugin covers 3rd party
**5. Vercel (Priority 5)**
- Python works on Vercel, but no unique features
- AI Gateway = just URL change
- Standard OTEL works fine
- Build only if users explicitly request
### What NOT to Build
| Plugin | Reason |
|--------|--------|
| Vercel AI SDK wrapper | JS/TS only, use existing plugins |
| Vercel OTEL package | Node.js only, standard OTEL works |
| Generic OTEL presets | Too generic, not Genkit-specific value |
---
## Appendix: Complete Feature Matrix
### AI/Model Capabilities
```
┌─────────────────────────────────────────────────────────────────────────────────┐
│ AI/MODEL FEATURE MATRIX │
├──────────────────────┬─────────┬──────────┬─────────┬─────────────┬────────────┤
│ Feature │ AWS │ Google │ Azure │ Cloudflare │ Vercel │
│ │ Bedrock │ GenAI │ Foundry │ Workers AI │ AI Gateway │
├──────────────────────┼─────────┼──────────┼─────────┼─────────────┼────────────┤
│ Text Generation │ ✅ │ ✅ │ ✅ │ ✅ │ ✅ proxy │
│ Streaming │ ✅ │ ✅ │ ✅ │ ✅ │ ✅ proxy │
│ Tool Calling │ ✅ │ ✅ │ ✅ │ ✅ │ ✅ proxy │
│ Structured Output │ ✅ │ ✅ │ ✅ │ ⚠️ partial │ ✅ proxy │
│ Embeddings │ ✅ │ ✅ │ ✅ │ ✅ │ ❌ │
│ Image Generation │ ✅ │ ✅ │ ✅ │ ✅ │ ❌ │
│ Image Understanding │ ✅ │ ✅ │ ✅ │ ✅ │ ✅ proxy │
│ Speech-to-Text │ ✅ │ ✅ │ ✅ │ ✅ │ ❌ │
│ Text-to-Speech │ ✅ │ ✅ │ ✅ │ ❌ │ ❌ │
│ Video Generation │ ❌ │ ✅ │ ❌ │ ❌ │ ❌ │
│ Audio Generation │ ❌ │ ✅ │ ❌ │ ❌ │ ❌ │
├──────────────────────┼─────────┼──────────┼─────────┼─────────────┼────────────┤
│ Python SDK │ ✅ boto3│ ✅ google│ ✅ openai│ ❌ REST │ ✅ openai │
│ Auth Method │ IAM/Key │ Key/ADC │ API Key │ API Token │ API Key │
│ Regional │ ✅ │ ✅ │ ✅ │ ❌ Global │ ❌ Global │
├──────────────────────┼─────────┼──────────┼─────────┼─────────────┼────────────┤
│ STATUS │ ✅ DONE │ ✅ DONE │ ✅ DONE │ 📋 PLANNED │ ❌ SKIP │
└──────────────────────┴─────────┴──────────┴─────────┴─────────────┴────────────┘
```
### Telemetry Capabilities
```
┌──────────────────────────────────────────────────────────────────────────────────────────────┐
│ TELEMETRY FEATURE MATRIX │
├──────────────────────┬─────────┬──────────┬─────────┬─────────────┬─────────────┬───────────┤
│ Feature │ AWS │ GCP │ Azure │ observ. │ Cloudflare │ Vercel │
├──────────────────────┼─────────┼──────────┼─────────┼─────────────┼─────────────┼───────────┤
│ Native Trace Backend │ ✅ X-Ray│ ✅ Trace │ ✅ Insght│ ❌ (3rd pty)│ ❌ (3rd pty)│ ❌ (3rd) │
│ Distributed Tracing │ ✅ │ ✅ │ ✅ │ ✅ any OTLP │ ✅ export │ ✅ export │
│ Structured Logging │ ✅ │ ✅ │ ✅ │ ⚠️ backend │ ✅ Logpush │ ⚠️ backend│
│ Metrics │ ✅ │ ✅ │ ✅ │ ⚠️ backend │ ⚠️ basic │ ❌ │
│ Live Metrics │ ❌ │ ❌ │ ✅ │ ❌ │ ❌ │ ❌ │
│ Application Map │ ❌ │ ❌ │ ✅ │ ❌ │ ❌ │ ❌ │
│ Log-Trace Correlation│ ✅ │ ✅ │ ✅ │ ✅ │ ✅ │ ✅ │
│ Auto-Instrumentation │ ⚠️ │ ⚠️ │ ✅ │ ⚠️ manual │ ⚠️ AI only │ ❌ │
├──────────────────────┼─────────┼──────────┼─────────┼─────────────┼─────────────┼───────────┤
│ Sentry Export │ ✅ OTLP │ ✅ OTLP │ ✅ OTLP │ ✅ PRESET │ ✅ Native │ ✅ OTLP │
│ Honeycomb Export │ ✅ OTLP │ ✅ OTLP │ ✅ OTLP │ ✅ PRESET │ ✅ Native │ ✅ OTLP │
│ Datadog Export │ ✅ OTLP │ ✅ OTLP │ ✅ OTLP │ ✅ PRESET │ ✅ Native │ ✅ OTLP │
│ Grafana Export │ ✅ OTLP │ ✅ OTLP │ ✅ OTLP │ ✅ PRESET │ ✅ Native │ ✅ OTLP │
│ Axiom Export │ ✅ OTLP │ ✅ OTLP │ ✅ OTLP │ ✅ PRESET │ ✅ Native │ ✅ OTLP │
├──────────────────────┼─────────┼──────────┼─────────┼─────────────┼─────────────┼───────────┤
│ Official Python SDK │ ❌ manual│ ❌ manual│ ✅ distro│ ✅ OTEL │ ❌ REST │ ❌ manual │
│ Setup Complexity │ Medium │ Medium │ Very Low│ Very Low │ Low │ Low │
├──────────────────────┼─────────┼──────────┼─────────┼─────────────┼─────────────┼───────────┤
│ STATUS │ ✅ DONE │ ✅ DONE │ 📋 PLAN │ 📋 PLAN │ 📋 CONSIDER │ ⚠️ DEFER │
└──────────────────────┴─────────┴──────────┴─────────┴─────────────┴─────────────┴───────────┘
```
---
## Decision: What to Attack
Based on this analysis:
### ✅ Build Now (Q1 2026)
1. **azure** - 92/100 score, 1 week effort, high enterprise value
2. **observability** - 89/100 score, 1 week effort, platform-agnostic 3rd party
3. **cloudflare-ai** - 88/100 score, 2-3 weeks effort, edge differentiator
### ⚠️ Consider (Q2 2026)
4. **cloudflare** (telemetry) - 75/100 score, pairs with cloudflare-ai
### ⏸️ Defer
5. **vercel** - 55/100 score, build only if explicitly requested