Skip to main content
Glama

kb-mcp-server

by Geeksfino
questionaire.prompt3.03 kB
You are an expert in information retrieval and question generation. I have provided you with a Markdown document below. Your task is to read and analyze the document carefully, then generate a set of 10 questions based on its content. These questions will be used to test an embeddings/graph-based search system (graph RAG) that processes the document. The system retrieves contexts from the document to answer queries, and I need to evaluate its performance in terms of relevance (returning accurate content), noise reduction (excluding irrelevant sections), precision (delivering focused answers), and completeness (covering key details). ### Instructions: 1. **Analyze the Document**: Identify key topics, concepts, relationships, and specific details within the document. 2. **Generate Diverse Questions**: Create 10 questions that vary in type and complexity, including: - **Factual Questions**: Test retrieval of specific details or definitions (e.g., "What is X?"). - **Relational Questions**: Test understanding of connections between concepts (e.g., "How does X relate to Y?"). - **Explanatory Questions**: Test causal or process explanations (e.g., "Why does X improve Y?" or "How does X work?"). - **Comparative Questions**: Test differentiation of related concepts (e.g., "What’s the difference between X and Y?"). - **Broad Questions**: Test completeness by requiring multiple aspects (e.g., "What are the main benefits of X?"). 3. **Ensure Testability**: Each question should: - Have clear, relevant answers in the document to assess precision and relevance. - Potentially retrieve related but irrelevant content to test noise reduction. - Require specific or connected details to evaluate completeness and graph traversal. 4. **Avoid Ambiguity**: Make questions specific enough to have a single correct focus but not so narrow that they limit retrieval variation. 5. **Reflect Document Structure**: Base questions on headers, sections, and key terms to align with Markdown parsing. ### Output Format: Provide the 10 questions in a numbered list, each prefixed with its type (e.g., "[Factual]", "[Relational]"). After each question, include a brief note (in parentheses) explaining what aspect of the search system it tests. ### Markdown Document: [Insert the full text of your Markdown document here] ### Example (for reference, do not include in output): If the document were about "Machine Learning": 1. [Factual] What is supervised learning? (Tests retrieval of a specific definition) 2. [Relational] How does supervised learning relate to unsupervised learning? (Tests concept connections) 3. [Explanatory] Why does feature scaling improve model performance? (Tests causal reasoning) 4. [Comparative] What’s the difference between linear regression and logistic regression? (Tests precision in distinguishing concepts) 5. [Broad] What are the main applications of neural networks? (Tests completeness across sections) Now, generate the 10 questions based on the provided document.

MCP directory API

We provide all the information about MCP servers via our MCP API.

curl -X GET 'https://glama.ai/api/mcp/v1/servers/Geeksfino/kb-mcp-server'

If you have feedback or need assistance with the MCP directory API, please join our Discord server