ingestWebsite

ingestWebsite

Extract and process website content recursively with depth control and path filtering to organize and retrieve data for AI knowledge management.

Instructions

Crawls and ingests content from a website recursively. Supports depth control and path filtering.

Input Schema

Name	Required	Description	Default
`ingestConfig`	Yes
`namespaceId`	No
`tenantId`	No

Input Schema (JSON Schema)

{
  "$schema": "http://json-schema.org/draft-07/schema#",
  "additionalProperties": false,
  "properties": {
    "ingestConfig": {
      "additionalProperties": false,
      "properties": {
        "chunkConfig": {
          "additionalProperties": false,
          "description": "Optional Chunk config. When not passed, default chunk config will be used.",
          "properties": {
            "chunkOverlap": {
              "type": "number"
            },
            "chunkSize": {
              "type": "number"
            }
          },
          "required": [
            "chunkSize",
            "chunkOverlap"
          ],
          "type": "object"
        },
        "config": {
          "additionalProperties": false,
          "properties": {
            "excludePaths": {
              "items": {
                "type": "string"
              },
              "type": "array"
            },
            "includePaths": {
              "items": {
                "type": "string"
              },
              "type": "array"
            },
            "maxDepth": {
              "type": "number"
            },
            "maxLinks": {
              "type": "number"
            },
            "metadata": {
              "additionalProperties": {
                "anyOf": [
                  {
                    "type": "string"
                  },
                  {
                    "items": {
                      "type": "string"
                    },
                    "type": "array"
                  }
                ]
              },
              "type": "object"
            },
            "url": {
              "type": "string"
            }
          },
          "required": [
            "url"
          ],
          "type": "object"
        },
        "source": {
          "const": "WEBSITE",
          "type": "string"
        }
      },
      "required": [
        "source",
        "config"
      ],
      "type": "object"
    },
    "namespaceId": {
      "type": "string"
    },
    "tenantId": {
      "type": "string"
    }
  },
  "required": [
    "ingestConfig"
  ],
  "type": "object"
}

SourceSync.ai MCP Server

Instructions

Input Schema

Input Schema (JSON Schema)

Other Tools from SourceSync.ai MCP Server

Related Tools

MCP directory API