Supported Knowledge Connectors & Data Sources

MITHUNAI connectors continuously synchronize documents, codebases, and ticketing archives from your existing tools into partitioned pgvector collections without manual data export. Each connector tracks document versions, executes incremental delta updates, and applies automated secret redaction before text chunking and vector indexing.

Available Connectors

MITHUNAI provides native connectors across six enterprise data categories:

Code Repositories

GitHub & GitLab: Ingest source code, READMEs, Markdown documentation, and pull request discussions with branch filtering and file glob rules.

Documentation & Websites

Web Crawler & Sitemap Parser: Automated crawling of public documentation, developer portals, and marketing domains with same-origin fencing.

Workspace Knowledge Bases

Notion & Confluence: Enterprise OAuth integrations syncing spaces, pages, databases, and structured blocks with hierarchy preservation.

Cloud Object Storage

Google Drive & AWS S3: Real-time webhook and S3 event-driven synchronization for PDFs, Word (.docx) files, and technical whitepapers.

Support & Ticketing

Zendesk, Jira & Linear: Ingest resolved customer support tickets, help center articles, and bug tracker threads for agent deflection.

Team Communication

Slack & Discord: Index public technical support channels and knowledge-sharing threads with noise filtering and author attribution.

Code Repositories: GitHub & GitLab

Repository connectors allow MITHUNAI to answer technical implementation questions, explain API signatures, and cross-reference documentation against live code.

Configuration Parameters

Parameter	Type	Required	Description
`repository`	string	Yes	Fully qualified repository name (e.g., `acme/platform-core`).
`branch`	string	Yes	Target branch to index (e.g., `main`, `release/v2`).
`include_globs`	string[]	No	File matching patterns (e.g., `["docs/", "/.md", "src//.ts"]`).
`exclude_globs`	string[]	No	Exclusion patterns (e.g., `["/node_modules/", "*/.test.ts"]`).
`sync_on_push`	boolean	No	Automatically trigger delta re-indexing upon GitHub webhook push events (default: `true`).

Connect via API

curl -X POST https://app.mithunai.com/arukz/api/v1/knowledge/sources \
  -H "Authorization: Bearer $MITHUNAI_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{
    "collection_id": "col_prod_01",
    "type": "github",
    "name": "Platform Core Repo",
    "config": {
      "repository": "acme/platform-core",
      "branch": "main",
      "include_globs": ["docs/**/*.md", "api/**/*.py"]
    }
  }'

Web Crawling & Sitemap Connector

The sitemap and web crawler connector indexes public documentation portals, API reference catalogs, and developer guides.

Crawl Policy & Guardrails

Same-Origin Fencing: The crawler never follows hyperlinks pointing outside the declared domain or path prefix.
Canonical URL Deduplication: Pages declaring rel="canonical" pointing to another indexed document are automatically deduplicated.
Robots.txt Adherence: The crawler honors Disallow rules and crawl-delay directives declared by the target server.
Dynamic JavaScript Rendering: Headless Chromium execution ensures single-page applications (React, Vue, Next.js) render complete DOM trees prior to content extraction.

Workspace Knowledge Bases: Confluence & Notion

Confluence spaces and Notion workspaces contain institutional memory, architecture decision records (ADRs), and internal runbooks.

Hierarchy & Table Preservation

Breadcrumb Navigation: Every indexed chunk retains its complete workspace breadcrumb path (e.g., Engineering > Infrastructure > Disaster Recovery).
Markdown Table Extraction: Multi-column tables are extracted into GitHub-flavored Markdown tables to preserve cell relationships during vector search.
Access Control Mapping: Notion and Confluence access permissions can be mapped directly to MITHUNAI collection access roles.

Delta Synchronization & Webhook Triggers

MITHUNAI minimizes computational overhead and API rate limits by evaluating document content hashes (SHA-256) before re-embedding.

Get started

Knowledge

Assistants & Agents

Channels & Integration

Architecture & Solutions

Administration

Trust and support

Supported Knowledge Connectors & Data Sources

Available Connectors

Code Repositories

Documentation & Websites

Workspace Knowledge Bases

Cloud Object Storage

Support & Ticketing

Team Communication

Code Repositories: GitHub & GitLab

Configuration Parameters

Web Crawling & Sitemap Connector

Crawl Policy & Guardrails

Workspace Knowledge Bases: Confluence & Notion

Hierarchy & Table Preservation

Delta Synchronization & Webhook Triggers

​Available Connectors

Code Repositories

Documentation & Websites

Workspace Knowledge Bases

Cloud Object Storage

Support & Ticketing

Team Communication

​Code Repositories: GitHub & GitLab

​Configuration Parameters

​Web Crawling & Sitemap Connector

​Crawl Policy & Guardrails

​Workspace Knowledge Bases: Confluence & Notion

​Hierarchy & Table Preservation

​Delta Synchronization & Webhook Triggers

Available Connectors

Code Repositories: GitHub & GitLab

Configuration Parameters

Web Crawling & Sitemap Connector

Crawl Policy & Guardrails

Workspace Knowledge Bases: Confluence & Notion

Hierarchy & Table Preservation

Delta Synchronization & Webhook Triggers