> ## Documentation Index
> Fetch the complete documentation index at: https://docs.mithunai.com/llms.txt
> Use this file to discover all available pages before exploring further.

# Sovereign Cloud & Air-Gapped Deployment

> Deploy the complete MITHUNAI stack on private infrastructure, sovereign VPCs, or air-gapped environments with full data sovereignty and zero telemetry leaks.

MITHUNAI can be deployed as a completely self-contained appliance within your virtual private cloud (VPC), sovereign government cloud, or air-gapped datacenter without external dependencies. Every component—the API gateway, background ingestion workers, pgvector embedding storage, and Redis cache—runs on your infrastructure, ensuring zero telemetry or customer data leaves your security boundary.

```mermaid theme={"theme":{"light":"github-light","dark":"github-dark"}}
flowchart TD
    subgraph VPC["Customer Isolated Virtual Private Cloud / Air-Gapped Network"]
        direction TB
        LB["Internal Application Load Balancer / Ingress"]

        subgraph Core["Core Application Services"]
            API["MITHUNAI API & Gateway\n(Python FastAPI / Uvicorn)"]
            WRK["Asynchronous Ingestion Workers\n(Celery / Redis)"]
        end

        subgraph Storage["State & Vector Storage"]
            PG[("PostgreSQL 16\nwith pgvector")]
            REDIS[("Redis 7\n(Semantic Cache & Queue)")]
            S3[("Internal Object Store\n(MinIO / Ceph / S3)")]
        end

        subgraph LocalModels["Private Inference (Optional)"]
            LLM["Local LLM Server\n(vLLM / Ollama / DeepSeek R1)"]
            EMB["Local Embedding Server\n(TEI / BGE-m3 / Nomic)"]
        end

        LB --> API
        API --> PG
        API --> REDIS
        API --> WRK
        WRK --> S3
        WRK --> PG

        API -.-> LLM
        WRK -.-> EMB
    end
```

## Deployment Topologies

MITHUNAI supports three production deployment topologies:

<Columns cols={3}>
  <Card title="Managed Multi-Tenant" icon="cloud">
    Fully managed SaaS hosted in ISO 27001 and SOC 2 Type II certified regions with tenant
    isolation.
  </Card>

  <Card title="Dedicated Single-Tenant VPC" icon="shield">
    Isolated cloud instances in AWS, GCP, or Azure with customer-managed encryption keys (CMEK) and
    dedicated subnets.
  </Card>

  <Card title="Self-Hosted Air-Gapped" icon="hard-drive">
    Containerized distribution running entirely offline on your hardware with no internet access
    required.
  </Card>
</Columns>

***

## Docker Compose Quickstart

For developer evaluations and isolated single-node production environments, deploy using Docker Compose:

```bash Start Services theme={"theme":{"light":"github-light","dark":"github-dark"}}
# Clone the repository and configure sovereign environment variables
git clone https://github.com/mithunaihq/mithunai.git
cd mithunai/docker

# Copy environment template
cp env.example .env

# Start all core services in background
docker compose up -d
```

### Core Service Ports

| Service | Port         | Description                                     |
| :------ | :----------- | :---------------------------------------------- |
| `nginx` | `80` / `443` | Reverse proxy and SSL termination.              |
| `api`   | `5001`       | Backend HTTP API service (`/arukz/api/v1`).     |
| `db`    | `5432`       | PostgreSQL with `pgvector` extension enabled.   |
| `redis` | `6379`       | In-memory cache and Celery broker.              |
| `web`   | `3000`       | Administrative console and analytics dashboard. |

***

## Air-Gapped Compliance & Zero Telemetry

MITHUNAI enforces strict offline compliance guarantees for regulated healthcare, financial, and defense installations:

* **Zero Unauthorized Phone-Home**: The platform performs no external license verification pings, usage telemetry beacons, or third-party analytics calls.
* **Local Embedding Support**: Connect local embedding servers (e.g., Hugging Face Text Embeddings Inference running `BAAI/bge-large-en-v1.5` or `nomic-embed-text`) to eliminate external embedding APIs.
* **Local LLM Execution**: Route inference queries to private local engines such as `vLLM`, `Triton Inference Server`, or `Ollama` hosting open-weights models (`Llama-3.3-70B`, `DeepSeek-R1`, `Qwen-2.5-Coder`).
* **Static Assets Bundled**: All documentation, fonts, icons, and JavaScript widgets are self-contained without CDN links.