Files
mailflare/server/runtime/env.ts
T
Oday BakkourandClaude Fable 5.1 f0dc5a16fc feat(self-host): run Mailflare as a Docker container on any host
Adds a second runtime next to Cloudflare Workers. One Node process serves
the Next app, a realtime WebSocket hub, the job queues, the backup schedule
and an SMTP listener; SQLite and local files replace D1 and R2. The
application code is unchanged: the runtime builds an object with the same
binding interfaces (`server/runtime/`) and publishes it before Next starts,
so `getEnv()` hands route handlers the same shape on both platforms.

Runtime (server/)
- `sqlite-database.ts`: the D1 API over better-sqlite3, so Drizzle's D1
  driver, the raw `env.DB.prepare` callers, the FTS5 index and its triggers
  all work as-is. Migrations are applied from drizzle/migrations at start,
  recorded in `d1_migrations` like Wrangler does.
- `file-bucket.ts`: the R2 API over a directory, with metadata sidecars and
  byte ranges. `mailer.ts`: the send_email builder over nodemailer (any SMTP
  relay) or Cloudflare's Email Sending REST API; generates the Message-ID so
  threading matches Workers. `queue.ts`: in-process queues with the same
  retry policy. `realtime.ts`: per-user WebSocket fan-out in place of the
  Durable Object. `misc.ts`: rate limiter and ASSETS fetcher.
- `smtp.ts`: inbound SMTP on port 25 via smtp-server; reject rules answer
  550, forward rules relay the raw message through the outbound SMTP.
- `index.ts`: the custom server; `scripts/build-server.mjs` bundles it with
  esbuild to dist/server.mjs.

Application changes
- `src/lib/runtime.ts` + `getEnv()` prefer the Node env when present.
- `src/lib/email/intake.ts` factors the Worker email handler's logic so the
  SMTP listener and the new signed `/api/inbound` webhook share it.
- Domains without Cloudflare credentials are recorded with zone id
  "manual": Cloudflare calls no-op, the domain is active at once, and the
  DNS page lists MX/SPF/DMARC records to create. Setup checks, the domains
  page copy and the self-update button adapt to the runtime; `/api/auth/me`
  exposes `runtime` and `managesDns`.
- `APP_URL` overrides the origin for reset links and the JMAP session
  behind a proxy. The direct `getCloudflareContext` import in the update
  route is replaced with `getEnv()`.

Deployment
- Dockerfile (multi-stage, 1.1 GB, Workers toolchain pruned), compose file,
  `.env.docker.example`, `docs/self-hosting.md`, README section.
- `deploy/cloudflare-email-relay`: a Worker that keeps MX on Cloudflare
  Email Routing and posts messages to the server with an HMAC signature,
  acting on the reject/forward decision it returns.

Verified on a fresh data directory and again inside the built image:
migrations apply, first-run setup and registration work with no Cloudflare
credentials, mail over SMTP lands in the inbox with the raw copy on disk,
a reject rule answers 550, a send through SMTP_URL loops back and is stored
as sent and received, an inbound reply threads with the sent copy, FTS
search finds body text, a backup completes to the volume, the WebSocket
delivers a push, the relay webhook rejects a bad signature and returns
store/reject decisions, JMAP serves a session with the APP_URL origin.
Container healthcheck reports healthy. tsc (11) and eslint (105) unchanged.

Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01PGeWDVSkXtVEmDAN2AtB9h
2026-09-12 14:34:11 +03:00

76 lines
2.9 KiB
TypeScript

import { mkdirSync } from "node:fs";
import { join, resolve } from "node:path";
import { openFileBucket } from "./file-bucket";
import { openMailer, type Mailer, type MailerConfig } from "./mailer";
import { openAssets, openRateLimiter } from "./misc";
import { openQueue, type InProcessQueue } from "./queue";
import { RealtimeHubRegistry } from "./realtime";
import { openSqliteDatabase, type SqliteDatabase } from "./sqlite-database";
import type { NodeRuntime } from "./types";
function optional(name: string): string | undefined {
const value = process.env[name]?.trim();
return value || undefined;
}
function mailerConfig(): MailerConfig {
const smtp = optional("SMTP_URL");
if (smtp) return { kind: "smtp", url: smtp };
const accountId = optional("CF_ACCOUNT_ID");
const token = optional("CF_TOKEN");
if (accountId && token) return { kind: "cloudflare", accountId, token };
return { kind: "none" };
}
/**
* Assemble a `CloudflareEnv` for the Node runtime from environment variables
* and local resources. Everything the app reaches through `getEnv()` is here,
* so application code does not know which platform it runs on.
*/
export function createNodeRuntime(): NodeRuntime {
const dataDir = resolve(optional("DATA_DIR") ?? "./data");
mkdirSync(join(dataDir, "blobs"), { recursive: true });
const database = openSqliteDatabase(join(dataDir, "mailflare.sqlite"));
const bucket = openFileBucket(join(dataDir, "blobs"));
const mailer = openMailer(mailerConfig());
const inboundQueue = openQueue("mailflare-inbound");
const outboundQueue = openQueue("mailflare-outbound");
const realtime = new RealtimeHubRegistry();
const publicDir = resolve(optional("PUBLIC_DIR") ?? "./public");
const env = {
DB: database,
BUCKET: bucket,
EMAIL: mailer,
INBOUND_QUEUE: inboundQueue,
OUTBOUND_QUEUE: outboundQueue,
REALTIME: realtime.namespace(),
ASSETS: openAssets(publicDir),
IMAGES: undefined as unknown as CloudflareEnv["IMAGES"],
WORKER_SELF_REFERENCE: undefined as unknown as CloudflareEnv["WORKER_SELF_REFERENCE"],
LOGIN_RATE_LIMIT: openRateLimiter(20, 60),
CF_TOKEN: optional("CF_TOKEN"),
CF_API_KEY: optional("CF_API_KEY"),
CF_EMAIL: optional("CF_EMAIL"),
TURNSTILE_SECRET_KEY: optional("TURNSTILE_SECRET_KEY"),
GITHUB_UPDATE_TOKEN: optional("GITHUB_UPDATE_TOKEN"),
GITHUB_UPDATE_REF: optional("GITHUB_UPDATE_REF"),
GITHUB_UPDATE_REPO: optional("GITHUB_UPDATE_REPO"),
// Marks the runtime for the few places that must behave differently.
MAILFLARE_RUNTIME: "node",
APP_URL: optional("APP_URL")?.replace(/\/$/, ""),
INBOUND_WEBHOOK_SECRET: optional("INBOUND_WEBHOOK_SECRET"),
} as unknown as CloudflareEnv;
return {
env,
dataDir,
database: database as unknown as SqliteDatabase,
mailer: mailer as unknown as Mailer,
inboundQueue: inboundQueue as unknown as InProcessQueue,
outboundQueue: outboundQueue as unknown as InProcessQueue,
realtime,
};
}