feat(v10): 1-click pipeline promote, integrations platform, backup destinations

Backward-compatible release. Every migration is idempotent; new columns default
to values that preserve existing behavior. Legacy promote endpoint preserved.

Pipeline
- Staged 1-click beta → prod: preflight plan, typed confirmation, auto-snapshot,
  schema txn apply, site redeploy, one-click rollback from saved backup
- Exact beta fork: copies data (was schema-only), auto-deploys beta sites,
  remaps env vars from prod → beta DB
- Realtime progress on pipeline:promote:<id> and pipeline:fork:<id>

Authentication
- GitHub-style device flow powering VS Code (vpc-sync-10.0.0.vsix) and
  CLI (vpc-pull login) — no more manual PAT paste
- Standalone /auth/device approval page reuses SPA vpc-token

Integrations (7 → 33 platforms)
- Source control: GitHub, GitLab, Bitbucket
- DB/BaaS: Supabase, Firebase, MongoDB, PlanetScale, Neon, Redis
- Deploy: Docker, Vercel, Netlify, Railway, Render
- Cloud: AWS, GCP, DigitalOcean, Cloudflare
- Storage: S3-compatible
- Notifications: Slack, Discord, Telegram, Teams, SMTP, SendGrid, Twilio
- AI: OpenAI, Anthropic, Google AI, Groq
- Payments: Stripe, Razorpay
- Productivity: Notion, Linear, Jira
- Generic: Webhook, SSH
- Real testConnection() for every type — no stubs
- One-click automations: Supabase→Backup, GitHub→Import, Slack→Alerts,
  Cloudflare→DNS+Auto-SSL (Always HTTPS + Full SSL + TLS 1.2)
- Per-admin visibility (shared/private + created_by)

Backups
- Supabase destination type with encrypted service-role key
- Scheduler polls every 60s, runs due destinations
- Cloud restore: restore() falls back to Supabase download when local
  file is missing
- Realtime progress on backup:progress channel

Observability
- Central logger.js writes to vpc_system_logs
- GET /logs/health aggregate + SystemHealthWidget on Dashboard
- GET /logs/system for raw log browsing

Security
- Versioned encryption (v{N}: prefix), legacy format still decrypts
- backend/scripts/rekey.js re-encrypts all secrets with current key

Performance
- Lazy-loaded apps via React.lazy(): main bundle 1.2 MB → 498 KB (-59%)
- Window.jsx wraps AppComponent in Suspense + LoadingSpinner fallback

Quality
- backend/tests/smoke.test.js — 8 zero-dep tests via node --test
- Fixed ROUTE_PERMISSION_MAP gaps for pipeline + realtime

Migrations
- 041_vpc_device_codes.sql
- 042_vpc_backup_destinations.sql
- 043_vpc_pipeline_promotions.sql (+ integration visibility + enc_key_version)
- 044_vpc_system_logs.sql

See DEPLOY_LOG.md for full checklist, backward-compat notes, and rollback plan.

Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>

Author: Banametaliks

DEPLOY_LOG.md

@@ -0,0 +1,201 @@
+# VPC Deploy Log
+
+## v10.0.0 — 2026-04-22
+
+A forward-compatible release. No data loss paths, every migration is idempotent
+and every new column has a safe default. Existing integrations, backups, pipelines
+and sessions continue to work without manual intervention.
+
+---
+
+### 🚀 Highlights
+
+- **Perfect 1-click Pipeline promotion** — preflight plan, typed confirmation, auto-snapshot, staged execute, one-click rollback.
+- **Exact beta fork** — full data copy (not just schema), auto-deploy, env-var remap from prod → beta DB.
+- **GitHub-style browser sign-in** across VS Code (`vpc-sync-10.0.0.vsix`) and CLI (`vpc-pull login`) — no more pasting PATs.
+- **33 integration platforms** (up from 7) with one-click automations (Supabase→Backup, GitHub→Import, Slack→Alerts, Cloudflare→DNS+SSL).
+- **Supabase backup destination** — off-site backups on a schedule + cloud-restore fallback.
+- **Lazy-loaded apps** — main bundle 1.2 MB → 498 KB (−59%).
+- **System Health widget** — central logger captures every error, Dashboard surfaces 24h counts.
+- **Versioned encryption** with `rekey.js` script for key rotation.
+- **Baseline tests** via `node --test` — 8/8 passing.
+
+---
+
+### 📦 Deploy checklist
+
+Run in order. Each step is idempotent and safe to re-run.
+
+```bash
+# 1. Apply new migrations (all use CREATE TABLE IF NOT EXISTS / ADD COLUMN IF NOT EXISTS)
+psql "$DATABASE_URL" < backend/migrations/041_vpc_device_codes.sql
+psql "$DATABASE_URL" < backend/migrations/042_vpc_backup_destinations.sql
+psql "$DATABASE_URL" < backend/migrations/043_vpc_pipeline_promotions.sql
+psql "$DATABASE_URL" < backend/migrations/044_vpc_system_logs.sql
+
+# 2. Restart backend — new schedulers + logger wire up on boot
+pm2 restart vpc-backend   # or `systemctl restart vpc`
+
+# 3. Rebuild frontend (lazy-split chunks)
+cd frontend && npm install && npx vite build && cd ..
+
+# 4. (Optional) Install the new VS Code extension
+code --install-extension vscode-extension/vpc-sync-10.0.0.vsix --force
+
+# 5. Verify
+cd backend && npm test         # 8/8 should pass
+curl http://localhost:8001/health
+```
+
+---
+
+### 🔒 Backward-compatibility notes
+
+| Change | Existing behavior preserved? |
+|---|---|
+| `vpc_integrations.visibility` column added | Default `'shared'` → all existing integrations visible to every admin as before. |
+| `vpc_integrations.created_by` column added | Nullable, default NULL — no backfill needed. |
+| `vpc_settings.enc_key_version` column added | Default 1 — existing blobs continue decrypting. |
+| Encryption blob format: new blobs prefix `v{N}:` | `decrypt()` accepts both legacy and versioned formats — verified by smoke test `encryption: decrypt handles legacy (v-less) format`. |
+| `pipelineService.forkToBeta()` default `copyData` | Was `false`, now `true` (per user request for exact forks). Frontend always passes explicit `{ copyData: true }`; direct API callers using the default now get the new behavior. |
+| `POST /pipelines/:id/promote` response shape | ⚠ Changed — old response `{ schemaPRs, deployedSites, errors }` moved to `/pipelines/:id/promote-legacy`. New response `{ run_id, status, backup_id, schema_applied, deployed, deployErrors, stages }`. Only caller was the web UI, which is updated. |
+| `integrationService.getAll(pool)` | Backward compatible — existing signature still works. Optional `{ forUserId }` param enables per-admin filtering. |
+| Lazy-loaded apps | First open of each app shows loading spinner briefly; functional behavior unchanged. |
+
+---
+
+### 📂 New files
+
+**Backend**
+- `backend/migrations/041_vpc_device_codes.sql`
+- `backend/migrations/042_vpc_backup_destinations.sql`
+- `backend/migrations/043_vpc_pipeline_promotions.sql`
+- `backend/migrations/044_vpc_system_logs.sql`
+- `backend/routes/deviceAuth.js` — VS Code / CLI sign-in flow
+- `backend/routes/realtime.js` — SSE event stream
+- `backend/services/backupScheduler.js` — polls supabase destinations every 60s
+- `backend/services/credentialResolver.js` — shared integration creds for any app
+- `backend/services/integrationAutomations.js` — one-click automators
+- `backend/services/pipelinePromoteService.js` — staged promote + rollback
+- `backend/services/realtimeBus.js` — in-process pub/sub for SSE
+- `backend/services/supabaseBackupService.js` — upload & restore via Supabase Storage
+- `backend/scripts/rekey.js` — re-encrypt all secrets with new key
+- `backend/utils/logger.js` — central logger writing to `vpc_system_logs`
+- `backend/views/deviceApprove.html` — browser approval page for device flow
+- `backend/tests/smoke.test.js` — 8 zero-dep smoke tests
+
+**Frontend**
+- `frontend/src/components/apps/BackupDestinations.jsx`
+- `frontend/src/components/apps/Connections.jsx` (rewritten — 33 platforms, categories, automations)
+- `frontend/src/components/apps/Dashboard.jsx`
+- `frontend/src/components/desktop/CommandPalette.jsx`
+- `frontend/src/components/desktop/ContextBreadcrumb.jsx`
+- `frontend/src/components/desktop/JobQueue.jsx`
+- `frontend/src/components/desktop/KeyboardShortcutsOverlay.jsx`
+- `frontend/src/components/desktop/NotificationCenter.jsx`
+- `frontend/src/components/desktop/StatusBar.jsx`
+- `frontend/src/components/desktop/WorkspaceSwitcher.jsx`
+- `frontend/src/components/integrations/*`
+- `frontend/src/components/pipeline/PromoteDialog.jsx`
+- `frontend/src/components/widgets/*` (incl. `SystemHealthWidget`)
+- `frontend/src/hooks/useGlobalKeyboard.js`
+- `frontend/src/lib/realtime.js`
+- `frontend/src/lib/widgetRegistry.js`
+- `frontend/src/stores/useCommandStore.js`
+- `frontend/src/stores/useContextStore.js`
+- `frontend/src/stores/useDashboardStore.js`
+- `frontend/src/stores/useIntegrationsStore.js`
+- `frontend/src/stores/useJobStore.js`
+- `frontend/src/stores/useNotificationStore.js`
+- `frontend/src/stores/useWorkspaceStore.js`
+
+**VS Code Extension** (packaged as `vpc-sync-10.0.0.vsix`)
+- `vscode-extension/src/auth/deviceFlow.ts` — AuthenticationProvider + device-flow poller
+- `vscode-extension/src/vcs/merge.ts` — 3-way merge port
+
+**CLI**
+- `cli/src/commands/login.js` — `vpc-pull login` browser sign-in
+
+---
+
+### 🩺 New endpoints
+
+```
+# Device auth (public + JWT mix)
+POST   /api/admin/auth/device/code
+POST   /api/admin/auth/device/token
+GET    /api/admin/auth/device/pending?code=XXXX
+POST   /api/admin/auth/device/confirm  { user_code }
+POST   /api/admin/auth/device/deny     { user_code }
+
+# Backup destinations
+GET    /api/admin/backup/destinations
+POST   /api/admin/backup/destinations
+PATCH  /api/admin/backup/destinations/:id
+DELETE /api/admin/backup/destinations/:id
+POST   /api/admin/backup/destinations/:id/test
+POST   /api/admin/backup/destinations/:id/run
+GET    /api/admin/backup/destinations/:id/runs
+
+# Integration automations
+GET    /api/admin/integrations/automations
+POST   /api/admin/integrations/:id/automate  { automation, options }
+
+# Perfect pipeline promote
+GET    /api/admin/pipeline/pipelines/:id/promote/preflight
+POST   /api/admin/pipeline/pipelines/:id/promote        { confirmations, skipBackup, dryRun }
+POST   /api/admin/pipeline/pipelines/:id/promote-legacy (old behavior preserved)
+GET    /api/admin/pipeline/pipelines/:id/promotions
+POST   /api/admin/pipeline/pipelines/:id/promotions/:runId/rollback
+
+# Logs
+GET    /api/admin/logs/health
+GET    /api/admin/logs/system?level=error&limit=100
+
+# Static page
+GET    /auth/device             (approval UI for device codes)
+```
+
+---
+
+### ⚠ Rollback plan
+
+If something goes wrong after deploy:
+
+1. **Database**: new tables are independent. Drop them if needed — nothing else depends on them:
+   ```sql
+   DROP TABLE IF EXISTS vpc_pipeline_promotions CASCADE;
+   DROP TABLE IF EXISTS vpc_system_logs;
+   DROP TABLE IF EXISTS vpc_backup_destination_runs;
+   DROP TABLE IF EXISTS vpc_backup_destinations;
+   DROP TABLE IF EXISTS vpc_device_codes;
+   ALTER TABLE vpc_integrations DROP COLUMN IF EXISTS visibility;
+   ALTER TABLE vpc_integrations DROP COLUMN IF EXISTS created_by;
+   ALTER TABLE vpc_settings DROP COLUMN IF EXISTS enc_key_version;
+   ```
+2. **Code**: `git revert HEAD` and redeploy. Because migrations are additive,
+   reverting code without reverting the schema is also safe — the extra tables
+   simply sit unused.
+3. **Pipeline promotions in flight**: any running promotion records its
+   pre-promote backup in `vpc_pipeline_promotions.backup_id`. Use
+   `POST /promotions/:runId/rollback` or restore the backup directly
+   via the Backup Manager.
+
+---
+
+### ✅ Verification
+
+```
+cd backend && npm test
+✔ encryption: round-trip preserves plaintext
+✔ encryption: decrypt handles legacy (v-less) format
+✔ encryption: decrypt returns null for garbage
+✔ integrations: all types have name + fields
+✔ integrations: every type has a tester case
+✔ automations: registry is consistent
+✔ pipeline promote service: exports expected API
+✔ logger: forSource returns level methods
+ℹ 8 pass, 0 fail
+```
+
+Frontend build: `✓ built in 8.07s` — main chunk 498 KB (was 1,204 KB).

app.js

@@ -206,4 +206,12 @@ app.listen(PORT, async () => {
     }
   }, BACKUP_CHECK_INTERVAL);
   console.log('[VPC] Auto-backup scheduler running (checks every hour)');
+
+  // External backup destinations scheduler (Supabase, etc.) — polls every minute
+  try {
+    const backupScheduler = require('./backend/services/backupScheduler');
+    backupScheduler.start(pool);
+  } catch (err) {
+    console.error('[VPC] Backup destination scheduler failed to start:', err.message);
+  }
 });

backend/middleware/auth.js

@@ -16,17 +16,25 @@ const ROUTE_PERMISSION_MAP = {
   '/web-hosting': 'web_hosting',
   '/settings': 'ai_agent',
   '/vpshub': 'vpshub',
+  '/pipeline': 'pipeline',
+  '/realtime': 'realtime',
 };
 
 async function authenticateAdmin(req, res, next) {
   try {
     const authHeader = req.headers.authorization;
-    if (!authHeader || !authHeader.startsWith('Bearer ')) {
+    let token = null;
+    if (authHeader && authHeader.startsWith('Bearer ')) {
+      token = authHeader.replace('Bearer ', '');
+    } else if (req.query && req.query._t) {
+      // SSE/EventSource fallback — token via query string
+      token = String(req.query._t);
+    }
+    if (!token) {
       return res.status(401).json({ error: 'No authorization token provided' });
     }
 
-    const token = authHeader.replace('Bearer ', '');
-    if (!token || token.length < 20) {
+    if (token.length < 20) {
       return res.status(401).json({ error: 'Invalid token format' });
     }
 

backend/migrations/040_vpc_integrations_default.sql

@@ -0,0 +1,22 @@
+-- Mark one integration per type as the default reusable connection
+ALTER TABLE vpc_integrations
+  ADD COLUMN IF NOT EXISTS is_default BOOLEAN DEFAULT FALSE;
+
+-- One default per type
+CREATE UNIQUE INDEX IF NOT EXISTS idx_vpc_integrations_default_per_type
+  ON vpc_integrations(type) WHERE is_default = TRUE;
+
+-- Track which apps reference which integration (audit + reverse-lookup)
+CREATE TABLE IF NOT EXISTS vpc_integration_uses (
+  id UUID PRIMARY KEY DEFAULT gen_random_uuid(),
+  integration_id UUID NOT NULL REFERENCES vpc_integrations(id) ON DELETE CASCADE,
+  app_id VARCHAR(100) NOT NULL,
+  resource_kind VARCHAR(100),
+  resource_id VARCHAR(255),
+  last_used_at TIMESTAMPTZ DEFAULT NOW(),
+  created_at TIMESTAMPTZ DEFAULT NOW(),
+  UNIQUE (integration_id, app_id, resource_kind, resource_id)
+);
+
+CREATE INDEX IF NOT EXISTS idx_integration_uses_app ON vpc_integration_uses(app_id);
+CREATE INDEX IF NOT EXISTS idx_integration_uses_integration ON vpc_integration_uses(integration_id);

backend/migrations/041_vpc_device_codes.sql

@@ -0,0 +1,18 @@
+-- Device authorization codes for VS Code extension sign-in (OAuth-style device flow)
+CREATE TABLE IF NOT EXISTS vpc_device_codes (
+  id UUID PRIMARY KEY DEFAULT gen_random_uuid(),
+  device_code VARCHAR(64) NOT NULL UNIQUE,
+  user_code VARCHAR(16) NOT NULL UNIQUE,
+  client_name VARCHAR(255),
+  status VARCHAR(24) NOT NULL DEFAULT 'pending', -- pending | approved | denied | expired
+  user_id UUID REFERENCES vpc_admins(id) ON DELETE SET NULL,
+  issued_token_id UUID REFERENCES vpshub_tokens(id) ON DELETE SET NULL,
+  plaintext_once TEXT,
+  expires_at TIMESTAMPTZ NOT NULL,
+  approved_at TIMESTAMPTZ,
+  created_at TIMESTAMPTZ DEFAULT NOW()
+);
+
+CREATE INDEX IF NOT EXISTS idx_vpc_device_codes_user_code ON vpc_device_codes(user_code);
+CREATE INDEX IF NOT EXISTS idx_vpc_device_codes_device_code ON vpc_device_codes(device_code);
+CREATE INDEX IF NOT EXISTS idx_vpc_device_codes_expires ON vpc_device_codes(expires_at);

backend/migrations/042_vpc_backup_destinations.sql

@@ -0,0 +1,38 @@
+-- External backup destinations (Supabase, S3, etc.)
+CREATE TABLE IF NOT EXISTS vpc_backup_destinations (
+  id UUID PRIMARY KEY DEFAULT gen_random_uuid(),
+  name VARCHAR(255) NOT NULL,
+  provider VARCHAR(32) NOT NULL, -- 'supabase' | 's3' (future)
+  config JSONB NOT NULL DEFAULT '{}'::jsonb,
+  -- For supabase: { url, service_role_key (encrypted), bucket, sync_data, sync_schema }
+  schedule_cron VARCHAR(64),        -- standard 5-field cron, NULL disables
+  interval_minutes INTEGER,         -- simple alternative to cron (e.g. every 60 min)
+  enabled BOOLEAN DEFAULT true,
+  last_run_at TIMESTAMPTZ,
+  last_run_status VARCHAR(24),      -- 'success' | 'failed' | 'running'
+  last_run_error TEXT,
+  last_run_bytes BIGINT,
+  next_run_at TIMESTAMPTZ,
+  created_by UUID REFERENCES vpc_admins(id) ON DELETE SET NULL,
+  created_at TIMESTAMPTZ DEFAULT NOW(),
+  updated_at TIMESTAMPTZ DEFAULT NOW()
+);
+
+CREATE INDEX IF NOT EXISTS idx_vpc_backup_destinations_enabled ON vpc_backup_destinations(enabled);
+CREATE INDEX IF NOT EXISTS idx_vpc_backup_destinations_next_run ON vpc_backup_destinations(next_run_at);
+
+-- Audit trail per-destination
+CREATE TABLE IF NOT EXISTS vpc_backup_destination_runs (
+  id UUID PRIMARY KEY DEFAULT gen_random_uuid(),
+  destination_id UUID NOT NULL REFERENCES vpc_backup_destinations(id) ON DELETE CASCADE,
+  backup_id UUID REFERENCES backups(id) ON DELETE SET NULL,
+  status VARCHAR(24) NOT NULL,       -- 'success' | 'failed' | 'running'
+  bytes_uploaded BIGINT,
+  remote_path TEXT,
+  error_message TEXT,
+  duration_ms INTEGER,
+  started_at TIMESTAMPTZ DEFAULT NOW(),
+  completed_at TIMESTAMPTZ
+);
+
+CREATE INDEX IF NOT EXISTS idx_vpc_backup_dest_runs_dest ON vpc_backup_destination_runs(destination_id, started_at DESC);

backend/migrations/043_vpc_pipeline_promotions.sql

@@ -0,0 +1,26 @@
+-- Track each pipeline promotion run (snapshot + stages) for auditing & rollback
+CREATE TABLE IF NOT EXISTS vpc_pipeline_promotions (
+  id UUID PRIMARY KEY DEFAULT gen_random_uuid(),
+  pipeline_id UUID NOT NULL REFERENCES vpc_pipelines(id) ON DELETE CASCADE,
+  initiated_by UUID REFERENCES vpc_admins(id) ON DELETE SET NULL,
+  status VARCHAR(24) NOT NULL DEFAULT 'pending', -- pending|running|success|failed|rolled_back
+  stages JSONB DEFAULT '[]'::jsonb,              -- array of {name, status, started_at, completed_at, error?, details?}
+  backup_id UUID,                                 -- prod DB snapshot taken before promotion (for rollback)
+  schema_diff JSONB,
+  applied_sql TEXT,
+  deployed_sites JSONB DEFAULT '[]'::jsonb,
+  error_message TEXT,
+  started_at TIMESTAMPTZ DEFAULT NOW(),
+  completed_at TIMESTAMPTZ
+);
+
+CREATE INDEX IF NOT EXISTS idx_vpc_pipeline_promotions_pipeline ON vpc_pipeline_promotions(pipeline_id, started_at DESC);
+CREATE INDEX IF NOT EXISTS idx_vpc_pipeline_promotions_status ON vpc_pipeline_promotions(status);
+
+-- Integration visibility (fix #7)
+ALTER TABLE vpc_integrations ADD COLUMN IF NOT EXISTS created_by UUID REFERENCES vpc_admins(id) ON DELETE SET NULL;
+ALTER TABLE vpc_integrations ADD COLUMN IF NOT EXISTS visibility VARCHAR(16) NOT NULL DEFAULT 'shared'; -- private|shared
+CREATE INDEX IF NOT EXISTS idx_vpc_integrations_owner ON vpc_integrations(created_by);
+
+-- Key rotation (fix #6) — tag each encrypted blob with the key version that produced it
+ALTER TABLE vpc_settings ADD COLUMN IF NOT EXISTS enc_key_version SMALLINT DEFAULT 1;

backend/migrations/044_vpc_system_logs.sql

@@ -0,0 +1,13 @@
+-- Central system-level error/event log (separate from per-admin action_logs)
+CREATE TABLE IF NOT EXISTS vpc_system_logs (
+  id BIGSERIAL PRIMARY KEY,
+  level VARCHAR(16) NOT NULL,        -- debug|info|warn|error|fatal
+  source VARCHAR(64) NOT NULL,       -- subsystem: pipeline, backup, integration, etc.
+  message TEXT NOT NULL,
+  metadata JSONB,
+  created_at TIMESTAMPTZ DEFAULT NOW()
+);
+
+CREATE INDEX IF NOT EXISTS idx_vpc_system_logs_level_time ON vpc_system_logs(level, created_at DESC);
+CREATE INDEX IF NOT EXISTS idx_vpc_system_logs_source ON vpc_system_logs(source);
+CREATE INDEX IF NOT EXISTS idx_vpc_system_logs_created ON vpc_system_logs(created_at DESC);

backend/package.json

@@ -6,7 +6,8 @@
     "start": "node server.js",
     "dev": "nodemon server.js",
     "migrate": "node db/run-migrations.js",
-    "seed": "node db/seed-admin.js"
+    "seed": "node db/seed-admin.js",
+    "test": "node --test tests/*.test.js"
   },
   "dependencies": {
     "@anthropic-ai/sdk": "^0.78.0",