fix(db): bootstrap Projects for development push databases that predate them (#9611)

* fix(db): bootstrap Projects for development push databases that predate them

A push-managed database with workspaces but no Project schema could never pass
the schema-push guard: push cannot backfill workspace.project_id, and the
guard refuses every unenforced Project state. Under SIM_DEV_DB_PUSH=1 the
pre-push reconciler now replays migrations 0394 and 0406 (the foundation
commits atomically with the rollout marker) and runs the registered
0032_project_membership script migration on its single session, recording it
as the migration runner does. An interrupted bootstrap resumes; every other
unenforced state still refuses with the same message.

The pinned drizzle-kit patch also adds unique constraints before foreign keys,
so a composite foreign key on a new unique constraint of an existing table no
longer fails, and in the noninteractive push policy it answers the
unique-constraint truncate prompt with its non-destructive choice.

* fix(db): push the schema before the Project migration reads it

The bootstrap ran 0032_project_membership before Drizzle pushed anything, so a
development database from before a column the migration reads (such as the
fork parent) failed after committing the expansion, on every retry.

--prepare now only replays the expansion. push.ts then runs one Drizzle push
with workspace.project_id still nullable (SIM_DB_PUSH_PROJECT_BOOTSTRAP=1),
runs the migration through reconcile-project-membership.ts --bootstrap, and
finishes with the ordinary push. The connector and rollout marker are kept out
of Drizzle's diff until the migration retires them. A fresh bootstrap also
requires that no public table carries a project_id column.

* fix(db): pin the Project bootstrap to the public schema

The replayed migration SQL and the script runner name tables unqualified, so a
connection search path that lists another schema first created the Project
foundation outside public. The refusal snapshot now also covers folders and
Projects.

Author: waleedlatif1

packages/db/drizzle.config.ts

@@ -15,9 +15,14 @@ export default {
   dbCredentials: {
     url: process.env.DATABASE_URL!,
   },
-  /** Runner-owned journals and resumable cleanup cursors must survive a development schema push. */
+  /**
+   * Runner-owned journals, resumable cleanup cursors, and a Project bootstrap's connector and
+   * rollout marker (until its migration retires them) must survive a development schema push.
+   */
   tablesFilter: [
     '!script_migrations',
+    '!project_workspace',
+    '!project_membership_rollout',
     '!project_backfill_archive_repairs',
     '!search_embedding_cleanup_progress',
     '!search_embedding_cleanup_targets',

packages/db/schema.ts

@@ -2171,6 +2171,20 @@ export const workspaceModeEnum = pgEnum('workspace_mode', [
 
 export type WorkspaceMode = (typeof workspaceModeEnum.enumValues)[number]
 
+/**
+ * A development push that bootstraps Projects first pushes this column nullable, so the columns
+ * `0032_project_membership` reads exist before it fills the column and enforces NOT NULL; the
+ * push that follows uses the required column. Every other push and generation reads it required.
+ */
+function workspaceProjectIdColumn() {
+  const column = text('project_id').references((): AnyPgColumn => project.id, {
+    onDelete: 'restrict',
+  })
+  return process.env.SIM_DB_PUSH_PROJECT_BOOTSTRAP === '1'
+    ? (column as ReturnType<typeof column.notNull>)
+    : column.notNull()
+}
+
 export const workspace = pgTable(
   'workspace',
   {
@@ -2198,9 +2212,7 @@ export const workspace = pgTable(
     organizationScopeKey: text('organization_scope_key').generatedAlwaysAs(
       sql`CASE WHEN organization_id IS NULL THEN 'personal' ELSE 'organization:' || organization_id END`
     ),
-    projectId: text('project_id')
-      .notNull()
-      .references((): AnyPgColumn => project.id, { onDelete: 'restrict' }),
+    projectId: workspaceProjectIdColumn(),
     workspaceMode: workspaceModeEnum('workspace_mode').notNull().default('grandfathered_shared'),
     billedAccountUserId: text('billed_account_user_id')
       .notNull()