Files
insights/rust/cyclotron-node-migrations/20260616000001_add_email_fair_dequeue_columns.sql
zeekay 1b367e2b62 chore: rebase the tree onto upstream master
The tree was a debranded snapshot of upstream taken around 2026-02-20, and
upstream has moved about five months since. This replaces it with upstream
master, mechanically re-derived: bin/debrand does the rename, and the
pipeline and squashed migrations are restored from the shipped tree.

Not a merge. The previous import replaced the tree wholesale in a single
commit, so there is no shared content history to merge against. Reproducing
the rename on the new tree is what actually converges.

What survives: .hanzo/workflows, the Dockerfiles and bin/docker* entrypoints,
compose files, LLM.md, and insights/migrations. The squashed initial
migration is load-bearing — the live database records it by name, so
upstream's ~918 individual migrations cannot come back.

Nine products are dropped as unreferenced. Twenty-one more that we do not run
are kept anyway because the core app still imports them; unpicking those is a
refactor and does not belong in a rebase.

This base does not build yet, and the reasons are not in the rename:
upstream now wants Python 3.13.13 against our 3.12.12 and Django 5.2 against
our 4.2, and the dependency manifests still name upstream packages that we
republish under our own names. Those are decisions, not renames.
2026-08-01 15:44:40 -07:00

24 lines
1.0 KiB
SQL
Raw Permalink Blame History

This file contains ambiguous Unicode characters
This file contains Unicode characters that might be confused with other characters. If you think that this is intentional, you can safely ignore this warning. Use the Escape button to reveal them.
-- Fair dequeue for the email queue, scoped to queue_name='email'.
--
-- `dequeue_seq` is a precomputed sort key assigned at insert time so the
-- email worker's dequeue ORDER BY stays cheap (no window functions, no
-- recursive CTEs). It interleaves jobs across tenants: each tenant's first
-- job sorts together, then each tenant's second job, etc. A new tenant's
-- single email no longer waits behind another tenant's 2M-email campaign.
--
-- The column is NULL for non-email jobs — completely transparent to the
-- script/hogflow worker paths.
ALTER TABLE cyclotron_jobs
ADD COLUMN IF NOT EXISTS dequeue_seq BIGINT;
-- Per-team monotonic counter, used to compute dequeue_seq at insert time:
-- dequeue_seq = counter × 16,777,216 + team_id
--
-- One row per team that has ever sent an email. BIGINT gives ~5 × 10^11
-- jobs per team of headroom before sort_number overflow at the chosen
-- block size (decades at any realistic email volume).
CREATE TABLE IF NOT EXISTS cyclotron_email_team_seq (
team_id INT PRIMARY KEY,
counter BIGINT NOT NULL
);