Files
chains/aivm/quorum_state.go
zeekay eb02967a9a aivm: one staging layer, one commit, one chain
A-Chain kept the tip only in memory, staged every pending block's writes
in one shared versiondb, and accepted a block by committing that layer
before storing the block. So a restart came back at genesis, accepting A
published B's intent, rejecting B discarded A's, and a failed store left
the state durable and the block gone.

Verify and BuildBlock now decide against an overlay over committed state
and throw it away, so a block that is proposed or checked moves nothing.
Accept stages the transition, the block, its height entry and the tip
through one view and commits them once. Custody moves into engine state,
so balances commit with the stake records that depend on them instead of
living beside them in memory.

Verify also gains the lineage, time and size checks it never had: the
parent must be the tip or a block in flight above it, the height must
follow, the timestamp must sit between the parent's and the local clock
plus a skew allowance, and the encoding must be one a peer will accept.
Accept re-checks the tip under the lock that commits, because it moves
between the two calls.

A block is now named under its chain id, which never travels, so the same
bytes name different blocks on different chains. Nested payloads must
account for their blob exactly, id lists must be whole ids, and an
element the encoder cannot write is reported rather than dropped. A
merkle proof's index must be spent by the fold, so an out-of-range index
no longer verifies on its low bits.

Also: the running flag is read under the lock that writes it, a vertex no
longer moves the block chain's head, and eligibleSet says what its quorum
is a quorum of.

The ten probe files that proved all this are converted to regression
tests, not deleted.
2026-08-28 15:03:32 -07:00

290 lines
12 KiB
Go

// Copyright (C) 2019-2025, Lux Industries Inc. All rights reserved.
// See the file LICENSE for licensing terms.
package aivm
// quorum_state.go is the storage + custody SUBSTRATE the A-Chain quorum
// settlement engine runs on. It is the one place that knows how engine state is
// keyed and where native value lives. Everything above it (provider, task,
// selection, commit-reveal, settlement, receipts, import/export) is pure logic
// over these two interfaces — exactly the StateDB/Ledger split the proven
// hanzo-evm aiquorum precompile used, ported here to A-Chain-native types.
//
// Why a split:
// - QuorumState is opaque 32-byte slot storage. On a live A-Chain it is
// backed by the VM's keyed DB (state committed under consensus in
// Accept); in tests it is an in-memory map. The engine never cares which.
// - QuorumLedger is native-token custody around a SINGLE escrow account
// (EscrowAccount). Pull moves funds in, Pay moves funds out. Both are
// atomic and fail-closed. No value-bearing call is ever made (every money
// move is a balance mutation), so there is no reentrancy surface through
// stake, escrow, pay, or slash.
//
// Slot derivation is keccak over a namespace tuple, so distinct record kinds
// can never alias keyspaces. Identical scheme to the proven precompile.
import (
"github.com/holiman/uint256"
"github.com/luxfi/crypto"
"github.com/luxfi/geth/common"
)
// EscrowAccount is the single account that holds all engine-custodied native
// value: bonded provider stake, open job reward escrow, and unwithdrawn credit.
// It holds no code; all movement is balance mutation. The conservation
// invariant the engine maintains and the tests assert:
//
// balance(EscrowAccount) == sum(bonded stake)
// + sum(open job escrow)
// + sum(unwithdrawn credit)
//
// at every step, and the grand total over all accounts is constant.
var EscrowAccount = common.HexToAddress("0xA1A1A1A1A1A1A1A1A1A1A1A1A1A1A1A1A1A1A1A1")
// QuorumState is the minimal slot-level storage the engine needs. On A-Chain
// the VM adapts its DB to this (writes land in a block and commit under
// consensus at Accept); the in-memory MemState satisfies it for tests.
type QuorumState interface {
GetState(slot common.Hash) common.Hash
SetState(slot, value common.Hash)
}
// QuorumLedger is the native-value custody interface bound to EscrowAccount.
// Pull(from, amt) debits `from` and credits the escrow; Pay(to, amt) debits the
// escrow and credits `to`. Both are atomic and fail-closed (no partial state on
// error). GetBalance reads any account.
type QuorumLedger interface {
GetBalance(a common.Address) *uint256.Int
Pull(from common.Address, amount *uint256.Int) error
Pay(to common.Address, amount *uint256.Int) error
// Credit mints into an account. It is the genesis/deposit seam — the host
// L1 crediting an A-Chain account at chain birth or via a verified
// cross-chain deposit — and the only way value enters. Pull and Pay only
// move what Credit put there.
Credit(a common.Address, amount *uint256.Int) error
}
// ---------------------------------------------------------------------------
// The value arithmetic, once.
// ---------------------------------------------------------------------------
// balances is where an account's number is kept. It is the ONLY thing the two
// ledgers below differ in: one keeps them in a map, the other in engine state.
// Everything that decides whether value may move is written once, against this,
// so an in-memory ledger and a chain-state ledger cannot drift into different
// answers about an overdraft.
type balances interface {
get(a common.Address) *uint256.Int
set(a common.Address, v *uint256.Int)
}
// credit mints amount into a. Fail-closed on overflow; no write on error.
func credit(b balances, a common.Address, amount *uint256.Int) error {
nv := new(uint256.Int)
if _, over := nv.AddOverflow(b.get(a), amount); over {
return ErrCreditOverflow
}
b.set(a, nv)
return nil
}
// pull debits from by amount and credits EscrowAccount. Fail-closed on
// insufficient balance or overflow; no write on error.
func pull(b balances, from common.Address, amount *uint256.Int) error {
src := b.get(from)
if src.Lt(amount) {
return ErrInsufficientFunds
}
ne := new(uint256.Int)
if _, over := ne.AddOverflow(b.get(EscrowAccount), amount); over {
return ErrStakeOverflow
}
b.set(from, new(uint256.Int).Sub(src, amount))
b.set(EscrowAccount, ne)
return nil
}
// pay debits EscrowAccount by amount and credits to. Fail-closed on escrow
// underflow (a hard invariant breach) or recipient overflow.
func pay(b balances, to common.Address, amount *uint256.Int) error {
esc := b.get(EscrowAccount)
if esc.Lt(amount) {
return ErrEscrowUnderflow
}
nd := new(uint256.Int)
if _, over := nd.AddOverflow(b.get(to), amount); over {
return ErrCreditOverflow
}
b.set(EscrowAccount, new(uint256.Int).Sub(esc, amount))
b.set(to, nd)
return nil
}
// stateLedger keeps native balances in engine state. It is what the VM runs on,
// and it is the reason value now moves the way everything else does: through the
// block's staging layer, committed in the block's single write, and durable
// across a restart. Held beside the state instead, a ledger had to be staged,
// rolled back and committed in step with it — and the two halves were not in
// step, so a restart came back with the stake records and none of the balances.
type stateLedger struct{ st QuorumState }
func newStateLedger(st QuorumState) *stateLedger { return &stateLedger{st: st} }
func (l *stateLedger) get(a common.Address) *uint256.Int {
return new(uint256.Int).SetBytes(l.st.GetState(slotAddr(nsBalance, a)).Bytes())
}
func (l *stateLedger) set(a common.Address, v *uint256.Int) {
l.st.SetState(slotAddr(nsBalance, a), h32(v))
}
func (l *stateLedger) GetBalance(a common.Address) *uint256.Int { return l.get(a) }
func (l *stateLedger) Credit(a common.Address, amount *uint256.Int) error {
return credit(l, a, amount)
}
func (l *stateLedger) Pull(from common.Address, amount *uint256.Int) error {
return pull(l, from, amount)
}
func (l *stateLedger) Pay(to common.Address, amount *uint256.Int) error { return pay(l, to, amount) }
// ---------------------------------------------------------------------------
// In-memory substrate (tests + single-process engine; the live VM swaps in a
// DB-backed QuorumState committed under consensus).
// ---------------------------------------------------------------------------
// MemState is an in-memory QuorumState: a flat slot map. Zero value is NOT
// usable; use NewMemState.
type MemState struct {
m map[common.Hash]common.Hash
}
// NewMemState returns an empty in-memory state.
func NewMemState() *MemState { return &MemState{m: make(map[common.Hash]common.Hash)} }
// GetState returns the value at slot (zero hash if unset).
func (s *MemState) GetState(slot common.Hash) common.Hash { return s.m[slot] }
// SetState writes value at slot.
func (s *MemState) SetState(slot, value common.Hash) { s.m[slot] = value }
// MemLedger is an in-memory QuorumLedger over a balance map, custodying funds at
// EscrowAccount. Use NewMemLedger.
type MemLedger struct {
bal map[common.Address]*uint256.Int
}
// NewMemLedger returns a ledger with the given opening balances (copied).
func NewMemLedger(opening map[common.Address]*uint256.Int) *MemLedger {
bal := make(map[common.Address]*uint256.Int, len(opening)+1)
for a, v := range opening {
bal[a] = new(uint256.Int).Set(v)
}
if _, ok := bal[EscrowAccount]; !ok {
bal[EscrowAccount] = uint256.NewInt(0)
}
return &MemLedger{bal: bal}
}
func (l *MemLedger) get(a common.Address) *uint256.Int {
if v, ok := l.bal[a]; ok {
return new(uint256.Int).Set(v)
}
return uint256.NewInt(0)
}
func (l *MemLedger) set(a common.Address, v *uint256.Int) { l.bal[a] = v }
// GetBalance returns a copy of the account's balance (zero if unknown).
func (l *MemLedger) GetBalance(a common.Address) *uint256.Int { return l.get(a) }
// Credit mints `amount` into `a`'s balance.
func (l *MemLedger) Credit(a common.Address, amount *uint256.Int) error {
return credit(l, a, amount)
}
// Pull debits `from` by amount and credits EscrowAccount.
func (l *MemLedger) Pull(from common.Address, amount *uint256.Int) error {
return pull(l, from, amount)
}
// Pay debits EscrowAccount by amount and credits `to`.
func (l *MemLedger) Pay(to common.Address, amount *uint256.Int) error { return pay(l, to, amount) }
// Total returns the grand-total balance over every account (for the
// conservation invariant test). Pure read.
func (l *MemLedger) Total() *uint256.Int {
sum := uint256.NewInt(0)
for _, v := range l.bal {
sum.Add(sum, v)
}
return sum
}
// ---------------------------------------------------------------------------
// State-slot namespaces. Distinct prefixes guarantee the keccak keyspaces of
// different record kinds never collide. Mirrors the proven precompile's layout,
// renamed to the A-Chain (av/) namespace so it never aliases a C-Chain
// precompile's slots even if they ever shared a store.
// ---------------------------------------------------------------------------
var (
nsOperator = []byte("av/op") // operator registry meta
nsModelIndex = []byte("av/mspec.idx") // per-ModelSpec operator-array length
nsModelMember = []byte("av/mspec.mem") // per-ModelSpec operator-array element
nsModelSeen = []byte("av/mspec.seen") // per-(ModelSpec,operator) membership flag
nsBalance = []byte("av/bal") // native account balance (chain custody)
nsCredit = []byte("av/cred") // operator withdrawable credit ledger
nsReqNonce = []byte("av/req.nonce") // requester monotonic nonce
nsTask = []byte("av/task") // task record (status + params) *** also job_id domain
nsTaskReward = []byte("av/task.reward") // task rewardPerOperator (uint256)
nsTaskEscrow = []byte("av/task.escrow") // task remaining escrow (uint256)
nsTaskIntent = []byte("av/task.intent") // task -> source C intent id
nsTaskFee = []byte("av/task.fee") // task fee paid (uint256, for the receipt)
nsSelected = []byte("av/sel") // per-(task,operator) selection flag
nsSelList = []byte("av/sel.list") // per-task selected-operator-array element
nsCommit = []byte("av/commit") // per-(task,operator) commit hash
nsReveal = []byte("av/reveal") // per-(task,operator) revealed output_hash
nsRevealFlag = []byte("av/reveal.f") // per-(task,operator) revealed flag
nsRevealList = []byte("av/reveal.list") // per-task revealer-array element
nsRevealCount = []byte("av/reveal.cnt") // per-task revealer count
nsSettled = []byte("av/settled") // per-task settled marker (replay guard)
nsCanonical = []byte("av/canon") // per-task canonical output_hash
nsReceiptRoot = []byte("av/receipt.root") // running receipt_root accumulator
nsReceiptIdx = []byte("av/receipt.idx") // count of settled receipts in the root
nsReceiptLeaf = []byte("av/receipt.leaf") // settled receipt_hash by index (for proofs)
nsIntentSeen = []byte("av/intent.seen") // per-C-intent consumed marker (anti-replay)
nsIntentTask = []byte("av/intent.task") // per-C-intent -> A-chain task id
nsIntentRcpt = []byte("av/intent.rcpt") // per-C-intent settled-receipt leaf index+1 (0 = unsettled)
nsTaskHeight = []byte("av/task.height") // per-task settled height (so receipt is reproducible)
)
// ---------------------------------------------------------------------------
// Slot derivation (keccak of a namespace tuple).
// ---------------------------------------------------------------------------
func slotAddr(ns []byte, a common.Address) common.Hash {
return common.BytesToHash(crypto.Keccak256(ns, a.Bytes()))
}
func slotHash(ns []byte, h common.Hash) common.Hash {
return common.BytesToHash(crypto.Keccak256(ns, h.Bytes()))
}
func slotHashAddr(ns []byte, h common.Hash, a common.Address) common.Hash {
return common.BytesToHash(crypto.Keccak256(ns, h.Bytes(), a.Bytes()))
}
func slotHashIdx(ns []byte, h common.Hash, idx uint32) common.Hash {
return common.BytesToHash(crypto.Keccak256(ns, h.Bytes(), u32be(idx)))
}
func slotNS(ns []byte) common.Hash {
return common.BytesToHash(crypto.Keccak256(ns))
}
func slotNSIdx(ns []byte, idx uint32) common.Hash {
return common.BytesToHash(crypto.Keccak256(ns, u32be(idx)))
}