68bac2a70e turbopack: reduce EffectStateStorage memory by storing u128 content hashes (#92902)
### What?

In `turbo-tasks-fs`, the `WriteEffect` and `WriteLinkEffect` structs now
store a precomputed `u128` xxh3 content hash instead of returning the
full `ReadRef<PersistedFileContent>` / `ReadRef<LinkContent>` from their
`Effect::value()` implementations.

The associated type `Effect::Value` is changed from
`ReadRef<PersistedFileContent>` / `ReadRef<LinkContent>` to `u128` for
both effect types.

`LinkContent` gains a `DeterministicHash` derive to support hashing via
`hash_xxh3_hash128`.

### Why?

`EffectStateStorage` stores the last-applied value for each effect key
in `last_applied: Mutex<Option<Box<dyn Any + Send + Sync>>>` to enable a
double-checked deduplication fast path (skip re-writing a file if
content hasn't changed). In long-running sessions this map grows
continuously and holds onto a lot of memory because it stores full file
content (`ReadRef<PersistedFileContent>`) or full link content
(`ReadRef<LinkContent>`) for every file ever written.

Storing a `u128` hash (16 bytes) instead of the full content
significantly reduces memory usage while preserving the deduplication
semantics (hash equality implies content equality with negligible
collision probability).

### How?

- Added `content_hash: u128` field to `WriteEffect` and
`WriteLinkEffect`, computed at construction time using
`hash_xxh3_hash128` (xxh3 128-bit non-cryptographic hash, already used
elsewhere in turbopack for content addressing).
- Changed `Effect::Value = u128` for both effect types; `value()`
returns `&self.content_hash`.
- The `EffectStateStorage` now stores `Box<u128>` (24 bytes on the heap)
per entry instead of `Box<ReadRef<...>>` which held a reference-counted
pointer into potentially large file content.
- No changes to `EffectStateStorage`, `Effects::apply()`, or `DynEffect`
vtable — the existing `Any`/`DynPartialEq` machinery works transparently
with `u128`.

<!-- NEXT_JS_LLM_PR -->

Co-authored-by: Tobias Koppers <[email protected]>
Co-authored-by: Claude <[email protected]>
2026-04-17 09:14:42 +02:00
2025-10-13 10:43:51 +02:00
2024-06-28 04:41:35 -07:00
2026-04-16 23:29:15 +00:00
2025-01-02 14:31:08 -08:00
2026-04-16 23:29:15 +00:00
…
2024-08-14 13:05:42 +00:00

Next.js logo

Next.js

Vercel logo NPM version License Join the community on GitHub

Getting Started

Used by some of the world's largest companies, Next.js enables you to create full-stack web applications by extending the latest React features, and integrating powerful Rust-based JavaScript tooling for the fastest builds.

Documentation

Visit https://nextjs.org/docs to view the full documentation.

Community

The Next.js community can be found on GitHub Discussions where you can ask questions, voice ideas, and share your projects with other people.

To chat with other community members you can join the Next.js Discord server.

Do note that our Code of Conduct applies to all Next.js community channels. Users are highly encouraged to read and adhere to it to avoid repercussions.

Contributing

Contributions to Next.js are welcome and highly appreciated. However, before you jump right into it, we would like you to review our Contribution Guidelines to make sure you have a smooth experience contributing to Next.js.

Good First Issues:

We have a list of good first issues that contain bugs that have a relatively limited scope. This is a great place for newcomers and beginners alike to get started, gain experience, and get familiar with our contribution process.


Security

If you believe you have found a security vulnerability in Next.js, we encourage you to responsibly disclose this and NOT open a public issue.

To participate in our Open Source Software Bug Bounty program, please email [email protected]. We will add you to the program and provide further instructions for submitting your report.

S
Description
The React Framework
Readme
2.4 GiB
Languages
JavaScript 55.6%
TypeScript 30%
Rust 12.9%
MDX 0.7%
CSS 0.7%