hanzoai/datastore
2
0
Fork 0
mirror of https://github.com/hanzoai/datastore.git synced 2026-09-26 13:55:07 +00:00
Code Issues Packages Projects Releases Wiki Activity
240,144 Commits 5 Branches 2,005 Tags
c3b1b776ea463091c235b78d85b245d803e08db9
Commit Graph
1881 Commits
Author SHA1 Message Date
Alexey Milovidov c3b1b776ea Merge remote-tracking branch 'origin/master' into add-executable-udf-drivers 
# Conflicts:
#	src/Interpreters/Context.h
 2026-06-14 02:01:27 +00:00
Alexey MilovidovandGitHub 40359661e7 Merge pull request #101447 from tuanpach/fix-workload-storage-lifetime-race 
Fix use-after-free of workload storage mutex during server shutdown
 2026-06-13 20:40:44 +00:00
Alexey MilovidovandGitHub 436c6f159d Merge pull request #104964 from ClickHouse/memory-worker-dynamic-limit 
Dynamically adjust memory limit based on system free/cached memory
 2026-06-12 19:39:27 +00:00
Alexey MilovidovandClaude Fable 5 272db20fa0 Add memory_worker_dynamic_hard_limit setting to opt out of the runtime limit adjustment 
Address review: a positive max_server_memory_usage_to_ram_ratio used to
opt the server into runtime hard-limit shrinking with no way to keep the
previous static cap, while setting the ratio to 0 removed the cap
entirely. The new memory_worker_dynamic_hard_limit server setting
(enabled by default) gates only the runtime adjustment: when disabled,
max_server_memory_usage_to_ram_ratio caps the hard memory limit
statically at startup and on configuration reload, exactly as in
previous versions.

Co-Authored-By: Claude Fable 5 <[email protected]>
 2026-06-11 16:17:04 +00:00
Azat KhuzhinandGitHub 32cedf25cc Merge pull request #101942 from fastio/feature-oom-canary 
Add OOM canary: a sacrificial child process to protect the server from the OOM killer
 2026-06-11 12:17:44 +00:00
Raúl MarínandGitHub 4190813eef Merge pull request #107033 from Algunenano/darwin-thread-stack-size 
Use an 8 MiB thread stack on Darwin to avoid stack overflow in JIT codegen
 2026-06-11 10:21:16 +00:00
Alexey Milovidov c8328abbd9 Revert "Merge pull request #106020 from ClickHouse/multistage_distributed_queries" 
This reverts commit c3131f3265, reversing
changes made to 4f3fe68b90.
 2026-06-11 01:27:26 +00:00
Alexey Milovidov 1fa92f9aec Revert "Merge pull request #106978 from ClickHouse/distributed-plan-shrink-idle-thread-pools" 
This reverts commit 4f2c87963e, reversing
changes made to 56d78b5c22.
 2026-06-11 01:27:11 +00:00
Alexander GololobovandGitHub e9e12b9017 Merge pull request #106978 from ClickHouse/distributed-plan-shrink-idle-thread-pools 
Shrink idle thread pools of the distributed query infrastructure
 2026-06-10 19:04:48 +00:00
Raúl Marín 103d070e24 Use an 8 MiB thread stack on Darwin to avoid stack overflow in JIT codegen 2026-06-10 18:29:42 +02:00
Alexander GololobovandClaude Fable 5 f2a5248652 Reject stateless_worker_server.max_threads=0 
Co-Authored-By: Claude Fable 5 <[email protected]>
 2026-06-10 15:55:09 +02:00
Alexey Milovidov ee08129f75 Merge remote-tracking branch 'origin/master' into add-executable-udf-drivers 2026-06-10 13:44:46 +00:00
Alexander GololobovandClaude Fable 5 fccf8073bb Shrink idle thread pools of the distributed query infrastructure 
Co-Authored-By: Claude Fable 5 <[email protected]>
 2026-06-10 15:35:21 +02:00
Miсhael StetsyukandGitHub 4e2a34fe26 Merge pull request #106727 from ClickHouse/fix-startup-scripts-reload 
Fix logical error in startup scripts in SYSTEM RELOAD CONFIG
 2026-06-10 12:39:10 +00:00
Michael Stetsyuk 80bf58fa66 do not rename os thread in loadStartupScripts 2026-06-09 18:25:56 +00:00
Michael Stetsyuk 607c541231 Fix logical error in startup scripts in SYSTEM RELOAD CONFIG 2026-06-08 14:58:01 +00:00
Alexey Milovidov 2d67c3c0c5 Merge remote-tracking branch 'origin/master' into memory-worker-dynamic-limit 2026-06-07 04:44:12 +00:00
Alexey Milovidov 20b1a2928e Merge remote-tracking branch 'origin/master' into add-executable-udf-drivers 2026-06-07 02:55:28 +00:00
Alexey MilovidovandClaude Opus 4.8 6e5d95a75c Fix shutdown-concurrent lifetime race in lazy resource-manager init 
The previous fix protected `PipelineExecutor::allocateCPU` and the
query-execution callers, but the lazy initialization of the resource
manager still observed the same shutdown race.

`Context::getWorkloadClassifier` initializes the resource manager lazily
through `getResourceManager`, which calls `createResourceManager`. That
passed `getWorkloadEntityStorage()` (a raw reference whose owning
`shared_ptr` temporary is destroyed at the end of the full expression),
so no owner was held across `WorkloadResourceManager`'s constructor while
it runs `getAllEntitiesAndSubscribe`. If this first lazy init overlaps
shutdown's reset of `workload_entity_storage`, the storage can be
destroyed while the constructor is still using it — the same
`recursive_mutex` use-after-free this PR set out to fix.

Make `WorkloadResourceManager` take and retain a
`shared_ptr<IWorkloadEntityStorage>`, and have `createResourceManager`
pass `getWorkloadEntityStoragePtr`. The storage is only touched in the
constructor, so holding the owner for the manager's lifetime is more than
sufficient.

Also remove the now-unused reference accessor
`Context::getWorkloadEntityStorage` (the last caller in `Server.cpp`'s
startup `loadEntities` is migrated to `getWorkloadEntityStoragePtr`), so
the shutdown-unsafe accessor can no longer be reintroduced.

Co-Authored-By: Claude Opus 4.8 (1M context) <[email protected]>
 2026-06-06 11:53:22 +00:00
Alexander Gololobov 1740db5ef3 Merge branch 'master' of github.com:ClickHouse/ClickHouse into multistage_distributed_queries 2026-06-06 09:35:45 +02:00
Miсhael StetsyukandGitHub eb3f7f5fe8 Merge pull request #105617 from ClickHouse/system-keeper-changelogs 
Add system.keeper_changelogs table
 2026-06-05 11:10:40 +00:00
Alexey Milovidov d7ded9b04d Merge remote-tracking branch 'origin/master' into memory-worker-dynamic-limit 2026-06-05 02:18:09 +00:00
Alexey Milovidov 5aa4384131 Merge remote-tracking branch 'origin/master' into add-executable-udf-drivers 2026-06-04 22:29:12 +00:00
Alexander GololobovandClaude Opus 4.8 482675907a Require explicit listen host to enable the streaming exchange server 
Co-Authored-By: Claude Opus 4.8 (1M context) <[email protected]>
 2026-06-04 17:01:51 +02:00
Michael Stetsyuk 3cb79ab57c Gate system.keeper_changelogs behind USE_NURAFT 
Fixes FreeBSD build: tryGetKeeperDispatcher is only declared when
USE_NURAFT is set, and the storage's transitive includes pull in NuRaft
headers.
 2026-06-04 13:28:35 +00:00
Michael StetsyukandClaude Opus 4.7 c44734622f Add system.keeper_changelogs table 
New keeper-only system table with one row per on-disk Raft log file
(changelog_<from>_<to>.bin[.zstd]) tracked by the in-process Keeper.
Mirrors the plumbing of system.keeper_snapshots.

Co-Authored-By: Claude Opus 4.7 (1M context) <[email protected]>
 2026-06-04 13:28:35 +00:00
Alexander GololobovandClaude Opus 4.8 6ee7ca2b55 Remove the configured stateless worker endpoint name on shutdown 
Co-Authored-By: Claude Opus 4.8 (1M context) <[email protected]>
 2026-06-04 09:43:22 +02:00
murphy-4oandGitHub 31874f78ed Merge branch 'master' into uk-pr-7-dense-index-cache 2026-06-04 12:13:20 +08:00
Alexander GololobovandClaude Opus 4.7 26286be55c Validate distributed-plan config and settings 
Co-Authored-By: Claude Opus 4.7 (1M context) <[email protected]>
 2026-06-03 16:02:09 +02:00
Alexey MilovidovandGitHub b7e8361a28 Merge branch 'master' into multistage_distributed_queries 2026-06-03 00:39:00 -07:00
Alexander Gololobov e4bca96054 Match private master indentation for OS_LINUX block in Server.cpp 2026-06-03 04:42:15 +02:00
Alexey Milovidov 812979eb6a Merge remote-tracking branch 'origin/master' into memory-worker-dynamic-limit 2026-06-02 15:49:44 +00:00
PengandGitHub dc9662de1a Merge branch 'ClickHouse:master' into feature-oom-canary 2026-06-02 21:26:55 +08:00
Alexey MilovidovandGitHub 842b133f8d Merge pull request #100399 from ClickHouse/clang-tidy-init-variables 
Enable clang-tidy check for uninitialized variables
 2026-05-31 21:56:29 -07:00
Alexander Gololobov 12a1e63d3a Merge branch 'master' of github.com:ClickHouse/ClickHouse into multistage_distributed_queries 2026-05-31 19:40:55 -07:00
Alexey Milovidov 1e4a7a281f Merge remote-tracking branch 'origin/master' into clang-tidy-init-variables 2026-05-30 05:15:32 +00:00
PengandGitHub 1b729457b8 Merge branch 'ClickHouse:master' into feature-oom-canary 2026-05-29 18:05:16 +08:00
Alexey Milovidov ab6cd89b58 Merge remote-tracking branch 'origin/master' into fix-compiler-warnings 
# Conflicts:
#	src/AggregateFunctions/fuzzers/aggregate_function_state_deserialization_fuzzer.cpp
#	src/Client/BuzzHouse/AST/SQLProtoStr.cpp
#	src/Functions/UserDefined/UserDefinedWebAssembly.cpp
#	src/IO/examples/parse_int_perf.cpp
#	src/Processors/QueryPlan/Optimizations/removeUnusedColumns.cpp
#	src/TableFunctions/TableFunctionMergeTreeAnalyzeIndexes.cpp
 2026-05-29 02:17:22 +00:00
Alexey Milovidov 4f5306e16f Merge remote-tracking branch 'origin/master' into memory-worker-dynamic-limit 
# Conflicts:
#	programs/server/Server.cpp
 2026-05-29 01:49:17 +00:00
Alexey Milovidov 5199ee1a3d Merge remote-tracking branch 'origin/master' into add-executable-udf-drivers 2026-05-29 00:12:39 +00:00
Alexander Gololobov 980c435a06 Merge branch 'master' of github.com:ClickHouse/ClickHouse into multistage_distributed_queries 2026-05-28 11:13:06 -07:00
Alexander Gololobov 4fe6f8d12e Address review nits 2026-05-28 09:47:10 -07:00
Nikita TaranovandGitHub bd6d798801 Merge pull request #100242 from ClickHouse/enable_query_profiler_under_sanitizers 
Enable query profiler under sanitizers
 2026-05-28 13:29:19 +00:00
PengandGitHub ccacb4afc9 Merge branch 'ClickHouse:master' into feature-oom-canary 2026-05-28 18:07:12 +08:00
Alexander GololobovandGitHub 9896ad302e Merge branch 'master' into multistage_distributed_queries 2026-05-27 17:25:11 -07:00
Alexey Milovidov d5538f7d5d Merge remote-tracking branch 'origin/master' into clang-tidy-init-variables 
# Conflicts:
#	src/Compression/CompressionCodecALP.cpp
#	src/Functions/UserDefined/UserDefinedWebAssembly.cpp
#	src/IO/AzureBlobStorage/copyAzureBlobStorageFile.cpp
#	src/Interpreters/WasmModuleManager.h
#	src/Parsers/CreateQueryUUIDs.cpp
#	src/Storages/StorageTimeSeries.h
#	src/Storages/TimeSeries/PrometheusRemoteWriteProtocol.cpp
 2026-05-27 22:00:22 +00:00
Azat KhuzhinandGitHub cf3ab8d0f5 Merge pull request #105265 from azat/memory-tracker-min-alloc-throw-size 
RFC: Add a server setting to allow any allocation to throw MEMORY_LIMIT_EXCEEDED
 2026-05-27 18:31:23 +00:00
fastio 6e497f91cf OOM canary: address review feedback 2026-05-27 11:07:14 +08:00
PengandGitHub e1e13112b9 Merge branch 'ClickHouse:master' into feature-oom-canary 2026-05-26 09:46:44 +08:00
“JiaQi 1d8300c8d1 Merge branch 'master' into kafka-disable-streaming 2026-05-25 09:13:43 +08:00