Commit Graph
1630 Commits
Author SHA1 Message Date
Nikolai KochetovandGitHub 443bf8095c Merge pull request #95003 from ClickHouse/check-memory-limit-earlier
Check total memory limit overflow earlier.
2026-02-19 15:17:04 +00:00
Nikolai KochetovandGitHub ad9d023146 Update Server.cpp 2026-02-17 18:57:52 +01:00
Robert Schulze 24a90cdc06 Fix build 2026-02-16 21:36:59 +00:00
Alexey MilovidovandGitHub 44408616c7 Merge pull request #80295 from ClickHouse/respect-command-line-overrides-while-reloading-config
Respect command-line overrides when reloading configuration
2026-02-16 20:43:39 +01:00
Alexey Milovidov 223e53c76d Revert "Merge pull request #89750 from grantholly-clickhouse/parquet_footer_cache"
This reverts commit 5243ef786e, reversing
changes made to 6e3a5ad955.
2026-02-13 01:03:02 +01:00
Nikolai KochetovandGitHub 951d955d71 Merge branch 'master' into check-memory-limit-earlier 2026-02-11 19:25:04 +01:00
Miсhael StetsyukandGitHub 03df599806 Merge pull request #96524 from ClickHouse/hot-reload-core_dumps
Make core dump size limit configuration setting hot-reloadable
2026-02-10 19:03:06 +00:00
Nikolai Kochetov f17a6e12a7 Merge branch 'master' into check-memory-limit-earlier 2026-02-10 19:03:53 +01:00
Ilya YatsishinandGitHub 2da7b40d7a Revert "Fix relative config paths resolving against wrong directory after chdir" 2026-02-10 13:16:15 +01:00
Michael Stetsyuk e1b6c70a8a make core dump size limit configuration setting hot reloadable 2026-02-10 11:07:51 +00:00
divanik 5c33f119b5 Merge branch 'master' of github.com:ClickHouse/ClickHouse into parquet_footer_cache 2026-02-09 13:28:20 +01:00
Alexey MilovidovandClaude Opus 4.6 cbfa7d9f5a Fix test_server_no_logging by restoring log level before accepting connections
The config reload callback (`ConfigReloader`) fires during construction with
`initial_loading=true`. After the change to use `updateLevels(config(), ...)`
instead of `updateLevels(*config, ...)`, the callback reads `logger.level`
from the layered configuration, where the writable `MapConfiguration` at
`PRIO_APPLICATION` still holds the startup level override ("trace"). This
keeps the log level at "trace" until the explicit restoration after
`server.start()`, creating a window where HTTP requests get logged at
trace level.

Move the startup level restoration to before `server.start()` so that
no requests are ever served with the elevated startup log level.

https://s3.amazonaws.com/clickhouse-test-reports/json.html?PR=80295&sha=c7c2c8bd852fc40cf3640ee5810c7976dcfda96c&name_0=PR&name_1=Integration%20tests%20%28amd_tsan%2C%201%2F6%29

Co-Authored-By: Claude Opus 4.6 <[email protected]>
2026-02-08 12:08:50 +01:00
Alexey MilovidovandClaude Opus 4.6 e49958ad29 Use replace for ZK includes config reload; add integration test
Fix the ZK includes reload path in `Server.cpp` to use
`config().replace` instead of `removeConfiguration`/`add`/`setConfig`,
consistent with the reload callback. This ensures command-line overrides
are preserved when ZK includes are loaded.

Add integration test `test_config_not_overriding_args` that verifies
command-line arguments are not overridden by config file values
(including when ZK includes are used). Based on the test from #71452.

Co-Authored-By: Claude Opus 4.6 <[email protected]>
2026-02-08 07:21:07 +01:00
Alexey MilovidovandClaude Opus 4.6 9c9af9f585 Rename replaceByLabel to replace
Co-Authored-By: Claude Opus 4.6 <[email protected]>
2026-02-08 00:14:02 +01:00
Alexey MilovidovandClaude Opus 4.6 0e1b9c066d Fix use-after-free in replaceByLabel by using shared ownership
The `replaceByLabel` calls in `Server.cpp` and `Keeper.cpp` passed
`shared = false`, which means the `AutoPtr` inside `LayeredConfiguration`
took the raw pointer without incrementing the reference count. But the
caller's `loaded_config` `AutoPtr` also holds a reference. When the
callback's `loaded_config` goes out of scope, its destructor decrements
the reference count, potentially freeing the object while the
`LayeredConfiguration` still holds a pointer to it.

Passing `shared = true` makes the `AutoPtr` constructor call `duplicate`,
properly incrementing the reference count so the `LayeredConfiguration`
has its own counted reference.

Co-Authored-By: Claude Opus 4.6 <[email protected]>
2026-02-07 23:48:47 +01:00
Grant Holly d4179cbd85 merging in upstream master 2026-02-07 13:16:29 -08:00
Alexey MilovidovandClaude Opus 4.6 aa7578d2d0 Fix relative config paths resolving against wrong directory after chdir
`BaseDaemon::initialize` performs up to 3 `chdir` calls during daemon
startup (to application path, log path, and cores directory). After
`initialize` returns, `Server::main` reads path settings from config.
If those paths are relative, they resolve against the cores directory
instead of the original startup directory.

Fix by capturing the original working directory at the start of
`BaseDaemon::initialize` and using it to resolve the main `path`
setting to absolute. All secondary path settings (like `user_files_path`,
`tmp_path`, `format_schema_path`, etc.) are resolved relative to the
now-absolute main `path`.

Co-Authored-By: Claude Opus 4.6 <[email protected]>
2026-02-07 06:09:00 +01:00
Alexey MilovidovandClaude Opus 4.6 8774f046fc Add atomic replaceByLabel to LayeredConfiguration for thread-safe config reload
The config reload callback in `Server.cpp` and `Keeper.cpp` was doing
`find` + `removeConfiguration` + `add` on the shared `LayeredConfiguration`
from the `ConfigReloader` thread. This is not thread-safe because concurrent
readers (calling `getString`, etc.) iterate the same internal list without
synchronization against structural modifications.

`AbstractConfiguration` already has `mutable Poco::Mutex _mutex` that all
public read methods lock. The new `replaceByLabel` method locks the same
`_mutex` and atomically swaps the config pointer within the matching list
node — no list insert/erase needed for the common case, guaranteeing mutual
exclusion with concurrent readers.

Co-Authored-By: Claude Opus 4.6 <[email protected]>
2026-02-07 00:43:46 +01:00
Alexey MilovidovandClaude Opus 4.6 63c334301e Fix the order of config replacement in Server.cpp
The previous order (add new, find, remove) was incorrect because
`LayeredConfiguration::add` inserts at the same priority position
before existing entries, and `find` returns the first match.
This means the newly added config was found and removed instead
of the old one.

Changed to match the correct order used in Keeper.cpp:
find old, remove old, add new.

Co-Authored-By: Claude Opus 4.6 <[email protected]>
2026-02-07 00:19:01 +01:00
Alexey Milovidov f920b73f93 Merge branch 'master' into respect-command-line-overrides-while-reloading-config
# Conflicts:
#	programs/keeper/Keeper.cpp
#	programs/server/Server.cpp
2026-02-07 00:15:21 +01:00
Alexey MilovidovandGitHub 1bc8e2eca6 Merge pull request #95919 from garrettthomaskth/startup-and-shutdown-console-log-level
add startup and shutdown console log level
2026-02-06 22:37:29 +01:00
Alexey Milovidov a41f649e4d Merge branch 'master' into clickhouse-help 2026-02-05 20:27:00 +01:00
divanik 6571c48297 Merge branch 'master' of github.com:ClickHouse/ClickHouse into parquet_footer_cache 2026-02-05 17:32:40 +01:00
Antonio Andelic 4d63898331 Fix global profiler values 2026-02-05 12:59:25 +01:00
Alexey MilovidovandClaude Opus 4.5 62ccfbd3aa Improve help output for ClickHouse applications
This commit improves the help output for all ClickHouse applications:

- Add `clickhouse help` command that lists all available subcommands
- Return exit code 0 for all help messages (previously some returned 1)
- Output help messages to stdout instead of stderr
- Use "clickhouse <cmd>" format instead of argv[0] in help messages
- Add dynamic `app_name` detection for `clickhouse client` and `clickhouse local`
  to show correct invocation name based on how the binary was called
- Add `--no-sudo` option for `clickhouse start` and `clickhouse restart`
  for environments without sudo (e.g., Docker containers)
- Add detailed help headers and footers for client and local with usage examples

Closes #58244

Co-Authored-By: Claude Opus 4.5 <[email protected]>
2026-02-05 07:12:44 +01:00
garrettthomas 5af5872d23 fix instances of old name 2026-02-03 21:52:43 -08:00
garrettthomas 7a5e155c69 fix instances of old name 2026-02-03 16:41:07 -08:00
Garrett ThomasandGitHub 2e0fb48848 Merge branch 'master' into startup-and-shutdown-console-log-level 2026-02-03 15:47:20 -08:00
garrettthomas e128f6a237 fix names 2026-02-03 15:44:05 -08:00
garrettthomas 1c3ed8fbd5 add startup and shutdown console log level 2026-02-03 15:31:53 -08:00
Grant Holly 45e8756dc9 Merge branch 'master' into parquet_footer_cache 2026-02-02 14:44:57 -08:00
Nikolai Kochetov 5292dd7ca2 Review fixes. 2026-01-30 17:54:34 +00:00
Nikolai Kochetov a5a7daab09 Review fixes. 2026-01-30 15:07:18 +00:00
Alexander TokmakovandGitHub e643ff0e22 Revert "Support auxiliary zookeeper for DatabaseReplicated." 2026-01-29 13:32:17 +01:00
Nikolai Kochetov 3fde253c82 Merge branch 'master' into check-memory-limit-earlier 2026-01-29 12:40:09 +01:00
Grant Holly 1fcac4d2ab Merge branch 'master' into parquet_footer_cache 2026-01-28 13:47:14 -08:00
Alex Bakharew 248a662f0c Merge branch 'master' into abakharew/code-coverage 2026-01-28 11:14:08 +01:00
Nikolay DegterinskyandGitHub 5a10a1c238 Merge pull request #91683 from RinChanNOWWW/replicated-db-aux-keeper
Support auxiliary zookeeper for `DatabaseReplicated`.
2026-01-28 09:23:55 +00:00
Sema ChecherindaandGitHub 12cc3730ff Merge pull request #93356 from ClickHouse/chesema-async-insert-quorum
quorum with async inserts
2026-01-27 21:38:58 +00:00
Nikolai Kochetov 16b4aef94a Merge branch 'master' into check-memory-limit-earlier 2026-01-27 20:16:03 +01:00
Nikolai Kochetov 852821a2b3 Add exclusion list for users. Add a test 2026-01-27 19:14:40 +00:00
Alex Bakharew 684885ab96 Merge branch 'master' into abakharew/code-coverage 2026-01-26 19:06:20 +01:00
Antonio Andelic cb99079a8b Merge branch 'master' into less-shitty-memory-worker2 2026-01-26 16:42:21 +01:00
Antonio Andelic 90f604248d Cleanup 2026-01-26 11:12:47 +01:00
Antonio Andelic 773a2bfeed Merge branch 'master' into enable-implicit-int-float-conversion 2026-01-26 10:25:31 +01:00
RinChanNOWWW d0fd05ca59 Support auxiliary keeper for DatabaseReplicated. 2026-01-26 14:50:50 +08:00
Grant Holly 7ef8820e74 merging in upstream master 2026-01-24 13:13:53 -08:00
Sema Checherinda 7dfe727452 quorum with async inserts 2026-01-23 16:39:23 +01:00
Antonio Andelic 5d7d52d826 Change dirty_decay_ms 2026-01-23 13:24:52 +01:00
Antonio Andelic d718baab40 Run jemalloc dirty pages purging in a different thread 2026-01-23 11:28:39 +01:00