Commit Graph
1493 Commits
Author SHA1 Message Date
Alexey Milovidov bc2cf62881 Do not do mlock if the memory is low 2025-11-08 00:48:26 +01:00
Elmi Ahmadov d32724e76b Merge remote-tracking branch 'origin/master' into ahmadov/text-index-posting-list-cache 2025-11-06 12:39:36 +01:00
Elmi AhmadovandGitHub bcacae904b Merge pull request #89513 from ClickHouse/ahmadov/text-index-header-cache
Text index: introduce cache for the deserialized header
2025-11-06 10:05:14 +00:00
Elmi Ahmadov b37cd0b167 Text index: introduce cache for deserialized posting lists
Since posting lists are the largest by the data size, caching them would
reduce I/O and improve the quer performance in consecutive runs.

The cache can be configured via new server settings:
- `text_index_postings_cache_policy`
- `text_index_postings_cache_size`
- `text_index_postings_cache_max_entries`
- `text_index_postings_cache_size_ratio`

and enabled using `use_text_index_postings_cache` setting (disabled by
default).
2025-11-06 02:03:18 +01:00
Raúl MarínandGitHub e32f8e1a72 Merge pull request #88360 from Algunenano/lz4_simple
LZ4: Do not trust the compiler
2025-11-05 18:26:56 +00:00
Raúl Marín af6fb9ee40 Merge remote-tracking branch 'blessed/master' into lz4_simple 2025-11-04 19:37:31 +01:00
Elmi Ahmadov 208eb6a35f Text index: introduce cache for the deserialized header
The header of the text index contains the number of tokens, bloom filter
and sparse index.
Since both bloom filter and sparse index can be relatively large,
caching them would reduce I/O and improve the query performance.

Make the cache configurable by the new server settings:
- `text_index_header_cache_policy`
- `text_index_header_cache_size`
- `text_index_header_cache_max_entries`
- `text_index_header_cache_size_ratio`

Additionally, the header cache can be enabled via a new setting
`use_text_index_header_cache`. By default, cache is disabled.
2025-11-04 18:17:06 +01:00
avogar 791e540294 Remove flag in Server.cpp 2025-10-31 16:29:32 +00:00
Raúl Marín e7fac290ac Review improvements 2025-10-21 11:51:04 +00:00
Elmi Ahmadov 80e55777c8 make text index dictionary block cache configurable
Also, remove the singleton approach and move text index dictionary block
cache into `Context`.
2025-10-21 00:12:56 +02:00
Alexey Milovidov 1f20d99bab Merge branch 'master' into fix-throttling 2025-10-17 23:11:41 +02:00
Raúl MarínandGitHub a4b6a27928 Update Server.cpp 2025-10-15 15:31:09 +02:00
Raúl MarínandGitHub 9c83ae79b5 Update Server.cpp 2025-10-15 15:00:24 +02:00
Raúl MarínandGitHub bb24b61b1d Update Server.cpp 2025-10-15 14:34:03 +02:00
Raúl Marín 2831f6d157 Relocate the binary before other threads are started 2025-10-15 13:07:32 +02:00
Raúl Marín 9455394e51 Simplify decompress_perf 2025-10-13 14:29:09 +02:00
serxa 19d436d481 Merge branch 'master' into workloads-and-resources-in-cfg 2025-10-04 10:39:29 +00:00
Miсhael StetsyukandGitHub ae72e120a2 Merge pull request #87521 from ClickHouse/reliable-metric-collection
add histogram and dimensional metrics to `PrometheusMetricsWriter`
2025-10-03 07:34:24 +00:00
serxa 3c5cdb0b4f Merge branch 'master' into workloads-and-resources-in-cfg 2025-09-30 07:59:46 +00:00
Michael Kolupaev 6c07474c33 Merge remote-tracking branch 'origin/master' into rmvs 2025-09-27 01:44:33 +00:00
Michael Stetsyuk 07a4f6945a better 2025-09-25 20:35:02 +00:00
Michael Stetsyuk d5a24ab4ca resolve conf 2025-09-25 15:05:10 +00:00
Nikita Fomichev 9153c5df70 Rename the log level settings from startupLevel and shutdownLevel to startup_level and shutdown_level to match the general settings format. 2025-09-25 16:51:58 +02:00
serxa 44b4758f08 Merge branch 'master' into workloads-and-resources-in-cfg 2025-09-24 20:47:51 +00:00
Michael Stetsyuk def9c3ee63 better 2025-09-24 15:23:33 +00:00
serxa 795c1aae79 Add support for configuration-based workloads and resources 2025-09-22 19:11:58 +00:00
Pablo Marcos 846a14a41a Add max_named_collection_num_to_warn and max_named_collection_num_to_throw 2025-09-19 10:39:55 +00:00
Miсhael StetsyukandGitHub baa7fd791f Merge pull request #87208 from ClickHouse/fix-aggregated-zookeeper-log
Resubmit 'aggregated zookeeper log'
2025-09-17 15:41:43 +00:00
Miсhael StetsyukandGitHub 155fed4b23 Merge pull request #86202 from ClickHouse/startup_scripts_failure_reason
add `startup_scripts_failure_reason` dimensional metric
2025-09-17 08:48:31 +00:00
Michael Stetsyuk 3c093e5b7f aggregated zookeeper log 2025-09-16 17:27:31 +00:00
Azat Khuzhin c012692512 Merge remote-tracking branch 'u/master' into zk-permanent-watches 2025-09-12 16:48:40 +02:00
Konstantin Vedernikov d93b649c2c fixes 2025-09-09 12:14:10 +00:00
Azat Khuzhin a4da40949f Remove API for ZooKeeper client with WatchCallback completelly (leave only Ptr part) 2025-09-09 13:50:26 +02:00
Konstantin Vedernikov f836ef5dfb fixups 2025-09-09 10:44:17 +00:00
Azat Khuzhin 04d64a7ca1 Fix deduplication of watches in ZooKeeper client by EventPtr
While adding a chassert, I also discovered an issue with EventPtr: it
was never deduplicated, since it was always wrapped into a callback.
This has now been fixed as well.
2025-09-08 12:01:08 +02:00
Antonio Andelic ad6497f93c Merge branch 'master' into store-jemalloc-samples-in-trace-log 2025-09-03 17:35:28 +02:00
Azat Khuzhin f40d3f94f1 Catch exceptions during server shutdown to avoid std::terminate 2025-09-02 17:26:00 +02:00
Antonio Andelic 292f6dfe1c Fix build 2025-09-02 13:07:28 +02:00
Antonio Andelic 65800fd4d2 Merge branch 'master' into store-jemalloc-samples-in-trace-log 2025-09-01 09:58:23 +02:00
Kseniia SumarokovaandGitHub 19c8bb4dfc Merge pull request #85967 from Blokje5/support-startup-and-shutdown-log-levels
Support Startup & Shutdown Log Levels
2025-08-28 09:51:56 +00:00
Lennard Eijsackers 7e4d8005b5 Remove unnecessary comment. 2025-08-27 09:16:59 +02:00
Michael Stetsyuk 7de0c2df7e add startup_scripts_failure_reason dimensional metric 2025-08-26 14:16:41 +00:00
Lennard Eijsackers 315ade538b Support Startup & Shutdown Log Levels
Alter the log levels on startup & shutdown if the respective values are set. This allows for a higher log level during startup & shutdown of clickhouse.

Fixes: #85958
2025-08-25 09:40:29 +02:00
Azat Khuzhin 2506873ce4 Merge remote-tracking branch 'u/master' into ci/integration-tests-jemalloc-profile
Conflcits with ci/jobs/scripts/clickhouse_proc.py, due to unrelated
changes (sigh)
2025-08-16 16:39:26 +02:00
Antonio Andelic 26bb3e6274 Refactor and improve queries 2025-08-14 11:34:41 +02:00
Antonio Andelic e6b5d0c20e Merge branch 'master' into store-jemalloc-samples-in-trace-log 2025-08-14 09:25:24 +02:00
Nikita TaranovandGitHub c8630b4f74 Merge pull request #85441 from ClickHouse/try_fix_def_ssl_ctx_init
Try fix data race on default ssl context
2025-08-13 14:49:50 +00:00
Azat Khuzhin e201a7697a Enable jemalloc_flush_profile_interval_bytes/jemalloc_flush_profile_on_memory_exceeded even w/o trace_log 2025-08-13 16:04:08 +02:00
Antonio Andelic 8b73844caa Merge branch 'master' into store-jemalloc-samples-in-trace-log 2025-08-13 15:20:20 +02:00
Antonio Andelic 93973b838a Add more jemalloc server settings 2025-08-13 10:44:48 +02:00