Commit Graph
648 Commits
Author SHA1 Message Date
Kirill Nikiforov 3d297c7dea cleanup: a bit better handling of database data/store/metadata paths 2025-11-21 09:54:50 +04:00
Elmi Ahmadov d32724e76b Merge remote-tracking branch 'origin/master' into ahmadov/text-index-posting-list-cache 2025-11-06 12:39:36 +01:00
Elmi AhmadovandGitHub bcacae904b Merge pull request #89513 from ClickHouse/ahmadov/text-index-header-cache
Text index: introduce cache for the deserialized header
2025-11-06 10:05:14 +00:00
Elmi Ahmadov b37cd0b167 Text index: introduce cache for deserialized posting lists
Since posting lists are the largest by the data size, caching them would
reduce I/O and improve the quer performance in consecutive runs.

The cache can be configured via new server settings:
- `text_index_postings_cache_policy`
- `text_index_postings_cache_size`
- `text_index_postings_cache_max_entries`
- `text_index_postings_cache_size_ratio`

and enabled using `use_text_index_postings_cache` setting (disabled by
default).
2025-11-06 02:03:18 +01:00
Konstantin Bogdanov 48d2f3b145 Fix readability-container-contains 2025-11-04 23:40:04 +01:00
Elmi Ahmadov 208eb6a35f Text index: introduce cache for the deserialized header
The header of the text index contains the number of tokens, bloom filter
and sparse index.
Since both bloom filter and sparse index can be relatively large,
caching them would reduce I/O and improve the query performance.

Make the cache configurable by the new server settings:
- `text_index_header_cache_policy`
- `text_index_header_cache_size`
- `text_index_header_cache_max_entries`
- `text_index_header_cache_size_ratio`

Additionally, the header cache can be enabled via a new setting
`use_text_index_header_cache`. By default, cache is disabled.
2025-11-04 18:17:06 +01:00
Elmi Ahmadov 80e55777c8 make text index dictionary block cache configurable
Also, remove the singleton approach and move text index dictionary block
cache into `Context`.
2025-10-21 00:12:56 +02:00
Alexey Milovidov 0cdf109c3f Allow clickhouse-local to start from the clickhouse-server directory 2025-10-11 18:28:28 +02:00
Antonio Andelic 77a5734091 Small fixes for jemalloc profiler 2025-09-25 10:55:07 +02:00
scanhex12andGitHub b1e70d5dcf Revert "Revert "Iceberg + delta lake local and s3 disks"" 2025-09-12 19:53:27 +02:00
Alexander TokmakovandGitHub 928ad2dca6 Revert "Iceberg + delta lake local and s3 disks" 2025-09-12 18:00:58 +02:00
Konstantin Vedernikov d93b649c2c fixes 2025-09-09 12:14:10 +00:00
Konstantin Vedernikov f836ef5dfb fixups 2025-09-09 10:44:17 +00:00
Azat Khuzhin 56b4d9eeb7 local: create data directory prio to setting up data for temporary storage
Previously this code relies on that fact that setupTmpPath() will create
the directory recursively, found it because
03321_clickhouse_local_initialization_not_too_slow_even_under_sanitizers
started to fail.
2025-08-01 11:44:25 +02:00
Michael Kolupaev 5199cd863f Merge remote-tracking branch 'origin/master' into shp2 2025-07-04 21:16:48 +00:00
Raúl Marín b85de2e694 Less header dependencies 2025-07-03 17:36:25 +02:00
Michael Kolupaev 88c8bc094b Merge remote-tracking branch 'origin/master' into shp2 2025-07-01 16:53:01 +00:00
Alexey Milovidov b2b72fbd4e Merge branch 'master' into rename-class 2025-07-01 01:58:51 +02:00
Michael Kolupaev 77fbb7b56b Revert "Revert "Refactor how IInputFormat deals with reading many files at once""
This reverts commit 1f28e8bbd0.
2025-06-30 16:53:52 +00:00
Azat KhuzhinandGitHub e90e5e14d4 Merge pull request #82444 from azat/client-fix-data-races
Fix data-races in client, session_timezone overrides and some data-races in some corner cases
2025-06-30 15:50:37 +00:00
Alexey MilovidovandGitHub 1f28e8bbd0 Revert "Refactor how IInputFormat deals with reading many files at once" 2025-06-30 17:34:05 +02:00
Azat Khuzhin 74093a763c Properly initialize QueryScope/ThreadStatus in the client apps
This time I was fixing it for session_timezone, but there are other
reasons to have it properly configured.
2025-06-30 11:27:13 +02:00
Azat Khuzhin 9c0963c0a8 Do not use global context as main context for the client
The problem is that clietn calls setSettings() in the global settings,
but this produce a data-race with accessing global settings all over the
places [1]:

- ThreadStatus::finalizePerformanceCounters()
- ThreadStatus::initGlobalProfiler()

  [1]: https://github.com/ClickHouse/ClickHouse/issues/81893#issuecomment-2997271137

v2: Initialize query_id in a proper context
v3: Fix apply settings from config on the client
v4 + v5: Fix other settings adjustments
2025-06-30 11:27:13 +02:00
Alexey Milovidov 639ce05aa8 Rename DatabasesOverlay to DatabaseOverlay 2025-06-29 08:46:06 +02:00
Raúl Marín 22bf25b334 Merge remote-tracking branch 'blessed/master' into includes_utils 2025-06-25 19:31:29 +02:00
Raúl Marín d6ac63c8d2 Style: Forbid the use of quotes for includes (partial) 2025-06-24 13:20:10 +02:00
Michael Kolupaev 5efb430a10 Merge remote-tracking branch 'origin/master' into shp 2025-06-18 23:32:30 +00:00
Azat Khuzhin adb5ce495f local: properly override path from config with CLI options 2025-06-15 09:10:17 +02:00
Michael Kolupaev 7ce16d20af Use shared pool in ParallelParsingInputFormat and DWARFBlockInputFormat 2025-06-13 22:25:18 +00:00
Bharat Nallan Chakravarthy 2c6f054abf better comment 2025-06-12 19:14:48 -07:00
Bharat Nallan Chakravarthy d57f865a10 review fix - fix creating background tasks 2025-06-12 15:01:05 -07:00
Bharat Nallan Chakravarthy 5eef915440 clickhouse-local - create background tasks properly in temporary mode 2025-06-11 23:57:39 -07:00
Miсhael StetsyukandGitHub b216edf8d7 Merge pull request #81271 from ClickHouse/mark-exceptions-as-logged
mark exceptions as logged
2025-06-09 21:29:36 +00:00
Alexey MilovidovandGitHub 7f5f37cf06 Merge pull request #79429 from aaaengel/issue_63093
Support query parameters with dashes
2025-06-07 20:20:11 -07:00
Alexey Milovidov 39b0bf44e0 Fix error 2025-06-07 05:55:35 +02:00
Alexey Milovidov 03789c4f53 Add support for --database argument in clickhouse-local 2025-06-07 05:30:34 +02:00
Kseniia SumarokovaandGitHub 6f1c067e5f Merge pull request #81237 from ClickHouse/fix-file-cache-max-size-ratio-with-relative-cache-path
Fix fs cache max_size_to_total_space setting with relative cache path
2025-06-06 13:42:15 +00:00
Michael Stetsyuk d195c257b7 mark exceptions as logged 2025-06-06 13:40:27 +00:00
kssenii 454a0e3827 Fix tests 2025-06-04 15:21:47 +02:00
Raúl Marín 3cd4ad0d16 Remove usage of settings.h 2025-06-02 18:00:25 +02:00
Alexey Milovidov 0363e2abf4 Allow filesystem_caches and named_collections in clickhouse-local configuration file 2025-06-01 01:08:08 +02:00
Alexey Milovidov a12455bd3d Make SQL UDF persistent in clickhouse-local 2025-05-16 05:33:41 +02:00
János Benjamin Antal c2038a812d Remove format_alter_commands_with_parentheses server setting
The setting was introduced and set false by default in 24.2. It was enabled by default in 25.2. As there are no LTS versions that doesn't support the new format, we can remove the setting.
2025-05-08 13:26:11 +00:00
Nikita Mikhailov 8d80ccde93 Merge branch 'master' of github.com:ClickHouse/ClickHouse into issue_63093 2025-05-07 23:56:03 +02:00
Engel Danila 779d72c0c8 now it works with dash 2025-04-22 20:31:35 +03:00
Alexey Milovidov acdadec1d5 Miscellaneous 2025-04-16 03:38:52 +02:00
Alexey Milovidov b1a4c74981 Fix loading of system logs in clickhouse-local 2025-04-16 03:17:10 +02:00
Alexey MilovidovandGitHub 32ddafd462 Merge pull request #79085 from ClickHouse/implicit-table
Implicit table in `clickhouse-local`
2025-04-14 21:50:38 +02:00
Alexey MilovidovandGitHub 3fb7c4d882 Merge pull request #71722 from ClickHouse/clickhouse-local-persistency
Persistent databases in clickhouse-local
2025-04-14 21:01:36 +02:00
Azat KhuzhinandGitHub 94264b1193 Merge pull request #77578 from azat/fix-applying-async_insert-from-server
Fix applying async_insert from server (via apply_settings_from_server)
2025-04-14 08:32:05 +00:00