Commit Graph
354 Commits
Author SHA1 Message Date
vdimir fbdb5c60bd initial initialization of cluster discovery in main thread 2021-12-27 15:26:10 +03:00
vdimir 7404205f37 fix cluster discovery startup race 2021-12-27 15:26:09 +03:00
vdimir e7d3dbeebd cluster discovery init only with zookeeper 2021-12-27 15:26:08 +03:00
vdimir 94bb7cba62 cluster discovery wip 2021-12-27 15:26:05 +03:00
Azat Khuzhin 57c027be0e Remove arcadia build support 2021-12-11 21:25:23 +03:00
Timur Magomedov 08fc832038 Remove OpenCL completely 2021-11-25 00:45:35 +03:00
alesapinandGitHub 35de9e42d9 Merge branch 'master' into add_4_letter_words_commands 2021-11-22 18:02:02 +03:00
tavplubixandGitHub dc6d48ff83 Merge pull request #31292 from stigsb/materialized-mysql-atomic-only
Drop support for DatabaseOrdinary in MaterializedMySQL
2021-11-22 14:03:50 +03:00
Alexey MilovidovandVitaly Baranov 334535a4c4 Better exception message when users.xml cannot be loaded due to bad password hash 2021-11-20 10:06:20 +03:00
Stig BakkenandStig Bakken ff46e8bb51 Drop support for DatabaseOrdinary in MaterializedMySQL
1. Dropped support for DatabaseOrdinary for MaterializeMySQL. It
   is marked as experimental, and dropping support makes the code
   more maintaible, and speeds up integration tests by 50%.

2. Get rid of thread name logic for StorageMaterializeMySQL wrapping,
   use setInternalQuery instead (similar to MaterializedPostgreSQL).
2021-11-18 11:46:51 +01:00
alesapin 5f3eca4cd1 Merge branch 'master' into JackyWoo_add_4_letter_words_commands 2021-11-17 12:59:20 +03:00
Tomáš HromadaandGitHub 445b0ba7cc Expose all GlobalThreadPool config params (#31285) 2021-11-12 16:24:47 +03:00
Vitaly BaranovandGitHub 1579bcfd20 Merge pull request #31178 from vitlibar/backup-engines-and-improvements
Backup engines and improvements
2021-11-10 18:20:41 +03:00
Vitaly Baranov cf77c0b3fc New syntax for BACKUP/RESTORE: set backup engine explicitly. 2021-11-09 23:16:40 +03:00
Azat Khuzhin 7769d75088 Log size of remapped memory (remap_executable) 2021-11-04 00:19:00 +03:00
Vitaly BaranovandGitHub 1f217aeb5a Merge pull request #30998 from vitlibar/rename-access-control-manager
Rename AccessControlManager
2021-11-03 12:20:17 +03:00
Yuriy Chernyshov 14e7ea6685 Remove remaining usages of Y_IGNORE 2021-11-02 14:41:30 +03:00
Vitaly Baranov afe2c9c040 Rename AccessControlManager -> AccessControl. 2021-11-02 14:06:20 +03:00
JackyWoo a60663e33d add 4lw commands to keeper 2021-10-27 20:26:42 +08:00
Maksim KitaandGitHub b58f819789 Merge pull request #30667 from kitaisreal/compiled-expression-cache-limit-elements-size
CompiledExpressionCache limit elements size
2021-10-26 16:43:49 +03:00
Maksim Kita 3810baf44c CompiledExpressionCache limit elements size 2021-10-26 00:00:57 +03:00
mergify[bot]andGitHub 35b5cf23cb Merge branch 'master' into update_keeper_config 2021-10-20 09:57:09 +00:00
Kseniia SumarokovaandGitHub 5324cc8359 Merge pull request #30282 from kssenii/fix-local-less-threads
Less threads in clickhouse-local, fix Ok. printing
2021-10-19 22:54:28 +03:00
kssenii e53335bc6f Better way 2021-10-19 08:21:38 +00:00
alesapin f2d266acce Merge branch 'master' into update_keeper_config 2021-10-19 10:16:57 +03:00
alesapin bfe2a937eb At least able to start 2021-10-18 18:27:51 +03:00
alesapin 6d24ca4c3a Review fixes 2021-10-18 12:13:24 +03:00
alesapin f1fe96e194 Merge branch 'master' into debug_keeper 2021-10-18 10:16:07 +03:00
alexey-milovidovandGitHub f4bfed9d3a Merge pull request #29586 from evillique/log_levels_update
Add log levels updates
2021-10-17 20:54:46 +03:00
Nikolai Kochetov 067eaadadd Merge branch 'master' into removing-data-streams-folder 2021-10-16 09:46:05 +03:00
Nikolai Kochetov fd14faeae2 Remove DataStreams folder. 2021-10-15 23:18:20 +03:00
Maksim KitaandGitHub 7beaeb8b13 Merge branch 'master' into indexcache 2021-10-15 12:59:09 +03:00
Nikolay Degterinsky 2da43012b6 Add log levels updates 2021-10-14 16:34:30 +03:00
alesapin 90ff7f05fd Start keeper asynchronously if has connection to other nodes 2021-10-14 13:21:41 +03:00
Maksim KitaandGitHub 18a980d7b0 Merge pull request #29914 from amosbird/waitunfinish
Add shutdown_wait_unfinished_queries setting
2021-10-12 18:42:31 +03:00
Azat Khuzhin 063f9cffab Allow memory profiler under sanitizers
Only query profiler cannot work reliably with sanitizers (due to
unwinding from signal handler), but memory profiler should be fine.

Plus sometimes the problem appears only on build with sanitizers, so it
will be useful to have memory related profiling in trace_log.

Also there is a flaky check for stateless tests, that uses build with
ASan, and now trace_log there is empty, which sometimes does not allow
to debug further.
2021-10-11 10:21:26 +03:00
Vitaly Baranov 28459b282d Fix shutdown of AccessControlManager. Now there cannot be configuration reloading after AccessControlManager has been destroyed. 2021-10-10 13:25:24 +03:00
Amos Bird 5cc3793925 Add shutdown_wait_unfinished_queries setting 2021-10-09 11:50:06 +08:00
Azat Khuzhin 71cffbf521 Make memory_profiler_step API cleaner
Right now to configure memory_profiler_step/total_memory_profiler_step
you need to call:

    MemoryTracker::setOrRaiseProfilerLimit()
    MemoryTracker::setProfilerStep()

But it is easy to forget about setOrRaiseProfilerLimit(), since there is
no even any comments about this.

So instead, make setOrRaiseProfilerLimit() private and call it from
setProfilerStep()
2021-10-07 10:52:16 +03:00
Maksim KitaandGitHub 87f99c5104 Merge pull request #29643 from azat/listen_backlog
Increase listen_backlog by default (to match default in newer linux kernel)
2021-10-02 22:06:30 +03:00
Maksim Kita 395119339f Merge branch 'master' into rename-common 2021-10-02 17:15:10 +03:00
Maksim KitaandGitHub c966806205 Merge pull request #29529 from kitaisreal/external-xml-loaders-reload-with-server-configuration-support
ExternalXMLLoaders reload with server configuration support
2021-10-02 16:26:28 +03:00
Alexey Milovidov fe6b7c77c7 Rename "common" to "base" 2021-10-02 10:13:14 +03:00
Azat Khuzhin 9d69786a6b Increase listen_backlog by default (to match default in newer linux kernel)
It was 64 for a long time, and even linux kernel never has such a small
limit, it had 128 (net.core.somaxconn sysctl).

But recently, in 5.4, the default value had been increased even in
linux kernel, to 4096 [1].

  [1]: https://git.kernel.org/pub/scm/linux/kernel/git/torvalds/linux.git/commit/?id=19f92a030ca6d772ab44b22ee6a01378a8cb32d4

Let's increase it in ClickHouse too.

Also note, that I've looked through some instances with
clickhouse-server only, and TcpExtListenOverflows was non zero (`nstat
-za`), in other words backlog of the listen socket indeed overflowed
there.

So it is better to increase the default to move the problem to
clickhouse-server itself (yes you will unlikely have 4K new incomming
connections at one time, with accept thread do not accept them all, but
still seems that it is possible, maybe due to some locks or something
else).
2021-10-01 21:03:59 +03:00
Maksim Kita 4a480699bd Added tests 2021-10-01 16:44:09 +03:00
Nikita MikhaylovandGitHub 9756b8dc33 Added an ability to execute more merges and mutations than threads, added new settings (#29140) 2021-10-01 00:26:24 +03:00
Maksim Kita 7edf63162f ExternalXMLLoaders reload with server configuration support 2021-09-29 15:52:58 +03:00
Raúl Marín 462d36195c Allow reloading max_concurrent_queries without restart 2021-09-27 12:32:35 +02:00
Anton Popov 83e45adad6 Merge remote-tracking branch 'upstream/master' into HEAD 2021-09-20 20:04:50 +03:00
tavplubixandGitHub 922cf7ee20 Merge pull request #28373 from ClickHouse/tables_topsort
Resolve table dependencies on metadata loading
2021-09-20 14:46:47 +03:00