hanzoai/datastore
2
0
Fork 0
mirror of https://github.com/hanzoai/datastore.git synced 2026-09-26 13:55:07 +00:00
Code Issues Packages Projects Releases Wiki Activity
51,574 Commits 5 Branches 2,005 Tags
6cd1557d677b7dc8aa17aa696da07461c95fd7c8
Commit Graph
116 Commits
Author SHA1 Message Date
mnkonkovaandVitaly Baranov 6cd1557d67 Implement GRPC protocol. 2020-11-24 17:53:34 +03:00
tavplubixandGitHub 058aa8f85e Merge pull request #16824 from ClickHouse/replace_stringstreams_with_buffers 
Replace std::*stringstreams with DB::*Buffers
 2020-11-12 01:11:44 +03:00
Alexander Tokmakov b94cc5c4e5 remove more stringstreams 2020-11-10 21:22:26 +03:00
Amos Bird aa8e6db786 reload auxiliary zookeepers configuration 2020-11-10 15:56:37 +08:00
Alexey Milovidov 2e0a979e3a Fix inconsistency in FormatFactory 2020-10-29 06:39:43 +03:00
Azat Khuzhin 72d7b6117e Use total_memory_tracker when there is no other MemoryTracker object. 
This should significantly reduce the MemoryTracking drift, test shows
that there is 0 drift after query storm (100 queries, via http/tcp/tcp
in one session).

TL;DR;

To track memory, clickhouse creates memory tracker object for each
thread **explicitly**, but until it is not created the memory
allocations are not under account.
There should not be lot of allocations w/o memory tracker, since most of
the time it is created early enough, but even this maybe enough to
trigger some problems.

Plus sometimes it is not possible to create it, for example some 3d
party library does not allow to do this explicitly:
- for example before #15740 allocations from librdkafka threads,
- or even worse, poco threads, they don't have any routines to do this.
This won't be a problem for `MemoryTracking` metric if the deallocation
will be done from the same thread w/o memory tracker (or vise versa),
but this is not always true.

NOTE, that this will slow down per-thread allocations w/o memory
tracker, since before this patch there were no memory tracking for them
while now they will be accounted in total_memory_tracker, and for
total_memory_tracker max_untracked_memory is always reached.
But this should not be significant.
 2020-10-23 21:07:52 +03:00
Alexey Milovidov 7d97c8b053 Remove useless code 2020-10-07 11:21:32 +03:00
tavplubixandGitHub 4578d89819 Merge pull request #15348 from ClickHouse/replicate_default_args 
Continuation of #14791
 2020-09-28 18:53:02 +03:00
Alexander Tokmakov 34addcf61f add review suggestions 2020-09-26 22:18:28 +03:00
alesapin 97671a1771 Ugly fix for default database race 2020-09-25 14:27:00 +03:00
Alexey Milovidov 1f6e55ff35 Allow to run without /proc/self/maps 2020-09-25 05:03:58 +03:00
Alexander Kuzmenkov 679c0988a5 Merge remote-tracking branch 'origin/master' into HEAD 2020-09-22 16:25:52 +03:00
Alexander Kuzmenkov dde4cf70e1 Merge remote-tracking branch 'origin/master' into HEAD 2020-09-22 14:03:59 +03:00
Alexander KuzmenkovandGitHub 478c7309d4 Merge pull request #14843 from ClickHouse/aku/global-pool 
Exception on double init of global thread pool
 2020-09-22 13:44:39 +03:00
alexey-milovidovandGitHub 3e0509af69 Merge pull request #13573 from amosbird/rms 
specific ReplicatedMergeTree settings
 2020-09-21 01:36:33 +03:00
alexey-milovidovandGitHub 1474b80ecc Merge pull request #15008 from ClickHouse/clang-tidy-11-without-enabling 
Fix terribly wrong code
 2020-09-20 02:00:54 +03:00
alexey-milovidovandGitHub c461d782e4 Merge pull request #14929 from ClickHouse/mlock-code-segment 
Only mlock code segment
 2020-09-19 13:46:49 +03:00
Alexey Milovidov ef5363b87f Fix terribly wrong code 2020-09-19 02:05:13 +03:00
alexey-milovidovandGitHub 988b20a32c Merge pull request #14684 from azat/parallel-distributed_ddl 
Allow parallel execution of distributed DDL
 2020-09-18 22:18:17 +03:00
Alexander Kuzmenkov 449189dcda Initialize global thread pool before we fetch configs from ZK 2020-09-18 13:47:09 +03:00
Alexey Milovidov eb523f1a7c Merge branch 'master' into mlock-code-segment 2020-09-17 21:15:09 +03:00
Alexander Kuzmenkov fb64cf210a straighten the protocol version 2020-09-17 17:37:29 +03:00
Alexey Milovidov 068e8576b7 Corrections 2020-09-17 15:53:52 +03:00
Alexey Milovidov 8bce20076c Only mlock code segment 2020-09-17 15:39:37 +03:00
sundy-li 544b2cb20d add configChanged method for zookeeper 
fix logic error && skip reload testkeeper
 2020-09-17 13:33:45 +08:00
Alexey Milovidov 2ac88ab47d Added config option 2020-09-14 21:08:09 +03:00
Azat Khuzhin dd867b787f Allow parallel execution of distributed DDL 
Add distributed_ddl.pool_size to control maximum parallel to handle
distributed DDL.

Also:
- convert Exception constructors to fmt-like
- use sleepFor* over std::this_thread::sleep_for()
 2020-09-12 02:32:08 +03:00
Alexey Milovidov a644733139 Attempt to make performance test more reliable 2020-09-10 12:05:57 +03:00
Yatsishin Ilya 45e54f81c7 better resolv.conf, add DNSCacheUpdater logs 2020-09-02 11:07:46 +03:00
Amos Bird 05a5a13e08 specific ReplicatedMergeTree settings 2020-08-27 22:37:41 +08:00
Vitaly Baranov 0759dff12b Support <user_directories> section in the main config. 2020-08-16 19:15:38 +03:00
Vitaly Baranov 2909ed1bc0 Better initialization of access storages. Make list of access storages dynamic. 2020-08-16 19:15:34 +03:00
Alexey Milovidov e43746395e Merge branch 'master' into codespell-2 2020-08-16 14:57:21 +03:00
Alexander Tokmakov a6ff049eec use Atomic for system database 2020-08-12 23:40:13 +03:00
Alexey Milovidov 6c4df0f27a Better tool 2020-08-08 17:10:49 +03:00
Vitaly BaranovandGitHub 1a4a8a219c Merge pull request #13305 from vitlibar/correct-error-message-if-setting-not-found-in-users_xml 
Correct error message if setting not found in users.xml
 2020-08-07 23:31:23 +03:00
Vitaly Baranov a804f9499d Use references while iterating through settings. 2020-08-04 04:00:38 +03:00
Vitaly Baranov dadebadcac Print correct error message in log for unknown settings in users.xml 2020-08-04 00:20:33 +03:00
Alexey Milovidov 778abb346f Merge branch 'master' into merge-tree-settings-sanity-check 2020-08-02 17:13:17 +03:00
Vitaly Baranov 7c4ae5ee65 Add the parameter custom_settings_prefixes to the server config. 2020-07-31 20:57:49 +03:00
Vitaly Baranov 56665a15f7 Rework and rename the template class SettingsCollection => BaseSettings. 2020-07-31 20:54:18 +03:00
Alexey Milovidov b9f49d31df Sanity checks for MergeTreeSettings 2020-07-30 22:08:13 +03:00
Denis Glazachev 8688a1f5d0 Recreate ExternalAuthenticators (LDAP) on config update 2020-07-10 15:59:48 +04:00
alesapinandGitHub 1aa45f203b bump CI 2020-07-08 13:40:02 +03:00
Denis Glazachev 9effacfbc1 Merge branch 'master' into ldap-per-user-authentication 
* master: (1102 commits)
  Update README.md
  Update README.md
  Update README.md
  Update index.md
  [docs] add intrdocution for statements page (#12189)
  Revert "Run perf tests with memory sampling (for allocations >1M)"
  Sanitize LINK_LIBRARIES property for the directories (#12160)
  [docs] refactor Domains overview (#12186)
  DOCS-647: toStartOfSecond (#12190)
  [docs] add intrdocution for commercial page (#12187)
  DOCSUP-1348 Russian translation for new functions (#133) (#12194)
  changelog fixes
  Update index.md (#12191)
  Update zh kafka.md title (#12192)
  Added test for #3767
  style fix for #12152
  Tests for fixed issues #10846 and #7347
  changelog fixes
  [docs] introduction for special table engines (#12170)
  [docs] introduction for third-party interfaces (#12175)
  ...

# Conflicts:
#	src/Access/ya.make
#	src/Common/ErrorCodes.cpp
 2020-07-08 00:42:09 +04:00
Alexey Milovidov 176a7f2f72 Normalize "pid" file handling #3501 2020-07-04 16:54:24 +03:00
Alexey Milovidov 44f2742a51 Fix bad log message at server startup 2020-06-27 15:56:06 +03:00
Alexander Kuzmenkov d77f397b38 review fixes 2020-06-26 03:18:33 +03:00
Alexander KuzmenkovandGitHub 593a0181bd Merge pull request #11616 from ClickHouse/aku/perf-benchmark 
Add concurrent benchmark to performance test
 2020-06-25 09:36:52 +03:00
Alexander Kuzmenkov e0bdbe73d2 Merge remote-tracking branch 'origin/master' into HEAD 2020-06-23 15:31:09 +03:00