Commit Graph
94 Commits
Author SHA1 Message Date
Yakov Olkhovskiy 2e34b384c1 update tcp protocol, add quota_key 2022-08-03 15:44:08 -04:00
Nikolai Kochetov 6e924cdc77 Fix some more tests. 2022-06-01 15:21:47 +00:00
Nikolai Kochetov 3d84aae0ab Better. 2022-05-24 20:06:08 +00:00
Nikolai Kochetov 333fd09dbf Fixing build. 2022-05-24 19:29:00 +00:00
Robert Schulze 118e94523c Activate clang-tidy warning "readability-container-contains"
This check suggests replacing <Container>.count() by
<Container>.contains() which is more speaking and in case of
multimaps/multisets also faster.
2022-04-18 23:53:11 +02:00
vdimir e7d3dbeebd cluster discovery init only with zookeeper 2021-12-27 15:26:08 +03:00
Raúl Marín b2cfa70541 Reduce dependencies on ASTFunction.h
481 -> 230
2021-11-26 18:21:54 +01:00
Nikolay Degterinsky ba50e8387d Merge branch 'master' into query_parameters 2021-11-15 19:55:54 +00:00
Azat Khuzhin 6274c7bfc2 Do not use global context for query execution in clickhouse-copier 2021-11-15 10:32:19 +03:00
Nikolay Degterinsky d76976e272 Merge branch 'master' into query_parameters 2021-10-18 17:34:20 +03:00
Nikolai Kochetov a08c98d760 Move some files. 2021-10-16 17:03:50 +03:00
Nikolay Degterinsky 49c1a52f34 Merge branch 'master' into query_parameters 2021-10-13 03:04:40 +03:00
Nikita MikhaylovandGitHub 32d77aafe2 Merge pull request #29921 from azat/copier-fixes
copier: add ability to configure retries and delays between them
2021-10-11 12:11:38 +03:00
Azat Khuzhin 452b3b443d copier: add ability to configure retries and delays between them
The following options had been introduced:
- max-table-tries
- max-shard-partition-tries
- max-shard-partition-piece-tries-for-alter
- retry-delay-ms
2021-10-10 08:58:35 +03:00
Nikolai Kochetov 340b53ef85 Remove some more streams. 2021-10-08 17:03:54 +03:00
Nikolay Degterinsky 7f3d395bf3 Merge branch 'master' into query_parameters 2021-09-30 02:01:33 +03:00
Nikolai Kochetov 998d29ebc7 Merge branch 'master' into rewrite-pushing-to-views 2021-09-23 13:10:27 +03:00
Nikolay Degterinsky 1b1d90deb8 Merge branch 'master' into query_parameters 2021-09-22 13:53:56 +03:00
Dmitry NovikandGitHub fdd2e5d530 Update programs/copier/ClusterCopier.cpp 2021-09-21 01:19:40 +03:00
Eugene KonkovandGitHub 130552330f Fix error message
Fix typo in error message. Better wording.
2021-09-21 00:58:22 +03:00
Nikolai Kochetov a790d391c0 Merge branch 'master' into rewrite-pushing-to-views 2021-09-20 19:43:15 +03:00
Nikolai Kochetov 341553febd Fix build. 2021-09-16 20:40:42 +03:00
Nikolai Kochetov b997214620 Rename QueryPipeline to QueryPipelineBuilder. 2021-09-14 20:48:18 +03:00
Azat Khuzhin c99bd06195 copier: fix partition_key alias using WITH
After those changes it is not possible to add an alias for the tuple
element anymore, i.e.:

  $ clickhouse-local -q 'select ((1,2) = (1,2) as foo), foo'
  1       1
  $ clickhouse-upstream local -q 'select ((1,2) = ((1,2) as foo)), foo'
  1       (1,2)

But these can be done using WITH statement.
2021-09-12 00:15:31 +03:00
Nikolay Degterinsky 22f59e1714 Add support for table and database query parameters 2021-09-07 01:19:02 +03:00
Nikolai Kochetov 66a76ab70f Rewrite PushingToViewsBlockOutputStream part 6 2021-09-03 20:29:36 +03:00
Amos Bird dbfb699690 Asynchronously drain connections. 2021-07-19 21:53:29 +08:00
Maksim KitaandMaksim Kita 67e9b85951 Merge ext into common 2021-06-16 23:28:41 +03:00
Nikita Mikhaylov f6932026d5 delete partition from original table in case of errors while moving 2021-06-04 14:21:47 +00:00
Nikita Mikhaylov 68c92cd93e style 2021-06-03 23:58:47 +00:00
Nikita Mikhaylov b978405f4a fix 2021-06-03 15:50:44 +00:00
Nikita Mikhaylov 4382aac25d support for ReplicatedTable creation without arguments 2021-06-02 15:46:37 +03:00
Nikita Mikhaylov f57863b974 fix tests 2021-06-02 01:03:08 +03:00
Nikita Mikhaylov 33dcebbb24 style 2021-05-31 17:41:35 +03:00
Nikita Mikhaylov 01511d0cbe better 2021-05-31 17:40:07 +03:00
Nikita Mikhaylov 1c548058e6 add status json 2021-05-31 17:38:55 +03:00
Nikita Mikhaylov ac072243d6 style + enable trivial test 2021-05-31 17:38:55 +03:00
Nikita Mikhaylov 6d19dea761 better 2021-05-31 17:38:20 +03:00
Nikita Mikhaylov e9f66a0045 delete alter table optimize 2021-05-31 17:38:20 +03:00
Nikita Mikhaylov fa22b41d5a added allow_to_drop_target_partitions with test 2021-05-31 17:38:20 +03:00
Nikita Mikhaylov 9022646633 support copying of tables with data skipping indices 2021-05-31 17:38:20 +03:00
Nikita Mikhaylov 24af47063e allow to copy materialized and alias 2021-05-31 17:37:10 +03:00
Nikita Mikhaylov c41cc36046 support TTL on columns 2021-05-31 17:37:10 +03:00
Nikita Mikhaylov 90ab394769 better 2021-05-31 17:37:10 +03:00
Amos Bird 264cff6415 Projections
TODO (suggested by Nikolai)

1. Build query plan fro current query (inside storage::read) up to WithMergableState
2. Check, that plan is simple enough: Aggregating - Expression - Filter - ReadFromStorage (or simplier)
3. Check, that filter is the same as filter in projection, and also expression calculates the same aggregation keys as in projection
4. Return WithMergableState if projection applies

3 will be easier to do with ActionsDAG, cause it sees all functions, and dependencies are direct (but it is possible with ExpressionActions also)

Also need to figure out how prewhere works for projections, and
row_filter_policies.

wip
2021-05-11 18:12:23 +08:00
IvanandGitHub 495c6e03aa Replace all Context references with std::weak_ptr (#22297)
* Replace all Context references with std::weak_ptr

* Fix shared context captured by value

* Fix build

* Fix Context with named sessions

* Fix copy context

* Fix gcc build

* Merge with master and fix build

* Fix gcc-9 build
2021-04-11 02:33:54 +03:00
Nikita MikhaylovandGitHub 18dc213cee Merge pull request #21912 from songenjie/clickhouse-copier-create-destination-once
[ClickHouse][Copier] Improve copier work
2021-03-30 14:42:00 +03:00
turbo jason 22c9cb1aa3 fix code style 2021-03-23 15:35:15 +08:00
turbo jason f4be05ca25 fix code style 2021-03-23 15:04:25 +08:00
turbo jason 6aa89d0ee3 remove duplicated code 2021-03-23 11:00:06 +08:00