Commit Graph

115628 Commits

Author SHA1 Message Date
Robert Schulze
2d06947522
Better 2023-05-30 09:06:45 +00:00
Robert Schulze
fb6c4f2802
Fix msan issue, pt. II 2023-05-30 08:51:44 +00:00
Robert Schulze
bc869eac7b
Merge branch 'master' into msan-siphash-keyed 2023-05-26 00:18:07 +02:00
Robert Schulze
ad4a21034f
Fix msan issue in keyed siphash
Issue:
https://s3.amazonaws.com/clickhouse-test-reports/0/ffdd91669471f4934704f98f0191524496b4e85b/fuzzer_astfuzzermsan/report.html

Repro:
SELECT hex(sipHash128ReferenceKeyed((toUInt64(2), toUInt64(-9223372036854775807)))) GROUP BY (toUInt64(506097522914230528), toUInt64(now64(2, NULL + NULL), 1084818905618843912)), toUInt64(2), NULL + NULL, char(-2147483649, 1)

Minimal repro:
SELECT sipHash64Keyed((2::UInt64, toUInt64(2)), 4) GROUP BY toUInt64(2)
2023-05-25 17:52:03 +00:00
pufit
a014b4d06f
Merge pull request #50241 from ClickHouse/cherry-pick-url-fix
Fix URL in backport comment
2023-05-25 12:04:40 -04:00
pufit
4ce722854b Fix URL in backport comment 2023-05-25 11:51:47 -04:00
Nikita Taranov
243207aa4e
Update S3 sdk to v1.11.61 (#50037) 2023-05-25 16:00:50 +02:00
Kseniia Sumarokova
f1a3c9cfd5
Merge pull request #50109 from kssenii/abstract-async-prefetched-buffer
Make async prefetched buffer work with arbitrary impl
2023-05-25 15:06:44 +02:00
Nikita Mikhaylov
1c3b6738f4
Fixes for parallel replicas (#50195) 2023-05-25 14:41:04 +02:00
Mikhail f. Shiryaev
5c59d9a0ed
Merge pull request #50164 from ClickHouse/optimize-style-check
Speed-up the shellcheck with parallel xargs
2023-05-25 14:02:40 +02:00
Han Fei
55c2dbcc2d
Merge pull request #50062 from ZhiguoZh/20230511-toyear
Optimize predicate with toYear converter
2023-05-25 13:25:55 +02:00
Sema Checherinda
23f894b995
Merge pull request #49777 from helifu/master1
Add 'initial_query_id' field for system.processors_profile_log
2023-05-25 12:55:32 +02:00
Sema Checherinda
3329a8428d
Merge pull request #49779 from helifu/master3
Add 'partitions' field for system.query_log
2023-05-25 12:51:40 +02:00
Igor Nikonov
1c0b02c3c4
Merge pull request #49503 from ClickHouse/fill_with_by_sorting_prefix_2
WITH FILL by sorting prefix
2023-05-25 12:37:40 +02:00
何李夫
e4c8c4cecf
Add zookeeper name in endpoint id (#49780)
* Add zookeeper name in endpoint id

When we migrate a replicated table from one zookeeper cluster to
another (the reason why we migration is that zookeeper's load is
too high), we will create a new table with the same zpath, but it
will fail and the old table will be in trouble.

Here is some infomation:
1.old table:
  CREATE TABLE a1 (`id` UInt64)
  ENGINE = ReplicatedMergeTree('/clickhouse/tables/default/a1/{shard}', '{replica}')
  ORDER BY (id);
2.new table:
  CREATE TABLE a2 (`id` UInt64)
  ENGINE = ReplicatedMergeTree('aux1:/clickhouse/tables/default/a1/{shard}', '{replica}')
  ORDER BY (id);
3.error info:
  <Error> executeQuery: Code: 220. DB::Exception: Duplicate interserver IO endpoint:
          DataPartsExchange:/clickhouse/tables/default/a1/01/replicas/02.
          (DUPLICATE_INTERSERVER_IO_ENDPOINT)
  <Error> InterserverIOHTTPHandler: Code: 221. DB::Exception: No interserver IO endpoint
          named DataPartsExchange:/clickhouse/tables/default/a1/01/replicas/02.
          (NO_SUCH_INTERSERVER_IO_ENDPOINT)

* Revert "Add zookeeper name in endpoint id"

This reverts commit 9deb75b249619b7abdd38e3949ca8b3a76c9df8e.

* Add zookeeper name in endpoint id

When we migrate a replicated table from one zookeeper cluster to
another (the reason why we migration is that zookeeper's load is
too high), we will create a new table with the same zpath, but it
will fail and the old table will be in trouble.

* Fix incompatible with a new setting

* add a test, fix other issues

* Update 02442_auxiliary_zookeeper_endpoint_id.sql

* Update 02735_system_zookeeper_connection.reference

* Update 02735_system_zookeeper_connection.sql

* Update run.sh

* Remove the 'no-fasttest' tag

* Update 02442_auxiliary_zookeeper_endpoint_id.sql

---------

Co-authored-by: Alexander Tokmakov <tavplubix@clickhouse.com>
Co-authored-by: Alexander Tokmakov <tavplubix@gmail.com>
2023-05-25 12:50:14 +03:00
Robert Schulze
1b32348452
Merge pull request #50219 from rschu1ze/docs/client-doc-parameter
Minor adjustment of clickhouse-client/local parameter docs
2023-05-25 11:41:34 +02:00
Robert Schulze
4f5cf656eb
Minor adjustment of clickhouse-client/local parameter docs
Related to #50210
2023-05-25 09:36:03 +00:00
Robert Schulze
a06777c389
Merge pull request #50218 from rschu1ze/readme-update
README.md: Remove Berlin Meetup from upcoming events
2023-05-25 10:54:49 +02:00
Robert Schulze
2651330b12
README.md: Remove Berlin Meetup from upcoming events 2023-05-25 08:50:44 +00:00
Zhiguo Zhou
1bc4eb1a6c OptimizeDateFilterVisitor: Revise variable names for clarity 2023-05-25 13:47:03 +08:00
helifu
cb130a1eb3 Add a new line to the reference file 2023-05-25 09:37:02 +08:00
helifu
515d30caea Add test case. 2023-05-25 09:37:02 +08:00
helifu
802b63f2ab Add 'initial_query_id' field for system.processors_profile_log
Facilitate profile data association and aggregation for the same query
2023-05-25 09:37:02 +08:00
Zhiguo Zhou
773a5bbbaa Optimize predicate with toYear converter
The date converters, such as toYear, are widely used in the where
clauses of the SQL queries, however, these conversions are often
expensive due to the complexity of the calendar system.

The function preimage is found an optimization for the predicates
with the converters. Given a predicate, toYear(c) = y, we could
convert it to its equivalent form: c >= b AND c <= e, where b is
"y-01-01" and e is "y-12-31". The similar transformation applies
to other comparisons (<>, <, >, <=, <=).

This commit implemented the above transformation at the AST level
by adding a new pass in the TreeOptimizer and a new AST visitor
for in-place replacing the predicates of toYear with the converted
ones.
2023-05-25 09:11:51 +08:00
Mikhail f. Shiryaev
a9d5b68946
Merge pull request #50197 from ClickHouse/fix-codebrowser
Fix codebrowser by using clang-15 image
2023-05-24 23:39:13 +02:00
Mikhail f. Shiryaev
e117347ca0
Attempt to fix codebrowser with using clang-15 2023-05-24 23:15:38 +02:00
Kseniia Sumarokova
2e17503d36
Merge pull request #50187 from kssenii/fix-pg-source
Fix PostgreSQLSource reading all unread the data in onFinish
2023-05-24 22:51:48 +02:00
Alexander Gololobov
8996fcb090
Merge pull request #50193 from ClickHouse/fix_for_replicate_delete
Don't replicate delete through DDL worker if there is just 1 shard
2023-05-24 22:45:00 +02:00
Alexander Tokmakov
2c0c1ba4af
add comments to build reports (#50200) 2023-05-24 23:29:36 +03:00
Sorck
034a8bd6b3
Fix: typo in last_value.md (#50148)
Correct typo in page title

Co-authored-by: Dan Roscigno <dan@roscigno.com>
2023-05-24 22:14:01 +02:00
Dan Roscigno
026a15d8a7
Update dns_max_consecutive_failures docs (#50196)
Co-authored-by: Nikita Mikhaylov <mikhaylovnikitka@gmail.com>
2023-05-24 21:01:59 +02:00
Mikhail f. Shiryaev
13aebae511
Merge pull request #50202 from ClickHouse/cherry-pick-to-cloud
Automatic backports of important fixes to cloud-release
2023-05-24 20:21:04 +02:00
pufit
8875b98e2a Added default value for --from-repo arg 2023-05-24 13:47:50 -04:00
pufit
8df7a69147
Automatic backports of important fixes to cloud-release
* Automatic backports to cloud-release

---------

Co-authored-by: robot-clickhouse <robot-clickhouse@users.noreply.github.com>
2023-05-24 18:59:18 +02:00
Dan Roscigno
e5d6c90be0
Merge pull request #50201 from ClickHouse/DanRoscigno-patch-5
Update CREATE FUNCTION docs
2023-05-24 12:45:09 -04:00
Dan Roscigno
0219f78630
Testing algolia index 2023-05-24 12:40:12 -04:00
Dan Roscigno
2ac600b642
Merge pull request #50194 from DanRoscigno/zstd_window_max_docs
add docs for zstd_window_log_max
2023-05-24 11:29:42 -04:00
DanRoscigno
d4927e4fe5 add docs 2023-05-24 10:51:43 -04:00
Dan Roscigno
9b014eb1d2
Merge pull request #49512 from DanRoscigno/polygon-docs
Add docs for polygon functions
2023-05-24 10:37:01 -04:00
DanRoscigno
9f349e2102 add params 2023-05-24 10:35:20 -04:00
Dan Roscigno
c5b521498a
Merge pull request #50191 from den-crane/patch-69
Doc. Remove excessive tuple from ip_trie description
2023-05-24 10:15:28 -04:00
Alexander Gololobov
de0a074545 Don't replicate delete through DDL worker if there is just 1 shard 2023-05-24 16:10:31 +02:00
Dan Roscigno
99adef63e0
Merge pull request #50111 from tsolodov/url-function-docs
update url table function docs
2023-05-24 09:57:34 -04:00
Denny Crane
8a00be69b3
Update index.md 2023-05-24 10:40:33 -03:00
helifu
62208feaf3 Add a new line to the reference file 2023-05-24 21:08:25 +08:00
kssenii
07eedc8ef1 Fix 2023-05-24 15:03:11 +02:00
Dan Roscigno
9082e7feec
Merge branch 'master' into url-function-docs 2023-05-24 09:03:01 -04:00
Dan Roscigno
c2f6999aca
Merge pull request #50157 from den-crane/Doc/greatest_least
Doc. Move least/greatest to conditional-functions
2023-05-24 09:01:58 -04:00
alesapin
7c0c49c9d2
Merge pull request #50154 from hanfei1991/hanfei/fix-modify-order-by
do not allow modify order by when there are no order by cols
2023-05-24 15:01:38 +02:00
Dan Roscigno
c53bdc6927
Merge branch 'master' into polygon-docs 2023-05-24 08:56:46 -04:00