Commit Graph

13800 Commits

Author SHA1 Message Date
kssenii
b72f6ea78e Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into modulo-partition-key 2021-05-22 16:15:15 +00:00
alesapin
e4ce6faab6 Fix build 2021-05-22 15:32:53 +03:00
alexey-milovidov
13398ad233
Merge pull request #24319 from azat/ipv6-fix
Fix IPv6 addresses resolving
2021-05-22 15:23:18 +03:00
Maksim Kita
42e91df363 Updated submodule to llvm12 2021-05-22 15:22:38 +03:00
kssenii
53ce22ae65 Exponencial backoff if queues are empty 2021-05-22 09:44:57 +00:00
alesapin
8c06f81130 Followup fix 2021-05-22 10:50:23 +03:00
alesapin
8c63f0f8e2 Fix race condition on keeper shutdown 2021-05-22 10:46:12 +03:00
Vitaly Baranov
b89da7b420
Merge pull request #21858 from BoloniniD/yaml-cfg
YAML Configuration for ClickHouse
2021-05-22 10:29:51 +03:00
alexey-milovidov
a25f1910cc
Merge pull request #24320 from ClickHouse/remove-auto-array
Remove AutoArray
2021-05-22 02:19:59 +03:00
Maksim Kita
3aa1dba6e1 Added AggregateFunctionSegmentLengthSum to ya.make 2021-05-22 00:13:27 +03:00
alexey-milovidov
7b38ad3a85
Merge pull request #23204 from RedClusive/feature-quantileBfloat16
Feature quantile bfloat16
2021-05-21 23:46:05 +03:00
Azat Khuzhin
1eceb5a8d3 parseAddress: improve port parsing (verify that port is a valid int) 2021-05-21 22:47:35 +03:00
Azat Khuzhin
44c85edae0 parseAddress: improve parsing of port for IPv6 2021-05-21 22:47:35 +03:00
Azat Khuzhin
09020242b2 parseAddress: improve parsing of port (by using tryParse() over parse()) 2021-05-21 22:47:35 +03:00
Azat Khuzhin
0536db0ec3 Fix resolving of IPv6 addresses
v2: move the check from Cluster to DNSResolver
2021-05-21 22:47:35 +03:00
BoloniniD
33755f1f3d Implemented YAMLParser class 2021-05-21 21:56:22 +03:00
kssenii
fcfec83875 Fix comparisons with modulo key (version 2) 2021-05-21 16:40:47 +00:00
kssenii
94b5763dbd Revert "Different approach to fix modulo"
This reverts commit 665f1aa0f6.
2021-05-21 16:14:01 +00:00
alesapin
95a053ee72
Merge pull request #24316 from ClickHouse/more-localhost-addresses
Recognize more addresses as local
2021-05-21 18:41:58 +03:00
kssenii
30845a383f Fix comparisons with modulo key 2021-05-21 15:01:41 +00:00
kssenii
665f1aa0f6 Different approach to fix modulo 2021-05-21 14:30:08 +00:00
Anton Ivashkin
29336a4a34 Use keep_s3_on_delet flag instead of DeleteOnDestroyKeepS3 state 2021-05-21 15:29:10 +03:00
Maksim Kita
2aec0e37e4
CacheDictionaryStorage update 2021-05-21 15:27:41 +03:00
kssenii
bd0bc8e3e7 Revert "Adjust minMax index"
This reverts commit c69f587f8a.
2021-05-21 12:01:08 +00:00
Vladimir
d56d7145c1
Merge pull request #24250 from ucasFL/count-range
Add aggregate function rangeSum
2021-05-21 13:23:38 +03:00
alesapin
20a34e951a Split fetch part into two stages, don't use replicated block output stream 2021-05-21 12:30:49 +03:00
kssenii
6931573f69 Fix checks 2021-05-21 09:22:20 +00:00
kssenii
074428264f Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into hdfs-idisk 2021-05-21 08:26:54 +00:00
Maksim Kita
d78f9fc271
Merge pull request #24146 from azat/mysql-settings
Add settings (for connections) for MySQL storage engine
2021-05-21 10:04:11 +03:00
Maksim Kita
f65d44a5f6
Merge pull request #24364 from kitaisreal/aarch64-hash-tables-benchmark
AARCH64 hash tables benchmark
2021-05-21 09:59:36 +03:00
Alexey Milovidov
2b01b46b25 Add comment 2021-05-21 09:33:00 +03:00
Alexey Milovidov
792dbbe6ae Refinements 2021-05-21 09:30:13 +03:00
alexey-milovidov
7ae047a721
Update gtest_local_address.cpp 2021-05-21 08:22:08 +03:00
Alexey Milovidov
ee247aaa5b Simplify code 2021-05-21 08:21:37 +03:00
Alexey Milovidov
ccc19f1201 Simplify code 2021-05-21 08:21:19 +03:00
Alexey Milovidov
87a7133659 Add a test and fix the code 2021-05-21 08:19:08 +03:00
Alexey Milovidov
b553c5a117 Recognize more addresses as local 2021-05-21 08:19:08 +03:00
alexey-milovidov
04e3ddeffa
Merge pull request #24151 from azat/format-FROM-clause
Change FROM clause formatting (make it more human friendly)
2021-05-21 06:26:53 +03:00
alexey-milovidov
5de03390e0
Merge pull request #24285 from abyss7/issue-23901
Allow empty HTTP headers
2021-05-21 05:21:06 +03:00
Alexey Milovidov
ea30bb7abf Improve implementation 2021-05-21 04:17:18 +03:00
Maksim Kita
a896af572e Fixed comment 2021-05-21 01:06:29 +03:00
Maksim Kita
0d174831c9 Updated X86 benchmarks 2021-05-21 00:56:33 +03:00
Maksim Kita
d17adeecaf AARCH64 hash tables benchmark 2021-05-20 20:50:37 +00:00
Azat Khuzhin
4f41ebcae3 Add settings (for connections) for MySQL storage engine
Default settings are not very efficient, since they do not even reuse
connections.
And when each query requires connection you can have only ~80 QPS, while
by simply enabling connection reuse (connection_auto_close=false) you
can have ~500 QPS (and by increasing connection_pool_size you can have
better QPS throughput).

So this patch allows to pass through some connection related settings
for the StorageMySQL engine, like:
- connection_pool_size=16
- connection_max_tries=3
- connection_auto_close=true

v2: remove connection_pool_default_size
v3: remove num_tries_on_connection_loss
2021-05-20 22:44:52 +03:00
Maksim Kita
2c4920186b
Merge pull request #24342 from kitaisreal/jit-support-aarch64-compilation
LLVM JIT support AARCH64
2021-05-20 22:24:59 +03:00
robot-clickhouse
471142043f Auto version update to [21.7.1.1] [54452] 2021-05-20 22:23:34 +03:00
alesapin
deb784a321 Merge branch 'master' into nvartolomei-parts-move 2021-05-20 21:24:55 +03:00
Azat Khuzhin
8b438bcd3c Change formatting of subqueries (make it more human friendly)
Fix trailing whitespaces in FROM/IN clause with subqueries in multiline
mode, and also changes the output of the queries slightly in a more
human friendly way.

Before:

    $ clickhouse-format <<<'select * from system.one, (select * from system.one)'
    SELECT *
    FROM system.one
    ,
    (
        SELECT *
        FROM system.one
    )

After:

    $ clickhouse-format <<<'select * from system.one, (select * from system.one)'
    SELECT *
    FROM system.one,
    (
        SELECT *
        FROM system.one
    )

v2: Fix subqueries formatting in a different way
v3: Adjust *.reference in tests
v4: Fix modernize-loop-convert in ASTTablesInSelectQuery
2021-05-20 21:04:12 +03:00
Yuriy Chernyshov
b7993400fe Do not peerdir enabled-by-default libcxxabi-parts 2021-05-20 18:37:12 +03:00
kssenii
c69f587f8a Adjust minMax index 2021-05-20 15:32:18 +00:00
tavplubix
acd952d701
Merge pull request #24309 from ClickHouse/fix_rename_matview
Fix rename MaterializedView
2021-05-20 18:20:38 +03:00
vdimir
09d63545b0
Return float in segmentLengthSum for float args, add tests 2021-05-20 17:43:24 +03:00
Maksim Kita
cf5f36b70e LLVM JIT support AARCH64 2021-05-20 14:09:32 +00:00
vdimir
c8cbde1b89
Merge branch 'master' into count-range 2021-05-20 16:51:51 +03:00
kssenii
06ff4ab9da Fix build 2021-05-20 13:43:08 +00:00
kssenii
2f6770c9a0 Unite writeBuffers 2021-05-20 10:46:26 +00:00
Maksim Kita
bbd53196e7 PODArray insert in the middle tests 2021-05-20 13:24:50 +03:00
kssenii
550a4e33f9 Unite readBuffers 2021-05-20 09:57:59 +00:00
Maksim Kita
efe70aaa07
Merge pull request #24271 from fuzhe1989/fix/podarray_memmove
Use memmove in PODArray::insert to handle memory overlapping.
2021-05-20 12:50:27 +03:00
Maksim Kita
25fe0e88f8 Compile expressions added partition by test 2021-05-20 11:16:15 +03:00
Maksim Kita
af78649e56
Merge pull request #24023 from kitaisreal/compile-expressions-comparison-function-constant-case-with-alias-fix
CompileExpressions comparison function constant case fix
2021-05-20 10:58:38 +03:00
Maksim Kita
b0476c1fa2
Merge pull request #24273 from kitaisreal/expression-actions-compile-only-necessary-places
ExpressionActions compile only necessary places
2021-05-20 10:53:30 +03:00
Nikolai Kochetov
818d081292
Merge pull request #24296 from amosbird/projection-fix5
Skip data finalization when doing projection materialization.
2021-05-20 10:50:42 +03:00
Nikolai Kochetov
d09f3bcd0d
Merge pull request #24252 from ClickHouse/try-fix-group-by-shard-num-in-another-way
Try to fix GROUP BY _shard_num in a different way
2021-05-20 10:49:45 +03:00
alesapin
cf94bc9b8c
Merge pull request #24059 from ClickHouse/standalone_keeper
Standalone keeper server
2021-05-20 10:10:51 +03:00
alesapin
b9c3601083
Merge pull request #24275 from ucasFL/fix-mutation
Fix mutation fail of StorageMemory
2021-05-20 10:09:48 +03:00
Amos Bird
81dd60fdc2
Fix drop partition in rare case 2021-05-20 14:55:28 +08:00
Alexey Milovidov
2b6ffc557a Remove useless file 2021-05-20 09:31:17 +03:00
Alexey Milovidov
1006a970f7 Remove AutoArray 2021-05-20 09:30:13 +03:00
mergify[bot]
29b3ed4551
Merge branch 'master' into modulo-partition-key 2021-05-20 05:45:11 +00:00
Alexey Milovidov
e686349fcc Fix wrong logic in hints about Enum names 2021-05-20 01:47:10 +03:00
Alexey Milovidov
93585a0dd1 Fix bad test for Enum hints 2021-05-20 01:26:44 +03:00
Alexey Milovidov
335dafe887 Revert "Minor change"
This reverts commit db9f68fced.
2021-05-20 01:16:43 +03:00
Alexey Milovidov
db9f68fced Minor change 2021-05-20 01:16:11 +03:00
Azat Khuzhin
92632bf0c1 Fix isLocalAddress() (ifa_addr maybe NULL)
From getifaddrs(3):

    The ifa_addr field points to a structure containing the interface
    address.  (The sa_family subfield should be consulted to
    determine the format of the address structure.)  This field may
    contain a null pointer.

I have the problem with tun0, that creates points-to-point address, so
getifaddrs() returns NULL ifa_addr for one of addrs for tun0.
You can check this, using this simple example - [1].

  [1]: https://gist.github.com/azat/cc667d145bc74215c40cdbb69f38189b
2021-05-20 00:04:11 +03:00
kssenii
9a5a6f39b7 Simplify writeFile 2021-05-19 20:31:43 +00:00
kssenii
56b388addf Add check for nullptr 2021-05-19 19:32:04 +00:00
alexey-milovidov
57348632dc
Merge pull request #24196 from Algunenano/gcc11_compat
Gcc11 compatibility
2021-05-19 22:20:22 +03:00
Alexander Tokmakov
2996e7c072 fix rename matview 2021-05-19 21:53:31 +03:00
Maksim Kita
9982f05e4d
Merge pull request #24284 from kitaisreal/fix-arcadia-after-function-refactoring
Fixed Arcadia after IFunctionOverloadResolver interface refactoring
2021-05-19 21:13:01 +03:00
Maksim Kita
8e68d007f3 Fixed tests 2021-05-19 20:57:07 +03:00
kssenii
477214a57f Fix partitionPrunner with modulo 2021-05-19 17:36:32 +00:00
Amos Bird
c68ef31065
Skip data finalization when doing projection materialization. 2021-05-20 00:28:50 +08:00
Nikolai Kochetov
e8f8b2ba18
Merge pull request #24162 from amosbird/projection-fix2
Fix add projection to replicated mergetree
2021-05-19 18:07:52 +03:00
Maksim Kita
f3164a6bc0 IFunction updated Exception throw 2021-05-19 17:58:23 +03:00
feng lv
9de7399737 update
fix test
2021-05-19 14:51:54 +00:00
Maksim Kita
c50909468f Updated ExpressionActionSettings 2021-05-19 17:32:07 +03:00
Maksim Kita
218f534a6f
Merge pull request #24100 from Enmk/fix_DateTime64_vs_DateTime_in_WHERE
Fix DateTime64 column vs DateTime value in where
2021-05-19 17:27:28 +03:00
alesapin
301dc848f5 Merge branch 'master' into nvartolomei-parts-move 2021-05-19 17:17:01 +03:00
feng lv
d92b1f0e9a Fix mutation of StorageMemory
fix

fix
2021-05-19 14:15:50 +00:00
Ivan Lezhankin
33f816d28d Allow empty HTTP headers 2021-05-19 16:20:23 +03:00
Alexander Kuzmenkov
e9b69bbd70
Merge pull request #23906 from azat/fix-distributed_group_by_no_merge
distributed_group_by_no_merge fixes
2021-05-19 16:16:08 +03:00
Alexander Kuzmenkov
09cb467812
Update StorageDistributed.cpp 2021-05-19 16:14:33 +03:00
Maksim Kita
9699299083 Fix build 2021-05-19 16:11:38 +03:00
Maksim Kita
5a359a15bc Fixed Arcadia after IFunctionOverloadResolver interface refactoring 2021-05-19 15:57:37 +03:00
Nikolai Kochetov
9f28d0966a Fix typos. 2021-05-19 15:43:10 +03:00
kssenii
5196075fd9 Better 2021-05-19 12:34:01 +00:00
Nikolai Kochetov
c07043fd97 Try fix more cases. 2021-05-19 15:16:18 +03:00
kssenii
ba41d01b78 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into hdfs-idisk 2021-05-19 11:47:05 +00:00
Nikita Mikhaylov
aa58fc096c done 2021-05-19 14:44:39 +03:00
Nikolai Kochetov
9d152a3c4d
Update src/Interpreters/ClusterProxy/SelectStreamFactory.cpp
Co-authored-by: Azat Khuzhin <a3at.mail@gmail.com>
2021-05-19 13:40:46 +03:00
Nikolai Kochetov
0b8bf34aba
Merge pull request #24256 from ClickHouse/log-exception-for-allocator-free
Log exception in Allocator::free
2021-05-19 13:39:39 +03:00
feng lv
5e4cde8540 fix 2021-05-19 10:24:53 +00:00
mergify[bot]
230bec70fb
Merge branch 'master' into modulo-partition-key 2021-05-19 10:08:41 +00:00
alesapin
4d6c71801c
Merge branch 'master' into nv/parts-uuid-move-shard 2021-05-19 13:03:14 +03:00
Maksim Kita
3d94798d9d Remove comment 2021-05-19 11:45:31 +03:00
Maksim Kita
150a88d647 ExpressionActions compile only necessary places 2021-05-19 11:43:16 +03:00
fuzhe1989
f00158c10b Use memmove in PODArray::insert to handle memory overlapping. 2021-05-19 16:06:54 +08:00
alesapin
90f12a3002
Merge pull request #24203 from ClickHouse/simplier_is_local_address
Simplier isLocalAddress
2021-05-19 10:53:35 +03:00
Vitaly Baranov
ce1c947f25
Merge pull request #22228 from traceon/ldap-user-dn-detection
LDAP: user DN detection functionality for role mapping with Active Directory
2021-05-19 10:34:47 +03:00
tavplubix
8b13e73ac2
Merge pull request #24208 from ClickHouse/fix_intersecting_parts_again
Addition to #23997
2021-05-18 21:13:25 +03:00
Vitaliy Zakaznikov
03ebd18d01 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into ldap-user-dn-detection 2021-05-18 14:08:28 -04:00
Nikolai Kochetov
85c0844439
Update SelectStreamFactory.cpp
Fix typo
2021-05-18 19:19:16 +03:00
Nikolai Kochetov
342486e321 Log exception in Allocator::free 2021-05-18 19:15:48 +03:00
mergify[bot]
8ba2480724
Merge branch 'master' into modulo-partition-key 2021-05-18 15:32:51 +00:00
Anton Popov
662888aee0
Merge pull request #24183 from hexiaoting/dev_nested_bugfix
Fix bug for update nested columns with const condition
2021-05-18 18:26:02 +03:00
Nikolai Kochetov
57f5e33464 Try to fix GROUP BY _shard_num 2021-05-18 18:17:19 +03:00
Kseniia Sumarokova
0ab15d0bc4
Merge branch 'master' into modulo-partition-key 2021-05-18 17:45:32 +03:00
Anton Ivashkin
d256cf4edf Fix PVS check (Two or more case-branches perform the same actions) 2021-05-18 17:41:09 +03:00
alesapin
31181095e7 Review fixes 2021-05-18 17:08:56 +03:00
alesapin
b390ebb083 Merge branch 'master' into standalone_keeper 2021-05-18 16:27:28 +03:00
alesapin
c1c6a0d8e3
Merge pull request #24248 from ucasFL/remove
remove useless code
2021-05-18 16:09:00 +03:00
feng lv
6c064d62e9 add rangeSum udaf
fix
2021-05-18 12:48:08 +00:00
feng lv
403d0a305b remove useless code 2021-05-18 12:19:04 +00:00
tavplubix
3a98e7f427
Merge pull request #24124 from abel-cheng/feature/thread_name_in_stack_trace
Add thread_name in system.stack_trace
2021-05-18 14:48:49 +03:00
Alexander Tokmakov
2dac182df3 fix 2021-05-18 13:00:34 +03:00
alesapin
2b62ce9044 Add smoke test for local address 2021-05-18 11:35:51 +03:00
alesapin
36aeb59705 Fix lazy test 2021-05-18 11:03:38 +03:00
Kruglov Pavel
cee8e280c7
Merge pull request #24193 from plugine/fix-mutation-for-storagememory
Fix wrong typo at StorageMemory
2021-05-18 10:57:52 +03:00
alesapin
22cc1c953f Revert "PVS Studio fixes"
This reverts commit 87c6e39a29.
2021-05-18 10:34:16 +03:00
alesapin
64baa524b8
Merge pull request #24191 from kssenii/hdfs-fixes
Fix abnormal termination when hdfs is unreachable
2021-05-18 10:12:05 +03:00
Maksim Kita
40d8d95fd2
Merge pull request #24067 from azat/buffer-destroy-first
Flush Buffer tables before shutting down tables (within one database)
2021-05-18 09:07:28 +03:00
Maksim Kita
49d82ee408
Merge pull request #24177 from ucasFL/fix-reinterpret
fix reinterpretAsFixedString for UUID
2021-05-18 08:58:08 +03:00
Maksim Kita
4a84c2f3ea
Merge pull request #24210 from kitaisreal/small-style-code-simplification
Small code simplification
2021-05-18 08:13:54 +03:00
hexiaoting
4eeaa02975 fix 2021-05-18 10:00:09 +08:00
feng lv
dcf5d345e8 fix reinterpretAsFixedString for UUID
fix
2021-05-18 01:50:27 +00:00
Alexander Tokmakov
20b9af7b26 do not allow concurrent alter partition 2021-05-18 00:20:58 +03:00
Maksim Kita
8e13182bc4
Merge pull request #24182 from kitaisreal/lru-benchmarks
Updated LRUHashMap benchmarks
2021-05-17 23:58:16 +03:00
Maksim Kita
f5b9007d63 Small code simplification 2021-05-17 23:26:25 +03:00
alesapin
87c6e39a29 PVS Studio fixes 2021-05-17 23:23:32 +03:00
Maksim Kita
5e7ca811fb
Merge pull request #24176 from vitlibar/fix-race-condition-in-context-access
Fix race condition in ContextAccess
2021-05-17 23:01:01 +03:00
Maksim Kita
a208e3cdb5 Removed commented code 2021-05-17 22:13:50 +03:00
Maksim Kita
0870970e30
Merge pull request #24178 from kitaisreal/function-move-file
Function move file
2021-05-17 22:02:43 +03:00
Raúl Marín
c312121ced gtest_sensitive_data_masker: Adapt error output after re2 update 2021-05-17 19:38:23 +02:00
alesapin
6127ba901e Small improvements 2021-05-17 19:29:11 +03:00
alesapin
acaf260a2e Better 2021-05-17 19:18:38 +03:00
alesapin
b4f07a017c Space 2021-05-17 18:32:34 +03:00
alesapin
5a0d0a1717 Much simplier isLocalAddress 2021-05-17 18:31:44 +03:00
kssenii
71fcbefdc7 Add final to class 2021-05-17 14:38:48 +00:00
kssenii
8c955680ad Add comments and remove adjusted deserializarion 2021-05-17 14:33:04 +00:00