Commit Graph

13939 Commits

Author SHA1 Message Date
Kseniia Sumarokova
cb8af0fd4c
Merge pull request #11058 from overshov/master
Implement IDisk interface for HDFS
2021-05-26 14:14:06 +03:00
mergify[bot]
24002b98b4
Merge branch 'master' into log-fname-file-checker 2021-05-26 09:02:16 +00:00
alesapin
b63dfeef88
Merge pull request #24499 from ClickHouse/fix_fake_race
Fix benign race (detected by clang-12) in Keeper snapshots
2021-05-26 11:43:22 +03:00
alesapin
08c37a4c9e Merge branch 'master' into configurable_max_parts_to_merge 2021-05-26 11:30:39 +03:00
Maksim Kita
d56dc82784
Merge pull request #24468 from kitaisreal/compile-expressions-cached-functions-with-context-fix
CompileExpression cached functions with context fix
2021-05-26 10:52:22 +03:00
alesapin
069d45790f
Merge pull request #24157 from kssenii/modulo-partition-key
Adjust modulo function when used in partition key
2021-05-26 10:30:54 +03:00
alesapin
5638c18140
Merge pull request #22864 from ianton-ru/s3_zero_copy_replication
Fix Zero-Copy replication with several S3 volumes (issue 22679)
2021-05-26 10:28:23 +03:00
kssenii
940eab6924 Review fixes 2021-05-26 09:26:19 +03:00
mergify[bot]
d6ada7df5c
Merge branch 'master' into fixdate 2021-05-26 02:38:10 +00:00
tavplubix
84f9d38620
Merge pull request #24321 from amosbird/fixdroppartition
Fix drop partition in rare case
2021-05-26 01:34:22 +03:00
Maksim Kita
60c20ed62d Update MemoryTracker 2021-05-25 23:54:48 +03:00
Maksim Kita
c79f480e46 Fix expression compilation without cache 2021-05-25 23:53:46 +03:00
Maksim Kita
fadead3efe MemoryTracker new no throw 2021-05-25 22:23:26 +03:00
Maksim Kita
0eabdc7241 CompileExpression cached functions with context fix 2021-05-25 21:46:40 +03:00
Maksim Kita
315994f686
Merge pull request #24442 from kitaisreal/actions-dag-compile-expressions-update
ActionsDAG compile expressions update
2021-05-25 21:44:23 +03:00
Maksim Kita
0e03d216d8
Update Settings.h 2021-05-25 21:44:17 +03:00
Azat Khuzhin
99008e91f2 Remove superfluous includes of SourceWithProgress.h
Since Processors/Pipe is pretty common header, and after this patch -200
CU for SourceWithProgress.h changes.
2021-05-25 21:30:46 +03:00
kssenii
379e26bcbc Fix checks 2021-05-25 17:37:35 +00:00
kssenii
e01abf807e Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into hdfs-idisk 2021-05-25 17:32:43 +00:00
mergify[bot]
05ee36d820
Merge branch 'master' into s3_zero_copy_replication 2021-05-25 15:39:23 +00:00
mergify[bot]
67e7030eae
Merge branch 'master' into modulo-partition-key 2021-05-25 15:39:17 +00:00
mergify[bot]
526bdd7eaa
Merge branch 'master' into fix_fake_race 2021-05-25 15:32:43 +00:00
mergify[bot]
7f9746872d
Merge branch 'master' into keeper_auth 2021-05-25 15:32:30 +00:00
alesapin
359668a20b Fix benign race (detected by clang-12) in Keeper snapshots 2021-05-25 18:05:51 +03:00
Vladimir
a9e435816e
Merge pull request #24400 from ianton-ru/log_aws_remove
Add log record for removed from AWS S3 keys
2021-05-25 16:52:11 +03:00
Anton Popov
453a1963d3
fix style 2021-05-25 16:40:55 +03:00
Anton Popov
ed180daf33
fix style 2021-05-25 16:40:03 +03:00
alesapin
6e29404a75 Add max_parts_to_merge_at_once setting 2021-05-25 16:21:17 +03:00
Nikita Mikhaylov
da496cba01
Update ThreadPool.cpp 2021-05-25 15:58:04 +03:00
Nikita Mikhaylov
ba6595cd17 add more comments 2021-05-25 14:59:29 +03:00
Nikita Mikhaylov
343d30002d done 2021-05-25 14:59:29 +03:00
kssenii
75a6b21f19 Better 2021-05-25 11:29:46 +00:00
vdimir
de764d8be4
Log file name on error in FileChecker ctor 2021-05-25 14:11:20 +03:00
Alexander Tokmakov
4849ea2e03 fix unexpected behavior in mutation finalization 2021-05-25 14:10:45 +03:00
Nikolai Kochetov
d4998909b6
Merge pull request #24463 from ClickHouse/fix-24024
Fix header mismatch for UNION.
2021-05-25 12:04:45 +03:00
Maksim Kita
ba43fe784c Updated tests 2021-05-25 11:50:40 +03:00
Maksim Kita
f9f1ac165c Update jit_example 2021-05-25 10:22:25 +03:00
Anton Popov
3acbd12c54 enable reading of subcolumn for distributed tables 2021-05-25 03:49:24 +03:00
mergify[bot]
19c0f508a3
Merge branch 'master' into ldap-role-mappind-deadlock-fix 2021-05-25 00:21:10 +00:00
Anton Popov
35e2cc7b2b fix several cases in cast operator 2021-05-25 02:50:28 +03:00
kssenii
70469429c1 Fixes 2021-05-24 23:39:56 +00:00
kssenii
c3fc2ff04b Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into modulo-partition-key 2021-05-24 22:08:49 +00:00
Maksim Kita
ef2696bae5 Fixed IFunction then typos 2021-05-24 23:27:32 +03:00
Maksim Kita
0628fb8b1b
Merge pull request #24417 from kitaisreal/function-constant-result-with-nonconstant-arguments
Function constant result with nonconstant arguments
2021-05-24 23:16:47 +03:00
Anton Popov
6c0ac12dbb fix tuples in 'CREATE .. AS SELECT' queries 2021-05-24 23:15:04 +03:00
Nikolai Kochetov
79a0029843 Fix header mismatch for UNION. 2021-05-24 21:09:00 +03:00
kssenii
cef509e5b5 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into hdfs-idisk 2021-05-24 17:39:34 +00:00
kssenii
31107816bb fs::absolute to fs::canonical 2021-05-24 20:37:54 +03:00
Anton Ivashkin
c936dab6d5 Fix part type in Fetcher::downloadPartToS3 2021-05-24 19:37:37 +03:00
alesapin
d72d28a0a5 Fix clang tidy 2021-05-24 18:53:11 +03:00
Amos Bird
6ba29af871
Fix toWeek monotonicity 2021-05-24 23:52:02 +08:00
Anton Ivashkin
a98286b4c4 Merge master 2021-05-24 17:46:29 +03:00
Maksim Kita
04c5bbc378
Merge pull request #24434 from ClickHouse/pvs-studio-fixes-7
Mark false positives for PVS-Studio
2021-05-24 16:36:54 +03:00
mergify[bot]
5f1c2cf22e
Merge branch 'master' into keeper_auth 2021-05-24 13:17:32 +00:00
alesapin
77d4002498 Fix unit tests 2021-05-24 15:26:23 +03:00
alesapin
11ac483e12 Add tests 2021-05-24 15:18:04 +03:00
tavplubix
6b228f2630
Update StorageReplicatedMergeTree.cpp 2021-05-24 15:13:42 +03:00
Maksim Kita
7af4d5b86d Fixed tests 2021-05-24 14:25:02 +03:00
tavplubix
e0f214d0e9
Update StorageReplicatedMergeTree.cpp 2021-05-24 14:23:23 +03:00
Maksim Kita
83f423ec85 Add YAMLParser to ya.make 2021-05-24 14:22:49 +03:00
Anton Ivashkin
4b9488be40 Add log record for removed from AWS S3 keys 2021-05-24 12:34:32 +03:00
Maksim Kita
af233007f6 Fixed code review issues 2021-05-24 12:30:28 +03:00
Maksim Kita
b128221cf0 ActionsDAG compile expressions update 2021-05-24 11:59:27 +03:00
Maksim Kita
1a725d916b Upated LogicalFunctions 2021-05-24 10:16:12 +03:00
Maksim Kita
72fbb2dd54 Fixed tests 2021-05-24 10:16:12 +03:00
Maksim Kita
ed443c8941 Function constant result with nonconstant arguments 2021-05-24 10:16:12 +03:00
Alexey Milovidov
d32819f068 Mark false positives for PVS-Studio 2021-05-24 06:59:12 +03:00
kssenii
659e57e60f Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into modulo-partition-key 2021-05-23 22:46:00 +00:00
kssenii
1ffaf1d793 Better check 2021-05-23 21:53:32 +00:00
kssenii
ecd82213d1 Some clean up, more tests 2021-05-23 20:19:04 +00:00
Denis Glazachev
0d2c239938 Allow recursive execution paths 2021-05-24 00:07:52 +04:00
Kseniia Sumarokova
3dac785fa6
Merge pull request #24415 from kssenii/rabbit-fixes
Add exponential backoff to reschedule read attempt in case RabbitMQ queues are empty (CPU load issue)
2021-05-23 21:55:32 +03:00
alesapin
cd815efaee Merge branch 'master' into keeper_auth 2021-05-23 20:57:18 +03:00
alesapin
472a41b287 Superdigest support 2021-05-23 20:54:42 +03:00
Maksim Kita
e7f77f27bf
Merge pull request #24030 from kitaisreal/submodule-llvm-project
Added llvm-project submodule
2021-05-23 16:27:56 +03:00
Maksim Kita
32859fd901
Update min_count_to_compile_expression 2021-05-23 12:43:29 +03:00
kssenii
866b29fb5a Return list fds with Poco, more canonical 2021-05-23 10:56:13 +03:00
kssenii
bbf56e35ac Merge branch 'master' of github.com:ClickHouse/ClickHouse into poco-file-to-std-fs 2021-05-23 10:54:48 +03:00
kssenii
0f98731c1f More integration tests 2021-05-23 07:33:31 +00:00
alesapin
6c0b683d3a
Merge pull request #17871 from nvartolomei/nv/parts-uuid-move-shard
Part movement between shards
2021-05-23 10:20:57 +03:00
alesapin
3f2d280e34
Merge pull request #24412 from ClickHouse/fix_race_condition_keeper_shutdown
Fix race condition on keeper shutdown
2021-05-23 10:11:39 +03:00
mergify[bot]
3c6e6464a7
Merge branch 'master' into s3_zero_copy_replication 2021-05-23 07:09:17 +00:00
Maksim Kita
518552c866 Fixed tests 2021-05-23 01:37:54 +03:00
kssenii
1c43b333ea Merge branch 'master' of github.com:ClickHouse/ClickHouse into poco-file-to-std-fs 2021-05-22 21:26:48 +03:00
alesapin
bdb52bb643 Fixup ACL 2021-05-22 19:21:52 +03:00
kssenii
5606e248a7 Fix 2021-05-22 16:19:56 +00:00
kssenii
b72f6ea78e Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into modulo-partition-key 2021-05-22 16:15:15 +00:00
alesapin
b9e9c9cf23 More correct implementation 2021-05-22 19:07:47 +03:00
alesapin
e4ce6faab6 Fix build 2021-05-22 15:32:53 +03:00
alexey-milovidov
13398ad233
Merge pull request #24319 from azat/ipv6-fix
Fix IPv6 addresses resolving
2021-05-22 15:23:18 +03:00
Maksim Kita
42e91df363 Updated submodule to llvm12 2021-05-22 15:22:38 +03:00
kssenii
53ce22ae65 Exponencial backoff if queues are empty 2021-05-22 09:44:57 +00:00
alesapin
8c06f81130 Followup fix 2021-05-22 10:50:23 +03:00
alesapin
8c63f0f8e2 Fix race condition on keeper shutdown 2021-05-22 10:46:12 +03:00
alesapin
6e593cda7b Working test 2021-05-22 10:38:50 +03:00
Vitaly Baranov
b89da7b420
Merge pull request #21858 from BoloniniD/yaml-cfg
YAML Configuration for ClickHouse
2021-05-22 10:29:51 +03:00
alexey-milovidov
a25f1910cc
Merge pull request #24320 from ClickHouse/remove-auto-array
Remove AutoArray
2021-05-22 02:19:59 +03:00
alesapin
ec8394ed1d Initial implementation 2021-05-22 00:19:22 +03:00
Maksim Kita
3aa1dba6e1 Added AggregateFunctionSegmentLengthSum to ya.make 2021-05-22 00:13:27 +03:00
kssenii
096d117f68 Review fixes 2021-05-22 00:12:46 +03:00
alexey-milovidov
7b38ad3a85
Merge pull request #23204 from RedClusive/feature-quantileBfloat16
Feature quantile bfloat16
2021-05-21 23:46:05 +03:00
Azat Khuzhin
1eceb5a8d3 parseAddress: improve port parsing (verify that port is a valid int) 2021-05-21 22:47:35 +03:00
Azat Khuzhin
44c85edae0 parseAddress: improve parsing of port for IPv6 2021-05-21 22:47:35 +03:00
Azat Khuzhin
09020242b2 parseAddress: improve parsing of port (by using tryParse() over parse()) 2021-05-21 22:47:35 +03:00
Azat Khuzhin
0536db0ec3 Fix resolving of IPv6 addresses
v2: move the check from Cluster to DNSResolver
2021-05-21 22:47:35 +03:00
BoloniniD
33755f1f3d Implemented YAMLParser class 2021-05-21 21:56:22 +03:00
kssenii
fcfec83875 Fix comparisons with modulo key (version 2) 2021-05-21 16:40:47 +00:00
kssenii
94b5763dbd Revert "Different approach to fix modulo"
This reverts commit 665f1aa0f6.
2021-05-21 16:14:01 +00:00
alesapin
95a053ee72
Merge pull request #24316 from ClickHouse/more-localhost-addresses
Recognize more addresses as local
2021-05-21 18:41:58 +03:00
kssenii
30845a383f Fix comparisons with modulo key 2021-05-21 15:01:41 +00:00
kssenii
665f1aa0f6 Different approach to fix modulo 2021-05-21 14:30:08 +00:00
Anton Ivashkin
29336a4a34 Use keep_s3_on_delet flag instead of DeleteOnDestroyKeepS3 state 2021-05-21 15:29:10 +03:00
Maksim Kita
2aec0e37e4
CacheDictionaryStorage update 2021-05-21 15:27:41 +03:00
kssenii
bd0bc8e3e7 Revert "Adjust minMax index"
This reverts commit c69f587f8a.
2021-05-21 12:01:08 +00:00
Vladimir
d56d7145c1
Merge pull request #24250 from ucasFL/count-range
Add aggregate function rangeSum
2021-05-21 13:23:38 +03:00
alesapin
20a34e951a Split fetch part into two stages, don't use replicated block output stream 2021-05-21 12:30:49 +03:00
kssenii
6931573f69 Fix checks 2021-05-21 09:22:20 +00:00
kssenii
074428264f Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into hdfs-idisk 2021-05-21 08:26:54 +00:00
Maksim Kita
d78f9fc271
Merge pull request #24146 from azat/mysql-settings
Add settings (for connections) for MySQL storage engine
2021-05-21 10:04:11 +03:00
Maksim Kita
f65d44a5f6
Merge pull request #24364 from kitaisreal/aarch64-hash-tables-benchmark
AARCH64 hash tables benchmark
2021-05-21 09:59:36 +03:00
Alexey Milovidov
2b01b46b25 Add comment 2021-05-21 09:33:00 +03:00
Alexey Milovidov
792dbbe6ae Refinements 2021-05-21 09:30:13 +03:00
alexey-milovidov
7ae047a721
Update gtest_local_address.cpp 2021-05-21 08:22:08 +03:00
Alexey Milovidov
ee247aaa5b Simplify code 2021-05-21 08:21:37 +03:00
Alexey Milovidov
ccc19f1201 Simplify code 2021-05-21 08:21:19 +03:00
Alexey Milovidov
87a7133659 Add a test and fix the code 2021-05-21 08:19:08 +03:00
Alexey Milovidov
b553c5a117 Recognize more addresses as local 2021-05-21 08:19:08 +03:00
alexey-milovidov
04e3ddeffa
Merge pull request #24151 from azat/format-FROM-clause
Change FROM clause formatting (make it more human friendly)
2021-05-21 06:26:53 +03:00
alexey-milovidov
5de03390e0
Merge pull request #24285 from abyss7/issue-23901
Allow empty HTTP headers
2021-05-21 05:21:06 +03:00
Alexey Milovidov
ea30bb7abf Improve implementation 2021-05-21 04:17:18 +03:00
Maksim Kita
a896af572e Fixed comment 2021-05-21 01:06:29 +03:00
Maksim Kita
0d174831c9 Updated X86 benchmarks 2021-05-21 00:56:33 +03:00
Maksim Kita
d17adeecaf AARCH64 hash tables benchmark 2021-05-20 20:50:37 +00:00
Azat Khuzhin
4f41ebcae3 Add settings (for connections) for MySQL storage engine
Default settings are not very efficient, since they do not even reuse
connections.
And when each query requires connection you can have only ~80 QPS, while
by simply enabling connection reuse (connection_auto_close=false) you
can have ~500 QPS (and by increasing connection_pool_size you can have
better QPS throughput).

So this patch allows to pass through some connection related settings
for the StorageMySQL engine, like:
- connection_pool_size=16
- connection_max_tries=3
- connection_auto_close=true

v2: remove connection_pool_default_size
v3: remove num_tries_on_connection_loss
2021-05-20 22:44:52 +03:00
Maksim Kita
2c4920186b
Merge pull request #24342 from kitaisreal/jit-support-aarch64-compilation
LLVM JIT support AARCH64
2021-05-20 22:24:59 +03:00
robot-clickhouse
471142043f Auto version update to [21.7.1.1] [54452] 2021-05-20 22:23:34 +03:00
alesapin
deb784a321 Merge branch 'master' into nvartolomei-parts-move 2021-05-20 21:24:55 +03:00
Azat Khuzhin
8b438bcd3c Change formatting of subqueries (make it more human friendly)
Fix trailing whitespaces in FROM/IN clause with subqueries in multiline
mode, and also changes the output of the queries slightly in a more
human friendly way.

Before:

    $ clickhouse-format <<<'select * from system.one, (select * from system.one)'
    SELECT *
    FROM system.one
    ,
    (
        SELECT *
        FROM system.one
    )

After:

    $ clickhouse-format <<<'select * from system.one, (select * from system.one)'
    SELECT *
    FROM system.one,
    (
        SELECT *
        FROM system.one
    )

v2: Fix subqueries formatting in a different way
v3: Adjust *.reference in tests
v4: Fix modernize-loop-convert in ASTTablesInSelectQuery
2021-05-20 21:04:12 +03:00
kssenii
3dee003f9b Merge branch 'master' of github.com:ClickHouse/ClickHouse into poco-file-to-std-fs 2021-05-20 19:20:09 +03:00
Yuriy Chernyshov
b7993400fe Do not peerdir enabled-by-default libcxxabi-parts 2021-05-20 18:37:12 +03:00
kssenii
c69f587f8a Adjust minMax index 2021-05-20 15:32:18 +00:00
tavplubix
acd952d701
Merge pull request #24309 from ClickHouse/fix_rename_matview
Fix rename MaterializedView
2021-05-20 18:20:38 +03:00
vdimir
09d63545b0
Return float in segmentLengthSum for float args, add tests 2021-05-20 17:43:24 +03:00
Maksim Kita
cf5f36b70e LLVM JIT support AARCH64 2021-05-20 14:09:32 +00:00
vdimir
c8cbde1b89
Merge branch 'master' into count-range 2021-05-20 16:51:51 +03:00
kssenii
06ff4ab9da Fix build 2021-05-20 13:43:08 +00:00
kssenii
2f6770c9a0 Unite writeBuffers 2021-05-20 10:46:26 +00:00
Maksim Kita
bbd53196e7 PODArray insert in the middle tests 2021-05-20 13:24:50 +03:00
kssenii
550a4e33f9 Unite readBuffers 2021-05-20 09:57:59 +00:00
Maksim Kita
efe70aaa07
Merge pull request #24271 from fuzhe1989/fix/podarray_memmove
Use memmove in PODArray::insert to handle memory overlapping.
2021-05-20 12:50:27 +03:00