Commit Graph

14643 Commits

Author SHA1 Message Date
Amos Bird
6f12781bf1
Safer readInt 2021-05-27 22:56:51 +08:00
Alexander Kuzmenkov
7c6399d82d fixes 2021-05-27 17:45:40 +03:00
kssenii
0d393c0006 Fix tests 2021-05-27 17:21:19 +03:00
Nikolai Kochetov
cbdf3752ef Part 3. 2021-05-27 16:40:33 +03:00
Yatsishin Ilya
7d2f701e0a Merge remote-tracking branch 'origin/master' into integration-2 2021-05-27 16:34:30 +03:00
Anton Popov
bce3a49ff5
fix style check 2021-05-27 16:02:13 +03:00
Alexander Kuzmenkov
1d0b61dd0e Merge remote-tracking branch 'origin/master' into HEAD 2021-05-27 15:59:00 +03:00
Alexander Kuzmenkov
23e6b6fc48 parent window spec - tmp 2021-05-27 15:58:50 +03:00
Ivan Lezhankin
06a0ab12bc Merge remote-tracking branch 'upstream/master' into ast-table-identifier-2 2021-05-27 15:57:59 +03:00
alesapin
2985def91d Add tests 2021-05-27 15:54:47 +03:00
kssenii
a0d8d689d3 Merge branch 'master' of github.com:ClickHouse/ClickHouse into poco-file-to-std-fs 2021-05-27 15:44:12 +03:00
kssenii
f66c67a979 Fixes 2021-05-27 15:42:46 +03:00
mergify[bot]
452727dd2e
Merge branch 'master' into subcolumns-dist 2021-05-27 11:35:22 +00:00
Anton Popov
8a71af5797
Merge pull request #24471 from CurtizJ/fix-cast-operator
Fix several cases in cast operator
2021-05-27 14:31:51 +03:00
mergify[bot]
05766230fc
Merge branch 'master' into fix-tuples-create-as-select 2021-05-27 11:30:55 +00:00
Maksim Kita
5e65aff3fd
Merge pull request #24466 from kitaisreal/dictionaries-update-file-paths-restrictions
Dictionaries update file path restrictions
2021-05-27 13:46:47 +03:00
Alexander Kuzmenkov
5dc387d3bc
Merge pull request #24534 from ClickHouse/aku/green-check-mining-1
calculate perf test precision thresholds from historical data
2021-05-27 12:59:17 +03:00
Vladimir
bdc5b97d02
Merge pull request #24525 from vdimir/create-aggregate-func-settings
Merging #22762
2021-05-27 11:43:55 +03:00
Nikolai Kochetov
b3d30ed9cb
Merge pull request #24462 from azat/total_rows_approx-fix
Account total_rows_approx as soon as possible
2021-05-27 11:34:50 +03:00
alesapin
6924dd51a2 Merge branch 'master' into limited_fetches 2021-05-27 11:17:36 +03:00
alesapin
75dad2cdd7
Merge pull request #24533 from ClickHouse/watch_requests_read
Make `get/check/read/list` requests always read in Keeper
2021-05-27 11:16:36 +03:00
alesapin
4d59590b7f Slightly better 2021-05-27 11:15:46 +03:00
alesapin
ef17daaaa0
Merge pull request #24496 from ClickHouse/configurable_max_parts_to_merge
Add `max_parts_to_merge_at_once` setting
2021-05-27 10:56:58 +03:00
Maksim Kita
e5b78723bb
Merge pull request #24483 from kitaisreal/memory-tracker-new-no-throw
MemoryTracker new no throw
2021-05-27 10:35:55 +03:00
Yatsishin Ilya
28af06f3d0 Merge remote-tracking branch 'origin' into integration-2 2021-05-27 07:01:22 +03:00
Nikita Mikhaylov
0d3462afc8
Merge pull request #24457 from nikitamikhaylov/thread-pool-deadlock
Try to fix deadlock in ThreadPool
2021-05-27 02:51:50 +03:00
Nikita Mikhaylov
5eb47ccaa8
Merge pull request #24518 from georgthegreat/cxxabi-peerdir
Do not peerdir enabled-by-default libcxxabi-parts
2021-05-27 02:44:07 +03:00
mergify[bot]
d813d03a6a
Merge branch 'master' into i24461 2021-05-26 23:37:20 +00:00
Azat Khuzhin
66f254c8b3 Account total_rows_approx as soon as possible
Before total_rows_approx was accounted only on first read from that
source (and each part is a source), so in case of MergeTree and
max_threads=1 it can take sometime until it will be incremented.
2021-05-27 02:14:01 +03:00
Maksim Kita
4ca651838c
Merge pull request #24550 from kitaisreal/jit_example_update
Update jit_example
2021-05-27 01:02:31 +03:00
Maksim Kita
5af0ca1c1a Fixed tests 2021-05-27 00:17:46 +03:00
Maksim Kita
b26783b308 Dictionaries update file path restrictions 2021-05-27 00:17:45 +03:00
kssenii
f9088b98de Some disks update 2021-05-27 00:02:24 +03:00
kssenii
b28157a0df Merge branch 'master' of github.com:ClickHouse/ClickHouse into poco-file-to-std-fs 2021-05-27 00:01:25 +03:00
alesapin
42b2383e01 Basic throttler implementation 2021-05-26 23:37:44 +03:00
Maksim Kita
fc5dbaa413 Updated MemoryTracker 2021-05-26 23:31:35 +03:00
kssenii
73f16ee9ee Merge branch 'master' of github.com:ClickHouse/ClickHouse into poco-file-to-std-fs 2021-05-26 23:08:08 +03:00
Alexander Kuzmenkov
2a9b59f707
Update ITableFunctionFileLike.cpp 2021-05-26 21:49:33 +03:00
Nikolai Kochetov
a51a6ea0b7 Part 2. 2021-05-26 21:14:43 +03:00
BoloniniD
f8ccd47d75 Added catch to YAML_fuzzer + tested YAMLParser, no other errors found 2021-05-26 20:28:40 +03:00
Nicolae Vartolomei
be95a425d6 Avoid hiding errors like Limit for rows or bytes to read exceeded for subqueries 2021-05-26 16:45:05 +01:00
mergify[bot]
d1338230f4
Merge branch 'master' into keeper_auth 2021-05-26 13:55:00 +00:00
alesapin
8ba6ed3fc2 Simplier test 2021-05-26 16:53:05 +03:00
mergify[bot]
ab774890d3
Merge branch 'master' into thread-pool-deadlock 2021-05-26 13:42:23 +00:00
Alexander Kuzmenkov
5da54c2745 calculate perf test precision thresholds from historical data 2021-05-26 16:30:43 +03:00
alesapin
21ed59b11b Make get/check/read/list requests always read in Keeper 2021-05-26 16:09:43 +03:00
Anton Popov
e1c86d3747
Merge pull request #24446 from amosbird/fixdate
Fix toWeek monotonicity
2021-05-26 15:32:03 +03:00
tavplubix
a21e4b333e
Update ReplicatedMergeTreeQueue.cpp 2021-05-26 15:10:38 +03:00
Vladimir
fc15cad7e0
Pass Settings to aggregate function creator 2021-05-26 14:58:31 +03:00
Raúl Marín
d9bc0266f7 Add missing error codes to fix style check 2021-05-26 13:48:33 +02:00
Vladimir
7224e25156
Revert "Pass Settings to aggregate function creator" 2021-05-26 14:46:42 +03:00
Vladimir
6650c67b01
Merge pull request #22762 from vdimir/create-aggregate-func-settings 2021-05-26 14:32:14 +03:00
Raúl Marín
46787bf51f Disallow building a uniqXXXXState on top of another aggregation state
Fixes https://github.com/ClickHouse/ClickHouse/issues/24461
2021-05-26 13:15:03 +02:00
Kseniia Sumarokova
cb8af0fd4c
Merge pull request #11058 from overshov/master
Implement IDisk interface for HDFS
2021-05-26 14:14:06 +03:00
BoloniniD
6b3a430dbd Merge branch 'master' of github.com:ClickHouse/ClickHouse into yaml-fuzz 2021-05-26 13:58:03 +03:00
mergify[bot]
24002b98b4
Merge branch 'master' into log-fname-file-checker 2021-05-26 09:02:16 +00:00
alesapin
b63dfeef88
Merge pull request #24499 from ClickHouse/fix_fake_race
Fix benign race (detected by clang-12) in Keeper snapshots
2021-05-26 11:43:22 +03:00
alesapin
08c37a4c9e Merge branch 'master' into configurable_max_parts_to_merge 2021-05-26 11:30:39 +03:00
BoloniniD
84914ca12f Added YAML_fuzzer to CMakeLists + fixed .as<string> errors after testing 2021-05-26 10:56:51 +03:00
Maksim Kita
d56dc82784
Merge pull request #24468 from kitaisreal/compile-expressions-cached-functions-with-context-fix
CompileExpression cached functions with context fix
2021-05-26 10:52:22 +03:00
alesapin
069d45790f
Merge pull request #24157 from kssenii/modulo-partition-key
Adjust modulo function when used in partition key
2021-05-26 10:30:54 +03:00
alesapin
5638c18140
Merge pull request #22864 from ianton-ru/s3_zero_copy_replication
Fix Zero-Copy replication with several S3 volumes (issue 22679)
2021-05-26 10:28:23 +03:00
kssenii
940eab6924 Review fixes 2021-05-26 09:26:19 +03:00
Yatsishin Ilya
d34bc32224 Merge remote-tracking branch 'origin' into integration-2 2021-05-26 07:38:43 +03:00
mergify[bot]
d6ada7df5c
Merge branch 'master' into fixdate 2021-05-26 02:38:10 +00:00
Alexey Milovidov
20f59ffbb9 Merge branch 'master' into issue-16775 2021-05-26 03:46:43 +03:00
tavplubix
84f9d38620
Merge pull request #24321 from amosbird/fixdroppartition
Fix drop partition in rare case
2021-05-26 01:34:22 +03:00
BoloniniD
1fbcfd9c6a Added check for temp file existance 2021-05-26 00:58:49 +03:00
Maksim Kita
60c20ed62d Update MemoryTracker 2021-05-25 23:54:48 +03:00
Maksim Kita
c79f480e46 Fix expression compilation without cache 2021-05-25 23:53:46 +03:00
Maksim Kita
fadead3efe MemoryTracker new no throw 2021-05-25 22:23:26 +03:00
Maksim Kita
0eabdc7241 CompileExpression cached functions with context fix 2021-05-25 21:46:40 +03:00
Maksim Kita
315994f686
Merge pull request #24442 from kitaisreal/actions-dag-compile-expressions-update
ActionsDAG compile expressions update
2021-05-25 21:44:23 +03:00
Maksim Kita
0e03d216d8
Update Settings.h 2021-05-25 21:44:17 +03:00
Azat Khuzhin
99008e91f2 Remove superfluous includes of SourceWithProgress.h
Since Processors/Pipe is pretty common header, and after this patch -200
CU for SourceWithProgress.h changes.
2021-05-25 21:30:46 +03:00
kssenii
379e26bcbc Fix checks 2021-05-25 17:37:35 +00:00
kssenii
e01abf807e Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into hdfs-idisk 2021-05-25 17:32:43 +00:00
Anton Popov
7d1431f6b6 better code near dropPartition 2021-05-25 20:25:00 +03:00
Yatsishin Ilya
58671b64fb Merge remote-tracking branch 'origin' into integration-2 2021-05-25 19:55:05 +03:00
Nikolai Kochetov
34eaa48294 Part 1. 2021-05-25 19:34:43 +03:00
mergify[bot]
05ee36d820
Merge branch 'master' into s3_zero_copy_replication 2021-05-25 15:39:23 +00:00
mergify[bot]
67e7030eae
Merge branch 'master' into modulo-partition-key 2021-05-25 15:39:17 +00:00
mergify[bot]
526bdd7eaa
Merge branch 'master' into fix_fake_race 2021-05-25 15:32:43 +00:00
mergify[bot]
7f9746872d
Merge branch 'master' into keeper_auth 2021-05-25 15:32:30 +00:00
alesapin
359668a20b Fix benign race (detected by clang-12) in Keeper snapshots 2021-05-25 18:05:51 +03:00
mergify[bot]
400b74d186
Merge branch 'master' into merging-s3-backoff 2021-05-25 14:02:38 +00:00
Vladimir
a9e435816e
Merge pull request #24400 from ianton-ru/log_aws_remove
Add log record for removed from AWS S3 keys
2021-05-25 16:52:11 +03:00
Anton Popov
453a1963d3
fix style 2021-05-25 16:40:55 +03:00
Anton Popov
ed180daf33
fix style 2021-05-25 16:40:03 +03:00
alesapin
6e29404a75 Add max_parts_to_merge_at_once setting 2021-05-25 16:21:17 +03:00
Nikita Mikhaylov
da496cba01
Update ThreadPool.cpp 2021-05-25 15:58:04 +03:00
Nikita Mikhaylov
ba6595cd17 add more comments 2021-05-25 14:59:29 +03:00
Nikita Mikhaylov
343d30002d done 2021-05-25 14:59:29 +03:00
Yatsishin Ilya
125f1706f1 Merge remote-tracking branch 'origin' into integration-2 2021-05-25 14:43:01 +03:00
kssenii
75a6b21f19 Better 2021-05-25 11:29:46 +00:00
vdimir
de764d8be4
Log file name on error in FileChecker ctor 2021-05-25 14:11:20 +03:00
Alexander Tokmakov
4849ea2e03 fix unexpected behavior in mutation finalization 2021-05-25 14:10:45 +03:00
BoloniniD
6a434c0ce8 Started to implement fuzzing for YAMLParser 2021-05-25 12:19:03 +03:00
Nikolai Kochetov
d4998909b6
Merge pull request #24463 from ClickHouse/fix-24024
Fix header mismatch for UNION.
2021-05-25 12:04:45 +03:00
Maksim Kita
ba43fe784c Updated tests 2021-05-25 11:50:40 +03:00
Maksim Kita
f9f1ac165c Update jit_example 2021-05-25 10:22:25 +03:00
Anton Popov
3acbd12c54 enable reading of subcolumn for distributed tables 2021-05-25 03:49:24 +03:00
mergify[bot]
19c0f508a3
Merge branch 'master' into ldap-role-mappind-deadlock-fix 2021-05-25 00:21:10 +00:00
Anton Popov
35e2cc7b2b fix several cases in cast operator 2021-05-25 02:50:28 +03:00
kssenii
70469429c1 Fixes 2021-05-24 23:39:56 +00:00
kssenii
c3fc2ff04b Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into modulo-partition-key 2021-05-24 22:08:49 +00:00
Maksim Kita
ef2696bae5 Fixed IFunction then typos 2021-05-24 23:27:32 +03:00
Maksim Kita
0628fb8b1b
Merge pull request #24417 from kitaisreal/function-constant-result-with-nonconstant-arguments
Function constant result with nonconstant arguments
2021-05-24 23:16:47 +03:00
Anton Popov
6c0ac12dbb fix tuples in 'CREATE .. AS SELECT' queries 2021-05-24 23:15:04 +03:00
Nikolai Kochetov
79a0029843 Fix header mismatch for UNION. 2021-05-24 21:09:00 +03:00
kssenii
cef509e5b5 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into hdfs-idisk 2021-05-24 17:39:34 +00:00
kssenii
31107816bb fs::absolute to fs::canonical 2021-05-24 20:37:54 +03:00
Anton Ivashkin
c936dab6d5 Fix part type in Fetcher::downloadPartToS3 2021-05-24 19:37:37 +03:00
alesapin
d72d28a0a5 Fix clang tidy 2021-05-24 18:53:11 +03:00
Amos Bird
6ba29af871
Fix toWeek monotonicity 2021-05-24 23:52:02 +08:00
Yatsishin Ilya
2b02689213 Merge remote-tracking branch 'origin' into integration-2 2021-05-24 18:31:21 +03:00
Anton Ivashkin
a98286b4c4 Merge master 2021-05-24 17:46:29 +03:00
Dmitrii Kovalkov
a4d1b9b07d Fix 2021-05-24 16:55:05 +03:00
Maksim Kita
04c5bbc378
Merge pull request #24434 from ClickHouse/pvs-studio-fixes-7
Mark false positives for PVS-Studio
2021-05-24 16:36:54 +03:00
mergify[bot]
5f1c2cf22e
Merge branch 'master' into keeper_auth 2021-05-24 13:17:32 +00:00
Anton Popov
a36c1793d0 Merge remote-tracking branch 'upstream/master' into HEAD 2021-05-24 15:57:43 +03:00
Anton Popov
d1b9dcdcec fix build 2021-05-24 15:57:03 +03:00
alesapin
77d4002498 Fix unit tests 2021-05-24 15:26:23 +03:00
alesapin
11ac483e12 Add tests 2021-05-24 15:18:04 +03:00
tavplubix
6b228f2630
Update StorageReplicatedMergeTree.cpp 2021-05-24 15:13:42 +03:00
Maksim Kita
7af4d5b86d Fixed tests 2021-05-24 14:25:02 +03:00
tavplubix
e0f214d0e9
Update StorageReplicatedMergeTree.cpp 2021-05-24 14:23:23 +03:00
Maksim Kita
83f423ec85 Add YAMLParser to ya.make 2021-05-24 14:22:49 +03:00
Anton Ivashkin
4b9488be40 Add log record for removed from AWS S3 keys 2021-05-24 12:34:32 +03:00
Maksim Kita
af233007f6 Fixed code review issues 2021-05-24 12:30:28 +03:00
Amos Bird
7bc13f7ae8
Add initial_query_start_time to query log 2021-05-24 17:06:40 +08:00
Maksim Kita
b128221cf0 ActionsDAG compile expressions update 2021-05-24 11:59:27 +03:00
Maksim Kita
1a725d916b Upated LogicalFunctions 2021-05-24 10:16:12 +03:00
Maksim Kita
72fbb2dd54 Fixed tests 2021-05-24 10:16:12 +03:00
Maksim Kita
ed443c8941 Function constant result with nonconstant arguments 2021-05-24 10:16:12 +03:00
Yatsishin Ilya
c32cea4dd2 Merge remote-tracking branch 'origin' into integration-2 2021-05-24 09:59:16 +03:00
Alexey Milovidov
d32819f068 Mark false positives for PVS-Studio 2021-05-24 06:59:12 +03:00
Alexey Milovidov
54f0591aa5 Allow to ATTACH a table with experimental codecs 2021-05-24 06:47:00 +03:00
Alexey Milovidov
273226de32 Remove string parameter for Density 2021-05-24 06:43:25 +03:00
Alexey Milovidov
4290b48a61 Fix clang-tidy 2021-05-24 06:00:57 +03:00
Alexey Milovidov
6f70feed2f Merge branch 'master' into issue-16775 2021-05-24 05:56:57 +03:00
Alexey Milovidov
ff7b5d34bb Mark false positives for PVS-Studio 2021-05-24 02:56:03 +03:00
Alexey Milovidov
5412242908 Fix error 2021-05-24 02:38:46 +03:00
Alexey Milovidov
70d9f5c154 Fix error 2021-05-24 02:36:50 +03:00
kssenii
659e57e60f Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into modulo-partition-key 2021-05-23 22:46:00 +00:00
Alexey Milovidov
99b85bd032 Fix CMake 2021-05-24 01:34:59 +03:00
Alexey Milovidov
8d2fa6cf50 Allow to build without experimental compression libraries and remove from fasttest 2021-05-24 01:18:12 +03:00
kssenii
1ffaf1d793 Better check 2021-05-23 21:53:32 +00:00
Alexey Milovidov
57a3f132d7 Fix style 2021-05-24 00:48:54 +03:00
kssenii
ecd82213d1 Some clean up, more tests 2021-05-23 20:19:04 +00:00
Denis Glazachev
0d2c239938 Allow recursive execution paths 2021-05-24 00:07:52 +04:00
Kseniia Sumarokova
3dac785fa6
Merge pull request #24415 from kssenii/rabbit-fixes
Add exponential backoff to reschedule read attempt in case RabbitMQ queues are empty (CPU load issue)
2021-05-23 21:55:32 +03:00
alesapin
cd815efaee Merge branch 'master' into keeper_auth 2021-05-23 20:57:18 +03:00
alesapin
472a41b287 Superdigest support 2021-05-23 20:54:42 +03:00
Maksim Kita
e7f77f27bf
Merge pull request #24030 from kitaisreal/submodule-llvm-project
Added llvm-project submodule
2021-05-23 16:27:56 +03:00
Maksim Kita
32859fd901
Update min_count_to_compile_expression 2021-05-23 12:43:29 +03:00
kssenii
866b29fb5a Return list fds with Poco, more canonical 2021-05-23 10:56:13 +03:00
kssenii
bbf56e35ac Merge branch 'master' of github.com:ClickHouse/ClickHouse into poco-file-to-std-fs 2021-05-23 10:54:48 +03:00
kssenii
0f98731c1f More integration tests 2021-05-23 07:33:31 +00:00
alesapin
6c0b683d3a
Merge pull request #17871 from nvartolomei/nv/parts-uuid-move-shard
Part movement between shards
2021-05-23 10:20:57 +03:00
alesapin
3f2d280e34
Merge pull request #24412 from ClickHouse/fix_race_condition_keeper_shutdown
Fix race condition on keeper shutdown
2021-05-23 10:11:39 +03:00
mergify[bot]
3c6e6464a7
Merge branch 'master' into s3_zero_copy_replication 2021-05-23 07:09:17 +00:00
Alexey Milovidov
40d4f0678f Remove overload (harmful) 2021-05-23 04:25:06 +03:00
Alexey Milovidov
fdc5bb72f5 Minor modification 2021-05-23 04:14:29 +03:00
Alexey Milovidov
3057bbe831 Remove header files 2021-05-23 04:12:30 +03:00
Alexey Milovidov
deb68b15da Fix bad dependencies in code 2021-05-23 04:03:42 +03:00
Alexey Milovidov
77414b50e6 Remove copy-paste 2021-05-23 03:55:16 +03:00
Alexey Milovidov
1a091c7a17 Fix unbalanced whitespace 2021-05-23 03:32:22 +03:00
Alexey Milovidov
a25edc192c Fix whitespace 2021-05-23 03:31:58 +03:00
Alexey Milovidov
b0df9286f0 Fix whitespace 2021-05-23 03:30:53 +03:00
Alexey Milovidov
ecc2e98265 Fix wrong intent in exception message 2021-05-23 03:30:17 +03:00
Alexey Milovidov
e000b994e5 Add missing whitespace 2021-05-23 03:26:31 +03:00
Alexey Milovidov
4cfabd2675 Fix style, fix typo and remove extra code 2021-05-23 03:21:48 +03:00
Alexey Milovidov
0da00f6497 Fix style, fix typo and remove extra code 2021-05-23 03:18:24 +03:00
Alexey Milovidov
e330fe4bb5 Fix extra whitespace in exception messages 2021-05-23 03:15:11 +03:00
Maksim Kita
518552c866 Fixed tests 2021-05-23 01:37:54 +03:00
kssenii
1c43b333ea Merge branch 'master' of github.com:ClickHouse/ClickHouse into poco-file-to-std-fs 2021-05-22 21:26:48 +03:00
alesapin
bdb52bb643 Fixup ACL 2021-05-22 19:21:52 +03:00
kssenii
5606e248a7 Fix 2021-05-22 16:19:56 +00:00
kssenii
b72f6ea78e Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into modulo-partition-key 2021-05-22 16:15:15 +00:00
alesapin
b9e9c9cf23 More correct implementation 2021-05-22 19:07:47 +03:00
alexey-milovidov
1ed30f7246
Merge branch 'master' into issue-16775 2021-05-22 17:14:23 +03:00
alesapin
e4ce6faab6 Fix build 2021-05-22 15:32:53 +03:00
alexey-milovidov
13398ad233
Merge pull request #24319 from azat/ipv6-fix
Fix IPv6 addresses resolving
2021-05-22 15:23:18 +03:00
Maksim Kita
42e91df363 Updated submodule to llvm12 2021-05-22 15:22:38 +03:00
kssenii
53ce22ae65 Exponencial backoff if queues are empty 2021-05-22 09:44:57 +00:00
kssenii
3e6d3d4ecb Postgres schema for insert 2021-05-22 08:50:23 +00:00
alesapin
8c06f81130 Followup fix 2021-05-22 10:50:23 +03:00
alesapin
8c63f0f8e2 Fix race condition on keeper shutdown 2021-05-22 10:46:12 +03:00
alesapin
6e593cda7b Working test 2021-05-22 10:38:50 +03:00
Vitaly Baranov
b89da7b420
Merge pull request #21858 from BoloniniD/yaml-cfg
YAML Configuration for ClickHouse
2021-05-22 10:29:51 +03:00
Anton Popov
e3ca1cf94d Merge remote-tracking branch 'upstream/master' into rewrite-functions-to-subcolumns 2021-05-22 03:06:36 +03:00
Anton Popov
75adbd8e23 optimize some functions to subcolumns 2021-05-22 02:22:22 +03:00
alexey-milovidov
a25f1910cc
Merge pull request #24320 from ClickHouse/remove-auto-array
Remove AutoArray
2021-05-22 02:19:59 +03:00
alesapin
ec8394ed1d Initial implementation 2021-05-22 00:19:22 +03:00
Maksim Kita
3aa1dba6e1 Added AggregateFunctionSegmentLengthSum to ya.make 2021-05-22 00:13:27 +03:00
kssenii
096d117f68 Review fixes 2021-05-22 00:12:46 +03:00
alexey-milovidov
7b38ad3a85
Merge pull request #23204 from RedClusive/feature-quantileBfloat16
Feature quantile bfloat16
2021-05-21 23:46:05 +03:00
Azat Khuzhin
1eceb5a8d3 parseAddress: improve port parsing (verify that port is a valid int) 2021-05-21 22:47:35 +03:00
Azat Khuzhin
44c85edae0 parseAddress: improve parsing of port for IPv6 2021-05-21 22:47:35 +03:00
Azat Khuzhin
09020242b2 parseAddress: improve parsing of port (by using tryParse() over parse()) 2021-05-21 22:47:35 +03:00
Azat Khuzhin
0536db0ec3 Fix resolving of IPv6 addresses
v2: move the check from Cluster to DNSResolver
2021-05-21 22:47:35 +03:00
BoloniniD
33755f1f3d Implemented YAMLParser class 2021-05-21 21:56:22 +03:00
Anton Popov
13cfedd188 optimize some functions to subcolumns 2021-05-21 21:48:19 +03:00
kssenii
fcfec83875 Fix comparisons with modulo key (version 2) 2021-05-21 16:40:47 +00:00
kssenii
94b5763dbd Revert "Different approach to fix modulo"
This reverts commit 665f1aa0f6.
2021-05-21 16:14:01 +00:00
alesapin
95a053ee72
Merge pull request #24316 from ClickHouse/more-localhost-addresses
Recognize more addresses as local
2021-05-21 18:41:58 +03:00
kssenii
30845a383f Fix comparisons with modulo key 2021-05-21 15:01:41 +00:00
Yatsishin Ilya
fe630a0139 Merge remote-tracking branch 'origin/master' into integration-2 2021-05-21 17:57:44 +03:00
kssenii
665f1aa0f6 Different approach to fix modulo 2021-05-21 14:30:08 +00:00
mergify[bot]
970243850f
Merge branch 'master' into ast-table-identifier-2 2021-05-21 12:56:49 +00:00
Anton Ivashkin
29336a4a34 Use keep_s3_on_delet flag instead of DeleteOnDestroyKeepS3 state 2021-05-21 15:29:10 +03:00
Maksim Kita
2aec0e37e4
CacheDictionaryStorage update 2021-05-21 15:27:41 +03:00
kssenii
bd0bc8e3e7 Revert "Adjust minMax index"
This reverts commit c69f587f8a.
2021-05-21 12:01:08 +00:00
mergify[bot]
96e22c1926
Merge branch 'master' into issue-23351 2021-05-21 10:31:40 +00:00
Vladimir
d56d7145c1
Merge pull request #24250 from ucasFL/count-range
Add aggregate function rangeSum
2021-05-21 13:23:38 +03:00
alesapin
20a34e951a Split fetch part into two stages, don't use replicated block output stream 2021-05-21 12:30:49 +03:00
kssenii
6931573f69 Fix checks 2021-05-21 09:22:20 +00:00
kssenii
074428264f Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into hdfs-idisk 2021-05-21 08:26:54 +00:00
Maksim Kita
d78f9fc271
Merge pull request #24146 from azat/mysql-settings
Add settings (for connections) for MySQL storage engine
2021-05-21 10:04:11 +03:00
Maksim Kita
f65d44a5f6
Merge pull request #24364 from kitaisreal/aarch64-hash-tables-benchmark
AARCH64 hash tables benchmark
2021-05-21 09:59:36 +03:00
Alexey Milovidov
2b01b46b25 Add comment 2021-05-21 09:33:00 +03:00
Alexey Milovidov
792dbbe6ae Refinements 2021-05-21 09:30:13 +03:00
alexey-milovidov
7ae047a721
Update gtest_local_address.cpp 2021-05-21 08:22:08 +03:00
Alexey Milovidov
ee247aaa5b Simplify code 2021-05-21 08:21:37 +03:00
Alexey Milovidov
ccc19f1201 Simplify code 2021-05-21 08:21:19 +03:00
Alexey Milovidov
87a7133659 Add a test and fix the code 2021-05-21 08:19:08 +03:00
Alexey Milovidov
b553c5a117 Recognize more addresses as local 2021-05-21 08:19:08 +03:00
alexey-milovidov
04e3ddeffa
Merge pull request #24151 from azat/format-FROM-clause
Change FROM clause formatting (make it more human friendly)
2021-05-21 06:26:53 +03:00
alexey-milovidov
5de03390e0
Merge pull request #24285 from abyss7/issue-23901
Allow empty HTTP headers
2021-05-21 05:21:06 +03:00
Alexey Milovidov
ea30bb7abf Improve implementation 2021-05-21 04:17:18 +03:00
Maksim Kita
a896af572e Fixed comment 2021-05-21 01:06:29 +03:00
Maksim Kita
0d174831c9 Updated X86 benchmarks 2021-05-21 00:56:33 +03:00
Maksim Kita
d17adeecaf AARCH64 hash tables benchmark 2021-05-20 20:50:37 +00:00
Azat Khuzhin
4f41ebcae3 Add settings (for connections) for MySQL storage engine
Default settings are not very efficient, since they do not even reuse
connections.
And when each query requires connection you can have only ~80 QPS, while
by simply enabling connection reuse (connection_auto_close=false) you
can have ~500 QPS (and by increasing connection_pool_size you can have
better QPS throughput).

So this patch allows to pass through some connection related settings
for the StorageMySQL engine, like:
- connection_pool_size=16
- connection_max_tries=3
- connection_auto_close=true

v2: remove connection_pool_default_size
v3: remove num_tries_on_connection_loss
2021-05-20 22:44:52 +03:00
Maksim Kita
2c4920186b
Merge pull request #24342 from kitaisreal/jit-support-aarch64-compilation
LLVM JIT support AARCH64
2021-05-20 22:24:59 +03:00
robot-clickhouse
471142043f Auto version update to [21.7.1.1] [54452] 2021-05-20 22:23:34 +03:00
alesapin
deb784a321 Merge branch 'master' into nvartolomei-parts-move 2021-05-20 21:24:55 +03:00
Azat Khuzhin
8b438bcd3c Change formatting of subqueries (make it more human friendly)
Fix trailing whitespaces in FROM/IN clause with subqueries in multiline
mode, and also changes the output of the queries slightly in a more
human friendly way.

Before:

    $ clickhouse-format <<<'select * from system.one, (select * from system.one)'
    SELECT *
    FROM system.one
    ,
    (
        SELECT *
        FROM system.one
    )

After:

    $ clickhouse-format <<<'select * from system.one, (select * from system.one)'
    SELECT *
    FROM system.one,
    (
        SELECT *
        FROM system.one
    )

v2: Fix subqueries formatting in a different way
v3: Adjust *.reference in tests
v4: Fix modernize-loop-convert in ASTTablesInSelectQuery
2021-05-20 21:04:12 +03:00
kssenii
3dee003f9b Merge branch 'master' of github.com:ClickHouse/ClickHouse into poco-file-to-std-fs 2021-05-20 19:20:09 +03:00
Yatsishin Ilya
d07b3763ef Merge remote-tracking branch 'origin' into integration-2 2021-05-20 19:12:20 +03:00
Yatsishin Ilya
1d35da6882 Merge remote-tracking branch 'origin' into integration-2 2021-05-20 19:12:04 +03:00
Yuriy Chernyshov
b7993400fe Do not peerdir enabled-by-default libcxxabi-parts 2021-05-20 18:37:12 +03:00
kssenii
c69f587f8a Adjust minMax index 2021-05-20 15:32:18 +00:00
tavplubix
acd952d701
Merge pull request #24309 from ClickHouse/fix_rename_matview
Fix rename MaterializedView
2021-05-20 18:20:38 +03:00
vdimir
09d63545b0
Return float in segmentLengthSum for float args, add tests 2021-05-20 17:43:24 +03:00
Maksim Kita
cf5f36b70e LLVM JIT support AARCH64 2021-05-20 14:09:32 +00:00
vdimir
c8cbde1b89
Merge branch 'master' into count-range 2021-05-20 16:51:51 +03:00
kssenii
06ff4ab9da Fix build 2021-05-20 13:43:08 +00:00
kssenii
2f6770c9a0 Unite writeBuffers 2021-05-20 10:46:26 +00:00
Maksim Kita
bbd53196e7 PODArray insert in the middle tests 2021-05-20 13:24:50 +03:00
kssenii
550a4e33f9 Unite readBuffers 2021-05-20 09:57:59 +00:00
Maksim Kita
efe70aaa07
Merge pull request #24271 from fuzhe1989/fix/podarray_memmove
Use memmove in PODArray::insert to handle memory overlapping.
2021-05-20 12:50:27 +03:00
Maksim Kita
25fe0e88f8 Compile expressions added partition by test 2021-05-20 11:16:15 +03:00
Maksim Kita
af78649e56
Merge pull request #24023 from kitaisreal/compile-expressions-comparison-function-constant-case-with-alias-fix
CompileExpressions comparison function constant case fix
2021-05-20 10:58:38 +03:00
Maksim Kita
b0476c1fa2
Merge pull request #24273 from kitaisreal/expression-actions-compile-only-necessary-places
ExpressionActions compile only necessary places
2021-05-20 10:53:30 +03:00
Nikolai Kochetov
818d081292
Merge pull request #24296 from amosbird/projection-fix5
Skip data finalization when doing projection materialization.
2021-05-20 10:50:42 +03:00
Nikolai Kochetov
d09f3bcd0d
Merge pull request #24252 from ClickHouse/try-fix-group-by-shard-num-in-another-way
Try to fix GROUP BY _shard_num in a different way
2021-05-20 10:49:45 +03:00
alesapin
cf94bc9b8c
Merge pull request #24059 from ClickHouse/standalone_keeper
Standalone keeper server
2021-05-20 10:10:51 +03:00
alesapin
b9c3601083
Merge pull request #24275 from ucasFL/fix-mutation
Fix mutation fail of StorageMemory
2021-05-20 10:09:48 +03:00
Amos Bird
81dd60fdc2
Fix drop partition in rare case 2021-05-20 14:55:28 +08:00
Alexey Milovidov
2b6ffc557a Remove useless file 2021-05-20 09:31:17 +03:00
Alexey Milovidov
1006a970f7 Remove AutoArray 2021-05-20 09:30:13 +03:00
mergify[bot]
29b3ed4551
Merge branch 'master' into modulo-partition-key 2021-05-20 05:45:11 +00:00
Azat Khuzhin
4d737a5481 Respect insert_allow_materialized_columns for INSERT into Distributed() 2021-05-20 07:40:46 +03:00
Azat Khuzhin
c3e65c0d27 Async INSERT into Distributed() does support settings
Since #4852
2021-05-20 07:40:46 +03:00
Alexey Milovidov
e686349fcc Fix wrong logic in hints about Enum names 2021-05-20 01:47:10 +03:00
Alexey Milovidov
93585a0dd1 Fix bad test for Enum hints 2021-05-20 01:26:44 +03:00
Alexey Milovidov
335dafe887 Revert "Minor change"
This reverts commit db9f68fced.
2021-05-20 01:16:43 +03:00
Alexey Milovidov
db9f68fced Minor change 2021-05-20 01:16:11 +03:00
mergify[bot]
e762039db7
Merge branch 'master' into merging-s3-backoff 2021-05-19 21:57:10 +00:00
Nikita Mikhaylov
f33b70c54a better 2021-05-20 00:42:25 +03:00
Azat Khuzhin
92632bf0c1 Fix isLocalAddress() (ifa_addr maybe NULL)
From getifaddrs(3):

    The ifa_addr field points to a structure containing the interface
    address.  (The sa_family subfield should be consulted to
    determine the format of the address structure.)  This field may
    contain a null pointer.

I have the problem with tun0, that creates points-to-point address, so
getifaddrs() returns NULL ifa_addr for one of addrs for tun0.
You can check this, using this simple example - [1].

  [1]: https://gist.github.com/azat/cc667d145bc74215c40cdbb69f38189b
2021-05-20 00:04:11 +03:00
kssenii
9a5a6f39b7 Simplify writeFile 2021-05-19 20:31:43 +00:00
kssenii
56b388addf Add check for nullptr 2021-05-19 19:32:04 +00:00
alexey-milovidov
57348632dc
Merge pull request #24196 from Algunenano/gcc11_compat
Gcc11 compatibility
2021-05-19 22:20:22 +03:00
Alexander Tokmakov
2996e7c072 fix rename matview 2021-05-19 21:53:31 +03:00
Maksim Kita
9982f05e4d
Merge pull request #24284 from kitaisreal/fix-arcadia-after-function-refactoring
Fixed Arcadia after IFunctionOverloadResolver interface refactoring
2021-05-19 21:13:01 +03:00
Maksim Kita
8e68d007f3 Fixed tests 2021-05-19 20:57:07 +03:00
kssenii
477214a57f Fix partitionPrunner with modulo 2021-05-19 17:36:32 +00:00
Amos Bird
c68ef31065
Skip data finalization when doing projection materialization. 2021-05-20 00:28:50 +08:00
Nikolai Kochetov
e8f8b2ba18
Merge pull request #24162 from amosbird/projection-fix2
Fix add projection to replicated mergetree
2021-05-19 18:07:52 +03:00
Maksim Kita
f3164a6bc0 IFunction updated Exception throw 2021-05-19 17:58:23 +03:00
feng lv
9de7399737 update
fix test
2021-05-19 14:51:54 +00:00
Maksim Kita
c50909468f Updated ExpressionActionSettings 2021-05-19 17:32:07 +03:00
Maksim Kita
218f534a6f
Merge pull request #24100 from Enmk/fix_DateTime64_vs_DateTime_in_WHERE
Fix DateTime64 column vs DateTime value in where
2021-05-19 17:27:28 +03:00
alesapin
301dc848f5 Merge branch 'master' into nvartolomei-parts-move 2021-05-19 17:17:01 +03:00
feng lv
d92b1f0e9a Fix mutation of StorageMemory
fix

fix
2021-05-19 14:15:50 +00:00
Ivan Lezhankin
33f816d28d Allow empty HTTP headers 2021-05-19 16:20:23 +03:00
Alexander Kuzmenkov
e9b69bbd70
Merge pull request #23906 from azat/fix-distributed_group_by_no_merge
distributed_group_by_no_merge fixes
2021-05-19 16:16:08 +03:00
Alexander Kuzmenkov
09cb467812
Update StorageDistributed.cpp 2021-05-19 16:14:33 +03:00
Maksim Kita
9699299083 Fix build 2021-05-19 16:11:38 +03:00
Maksim Kita
5a359a15bc Fixed Arcadia after IFunctionOverloadResolver interface refactoring 2021-05-19 15:57:37 +03:00
Nikolai Kochetov
9f28d0966a Fix typos. 2021-05-19 15:43:10 +03:00
kssenii
5196075fd9 Better 2021-05-19 12:34:01 +00:00
vdimir
4fcc901be9
Merge branch 'master' into issue-23351 2021-05-19 15:33:47 +03:00
Nikolai Kochetov
c07043fd97 Try fix more cases. 2021-05-19 15:16:18 +03:00
kssenii
ba41d01b78 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into hdfs-idisk 2021-05-19 11:47:05 +00:00
Nikita Mikhaylov
aa58fc096c done 2021-05-19 14:44:39 +03:00
Yatsishin Ilya
8932f794aa Merge remote-tracking branch 'origin' into integration-2 2021-05-19 14:15:52 +03:00
Nikolai Kochetov
9d152a3c4d
Update src/Interpreters/ClusterProxy/SelectStreamFactory.cpp
Co-authored-by: Azat Khuzhin <a3at.mail@gmail.com>
2021-05-19 13:40:46 +03:00
Nikolai Kochetov
0b8bf34aba
Merge pull request #24256 from ClickHouse/log-exception-for-allocator-free
Log exception in Allocator::free
2021-05-19 13:39:39 +03:00
Yatsishin Ilya
1f4e28accb Merge remote-tracking branch 'origin' into integration-2 2021-05-19 13:25:30 +03:00
feng lv
5e4cde8540 fix 2021-05-19 10:24:53 +00:00
mergify[bot]
230bec70fb
Merge branch 'master' into modulo-partition-key 2021-05-19 10:08:41 +00:00
alesapin
4d6c71801c
Merge branch 'master' into nv/parts-uuid-move-shard 2021-05-19 13:03:14 +03:00
Maksim Kita
3d94798d9d Remove comment 2021-05-19 11:45:31 +03:00
Maksim Kita
150a88d647 ExpressionActions compile only necessary places 2021-05-19 11:43:16 +03:00
fuzhe1989
f00158c10b Use memmove in PODArray::insert to handle memory overlapping. 2021-05-19 16:06:54 +08:00
alesapin
90f12a3002
Merge pull request #24203 from ClickHouse/simplier_is_local_address
Simplier isLocalAddress
2021-05-19 10:53:35 +03:00
Vitaly Baranov
ce1c947f25
Merge pull request #22228 from traceon/ldap-user-dn-detection
LDAP: user DN detection functionality for role mapping with Active Directory
2021-05-19 10:34:47 +03:00
Yatsishin Ilya
76e481189b Merge remote-tracking branch 'origin/master' into integration-2 2021-05-19 08:55:12 +03:00
tavplubix
8b13e73ac2
Merge pull request #24208 from ClickHouse/fix_intersecting_parts_again
Addition to #23997
2021-05-18 21:13:25 +03:00
Vitaliy Zakaznikov
03ebd18d01 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into ldap-user-dn-detection 2021-05-18 14:08:28 -04:00
Nikolai Kochetov
85c0844439
Update SelectStreamFactory.cpp
Fix typo
2021-05-18 19:19:16 +03:00
Nikolai Kochetov
342486e321 Log exception in Allocator::free 2021-05-18 19:15:48 +03:00
mergify[bot]
8ba2480724
Merge branch 'master' into modulo-partition-key 2021-05-18 15:32:51 +00:00
Anton Popov
662888aee0
Merge pull request #24183 from hexiaoting/dev_nested_bugfix
Fix bug for update nested columns with const condition
2021-05-18 18:26:02 +03:00
Nikolai Kochetov
57f5e33464 Try to fix GROUP BY _shard_num 2021-05-18 18:17:19 +03:00
Kseniia Sumarokova
0ab15d0bc4
Merge branch 'master' into modulo-partition-key 2021-05-18 17:45:32 +03:00
Anton Ivashkin
d256cf4edf Fix PVS check (Two or more case-branches perform the same actions) 2021-05-18 17:41:09 +03:00
alesapin
31181095e7 Review fixes 2021-05-18 17:08:56 +03:00
alesapin
b390ebb083 Merge branch 'master' into standalone_keeper 2021-05-18 16:27:28 +03:00
alesapin
c1c6a0d8e3
Merge pull request #24248 from ucasFL/remove
remove useless code
2021-05-18 16:09:00 +03:00
feng lv
6c064d62e9 add rangeSum udaf
fix
2021-05-18 12:48:08 +00:00
feng lv
403d0a305b remove useless code 2021-05-18 12:19:04 +00:00
tavplubix
3a98e7f427
Merge pull request #24124 from abel-cheng/feature/thread_name_in_stack_trace
Add thread_name in system.stack_trace
2021-05-18 14:48:49 +03:00
kssenii
5f083b779d A little better, fix checks 2021-05-18 14:25:19 +03:00
Alexander Tokmakov
2dac182df3 fix 2021-05-18 13:00:34 +03:00
Yatsishin Ilya
c596ffdd8e Merge remote-tracking branch 'origin' into integration-2 2021-05-18 12:35:50 +03:00
alesapin
2b62ce9044 Add smoke test for local address 2021-05-18 11:35:51 +03:00
alesapin
36aeb59705 Fix lazy test 2021-05-18 11:03:38 +03:00
Kruglov Pavel
cee8e280c7
Merge pull request #24193 from plugine/fix-mutation-for-storagememory
Fix wrong typo at StorageMemory
2021-05-18 10:57:52 +03:00
alesapin
22cc1c953f Revert "PVS Studio fixes"
This reverts commit 87c6e39a29.
2021-05-18 10:34:16 +03:00
alesapin
64baa524b8
Merge pull request #24191 from kssenii/hdfs-fixes
Fix abnormal termination when hdfs is unreachable
2021-05-18 10:12:05 +03:00
Maksim Kita
40d8d95fd2
Merge pull request #24067 from azat/buffer-destroy-first
Flush Buffer tables before shutting down tables (within one database)
2021-05-18 09:07:28 +03:00
Maksim Kita
49d82ee408
Merge pull request #24177 from ucasFL/fix-reinterpret
fix reinterpretAsFixedString for UUID
2021-05-18 08:58:08 +03:00
Maksim Kita
4a84c2f3ea
Merge pull request #24210 from kitaisreal/small-style-code-simplification
Small code simplification
2021-05-18 08:13:54 +03:00
Yatsishin Ilya
e5b78727be Merge remote-tracking branch 'origin/simplier_is_local_address' into integration-2 2021-05-18 07:46:18 +03:00
Yatsishin Ilya
83718a003d Merge remote-tracking branch 'origin/master' into integration-2 2021-05-18 07:46:07 +03:00
hexiaoting
4eeaa02975 fix 2021-05-18 10:00:09 +08:00
feng lv
dcf5d345e8 fix reinterpretAsFixedString for UUID
fix
2021-05-18 01:50:27 +00:00
Alexander Tokmakov
20b9af7b26 do not allow concurrent alter partition 2021-05-18 00:20:58 +03:00
Maksim Kita
8e13182bc4
Merge pull request #24182 from kitaisreal/lru-benchmarks
Updated LRUHashMap benchmarks
2021-05-17 23:58:16 +03:00
Maksim Kita
f5b9007d63 Small code simplification 2021-05-17 23:26:25 +03:00
alesapin
87c6e39a29 PVS Studio fixes 2021-05-17 23:23:32 +03:00
Maksim Kita
5e7ca811fb
Merge pull request #24176 from vitlibar/fix-race-condition-in-context-access
Fix race condition in ContextAccess
2021-05-17 23:01:01 +03:00
Maksim Kita
a208e3cdb5 Removed commented code 2021-05-17 22:13:50 +03:00
Maksim Kita
0870970e30
Merge pull request #24178 from kitaisreal/function-move-file
Function move file
2021-05-17 22:02:43 +03:00
Raúl Marín
c312121ced gtest_sensitive_data_masker: Adapt error output after re2 update 2021-05-17 19:38:23 +02:00
alesapin
6127ba901e Small improvements 2021-05-17 19:29:11 +03:00
alesapin
acaf260a2e Better 2021-05-17 19:18:38 +03:00
alesapin
b4f07a017c Space 2021-05-17 18:32:34 +03:00
alesapin
5a0d0a1717 Much simplier isLocalAddress 2021-05-17 18:31:44 +03:00
kssenii
85cc7a8923 Remove last presence of Poco::Path in src 2021-05-17 17:44:10 +03:00
kssenii
9b8df78fdd Merge branch 'master' of github.com:ClickHouse/ClickHouse into poco-file-to-std-fs 2021-05-17 17:42:05 +03:00
kssenii
71fcbefdc7 Add final to class 2021-05-17 14:38:48 +00:00
kssenii
8c955680ad Add comments and remove adjusted deserializarion 2021-05-17 14:33:04 +00:00
Nikolai Kochetov
2e3e56f353 Update IFunction.cpp 2021-05-17 17:27:06 +03:00
Anton Popov
e27acc26be better dropPart and dropPartition 2021-05-17 17:26:36 +03:00
Anton Popov
e043cc45bf Merge remote-tracking branch 'upstream/master' into HEAD 2021-05-17 16:11:12 +03:00
Anton Ivashkin
8ed4a5de62 Fix Zero Copy after merge master 2021-05-17 16:01:08 +03:00
kssenii
26fa920ad5 Fix clang tidy, slightly improve writeSuffix 2021-05-17 12:32:48 +00:00
Raúl Marín
439f161764 Fix GCC 11 build
../src/IO/HashingWriteBuffer.h:20:34: error: expected ‘)’ before ‘block_size_’
   20 |     IHashingBuffer<Buffer>(size_t block_size_ = DBMS_DEFAULT_HASHING_BLOCK_SIZE)
2021-05-17 14:04:08 +02:00
alesapin
5563a0d7f3 Fix style 2021-05-17 14:44:47 +03:00
alesapin
023b592f97 Fix style 2021-05-17 14:42:14 +03:00
alesapin
d8994350c1 Useful comments 2021-05-17 14:39:37 +03:00
Ilya Yatsishin
8ede5c736a
Merge pull request #23992 from MaxWk/enable-datatime64-version-column
enable DateTime64 to be version column
2021-05-17 14:34:15 +03:00
alesapin
77b1aeaac2 Use same zookeeper object to have an exception if something went wrong 2021-05-17 14:30:23 +03:00
vdimir
392148ba86
Handle incorrect type of column in JoinCommon::removeColumnNullability 2021-05-17 14:24:34 +03:00
vdimir
80466427ad
Correct cardinality in MergeJoin (same as in input) 2021-05-17 14:18:03 +03:00
alesapin
67d34c0136 merge with master 2021-05-17 14:13:18 +03:00
alesapin
17f229857c Merge branch 'master' into nvartolomei-parts-move 2021-05-17 13:52:48 +03:00
张中南
3d1992ea50 fix wrong typo at StorageMemory 2021-05-17 18:24:01 +08:00
kssenii
a8748a55df Fix abnormal termination when hdfs goes away 2021-05-17 09:55:23 +00:00
tavplubix
42d5400e36
Update StorageSystemStackTrace.cpp 2021-05-17 12:07:50 +03:00
Kruglov Pavel
64e7994987
Merge pull request #23887 from kssenii/rabbitmq-fixes
RabbitMQ: allow user to define specific queue settings, its own exchange, user-managed queues; add cleanup on drop table
2021-05-17 12:01:12 +03:00
Anton Ivashkin
39a30b77fe Merge master 2021-05-17 11:47:48 +03:00
hexiaoting
c5c7b2db97 Fix bug for update nested columns with const condition 2021-05-17 16:34:50 +08:00
Maksim Kita
0adc5883c0 Fixed style check 2021-05-17 11:13:15 +03:00
Maksim Kita
cf43a3efe2 Updated LRUHashMap benchmarks 2021-05-17 11:08:22 +03:00
alesapin
eae2df6478
Merge pull request #23997 from ClickHouse/fix_intersecting_parts
Try fix intersecting parts
2021-05-17 10:46:58 +03:00
Vladimir Chebotarev
fa7308d2cb Minor fix. 2021-05-17 10:38:34 +03:00
Vladimir Chebotarev
90efb9d0db Minor fix. 2021-05-17 10:38:34 +03:00
Vladimir Chebotarev
bdf03387ab Better S3 read retries. Renamed s3_max_single_read_retries -> s3_single_read_retry_attempts, added sleeps before next attempts. 2021-05-17 10:38:32 +03:00
Maksim Kita
84fc1e0c3d Fixed style check 2021-05-17 10:32:29 +03:00
Maksim Kita
d923d9e6ef Function move file 2021-05-17 10:30:42 +03:00
alesapin
62004cf0d9 Merge branch 'master' into standalone_keeper 2021-05-17 10:14:58 +03:00
Vitaly Baranov
1dc415596c Fix race condition in ContextAccess. 2021-05-17 10:03:26 +03:00
Yatsishin Ilya
e1176acc04 Merge remote-tracking branch 'origin' into integration-2 2021-05-17 09:53:00 +03:00
kssenii
649dd23b8b Poco::resolve 2021-05-17 09:48:02 +03:00
Nikolai Kochetov
98e6c27a95
Merge pull request #24168 from amosbird/projection-fix3
Fix distributed processing when using projection
2021-05-17 09:45:39 +03:00
vdimir
d266050b23
Merge branch 'master' into issue-23351 2021-05-17 09:42:59 +03:00
Maksim Kita
20cced0a4c
Merge pull request #24155 from kitaisreal/function-refactoring
IFunction refactoring
2021-05-17 09:26:57 +03:00
abel-wang
4edd5fbb35 Add thread_name in system.stack_trace 2021-05-17 12:44:57 +08:00
kssenii
e9c3bc1836 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into progress-bar 2021-05-16 20:48:35 +00:00
kssenii
3b1bf2bae6 Poco::Path substitution 2021-05-16 23:38:23 +03:00
kssenii
e524d11222 Remove setting 2021-05-16 20:16:10 +00:00
kssenii
57da32472b Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into rabbitmq-fixes 2021-05-16 18:39:51 +00:00
kssenii
807684812e Fix clang tidy 2021-05-16 18:18:11 +00:00
kssenii
d44f1680da Use unsigned type for (de)serialization 2021-05-16 18:09:55 +00:00
Maksim Kita
843aa1ae28
Merge pull request #24169 from ucasFL/style
fix tiny code style
2021-05-16 18:20:34 +03:00
Maksim Kita
fa24fe82e1 Fixed FunctionConversion tests 2021-05-16 18:17:05 +03:00
Amos Bird
07b1be5a76
Fix distributed processing when using projection 2021-05-16 22:40:06 +08:00
feng lv
fb3a627bd3 fix tiny code style 2021-05-16 14:14:59 +00:00
alesapin
29726b5510
Merge pull request #24122 from ClickHouse/fix_table_startup
Set readonly mode if restarting thread failed to activate replica
2021-05-16 16:45:51 +03:00
Azat Khuzhin
5a8d61954a Call IStorage::flush() for each table on DETACH DATABASE before shutdown 2021-05-16 13:28:35 +03:00
Azat Khuzhin
23981ffd0e Introduce IStorage::flushAndShutdown() 2021-05-16 13:23:53 +03:00
Azat Khuzhin
f20799f683 Destroy Buffer() tables before others (within one database)
This will reduce amount of data that may be lost at shutdown.

v2: replace dynamic_cast with IStorage::isBuffer (@kitaisreal)
v3: replace IStorage::isBuffer with IStorage::flush (@alexey-milovidov)
v4: flush() for StorageProxy/StorageTableFunction
2021-05-16 13:23:53 +03:00
kssenii
22b6d0eb25 Adjust modulo recursively 2021-05-16 09:20:59 +00:00
Amos Bird
e5cd597111
Fix add projection to replicated mergetree 2021-05-16 16:49:38 +08:00
Nikolai Kochetov
093b7e120a
Merge pull request #24062 from amosbird/projection-fix1
Fix empty key projection query analysis
2021-05-16 07:37:03 +03:00
kssenii
add5970b5f fs::absolute 2021-05-16 03:12:13 +03:00
kssenii
c7f51fe60e Modulo adjustment for partition key 2021-05-15 19:51:02 +00:00
Maksim Kita
196ca14c3a
Merge pull request #24150 from azat/whitespaces
Fix a few trailing whitespaces in output
2021-05-15 22:39:16 +03:00
kssenii
d303975a1c ModuloLegacy function 2021-05-15 18:45:19 +00:00
Maksim Kita
947f28d430 IFunction refactoring 2021-05-15 20:33:15 +03:00
Kseniia Sumarokova
99e2f83c69
Merge pull request #23548 from ucasFL/table-comment
Implement table comments
2021-05-15 19:56:16 +03:00
alesapin
bae419be36 Fix typo 2021-05-15 18:29:07 +03:00
Maksim Kita
3dd7401985
Merge pull request #23412 from godliness/fix-kafka-with-parquet
Fix kafka storage does not work with parquet format messages
2021-05-15 18:15:58 +03:00
RedClusive
5e725510e7 Merge branch 'master' of github.com:ClickHouse/ClickHouse into feature-quantileBfloat16 2021-05-15 15:03:47 +00:00
alesapin
852608c937 Don't abort on Auth request 2021-05-15 18:01:00 +03:00
alesapin
83627de2b8 Merge branch 'master' into standalone_keeper 2021-05-15 17:15:06 +03:00
vdimir
8dddcebe8c
Handle correct nullability with low card in HashJoin 2021-05-15 17:09:51 +03:00
alexey-milovidov
a9a66f6572
Merge pull request #24139 from Algunenano/aiotest_fix_tmpfs
TestReadAfterAIO: Use the current path instead of /tmp for temporal files
2021-05-15 17:04:41 +03:00
Azat Khuzhin
1cdeafe473 Remove superfluous trailing whitespace in Markdown format 2021-05-15 16:08:17 +03:00
Azat Khuzhin
a44ddd2064 Update distributed_group_by_no_merge description 2021-05-15 15:03:13 +03:00
vdimir
9091bba3d6
Restore correct cardinality in HashJoin 2021-05-15 14:39:13 +03:00
vdimir
be966f0e8c
Revert "Try to not remove lowcard in merge join"
This reverts commit 35bbbd05b6.
2021-05-15 14:26:59 +03:00
Kseniia Sumarokova
6bcc99e5e6
Whitespace 2021-05-15 10:56:46 +03:00
Kseniia Sumarokova
9e65f376cc
Fix PVS check 2021-05-15 10:05:31 +03:00
kssenii
018d52d71f Directory path 2021-05-15 09:20:26 +03:00
Kseniia Sumarokova
1d73cd6406
Fix PVS check 2021-05-15 09:05:27 +03:00
Raúl Marín
e358a0963c Clearer code based on review 2021-05-15 03:03:38 +02:00
Raúl Marín
0ddfc3df84 TestReadAfterAIO: Use the local path instead of /tmp for temporal files
/tmp might be mounted as tmpfs (default in ArchLinux) which is incompatible with
O_DIRECT (https://lore.kernel.org/lkml/459D290B.1040703@tmr.com/t/), making the
test fail:

```
[ RUN      ] ReadBufferAIOTest.TestReadAfterAIO
unknown file: Failure
C++ exception with description "Cannot open file /tmp/filei6ZsCa/foo, errno: 22, strerror: Invalid argument" thrown in the test body.
[  FAILED  ] ReadBufferAIOTest.TestReadAfterAIO (0 ms)
```

Instead create the tmp folder in the local path and delete it at the end
2021-05-15 02:13:51 +02:00
Maksim Kita
e785029ead
Merge pull request #24116 from hexiaoting/dev_explain
Fix bug for explain pipeline
2021-05-15 01:41:27 +03:00
mergify[bot]
d31021ea4f
Merge branch 'master' into fix-kafka-with-parquet 2021-05-14 21:10:12 +00:00
Maksim Kita
0b4b5eb808 FunctionComparison remove constant result for non constant arguments optimization 2021-05-15 00:03:26 +03:00
Maksim Kita
18894005ac Update ExpressionJIT.cpp 2021-05-15 00:03:26 +03:00
Maksim Kita
f42b25e65c Update ExpressionJIT.cpp 2021-05-15 00:03:26 +03:00
Maksim Kita
26be39f419 CompileExpressions comparison function constant case fix 2021-05-15 00:03:26 +03:00
Kruglov Pavel
1a2e3e605a
Merge pull request #21770 from taylor12805/arrow_array
Arrow array
2021-05-14 23:44:48 +03:00
Alexander Tokmakov
df5f3fbc9d review suggestions 2021-05-14 19:11:40 +03:00
feng lv
8c82e3f1b9 fix style
fix
2021-05-14 15:50:05 +00:00
Amos Bird
a113acc40c
Fix empty key 2021-05-14 22:54:14 +08:00
Amos Bird
8de016d33a
Fix empty key projection query analysis 2021-05-14 22:26:26 +08:00
Yatsishin Ilya
f922ef4bbf Merge remote-tracking branch 'origin/fix_table_startup' into integration-2 2021-05-14 17:12:45 +03:00
Yatsishin Ilya
ad706b0de4 Merge remote-tracking branch 'origin' into integration-2 2021-05-14 16:48:44 +03:00
Alexander Tokmakov
41776ba5d9 fix 2021-05-14 15:55:30 +03:00
Alexander Kuzmenkov
5ed6a273d3
Merge pull request #24058 from ClickHouse/aku/uniq-two-level
lower two-level aggregation threshold for uniq test to avoid jitter
2021-05-14 15:50:48 +03:00
Alexander Kuzmenkov
6f16d92cfe
Update Settings.h 2021-05-14 15:50:30 +03:00
Ivan Lezhankin
bd16dd22b9 Merge remote-tracking branch 'upstream/master' into ast-table-identifier-2 2021-05-14 15:40:33 +03:00
vdimir
35bbbd05b6
Try to not remove lowcard in merge join 2021-05-14 15:10:56 +03:00
Nikolai Kochetov
bb11cde871
Merge pull request #24108 from ClickHouse/actions-dag-calc-header
Calculate header from ActionsDAG
2021-05-14 13:55:00 +03:00
Pavel Kruglov
484cac6193 Return include_indices, fix arrays and add more tests 2021-05-14 13:50:10 +03:00
Alexander Tokmakov
970ad94851 Merge branch 'master' into fix_intersecting_parts 2021-05-14 13:17:02 +03:00
alesapin
f8ddf511c5 Merge branch 'master' into standalone_keeper 2021-05-14 13:05:55 +03:00
Nikolai Kochetov
782f02b1dc Review fixes. 2021-05-14 13:01:27 +03:00
Nikolai Kochetov
a1e9202b93 Review fixes. 2021-05-14 12:30:32 +03:00
Maksim Kita
7eee500ef9
Merge pull request #24068 from azat/preserve-dict-for-shutdown
Preserve dictionaries until storage shutdown
2021-05-14 11:48:40 +03:00
alesapin
d4c6a5a05e Better logging 2021-05-14 11:38:53 +03:00
kssenii
4574c09048 Fix style check 2021-05-14 08:35:51 +00:00
alesapin
67e4393769 If table was not active set readonly mode 2021-05-14 11:32:41 +03:00
kssenii
db849eb3e5 Remaining poco 2021-05-14 11:02:17 +03:00
Ilya Yatsishin
e345b8b868
Merge pull request #24077 from abel-cheng/feature/splitByRegexp
add function splitByRegexp
2021-05-14 10:43:08 +03:00
Ilya Yatsishin
19fb0d2033
Merge pull request #24091 from Enmk/now64_timezone_fix
Fixed now64(): added second optional argument for timezone.
2021-05-14 10:36:40 +03:00
Maksim Kita
b0bad25dd3
Merge pull request #24111 from kitaisreal/hash-table-performance
Added hash table benchmarks
2021-05-14 10:29:12 +03:00
kssenii
55c573f920 Fix 2021-05-14 07:11:32 +00:00
hexiaoting
396f60f292 Fix bug for explain pipeline 2021-05-14 14:43:51 +08:00
kssenii
c25be65ebf Refactor progress bar, adjust progress indication for reading from file 2021-05-14 06:16:31 +00:00
kssenii
f33a517d33 Merge branch 'master' of github.com:ClickHouse/ClickHouse into poco-file-to-std-fs 2021-05-14 02:58:26 +03:00
Pavel Kruglov
46a7cc5f1d Remove include_indices 2021-05-14 00:52:29 +03:00
kssenii
b123ec1354 Poco::FileException, Poco::parentPath 2021-05-14 00:20:28 +03:00
Maksim Kita
1f9c9eda45 Added hash table benchmarks 2021-05-13 23:40:47 +03:00
Azat Khuzhin
aeb2c5d88a Preserve dictionaries until storage shutdown
v2: Context::loadEmbeddedDictionaries()
v3: Context::loadDictionaries()
2021-05-13 22:03:00 +03:00
Pavel Kruglov
bbe470a670 Remove fillArrowArray from .h file 2021-05-13 21:15:55 +03:00
Nikolai Kochetov
bc4ccdece6 Fix tests. 2021-05-13 21:07:47 +03:00
Vasily Nemkov
1330ef7567 Fixed converting const DateTime to DateTime64 in WHERE 2021-05-13 20:16:00 +03:00
Vasily Nemkov
22e304f88c
Fixed clang-tidy style check 2021-05-13 20:15:24 +03:00
Pavel Kruglov
25ceb1df65 Final fixes 2021-05-13 20:00:13 +03:00
alexey-milovidov
d340e33e2b
Merge pull request #23844 from excitoon-favorites/s3morecorrectclient
Better handling of HTTP errors in `PocoHTTPClient`
2021-05-13 19:21:09 +03:00
tavplubix
780b7cc8e1
Merge pull request #23863 from Algunenano/mutation_logs
Reduce the amount of logs that StorageMergeTree::selectPartsToMutate outputs in busy systems.
2021-05-13 19:02:23 +03:00
Alexander Tokmakov
eaffe6848b fix 2021-05-13 17:24:07 +03:00
Alexander Tokmakov
2da12f0b59 fix intersection of drop range and merge 2021-05-13 17:04:36 +03:00
Vasily Nemkov
3119660406 Fixed now64(): added second optional argument for timezone. 2021-05-13 16:51:32 +03:00
Nikolai Kochetov
d78be51fb4 Calculate header for ActionsDAG 2021-05-13 16:38:18 +03:00
alesapin
3abc891107
Merge pull request #24037 from amosbird/dh
Run check_*_compiler_flag earlier
2021-05-13 15:32:23 +03:00
mergify[bot]
1b181606e8
Merge branch 'master' into arrow_array 2021-05-13 12:23:48 +00:00
Pavel Kruglov
ff6e4bf91a Remove debug output 2021-05-13 15:21:39 +03:00
Alexander Tokmakov
e114c7eb8b fix virtual parts in REPLACE_RANGE 2021-05-13 14:29:59 +03:00
Vladimir
454b77c654
Update SplitByRegexpImpl 2021-05-13 13:27:29 +03:00
kssenii
e82d717233 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into progress-bar 2021-05-13 10:20:02 +00:00
Kseniia Sumarokova
135bed27f5
Merge pull request #23196 from Amesaru/progress_bar_for_LocalServer
Progress bar for local server
2021-05-13 13:13:53 +03:00
kssenii
7115045317 Tiny changes 2021-05-13 09:39:57 +00:00
Pavel Kruglov
ec214bb04c Try fix tests again 2021-05-13 12:23:59 +03:00
Maksim Kita
f3ee14d24a
Merge pull request #24066 from azat/buffer-total-lock-contention
Do not acquire lock for total_bytes/total_rows for Buffer engine
2021-05-13 11:15:06 +03:00
alesapin
bfa23d7e02 Merge branch 'master' into standalone_keeper 2021-05-13 11:03:07 +03:00
alesapin
c484cb4f37
Merge pull request #24073 from ClickHouse/fix_snapshot_race
Fix concurrent snapshot read/write
2021-05-13 10:47:41 +03:00
kssenii
0cb0bd48f7 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into rabbitmq-fixes 2021-05-13 06:36:51 +00:00
Vladimir Chebotarev
a3f7992442 Fixed typo. 2021-05-13 08:46:16 +03:00
Vladimir Chebotarev
b738e25f5b Better handling of HTTP errors in PocoHTTPClient. 2021-05-13 08:46:16 +03:00
Alexander Kuzmenkov
220f5b512e
try even smaller value 2021-05-13 06:15:44 +03:00
abel-wang
51c1d7c7ba split into characters when split by '' & add docs 2021-05-13 11:15:38 +08:00
abel-wang
99b9fe6c33 add function splitByRegexp 2021-05-13 10:37:09 +08:00
feng lv
c6f8ab9826 fix 2021-05-13 02:05:53 +00:00
kssenii
e466924898 fs::premissions 2021-05-13 02:01:35 +03:00
alexey-milovidov
020cececc4
Merge pull request #24051 from georgthegreat/thread-local-arc
Enable thread_local in Arcadia build
2021-05-13 01:34:22 +03:00
Maksim Kita
5e1e968ef8
Merge pull request #24064 from davenger/uuid_build_fix
Generate ya.make for missing UUID.cpp
2021-05-13 00:41:13 +03:00
Azat Khuzhin
074b57fe82 Do not acquire lock for total_bytes/total_rows for Buffer engine
When Buffer() is under preassure, acquiring per-layer lock may take
significant time. And so the following query may take significant amount of time:

    SELECT total_bytes, total_rows FROM system.tables WHERE engine='Buffer'
2021-05-12 23:38:00 +03:00
Azat Khuzhin
26a1277609 Fix typo for IStorage::totalRows() comment 2021-05-12 23:38:00 +03:00
alesapin
f2a8b5b2c6 Fix concurrent snapshot read/write 2021-05-12 23:28:01 +03:00
Alexander Kuzmenkov
833f48751a
Merge pull request #24048 from ClickHouse/aku/insert-select-bytes
for trivial INSERT SELECT, adjust block size in bytes as well
2021-05-12 22:33:35 +03:00
Pavel Kruglov
86f061976e Some fixes 2021-05-12 22:02:56 +03:00
Amesaru
a95028bb43 UpdateProgress fix 2021-05-12 21:25:16 +03:00
Alexander Gololobov
748d1b6e9c Generate ya.make for missing UUID.cpp 2021-05-12 20:32:29 +03:00
Amesaru
e21899c854 Merge remote-tracking branch 'origin/progress_bar_for_LocalServer' into progress_bar_for_LocalServer 2021-05-12 19:26:42 +03:00
Amesaru
40cced96f4 UpdateProgress static 2021-05-12 19:25:12 +03:00
Nikolai Kochetov
690410009c Restor is_temporary flag for fetched part. 2021-05-12 19:17:01 +03:00
Pavel Kruglov
8ed6ad7c55 Refactor, support all types in array, add nested arrays support, more tests 2021-05-12 19:06:08 +03:00
kssenii
17432b1a41 Poco::moveTo to fs version 2021-05-12 17:32:22 +03:00
alesapin
9f5f29f0aa Remove accident changes 2021-05-12 17:16:45 +03:00
alesapin
43ee9f0a3a Check for directory owner 2021-05-12 17:05:44 +03:00
kssenii
0527f0ea33 Merge branch 'master' of github.com:ClickHouse/ClickHouse into poco-file-to-std-fs 2021-05-12 16:54:18 +03:00
kssenii
047f8a4e3c Correct merge 2021-05-12 13:10:06 +00:00
alesapin
41eadf9127 Something working 2021-05-12 16:04:34 +03:00
Alexander Kuzmenkov
f6cb9f95df lower two-level aggregation threshold for uniq test to avoid jitter 2021-05-12 16:01:48 +03:00
kssenii
8eb9e72f66 Fix bug 2021-05-12 12:33:04 +00:00
Anton Popov
46ce4b7a88
Merge pull request #24016 from MaxWk/order-by-with-fill-datetime64
support for order by fill with DateTime64
2021-05-12 14:44:36 +03:00
Yuriy Chernyshov
5a2bd0b6ba Enable thread_local in Arcadia build 2021-05-12 13:33:38 +03:00
Alexander Kuzmenkov
2536247754
Update src/Interpreters/InterpreterInsertQuery.cpp 2021-05-12 12:42:21 +03:00
Alexander Kuzmenkov
70d4ee3cde for trivial INSERT SELECT, adjust block size in bytes as well 2021-05-12 12:40:39 +03:00
alesapin
ed3f89a7be
Merge pull request #23980 from kssenii/add-postgres-schema
Add missing table schema for postgres dictionary
2021-05-12 10:50:49 +03:00
alesapin
d5462df2f9
Merge pull request #24017 from ClickHouse/fix_bug_with_snapshots_read
Better error codes in Keeper when no leader alive
2021-05-12 10:15:58 +03:00
Yatsishin Ilya
4311495243 Merge remote-tracking branch 'origin' into integration-2 2021-05-12 10:04:10 +03:00
Maksim Kita
ffdc2b22a5
Merge pull request #24022 from amosbird/fixalias
Make `prefer_column_name_to_alias` setting more standard
2021-05-12 09:54:04 +03:00
Nikolai Kochetov
a1ba67e029
Merge pull request #20202 from amosbird/projection
Projections
2021-05-12 09:38:07 +03:00
kssenii
81797393f1 fs::last_write_time, fs::space 2021-05-12 09:19:11 +03:00
Amos Bird
d22ab2028f
Run check_*_compiler_flag earlier 2021-05-12 12:14:25 +08:00
万康
aa43d3cff9 fix tests and code style 2021-05-12 11:44:45 +08:00
alexey-milovidov
41012b5ba4
Merge pull request #23793 from fuwhu/feature/fix-session-expired-when-selecting-system-tables
fix session expired while executing Tables
2021-05-12 01:18:36 +03:00
alexey-milovidov
d422e0199b
Merge pull request #24019 from Avogar/rename-uniq-theta
Rename uniqThetaSketch to uniqTheta
2021-05-12 01:17:18 +03:00
Maksim Kita
2b833f4bce
Merge pull request #24021 from kitaisreal/fix-arena-with-free-lists-test
Fix ArenaWithFreeLists test
2021-05-11 22:00:45 +03:00
Amos Bird
62153e7030
Fix 2021-05-12 02:30:16 +08:00
Maksim Kita
d33f4750e1 Fix ArenaWithFreeLists test 2021-05-11 21:22:50 +03:00
Vladimir
124766f3ac
Merge pull request #24013 from vdimir/issue-24010
Finalize CompressedWriteBuffer in TemporaryFileStream
2021-05-11 21:19:12 +03:00
Maksim Kita
72d46beca0
Merge pull request #23979 from azat/dict-preallocate
Reimplement preallocate for hashed/sparse_hashed dictionaries
2021-05-11 20:15:46 +03:00
feng lv
9035e3a643 fix test and conflict 2021-05-11 16:22:24 +00:00
kssenii
3439492700 fs::last_write_time 2021-05-11 19:14:58 +03:00
Egor Savin
e51e13db61
Merge branch 'master' into progress_bar_for_LocalServer 2021-05-11 18:36:06 +03:00
Pavel Kruglov
704bbe0aeb Raname uniqThetaSketch to uniqTheta 2021-05-11 17:39:35 +03:00
Amesaru
fa8e904987 WriteProgress fix 2021-05-11 17:24:04 +03:00
kssenii
850b6f02cb Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into hdfs-idisk 2021-05-11 14:22:30 +00:00
Amesaru
6dd475cc76 Convert ProgressBar into a struct 2021-05-11 17:14:57 +03:00
Nikolai Kochetov
817bc1377c Fix part check for projections. 2021-05-11 17:07:19 +03:00
alesapin
591abbaded Better error codes in Keeper while no leader alive 2021-05-11 16:54:36 +03:00
kssenii
393b026f2e Merge branch 'master' of github.com:ClickHouse/ClickHouse into poco-file-to-std-fs 2021-05-11 16:49:23 +03:00
万康
36fc6432ce support for order by fill with DateTime64 2021-05-11 21:03:32 +08:00
alesapin
46e136b5c4
Merge branch 'master' into nv/parts-uuid-move-shard 2021-05-11 15:36:40 +03:00
Fuwang Hu
a312dd414c
Merge branch 'master' into feature/fix-session-expired-when-selecting-system-tables 2021-05-11 20:04:36 +08:00
Nikolai Kochetov
a7d717d767 Remove unused code. 2021-05-11 14:59:56 +03:00
fuwhu
bf0b0e2edc disable select_sequential_consistency when getting total rows and bytes in TablesBlockSource::generate 2021-05-11 19:49:48 +08:00
Nikolai Kochetov
89f16014b8 fix fetch for projection. 2021-05-11 14:44:59 +03:00
Yatsishin Ilya
9d159072ef mERGe remote-tracking branch 'origin' into integration-2 2021-05-11 13:32:44 +03:00
Amos Bird
074c2ead9c
Fix 2021-05-11 18:22:23 +08:00
Amos Bird
5e9fab6d10
Comment debug info out 2021-05-11 18:12:29 +08:00
Amos Bird
5836e2e277
Fix issues in normal projection 2021-05-11 18:12:29 +08:00
Amos Bird
dfa5629071
Remove projection type ast 2021-05-11 18:12:29 +08:00
Amos Bird
51d685bb9c
Even more fixes 2021-05-11 18:12:29 +08:00
Amos Bird
ddd4256a15
More fixes 2021-05-11 18:12:28 +08:00
Amos Bird
718c284437
Fix more tests 2021-05-11 18:12:28 +08:00
Amos Bird
ba17acbd63
Fix tests 2021-05-11 18:12:28 +08:00
Amos Bird
a3fd0b6f2e
Fix tests 2021-05-11 18:12:28 +08:00
Amos Bird
42f161b1dc
Fix more 2021-05-11 18:12:28 +08:00
Amos Bird
012eb56e3b
fix ya make (projection only) 2021-05-11 18:12:28 +08:00
Amos Bird
ef918aeaff
Rebase and fix 2021-05-11 18:12:28 +08:00
Amos Bird
9c069ebdbf
support prewhere, row_filter, read_in_order and decent projection selection
TODO set index analysis in projection
2021-05-11 18:12:27 +08:00
Amos Bird
f7f949c1f9
Fix aggregation keys order 2021-05-11 18:12:27 +08:00
Amos Bird
e1e560765c
Fix missing columns 2021-05-11 18:12:27 +08:00
Amos Bird
35961c0c5d
Use ActionsDAG to rewrite projection queries 2021-05-11 18:12:27 +08:00
Nikolai Kochetov
bf95b684a7
Remove copy constructor from ProjectionDescription 2021-05-11 18:12:27 +08:00
Nikolai Kochetov
29d7038e30
Add ProjectionDescription::Type enum. Remove some checks. 2021-05-11 18:12:27 +08:00
Amos Bird
ebaf42a448
Reformat and fix some tests 2021-05-11 18:12:27 +08:00
Nikolai Kochetov
c2396c5144
Disable read-in-order optimization in case of projections. 2021-05-11 18:12:26 +08:00
Nikolai Kochetov
672cfedd13
Disable normal projection by the number of granules. 2021-05-11 18:12:26 +08:00
Nikolai Kochetov
95431168c2
Try to enable normal projections. 2021-05-11 18:12:26 +08:00
Amos Bird
483bd165e7
Check if pipeline is simple and add more comments 2021-05-11 18:12:26 +08:00
Nikolai Kochetov
427f444ba4
Fix prewhere. 2021-05-11 18:12:26 +08:00
Nikolai Kochetov
3d36fb57eb
Cleanup code. 2021-05-11 18:12:26 +08:00
Nikolai Kochetov
3296c9292f
Try to merge projectons faster. 2021-05-11 18:12:26 +08:00
Amos Bird
cd6414639e
add metadata_snapshot to getQueryProcessingStage 2021-05-11 18:12:26 +08:00
Amos Bird
264cff6415
Projections
TODO (suggested by Nikolai)

1. Build query plan fro current query (inside storage::read) up to WithMergableState
2. Check, that plan is simple enough: Aggregating - Expression - Filter - ReadFromStorage (or simplier)
3. Check, that filter is the same as filter in projection, and also expression calculates the same aggregation keys as in projection
4. Return WithMergableState if projection applies

3 will be easier to do with ActionsDAG, cause it sees all functions, and dependencies are direct (but it is possible with ExpressionActions also)

Also need to figure out how prewhere works for projections, and
row_filter_policies.

wip
2021-05-11 18:12:23 +08:00
vdimir
adb5fe2f30
Finalize CompressedWriteBuffer in TemporaryFileStream 2021-05-11 12:23:35 +03:00
vdimir
7ccf47cdfd
Add Settings to AggregateFunctionSumCount/AggregateFunctionDeltaSumTimestamp 2021-05-11 12:22:00 +03:00
Maksim Kita
fdaffe869d
Merge pull request #24007 from ClickHouse/fix-bad-code-2
Fix bad code
2021-05-11 12:03:53 +03:00
万康
7ef770e9c6 fix style check 2021-05-11 16:55:23 +08:00
Kruglov Pavel
fb038c1985
Merge pull request #23894 from pingyu/datasketches-uniq-again
Add uniqThetaSketch again
2021-05-11 11:24:43 +03:00
Kruglov Pavel
49e7ed6e60
Merge pull request #23673 from amosbird/partitionvalue
Add _partition_value virtual column
2021-05-11 11:23:00 +03:00
vdimir
905e54a0af
Merge branch 'master' into create-aggregate-func-settings 2021-05-11 11:18:24 +03:00
alexey-milovidov
066d02dd2f
Merge pull request #23631 from ClickHouse/normalize-bigint
Make big integers production ready.
2021-05-11 11:07:52 +03:00
Alexander Kuzmenkov
6b6caba9cf
Merge pull request #23726 from ClickHouse/aku/fuzzer-typo
fix a typo in query formatting check in fuzzer
2021-05-11 05:44:49 +03:00