Commit Graph

27148 Commits

Author SHA1 Message Date
Alexey Milovidov
fbe951e03d Removed garbage 2020-03-28 13:26:23 +03:00
hcz
b634228947 Use tuples in arrayReduceInRanges 2020-03-28 18:07:54 +08:00
hcz
421d45f04d Add performance tests for arrayReduce* functions 2020-03-28 18:02:11 +08:00
hcz
d856313b15 Fix 2020-03-28 18:02:11 +08:00
hcz
3e418f8af9 Add tests for array_reduce_in_ranges 2020-03-28 18:02:11 +08:00
hcz
40207b072d Add function arrayReduceInRanges 2020-03-28 18:02:11 +08:00
hcz
6c4147501b Register function arrayReduceInRanges 2020-03-28 18:00:29 +08:00
hcz
003671ee39 Cleanup arrayReduce.cpp 2020-03-28 17:55:34 +08:00
alesapin
219b39187d Fix build 2020-03-28 12:40:06 +03:00
Alexey Milovidov
01ed894b65 Whitespaces 2020-03-28 06:02:26 +03:00
Alexey Milovidov
4ec30b01b1 Remove some of the garbage from code 2020-03-28 05:26:48 +03:00
Alexey Milovidov
1ea236c91d Remove useless code around locks 2020-03-28 05:09:29 +03:00
Alexey Milovidov
f27a95da0d Fixed typo 2020-03-28 04:59:06 +03:00
Alexey Milovidov
097fcbcadf Removed useless method 2020-03-28 04:53:59 +03:00
alexey-milovidov
e75cf7b6af
Merge pull request #9901 from ClickHouse/fix_optimize_drop_race
Fix race condition between optimize and drop
2020-03-28 04:32:38 +03:00
alexey-milovidov
aa9ab6bae0
Merge pull request #9808 from azat/optimize_skip_unused_shards-DISTINCT
Fix DISTINCT for Distributed and optimize_skip_unused_shards
2020-03-28 04:31:50 +03:00
alexey-milovidov
676aff9ba8
Update StorageDistributed.cpp 2020-03-28 04:31:03 +03:00
alexey-milovidov
c63ff92ec2
Update IStorage.h 2020-03-28 04:30:21 +03:00
alexey-milovidov
4b2edd16ec
Merge pull request #9888 from ClickHouse/better-check-instructions
Better check for available CPU instructions.
2020-03-28 04:28:30 +03:00
alexey-milovidov
47c48111f3
Update SystemLog.cpp 2020-03-28 04:20:18 +03:00
alexey-milovidov
8d40a711f1
Merge pull request #9196 from Avogar/regexp_format
Add new input format: RegexpRowInputFormat.
2020-03-28 04:18:03 +03:00
alexey-milovidov
8b87aea35e
Update RegexpRowInputFormat.h 2020-03-28 04:17:49 +03:00
alexey-milovidov
49865294d2
Update RegexpRowInputFormat.cpp 2020-03-28 04:15:09 +03:00
alexey-milovidov
315cd96543
Merge pull request #9740 from CurtizJ/tuple-literal
Parse Tuple as literal if possible
2020-03-28 04:10:21 +03:00
alexey-milovidov
6dd4f1c9c3
Merge pull request #9904 from amosbird/it
Fix scalar optimization in ALTER mutations
2020-03-28 02:17:52 +03:00
Nikita Mikhaylov
0fc7205ea3 fix build after clang-tidy 2020-03-28 01:44:13 +03:00
Artem Zuikov
b1bd11f962
Rename column names in local distributed_product_mode (#9891) 2020-03-27 23:12:14 +03:00
Avogar
318d7f45f0 Fix errors 2020-03-27 23:10:03 +03:00
Nikita Mikhaylov
7fc9de01f2
Merge pull request #9075 from nikitamikhaylov/clickhouse-copier
clickhouse copier
2020-03-27 23:25:44 +04:00
Anton Popov
77fe0b7f06 turn on polymorphic parts for log tables 2020-03-27 18:23:11 +03:00
Amos Bird
c0e3564ff5
Fix scalar optimization in ALTER 2020-03-27 23:12:48 +08:00
alesapin
4003dcd12e Better storage def in flaky test 2020-03-27 17:51:14 +03:00
alesapin
655ce5b6a7
Merge pull request #9886 from ClickHouse/add_sort_check_to_mutations
Remove order by from mutations interpreter and add check
2020-03-27 16:23:33 +03:00
alexey-milovidov
75eab25da0
Merge pull request #9890 from ClickHouse/like-fixed-string
Implement operator LIKE for FixedString at left hand side.
2020-03-27 15:18:09 +03:00
alesapin
96203d4391 Review fixes 2020-03-27 14:22:08 +03:00
alesapin
d3e8335a8d Fix race condition between optimize and drop 2020-03-27 13:53:04 +03:00
alesapin
3e17cf3a9b
Update main.cpp 2020-03-27 11:14:20 +03:00
Vitaly Baranov
75735f1e94 Add test 2020-03-27 03:28:12 +03:00
Vitaly Baranov
34984d4a9a INSERT now clamps settings from initiator to shard's constraints. 2020-03-27 03:28:12 +03:00
alexey-milovidov
6f87f7ba68
Merge pull request #9884 from filimonov/kafka_commit_retry
Kafka retry commits on failure
2020-03-26 22:48:49 +03:00
Alexey Milovidov
03f6d5f77e Added comment 2020-03-26 22:45:04 +03:00
Alexey Milovidov
8cceb8980e Added another test 2020-03-26 22:44:33 +03:00
Alexey Milovidov
105cb5580c Added a test 2020-03-26 22:42:31 +03:00
Alexey Milovidov
d5b17893fc --amend fixed string LIKE: initial implementation 2020-03-26 22:40:19 +03:00
Anton Popov
9e5d82641f fix build 2020-03-26 22:22:34 +03:00
Alexey Milovidov
c08fce3e60 --amend fixed string LIKE: initial implementation 2020-03-26 22:12:34 +03:00
Alexey Milovidov
8c0aa1bd6a fixed string LIKE: initial implementation 2020-03-26 21:55:41 +03:00
alesapin
1ba81dd050 Fix tidy check 2020-03-26 21:35:15 +03:00
alexey-milovidov
aca6d99d42
Merge pull request #9847 from azat/distributed-const-expr-eval-fixes
Fix optimize_skip_unused_shards with virtual columns of the underlying table in WHERE
2020-03-26 21:25:34 +03:00
alexey-milovidov
b23c500433
Update StorageDistributed.cpp 2020-03-26 21:25:26 +03:00
alexey-milovidov
6c6d98f241
Merge pull request #9868 from ClickHouse/processors-better-print-pipeline-1
Better exception message for invalid pipeline
2020-03-26 21:12:13 +03:00
alexey-milovidov
c14a8d65e7
Update ReadBufferFromKafkaConsumer.cpp 2020-03-26 21:10:35 +03:00
alexey-milovidov
a67993e0f6
Update ReadBufferFromKafkaConsumer.cpp 2020-03-26 21:10:21 +03:00
Alexey Milovidov
6eb98d8c77 Proper check 2020-03-26 20:53:57 +03:00
Alexey Milovidov
e4b9fcaddc Added a test 2020-03-26 20:53:46 +03:00
alexey-milovidov
5bb4c82329
Merge pull request #9872 from ClickHouse/add-performance-test-parser
Added performance test for the case of extremely slow analysis of array of tuples
2020-03-26 20:21:04 +03:00
Alexey Milovidov
3b10543b85 Adaptation for the new perf test 2020-03-26 20:20:52 +03:00
alexey-milovidov
ce49ae51bf
Merge pull request #9857 from ClickHouse/validate-polygons
Added setting "validate_polygons"
2020-03-26 20:17:05 +03:00
Anton Popov
949c0f2d45 better tuples parsing in format 'VALUES' 2020-03-26 20:13:14 +03:00
Alexey Milovidov
68726fe2a2 Better check for available instructions 2020-03-26 19:58:50 +03:00
alesapin
f0145d3393 Remove order by from mutations interpreter and add check 2020-03-26 18:59:09 +03:00
Alexander Kuzmenkov
600192c339
Merge pull request #9880 from ClickHouse/aku/msan
Some MemorySanitizer fixes
2020-03-26 18:13:06 +03:00
Mikhail Filimonov
dabccbba60 Adding test for commit retries 2020-03-26 15:43:22 +01:00
Alexander Kuzmenkov
8f948fb4c1 fixup 2020-03-26 15:35:31 +03:00
Mikhail Filimonov
4fbe0e230e Add retry logic for Kafka commits 2020-03-26 12:52:16 +01:00
Alexey Milovidov
72327d4836 Better check for supported instructions 2020-03-26 13:33:53 +03:00
Alexey Milovidov
df3c7094d5 Fixed error 2020-03-26 13:25:36 +03:00
alexey-milovidov
f0d8c8a1f6
Merge pull request #9574 from Enmk/DateTime_various_timezone_fixes
Date time various timezone fixes
2020-03-26 13:07:13 +03:00
Alexander Kuzmenkov
1726404625 Some MemorySanitizer fixes 2020-03-26 12:59:25 +03:00
Artem Zuikov
5b6a6b9b01
Test for fixed bug (#9862) 2020-03-26 12:32:54 +03:00
Artem Zuikov
adca27cb45
Fix PREWHERE with distributed IN (#9871)
fix PREWHERE with distributed IN (local mode)
2020-03-26 12:07:10 +03:00
alesapin
893fda2dbe
Merge pull request #9860 from ClickHouse/fix_mutations_memory_consumption_one_more_time
Fix mutations memory consumption finally
2020-03-26 11:43:40 +03:00
Alexander Kuzmenkov
54e6f63226 Revert "Some fixes for interactive clickhouse-test"
This reverts commit 573983d407.
2020-03-26 11:36:15 +03:00
Alexey Milovidov
25ea98ff2e Fixed style 2020-03-26 11:15:48 +03:00
Alexey Milovidov
197a599902 Fixed build 2020-03-26 10:07:48 +03:00
Alexander Kuzmenkov
573983d407 Some fixes for interactive clickhouse-test
* Don't hang indefinitely on Ctrl+C (still broken but somewhat better)

* Move to a separate process group and kill it at exit, so that we don't
leave endless test processes.
2020-03-26 08:41:10 +03:00
Alexander Kuzmenkov
d5ada06d7f
Update msan_suppressions.txt 2020-03-26 04:40:25 +03:00
Alexey Milovidov
48dc513c5a Added performance test for the case of extremely slow analysis of array of tuples 2020-03-26 00:00:51 +03:00
Alexey Milovidov
59b4350957 Removed debug output 2020-03-25 23:41:31 +03:00
Alexey Milovidov
d549bbe0a6 Fixed bug #9403 2020-03-25 23:37:10 +03:00
Alexey Milovidov
b42748fd08 Added a test #9403 2020-03-25 23:36:45 +03:00
alesapin
7691043df9 Fix integration test 2020-03-25 23:16:56 +03:00
Alexey Milovidov
fc68ba0540 Remove useless code, part 4 2020-03-25 23:12:32 +03:00
Alexey Milovidov
2d51c8ac4e Remove useless code 2020-03-25 23:06:27 +03:00
Alexey Milovidov
2bfaee37b7 Style 2020-03-25 22:50:18 +03:00
Alexey Milovidov
33f1ee4ae6 Added comments within my understanding of the algorithm 2020-03-25 22:44:16 +03:00
Alexey Milovidov
279ff96b19 Remove strange code, part 2 2020-03-25 22:19:49 +03:00
Alexey Milovidov
61778d2c03 Remove strange code 2020-03-25 22:14:29 +03:00
Alexey Milovidov
24e825e98b Returned trivial algorithm for debugging 2020-03-25 22:10:13 +03:00
Alexey Milovidov
5d2d26604c Removed strange code, part 2 2020-03-25 21:59:11 +03:00
Alexey Milovidov
10561c641a Removed strange code 2020-03-25 21:55:34 +03:00
Alexey Milovidov
c8108dc438 Renamed file 2020-03-25 21:54:45 +03:00
Alexey Milovidov
3e8aec99f5 Renamed file 2020-03-25 21:52:52 +03:00
Alexey Milovidov
06520941ee Removed useless header 2020-03-25 21:51:48 +03:00
Alexey Milovidov
48820546a8 Split GeoHash from GeoUtils 2020-03-25 21:48:09 +03:00
Alexey Milovidov
f921d388b6 Use only 64bit float for pointInPolygon 2020-03-25 20:29:26 +03:00
Alexey Milovidov
ec915f1602 Fix clang-tidy 2020-03-25 20:00:54 +03:00
Nikolai Kochetov
6fd963c805 Update test. 2020-03-25 19:55:05 +03:00
Nikolai Kochetov
7a3daac751 Update test. 2020-03-25 19:44:50 +03:00
Nikolai Kochetov
8948a96c60 Update test. 2020-03-25 19:34:46 +03:00
Nikolai Kochetov
0b1ad7f7c8 Print pipeline on PipelineExecutor init exception. 2020-03-25 19:02:51 +03:00
Vasily Nemkov
699f4908e5 Merge remote-tracking branch 'upstream/master' into DateTime_various_timezone_fixes 2020-03-25 18:41:26 +03:00
Nikolai Kochetov
a6c85ff97d
Merge pull request #9735 from ClickHouse/weak-hash
WeakHash32
2020-03-25 18:11:15 +03:00
alesapin
7470664880 Simplify test 2020-03-25 17:35:48 +03:00
Nikolai Kochetov
778b95797f Fix style. 2020-03-25 16:51:50 +03:00
Alexey Milovidov
e125209f17 Added a test 2020-03-25 16:00:45 +03:00
alesapin
d70a448ca1 Fix flaky unit test 2020-03-25 15:49:26 +03:00
Nikolai Kochetov
68f8343af6 Fix build. 2020-03-25 15:17:11 +03:00
Nikolai Kochetov
333ac3f8db Fix build. 2020-03-25 15:15:51 +03:00
Nikolai Kochetov
4837257bca Force read in order of parts using single thread. 2020-03-25 15:10:24 +03:00
Alexander Kuzmenkov
be75df7c60
Add a note about double escaping in regexes. 2020-03-25 14:34:33 +03:00
Nikolai Kochetov
f37b30f9ec Review fixes. 2020-03-25 14:20:34 +03:00
Nikolai Kochetov
1a37afa3d1 Review fixes. 2020-03-25 14:14:11 +03:00
alesapin
83b2103fd0 Fix mutations memory consumption finally 2020-03-25 13:52:32 +03:00
alexey-milovidov
2c0105a379
Update pointInPolygon.cpp 2020-03-25 13:18:04 +03:00
Alexey Milovidov
4d1ad2b630 Added setting "validate_polygons" 2020-03-25 13:13:34 +03:00
Alexey Milovidov
fa219179f9 Fixed bad code in Settings 2020-03-25 12:36:49 +03:00
alexey-milovidov
a70a9e5383
Update WeakHash.h 2020-03-25 08:27:43 +03:00
Vitaly Baranov
db89b24948
Merge pull request #9840 from vitlibar/fix-grants-for-introspection
Fix calculating grants for introspection
2020-03-24 22:43:50 +03:00
Anton Popov
445d750938 fix build 2020-03-24 22:23:01 +03:00
Alexey Milovidov
484903a22a Whitespace 2020-03-24 22:03:40 +03:00
alexey-milovidov
7aefaf5ff1
Merge pull request #9845 from ClickHouse/fix_delta_test_unbundled
Fix delta test in unbundled mode
2020-03-24 21:58:28 +03:00
Azat Khuzhin
5039b6ab73 Fix Distributed engine with virtual columns of the underlying table in WHERE
Before storage has not been passed to the SyntaxAnalyzer and hence
it cannot check if there is such column and throw for virtual columns
like _part (MergeTree) and others.

Follow-up-for: #8846
2020-03-24 21:07:20 +03:00
Azat Khuzhin
dcf4d5198f Accept const IStorage in SyntaxAnalyzer 2020-03-24 21:06:55 +03:00
Azat Khuzhin
580a7c9f41 Use overload over default value for IStorage::getQueryProcessingStage()
Since clang-tidy complains about it [1]:

    2020-03-24 09:00:53 /build/obj-x86_64-linux-gnu/../dbms/src/Storages/StorageMerge.cpp:139:42: error: default arguments on virtual or override methods are prohibited [google-default-arguments,-warnings-as-errors]
    2020-03-24 09:00:53 QueryProcessingStage::Enum StorageMerge::getQueryProcessingStage(const Context & context, const ASTPtr & query_ptr) const

  [1]: https://clickhouse-builds.s3.yandex.net/9808/b8614de64af3e65c83ee35588082df373959a737/build_log_637307151_1585043194.txt

And indeed, this is a good idea!
2020-03-24 21:00:57 +03:00
Alexey Milovidov
0b4e601d81 Whitespace 2020-03-24 20:27:58 +03:00
Vasily Nemkov
d0e23a503e Fixed formatDateTime handling explicit timezone argument.
Updated reference of the 00921_datetime64_compatibility, issues caused
by Date implicitly using server's timezone (and I was not in GMT+3) at
the moment of updating tests.
2020-03-24 19:58:24 +03:00
alesapin
822fea0405 Fix delta test in unbundled mode 2020-03-24 19:53:12 +03:00
Anton Popov
b12bf5758e Merge remote-tracking branch 'upstream/master' into tuple-literal 2020-03-24 18:11:27 +03:00
Anton Popov
c1291e9348 tuple as literal 2020-03-24 15:55:35 +03:00
Nikolai Kochetov
778be3174a Fix pvs warnings. 2020-03-24 15:32:33 +03:00
Nikolai Kochetov
5400ffbf93 Update weak hash. 2020-03-24 14:38:41 +03:00
Nikolai Kochetov
08a9486cfc Update weak hash. 2020-03-24 14:38:05 +03:00
Nikolai Kochetov
07b29453cc Update weak hash. 2020-03-24 14:29:55 +03:00
Nikolai Kochetov
20d3e34fb0 Update weak hash. 2020-03-24 14:02:16 +03:00
Nikolai Kochetov
488b21cd82 Update weak hash. 2020-03-24 14:01:15 +03:00
Nikolai Kochetov
67ed4d4cc3 Update weak hash. 2020-03-24 13:02:09 +03:00
Azat Khuzhin
b8614de64a Fix DISTINCT for Distributed and optimize_skip_unused_shards
In case of optimize_skip_unused_shards the getQueryProcessingStage() can
return QueryProcessingStage::WithMergeableState because the whole
cluster has multiple nodes, but optimize_skip_unused_shards can trim it
to 1 and in this case we need final merge that won't be done with
QueryProcessingStage::WithMergeableState only with
QueryProcessingStage::Complete.
2020-03-24 11:07:09 +03:00
Azat Khuzhin
0e925ff7ad Cover DISTINCT for Distributed with one shard (test from #9046)
v2: cover case when getQueryProcessingStage() returns Complete when it
should not (pointed by @alexey-milovidov in
https://github.com/ClickHouse/ClickHouse/pull/9808#issuecomment-602291996)
2020-03-24 11:07:09 +03:00
Vitaly Baranov
4576cf198e Fix calculating grants for introspection functions from the setting 'allow_introspection_functions'. 2020-03-24 11:03:09 +03:00
Azat Khuzhin
4707dd827a StorageDistributed: cleanup skipping unused shards 2020-03-24 10:58:34 +03:00
Azat Khuzhin
66ccbf5d11 Pass query to the IStorage::getQueryProcessingStage()
Will be used to return correct stage with optimize_skip_unused_shards.
2020-03-24 10:58:16 +03:00
alexey-milovidov
df19d6aac1
Merge pull request #9622 from PerformanceVision/dictionary_status
Bring dictionary status on native prometheus exporter
2020-03-24 09:44:01 +03:00
alexey-milovidov
c762a42f4b
Merge pull request #9815 from ClickHouse/taiyang-li-pr_add_auc
Merging arrayAUC
2020-03-24 09:36:13 +03:00
alexey-milovidov
25cf827365
Merge pull request #9759 from Vxider/distributed_insert_select
Distributed INSERT SELECT
2020-03-24 09:34:44 +03:00
alexey-milovidov
9f72c28035
Update InterpreterInsertQuery.cpp 2020-03-24 09:34:01 +03:00
alexey-milovidov
9a2760d914
Merge pull request #9673 from azat/processors-max_distributed_connections
Fix max_distributed_connections
2020-03-24 08:32:15 +03:00
Alexey Milovidov
9a41113bf4 Renamed tests 2020-03-24 08:25:17 +03:00
Alexey Milovidov
691d98ff34 Added another test 2020-03-24 08:14:48 +03:00
Alexey Milovidov
5a89fd0abc Added performance test 2020-03-24 08:06:35 +03:00