Commit Graph

26633 Commits

Author SHA1 Message Date
alesapin
18dcb193fd More verbose message about error in case of exception during recursive remove 2020-03-16 21:57:01 +03:00
alesapin
1c98210b71 Fix bug in integration test 2020-03-16 18:09:20 +03:00
alesapin
5b54ef5bfd Split long dictionaries test 2020-03-16 17:59:11 +03:00
alesapin
718903f140 Simplify test and fix order of messages 2020-03-16 17:05:11 +03:00
Alexey Milovidov
32b3e7946c Fix flacky test, take two 2020-03-16 15:32:07 +03:00
alesapin
4547e1a25b Simplify kill mutation test 2020-03-16 14:54:07 +03:00
Nikita Mikhaylov
b34d1dfc7d fix debug build for gcc-9 2020-03-16 12:16:14 +03:00
alesapin
930e6f24b1
Merge pull request #9652 from ClickHouse/fix_compatibility_for_mutations
Fix compatibility in replication
2020-03-16 11:19:57 +03:00
Hui Wang
c1ff111146 remove warnings under MacOS 2020-03-15 21:02:06 +01:00
alesapin
2c16732536 Revert version check 2020-03-15 22:34:36 +03:00
alesapin
b0cc690cfb Fix entries compatibility without versions update 2020-03-15 22:33:25 +03:00
Azat Khuzhin
a15b2daf6d Do not shutdown global thread pool on exception
Otherwise GlobalThreadPool can be terminated (for example due to an
exception from the ParallelInputsHandler::onFinish/onFinishThread, from
ParallelAggregatingBlockInputStream::Handler::onFinish/onFinishThread,
since writeToTemporaryFile() can definitelly throw) and the server will
not accept new connections (or/and execute queries) anymore.

Here is possible stacktrace (it is a bit inaccurate, due to
optimizations I guess, and it had been obtained with the
DB::tryLogCurrentException() in the catch block of the
ThreadPoolImpl::worker()):

    2020.02.16 22:30:40.415246 [ 45909 ] {} <Error> ThreadPool: Unhandled exception in the ThreadPool(10000,1000,10000) the loop will be shutted down: Code: 241, e.displayText() = DB::Exception: Memory limit (total) exceeded: would use 279.40 GiB (attempt to allocate chunk of 4205536 bytes), maximum: 279.40 GiB, Stack trace (when copying this message, always include the lines below):

    1.  Common/Exception.cpp:35: DB::Exception::Exception(...)
    ...
    6.  Common/Allocator.h:102: void DB::PODArrayBase<8ul, 4096ul, Allocator<false, false>, 15ul, 16ul>::reserve<>(unsigned long) (.part.0)
    7.  Interpreters/Aggregator.cpp:1040: void DB::Aggregator::writeToTemporaryFileImpl<...>(...)
    8.  Interpreters/Aggregator.cpp:719: DB::Aggregator::writeToTemporaryFile(...)
    9.  include/memory:4206: DB::Aggregator::writeToTemporaryFile(...)
    10. DataStreams/ParallelInputsProcessor.h:223: DB::ParallelInputsProcessor<DB::ParallelAggregatingBlockInputStream::Handler>::thread(...)

Refs: https://github.com/ClickHouse/ClickHouse/issues/6833#issuecomment-579221732
(Reference to particular comment, since I'm not sure about the initial issue)
2020-03-15 13:13:10 +03:00
Azat Khuzhin
6969191c9f Call onException if ParallelInputsHandler::onFinish* throws 2020-03-15 13:13:10 +03:00
alexey-milovidov
f3f1208e06
Merge pull request #9667 from ClickHouse/fix-flacky-test-uniq-combined-memory-usage
Fix flacky test 01017_uniqCombined_memory_usage
2020-03-15 05:40:23 +03:00
alexey-milovidov
a4cc526133
Merge pull request #9065 from ClickHouse/split_databases_from_context
Split databases from Context
2020-03-15 03:42:57 +03:00
Alexey Milovidov
93ea73ae0f Fix flacky test 01017_uniqCombined_memory_usage #7236 2020-03-15 03:22:06 +03:00
Alexey Milovidov
00b7e2b659 Make unit test less flacky by allowing session expiration during the test 2020-03-15 02:59:39 +03:00
Alexey Milovidov
5673fcc44d Merge branch 'master' of github.com:yandex/ClickHouse 2020-03-15 02:39:53 +03:00
Alexey Milovidov
abd9802317 Slightly improve unit tests 2020-03-15 02:37:09 +03:00
alexey-milovidov
9e658d4541
Merge pull request #9602 from ClickHouse/common-prelimit-counter
Common prelimit counter
2020-03-15 02:24:07 +03:00
alexey-milovidov
fd2269c1a7
Merge pull request #9633 from Slach/docs/distributedconnectionfail
add DistributedConnectionFailAtAll, DistributedConnectionFailTry system.events description
2020-03-15 01:45:38 +03:00
alexey-milovidov
2086c96a54
Merge pull request #9634 from azat/client-no-cursor-restore-on-send_logs_level
Do not restore previous cursor if send_logs_level is used
2020-03-15 01:03:03 +03:00
alexey-milovidov
3ef1d40b97
Merge pull request #9636 from azat/fix-sum-remote
Fix various sum*() functions via remote() usage (incorrect function name)
2020-03-15 01:00:39 +03:00
alexey-milovidov
68074a1524
Merge pull request #9653 from ClickHouse/add_setting_for_path_format
Add setting for a new format of distributed parts
2020-03-15 00:40:33 +03:00
alexey-milovidov
6dbb6317b6
Merge pull request #9654 from ClickHouse/remove-nontrivial-global-variable
Remove global variable with nontrivial ctor/dtor
2020-03-14 23:14:24 +03:00
Nikolai Kochetov
95c83ec95a Fix typo. 2020-03-14 17:51:32 +03:00
Anton Popov
71e86fc471
Merge pull request #9581 from excitoon-favorites/materializeinpartition
Added MATERIALIZE TTL IN PARTITION
2020-03-14 02:15:03 +03:00
Alexey Milovidov
4d637aace5 Merge branch 'master' of github.com:yandex/ClickHouse 2020-03-13 23:07:07 +03:00
Alexey Milovidov
16be947390 Make test faster in debug + coverage mode 2020-03-13 23:06:55 +03:00
Alexander Tokmakov
99e0f7b10e fix 2020-03-13 23:00:54 +03:00
Alexander Tokmakov
729e4fc9fd fix 2020-03-13 22:46:16 +03:00
alexey-milovidov
930f2bae54
Merge pull request #9611 from ClickHouse/aku/fix-some-perf-tests
Fix some performance tests
2020-03-13 22:30:26 +03:00
Alexey Milovidov
482915fa46 Fixed profile event name and description #9632 2020-03-13 22:00:00 +03:00
alexey-milovidov
b4315e24f6
Merge pull request #9632 from Slach/docs/add_networks_errors_description
add NetworkErrors metric description in system.events
2020-03-13 21:56:15 +03:00
alexey-milovidov
253cfb096c
Merge pull request #9640 from Slach/docs/replicapartialshutdown
add description for ReplicaPartialShutdown in system.events
2020-03-13 21:53:22 +03:00
alexey-milovidov
8e0cb6b641
Update ProfileEvents.cpp 2020-03-13 21:52:54 +03:00
alesapin
f6044c9c53 Add setting for a new format of distributed parts 2020-03-13 21:49:46 +03:00
Nikolai Kochetov
75fa33fa04 Try fix tests. 2020-03-13 21:43:21 +03:00
Alexey Milovidov
3f6fdc1ddb Remove global variable with nontrivial ctor/dtor 2020-03-13 21:42:19 +03:00
Alexey Milovidov
0a1b3e57a8 Renamed a file for consistency 2020-03-13 20:47:46 +03:00
Nikolai Kochetov
62e06c7813 Try fix tests. 2020-03-13 20:41:39 +03:00
alesapin
c7c945a859 Fix style check 2020-03-13 20:38:26 +03:00
alesapin
d7a13fb1c4 Merge branch 'remove_empty_columns_when_part_written' into alter_on_top_of_mutations_merge_tree 2020-03-13 20:32:32 +03:00
alesapin
18bbe16aae Fix compatibility in replication 2020-03-13 20:23:36 +03:00
Alexander Tokmakov
339c1016c8 add test for tmp tables 2020-03-13 20:08:06 +03:00
Alexander Tokmakov
00b7190003 minor improvements 2020-03-13 18:41:36 +03:00
alesapin
c777191217 Get rid of removeEmptyColumnsFromPart method based on alterDataPart. 2020-03-13 18:09:55 +03:00
Nikolai Kochetov
68dc95486b Fix build. 2020-03-13 16:50:34 +03:00
Nikolai Kochetov
9caa6b3f1e Try fix tests. 2020-03-13 16:44:08 +03:00
Alexander Kuzmenkov
7e6585328f fixup 2020-03-13 16:30:54 +03:00
alexey-milovidov
ff91b3f317
Merge pull request #9635 from ClickHouse/thread-fuzzer-wrap-pthread
Wrap pthread functions in ThreadFuzzer
2020-03-13 14:21:04 +03:00
alesapin
814e4c0f07 Return back some log messages 2020-03-13 13:41:54 +03:00
Alexander Tokmakov
2208ff67e2 fix build 2020-03-13 13:30:55 +03:00
alesapin
71e2af386a Some trach code 2020-03-13 13:18:37 +03:00
alesapin
dbf940d64a Merge branch 'master' of github.com:ClickHouse/ClickHouse into alter_on_top_of_mutations_merge_tree 2020-03-13 12:38:13 +03:00
Artem Zuikov
2f6bdffffc
Fix RIGHT and FULL JOIN with LowCardinality (#9610)
fix RIGHT and FULL JOIN with LowCardinality
2020-03-13 11:15:43 +03:00
Slach
95ba061cea add description for ReplicaPartialShutdown in system.events
Signed-off-by: Slach <bloodjazman@gmail.com>
2020-03-13 12:43:38 +05:00
Alexander Kuzmenkov
dfafac73f1 fixup 2020-03-13 03:59:04 +03:00
Ivan
b7ef5a699c
Move FastMemcpy to contribs (#9219)
* Get rid of non-existent vectorclass
* Move FastMemcpy to contribs
* Restore comments
* Disable FastMemcpy on non-Linux
* Fix cmake file
* Don't build FastMemcpy for ARM64
* Replace FastMemcpy submodule with its contents
* Fix cmake file
* Move widechar_width to contrib/
* Move sumbur to contrib/
* Move consistent-hashing to contrib/
* Fix UBSan tests
2020-03-13 01:26:16 +03:00
Alexey Milovidov
c38f99f3ba Wrap pthread functions in ThreadFuzzer 2020-03-13 00:49:51 +03:00
Azat Khuzhin
9e999e0fb9 Fix various sum*() functions via remote() usage (incorrect function name) 2020-03-13 00:05:11 +03:00
alexey-milovidov
dc9725a757
Merge pull request #9612 from CurtizJ/fix-range-reader
Fix MergeTreeRangeReader
2020-03-12 23:31:50 +03:00
Alexander Tokmakov
158cde68b5 enable UUIDs for temporary tables 2020-03-12 23:00:37 +03:00
Alexey Milovidov
f4f4e96d15 Wrap pthread functions in ThreadFuzzer 2020-03-12 22:09:20 +03:00
Alexey Milovidov
2a70f5ccd8 Wrap pthread functions in ThreadFuzzer 2020-03-12 22:08:25 +03:00
Nikolai Kochetov
4ea2361f37 Added comment. 2020-03-12 22:04:12 +03:00
Azat Khuzhin
5134af51ce Do not restore previous cursor if send_logs_level is used
This will avoid overlapping logs with progress/output rows.
2020-03-12 21:56:34 +03:00
Alexander Kuzmenkov
9b4e45748a fixup 2020-03-12 21:26:02 +03:00
Alexander Kuzmenkov
148690ca20 fixup 2020-03-12 20:04:06 +03:00
Nikolai Kochetov
4a98887e27 Update LimitTransform. 2020-03-12 20:02:12 +03:00
Nikolai Kochetov
77bf8805ee Update LimitTransform. 2020-03-12 19:59:49 +03:00
Slach
c5b5bb3168 add DistributedConnectionFailAtAll, DistributedConnectionFailTry system.events description
Signed-off-by: Slach <bloodjazman@gmail.com>
2020-03-12 21:14:00 +05:00
Nikolai Kochetov
b1488952c2 Added test. 2020-03-12 18:58:53 +03:00
Slach
d5bf33541e add NetworkErrors system.events description
Signed-off-by: Slach <bloodjazman@gmail.com>
2020-03-12 20:53:08 +05:00
Nikolai Kochetov
4b0cac25d1 Update LimitTransform. 2020-03-12 18:52:27 +03:00
alesapin
74a908f7de Reslove conflicts 2020-03-12 18:41:34 +03:00
Nikolai Kochetov
75185e5b40 Update LimitTransform. 2020-03-12 18:37:21 +03:00
Nikolai Kochetov
67518b777f Update LimitTransform. 2020-03-12 18:33:13 +03:00
Nikolai Kochetov
c580e42825 Update LimitTransform. 2020-03-12 18:29:35 +03:00
Alexander Kuzmenkov
81ac09746a Fix jit compilation settings in performance test 2020-03-12 18:27:24 +03:00
alexey-milovidov
5090198d3a
Merge pull request #9620 from ClickHouse/fix_round_error_code
Fix round function error code
2020-03-12 18:16:39 +03:00
alesapin
eac80dc420 Fix style error 2020-03-12 17:56:01 +03:00
alesapin
7a9f7bda9e test 2020-03-12 17:50:44 +03:00
Alexey Milovidov
e301e4fd51 Fixes after merge #9617 2020-03-12 17:36:54 +03:00
alexey-milovidov
170dc2124e
Merge pull request #9617 from shinoi2/master
Fix distributed ddl alter
2020-03-12 17:34:59 +03:00
Alexey Milovidov
91856dc36c Miscellaneous 2020-03-12 17:17:31 +03:00
Alexey Milovidov
e7db91a109 Miscellaneous 2020-03-12 17:17:31 +03:00
Alexey Milovidov
8afee2c686 Attempt to improve performance of datetime interval functions 2020-03-12 17:17:31 +03:00
Alexey Milovidov
d6b3773459 Miscellaneous improvements 2020-03-12 17:17:31 +03:00
Alexey Milovidov
f297c32930 Remove garbage 2020-03-12 17:17:31 +03:00
Alexey Milovidov
ee1103be3b Updated test result 2020-03-12 17:17:31 +03:00
Alexey Milovidov
0a0ef1ecc8 Fixed test 2020-03-12 17:17:31 +03:00
Alexey Milovidov
10b67aa231 Fixed error 2020-03-12 17:17:31 +03:00
Alexey Milovidov
a1c3c050cc Preparation to fix a test 2020-03-12 17:17:31 +03:00
Alexey Milovidov
9f7c87a681 Removed test that exists only by ignorance 2020-03-12 17:17:31 +03:00
Alexey Milovidov
dbc776d422 Better error messages 2020-03-12 17:17:31 +03:00
Alexey Milovidov
66b1c1a87b Preserve timezone in arithmetic operations on DateTime 2020-03-12 17:17:31 +03:00
robot-clickhouse
6a4e022a3b Auto version update to [20.4.1.1] [54434] 2020-03-12 16:07:08 +03:00
robot-clickhouse
fea24d0f98 Auto version update to [20.3.1.2621] [54433] 2020-03-12 16:06:31 +03:00
Alexander Kuzmenkov
5e26c33d58 fixup 2020-03-12 16:06:29 +03:00
Nikolai Kochetov
560576e1c9 Update LimitTransform. 2020-03-12 15:49:42 +03:00
Alexander Tokmakov
e98d4f4e5e remove isExternalTableExist 2020-03-12 15:36:31 +03:00
Alexander Tokmakov
cf28bfe8a7 Merge branch 'master' into split_databases_from_context 2020-03-12 15:09:41 +03:00
Nikolai Kochetov
708fe27022 Fix exception message in LibraryDictionarySource. 2020-03-12 14:26:00 +03:00
Nikolai Kochetov
401372544c Lower the number of processing rows for slow query. 2020-03-12 13:46:53 +03:00
alexey-milovidov
05da1bff8b
Merge pull request #9566 from ClickHouse/clang-tidy
Added some clang-tidy checks
2020-03-12 13:33:19 +03:00
Alexander Kuzmenkov
970836082e Merge remote-tracking branch 'origin/master' into HEAD 2020-03-12 12:38:19 +03:00
Alexander Kuzmenkov
c8744ab739 fixup 2020-03-12 12:37:57 +03:00
alesapin
9f67498af7 Merge branch 'master' into alter_on_top_of_mutations_merge_tree 2020-03-12 12:33:57 +03:00
alesapin
eb656c2a65 Fix round function error code 2020-03-12 12:26:54 +03:00
Alexey Milovidov
4543bca16f Fixed error 2020-03-12 12:09:44 +03:00
hao.he
5d14c50798 use dynamic_cast check distribued 2020-03-12 17:00:09 +08:00
Alexander Kuzmenkov
03f7130e98
Merge pull request #9605 from ClickHouse/aku/faster-perf-tests
Faster performance tests
2020-03-12 11:57:52 +03:00
hao.he
b3447aaa58 Fix distributed ddl alter 2020-03-12 14:43:01 +08:00
Anton Popov
76cfa8a215 fix incorrect number of rows after filtering column with defaults 2020-03-12 05:16:05 +03:00
Anton Popov
aa95a8d951
Update 01097_one_more_range_reader_test.sql 2020-03-12 03:50:45 +03:00
Anton Popov
32f82629d8 fix prewhere in case when filter is shrinked by optimization and exists missing default in part 2020-03-12 03:39:48 +03:00
alexey-milovidov
ee1c801a27
Merge pull request #9599 from ClickHouse/trying_to_fix_kill_mutations
Trying to improve kill mutation tests
2020-03-12 03:10:45 +03:00
alexey-milovidov
0d7336c00e
Merge pull request #9603 from ClickHouse/fix_cyclic_aliases
Fix simpliest case of cyclic aliases
2020-03-12 03:03:49 +03:00
alexey-milovidov
fe10eb7546
Merge pull request #9608 from CurtizJ/fix-unstable-test
Make test more stable
2020-03-12 02:59:35 +03:00
Alexey Milovidov
1013fb9c55 Fixed minor issue in integration test 2020-03-12 02:19:00 +03:00
Alexander Kuzmenkov
f456ea3cda more stable queries 2020-03-12 00:14:25 +03:00
Alexander Kuzmenkov
299c0d4da9 Fix some performance tests 2020-03-12 00:08:08 +03:00
Alexander Kuzmenkov
41e6c64b59 fixup 2020-03-11 23:40:26 +03:00
Alexander Kuzmenkov
6313dcc19b Merge remote-tracking branch 'origin/master' into HEAD 2020-03-11 23:18:48 +03:00
Vladimir Chebotarev
850925325e Added test for MATERIALIZE TTL IN PARTITION. 2020-03-11 22:39:04 +03:00
Vladimir Chebotarev
8a8142049a Added MATERIALIZE TTL IN PARTITION. 2020-03-11 22:38:55 +03:00
Alexander Tokmakov
4972daeaed fixes 2020-03-11 22:10:55 +03:00
Alexey Milovidov
ec4794d3f6 Better wording 2020-03-11 21:51:12 +03:00
Nikolai Kochetov
aa72aa540c Added perftest. 2020-03-11 21:49:06 +03:00
Anton Popov
3729b2c77a
Update 01055_compact_parts_granularity.sh 2020-03-11 21:43:46 +03:00
Nikolai Kochetov
78d350bbaa Added comment. 2020-03-11 21:35:14 +03:00
alexey-milovidov
bbd9eb3d3e
Merge pull request #9600 from ClickHouse/update-zeros-tests
Update zeros tests
2020-03-11 21:14:08 +03:00
Alexey Milovidov
b024731b30 Fixed style 2020-03-11 21:02:00 +03:00
Alexey Milovidov
8f78741126 Fixed build 2020-03-11 20:56:57 +03:00
Anton Popov
a01f824789 make test more stable 2020-03-11 19:54:24 +03:00
alesapin
406b48a20e First stupid implementation of non-blocking alter for vanilla merge tree 2020-03-11 18:51:04 +03:00
Alexander Kuzmenkov
c30c3dbfbf Faster performance tests 2020-03-11 18:11:07 +03:00
alesapin
181f64b68c
Update 00834_kill_mutation.sh 2020-03-11 18:00:14 +03:00
alesapin
50a88885e1 Fix test for parallel drop 2020-03-11 17:38:58 +03:00
Nikolai Kochetov
5b56cb196c Fix debug tests. 2020-03-11 16:46:51 +03:00
Nikolai Kochetov
969ed1fcd8 Do not add limit to pipeline if there is prelimit. 2020-03-11 16:39:48 +03:00
alesapin
6d7eb583a5 Several cases with alters 2020-03-11 16:39:34 +03:00
alesapin
e63bb9a4a7 Fix simpliest case of cyclic aliases in QueryNormalizer 2020-03-11 16:36:33 +03:00
Nikolai Kochetov
325990caf9 Fil limit transform. 2020-03-11 16:17:50 +03:00
Nikolai Kochetov
926724ffd5 Fix limit transform. 2020-03-11 16:07:38 +03:00
Nikolai Kochetov
43ff4e669c Use common read roes counter for all pre-limit streams. 2020-03-11 15:19:30 +03:00
Alexey Milovidov
268c3600dc Fixed build 2020-03-11 15:01:58 +03:00
Nikolai Kochetov
cad043b11f Remove wrong files. 2020-03-11 14:25:53 +03:00
Nikolai Kochetov
ab2f2651f7 Update perftest after zeros. 2020-03-11 14:22:10 +03:00