Commit Graph

1758 Commits

Author SHA1 Message Date
bharatnc
a0a566bcf7 add tests for new time_zones table 2020-08-24 23:30:41 +03:00
alexey-milovidov
7ea5364299
Merge pull request #13648 from filimonov/tzdata_version2
tzdata improvements
2020-08-24 23:07:37 +03:00
Alexey Milovidov
846cdd70fc Merge branch 'patch-0819' of https://github.com/hczhcz/ClickHouse into hczhcz-patch-0819-2 2020-08-24 23:01:59 +03:00
Alexey Milovidov
ffd8c19385 Faster test under TSan 2020-08-24 22:59:28 +03:00
Alexey Milovidov
ec24bfe128 Added a test that proves feature exists 2020-08-24 22:54:06 +03:00
Nikita Mikhaylov
e4fc48254a
Merge pull request #13818 from bharatnc/ncb/quantileExactLowHigh
add functions for quantileExactLow & quantileExactHigh
2020-08-24 23:51:30 +04:00
alexey-milovidov
2e6ff0c5ec
Merge pull request #13925 from 4ertus2/ast
Rewrite duplicate distinct optimization
2020-08-24 22:33:22 +03:00
alexey-milovidov
6a164634d7
Merge pull request #12550 from myrrc/bug/low-cardinality-arrays-optimisations
Optimising has(), indexOf(), and countEqual() for Array(LowCardinality(T)) and constant right arguments
2020-08-24 22:31:29 +03:00
alexey-milovidov
14400b5b41
Merge pull request #13940 from hczhcz/patch-0821
Fix parser to reject create table as table function with engine
2020-08-24 22:01:40 +03:00
Alexey Milovidov
dfe870e38c Merge branch 'new-branch' of https://github.com/ucasFL/ClickHouse into ucasFL-new-branch 2020-08-24 16:26:08 +03:00
Artem Zuikov
69c77ff229 Merge branch 'master' into ast 2020-08-24 14:09:30 +03:00
Anton Popov
93d49e5815
Merge pull request #13237 from vdimir/string-locate-startpos-3776
Support start_pos argument in `position` function
2020-08-24 12:23:19 +03:00
hcz
7c02047060 Fix tests 2020-08-24 10:51:04 +08:00
alexey-milovidov
d0b6ba35d1
Merge pull request #8367 from amosbird/scalarfix
fix scalar subquery hash conflicts
2020-08-24 01:14:34 +03:00
bharatnc
70d532ace6 fix tests spacing in 0700_decimal_aggregates.reference 2020-08-23 10:09:41 -07:00
bharatnc
0814973af9 add tests for quantileExactLow & quantileExactHigh 2020-08-23 10:09:41 -07:00
hcz
559242503b Add test cases 2020-08-24 01:01:47 +08:00
zhang2014
0e8cb96eb1 Try fix IfAggCombinator with NullAggCombinator 2020-08-22 22:57:46 +08:00
alexey-milovidov
84db9a3a66
Merge pull request #13906 from tomjiang1987/optimize_error_msg_for_null
optimize error msg for null value of TabSeparatedRow format
2020-08-21 16:06:16 +03:00
alexey-milovidov
55ac192417
Merge pull request #13928 from ClickHouse/wring-error-for-too-long-query
Fix wrong error for long queries.
2020-08-21 13:18:19 +03:00
tao jiang
a269855e2f add testcase. due to the error msg have version string so just print matched part 2020-08-21 11:32:12 +08:00
Artem Zuikov
13bb3774ff update tests 2020-08-20 23:50:53 +03:00
Nikolai Kochetov
99b31480fd Fix wrong error for long queries. 2020-08-20 21:56:50 +03:00
Artem Zuikov
f4e84d93ba fix indirect distinct with less columns 2020-08-20 21:51:22 +03:00
alexey-milovidov
6cf1a61735
Merge pull request #13841 from azat/unknown-packet-fix
Unknown packet fix (for Protocol::Server::Log for distributed queries)
2020-08-20 20:25:58 +03:00
Artem Zuikov
911e6efe3e rewrite duplicate distinct optimization 2020-08-20 20:04:42 +03:00
Amos Bird
333ec2e496
fix scalar subquery hash conflicts 2020-08-20 21:19:10 +08:00
myrrc
d298409660 Merge remote-tracking branch 'upstream/master' into bug/low-cardinality-arrays-optimisations 2020-08-20 12:07:02 +03:00
hcz
cc328532af Fix timezone 2020-08-20 12:07:01 +08:00
Alexander Tokmakov
f38bf04f62 fix test 2020-08-20 00:32:39 +03:00
myrrc
4f96291c35 rewrote the LC spec as a dispatcher 2020-08-19 21:59:39 +03:00
Nikolai Kochetov
322cb241b9
Merge pull request #13887 from ClickHouse/fix-fixed-string-partial-sort
Fix fixed string partial sort
2020-08-19 21:41:25 +03:00
alexey-milovidov
b0a171211f
Merge pull request #13881 from ClickHouse/check-ya-make-files
Check that ya.make files are auto-generated
2020-08-19 21:24:20 +03:00
Alexander Tokmakov
30e0cd438e fix test 2020-08-19 18:56:26 +03:00
Nikolai Kochetov
25dd0fa4d6
Update 01453_fixsed_string_sort.sql 2020-08-19 15:43:08 +03:00
Nikolai Kochetov
ab37eee653 Added test. 2020-08-19 15:26:48 +03:00
Artem Zuikov
becc186c91
Add support for extended precision integers and decimals (#13097) 2020-08-19 14:52:17 +03:00
tavplubix
3b8ac01ed0
Merge pull request #13756 from ClickHouse/test-drop-database-race
Fix race condition in DROP DATABASE
2020-08-19 13:27:50 +03:00
Alexey Milovidov
425297e9c9 Check that ya.make files are auto-generated 2020-08-19 12:40:28 +03:00
alexey-milovidov
1c40e3ca4e
Merge pull request #13867 from azat/00956_sensitive_data_masking-fix
Fix 00956_sensitive_data_masking flackiness
2020-08-19 12:33:48 +03:00
alexey-milovidov
6d72777b6e
Merge pull request #13868 from ClickHouse/stratify-array-compact-nan
Stratify nans comparison in arrayCompact function
2020-08-19 11:53:58 +03:00
hcz
be2ffe07ee Add docs and tests 2020-08-19 16:07:51 +08:00
alexey-milovidov
23ccb0b6be
Merge pull request #13677 from hagen1778/merge-tree-fail-fast-on-rows-limit
[mergeTree]: fail fast if max_rows_to_read limit exceeded on parts scan
2020-08-18 22:24:39 +03:00
Alexey Milovidov
acf312467e Stratify nans comparison in arrayCompact function 2020-08-18 22:16:53 +03:00
Azat Khuzhin
3ba9e9f6ce Fix 00956_sensitive_data_masking flackiness
00956_sensitive_data_masking is still flacky even after #13748 [1].

    [1]: https://clickhouse-test-reports.s3.yandex.net/10373/348ef1256ea8fb8f61109c33bbdd28daf46bdc8e/functional_stateless_tests_(debug).html#fail1

The problem is that it uses the following pattern:

    clickhouse-client -q ... & # run some query in background
    clickhouse-client -q 'show processlist' > log
    grep background-query log

But there is no guarantee that the query in background will be executed before `show processlist`:

    2020.08.18 02:52:47.916386 [ 26788 ] {98c36d38-f710-4dfb-af8f-61906abc163c} <Debug> executeQuery: (from [::1]:51650) SHOW PROCESSLIST
    ...
    2020.08.18 02:52:47.926854 [ 26756 ] {086c64fa-713b-4f8c-b702-23bfea10a49c} <Debug> executeQuery: (from [::1]:51652) select count() from system.numbers where ignore('find_me_[hidden]')=0 and ignore('fwerkh_that_magic_string_make_me_unique') = 0 FORMAT Null

Fix the test by waiting until the query in backgroud will start, and use
limited numbers + sleepEachRow over system.numbers to reduce CPU usage.
2020-08-18 21:57:53 +03:00
Alexander Tokmakov
e686616756 add exclusive DDLGuard for database 2020-08-18 18:15:27 +03:00
Alexander Kazakov
874fd4d068
A test to challenge a data race in StorageMemory (#13858) 2020-08-18 17:16:59 +03:00
roman
ac72148c3e [tests]: adjust staeless/01064 test max_rows_to_read limits
With default index_granularity=8096 CH always reads at least that number
of rows per selected part, but limit is checked afterwards. The optimization
that interrupts execution of queries based on approx number of rows to read
breaks the test. This means that test case is potetntially contains incorrect
limits.
2020-08-18 13:22:54 +01:00
Azat Khuzhin
ee666448e9 Simplify 01451_dist_logs test 2020-08-17 22:49:10 +03:00
Azat Khuzhin
2e933a94a6 Handle Protocol::Server::Log in the RemoteQueryExecutor::finish()
Even when finish() is called, there can be no EndOfStream sent, so it is
100% correct to handle Log packages there.

W/o fix in RemoteQueryExecutor:

    Code: 100, e.displayText() = DB::Exception: Unknown packet 10 from one of the following replicas: : While executing Remote (version 20.8.1.1) (from [::1]:56960) (in query: select * from remote('127.{2,3}', system.numbers) where number = 10 limit 1; ), Stack trace (when copying this message, always include the lines below):

    0. Common/StackTrace.cpp:291: StackTrace::tryCapture() @ 0x28b80a
    1. Common/StackTrace.cpp:256: StackTrace::StackTrace() @ 0x28b6ab
    2. Common/Exception.cpp:42: DB::Exception::Exception(std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, int) @ 0x2481ba
    3. Common/Exception.h:28: DB::Exception::Exception<>() @ 0x334d48
    4. DataStreams/RemoteQueryExecutor.cpp:288: DB::RemoteQueryExecutor::finish() @ 0x330314
    5. Processors/Sources/RemoteSource.cpp:46: DB::RemoteSource::generate() @ 0x6fce5
2020-08-17 21:55:09 +03:00
Alexey Milovidov
ba4c42abfe Support UUID aliases in normalizeQuery 2020-08-17 21:17:20 +03:00
alexey-milovidov
abf3cb8746
Merge pull request #13816 from ClickHouse/normalize-query
Add function "normalizeQuery"
2020-08-17 16:23:24 +03:00
Vitaly Baranov
695c2aafba
Merge pull request #13425 from vitlibar/user-directories
user_directories in the main config
2020-08-17 15:49:24 +03:00
Azat Khuzhin
dfa6caa4da Fix 01356_initialize_aggregation in unbundled build (change topKWeighted order) 2020-08-17 00:36:57 +03:00
Alexey Milovidov
9cd2ddb646 Add normalizedQueryHash function with tests 2020-08-16 22:38:56 +03:00
Azat Khuzhin
0eac96972c Fix topK/topKWeighted merge (wtih non-default parameters) 2020-08-16 22:32:56 +03:00
Alexey Milovidov
6a55ec0390 Add test 2020-08-16 22:23:03 +03:00
Vitaly Baranov
ad03ff3887 Rename storages users.xml=>users_xml, disk=>local_directory. 2020-08-16 16:42:57 +03:00
Alexey Milovidov
5059d1f441 Merge branch 'master' into manual-write-duplicate-parts-to-replicas 2020-08-16 15:58:57 +03:00
Alexey Milovidov
bbb10bacf9 Suppress Shellcheck 2020-08-16 15:23:41 +03:00
alexey-milovidov
f3755fecb7
Merge pull request #13793 from amosbird/fnc
Fix set index with const column pred
2020-08-16 15:18:31 +03:00
Amos Bird
ae2c50e9e8
Fix set index with const column pred 2020-08-16 15:16:37 +08:00
alexey-milovidov
0d8fecc37d
Merge pull request #13760 from ClickHouse/fix-flaky-test-4
Make a test slightly more reliable
2020-08-16 10:13:51 +03:00
alexey-milovidov
ec882e3424
Merge pull request #13770 from ClickHouse/fix-flaky-test-5
Fix flaky mutations test
2020-08-16 10:13:31 +03:00
alexey-milovidov
3db28c0b3e
Merge pull request #13777 from ClickHouse/fix-flaky-test-6
Fix error in test 01079_parallel_alter_detach_table_zookeeper
2020-08-16 10:13:10 +03:00
alexey-milovidov
4acfa00b1b
Merge pull request #13785 from ClickHouse/fix-flaky-test-8
Fix topK test
2020-08-16 09:51:59 +03:00
feng lv
aaedf02d2b fix conflict 2020-08-16 12:38:39 +08:00
Azat Khuzhin
e9d373b5b7 Fix step overflow in range() 2020-08-16 00:26:47 +03:00
Alexey Milovidov
0217de37b9 Fix topK test 2020-08-15 20:55:49 +03:00
alexey-milovidov
521ab806aa
Merge pull request #13754 from ClickHouse/fix-flaky-test-2
Fix flaky test 00988_constraints_replication_zookeeper
2020-08-15 19:30:01 +03:00
alexey-milovidov
82a6c0a4b6
Merge pull request #13752 from ClickHouse/h3kRing-fix
Range check for h3KRing
2020-08-15 19:28:52 +03:00
Alexey Milovidov
1f1685d696 Fix error in test 2020-08-15 17:55:08 +03:00
Alexey Milovidov
eb548c08b7 Fix flaky mutations test 2020-08-15 17:35:31 +03:00
Alexey Milovidov
5b3fa69d69 Make a test slightly more reliable 2020-08-15 16:26:56 +03:00
alexey-milovidov
7ccfae5da9
Merge pull request #13748 from ClickHouse/fix-bad-test-sensitive-data-masking
Fix bad test sensitive_data_masking
2020-08-15 15:56:38 +03:00
alexey-milovidov
0e3b9d0da6
Merge pull request #13747 from ClickHouse/fix-race-condition-in-test
Fix race condition in test
2020-08-15 15:55:47 +03:00
alexey-milovidov
8c34cc3df6
Merge pull request #13746 from ClickHouse/fix-race-condition-detach-merge
Fix race condition in DETACH and background merge
2020-08-15 15:53:26 +03:00
alexey-milovidov
faa0d50d67
Merge pull request #13737 from azat/query_log-Settings-logging-fix
Fix logging Settings.Names/Values when log_queries_min_type > QUERY_START
2020-08-15 15:51:19 +03:00
Alexey Milovidov
d4af19b3e7 Update test 2020-08-15 14:22:01 +03:00
Alexey Milovidov
eee3cb6887 Add a test reproducing race condition in DROP DATABASE 2020-08-15 14:16:43 +03:00
Alexey Milovidov
aaddb6a086 Fix flaky test 2020-08-15 12:37:05 +03:00
alexey-milovidov
b0ffde5825
Merge pull request #13743 from ClickHouse/fix-stress-test
Fix server restart after stress test
2020-08-15 12:16:01 +03:00
Alexey Milovidov
1d51d9e8b6 Range check for h3KRing 2020-08-15 11:49:54 +03:00
alexey-milovidov
c5c79e9408
Merge pull request #13590 from azat/TSV-fix-CR-assertion
Fix assertion for carriage return in TSV format header
2020-08-15 11:15:23 +03:00
Alexey Milovidov
096209881b Fix bad test sensitive_data_masking 2020-08-15 09:41:28 +03:00
Alexey Milovidov
5fe807613f Fix race condition in test 2020-08-15 08:37:46 +03:00
Alexey Milovidov
ee084f0ec9 Fix race condition in DETACH and background merge 2020-08-15 08:21:02 +03:00
Alexey Milovidov
52c3857225 Fix server restart after stress test 2020-08-15 06:10:57 +03:00
alexey-milovidov
7e72437b9d
Merge pull request #13680 from ClickHouse/use_atomic_engine_for_system_db
Use Atomic engine for system database
2020-08-15 01:15:09 +03:00
alexey-milovidov
9e33f41dec
Merge pull request #13709 from ClickHouse/fix-array-combinator
Fix error with batch aggregation and -Array combinator
2020-08-15 01:10:34 +03:00
Azat Khuzhin
082dbea039 Cover Settings in query_log with non default log_queries_min_type 2020-08-15 00:43:48 +03:00
Azat Khuzhin
249ceec61b Fix 01231_log_queries_min_type test 2020-08-15 00:43:20 +03:00
Nikolai Kochetov
4af4d25db4
Merge pull request #13690 from ClickHouse/sql_fuzzy_timeout
Fix timeout in sql_fuzzy test
2020-08-14 19:21:47 +03:00
Alexander Tokmakov
128b19fdba Merge branch 'master' into use_atomic_engine_for_system_db 2020-08-14 13:47:44 +03:00
Artem Zuikov
89e9673336
Hotfix for pushdown with StorageMerge (#13679) 2020-08-14 12:38:18 +03:00
Alexey Milovidov
8c85ab3753 Fix error with batch aggregation and -Array combinator 2020-08-14 09:52:28 +03:00
Alexey Milovidov
1c939b6d89 Merge branch 'master' into sql_fuzzy_timeout 2020-08-14 08:32:25 +03:00
alexey-milovidov
e1a25053dd
Merge pull request #13681 from azat/optimize_move_functions_out_of_any-arrayJoin
Do not optimize any(arrayJoin()) -> arrayJoin() under optimize_move_functions_out_of_any
2020-08-14 04:39:06 +03:00
Alexey Milovidov
baa85f0a88 Fix timeout in sql_fuzzy test 2020-08-14 04:35:02 +03:00
Azat Khuzhin
17b27b6c28 Do not optimize any(arrayJoin()) -> arrayJoin() under optimize_move_functions_out_of_any
Otherwise the following query will be optimized incorrectly:

    SELECT
        *,
        any(arrayJoin([[], []]))
    FROM numbers(1)
    GROUP BY number

And the result will be:

    ┌─number─┬─arrayJoin(array(array(), array()))─┐
    │      0 │ []                                 │
    │      0 │ []                                 │
    └────────┴────────────────────────────────────┘

While should be:

    ┌─number─┬─any(arrayJoin(array(array(), array())))─┐
    │      0 │ []                                      │
    └────────┴─────────────────────────────────────────┘
2020-08-13 22:17:49 +03:00