Commit Graph

8690 Commits

Author SHA1 Message Date
Alexander Tokmakov
eaffe6848b fix 2021-05-13 17:24:07 +03:00
Vitaliy Zakaznikov
58685dc9fa Disabling RBAC module.
Removing debugging code.
2021-05-13 10:04:08 -04:00
Mikhail Filimonov
dd619e1e37
Try to stabilize flapping test 2021-05-13 16:03:32 +02:00
Vasily Nemkov
3119660406 Fixed now64(): added second optional argument for timezone. 2021-05-13 16:51:32 +03:00
alesapin
e7eae2688c Also retry database creation 2021-05-13 16:37:19 +03:00
mergify[bot]
1b181606e8
Merge branch 'master' into arrow_array 2021-05-13 12:23:48 +00:00
Alexander Tokmakov
e114c7eb8b fix virtual parts in REPLACE_RANGE 2021-05-13 14:29:59 +03:00
Vladimir
33c3a2711c
Fix 01866_split_by_regexp.reference 2021-05-13 13:26:31 +03:00
kssenii
7115045317 Tiny changes 2021-05-13 09:39:57 +00:00
Pavel Kruglov
ec214bb04c Try fix tests again 2021-05-13 12:23:59 +03:00
Vladimir
7c77dd1e21
Minor changes in splitByRegexp 2021-05-13 12:21:00 +03:00
Alexander Kuzmenkov
99ab98b64c fix the tests 2021-05-13 12:06:59 +03:00
abel-wang
452dec891d correct reference name 2021-05-13 16:54:17 +08:00
Nikolai Kochetov
636b86d13e Disable 01710_projection_fetch for database replicated. 2021-05-13 11:13:24 +03:00
alesapin
bfa23d7e02 Merge branch 'master' into standalone_keeper 2021-05-13 11:03:07 +03:00
Pavel Kruglov
42d7621aee Change tests 2021-05-13 10:20:24 +03:00
kssenii
0cb0bd48f7 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into rabbitmq-fixes 2021-05-13 06:36:51 +00:00
Vladimir Chebotarev
1141872db2 Fix tests II. 2021-05-13 08:46:16 +03:00
Vladimir Chebotarev
83dddb33db Better tests fix. 2021-05-13 08:46:16 +03:00
Vladimir Chebotarev
8ba32fc935 Fix tests I. 2021-05-13 08:46:16 +03:00
Vitaliy Zakaznikov
7e899fff76 Comment 4 to retrigger CI/CD pipeline to check test stability. 2021-05-12 23:42:20 -04:00
abel-wang
51c1d7c7ba split into characters when split by '' & add docs 2021-05-13 11:15:38 +08:00
abel-wang
99b9fe6c33 add function splitByRegexp 2021-05-13 10:37:09 +08:00
feng lv
c6f8ab9826 fix 2021-05-13 02:05:53 +00:00
Vitaliy Zakaznikov
086a30a198 Comment 3 to retrigger CI/CD pipeline to check test stability. 2021-05-12 19:36:26 -04:00
Pavel Kruglov
cef7c8700b Try to fix tests 2021-05-13 00:48:06 +03:00
Vitaliy Zakaznikov
889d406341 Commint to retrigger CI/CD pipeline to check test stability. 2021-05-12 15:55:29 -04:00
Pavel Kruglov
86f061976e Some fixes 2021-05-12 22:02:56 +03:00
Vitaliy Zakaznikov
e55b4117be Updating helpers/cluster.py to increase timeout and add polling
when getting control shell.
2021-05-12 12:34:28 -04:00
Pavel Kruglov
8ed6ad7c55 Refactor, support all types in array, add nested arrays support, more tests 2021-05-12 19:06:08 +03:00
alesapin
ed89af22b2 Move jepsen tests to clickhouse-keeper 2021-05-12 16:31:29 +03:00
Alexander Kuzmenkov
f6cb9f95df lower two-level aggregation threshold for uniq test to avoid jitter 2021-05-12 16:01:48 +03:00
Vitaliy Zakaznikov
258525167f Commint to retrigger CI/CD pipeline to check test stability. 2021-05-12 08:15:09 -04:00
Anton Popov
46ce4b7a88
Merge pull request #24016 from MaxWk/order-by-with-fill-datetime64
support for order by fill with DateTime64
2021-05-12 14:44:36 +03:00
alesapin
ed3f89a7be
Merge pull request #23980 from kssenii/add-postgres-schema
Add missing table schema for postgres dictionary
2021-05-12 10:50:49 +03:00
alesapin
d5462df2f9
Merge pull request #24017 from ClickHouse/fix_bug_with_snapshots_read
Better error codes in Keeper when no leader alive
2021-05-12 10:15:58 +03:00
Maksim Kita
ffdc2b22a5
Merge pull request #24022 from amosbird/fixalias
Make `prefer_column_name_to_alias` setting more standard
2021-05-12 09:54:04 +03:00
Nikolai Kochetov
a5ad3324c9 Skip 01710_projection_fetch for parallel execution. 2021-05-12 09:42:01 +03:00
Nikolai Kochetov
a1ba67e029
Merge pull request #20202 from amosbird/projection
Projections
2021-05-12 09:38:07 +03:00
万康
aa43d3cff9 fix tests and code style 2021-05-12 11:44:45 +08:00
Vitaliy Zakaznikov
3d32363f39 Xfailing new fails in aes encryption module.
Adding basic execution of aes encryption module features in parallel.
2021-05-11 19:45:03 -04:00
alexey-milovidov
e8524d6e69
Update 01867_support_datetime64_version_column.reference 2021-05-12 01:19:51 +03:00
alexey-milovidov
d422e0199b
Merge pull request #24019 from Avogar/rename-uniq-theta
Rename uniqThetaSketch to uniqTheta
2021-05-12 01:17:18 +03:00
Vitaliy Zakaznikov
9c2b30f9fd Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into testflows_modules_in_parallel 2021-05-11 17:17:53 -04:00
Vitaliy Zakaznikov
2541f2cb25 Updating run_scenario method to not launch new parallel tests
if top test is terminating.
2021-05-11 17:17:08 -04:00
Amos Bird
62153e7030
Fix 2021-05-12 02:30:16 +08:00
alesapin
0dec8f77e4 Retry more errors in clickhouse-test 2021-05-11 20:33:44 +03:00
Maksim Kita
72d46beca0
Merge pull request #23979 from azat/dict-preallocate
Reimplement preallocate for hashed/sparse_hashed dictionaries
2021-05-11 20:15:46 +03:00
feng lv
9035e3a643 fix test and conflict 2021-05-11 16:22:24 +00:00
Pavel Kruglov
704bbe0aeb Raname uniqThetaSketch to uniqTheta 2021-05-11 17:39:35 +03:00
Nikolai Kochetov
817bc1377c Fix part check for projections. 2021-05-11 17:07:19 +03:00
Nikolai Kochetov
0e469f3ebf Try fix test. 2021-05-11 16:19:51 +03:00
Vitaliy Zakaznikov
042625a8e2 Debug commit to run all modules 4 times to check stability. 2021-05-11 09:13:04 -04:00
万康
36fc6432ce support for order by fill with DateTime64 2021-05-11 21:03:32 +08:00
Vitaliy Zakaznikov
f964f8b9c0 Adding retries when trying to obtain a terminal to a container. 2021-05-11 08:56:14 -04:00
alesapin
46e136b5c4
Merge branch 'master' into nv/parts-uuid-move-shard 2021-05-11 15:36:40 +03:00
tavplubix
430f558234
Update 01154_move_partition.sh 2021-05-11 15:31:13 +03:00
alexey-milovidov
f6c9327fd5
Update 01867_support_datetime64_version_column.sql 2021-05-11 15:29:48 +03:00
alexey-milovidov
3bb480bd37
Update 01867_support_datetime64_version_column.sql 2021-05-11 15:29:37 +03:00
万康
04f00b2b42 add tests 2021-05-11 20:00:34 +08:00
Nikolai Kochetov
89f16014b8 fix fetch for projection. 2021-05-11 14:44:59 +03:00
Amos Bird
dfa5629071
Remove projection type ast 2021-05-11 18:12:29 +08:00
Amos Bird
51d685bb9c
Even more fixes 2021-05-11 18:12:29 +08:00
Amos Bird
ddd4256a15
More fixes 2021-05-11 18:12:28 +08:00
Amos Bird
718c284437
Fix more tests 2021-05-11 18:12:28 +08:00
Amos Bird
ba17acbd63
Fix tests 2021-05-11 18:12:28 +08:00
Nikolai Kochetov
b736515c66
More tests. 2021-05-11 18:12:28 +08:00
Amos Bird
a3fd0b6f2e
Fix tests 2021-05-11 18:12:28 +08:00
Amos Bird
f7f949c1f9
Fix aggregation keys order 2021-05-11 18:12:27 +08:00
Amos Bird
e1e560765c
Fix missing columns 2021-05-11 18:12:27 +08:00
Amos Bird
ebaf42a448
Reformat and fix some tests 2021-05-11 18:12:27 +08:00
Nikolai Kochetov
233e8bc927
Added test with normal projections. 2021-05-11 18:12:27 +08:00
Amos Bird
483bd165e7
Check if pipeline is simple and add more comments 2021-05-11 18:12:26 +08:00
Amos Bird
264cff6415
Projections
TODO (suggested by Nikolai)

1. Build query plan fro current query (inside storage::read) up to WithMergableState
2. Check, that plan is simple enough: Aggregating - Expression - Filter - ReadFromStorage (or simplier)
3. Check, that filter is the same as filter in projection, and also expression calculates the same aggregation keys as in projection
4. Return WithMergableState if projection applies

3 will be easier to do with ActionsDAG, cause it sees all functions, and dependencies are direct (but it is possible with ExpressionActions also)

Also need to figure out how prewhere works for projections, and
row_filter_policies.

wip
2021-05-11 18:12:23 +08:00
Kruglov Pavel
fb038c1985
Merge pull request #23894 from pingyu/datasketches-uniq-again
Add uniqThetaSketch again
2021-05-11 11:24:43 +03:00
Kruglov Pavel
49e7ed6e60
Merge pull request #23673 from amosbird/partitionvalue
Add _partition_value virtual column
2021-05-11 11:23:00 +03:00
Alexey Milovidov
b2ca5cd98b Merge branch 'master' into normalize-bigint 2021-05-11 02:05:40 +03:00
Alexey Milovidov
2fcdc85dc7 Fix integration test 2021-05-11 01:54:52 +03:00
Vitaliy Zakaznikov
e0375204f1 Removing hard coded SKIP flag and xfailed it instead. 2021-05-10 17:09:26 -04:00
Vitaliy Zakaznikov
bce80f1256 Updating docker and docker-compose versions.
Updating and enabling datetime64 extended range tests.
2021-05-10 16:59:47 -04:00
alexey-milovidov
6d0bd4f7d2
Merge pull request #23969 from ClickHouse/aku/long-trace-id
support longer query ids in trace log for perf tests
2021-05-10 23:35:40 +03:00
Maksim Kita
4a22924ed5
Merge pull request #23946 from FArthur-cmd/8912-fix-dict-http-source
Add support for HTTP compression in dictionary source.
2021-05-10 22:52:07 +03:00
tavplubix
547e1f5a23
Update 01154_move_partition.sh 2021-05-10 22:31:13 +03:00
Vitaliy Zakaznikov
d4cead19f4 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into testflows_modules_in_parallel 2021-05-10 14:12:00 -04:00
Vitaliy Zakaznikov
c0a4770ee7 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into testflows_modules_in_parallel 2021-05-10 14:11:48 -04:00
alexey-milovidov
066acc71b6
Merge pull request #8482 from ClickHouse/enable-compile-expressions
Enable "compile_expressions" by default
2021-05-10 21:09:18 +03:00
Alexander Tokmakov
eef899ae63 better code, add test 2021-05-10 21:03:37 +03:00
alexey-milovidov
0400070924
Merge pull request #23822 from excitoon-favorites/equalsignins3path
Better handling of URI's in `PocoHTTPClient`
2021-05-10 20:25:18 +03:00
alexey-milovidov
ab33b80edc
Merge pull request #23962 from azat/external-group-by-overflow-row-fix
Fix SIGSEGV for external GROUP BY and overflow row
2021-05-10 20:02:05 +03:00
Alexey Milovidov
db4447d819 Fix integration test 2021-05-10 17:45:37 +03:00
Vitaliy Zakaznikov
1a83604d23 Fixing issue with getting node service docker container id. 2021-05-10 09:26:24 -04:00
Azat Khuzhin
808d1a0215 Reimplement preallocate for hashed/sparse_hashed dictionaries
It was initially implemented in #15454, but was reverted in #21948 (due
to higher memory usage).

This implementation differs from the initial, since now there is
separate attribute to enable preallocation, before it was done
automatically, but this has problems with duplicates in the source.

Plus this implementation does not uses dynamic_cast, instead it extends
IDictionarySource interface.
2021-05-10 07:41:48 +03:00
Alexander Kuzmenkov
e7225b8bee fix the tests 2021-05-10 07:18:21 +03:00
Maksim Kita
742434a0cd
Merge pull request #23903 from azat/fix-flaky-tests-21.6
Fix test_insert_into_distributed flaps
2021-05-10 00:44:46 +03:00
Alexey Milovidov
49e4a43300 Fix double whitespace in integration tests 2021-05-09 23:16:57 +03:00
FArthur-cmd
fc104f0d0d improving test to cover updates 2021-05-09 23:04:06 +03:00
FArthur-cmd
6363a5dd96 use path to define compression type 2021-05-09 21:58:08 +03:00
Vitaliy Zakaznikov
06c60158b8 Increasing timeouts. 2021-05-09 12:34:56 -04:00
Alexey Milovidov
9753ddc8a0 Merge branch 'master' of github.com:yandex/ClickHouse into normalize-bigint 2021-05-09 18:54:29 +03:00
kssenii
d6582f5fe5 Table schema for dict 2021-05-09 15:42:54 +00:00
alexey-milovidov
4ada91574b
Merge branch 'master' into fixing_testflows_window_function_distributed_tests 2021-05-09 18:29:33 +03:00
FArthur-cmd
cc583fde4f tests reference 2021-05-09 15:54:01 +03:00
FArthur-cmd
bd519075b7 adding checking url in HTTPSource 2021-05-09 14:27:11 +03:00
Maksim Kita
e517436ba4
Merge pull request #23961 from kitaisreal/array-difference-decimal-math-overflow
Function arrayDifference decimal math overflow
2021-05-09 14:04:35 +03:00
Vitaliy Zakaznikov
c5948c3ba7 Updating timeouts in LDAP tests. 2021-05-08 20:33:22 -04:00
alexey-milovidov
a34c927fb2
Merge branch 'master' into tests_dt64_ext 2021-05-08 23:29:18 +03:00
Alexey Milovidov
67200d5a96 Split test (it is too large) 2021-05-08 23:15:54 +03:00
Vitaliy Zakaznikov
b85205aa30 Enabling testflows window function tests. 2021-05-08 15:22:03 -04:00
Vitaliy Zakaznikov
b303ebc7e3 Fixing window functions distributed tests by moving to using deterministic sharding key. 2021-05-08 15:06:31 -04:00
Vitaliy Zakaznikov
f886e2cebb Removing rand() as a sharding key to avoid instability in window function tests and
instead moved to using deterministic sharding key.
2021-05-08 15:00:54 -04:00
Maksim Kita
290e1ec307 Functional stateless tests fix numbers 2021-05-08 21:13:27 +03:00
Maksim Kita
2a630b68a4 Fixed FunctionComparison with special edge case 2021-05-08 21:04:21 +03:00
Vitaliy Zakaznikov
521b61741b Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into testflows_modules_in_parallel 2021-05-08 14:01:28 -04:00
Azat Khuzhin
f1aebbe927 Check that totals correctly calculated in 01865_aggregator_overflow_row
Change aggregation function to uniqCombined() to check this.
2021-05-08 20:43:01 +03:00
Maksim Kita
0a2ea38cc9
Merge pull request #23916 from azat/dict-found_rate
Measure found rate for dictionaries
2021-05-08 19:23:52 +03:00
Alexander Kuzmenkov
308c4657ce support longer query ids in trace log for perf tests 2021-05-08 18:20:42 +03:00
Azat Khuzhin
4cecc238d6 Fix SIGSEGV for external GROUP BY and overflow row
Overflow row is used for GROUP BY if all of the above is true:
- WITH TOTALS is requested
- max_rows_to_group_by > 0
- group_by_overflow_mode = any
- totals_mode != after_having_exclusive

And in case of overflow row and external GROUP BY, once the temporary
file dumps to disk it resets without_key data variant to nullptr, so any
subsequent dump to disk will cause SIGSEGV.

Fix this, by recreating without_key data variant after dumping to disk,
instead of reseting to nullptr.

And also add sanity check (LOGICAL_ERROR) to make error more
deterministic in case of such error.

Found with fuzzer [1].

  [1]: https://clickhouse-test-reports.s3.yandex.net/23929/e7027e052998540ee660d186727e20f9555b729d/fuzzer_ubsan/report.html#fail1
2021-05-08 17:48:24 +03:00
Maksim Kita
57d5f55d7f Added jit if test 2021-05-08 17:39:35 +03:00
Azat Khuzhin
bdb5dad3a3 Cover system.dictionaries.found_count
v2: fix for ANTRL
v3: add all dictionaries layouts
2021-05-08 17:09:01 +03:00
Maksim Kita
108c2022d9 Function arrayDifference decimal math overflow 2021-05-08 17:01:30 +03:00
Alexey Milovidov
47a4c101b9 Merge branch 'master' into normalize-bigint 2021-05-08 16:41:15 +03:00
Alexey Milovidov
b64f5b0419 Disable unreliable TestFlows 2021-05-08 16:40:54 +03:00
tavplubix
f8c7725ef5
Merge pull request #23742 from ClickHouse/update_metadata_on_replica_recovery
Update metadata on replica recovery
2021-05-08 16:34:03 +03:00
Maksim Kita
80dbb7ca4f
Merge pull request #23948 from azat/dict-range-min-max-check
Check MIN/MAX attributes in the list of dictionary attributes
2021-05-08 16:07:26 +03:00
FArthur-cmd
acb09f01d4 fixing details in code style and moving tests 2021-05-08 12:46:50 +03:00
Maksim Kita
b617c57ce8
Merge pull request #23929 from azat/dict-cache-source-dups-fix
Fix keys metrics accounting for CACHE() dictionary with duplicates in the source
2021-05-08 11:56:20 +03:00
FArthur-cmd
c6c80085b8 solving problem with same test naming 2021-05-08 10:15:55 +03:00
FArthur-cmd
13a6e03849 solving style-check problems 2021-05-08 10:15:14 +03:00
Azat Khuzhin
8e9655d513 Check MIN/MAX attributes in the list of dictionary attributes
This way there will be proper exception instead of std::out_of_range
2021-05-08 08:59:47 +03:00
Alexey Milovidov
dd4e002b5c Adjust a test after relaxed overflow checks 2021-05-08 03:38:56 +03:00
Alexey Milovidov
53637d7be0 Adjust a test after relaxed overflow checks 2021-05-08 03:38:15 +03:00
Alexey Milovidov
89d56f1668 Fix bad test 2021-05-08 03:36:28 +03:00
Alexey Milovidov
1f69f8c475 Make test for Decimal correct 2021-05-08 03:33:01 +03:00
Alexey Milovidov
e8c29bf15f Adjust test because rounding in conversion of Float to Decimal has changed 2021-05-08 03:27:23 +03:00
Alexey Milovidov
5f3377cb84 Adapt test after some overflow checks were removed 2021-05-08 03:24:56 +03:00
Alexey Milovidov
059bdd89dc Adapt test after some overflow checks were removed 2021-05-08 03:22:34 +03:00
Vitaliy Zakaznikov
945ff2c338 Fixing styling errors. 2021-05-07 19:28:20 -04:00
FArthur-cmd
4ea9851e99 fixing dictionary http source by adding wrapper 2021-05-08 02:20:30 +03:00
Alexey Milovidov
e49b44a0fd Update generateRandom tests 2021-05-08 01:09:51 +03:00
Azat Khuzhin
c1b213b96e Fix 01863_dictionary_cache_duplicates under ANTLR parser
By do not start name of table/dict from number.
2021-05-08 00:59:55 +03:00
Vitaliy Zakaznikov
1dd5e7d986 Fixing intro to window functions SRS. 2021-05-07 17:45:08 -04:00
Kseniia Sumarokova
e6ac136c32
Merge pull request #23909 from kssenii/postgres-fixes
Fix postgres connections issue
2021-05-08 00:07:21 +03:00
Vladimir Chebotarev
a39314949e
Added solution for host network mode in Ubuntu 20.10+. 2021-05-07 23:36:15 +03:00
Vitaliy Zakaznikov
4b87ae684c Adding 'clean' script to clean up _instances folders.
Updating RBAC to run on the latest master.
Fixing ldap SRS reference issue.
2021-05-07 15:40:58 -04:00
Vitaliy Zakaznikov
04a9dbeb2b Fixing SRS reference and updating requirements. 2021-05-07 15:37:29 -04:00
Alexey Milovidov
c404e6db2f Merge branch 'master' of github.com:yandex/ClickHouse into normalize-bigint 2021-05-07 18:25:12 +03:00
Anton Popov
01e99ab72e
Merge pull request #23871 from CurtizJ/cast-operator
Add postgres-like cast operator
2021-05-07 16:29:22 +03:00
Anton Popov
576728829d fix perf test 2021-05-07 16:23:46 +03:00
Vitaliy Zakaznikov
0b95bfb38e Adding support to run modules in parallel.
Adding fixes to ldap and rbac tests.
Adding user_dn_detection tests in LDAP role mapping.
2021-05-07 09:14:40 -04:00
alexey-milovidov
fd56e0a984
Merge pull request #23919 from ucasFL/hint-enum
Add hints for enum names
2021-05-07 16:12:16 +03:00