thevar1able/ClickHouse
1
0
Fork 0
mirror of https://github.com/ClickHouse/ClickHouse.git synced 2024-11-22 15:42:02 +00:00
Code Issues Packages Projects Releases Wiki Activity
49,000 Commits 9,152 Branches 1,781 Tags 2.1 GiB
4d427e822f
Commit Graph

3490 Commits

Author SHA1 Message Date
Vxider
fb31544d4a add blank line to the end of file 2020-09-18 09:39:15 +08:00
Vxider
848664c4af rewrite performance test to functional test 2020-09-18 09:34:51 +08:00
Anton Popov
d1e90e0e4b fix tests 2020-09-18 03:05:51 +03:00
alexey-milovidov
76a3cc2dae
Merge pull request #14937 from filimonov/finalizeAggregation_statefullness 
Fix enable_optimize_predicate_expression for finalizeAggregation
 2020-09-18 01:24:02 +03:00
alexey-milovidov
cf5db5e4dc
Merge pull request #14888 from azat/client-imporove-INSERT-error-message 
Improve error message for INSERT via clickhouse-client
 2020-09-18 01:13:22 +03:00
alesapin
dc677b93fb Comments and fix test 2020-09-17 22:30:17 +03:00
Alexander Tokmakov
06ff6d2eda better 01193_metadata_loading 2020-09-17 19:28:44 +03:00
zhang2014
64032e22a2 Merge branch 'master' into fix/datetime 2020-09-18 00:28:09 +08:00
Alexander Kuzmenkov
652163c07c
Merge pull request #14883 from ClickHouse/aku/ignore-thresholds 
Adjust ignore thresholds for unstable perf tests
 2020-09-17 18:14:53 +03:00
Alexander Kuzmenkov
5539c6ecaa
Merge pull request #14928 from ClickHouse/aku/special-builds 
Move non-essential builds to special
 2020-09-17 17:19:32 +03:00
Vitaly Baranov
3356d75b23
Merge pull request #13156 from azat/cluster-secure 
Secure inter-cluster query execution (with initial_user as current query user) [v3]
 2020-09-17 17:11:00 +03:00
alexey-milovidov
496df5b3e9
Merge pull request #14678 from sundy-li/patch-2 
dynamic zookeeper config when session expired
 2020-09-17 17:05:22 +03:00
Mikhail Filimonov
22bd22702e
Fix enable_optimize_predicate_expression for finalizeAggregation 
finalizeAggregation was wrongly marked as stateful, preventing pushing the conditions down.
 2020-09-17 15:59:14 +02:00
Vxider
1322a1ce7a add blank line to end of file 2020-09-17 21:53:39 +08:00
Ilya Golshtein
624a4c4d55 kdc Dockerfile integrated 2020-09-17 16:51:34 +03:00
Ilya Golshtein
1862f58cf5 forgotten empty clickhouse_path dir 2020-09-17 16:51:34 +03:00
Ilya Golshtein
75836acddc code review changes 2020-09-17 16:51:34 +03:00
Ilya Golshtein
bcdb2277bd distutils=>shutil 2020-09-17 16:51:34 +03:00
Ilya Golshtein
23853cc8cf fix conflict resolution mistake 2020-09-17 16:51:34 +03:00
Ilya Golshtein
96c2a7c77e kerberized kafka test works after merge 2020-09-17 16:51:34 +03:00
Ilya Golshtein
1808a1e36c short krb ticket lifetime, Dockerile renamed 2020-09-17 16:51:34 +03:00
Ilya Golshtein
c227f91636 remove_files improved, proper docker images, tiny cleanup 2020-09-17 16:51:34 +03:00
Ilya Golshtein
a2e72ec37a test via runner is Ok, switched to custom images 2020-09-17 16:51:34 +03:00
Ilya Golshtein
2d5c31d588 test_storage_kerberized_kafka cleanup + negative test 2020-09-17 16:51:34 +03:00
Ilya Golshtein
c12fa26fe3 kerberized kafka test works 2020-09-17 16:51:34 +03:00
alexey-milovidov
2413caa7d5
Merge pull request #14889 from ClickHouse/extract-all-groups-empty-match 
Fix error in "extractAllGroups" function
 2020-09-17 16:02:30 +03:00
Alexander Kuzmenkov
946d364b10 Move non-essential builds to special 
Special builds have lower CI priority and start later. If some tests
fail, they won't start at all, so we'll save some CI time.
 2020-09-17 14:41:14 +03:00
alesapin
40b2f203b6 Merge branch 'master' into manual-write-duplicate-parts-to-replicas 2020-09-17 13:21:00 +03:00
alesapin
50c55eb2d2
Merge pull request #14846 from ClickHouse/add_clang_11 
Move to clang-11 in CI builds
 2020-09-17 13:14:00 +03:00
alexey-milovidov
2886b38c03
Merge branch 'master' into fix_test_distributed_over_live_view2 2020-09-17 13:06:39 +03:00
Alexander Kuzmenkov
36538ce08f Don't account for short queries, we'll deal with them separately. 
New query:

```
WITH ceil(max(q[3]), 1) AS h
SELECT concat('sed -i s\'/^<test.*$/<test max_ignored_relative_change="', toString(h), '">/g\' tests/performance/', test, '.xml') AS s
FROM
(
    SELECT
        test,
        query_index,
        count(*),
        min(event_time),
        max(event_time) AS t,
        arrayMap(x -> floor(x, 3), quantiles(0, 0.5, 0.95, 1)(stat_threshold)) AS q,
        median(stat_threshold) AS m
    FROM perftest.query_metrics
    WHERE (metric = 'client_time') AND (abs(diff) < 0.05) AND (old > 0.2)
    GROUP BY
        test,
        query_index,
        query_display_name
    HAVING (t > '2020-09-01 00:00:00') AND (m > 0.1)
    ORDER BY test DESC
)
GROUP BY test
ORDER BY h DESC
FORMAT PrettySpace
```
 2020-09-17 13:00:51 +03:00
roman
b41421cb1c [settings]: introduce new query complexity settings for leaf-nodes 
The new setting should allow to control query complexity on leaf nodes
excluding the final merging stage on the root-node. For example, distributed
query that reads 1k rows from 5 shards will breach the `max_rows_to_read=5000`,
while effectively every shard reads only 1k rows. With setting `max_rows_to_read_leaf=1500`
this limit won't be reached and query will succeed since every shard reads
not more that ~1k rows.
 2020-09-17 10:37:05 +01:00
Nikolai Kochetov
339521fadb
Update test.py 2020-09-17 11:48:27 +03:00
alesapin
f104c382f8
Merge pull request #14887 from azat/StorageFile-write-to-fd 
Fix SIGSEGV for an attempt to INSERT into StorageFile(fd)
 2020-09-17 10:25:02 +03:00
alesapin
4348dca960
Update ci_config.json 2020-09-17 10:07:58 +03:00
alesapin
73544a3781
Merge pull request #14845 from ClickHouse/fix_alias_array 
Fix recursive column defaults
 2020-09-17 10:02:39 +03:00
sundy-li
544b2cb20d add configChanged method for zookeeper 
fix logic error && skip reload testkeeper
 2020-09-17 13:33:45 +08:00
Azat Khuzhin
13088d9bef Fix 00900_parquet_load (update exception message on INSERT failures) 2020-09-17 08:05:56 +03:00
Vitaliy Zakaznikov
bf9feb6865 Removing usage of time.sleep in tests/integration/test_distributed_over_live_view/test.py 2020-09-16 22:07:58 -04:00
Azat Khuzhin
138e953429 Fix SIGSEGV for an attempt to INSERT into StorageFile(fd) 2020-09-17 01:26:34 +03:00
Alexey Milovidov
c37b55c3b1 Fix error in "extractAllGroups" function 2020-09-17 00:19:58 +03:00
Azat Khuzhin
7d046b24e6 Improve error message for INSERT via clickhouse-client 
With '\n...' after the query [1] clickhouse-client prefer data from the
INSERT over from stdin, and produce very tricky message:

    Code: 27. DB::Exception: Cannot parse input: expected '\n' before: ' ': (at row 1)

Well for TSV it is ok, but for RowBinary:

    Code: 33. DB::Exception: Cannot read all data. Bytes read: 1. Bytes expected: 4.

So improve error message by adding the source of data for INSERT.

  [1]: clickhouse-client -q "INSERT INTO data FORMAT TSV\n " <<<2
 2020-09-17 00:16:51 +03:00
Anton Popov
8e9828d2ff Merge remote-tracking branch 'upstream/master' into HEAD 2020-09-16 21:07:35 +03:00
alexey-milovidov
84b210f93e
Merge pull request #14864 from bharatnc/ncb/format-integration-tests 
Format and cleanup imports form all *.py integration test files
 2020-09-16 20:40:57 +03:00
Nikolai Kochetov
d0debd51c0 Add sorting to fix test. 2020-09-16 20:00:44 +03:00
alesapin
e173658422 Fix integration test 2020-09-16 19:53:58 +03:00
Alexander Kuzmenkov
0f8aec59a3 Adjust ignore thresholds for unstable perf tests 
Based on historical data.

```
SELECT
    test,
    ceil(max(q[3]), 1) AS h
FROM
(
    SELECT
        test,
        query_index,
        count(*),
        min(event_time),
        max(event_time) AS t,
        arrayMap(x -> floor(x, 3), quantiles(0, 0.5, 0.95, 1)(stat_threshold)) AS q,
        median(stat_threshold) AS m
    FROM perftest.query_metrics
    WHERE (metric = 'client_time') AND (abs(diff) < 0.05)
    GROUP BY
        test,
        query_index,
        query_display_name
    HAVING (t > '2020-09-01 00:00:00') AND (m > 0.1)
    ORDER BY m DESC
)
GROUP BY test
ORDER BY h DESC
FORMAT TSV

cryptographic_hashes	1.3
collations	0.8
joins_in_memory_pmj	0.8
joins_in_memory	0.7
merge_tree_simple_select	0.7
set_index	0.7
decimal_casts	0.7
website	0.6
logical_functions_medium	0.5
count	0.5
merge_tree_many_partitions	0.5
decimal_aggregates	0.5
codecs_int_insert	0.5
column_column_comparison	0.5
insert_parallel	0.4
parse_engine_file	0.4
read_in_order_many_parts	0.4
logical_functions_small	0.4
parallel_insert	0.3
parallel_index	0.3
push_down_limit	0.3
jit_large_requests	0.3
select_format	0.3
arithmetic	0.3
merge_tree_huge_pk	0.3
materialized_view_parallel_insert	0.3
columns_hashing	0.3
if_array_string	0.3
random_string	0.2
random_printable_ascii	0.2
set	0.2
empty_string_serialization	0.2
```

To apply:
```
sed 's/^\(.*\)        \(.*\)$/sed -i "s\/^<test.*$\/<test max_ignored_relative_change="'"'"\2">\/g" tests\/performance\/\1.xml/g' ../bad.tsv | bash
```
 2020-09-16 18:27:51 +03:00
tavplubix
faa5190f11
Update arcadia_skip_list.txt 2020-09-16 18:17:16 +03:00
Amos Bird
3e576a29c9
explict column list in columns matcher (#14775) 2020-09-16 15:44:05 +03:00
tavplubix
28a6b7e622
Merge pull request #14831 from bharatnc/ncb/fix-timespec-construct 
construct query_start_time & query_start_time_microseconds from the same timespec
 2020-09-16 15:42:19 +03:00
alesapin
a12521dd4d Remove clang-11 build for release 2020-09-16 14:27:29 +03:00
alesapin
d9057eb2c1
Merge pull request #14855 from ClickHouse/fix_flaky_test_6 
Flaky tests fixes
 2020-09-16 09:47:51 +03:00
bharatnc
b75963d370 Format and optimize imports in integration test files 
This PR formats all the `*.py` files found under the `tests/integration`
folder. It also reorders the imports and cleans up a bunch of unused
imports.

The formatting also takes care of other things like wrapping lines and
fixing spaces and indents such that the tests look more readable.
 2020-09-15 23:10:54 -07:00
alexey-milovidov
7fb0291c09
Merge pull request #14854 from zhang2014/fix/ISSUES-14809 
ISSUES-14809 fix MaterializeMySQL empty transaction unstable test case
 2020-09-16 00:44:51 +03:00
alesapin
3b34345abb Less flaky tests 2020-09-15 18:42:46 +03:00
Vitaly Baranov
74d5b43fe6
Merge pull request #14828 from vitlibar/change-columns-of-system-user-directories 
Add 'params' column to system.user_directories table.
 2020-09-15 18:25:50 +03:00
alesapin
813a6e991c Remove wait_for_mutation from test 2020-09-15 18:16:29 +03:00
alesapin
6130cd7365 More stable test_no_ttl_merges_in_busy_pool 2020-09-15 17:53:55 +03:00
zhang2014
1c659de8b1 ISSUES-14809 fix MaterializeMySQL empty transaction test failure 2020-09-15 22:44:18 +08:00
Anton Popov
3e855daefd Merge remote-tracking branch 'upstream/master' into HEAD 2020-09-15 15:31:29 +03:00
Anton Popov
63db2ca68d fix test 2020-09-15 15:30:07 +03:00
alesapin
eaf5e293ad Move to clang-11 in most CI builds 2020-09-15 14:37:51 +03:00
alesapin
8828a78174 Fix alias on default columns 2020-09-15 14:17:58 +03:00
hexiaoting
023daddbea Fix bug for LineAsString Format 2020-09-15 18:13:39 +08:00
Nikolai Kochetov
c1f61984e5
Merge pull request #14513 from amosbird/mf1 
Binary operator monotonicity
 2020-09-15 12:45:23 +03:00
Vxider
03346a0a30 add performance test 2020-09-15 17:35:38 +08:00
Vxider
9b98ec2cc0 add functional test 2020-09-15 17:16:48 +08:00
tavplubix
1d8ee50769
Merge pull request #14628 from ClickHouse/enable_some_tests_with_database_atomic 
Enable more tests with Atomic database
 2020-09-15 12:13:40 +03:00
alesapin
a75254766e
Merge pull request #14609 from ClickHouse/update_to_gcc_10 
Update default build to gcc-10
 2020-09-15 09:49:43 +03:00
bharatnc
90e0ef9b70 QueryLog,QueryThreadLOg - better test for query_start_time_microseconds 2020-09-14 20:04:29 -07:00
Amos Bird
4770175aa3
more tests 2020-09-15 10:02:26 +08:00
Anton Popov
f725f8deee fix more tests 2020-09-15 02:14:14 +03:00
Vitaly Baranov
0f53b449fd Add 'params' column to system.user_directories table. 2020-09-15 01:51:53 +03:00
Azat Khuzhin
0159c74f21 Secure inter-cluster query execution (with initial_user as current query user) [v3] 
Add inter-server cluster secret, it is used for Distributed queries
inside cluster, you can configure in the configuration file:

  <remote_servers>
      <logs>
          <shard>
              <secret>foobar</secret> <!-- empty -- works as before -->
              ...
          </shard>
      </logs>
  </remote_servers>

And this will allow clickhouse to make sure that the query was not
faked, and was issued from the node that knows the secret. And since
trust appeared it can use initial_user for query execution, this will
apply correct *_for_user (since with inter-server secret enabled, the
query will be executed from the same user on the shards as on initator,
unlike "default" user w/o it).

v2: Change user to the initial_user for Distributed queries if secret match
v3: Add Protocol::Cluster package
v4: Drop Protocol::Cluster and use plain Protocol::Hello + user marker
v5: Do not use user from Hello for cluster-secure (superfluous)
 2020-09-15 01:36:28 +03:00
Azat Khuzhin
2fce2b21a8 Use pytest.raises(match=) in test_allowed_client_hosts 
Since pytest.raises() produces excinfo not exception, hence at least
str(excinfo.value) should be used to match the exception message.
 2020-09-15 01:36:28 +03:00
Azat Khuzhin
65e48663e7 Drop policy on start in 01308_row_policy_and_trivial_count_query 2020-09-15 01:36:22 +03:00
Alexander Tokmakov
da6beb1a91 Merge branch 'master' into enable_some_tests_with_database_atomic 2020-09-14 23:00:14 +03:00
alesapin
58f4e5f967
Merge pull request #14755 from vitlibar/fix-permission-denied-in-integration-tests 
Fix access denied on opening file /var/lib/clickhouse/status in integration tests.
 2020-09-14 22:08:21 +03:00
Nikolai Kochetov
d418ee48a4
Merge pull request #14783 from amosbird/fix3 
Fix signedness conversion monotonicity
 2020-09-14 21:40:51 +03:00
Alexander Kuzmenkov
9e3797b252
Merge pull request #14710 from ClickHouse/aku/faster-perf 
Do less runs in perf test
 2020-09-14 19:17:34 +03:00
Ildus Kurbangaliev
67b49862d9
Add mapPopulateSeries function (#13166) 2020-09-14 19:11:50 +03:00
Vitaly Baranov
cae5a23a43
Merge pull request #13837 from vitlibar/add-user-directories-section-to-default-config 
Add the section <user_directories> to the default config.
 2020-09-14 16:47:32 +03:00
alexey-milovidov
752e3f8197
Merge pull request #14453 from amosbird/apply2 
column transformers in insert select
 2020-09-14 16:46:01 +03:00
Anton Popov
ac9ba23bdf fix more tests 2020-09-14 15:49:04 +03:00
Artem Zuikov
d274125c74
Fix wide integer left shift + refactoring (#14697) 2020-09-14 14:56:43 +03:00
Amos Bird
5998570762
Fix signedness conversion monotonicity 2020-09-14 18:12:41 +08:00
Amos Bird
654245af3c
Fix signedness conversion monotonicity 2020-09-14 18:11:40 +08:00
Alexander Kuzmenkov
3113aa6cfe Avoid extra error in perf report on broken queries 2020-09-14 10:59:45 +03:00
Alexander Kuzmenkov
c701a15271 fixup 2020-09-14 10:27:46 +03:00
alesapin
0c04f4d008
Update cluster.py 2020-09-14 10:01:20 +03:00
alesapin
336430d3c2
Merge pull request #14646 from ClickHouse/if_bug 
Fix bug in if function when then clause contain const nullable column
 2020-09-14 09:51:40 +03:00
Nikolai Kochetov
109fd9d6d7
Merge pull request #13015 from amosbird/jgmko 
Refactor joinGet and implement multi-key lookup.
 2020-09-13 22:39:48 +03:00
Amos Bird
34b9547ce1
Binary operator monotonicity 2020-09-13 21:55:12 +08:00
Amos Bird
016f707ea1
column transformers in insert select 2020-09-13 10:21:13 +08:00
Amos Bird
882b2a3348
CTE 2020-09-13 09:39:17 +08:00
Vitaly Baranov
421eeeccef Add the section user_directories to the default config. 2020-09-12 23:04:28 +03:00
alesapin
8242a94880
Update ci_config.json 2020-09-12 15:42:07 +03:00
alexey-milovidov
c2f762e20a
Merge pull request #14748 from vitlibar/skip-access-storages-with-same-path 
Skip access storages with same path while reading the main config.
 2020-09-12 14:20:02 +03:00
alesapin
ecbcbad0d9 Fix flaky test 2020-09-12 10:07:08 +03:00
alesapin
2c6567eb88
Merge pull request #14745 from kssenii/fix-rabbit-tests-crash 
Fix crashes in RabbitMQ tests
 2020-09-12 09:53:14 +03:00
Vitaly Baranov
1e849f2975 Fix permission denied on opening file /var/lib/clickhouse/status in integration tests. 2020-09-12 03:18:18 +03:00
Azat Khuzhin
9c7f3a9a74 Add test_distributed_ddl_parallel 2020-09-12 02:33:17 +03:00
Vitaly Baranov
e2c2a679ef Skip access storages with same path while reading the main config. 2020-09-12 01:34:46 +03:00
Nikita Mikhaylov
fcad11e48f
Merge pull request #14746 from nikitamikhaylov/arcadia-fix 
Disable test in Arcadia
 2020-09-11 22:56:21 +04:00
alesapin
36019596c1 Disable flaky test 2020-09-11 20:08:23 +03:00
alesapin
2c4047b280 Revert accident changes 2020-09-11 20:07:00 +03:00
alesapin
c0dafb0283 Disable test 2020-09-11 20:04:55 +03:00
alesapin
a4c43e51b9 Add a test 2020-09-11 20:04:55 +03:00
nikitamikhaylov
b96da75ead done 2020-09-11 19:44:14 +03:00
kssenii
31dbfd07e2 remove tests crash reason 2020-09-11 16:16:24 +00:00
alesapin
d9394fbf66 Fix code 2020-09-11 18:51:08 +03:00
Nikita Mikhaylov
26742a3c81
Merge pull request #14703 from nikitamikhaylov/format-line-as-string 
Merging #13846 (Format LineAsString)
 2020-09-11 16:45:57 +04:00
Nikita Mikhaylov
468089a4cd
Merge pull request #14514 from bharatnc/ncb/event_time_microseconds_metric_logs 
add event_time_microseconds field to asynchronous_metric_log & metric_log system tables
 2020-09-11 16:14:00 +04:00
alesapin
c202ce8e63 Merge branch 'master' into update_to_gcc_10 2020-09-11 12:50:10 +03:00
alexey-milovidov
e73ca17ad3
Merge pull request #14725 from BooBSD/formatReadableQuantity 
formatReadableQuantity() function
 2020-09-11 12:09:18 +03:00
Alexander Kuzmenkov
d227f1f706
Merge pull request #13192 from ClickHouse/aku/semicolon-simple 
Simpler version of semicolon-terminated VALUES #12999 w/o `pos` changes
 2020-09-11 11:51:52 +03:00
alesapin
902624cb7b Merge branch 'master' into if_bug 2020-09-11 10:54:32 +03:00
zhang2014
7ff7ee6aac ISSUES-4006 try fix integration test 2020-09-11 15:37:14 +08:00
Anton Popov
8a201a28c0 remove skip list for tests with polymorphic parts 2020-09-11 03:14:35 +03:00
alexey-milovidov
87b3984d17
Merge pull request #14713 from ClickHouse/add-test-with-crahs-in-array-join 
Added test from #13829
 2020-09-10 23:57:02 +03:00
Anton Popov
fa6d88b3b2 fix more tests 2020-09-10 21:43:02 +03:00
Anton Popov
6031e6bae9 fix tests 2020-09-10 20:09:19 +03:00
Artem Hnilov
bbe379d58e 00534_filimonov.data was updated 2020-09-10 17:06:32 +00:00
Artem Hnilov
142026f4ab 01492_format_readable_quantity test added 2020-09-10 16:54:52 +00:00
nikitamikhaylov
6e0d2a427c add another test 2020-09-10 19:30:11 +03:00
tavplubix
4581e3a18a
Merge pull request #14563 from bharatnc/ncb/zk-conn-fail-do-cleanup 
ReplicatedMergeTree - cleanup data directory after Zookeeper exceptions
 2020-09-10 19:19:57 +03:00
Nikolai Kochetov
964c18241c Added test from #13829 2020-09-10 19:04:53 +03:00
bharatnc
397ebdb855 remove sleep from unit test 2020-09-10 08:55:39 -07:00
Nikita Mikhaylov
a39ba57e8c
Merge branch 'master' into dev-nf 2020-09-10 18:10:47 +04:00
Nikita Mikhaylov
f0a65522cc
Merge pull request #14333 from hczhcz/patch-0901 
Add JSONStrings formats
 2020-09-10 17:54:42 +04:00
Alexander Tokmakov
20b3823770 do not remove directory on attach 2020-09-10 13:21:13 +03:00
zhang2014
5b3e9eaaf0 Merge branch 'master' into fix/datetime 2020-09-10 17:26:26 +08:00
zhang2014
338b69201d ISSUES-4006 add test decimal when dump stage 2020-09-10 17:20:28 +08:00
bharatnc
31b0bd481c Integration tests - more accurate tests 2020-09-10 00:35:25 -07:00
alexey-milovidov
92b746116a
Merge pull request #14655 from ClickHouse/nested-multiline-comments 
Support for nested multiline comments
 2020-09-10 06:10:31 +03:00
bharatnc
05a80518a1 Merge remote-tracking branch 'upstream/master' into ncb/event_time_microseconds_metric_logs 2020-09-09 17:58:29 -07:00
bharatnc
2ad63d2b4d AsynchronousMetricLog - refactor integration test 2020-09-09 17:56:21 -07:00
bharatnc
0a3f7d0fcc AsynchronousMetricsLog - add improved tests 
This adds integration tests to test the asynchronous_metric_log table
for event_time_microseconds field.

Asynchronous metrics are updated once every 60s, so this setting needs
to be overridden for having those metrics available in time so that the
tests can run. So the `asynchronous_metric_update_period_s` setting is
being overriden to be 2s.
 2020-09-09 17:50:39 -07:00
Anton Popov
d1c35dc794 Merge remote-tracking branch 'upstream/master' into HEAD 2020-09-10 03:13:08 +03:00
Nikita Mikhaylov
44726c37c3
Merge branch 'master' into fix-executable-dictionary-source-hangup 2020-09-09 23:01:41 +04:00
Alexey Milovidov
7304bad56f Support for nested multiline comments 2020-09-09 20:51:05 +03:00
Alexander Tokmakov
dee1fefeb4 add more tests 2020-09-09 20:39:49 +03:00
alesapin
62428845a0 Bug in mutation 2020-09-09 19:47:06 +03:00
alesapin
cdb72add35
Merge pull request #14619 from ClickHouse/better_copy_dir 
Better recursive database copy in integration tests
 2020-09-09 19:38:55 +03:00
bharatnc
fe6d6f16ea Merge remote-tracking branch 'upstream/master' into ncb/zk-conn-fail-do-cleanup 2020-09-09 09:25:34 -07:00
bharatnc
d1d3af7501 StorageReplicatedMergeTree - more improvements to integration test 2020-09-09 09:24:18 -07:00
alexey-milovidov
38131917ef
Merge pull request #14530 from amosbird/ma 
Fix Nullable String to Enum conversion.
 2020-09-09 19:24:04 +03:00
Alexander Tokmakov
7f4106687c fix 2020-09-09 19:23:31 +03:00
alexey-milovidov
c6d0944994
Merge pull request #14591 from myrrc/bugfix/lc-nullability-checker 
Correct nullability checker for LowCardinality nested columns
 2020-09-09 19:23:19 +03:00
alexey-milovidov
a6a0d4966c
Merge pull request #14595 from azat/query-format-trailing-whitespace 
Fix some trailing whitespaces in query format (ExpressionList users)
 2020-09-09 19:22:55 +03:00
zhang2014
6ed3f7fb86 ISSUES-4006 try fix integration test failure when mysql 5.7 2020-09-09 23:42:03 +08:00
zhang2014
094897fe69 Merge branch 'master' into fix/datetime 2020-09-09 23:37:54 +08:00
alesapin
bd14c79b0b
Merge pull request #14494 from ClickHouse/recompression_in_background 
Recompression TTL
 2020-09-09 17:46:01 +03:00
Alexander Tokmakov
b68782d285 enable more tests with Atomic database 2020-09-09 16:32:50 +03:00
Artem Zuikov
48f29ae11f
Fix bug in Decimal scale (#14603) 2020-09-09 16:18:58 +03:00
myrrc
a8f5d9e70f added the test and comment 2020-09-09 15:52:44 +03:00
Vasily Nemkov
3973a17530
MySql datatypes dateTime64 and decimal (#11512) 2020-09-09 15:18:02 +03:00
Nikita Mikhaylov
c03a9487ca another test + fix 2020-09-09 14:55:20 +03:00
alesapin
98f19a5d50 Better permissions 2020-09-09 14:29:53 +03:00
alesapin
f5bef34be6 Fix configs for test_default_database_on_cluster 2020-09-09 14:28:59 +03:00
alesapin
150d8d4e79 Better recursive copy in integration tests 2020-09-09 14:11:59 +03:00
Artem Zuikov
36972d34a7
Fix logical error in GLOBAL JOIN with table function (#14545) 2020-09-09 13:03:13 +03:00
Winter Zhang
3d1d64ec60
Fix currentDatabase function cannot be used in ON CLUSTER ddl query. (#14211) 2020-09-09 12:58:59 +03:00
hcz
2ea59cb0c2 Fix tests 2020-09-09 17:54:41 +08:00
Anton Popov
32135d96f9
Merge pull request #12183 from CurtizJ/polymorphic-parts-2 
Support codecs in compact parts
 2020-09-09 12:34:13 +03:00
alesapin
485b104898 Use max ttl and add introspection to system parts about recompression 2020-09-09 12:15:42 +03:00
hcz
d8fce448a2 Implement null_as_default for JSONStrings formats 2020-09-09 15:47:32 +08:00
alesapin
a696cf12f6 Merge branch 'master' into recompression_in_background 2020-09-09 10:12:03 +03:00
alesapin
c34eaf5de3 Update ci_config and llvm 2020-09-09 10:08:38 +03:00
alesapin
b030cb650d
Merge pull request #14547 from ClickHouse/build_config_in_repo 
CI config in repo
 2020-09-09 10:05:37 +03:00
alesapin
9548d69792
Merge pull request #14581 from ClickHouse/fix_flaky_test_3 
Add retries to several integration tests
 2020-09-09 10:04:37 +03:00
bharatnc
f37814b367 Merge remote-tracking branch 'upstream/master' into ncb/zk-conn-fail-do-cleanup 2020-09-08 23:45:20 -07:00
bharatnc
48bf65d63d StorageReplicatedMergeTree - improve integration test 2020-09-08 23:45:04 -07:00
Winter Zhang
62ef728b2f
ISSUES-4006 try fix test failure 2020-09-09 10:52:14 +08:00
Anton Popov
032f4ba6f3
Merge pull request #14532 from CurtizJ/fix-redis-test 
Rework test for redis dictionary
 2020-09-09 02:38:09 +03:00
Azat Khuzhin
68c441e07b Add LIMIT BY format test 2020-09-09 01:37:15 +03:00
Azat Khuzhin
11ba7049c0 Cover WITH format 2020-09-09 01:37:15 +03:00
Azat Khuzhin
0324770773 Remove all trailing whitespaces in tests 
sed -r -i \
    -e 's/SELECT $/SELECT/' \
    -e 's/SELECT DISTINCT $/SELECT DISTINCT/' \
    -e 's/WITH $/WITH/' \ # zero matches, new test will be added
    -e 's/ARRAY JOIN $/ARRAY JOIN/' \
    -e 's/GROUP BY $/GROUP BY/' \
    -e 's/ORDER BY $/ORDER BY/' \
    -e 's/LIMIT ([0-9]+) BY $/LIMIT \1 BY/' \ # zero matches, new test will be added
    tests/queries/*/*.sql \
    tests/queries/*/*.reference

(With except for tests/queries/0_stateless/00751_default_databasename_for_view.reference)
 2020-09-09 01:36:58 +03:00
Azat Khuzhin
4f1321daef Make 00443_merge_tree_uniform_read_distribution_0.reference real file (was symlink) 2020-09-09 01:36:21 +03:00
alexey-milovidov
1e300d9119
Merge pull request #14562 from CurtizJ/fix-fuzz 
Fix segfault in combinator -Resample
 2020-09-08 23:53:14 +03:00
Anton Popov
53572b3783 add gitkeep 2020-09-08 19:37:16 +03:00
Anton Popov
a419267dc6 minor fixes 2020-09-08 19:28:49 +03:00
alesapin
88d569b6a6 Add ASTFuzzer to checks list 2020-09-08 16:31:59 +03:00
Alexey Milovidov
74bd12284e Fix typo 2020-09-08 16:13:49 +03:00
Alexey Milovidov
cfcdcce484 Merge branch 'Custom-null-representation-in-TCV' of https://github.com/Avogar/ClickHouse into Avogar-Custom-null-representation-in-TCV 2020-09-08 16:08:17 +03:00
Kruglov Pavel
23a5a78873
Fix tests 2020-09-08 16:07:58 +03:00
Alexey Milovidov
b4401e8298 Merge branch 'Custom-null-representation-in-TCV' of https://github.com/Avogar/ClickHouse into Avogar-Custom-null-representation-in-TCV 2020-09-08 16:06:34 +03:00
Avogar
5d303573c7 Add tests 2020-09-08 16:06:05 +03:00
alesapin
f0f7f2b5d2 Merge branch 'master' into recompression_in_background 2020-09-08 15:43:37 +03:00
alesapin
6ad91d1018
Merge pull request #14490 from ClickHouse/control_ttl_merges_in_pool 
Control ttl merges in pool
 2020-09-08 15:42:20 +03:00
Ilya Yatsishin
37236e5923
Merge pull request #14553 from ClickHouse/fix-flacky-test-11 
Handle host/network is unreachable in integration tests
 2020-09-08 14:45:00 +03:00
alesapin
6e591d5dea Better retries 2020-09-08 14:20:35 +03:00
Nikita Mikhaylov
80f193f615
Merge pull request #14252 from bharatnc/ncb/time-query-log-in-ms 
add query_start_time_microseconds field to system.query_log & system.query_thread_log tables
 2020-09-08 15:11:50 +04:00
alesapin
cdfca04b42 Missed break 2020-09-08 14:07:41 +03:00
alesapin
43c17ff79e Add retries to test 2020-09-08 14:02:44 +03:00
alesapin
30827dec70 Add special build config 2020-09-08 11:20:41 +03:00
Nikolai Kochetov
c3eeb8f71e
Merge pull request #14412 from ClickHouse/pipes-and-creating-sets 
Pipes and creating sets
 2020-09-08 10:47:56 +03:00
Nikolai Kochetov
d771ce5609
Merge pull request #14500 from ClickHouse/many-rows-in-totals 
Many rows in totals
 2020-09-08 10:40:14 +03:00
alesapin
4364bff3bc
Merge pull request #12761 from kssenii/rabbitmq-improvements 
RabbitMQ improvements
 2020-09-08 09:38:25 +03:00
bharatnc
806334a642 StorageReplicatedMergeTree - add integration tests that test dir cleanup 
This adds a integration test that tests if table directory is cleaned
up after a ZooKeeper connection failure for ReplicatedMergeTree tables.
 2020-09-07 22:32:01 -07:00
Winter Zhang
18b4c5997d
Merge branch 'master' into fix/datetime 2020-09-08 11:32:48 +08:00
zhang2014
a150b1345b ISSUES-4006 add integration test 2020-09-08 11:29:18 +08:00
Anton Popov
ee218c354e fix segfault in combinator -Resample 2020-09-08 02:21:12 +03:00
zhang2014
05bd0b7c28 ISSUES-4006 add integration test 2020-09-08 02:36:28 +08:00
Nikolai Kochetov
73de00f4df Review fix. 2020-09-07 20:49:23 +03:00
Nikita Mikhaylov
5d9367aea4
Merge pull request #14411 from nikitamikhaylov/rank-corr 
Merging #11769 (Rank Correlation Spearman)
 2020-09-07 21:18:19 +04:00
alexey-milovidov
e1104135c8
Merge pull request #13939 from fastio/master 
Multithreading implementation of Kafka engine
 2020-09-07 20:12:06 +03:00
Alexey Milovidov
829049de2f Handle host/network is unreachable in integration tests 2020-09-07 19:43:35 +03:00
alesapin
105f704efe Back to gcc-9 2020-09-07 19:20:00 +03:00
Alexey Milovidov
661d9bdb4c Skip test 2020-09-07 19:03:36 +03:00
kssenii
40c8290dde Tiny fixes, better tests 2020-09-07 14:48:50 +00:00
alesapin
7b8f8acd38 Bump all versions to gcc-10 2020-09-07 17:47:14 +03:00
alesapin
54e6257070 Better name 2020-09-07 17:23:20 +03:00
alesapin
df8dde109c Remove tests config 2020-09-07 16:40:16 +03:00
alesapin
f8932a7a6b Build and tests config 2020-09-07 16:40:03 +03:00
alesapin
45496beacf Merge branch 'master' into build_config_in_repo 2020-09-07 15:51:14 +03:00
alesapin
acbe21304a Fix test for compact parts 2020-09-07 14:46:32 +03:00
Anton Popov
9493532fdb rework test for redis dictionary 2020-09-07 14:16:47 +03:00
alesapin
17650e803f Tiny improvements 2020-09-07 14:08:53 +03:00
Alexey Milovidov
99ebab706c Fix "Arcadia" 2020-09-07 12:02:47 +03:00
alesapin
4ce975c512 Merge branch 'master' into kssenii-rabbitmq-improvements 2020-09-07 11:36:08 +03:00
alesapin
9703494f32 Less debug prints 2020-09-07 11:25:14 +03:00
Amos Bird
4c3c1cdaf3
Fix Nullable String to Enum conversion. 2020-09-07 15:32:44 +08:00
alesapin
ba70de63f8 Fix diff 2020-09-07 10:28:04 +03:00
Alexey Milovidov
04a6965006 Fix error with executable dictionary source 2020-09-07 09:40:01 +03:00
Alexander Kuzmenkov
0904433c87 Temporarily remove UInt256 perf test broken in https://github.com/ClickHouse/ClickHouse/pull/14229 
Also add one more timeout to perf test runner.
 2020-09-07 09:33:57 +03:00
alesapin
7f301eab63 Merge branch 'master' into recompression_in_background 2020-09-07 09:31:16 +03:00
alexey-milovidov
ff2d9aec1a
Merge pull request #14409 from dimarub2000/obfuscator_uuid 
Added UUID to Obfuscator
 2020-09-07 06:58:41 +03:00
alexey-milovidov
8b0a6d5609
Merge pull request #14404 from dimarub2000/system_events_show_zero_values 
system_events_show_zero_values setting added
 2020-09-07 06:40:36 +03:00
hexiaoting
a3671a15f6 Add new feature: SHOW DATABASES LIKE 2020-09-07 10:54:59 +08:00
bharatnc
fd22450a2a Merge remote-tracking branch 'upstream/master' into ncb/time-query-log-in-ms 2020-09-06 13:19:27 -07:00
Dmitry
7ca155c417 test added 2020-09-06 19:44:12 +03:00
bharatnc
ec0d0243cc MetricLog - add tests for event_time_microseconds field 2020-09-06 08:31:27 -07:00
bharatnc
6a5b885ac1 AsynchronousMetricLog - add tests for event_time_microseconds column 2020-09-06 08:31:27 -07:00
Peng Jian
77420c82ea Add test case for Kafka engine with kafka_thread_per_consumer enabled. 2020-09-06 11:17:19 +08:00
Dmitry
5aa9dc0e86 show transform in test 2020-09-06 00:42:38 +03:00
Dmitry
ace61fa67e Uint128 logic and tests 2020-09-06 00:35:24 +03:00
alexey-milovidov
69630972d4
Merge pull request #14509 from bharatnc/ncb/disallow-empty-tz-toStartOfIntervalFunc 
disallow empty time_zone argument in toStartOf* type of functions
 2020-09-05 17:41:53 +03:00
Anton Popov
30a867e387 Merge remote-tracking branch 'upstream/master' into HEAD 2020-09-05 17:00:14 +03:00
bharatnc
d543b82100 fix 00921_dateteime_compatibility test 2020-09-04 21:26:41 -07:00
alexey-milovidov
c4861155f7
Merge pull request #14498 from ClickHouse/add_retries_to_host_ip_change 
Add retries to integration test_host_ip_change
 2020-09-05 07:03:34 +03:00
bharatnc
25080f3a88 additional checks for empty tz for toStartOfMonth|Quarter|Year 2020-09-04 20:15:37 -07:00
bharatnc
8fd00ff77b rename test files and fix tests - add ; at the end 2020-09-04 18:42:43 -07:00
alexey-milovidov
03f11d851f
Merge pull request #14501 from CurtizJ/fix-ttl-test 
Fix flaky test 01280_ttl_where_group_by
 2020-09-05 04:26:09 +03:00
bharatnc
0fd9288374 add tests for - toStartOfInterval* functions 2020-09-04 17:32:38 -07:00
Nikolai Kochetov
499405504f Merge branch 'master' into pipes-and-creating-sets 2020-09-04 23:41:20 +03:00
Anton Popov
af69c4208c fix flaky test 2020-09-04 22:16:30 +03:00
Vitaly Baranov
81db73f066
Merge pull request #13647 from qoega/integration-explicit-configs 
Add explicit main_configs, user_configs and dictionaries in integration tests
 2020-09-04 20:16:00 +03:00
bharatnc
0c1a65ddf2 tests query_start_time_microseconds for system.query_thread_log 2020-09-04 09:42:18 -07:00
bharatnc
89eebdfde4 fix tests 2020-09-04 09:42:18 -07:00
bharatnc
774bae722b add tests 2020-09-04 09:42:18 -07:00
Nikolai Kochetov
35bf64471f Added test 2020-09-04 19:32:51 +03:00
alesapin
3095c167ea Add retries 2020-09-04 18:22:43 +03:00
Anton Popov
f1cf03f1bb Merge remote-tracking branch 'upstream/master' into HEAD 2020-09-04 17:40:22 +03:00
Nikita Mikhaylov
d718c5af99 fixed 2020-09-04 17:36:08 +03:00
alesapin
de911aaabe Merge branch 'master' into recompression_in_background 2020-09-04 17:21:27 +03:00
alesapin
21de2f54f6 Fix tests 2020-09-04 17:13:57 +03:00
Artem Zuikov
7c20aa2c62
Another 256-bit integers (strict 32 bytes) (#14229) 2020-09-04 16:33:02 +03:00
Anton Popov
68913eab62 better reading from compact parts with differents codecs 2020-09-04 15:48:55 +03:00
alesapin
f8aa6cfe8a
Merge pull request #14438 from ClickHouse/apply_ttl_if_not_calculated 
Apply TTL if it's not calculated for part
 2020-09-04 15:32:50 +03:00
Nikolai Kochetov
40768593c3
Merge pull request #14469 from BohuTANG/mysql_set_@@var 
Support MySQL handler 'set @@xx' settting
 2020-09-04 14:18:57 +03:00
alesapin
4079636f81 Merge 2020-09-04 13:52:51 +03:00
alesapin
82c56349a5 Some comments 2020-09-04 13:08:09 +03:00
Nikolai Kochetov
7a03dbaa2f Added test. 2020-09-04 12:11:37 +03:00
alesapin
c96a2b4f22
Merge pull request #14444 from ClickHouse/fix_select_parts_for_merge 
Fix select parts for merge
 2020-09-04 09:55:48 +03:00
alexey-milovidov
54ede2e1bb
Merge pull request #14467 from ClickHouse/topk-check-overflow 
Check for array size overflow in topK
 2020-09-04 09:15:33 +03:00
BohuTANG
c094ff7eca ISSUES-9336 support MySQL handler 'set @@xx' settting 2020-09-04 12:51:15 +08:00
Alexey Milovidov
1cee6d5a31 Check for array size overflow in topK #14452 2020-09-04 04:05:57 +03:00
Alexey Milovidov
0e53cd26a0 Simplify tests for mutations 2020-09-04 02:28:44 +03:00
Alexey Milovidov
40ad23245c Fix flaky test 00944_clear_index_in_partition 2020-09-04 02:12:30 +03:00
alexey-milovidov
4f9df21d3e
Merge pull request #10373 from azat/dist-SELECT-optimization 
Optimize queries with LIMIT/LIMIT BY/ORDER BY for distributed with GROUP BY sharding_key
 2020-09-04 01:38:56 +03:00
Nikita Mikhaylov
9fef663caa add test 2020-09-03 21:06:30 +03:00
Ilya Yatsishin
5ada30df96
Merge branch 'master' into integration-explicit-configs 2020-09-03 20:43:01 +03:00
nikitamikhaylov
b7a2d9b176 fast test 2020-09-03 19:04:08 +03:00
Anton Popov
98011f6fc3 Merge remote-tracking branch 'upstream/master' into HEAD 2020-09-03 17:53:05 +03:00
Kseniia Sumarokova
4b7c303eaf
Merge branch 'master' into rabbitmq-improvements 2020-09-03 17:26:04 +03:00
alesapin
e48e4309b2 Better names 2020-09-03 16:29:18 +03:00
alesapin
5ccf78ccff Simplier test 2020-09-03 16:08:45 +03:00
alesapin
565555e55c Fix bug in parts selection 2020-09-03 16:04:28 +03:00
alesapin
4519b4308c Fix default tag for base image 2020-09-03 16:03:26 +03:00
Yatsishin Ilya
216436a221 mysql fix 2020-09-03 13:27:44 +03:00
Yatsishin Ilya
a4f0267709 pass katest if no DOCKER_BASE_TAG in env 2020-09-03 13:20:15 +03:00
Yatsishin Ilya
53cc50ae0a fix test_dictionaries_ddl 2020-09-03 12:55:07 +03:00
alesapin
aa47d0aabc Merge branch 'apply_ttl_if_not_calculated' into recompression_in_background 2020-09-03 12:07:03 +03:00
alesapin
acc0ee0657 Apply TTL if it's not calculated for part 2020-09-03 11:59:41 +03:00
Yatsishin Ilya
fc075e65da Merge remote-tracking branch 'origin' into integration-explicit-configs 2020-09-03 11:49:48 +03:00
Ilya Yatsishin
2b8ad576cc
Merge pull request #14323 from qoega/try-dns-fix 
Add tag pass for integration base image. Add explicit dns options for docker-compose.
 2020-09-03 11:27:24 +03:00
alesapin
672f239f5b Add settings to test 2020-09-03 10:34:53 +03:00
alexey-milovidov
9e4aa5954e
Update 00184_shard_distributed_group_by_no_merge.sql 2020-09-03 04:46:45 +03:00
alexey-milovidov
06edd217db
Update 01247_optimize_distributed_group_by_sharding_key.sql 2020-09-03 04:46:12 +03:00
alexey-milovidov
722e1bb81f
Update 01247_optimize_distributed_group_by_sharding_key_dist_on_dist.sql 2020-09-03 04:45:36 +03:00
alexey-milovidov
1c2435d4f7
Merge pull request #14233 from amosbird/apply 
Introduce columns transformers.
 2020-09-03 01:37:40 +03:00
alexey-milovidov
72417d2716
Merge pull request #14368 from BohuTANG/materialize_mysql_query_filter_1 
change string.rfind to string starts_with and add some tests
 2020-09-03 01:09:53 +03:00
Azat Khuzhin
5e71fe3f39 Add a test for distributed_group_by_no_merge=2 2020-09-03 00:54:11 +03:00
Azat Khuzhin
10b4f3b41f Optimize queries with LIMIT/LIMIT BY/ORDER BY for distributed with GROUP BY sharding_key 
Previous set of QueryProcessingStage does not allow to do this.
But after WithMergeableStateAfterAggregation had been introduced the
following queries can be optimized too under
optimize_distributed_group_by_sharding_key:
- GROUP BY sharding_key LIMIT
- GROUP BY sharding_key LIMIT BY
- GROUP BY sharding_key ORDER BY

And right now it is still not supports:
- WITH TOTALS (looks like it can be supported)
- WITH ROLLUP (looks like it can be supported)
- WITH CUBE
- SETTINGS extremes=1 (looks like it can be supported)
But will be implemented separatelly.

vX: fixes
v2: fix WITH *
v3: fix extremes
v4: fix LIMIT OFFSET (and make a little bit cleaner)
v5: fix HAVING
v6: fix ORDER BY
v7: rebase against 20.7
v8: move out WithMergeableStateAfterAggregation
v9: add optimize_distributed_group_by_sharding_key into test names
 2020-09-03 00:52:51 +03:00
alesapin
dcbddbb8d0 Add recompression ttls tests and fix bugs 2020-09-02 19:15:41 +03:00
Ilya Yatsishin
a5e9449bc3
Merge branch 'master' into try-dns-fix 2020-09-02 19:01:30 +03:00
Yatsishin Ilya
c2ab85f214 Split tag part from image 2020-09-02 17:36:25 +03:00
Yatsishin Ilya
fda89095cc Split tag part from image 2020-09-02 17:22:54 +03:00
alexey-milovidov
8e2fba5be1
Merge pull request #12567 from amosbird/fmi 
table function view
 2020-09-02 17:07:57 +03:00