Commit Graph

3194 Commits

Author SHA1 Message Date
Amos Bird
4770175aa3
more tests 2020-09-15 10:02:26 +08:00
Vitaly Baranov
0f53b449fd Add 'params' column to system.user_directories table. 2020-09-15 01:51:53 +03:00
Azat Khuzhin
0159c74f21 Secure inter-cluster query execution (with initial_user as current query user) [v3]
Add inter-server cluster secret, it is used for Distributed queries
inside cluster, you can configure in the configuration file:

  <remote_servers>
      <logs>
          <shard>
              <secret>foobar</secret> <!-- empty -- works as before -->
              ...
          </shard>
      </logs>
  </remote_servers>

And this will allow clickhouse to make sure that the query was not
faked, and was issued from the node that knows the secret. And since
trust appeared it can use initial_user for query execution, this will
apply correct *_for_user (since with inter-server secret enabled, the
query will be executed from the same user on the shards as on initator,
unlike "default" user w/o it).

v2: Change user to the initial_user for Distributed queries if secret match
v3: Add Protocol::Cluster package
v4: Drop Protocol::Cluster and use plain Protocol::Hello + user marker
v5: Do not use user from Hello for cluster-secure (superfluous)
2020-09-15 01:36:28 +03:00
Azat Khuzhin
2fce2b21a8 Use pytest.raises(match=) in test_allowed_client_hosts
Since pytest.raises() produces excinfo not exception, hence at least
str(excinfo.value) should be used to match the exception message.
2020-09-15 01:36:28 +03:00
Azat Khuzhin
65e48663e7 Drop policy on start in 01308_row_policy_and_trivial_count_query 2020-09-15 01:36:22 +03:00
Alexander Tokmakov
da6beb1a91 Merge branch 'master' into enable_some_tests_with_database_atomic 2020-09-14 23:00:14 +03:00
alesapin
58f4e5f967
Merge pull request #14755 from vitlibar/fix-permission-denied-in-integration-tests
Fix access denied on opening file /var/lib/clickhouse/status in integration tests.
2020-09-14 22:08:21 +03:00
Nikolai Kochetov
d418ee48a4
Merge pull request #14783 from amosbird/fix3
Fix signedness conversion monotonicity
2020-09-14 21:40:51 +03:00
Alexander Kuzmenkov
9e3797b252
Merge pull request #14710 from ClickHouse/aku/faster-perf
Do less runs in perf test
2020-09-14 19:17:34 +03:00
Ildus Kurbangaliev
67b49862d9
Add mapPopulateSeries function (#13166) 2020-09-14 19:11:50 +03:00
Vitaly Baranov
cae5a23a43
Merge pull request #13837 from vitlibar/add-user-directories-section-to-default-config
Add the section <user_directories> to the default config.
2020-09-14 16:47:32 +03:00
alexey-milovidov
752e3f8197
Merge pull request #14453 from amosbird/apply2
column transformers in insert select
2020-09-14 16:46:01 +03:00
Artem Zuikov
d274125c74
Fix wide integer left shift + refactoring (#14697) 2020-09-14 14:56:43 +03:00
Amos Bird
5998570762
Fix signedness conversion monotonicity 2020-09-14 18:12:41 +08:00
Amos Bird
654245af3c
Fix signedness conversion monotonicity 2020-09-14 18:11:40 +08:00
Alexander Kuzmenkov
3113aa6cfe Avoid extra error in perf report on broken queries 2020-09-14 10:59:45 +03:00
Alexander Kuzmenkov
c701a15271 fixup 2020-09-14 10:27:46 +03:00
alesapin
0c04f4d008
Update cluster.py 2020-09-14 10:01:20 +03:00
alesapin
336430d3c2
Merge pull request #14646 from ClickHouse/if_bug
Fix bug in if function when then clause contain const nullable column
2020-09-14 09:51:40 +03:00
Nikolai Kochetov
109fd9d6d7
Merge pull request #13015 from amosbird/jgmko
Refactor joinGet and implement multi-key lookup.
2020-09-13 22:39:48 +03:00
Amos Bird
34b9547ce1
Binary operator monotonicity 2020-09-13 21:55:12 +08:00
Amos Bird
016f707ea1
column transformers in insert select 2020-09-13 10:21:13 +08:00
Vitaly Baranov
421eeeccef Add the section user_directories to the default config. 2020-09-12 23:04:28 +03:00
alesapin
8242a94880
Update ci_config.json 2020-09-12 15:42:07 +03:00
alexey-milovidov
c2f762e20a
Merge pull request #14748 from vitlibar/skip-access-storages-with-same-path
Skip access storages with same path while reading the main config.
2020-09-12 14:20:02 +03:00
alesapin
ecbcbad0d9 Fix flaky test 2020-09-12 10:07:08 +03:00
alesapin
2c6567eb88
Merge pull request #14745 from kssenii/fix-rabbit-tests-crash
Fix crashes in RabbitMQ tests
2020-09-12 09:53:14 +03:00
Vitaly Baranov
1e849f2975 Fix permission denied on opening file /var/lib/clickhouse/status in integration tests. 2020-09-12 03:18:18 +03:00
Vitaly Baranov
e2c2a679ef Skip access storages with same path while reading the main config. 2020-09-12 01:34:46 +03:00
Nikita Mikhaylov
fcad11e48f
Merge pull request #14746 from nikitamikhaylov/arcadia-fix
Disable test in Arcadia
2020-09-11 22:56:21 +04:00
alesapin
36019596c1 Disable flaky test 2020-09-11 20:08:23 +03:00
alesapin
2c4047b280 Revert accident changes 2020-09-11 20:07:00 +03:00
alesapin
c0dafb0283 Disable test 2020-09-11 20:04:55 +03:00
alesapin
a4c43e51b9 Add a test 2020-09-11 20:04:55 +03:00
nikitamikhaylov
b96da75ead done 2020-09-11 19:44:14 +03:00
kssenii
31dbfd07e2 remove tests crash reason 2020-09-11 16:16:24 +00:00
alesapin
d9394fbf66 Fix code 2020-09-11 18:51:08 +03:00
Nikita Mikhaylov
26742a3c81
Merge pull request #14703 from nikitamikhaylov/format-line-as-string
Merging #13846 (Format LineAsString)
2020-09-11 16:45:57 +04:00
Nikita Mikhaylov
468089a4cd
Merge pull request #14514 from bharatnc/ncb/event_time_microseconds_metric_logs
add event_time_microseconds field to asynchronous_metric_log & metric_log system tables
2020-09-11 16:14:00 +04:00
alesapin
c202ce8e63 Merge branch 'master' into update_to_gcc_10 2020-09-11 12:50:10 +03:00
alexey-milovidov
e73ca17ad3
Merge pull request #14725 from BooBSD/formatReadableQuantity
formatReadableQuantity() function
2020-09-11 12:09:18 +03:00
Alexander Kuzmenkov
d227f1f706
Merge pull request #13192 from ClickHouse/aku/semicolon-simple
Simpler version of semicolon-terminated VALUES #12999 w/o `pos` changes
2020-09-11 11:51:52 +03:00
alesapin
902624cb7b Merge branch 'master' into if_bug 2020-09-11 10:54:32 +03:00
alexey-milovidov
87b3984d17
Merge pull request #14713 from ClickHouse/add-test-with-crahs-in-array-join
Added test from #13829
2020-09-10 23:57:02 +03:00
Artem Hnilov
bbe379d58e 00534_filimonov.data was updated 2020-09-10 17:06:32 +00:00
Artem Hnilov
142026f4ab 01492_format_readable_quantity test added 2020-09-10 16:54:52 +00:00
nikitamikhaylov
6e0d2a427c add another test 2020-09-10 19:30:11 +03:00
tavplubix
4581e3a18a
Merge pull request #14563 from bharatnc/ncb/zk-conn-fail-do-cleanup
ReplicatedMergeTree - cleanup data directory after Zookeeper exceptions
2020-09-10 19:19:57 +03:00
Nikolai Kochetov
964c18241c Added test from #13829 2020-09-10 19:04:53 +03:00
bharatnc
397ebdb855 remove sleep from unit test 2020-09-10 08:55:39 -07:00
Nikita Mikhaylov
a39ba57e8c
Merge branch 'master' into dev-nf 2020-09-10 18:10:47 +04:00
Nikita Mikhaylov
f0a65522cc
Merge pull request #14333 from hczhcz/patch-0901
Add JSONStrings formats
2020-09-10 17:54:42 +04:00
Alexander Tokmakov
20b3823770 do not remove directory on attach 2020-09-10 13:21:13 +03:00
bharatnc
31b0bd481c Integration tests - more accurate tests 2020-09-10 00:35:25 -07:00
alexey-milovidov
92b746116a
Merge pull request #14655 from ClickHouse/nested-multiline-comments
Support for nested multiline comments
2020-09-10 06:10:31 +03:00
bharatnc
05a80518a1 Merge remote-tracking branch 'upstream/master' into ncb/event_time_microseconds_metric_logs 2020-09-09 17:58:29 -07:00
bharatnc
2ad63d2b4d AsynchronousMetricLog - refactor integration test 2020-09-09 17:56:21 -07:00
bharatnc
0a3f7d0fcc AsynchronousMetricsLog - add improved tests
This adds integration tests to test the asynchronous_metric_log table
for event_time_microseconds field.

Asynchronous metrics are updated once every 60s, so this setting needs
to be overridden for having those metrics available in time so that the
tests can run. So the `asynchronous_metric_update_period_s` setting is
being overriden to be 2s.
2020-09-09 17:50:39 -07:00
Nikita Mikhaylov
44726c37c3
Merge branch 'master' into fix-executable-dictionary-source-hangup 2020-09-09 23:01:41 +04:00
Alexey Milovidov
7304bad56f Support for nested multiline comments 2020-09-09 20:51:05 +03:00
Alexander Tokmakov
dee1fefeb4 add more tests 2020-09-09 20:39:49 +03:00
alesapin
62428845a0 Bug in mutation 2020-09-09 19:47:06 +03:00
alesapin
cdb72add35
Merge pull request #14619 from ClickHouse/better_copy_dir
Better recursive database copy in integration tests
2020-09-09 19:38:55 +03:00
bharatnc
fe6d6f16ea Merge remote-tracking branch 'upstream/master' into ncb/zk-conn-fail-do-cleanup 2020-09-09 09:25:34 -07:00
bharatnc
d1d3af7501 StorageReplicatedMergeTree - more improvements to integration test 2020-09-09 09:24:18 -07:00
alexey-milovidov
38131917ef
Merge pull request #14530 from amosbird/ma
Fix Nullable String to Enum conversion.
2020-09-09 19:24:04 +03:00
Alexander Tokmakov
7f4106687c fix 2020-09-09 19:23:31 +03:00
alexey-milovidov
c6d0944994
Merge pull request #14591 from myrrc/bugfix/lc-nullability-checker
Correct nullability checker for LowCardinality nested columns
2020-09-09 19:23:19 +03:00
alexey-milovidov
a6a0d4966c
Merge pull request #14595 from azat/query-format-trailing-whitespace
Fix some trailing whitespaces in query format (ExpressionList users)
2020-09-09 19:22:55 +03:00
alesapin
bd14c79b0b
Merge pull request #14494 from ClickHouse/recompression_in_background
Recompression TTL
2020-09-09 17:46:01 +03:00
Alexander Tokmakov
b68782d285 enable more tests with Atomic database 2020-09-09 16:32:50 +03:00
Artem Zuikov
48f29ae11f
Fix bug in Decimal scale (#14603) 2020-09-09 16:18:58 +03:00
myrrc
a8f5d9e70f added the test and comment 2020-09-09 15:52:44 +03:00
Vasily Nemkov
3973a17530
MySql datatypes dateTime64 and decimal (#11512) 2020-09-09 15:18:02 +03:00
alesapin
98f19a5d50 Better permissions 2020-09-09 14:29:53 +03:00
alesapin
f5bef34be6 Fix configs for test_default_database_on_cluster 2020-09-09 14:28:59 +03:00
alesapin
150d8d4e79 Better recursive copy in integration tests 2020-09-09 14:11:59 +03:00
Artem Zuikov
36972d34a7
Fix logical error in GLOBAL JOIN with table function (#14545) 2020-09-09 13:03:13 +03:00
Winter Zhang
3d1d64ec60
Fix currentDatabase function cannot be used in ON CLUSTER ddl query. (#14211) 2020-09-09 12:58:59 +03:00
hcz
2ea59cb0c2 Fix tests 2020-09-09 17:54:41 +08:00
Anton Popov
32135d96f9
Merge pull request #12183 from CurtizJ/polymorphic-parts-2
Support codecs in compact parts
2020-09-09 12:34:13 +03:00
alesapin
485b104898 Use max ttl and add introspection to system parts about recompression 2020-09-09 12:15:42 +03:00
hcz
d8fce448a2 Implement null_as_default for JSONStrings formats 2020-09-09 15:47:32 +08:00
alesapin
a696cf12f6 Merge branch 'master' into recompression_in_background 2020-09-09 10:12:03 +03:00
alesapin
c34eaf5de3 Update ci_config and llvm 2020-09-09 10:08:38 +03:00
alesapin
b030cb650d
Merge pull request #14547 from ClickHouse/build_config_in_repo
CI config in repo
2020-09-09 10:05:37 +03:00
alesapin
9548d69792
Merge pull request #14581 from ClickHouse/fix_flaky_test_3
Add retries to several integration tests
2020-09-09 10:04:37 +03:00
bharatnc
f37814b367 Merge remote-tracking branch 'upstream/master' into ncb/zk-conn-fail-do-cleanup 2020-09-08 23:45:20 -07:00
bharatnc
48bf65d63d StorageReplicatedMergeTree - improve integration test 2020-09-08 23:45:04 -07:00
Anton Popov
032f4ba6f3
Merge pull request #14532 from CurtizJ/fix-redis-test
Rework test for redis dictionary
2020-09-09 02:38:09 +03:00
Azat Khuzhin
68c441e07b Add LIMIT BY format test 2020-09-09 01:37:15 +03:00
Azat Khuzhin
11ba7049c0 Cover WITH format 2020-09-09 01:37:15 +03:00
Azat Khuzhin
0324770773 Remove all trailing whitespaces in tests
sed -r -i \
    -e 's/SELECT $/SELECT/' \
    -e 's/SELECT DISTINCT $/SELECT DISTINCT/' \
    -e 's/WITH $/WITH/' \ # zero matches, new test will be added
    -e 's/ARRAY JOIN $/ARRAY JOIN/' \
    -e 's/GROUP BY $/GROUP BY/' \
    -e 's/ORDER BY $/ORDER BY/' \
    -e 's/LIMIT ([0-9]+) BY $/LIMIT \1 BY/' \ # zero matches, new test will be added
    tests/queries/*/*.sql \
    tests/queries/*/*.reference

(With except for tests/queries/0_stateless/00751_default_databasename_for_view.reference)
2020-09-09 01:36:58 +03:00
Azat Khuzhin
4f1321daef Make 00443_merge_tree_uniform_read_distribution_0.reference real file (was symlink) 2020-09-09 01:36:21 +03:00
alexey-milovidov
1e300d9119
Merge pull request #14562 from CurtizJ/fix-fuzz
Fix segfault in combinator -Resample
2020-09-08 23:53:14 +03:00
Anton Popov
53572b3783 add gitkeep 2020-09-08 19:37:16 +03:00
Anton Popov
a419267dc6 minor fixes 2020-09-08 19:28:49 +03:00
alesapin
88d569b6a6 Add ASTFuzzer to checks list 2020-09-08 16:31:59 +03:00
Alexey Milovidov
74bd12284e Fix typo 2020-09-08 16:13:49 +03:00
Alexey Milovidov
cfcdcce484 Merge branch 'Custom-null-representation-in-TCV' of https://github.com/Avogar/ClickHouse into Avogar-Custom-null-representation-in-TCV 2020-09-08 16:08:17 +03:00