Commit Graph

1935 Commits

Author SHA1 Message Date
alexey-milovidov
988b20a32c
Merge pull request #14684 from azat/parallel-distributed_ddl
Allow parallel execution of distributed DDL
2020-09-18 22:18:17 +03:00
Pavel Kovalenko
1fc3aa3ea8 Fixed test_disabled_ttl_move_on_insert test 2020-09-18 22:10:49 +03:00
Pavel Kovalenko
77be35a2b8 Fixed test_disabled_ttl_move_on_insert test 2020-09-18 21:59:56 +03:00
Amos Bird
d842cb704f
Allow mutations to work with key constraints. 2020-09-19 02:40:02 +08:00
Alexander Tokmakov
1ca9a92b21 Merge branch 'master' into write_structure_of_table_functions 2020-09-18 21:09:23 +03:00
Pavel Kovalenko
da04a130ed Add option to disable ttl move on data part insert - minor fixes. 2020-09-18 20:45:30 +03:00
Pavel Kovalenko
0da19ab46d Add option to disable ttl move on data part insert 2020-09-18 18:30:00 +03:00
Anton Popov
d1e90e0e4b fix tests 2020-09-18 03:05:51 +03:00
Alexander Tokmakov
41e99cf261 Merge branch 'master' into allow_atomic_database_inside_materialize_mysql 2020-09-17 20:28:50 +03:00
zhang2014
64032e22a2 Merge branch 'master' into fix/datetime 2020-09-18 00:28:09 +08:00
Vitaly Baranov
3356d75b23
Merge pull request #13156 from azat/cluster-secure
Secure inter-cluster query execution (with initial_user as current query user) [v3]
2020-09-17 17:11:00 +03:00
Ilya Golshtein
624a4c4d55 kdc Dockerfile integrated 2020-09-17 16:51:34 +03:00
Ilya Golshtein
1862f58cf5 forgotten empty clickhouse_path dir 2020-09-17 16:51:34 +03:00
Ilya Golshtein
75836acddc code review changes 2020-09-17 16:51:34 +03:00
Ilya Golshtein
bcdb2277bd distutils=>shutil 2020-09-17 16:51:34 +03:00
Ilya Golshtein
23853cc8cf fix conflict resolution mistake 2020-09-17 16:51:34 +03:00
Ilya Golshtein
96c2a7c77e kerberized kafka test works after merge 2020-09-17 16:51:34 +03:00
Ilya Golshtein
1808a1e36c short krb ticket lifetime, Dockerile renamed 2020-09-17 16:51:34 +03:00
Ilya Golshtein
c227f91636 remove_files improved, proper docker images, tiny cleanup 2020-09-17 16:51:34 +03:00
Ilya Golshtein
a2e72ec37a test via runner is Ok, switched to custom images 2020-09-17 16:51:34 +03:00
Ilya Golshtein
2d5c31d588 test_storage_kerberized_kafka cleanup + negative test 2020-09-17 16:51:34 +03:00
Ilya Golshtein
c12fa26fe3 kerberized kafka test works 2020-09-17 16:51:34 +03:00
alexey-milovidov
2886b38c03
Merge branch 'master' into fix_test_distributed_over_live_view2 2020-09-17 13:06:39 +03:00
Nikolai Kochetov
339521fadb
Update test.py 2020-09-17 11:48:27 +03:00
sundy-li
544b2cb20d add configChanged method for zookeeper
fix logic error && skip reload testkeeper
2020-09-17 13:33:45 +08:00
Vitaliy Zakaznikov
bf9feb6865 Removing usage of time.sleep in tests/integration/test_distributed_over_live_view/test.py 2020-09-16 22:07:58 -04:00
Anton Popov
8e9828d2ff Merge remote-tracking branch 'upstream/master' into HEAD 2020-09-16 21:07:35 +03:00
alexey-milovidov
84b210f93e
Merge pull request #14864 from bharatnc/ncb/format-integration-tests
Format and cleanup imports form all *.py integration test files
2020-09-16 20:40:57 +03:00
alesapin
e173658422 Fix integration test 2020-09-16 19:53:58 +03:00
alesapin
d9057eb2c1
Merge pull request #14855 from ClickHouse/fix_flaky_test_6
Flaky tests fixes
2020-09-16 09:47:51 +03:00
bharatnc
b75963d370 Format and optimize imports in integration test files
This PR formats all the `*.py` files found under the `tests/integration`
folder. It also reorders the imports and cleans up a bunch of unused
imports.

The formatting also takes care of other things like wrapping lines and
fixing spaces and indents such that the tests look more readable.
2020-09-15 23:10:54 -07:00
alexey-milovidov
7fb0291c09
Merge pull request #14854 from zhang2014/fix/ISSUES-14809
ISSUES-14809 fix MaterializeMySQL empty transaction unstable test case
2020-09-16 00:44:51 +03:00
alesapin
3b34345abb Less flaky tests 2020-09-15 18:42:46 +03:00
Vitaly Baranov
74d5b43fe6
Merge pull request #14828 from vitlibar/change-columns-of-system-user-directories
Add 'params' column to system.user_directories table.
2020-09-15 18:25:50 +03:00
alesapin
6130cd7365 More stable test_no_ttl_merges_in_busy_pool 2020-09-15 17:53:55 +03:00
zhang2014
1c659de8b1 ISSUES-14809 fix MaterializeMySQL empty transaction test failure 2020-09-15 22:44:18 +08:00
Alexander Tokmakov
5455068226 try fix flacky test 2020-09-15 17:17:30 +03:00
Alexander Tokmakov
0ecf8e595f cleanup code, add test 2020-09-15 16:41:53 +03:00
Anton Popov
3e855daefd Merge remote-tracking branch 'upstream/master' into HEAD 2020-09-15 15:31:29 +03:00
Alexander Tokmakov
3671c91c37 Merge branch 'master' into allow_atomic_database_inside_materialize_mysql 2020-09-15 12:43:01 +03:00
Anton Popov
f725f8deee fix more tests 2020-09-15 02:14:14 +03:00
Vitaly Baranov
0f53b449fd Add 'params' column to system.user_directories table. 2020-09-15 01:51:53 +03:00
Azat Khuzhin
0159c74f21 Secure inter-cluster query execution (with initial_user as current query user) [v3]
Add inter-server cluster secret, it is used for Distributed queries
inside cluster, you can configure in the configuration file:

  <remote_servers>
      <logs>
          <shard>
              <secret>foobar</secret> <!-- empty -- works as before -->
              ...
          </shard>
      </logs>
  </remote_servers>

And this will allow clickhouse to make sure that the query was not
faked, and was issued from the node that knows the secret. And since
trust appeared it can use initial_user for query execution, this will
apply correct *_for_user (since with inter-server secret enabled, the
query will be executed from the same user on the shards as on initator,
unlike "default" user w/o it).

v2: Change user to the initial_user for Distributed queries if secret match
v3: Add Protocol::Cluster package
v4: Drop Protocol::Cluster and use plain Protocol::Hello + user marker
v5: Do not use user from Hello for cluster-secure (superfluous)
2020-09-15 01:36:28 +03:00
Azat Khuzhin
2fce2b21a8 Use pytest.raises(match=) in test_allowed_client_hosts
Since pytest.raises() produces excinfo not exception, hence at least
str(excinfo.value) should be used to match the exception message.
2020-09-15 01:36:28 +03:00
Alexander Tokmakov
a812f7eb75 allow using Atomic database inside MaterializeMySQL 2020-09-14 22:25:02 +03:00
alesapin
58f4e5f967
Merge pull request #14755 from vitlibar/fix-permission-denied-in-integration-tests
Fix access denied on opening file /var/lib/clickhouse/status in integration tests.
2020-09-14 22:08:21 +03:00
Anton Popov
ac9ba23bdf fix more tests 2020-09-14 15:49:04 +03:00
alesapin
0c04f4d008
Update cluster.py 2020-09-14 10:01:20 +03:00
Vitaly Baranov
421eeeccef Add the section user_directories to the default config. 2020-09-12 23:04:28 +03:00
alexey-milovidov
c2f762e20a
Merge pull request #14748 from vitlibar/skip-access-storages-with-same-path
Skip access storages with same path while reading the main config.
2020-09-12 14:20:02 +03:00
alesapin
2c6567eb88
Merge pull request #14745 from kssenii/fix-rabbit-tests-crash
Fix crashes in RabbitMQ tests
2020-09-12 09:53:14 +03:00
Vitaly Baranov
1e849f2975 Fix permission denied on opening file /var/lib/clickhouse/status in integration tests. 2020-09-12 03:18:18 +03:00
Azat Khuzhin
9c7f3a9a74 Add test_distributed_ddl_parallel 2020-09-12 02:33:17 +03:00
Vitaly Baranov
e2c2a679ef Skip access storages with same path while reading the main config. 2020-09-12 01:34:46 +03:00
alesapin
36019596c1 Disable flaky test 2020-09-11 20:08:23 +03:00
alesapin
2c4047b280 Revert accident changes 2020-09-11 20:07:00 +03:00
alesapin
c0dafb0283 Disable test 2020-09-11 20:04:55 +03:00
kssenii
31dbfd07e2 remove tests crash reason 2020-09-11 16:16:24 +00:00
Nikita Mikhaylov
468089a4cd
Merge pull request #14514 from bharatnc/ncb/event_time_microseconds_metric_logs
add event_time_microseconds field to asynchronous_metric_log & metric_log system tables
2020-09-11 16:14:00 +04:00
zhang2014
7ff7ee6aac ISSUES-4006 try fix integration test 2020-09-11 15:37:14 +08:00
Anton Popov
fa6d88b3b2 fix more tests 2020-09-10 21:43:02 +03:00
Anton Popov
6031e6bae9 fix tests 2020-09-10 20:09:19 +03:00
tavplubix
4581e3a18a
Merge pull request #14563 from bharatnc/ncb/zk-conn-fail-do-cleanup
ReplicatedMergeTree - cleanup data directory after Zookeeper exceptions
2020-09-10 19:19:57 +03:00
bharatnc
397ebdb855 remove sleep from unit test 2020-09-10 08:55:39 -07:00
Alexander Tokmakov
20b3823770 do not remove directory on attach 2020-09-10 13:21:13 +03:00
zhang2014
5b3e9eaaf0 Merge branch 'master' into fix/datetime 2020-09-10 17:26:26 +08:00
zhang2014
338b69201d ISSUES-4006 add test decimal when dump stage 2020-09-10 17:20:28 +08:00
bharatnc
31b0bd481c Integration tests - more accurate tests 2020-09-10 00:35:25 -07:00
bharatnc
05a80518a1 Merge remote-tracking branch 'upstream/master' into ncb/event_time_microseconds_metric_logs 2020-09-09 17:58:29 -07:00
bharatnc
2ad63d2b4d AsynchronousMetricLog - refactor integration test 2020-09-09 17:56:21 -07:00
bharatnc
0a3f7d0fcc AsynchronousMetricsLog - add improved tests
This adds integration tests to test the asynchronous_metric_log table
for event_time_microseconds field.

Asynchronous metrics are updated once every 60s, so this setting needs
to be overridden for having those metrics available in time so that the
tests can run. So the `asynchronous_metric_update_period_s` setting is
being overriden to be 2s.
2020-09-09 17:50:39 -07:00
Alexander Tokmakov
dee1fefeb4 add more tests 2020-09-09 20:39:49 +03:00
alesapin
cdb72add35
Merge pull request #14619 from ClickHouse/better_copy_dir
Better recursive database copy in integration tests
2020-09-09 19:38:55 +03:00
bharatnc
fe6d6f16ea Merge remote-tracking branch 'upstream/master' into ncb/zk-conn-fail-do-cleanup 2020-09-09 09:25:34 -07:00
bharatnc
d1d3af7501 StorageReplicatedMergeTree - more improvements to integration test 2020-09-09 09:24:18 -07:00
zhang2014
6ed3f7fb86 ISSUES-4006 try fix integration test failure when mysql 5.7 2020-09-09 23:42:03 +08:00
zhang2014
094897fe69 Merge branch 'master' into fix/datetime 2020-09-09 23:37:54 +08:00
alesapin
bd14c79b0b
Merge pull request #14494 from ClickHouse/recompression_in_background
Recompression TTL
2020-09-09 17:46:01 +03:00
Alexander Tokmakov
d278d849e4 Merge branch 'master' into write_structure_of_table_functions 2020-09-09 17:12:35 +03:00
Vasily Nemkov
3973a17530
MySql datatypes dateTime64 and decimal (#11512) 2020-09-09 15:18:02 +03:00
alesapin
98f19a5d50 Better permissions 2020-09-09 14:29:53 +03:00
alesapin
f5bef34be6 Fix configs for test_default_database_on_cluster 2020-09-09 14:28:59 +03:00
alesapin
150d8d4e79 Better recursive copy in integration tests 2020-09-09 14:11:59 +03:00
Winter Zhang
3d1d64ec60
Fix currentDatabase function cannot be used in ON CLUSTER ddl query. (#14211) 2020-09-09 12:58:59 +03:00
alesapin
485b104898 Use max ttl and add introspection to system parts about recompression 2020-09-09 12:15:42 +03:00
alesapin
a696cf12f6 Merge branch 'master' into recompression_in_background 2020-09-09 10:12:03 +03:00
alesapin
9548d69792
Merge pull request #14581 from ClickHouse/fix_flaky_test_3
Add retries to several integration tests
2020-09-09 10:04:37 +03:00
bharatnc
f37814b367 Merge remote-tracking branch 'upstream/master' into ncb/zk-conn-fail-do-cleanup 2020-09-08 23:45:20 -07:00
bharatnc
48bf65d63d StorageReplicatedMergeTree - improve integration test 2020-09-08 23:45:04 -07:00
Winter Zhang
62ef728b2f
ISSUES-4006 try fix test failure 2020-09-09 10:52:14 +08:00
Anton Popov
032f4ba6f3
Merge pull request #14532 from CurtizJ/fix-redis-test
Rework test for redis dictionary
2020-09-09 02:38:09 +03:00
Anton Popov
53572b3783 add gitkeep 2020-09-08 19:37:16 +03:00
alesapin
f0f7f2b5d2 Merge branch 'master' into recompression_in_background 2020-09-08 15:43:37 +03:00
alesapin
6ad91d1018
Merge pull request #14490 from ClickHouse/control_ttl_merges_in_pool
Control ttl merges in pool
2020-09-08 15:42:20 +03:00
Ilya Yatsishin
37236e5923
Merge pull request #14553 from ClickHouse/fix-flacky-test-11
Handle host/network is unreachable in integration tests
2020-09-08 14:45:00 +03:00
alesapin
6e591d5dea Better retries 2020-09-08 14:20:35 +03:00
alesapin
cdfca04b42 Missed break 2020-09-08 14:07:41 +03:00
alesapin
43c17ff79e Add retries to test 2020-09-08 14:02:44 +03:00
alesapin
4364bff3bc
Merge pull request #12761 from kssenii/rabbitmq-improvements
RabbitMQ improvements
2020-09-08 09:38:25 +03:00
bharatnc
806334a642 StorageReplicatedMergeTree - add integration tests that test dir cleanup
This adds a integration test that tests if table directory is cleaned
up after a ZooKeeper connection failure for ReplicatedMergeTree tables.
2020-09-07 22:32:01 -07:00
Winter Zhang
18b4c5997d
Merge branch 'master' into fix/datetime 2020-09-08 11:32:48 +08:00
zhang2014
a150b1345b ISSUES-4006 add integration test 2020-09-08 11:29:18 +08:00
zhang2014
05bd0b7c28 ISSUES-4006 add integration test 2020-09-08 02:36:28 +08:00
alexey-milovidov
e1104135c8
Merge pull request #13939 from fastio/master
Multithreading implementation of Kafka engine
2020-09-07 20:12:06 +03:00
Alexey Milovidov
829049de2f Handle host/network is unreachable in integration tests 2020-09-07 19:43:35 +03:00
kssenii
40c8290dde Tiny fixes, better tests 2020-09-07 14:48:50 +00:00
Anton Popov
9493532fdb rework test for redis dictionary 2020-09-07 14:16:47 +03:00
alesapin
17650e803f Tiny improvements 2020-09-07 14:08:53 +03:00
alesapin
4ce975c512 Merge branch 'master' into kssenii-rabbitmq-improvements 2020-09-07 11:36:08 +03:00
alesapin
9703494f32 Less debug prints 2020-09-07 11:25:14 +03:00
alesapin
7f301eab63 Merge branch 'master' into recompression_in_background 2020-09-07 09:31:16 +03:00
Peng Jian
77420c82ea Add test case for Kafka engine with kafka_thread_per_consumer enabled. 2020-09-06 11:17:19 +08:00
alexey-milovidov
c4861155f7
Merge pull request #14498 from ClickHouse/add_retries_to_host_ip_change
Add retries to integration test_host_ip_change
2020-09-05 07:03:34 +03:00
Vitaly Baranov
81db73f066
Merge pull request #13647 from qoega/integration-explicit-configs
Add explicit main_configs, user_configs and dictionaries in integration tests
2020-09-04 20:16:00 +03:00
alesapin
3095c167ea Add retries 2020-09-04 18:22:43 +03:00
alesapin
de911aaabe Merge branch 'master' into recompression_in_background 2020-09-04 17:21:27 +03:00
alesapin
21de2f54f6 Fix tests 2020-09-04 17:13:57 +03:00
Alexander Tokmakov
ed5f827708 Merge branch 'master' into write_structure_of_table_functions 2020-09-04 16:38:57 +03:00
Alexander Tokmakov
c233be29c5 fix 2020-09-04 16:29:43 +03:00
Nikolai Kochetov
40768593c3
Merge pull request #14469 from BohuTANG/mysql_set_@@var
Support MySQL handler 'set @@xx' settting
2020-09-04 14:18:57 +03:00
alesapin
4079636f81 Merge 2020-09-04 13:52:51 +03:00
alesapin
82c56349a5 Some comments 2020-09-04 13:08:09 +03:00
BohuTANG
c094ff7eca ISSUES-9336 support MySQL handler 'set @@xx' settting 2020-09-04 12:51:15 +08:00
Ilya Yatsishin
5ada30df96
Merge branch 'master' into integration-explicit-configs 2020-09-03 20:43:01 +03:00
Kseniia Sumarokova
4b7c303eaf
Merge branch 'master' into rabbitmq-improvements 2020-09-03 17:26:04 +03:00
alesapin
e48e4309b2 Better names 2020-09-03 16:29:18 +03:00
alesapin
5ccf78ccff Simplier test 2020-09-03 16:08:45 +03:00
alesapin
565555e55c Fix bug in parts selection 2020-09-03 16:04:28 +03:00
alesapin
4519b4308c Fix default tag for base image 2020-09-03 16:03:26 +03:00
Yatsishin Ilya
216436a221 mysql fix 2020-09-03 13:27:44 +03:00
Yatsishin Ilya
a4f0267709 pass katest if no DOCKER_BASE_TAG in env 2020-09-03 13:20:15 +03:00
Yatsishin Ilya
53cc50ae0a fix test_dictionaries_ddl 2020-09-03 12:55:07 +03:00
alesapin
aa47d0aabc Merge branch 'apply_ttl_if_not_calculated' into recompression_in_background 2020-09-03 12:07:03 +03:00
Yatsishin Ilya
fc075e65da Merge remote-tracking branch 'origin' into integration-explicit-configs 2020-09-03 11:49:48 +03:00
Ilya Yatsishin
2b8ad576cc
Merge pull request #14323 from qoega/try-dns-fix
Add tag pass for integration base image. Add explicit dns options for docker-compose.
2020-09-03 11:27:24 +03:00
alesapin
672f239f5b Add settings to test 2020-09-03 10:34:53 +03:00
alexey-milovidov
72417d2716
Merge pull request #14368 from BohuTANG/materialize_mysql_query_filter_1
change string.rfind to string starts_with and add some tests
2020-09-03 01:09:53 +03:00
alesapin
dcbddbb8d0 Add recompression ttls tests and fix bugs 2020-09-02 19:15:41 +03:00
Ilya Yatsishin
a5e9449bc3
Merge branch 'master' into try-dns-fix 2020-09-02 19:01:30 +03:00
Yatsishin Ilya
c2ab85f214 Split tag part from image 2020-09-02 17:36:25 +03:00
Yatsishin Ilya
fda89095cc Split tag part from image 2020-09-02 17:22:54 +03:00
Yatsishin Ilya
8f50a6769d Fix bad merge 2020-09-02 15:28:47 +03:00
Yatsishin Ilya
5ab9f249e5 Merge branch 'try-dns-fix' into integration-explicit-configs 2020-09-02 12:53:10 +03:00
Yatsishin Ilya
6902bbce50 Merge remote-tracking branch 'origin' into integration-explicit-configs 2020-09-02 12:48:07 +03:00
Yatsishin Ilya
45e54f81c7 better resolv.conf, add DNSCacheUpdater logs 2020-09-02 11:07:46 +03:00
BohuTANG
13fdcfada9 Try to fix query_event_with_empty_transaction failed 2020-09-02 15:41:09 +08:00
alexey-milovidov
bfa5a9ef03
Merge pull request #13987 from vitlibar/fix-grant-all-on-table
Fix GRANT ALL statement when executed on a non-global level
2020-09-02 05:06:32 +03:00
alexey-milovidov
5a529f171c
Merge pull request #13988 from vitlibar/user-directories-mixed-style
Add storages from <user_directories> after ones from <users_config> and <access_control_path>.
2020-09-02 05:03:34 +03:00
BohuTANG
6dfab88156 ISSUES-14235 change string.rfind to string starts_with and add some tests 2020-09-02 08:31:51 +08:00
Alexander Kuzmenkov
fa04b39d32
Revert "Change query event filter and add integration test for empty GTID transaction" 2020-09-02 02:06:53 +03:00
Anton Popov
7c3712c121
Merge pull request #13688 from it1804/master
Redis dictionary support for simple Redis requirepass authorization
2020-09-02 01:43:02 +03:00
kssenii
6682c62a90 Fixes 2020-09-01 20:07:34 +00:00
Alexander Kuzmenkov
949a41f8b5
Merge pull request #14321 from BohuTANG/materialize_mysql_query_filter
Change query event filter and add integration test for empty GTID transaction
2020-09-01 17:44:58 +03:00
kssenii
15f735bb24 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into rabbitmq-improvements 2020-09-01 10:51:34 +00:00
Yatsishin Ilya
0af3f92bac Ignore unknown image names 2020-09-01 13:42:38 +03:00
BohuTANG
d604e84df3 ISSUES-14235 add mysql_5_7 and mysql_8_0 empty transaction tests 2020-09-01 16:37:58 +08:00
kssenii
c2fb72abf8 Better mv, more comments 2020-09-01 07:58:41 +00:00
alesapin
05b10048a6
Merge pull request #14116 from ClickHouse/parts_default_compression
Save parts default compression
2020-09-01 09:43:42 +03:00
Yatsishin Ilya
6cb893f073 Draft. 2020-09-01 09:38:23 +03:00
BohuTANG
49095e8169 ISSUES-14235 add one integration test for empty GTID transaction 2020-09-01 13:29:45 +08:00
alexey-milovidov
f5a38fa78d
Merge pull request #14203 from donge/master
fix issue #14202
2020-08-31 17:48:39 +03:00
kssenii
647cf5718e Better settings 2020-08-31 09:27:42 +00:00
Dongdong Yang
9651c36ceb testcase for issue 14202 2020-08-31 15:42:01 +08:00
alesapin
5b0822902b
Merge pull request #14155 from amosbird/fzk
Allow FETCH PARTITION from other zookeepers
2020-08-31 09:54:51 +03:00
alesapin
726f7f9823 Fix s3 tests 2020-08-28 23:38:44 +03:00
alesapin
ebc163c924 Merge branch 'master' into parts_default_compression 2020-08-28 23:11:42 +03:00
alesapin
10c7a6c45e
Add ability to specify Default codec for columns (#14049)
* Add ability to specify DefaultCompression codec which correspond to settings specified in config.xml

* Fix style

* Rename DefaultCompression to simple Default

* Fix compression codec

* Better codec description representation

* Less strange code and one method

* Fix delta
2020-08-28 20:40:45 +03:00
alesapin
f1dc668136
Update test.py 2020-08-28 16:03:42 +03:00
alesapin
1ea00d5e7a Fix test and better messages 2020-08-28 14:12:51 +03:00
kssenii
4e0c619721 Global refactoring 2020-08-28 10:03:54 +00:00
alesapin
77faf9587f Better interface 2020-08-28 12:07:20 +03:00
Amos Bird
44364a5f59
add tests 2020-08-27 22:37:41 +08:00
Amos Bird
0c1cf22c00
Allow FETCH PARTITION from other zookeepers 2020-08-27 22:19:18 +08:00
alexey-milovidov
b54011bae2
Merge pull request #14161 from ClickHouse/fix_flaky_test_2
Disable several flaky tests for RabbitMQ
2020-08-27 16:58:36 +03:00
alesapin
0ff5e5412e Merge branch 'master' into parts_default_compression 2020-08-27 16:01:37 +03:00
alesapin
6a963f58da
Merge pull request #14158 from ClickHouse/fix_flaky_test_1
Wait for async mutation in test_version_update_after_mutation
2020-08-27 15:59:31 +03:00
Alexander Tokmakov
65a69ff6ad move docker-compose files 2020-08-27 14:46:19 +03:00
alesapin
3950afa3ae Disable several flaky tests for rabbitmq 2020-08-27 11:57:43 +03:00
alesapin
1f22ec5f7c Wait for async mutation in test 2020-08-27 10:16:07 +03:00
kssenii
4fecfdbe2f Better & cleaner 2020-08-26 18:52:45 +00:00
Alexey Milovidov
b27be98272 Increase timeout in test 2020-08-26 19:27:09 +03:00
alesapin
2fc80189af Add default compression codec to merge tree data part 2020-08-26 18:29:46 +03:00
tavplubix
cff92c8ad3
Merge pull request #13820 from BohuTANG/mysql_replica_gtid_issue_4006
ISSUES-4006 support MySQL GTID based replication #4006
2020-08-26 15:02:53 +03:00
Vitaly Baranov
7ac4bd7d1e Add storages from <user_directories> after ones from <users_config> and <access_control_path>. 2020-08-26 13:45:35 +03:00
alesapin
7428c46737 Merge branch 'master' into recompressing_in_background 2020-08-26 10:28:03 +03:00
alexey-milovidov
f40b80ed45
Merge pull request #12756 from sundy-li/hotfix/dict-access
Fix ClickHouseDictionarySource wrong access check
2020-08-26 03:33:42 +03:00
alexey-milovidov
75a3bbf5b2
Merge pull request #13722 from javisantana/fix/replicas_status_verbose
return 200 when replicas status is ok and verbose = 1
2020-08-26 00:35:47 +03:00
alesapin
9ca8c5e77a Rename DefaultCompression to simple Default 2020-08-25 18:53:06 +03:00
alesapin
1180bad3a7 Add ability to specify DefaultCompression codec which correspond to settings specified in config.xml 2020-08-25 18:02:32 +03:00
kssenii
31b1b6fe9f Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into rabbitmq-improvements 2020-08-25 14:47:03 +00:00
alesapin
f5730a3a5f Merge branch 'master' into fix_ddl_worker_timeouts 2020-08-24 11:50:11 +03:00
Vitaly Baranov
4c8a8d5e67 Add test. 2020-08-22 01:59:52 +03:00
alexey-milovidov
7b53a0ef33 Revert "Added allow_merges option for volumes in multi-disk configuration (#13402)"
This reverts commit 1e2616542a.
2020-08-21 18:44:29 +03:00
Vladimir Chebotarev
1e2616542a
Added allow_merges option for volumes in multi-disk configuration (#13402) 2020-08-21 12:04:13 +03:00
Alexander Tokmakov
be6af3881a remove retries 2020-08-19 13:05:40 +03:00
Yatsishin Ilya
e77ab608c8 fix typo 2020-08-19 10:45:16 +03:00
BohuTANG
26525a5eb1 Merge remote-tracking branch 'origin/master' into mysql_replica_gtid_issue_4006 2020-08-19 08:04:02 +08:00
Yatsishin Ilya
26020cdf68 typo 2020-08-18 17:38:16 +03:00
Yatsishin Ilya
adc2c117c8 fixes 2020-08-18 17:34:04 +03:00
Yatsishin Ilya
8fd70835d5 Merge remote-tracking branch 'origin' into integration-explicit-configs 2020-08-18 17:31:41 +03:00
Ivan
cd22abbfe3
Expect empty content on verbose response 2020-08-18 14:59:57 +03:00
zhang2014
cba1e3d568 ISSUES-4006 Add more times test 2020-08-18 10:51:05 +08:00
Alexander Tokmakov
790c420dcf run multiple times, print stacktraces 2020-08-17 22:55:27 +03:00
Alexander Tokmakov
51bb0412b1 enable the test 2020-08-17 21:48:55 +03:00
Alexander Tokmakov
f5c14a0766 Merge branch 'master' into fix/materialize_integration_test 2020-08-17 21:47:53 +03:00
Alexander Tokmakov
1eb36d6067 partially disable test with MaterializeMySQL 2020-08-17 21:17:29 +03:00
BohuTANG
b94a4a64d2 ISSUES-4006 enable GTID mode for materialize mysql database intergration tests 2020-08-17 22:16:51 +08:00
Javi Santana
ce64a73342 fixed tests and style 2020-08-17 09:46:38 +02:00
zhang2014
b11f4b45a0 ISSUES-4006 fix race condition in integeration test 2020-08-17 13:13:56 +08:00
Vitaly Baranov
e6c6f904bb Add test for user directories. 2020-08-16 19:33:50 +03:00
Vitaly Baranov
ad03ff3887 Rename storages users.xml=>users_xml, disk=>local_directory. 2020-08-16 16:42:57 +03:00
kssenii
1e7eb49481 Add one more mes property, support format_schema 2020-08-15 15:05:53 +00:00
Vladimir Chebotarev
cca417b058 Fixed flappy test_multiple_disks::test_start_stop_moves. 2020-08-15 16:00:53 +03:00
Ivan A. Torgashov
1006c4f11b Update tests for Redis dictionary requirepass authorization support 2020-08-15 14:18:17 +05:00
kssenii
c6fdeb6c02 Better 2020-08-15 08:00:56 +00:00
kssenii
9a409db5c0 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into rabbitmq-improvements 2020-08-15 06:51:22 +00:00
Yatsishin Ilya
fac881a6f0 finally remove config_dir 2020-08-14 18:51:28 +03:00
Javi Santana
f04f984fb2 change response content for test 2020-08-14 15:31:54 +02:00
Javi Santana
cb80eba410 added tests 2020-08-14 15:16:07 +02:00
Yatsishin Ilya
73e9f4d421 update test_materialize_mysql_database test 2020-08-13 21:20:47 +03:00
Ilya Yatsishin
c90c06ceaf
Merge branch 'master' into integration-explicit-configs 2020-08-13 05:20:17 +03:00
Ilya Yatsishin
e6420c82ca
mysql/postgresql: move Dockerfiles and docker_compose to docker/test (#13448)
* mysql/postgresql: move Dockerfiles and docker_compose to docker/test
* Build client containers in CI
* pass tag to docker_compose
2020-08-12 18:04:36 +03:00
tavplubix
4aff48dc3f
Merge pull request #10851 from zhang2014/feature/materialize_mysql_database
ISSUES-4006 support MaterializeMySQL database engine
2020-08-12 15:59:28 +03:00
Yatsishin Ilya
f663f794b0 Merge remote-tracking branch 'qoega/integration-explicit-configs' into integration-explicit-configs 2020-08-12 14:58:41 +03:00
Yatsishin Ilya
ad740fc7da copy dictionaries 2020-08-12 12:26:01 +03:00
Yatsishin Ilya
160776f183 Add explicit main_configs, user_configs and dictionaries in integration tests. 2020-08-12 11:55:04 +03:00
Yatsishin Ilya
9767d96274 Fix names 2020-08-12 11:16:46 +03:00
Alexander Kuzmenkov
ef5882639b
Merge pull request #13459 from Jokser/s3-multithreaded-disk-copy
Move parts from DiskLocal to DiskS3 in parallel
2020-08-12 07:36:03 +03:00
Yatsishin Ilya
fdd18e540d move reference files 2020-08-12 07:06:23 +03:00
Alexander Tokmakov
829f7e65de try fix sync, add experimetal flag 2020-08-12 00:59:46 +03:00
zhang2014
e3b51835ff ISSUES-4006 try fix ci 2020-08-11 21:35:50 +08:00
Yatsishin Ilya
75d0b8245f fix typo 2020-08-11 11:36:26 +03:00
Yatsishin Ilya
5d52c306c8 fix 2020-08-11 11:35:31 +03:00
Yatsishin Ilya
dd2449354a fix 2020-08-11 11:28:16 +03:00
Yatsishin Ilya
4c61a29a63 Add noop runner parameter to prepare actual changes 2020-08-10 16:44:04 +03:00
Yatsishin Ilya
1d0e4ca670 pass tag to docker_compose 2020-08-10 16:35:08 +03:00
Pavel Kovalenko
f503273d41 Merge remote-tracking branch 'origin/master' into s3-multithreaded-disk-copy
# Conflicts:
#	src/Disks/S3/DiskS3.cpp
2020-08-10 14:35:26 +03:00
Yatsishin Ilya
1884cfe110 Merge remote-tracking branch 'origin/master' into docker-mysql-postgres 2020-08-10 11:12:22 +03:00
zhang2014
90b7628496 ISSUES-4006 try fix test failure & add some test 2020-08-10 10:25:08 +08:00
zhang2014
933f287db4 ISSUES-4006 resolve review comment & support alter renmae command 2020-08-09 20:10:30 +08:00
alexey-milovidov
aefa9b297b
Merge pull request #13449 from ClickHouse/mixed_granularity_parts_by_default
Enable mixed granularity parts by default
2020-08-09 01:36:59 +03:00
kssenii
139a19d583 Merge 2020-08-08 17:20:50 +00:00
kssenii
2ea32a710a More tests, better reconnect 2020-08-08 17:03:55 +00:00
Alexander Kuzmenkov
6a596d5c40
Merge pull request #13076 from Jokser/s3-file-cache
Ability to cache mark and index files for S3 disk
2020-08-08 01:04:53 +03:00
Vitaly Baranov
8d6e04835c
Merge pull request #13199 from vitlibar/fix-reading-row-policies-from-users-xml
Fix parsing row policies from users.xml
2020-08-07 23:32:28 +03:00
Vitaly Baranov
1a4a8a219c
Merge pull request #13305 from vitlibar/correct-error-message-if-setting-not-found-in-users_xml
Correct error message if setting not found in users.xml
2020-08-07 23:31:23 +03:00
alesapin
7d1283247f Fix tests 2020-08-07 20:16:59 +03:00
Pavel Kovalenko
a6ee09f696 Move parts to DiskS3 in parallel refactoring. 2020-08-07 14:40:19 +03:00
Yatsishin Ilya
222b06f4e9 Add lost import 2020-08-07 13:42:39 +03:00
alesapin
77b8c9e332 Fix DDL worker 2020-08-07 12:18:34 +03:00
Yatsishin Ilya
70fca95a5a mysql/postgresql: move Dockerfiles and docker_compose to docker/test 2020-08-07 11:42:04 +03:00
kssenii
24b032b378 Allow multiple consumers for same queues 2020-08-06 13:50:44 +00:00
alesapin
d387b97a69
Merge pull request #13285 from filimonov/kafka_fix_test_rdkafka_15
Fix for test_kafka_flush_by_block_size after rdkafka 1.5
2020-08-06 11:48:21 +03:00
Alexander Kuzmenkov
4417fb80e6
Merge pull request #13203 from oandrew/avro-confluent-skip-tombstone
AvroConfluent: skip Kafka tombstone records/skip broken records
2020-08-05 02:47:42 +03:00
kssenii
add698a86b Merge 2020-08-04 21:44:33 +00:00
Vitaly Baranov
b8b4bb331e Add test. 2020-08-04 20:50:29 +03:00
alesapin
61a8d9b137
Merge pull request #13278 from ClickHouse/kill_clickhouse_without_throw
Fix exception in integration tests during clickhouse restart
2020-08-04 11:28:28 +03:00
Nikolai Kochetov
389f895b43
Merge pull request #13290 from ClickHouse/fix-totals-for-delayed-replica
Fix totals for delayed replica
2020-08-04 11:26:09 +03:00
Andrew Onyshchuk
a46049f86d test_storage_kafka: test empty message when supported by format 2020-08-04 02:43:42 -05:00
Andrew Onyshchuk
e472c83601 Add AvroConfluent kafka test 2020-08-04 02:43:42 -05:00
zhang2014
c173bd391f ISSUES-4006 try fix build & test failure 2020-08-04 10:31:27 +08:00
zhang2014
6b452cf83d ISSUES-4006 try fix build failure & fix float 32 parser 2020-08-04 10:31:27 +08:00
zhang2014
b76f218d90 ISSUES-4006 add mysql dml test 2020-08-04 10:31:27 +08:00
zhang2014
9996166860 ISSUES-4006 try fix check style 2020-08-04 10:31:27 +08:00
zhang2014
7eb232e02d ISSUES-4006 add dml test after ddl 2020-08-04 10:31:27 +08:00
zhang2014
bd65a8f213 ISSUES-4006 try fix build failure 2020-08-04 10:31:27 +08:00
zhang2014
d57631210e ISSUES-4006 try fix integration test 2020-08-04 10:31:27 +08:00
zhang2014
cfe2c42199 ISSUES-4006 try fix integration test 2020-08-04 10:31:27 +08:00
zhang2014
9d8234afd7 ISSUES-4006 try fix integration test 2020-08-04 10:31:27 +08:00
zhang2014
c5946f7697 ISSUES-4006 add mysql 8.0 integration test 2020-08-04 10:31:27 +08:00
zhang2014
0974f6c692 ISSUES-4006 try fix integration test 2020-08-04 10:31:27 +08:00
zhang2014
2fd0c95d79 ISSUES-4006 try fix integration test 2020-08-04 10:31:27 +08:00
zhang2014
db6220e52c ISSUES-4006 add mysql 5.7 ddl integration test 2020-08-04 10:31:27 +08:00
zhang2014
74f354d840 ISSUES-4006 add some check before create materialize mysql database 2020-08-04 10:31:27 +08:00
zhang2014
e471f805b5 ISSUES-4006 try fix build failure & update integration test 2020-08-04 10:31:26 +08:00
zhang2014
94a2a7791c ISSUES-4006 add some integration test 2020-08-04 10:31:26 +08:00
zhang2014
f5b66810ce ISSUES-4006 add integration test 2020-08-04 10:31:26 +08:00
Vitaly Baranov
5ef4b19471 Add test for custom settings in users.xml 2020-08-04 01:48:29 +03:00
alexey-milovidov
c43a27782e
Merge pull request #13153 from ClickHouse/merge-tree-settings-sanity-check
Sanity checks for MergeTreeSettings
2020-08-04 01:27:19 +03:00
alexey-milovidov
ef0097d326
Merge pull request #12343 from ClickHouse/database_atomic_improvements
DatabaseAtomic improvements
2020-08-03 21:45:41 +03:00
Nikolai Kochetov
11830343fa Update test. 2020-08-03 20:07:09 +03:00
Mikhail Filimonov
991c673870 Fix for test_kafka_flush_by_block_size after rdkafka 1.5
Since rdkafka 1.5 (https://github.com/edenhill/librdkafka/releases/tag/v1.5.0)
don't auto-create topics when subscribing, so test start failing
because it was intentionally time-limited to check if flushing by block size worked.

Since 20.5 it's possible to increase kafka_flush_interval_ms per table, so i've
adjusted the test using that feature to test if data is flushed by block size,
not by time.
2020-08-03 18:43:37 +02:00
kssenii
d5b1332b67 Stop publish untill batch is confirmed 2020-08-03 14:40:51 +00:00
alesapin
8ad6a68fad Add ability to execute commands in integration tests containers without exceptions. Supress exception during kill 2020-08-03 17:40:02 +03:00
Alexander Kuzmenkov
4049f23188
Merge pull request #13103 from filimonov/test_for_macros_in_kafka
Add test for macros usage in some kafka settings.
2020-08-03 17:16:12 +03:00
Alexander Tokmakov
392778d482 fix test 2020-08-03 15:19:41 +03:00
Alexander Tokmakov
5b92f43f12 Merge branch 'master' into database_atomic_improvements 2020-08-03 14:35:40 +03:00
alesapin
eb2236fe8b Fix configs 2020-08-03 14:13:43 +03:00
kssenii
60124b769c Merge 2020-08-03 09:17:23 +00:00
Alexey Milovidov
b232659439 Update tests 2020-08-03 00:39:51 +03:00
alesapin
75a9053511
Merge pull request #13150 from nvartolomei/nv/freeze-verbose-absolute-path
Use absolute paths to backup locations (shadow)
2020-08-02 19:25:24 +03:00
alexey-milovidov
5e0437eeac
Merge pull request #12442 from ClickHouse/deprecate-special-zero-datetime
Deprecate special printing of zero Date/DateTime
2020-08-02 00:36:34 +03:00
alexey-milovidov
566044f9c8
Merge pull request #12991 from ClickHouse/kafka-fix-msan
Fix MSan error in "rdkafka" library #12990
2020-08-02 00:22:44 +03:00
Alexey Milovidov
07f3662f6d Merge remote-tracking branch 'origin/master' into deprecate-special-zero-datetime 2020-07-31 23:49:06 +03:00
Ilya Yatsishin
1566c8a92b
Merge pull request #12285 from qoega/rework-integrational
Rework integrational configuration paths
2020-07-31 15:34:21 +03:00
alesapin
0c918c6137
Update tests/integration/runner 2020-07-31 15:08:19 +03:00
alexey-milovidov
9c9ef0db9b
Merge branch 'master' into database_atomic_improvements 2020-07-31 14:56:49 +03:00
Pavel Kovalenko
91ca5fa585 Added __init__.py to DiskS3 with cache test. 2020-07-31 14:43:50 +03:00
Nikita Mikhaylov
2e6edf5aa1
trigger 2020-07-31 14:38:15 +03:00
Pavel Kovalenko
fced8d04f2 DiskS3 with cache test fix. 2020-07-31 12:24:57 +03:00
alexey-milovidov
dc733e7c45
Fix Python 2020-07-31 01:23:16 +03:00
Alexey Milovidov
7722008988 Update tests 2020-07-31 00:26:04 +03:00
Alexey Milovidov
cfd4e9da3d Update tests 2020-07-31 00:24:14 +03:00
Alexey Milovidov
a354508b7f Update test 2020-07-31 00:21:00 +03:00
Alexey Milovidov
83c9d9ef45 Merge branch 'master' into deprecate-special-zero-datetime 2020-07-31 00:17:04 +03:00
Alexey Milovidov
362655fa43 Fix some bad tests 2020-07-30 22:59:49 +03:00
Nicolae Vartolomei
85174d64a0 Use absolute paths to backup locations (shadow)
Tests are frankenstain. Had to hide absolute path `/tmp/clickhouse.test..IP69I/data/shadow/test_01417_single_part_7/data/default/table_for_freeze/7_8_8_0` to make them deterministic and independend of the method they are run (local vs remote target)
2020-07-30 18:03:26 +01:00
Pavel Kovalenko
7a41fc1b9b DiskS3 with cache tests. 2020-07-30 17:49:56 +03:00
Mikhail Filimonov
0d55d364da Add test for macros usage in certain kafka setting.
https://github.com/ClickHouse/ClickHouse/issues/2249
918dbc2902
2020-07-30 11:28:52 +02:00
alesapin
724b7be555 Merge branch 'volumes-related-refactorings' of https://github.com/excitoon-favorites/ClickHouse into volumes-refactorings 2020-07-30 12:20:48 +03:00
Vladimir Chebotarev
bcc926fbb2 Returned max_data_part_size to system.storage_policies. 2020-07-30 04:19:32 +03:00
Yatsishin Ilya
58b6621dd3 Merge remote-tracking branch 'origin' into rework-integrational 2020-07-29 10:24:26 +03:00
libenwang
f6183559eb Add integration dictionaries tests 2020-07-29 13:57:46 +08:00
Ilya Yatsishin
70d6e70e68
Merge pull request #12953 from qoega/helper_container2
Do not build helper_container image inside integrational tests. Part 2: use pre-built helper_container
2020-07-28 18:20:08 +03:00
alesapin
585d9247ec
Merge pull request #12959 from ClickHouse/test_for_backup
Check backup restore in integration test.
2020-07-28 17:59:52 +03:00
Alexander Kazakov
2bde393499
Merging #12548 - Correction to merge_with_ttl_timeout logic by @excitoon (#12982)
* Fixed `merge_with_ttl_timeout` logic.
* Separate TTL-merge timers for each partition

Co-authored-by: Vladimir Chebotarev <vladimir.chebotarev@gmail.com>
2020-07-28 17:38:34 +03:00
Yatsishin Ilya
b5722493f5 less changes 2020-07-28 16:11:29 +03:00
alexey-milovidov
7a22717180
Merge pull request #12760 from ClickHouse/sticky_mutations_bug
Sticking mutations bug
2020-07-28 14:42:54 +03:00
Yatsishin Ilya
c34b1b7db8 Merge remote-tracking branch 'origin/master' into rework-integrational 2020-07-28 14:36:10 +03:00
Yatsishin Ilya
99ff6cae27 Merge remote-tracking branch 'origin/master' into rework-integrational 2020-07-28 14:35:51 +03:00
kssenii
0ee54c8a4a Fix build, async acks -> sync acks, fix tests 2020-07-28 10:43:25 +00:00
alesapin
1bece3de0a Remove strange code and test 2020-07-28 12:36:08 +03:00
alesapin
60dd38eab6
Merge pull request #12857 from ClickHouse/fix_range_hashed_dictionary
Fix columns duplication for range hashed dictionary (DDL)
2020-07-28 11:20:09 +03:00
alexey-milovidov
4d76f41449
Merge pull request #12658 from azat/kafka-unavail-broker-SIGSEGV
Fix SIGSEGV in StorageKafka when broker is unavailable
2020-07-28 00:03:54 +03:00
alesapin
1f8fe725ec Add test for ability to restore from backup 2020-07-27 22:35:38 +03:00
Yatsishin Ilya
4bd6261dc1 Use prebuilt helper_container for integration tests 2020-07-27 20:00:14 +03:00
alesapin
e73961dfe2 Fix columns duplication for range hashed dictionary created from DDL query 2020-07-27 17:06:44 +03:00
Gleb Novikov
ee07c74868 Fixed integration test_multiple_disks 2020-07-26 21:27:36 +03:00
alesapin
2d8e36ed5f Add test for sticking mutations 2020-07-26 18:58:03 +03:00
Alexander Tokmakov
6bfe88e83f Merge branch 'master' into database_atomic_improvements 2020-07-26 13:40:05 +03:00
kssenii
22b16060f6 More reliable publishing 2020-07-25 16:56:29 +00:00
kssenii
2b57857afc Add dl-exchange, commits 2020-07-25 16:56:12 +00:00
kssenii
f9a4bf9e61 Add queue resume read 2020-07-25 16:55:58 +00:00
kssenii
f0f6111655 Move exchange init, add bridge-exchange 2020-07-25 16:55:44 +00:00
kssenii
ac448db491 Add virtuals 2020-07-25 16:55:32 +00:00
kssenii
a88e391bd2 Fix bug with insert, simplify exchanges logic 2020-07-25 16:55:18 +00:00
Azat Khuzhin
0cb6669531 Add integration test for input_format_parallel_parsing memory tracking 2020-07-23 11:31:13 +03:00
Azat Khuzhin
cdb959ec8e Fix test_storage_kafka::test_kafka_unavailable 2020-07-22 11:42:30 +03:00
Azat Khuzhin
58ba72c7b6 Merge remote-tracking branch 'upstream/pr/12487' into kafka-unavail-broker-SIGSEGV
* upstream/pr/12487:
  add failing test with kafka
2020-07-22 11:07:06 +03:00
Alexander Tokmakov
9bcaaea3e0 Merge branch 'master' into database_atomic_improvements 2020-07-22 05:24:48 +03:00
Alexander Kuzmenkov
40ee6eba19
Merge pull request #12545 from ClickHouse/fix_load_part_without_checksums
Fix loading parts without checksums
2020-07-20 14:40:53 +03:00
Alexey Milovidov
a104934d2c Merge branch 'master' into deprecate-special-zero-datetime 2020-07-20 04:34:26 +03:00
tavplubix
5634482393
Merge pull request #12556 from azat/distributed-remove-files-on-drop
Remove data for Distributed tables (blocks from async INSERTs) on DROP TABLE
2020-07-17 19:29:57 +03:00
Alexey Milovidov
e207acf19a Merge branch 'master' into deprecate-special-zero-datetime 2020-07-17 17:06:31 +03:00
Alexander Tokmakov
c27de9b424 fixes 2020-07-17 16:11:44 +03:00
alexey-milovidov
0f6599c9e5
Merge pull request #12541 from BohuTANG/mysql_explain
Fix EXPLAIN format for MySQL client
2020-07-17 14:04:01 +03:00
alesapin
ac802a8e96
Merge pull request #12543 from ClickHouse/fix_marks_type_on_mutation
Fix incorrect adaptive granularity by default
2020-07-17 11:09:54 +03:00
Azat Khuzhin
6ea1b19476 Remove data for Distributed tables (blocks from async INSERTs) on DROP TABLE 2020-07-17 08:59:57 +03:00
Alexander Tokmakov
a612080df1 Merge branch 'master' into database_atomic_improvements 2020-07-17 00:43:59 +03:00
alesapin
b3ec3b1ed1 Fix loading parts without checksums 2020-07-16 13:54:49 +03:00
Vitaly Baranov
000b197ad1
Merge pull request #11234 from traceon/ldap-per-user-authentication
Add LDAP authentication support
2020-07-16 13:17:21 +03:00
alesapin
42983c5416 Fix incorrect adaptive granularity by default 2020-07-16 12:10:15 +03:00
BohuTANG
bae11968de Fix EXPLAIN format for MySQL/PG client #12432 2020-07-16 16:29:17 +08:00
Alexey Milovidov
b0b0690e1c Fix Python 2020-07-16 06:56:46 +03:00
Alexey Milovidov
2753cb58b6 Fixup 2020-07-16 05:31:03 +03:00
Alexey Milovidov
8abcee3201 Add integration test 2020-07-16 05:27:46 +03:00
Alexey Milovidov
11f8e2d906 Remove strange empty file 2020-07-16 05:11:40 +03:00
Alexey Milovidov
126a94ab69 Update integration tests 2020-07-16 04:48:50 +03:00
Denis Glazachev
59cb758cf7 Merge branch 'master' into ldap-per-user-authentication 2020-07-16 02:29:24 +04:00
Alexander Tokmakov
7f6a0a652f fix tests 2020-07-15 23:16:31 +03:00
Anton Ivashkin
52fea6a5a3 Merge master 2020-07-14 15:56:38 +03:00
Anton Popov
890bb2f582 add failing test with kafka 2020-07-14 12:24:12 +03:00
Alexander Tokmakov
fdb02edc7c Merge branch 'master' into database_atomic_improvements 2020-07-13 17:28:48 +03:00
Alexander Tokmakov
04c3e7cab6 add implicit uuid macro 2020-07-13 16:18:38 +03:00
Denis Glazachev
f787702922 Merge branch 'master' into ldap-per-user-authentication
* master: (27 commits)
  Whitespaces
  Fix typo
  Fix UBSan report in base64
  Correct default secure port for clickhouse-benchmark #11044
  Remove test with bug #10697
  Update in-functions.md (#12430)
  Allow nullable key in MergeTree
  Update arithmetic-functions.md
  [docs] add rabbitmq docs (#12326)
  Lower block sizes and look what will happen #9248
  Fix lifetime_bytes/lifetime_rows for Buffer direct block write
  Retrigger CI
  Fix up  test_mysql_protocol failed
  Implement lifetime_rows/lifetime_bytes for Buffer engine
  Add comment regarding proxy tunnel usage in PocoHTTPClient.cpp
  Add lifetime_rows/lifetime_bytes interface (exported via system.tables)
  Tiny IStorage refactoring
  Trigger integration-test-runner image rebuild.
  Delete log.txt
  Fix test_mysql_client/test_python_client error
  ...
2020-07-13 15:46:27 +04:00
Anton Ivashkin
26fca949bd add profiling events from S3 request to system.events and system.query_log 2020-07-13 11:27:11 +03:00
alexey-milovidov
26d32f2ce5
Merge pull request #12412 from Jokser/s3-https
S3 HTTPS integration tests
2020-07-12 03:36:37 +03:00
Denis Glazachev
a6a6f43422 Fix the test: auth_params is a JSON object 2020-07-12 01:40:24 +04:00
alexey-milovidov
160dcf715d
Merge pull request #12383 from BohuTANG/mysql_write_through_poco_exception
Write through Poco::Exception exception to MySQL protocol client
2020-07-11 23:56:22 +03:00
Vitaly Baranov
fe6122a1dd
Merge pull request #12394 from vitlibar/fix-calculating-implicit-access-rights
Fix calculating implicit access rights
2020-07-11 19:31:56 +03:00
BohuTANG
d6b3509664 Fix up test_mysql_protocol failed 2020-07-11 21:30:20 +08:00
alexey-milovidov
60bc8c8a8e
Delete log.txt 2020-07-11 05:33:41 +03:00
BohuTANG
beaf97f634 Fix test_mysql_client/test_python_client error 2020-07-11 09:17:12 +08:00
Pavel Kovalenko
f43428a4d5 S3 HTTPS integration test. 2020-07-10 22:42:18 +03:00
Vitaly Baranov
c66433a472 Add tests for implicit access rights. 2020-07-10 17:16:47 +03:00
Vitaly Baranov
d036682ef1 Split test 'test_create_user_and_login' into two. 2020-07-10 17:16:47 +03:00
BohuTANG
86590d4aca Change the exception catch to the generic way 2020-07-10 17:18:00 +08:00
BohuTANG
dfd7c5300a Add test_mysql_client_exception integration test 2020-07-10 14:20:32 +08:00
alexey-milovidov
8d7e418617
Merge pull request #12314 from BohuTANG/mysql_select_database
Support MySQL 'SELECT DATABASE()'
2020-07-10 06:32:04 +03:00
BohuTANG
260bcb9d79 Add integration test for mysql replacement query 2020-07-09 22:20:54 +08:00
Vladimir Chebotarev
faf6be6576
Implemented single part uploads for DiskS3 (#12026)
* Implemented single part uploads for DiskS3.
* Added `min_multi_part_upload_size` to disk configuration.
2020-07-09 17:09:17 +03:00
alesapin
84f8bf1e14
Merge pull request #10697 from CurtizJ/polymorphic-parts
Polymorphic parts (in-memory format)
2020-07-08 13:25:45 +03:00
Yatsishin Ilya
79e4c6ff83 Merge remote-tracking branch 'origin' into rework-integrational 2020-07-08 10:36:38 +03:00
Yatsishin Ilya
42894ecb27 wait more 2020-07-08 10:36:35 +03:00
alesapin
f04a49a114
Merge pull request #12256 from ianton-ru/redirect_limit_exception
throw exception on redirect limit in S3 request
2020-07-08 10:33:42 +03:00
alesapin
042a3aa8d1
Merge pull request #12168 from qoega/compose-inside-docker
Place common docker compose files to integration docker container
2020-07-07 18:43:27 +03:00
Anton Ivashkin
78ba9c986f throw exception on redirect limit in S3 request 2020-07-07 16:20:48 +03:00
alesapin
be85f9f98a
Merge pull request #12165 from vitlibar/fix-split-dictionary-source-table-name
Fix splitting table name of dictionary source
2020-07-07 11:49:36 +03:00
Alexander Kuzmenkov
dce7709405
Merge pull request #12152 from BohuTANG/mysql_kill_query
Support MySQL 'KILL QUERY [connection_id]'
2020-07-07 11:07:20 +03:00
Vitaly Baranov
4733504b51 Don't split dictionary source's table name into schema and table name itself
if ODBC driver doesn't support schema.
2020-07-06 23:41:39 +03:00
alesapin
3f90f65678 Merge remote-tracking branch 'origin' into CurtizJ-polymorphic-parts 2020-07-06 21:34:17 +03:00
Yatsishin Ilya
0c7a261bc6 Place common docker compose files to integration docker container 2020-07-06 16:45:54 +03:00
Yatsishin Ilya
d23f0008ee Merge branch 'master', remote-tracking branch 'origin' into rework-integrational 2020-07-06 14:51:15 +03:00
Nikita Mikhaylov
5c6d6bdf54
Merge pull request #11995 from azat/load_balancing-priority
Load balancing manual priority
2020-07-06 13:32:20 +04:00
BohuTANG
18c48ce12c Add integration test for mysql replacement query 2020-07-06 16:26:06 +08:00
alexey-milovidov
ea0fb005fb
Merge pull request #12116 from vitlibar/fix-table-dictionary-dependency
Fix handling dictionary-table dependency
2020-07-06 04:19:43 +03:00
alexey-milovidov
c696354dd4
Merge pull request #12115 from ianton-ru/disk-type-in-system-disks
Add type column in system.disks
2020-07-05 01:04:17 +03:00
Val
147fa9fed9 fix type error in zookeeper 2020-07-04 16:48:44 +03:00
alesapin
a2b6d58053
Merge pull request #11069 from kssenii/add-storage-rabbitmq-read-only
Add storage RabbitMQ
2020-07-04 10:38:50 +03:00
Vitaly Baranov
dad96beb72 Add test. 2020-07-03 22:06:00 +03:00
Yatsishin Ilya
3790c8ccd9 wip 2020-07-03 18:43:48 +03:00
Vitaly Baranov
929d652297
Merge pull request #12083 from vitlibar/improve-revoke-command
Improve REVOKE command
2020-07-03 17:17:36 +03:00
Anton Ivashkin
23b44ca6fe Add type column in system.disks 2020-07-03 15:45:54 +03:00
alesapin
c57edd2018 Tiny fixes 2020-07-03 11:02:35 +03:00
Anton Popov
4422df2e37 Merge remote-tracking branch 'upstream/master' into HEAD 2020-07-02 20:18:21 +03:00
alesapin
ab54a96cc5 Reverse arguments 2020-07-02 17:38:09 +03:00
alesapin
96df2e6b71 Better shutdown and conversion 2020-07-02 17:35:10 +03:00
alesapin
64583ceb22 Merge branch 'master' into add-storage-rabbitmq-read-only 2020-07-02 16:08:29 +03:00
alesapin
1fb90f3811
Merge pull request #12052 from ClickHouse/test_image_changes
Test image changes
2020-07-02 15:01:06 +03:00
Vitaly Baranov
03b36c262e Improve REVOKE command: now it requires only grant/admin option for only
access which will be revoked.
REVOKE ALL FROM user1 now revokes all granted roles.
2020-07-02 12:54:24 +03:00
Alexander Kazakov
cc2cadb7f5
Merge pull request #11893 from excitoon-favorites/autostartmoves
In *MergeTree: Parts moving task shall be started if new storage policy needs them
2020-07-02 10:44:38 +03:00
Vitaly Baranov
c39eb8f71b Fix partial revokes (complex cases). 2020-06-30 18:47:02 +03:00
alesapin
29c528235e Add ability to run any image version from packager and runner 2020-06-30 16:08:12 +03:00
Vladimir Chebotarev
288b407d32 Added test for automatic start of background move task. 2020-06-30 15:36:44 +03:00
Vitaly Baranov
ace9c99e14 Fix test_allow_introspection. 2020-06-30 12:20:00 +03:00
Azat Khuzhin
0eb9c8e430 Add a test with negative priority in test_distributed_load_balancing 2020-06-30 11:10:30 +03:00
Anton Popov
53e955c6dd several fixes 2020-06-29 23:36:18 +03:00
Azat Khuzhin
beb341275c Cover <replica> <priority> in test_distributed_load_balancing 2020-06-29 23:03:28 +03:00
Azat Khuzhin
72db50fe22 Drop TODO about possible failures from test_distributed_load_balancing
Fixed in: #11669 bd45592539 ("Fix
test_distributed_load_balancing flaps (due to config reload)")
2020-06-29 23:03:28 +03:00
Vitaly Baranov
f3f005d5b9
Merge pull request #12015 from vitlibar/fix-access-rights-allow-ddl-0
Fix calculation of access rights when allow_ddl = 0
2020-06-29 15:14:22 +03:00
alesapin
e72bc39654
Merge pull request #11983 from ClickHouse/storage_mongodb
Merging #10931 (Storage MongoDB)
2020-06-29 11:49:18 +03:00
Alexey Milovidov
b985584a09 Fix integration test 2020-06-28 23:03:45 +03:00
Vitaly Baranov
b230e74026 Add test test_allow_ddl. 2020-06-28 21:44:27 +03:00
Val
8273248c4e add log_name_to_exec to dbreplicated 2020-06-28 18:43:30 +03:00
alexey-milovidov
5a99cdb0d9
Merge pull request #11996 from BohuTANG/mysql_engine_enum
ISSUES-3985 Support MySQL engine reading Enums type
2020-06-27 22:18:25 +03:00
Val
dde293fc3d check schema after alters in test 2020-06-27 17:04:12 +03:00
Val
67588edcf5 clean up db replicated files and add more tests 2020-06-27 17:04:11 +03:00
Val
e8e4e4d21c add tests for db replicated 2020-06-27 17:02:05 +03:00
Val
f6de720f59 speed up db replicated test 2020-06-27 17:02:05 +03:00
Val
a0af67b636 Add one more test for db replicated and fix related bug 2020-06-27 17:01:20 +03:00
Val
34f74ff785 add test cases for replicated db 2020-06-27 16:58:17 +03:00
Val
5e076b464e add replicated db snapshot, integration test, repl alter queries, etc
add an option to create replicated tables within replicated db without specifying zk path and replica id
add replicated sch pool
disable replication of alter queries for replicated tables in replicated dbs
snapshot prototype. amend of replicated db workflow
add prototype of integration tests for replicated db
2020-06-27 16:58:15 +03:00
BohuTANG
f783a2976b Insert enum column values for test 2020-06-27 21:25:03 +08:00
BohuTANG
a13d201991 Add integration test for MySQL enums type 2020-06-27 17:46:19 +08:00
alesapin
4aea4c928e Add __init__.py 2020-06-26 19:31:00 +03:00
alesapin
4969da85d9 Fixes 2020-06-26 17:28:00 +03:00
alesapin
e9c47dc89c Merge branch 'master' into CurtizJ-polymorphic-parts 2020-06-26 14:27:19 +03:00
Nikita Mikhaylov
f90dfa3ef4 Merge branch 'master' of github.com:ClickHouse/ClickHouse into merging-ssh-cache 2020-06-26 13:56:21 +03:00
Nikita Mikhaylov
ff47c143f0 remove unused imports + bump tests 2020-06-26 12:53:02 +03:00
Nikita Mikhaylov
ea4192abc4 one more test 2020-06-25 19:09:34 +03:00
Nikita Mikhailov
15e09c8b2e add ssd to integration test 2020-06-25 18:35:33 +03:00
alexey-milovidov
a34032cace
Merge pull request #11300 from blinkov/sentry
Opt-in support for sending crash reports
2020-06-25 17:20:50 +03:00
Nikita Mikhaylov
e16f942197 save 2020-06-25 14:17:46 +03:00
alesapin
36eb2c3028 Simplify code around locks 2020-06-25 13:25:22 +03:00
alesapin
d5847d29d6 Avoid memory leaks 2020-06-25 12:44:39 +03:00
Ivan Blinkov
269fc138be rename test back to test.py 2020-06-25 11:11:29 +03:00
alesapin
addee61bcb Trying to do everything on top of libuv, add heartbeats 2020-06-25 00:14:49 +03:00
alesapin
3fc65b3269 Merge branch 'master' into kssenii-rabbit-mq 2020-06-24 20:14:28 +03:00
Vitaly Baranov
29a9d4187f Fix using current database while checking access rights. 2020-06-24 17:31:05 +03:00
Ivan Blinkov
3206ed832a add __init__.py 2020-06-24 15:54:04 +03:00
Ivan Blinkov
ea2d1856f3 try to rename py files to less common names 2020-06-24 15:35:22 +03:00
tavplubix
2401bc9143
Merge pull request #11896 from ClickHouse/merging_drop_replica
Merging #10679
2020-06-24 11:42:39 +03:00
Anton Popov
8c3f496826 add test with alters and in-memory parts 2020-06-24 01:16:29 +03:00
Ivan Blinkov
45d1ca2567 merge master 2020-06-24 00:18:16 +03:00
Alexander Tokmakov
7b5de16da9 minor improvements 2020-06-23 22:15:01 +03:00
alexey-milovidov
1c1e12f06b
Merge pull request #11826 from ClickHouse/send-logs-on-fatal-errors
Send logs to client on fatal errors if possible
2020-06-23 09:49:48 +03:00
amudong
7723dc4935 add drop relica database and the whole replica
fix removeReplicaByZKPath

fix bug: add zkpath empty judge

fix: rewrite code

delete useless code.

fix:ast fromat

fix bug

add test_drop_replica

add drop_replica doc

add drop databse checkAccess

refactor dropReplica

update tests

add static method StorageReplicatedMergeTree::dropReplicaByZkPath

update doc and delete useless code

fix conflict

fix doc

fix doc

fix StorageReplicatedMergeTree::dropReplica

fix bug

delete useless code
2020-06-23 12:12:30 +08:00
amudong
2e6a3eff8e fix: can not drop local table and replace ALTER with SYSTEM
fix test_drop_replica

fix drop replica '/path/to/zk/' ending in '/' and update doc
2020-06-23 12:12:30 +08:00
sundy-li
0a4af8f0a7 add SYSTEM DROP REPLICA 2020-06-23 12:12:30 +08:00
sundy-li
15ad830290 only drop inactive replica
update doc

Increase timeout to release the zookeeper Ephemeral nodes

Fix code comment

use PartitionManager

make integrations test passed
2020-06-23 12:12:30 +08:00
sundy-li
34df59baf8 Add tests and docs
Fix integration-tests
2020-06-23 12:12:30 +08:00
alexey-milovidov
d147cd646a
Merge pull request #11860 from ClickHouse/supress_mysql_test_under_tsan
Disable MySQL dictionaries integration tests under tsan
2020-06-23 02:50:05 +03:00
Alexander Kuzmenkov
e76941b52c
Merge pull request #11669 from azat/distributed_replica_error_ignore
Add number of errors to ignore while choosing replicas
2020-06-22 22:06:04 +03:00
alexey-milovidov
3e71b6ae07
Merge pull request #11845 from ClickHouse/loose-odbc-connection-string-validation
Slightly relax the validation of ODBC connection string
2020-06-22 21:19:30 +03:00
alesapin
ef89a6f728
Merge pull request #11786 from ClickHouse/fix_alter_with_materialized
Fix alter key when materialized column passed
2020-06-22 19:06:25 +03:00
alesapin
b4d89bd124 Fix comment 2020-06-22 16:31:16 +03:00
alesapin
afcf63ad89 Add alias for postgesql container 2020-06-22 16:29:35 +03:00
alesapin
588568f39c Disable MySQL tests under tsan 2020-06-22 16:10:25 +03:00
Alexey Milovidov
d3deed991e Fix bad test for LIVE VIEW 2020-06-22 15:49:38 +03:00
Alexander Kuzmenkov
ffc5b21bad Merge remote-tracking branch 'origin/master' into HEAD 2020-06-22 15:28:03 +03:00
alesapin
9612b3e32b Add data to test and simplify 2020-06-22 14:03:01 +03:00
Ivan Blinkov
2c0ff29c48 Merge branch 'master' of github.com:ClickHouse/ClickHouse into sentry 2020-06-22 10:06:36 +03:00
Alexey Milovidov
8cce416921 Added a test with another hostname 2020-06-22 01:12:35 +03:00
Alexey Milovidov
e9fb277e6c Make LIVE VIEW test less wrong (it was depending on the timing of progress messages) 2020-06-21 23:37:55 +03:00
alexey-milovidov
4ee623ccac
Merge pull request #10242 from MovElb/movelb-postgresql-wire-protocol-impl
PostgreSQL wire protocol implementation
2020-06-21 14:39:22 +03:00
Azat Khuzhin
bd45592539 Fix test_distributed_load_balancing flaps (due to config reload)
At startup, server loads configuration files.

However ConfigReloader does not know about already loaded files (files
is empty()), hence it will always reload the configuration just after
server starts (+ 2 seconds, reload timeout).

And on configuration reload the clusters will be re-created, so some
internal stuff will be reseted:
- error_count
- last_used (round_robing)

And if the reload will happen during round_robin test it will start
querying from the beginning, so let's issue config reload just after
start to avoid reload in the middle of the test execution.
2020-06-21 12:01:15 +03:00
Alexey Milovidov
25af2d0b0a Fix bad integration test "always_fetch_merged" 2020-06-20 21:21:29 +03:00
Azat Khuzhin
9bfda65134 Add a test for distributed_replica_max_ignored_errors 2020-06-20 11:21:08 +03:00
alesapin
4b6db63fff Fix alter key when materialized column passed 2020-06-19 13:53:20 +03:00
Mikhail Filimonov
9609bd9dee Kafka better states, formats based on PeekableReadBuffer, and other minor fixes.
Add formats tests, fixes for JSONCompactEachRowWithNamesAndTypes, TSVWithNamesAndTypes. Some CR fixes
Add sanitizing for kafka_max_block_size and kafka_poll_max_batch_size
2020-06-19 10:49:05 +02:00
Azat Khuzhin
4572b1ede7 Cover re-parsing of metadata from zookeeper 2020-06-17 21:05:26 +03:00
Vitaly Baranov
7011401cd4
Merge pull request #11670 from vitlibar/rbac-improve-parser-multiple-entities
RBAC: improve syntax
2020-06-17 16:26:02 +03:00
Nikita Mikhaylov
ff0262626a
Merge pull request #11645 from azat/load-balancing-round-robin
Add round_robin load_balancing
2020-06-17 14:34:59 +04:00
Nikita Mikhaylov
edec79cf69
Merge pull request #11703 from nikitamikhaylov/merging-alter-query
Merging #11508
2020-06-17 12:47:34 +04:00
Nikita Mikhaylov
ab04a6bb62
Merge pull request #11615 from azat/SYSTEM-FLUSH-LOGS-force-table-creation-v2
Force table creation on SYSTEM FLUSH LOGS (v2)
2020-06-17 11:09:19 +04:00
alexey-milovidov
8eb811140a
Merge pull request #11717 from ClickHouse/fix-test-mysql-federated
Added retries to test_mysql_federated
2020-06-17 09:26:33 +03:00
Alexey Milovidov
3e7ac1f9ab Added retries to test_mysql_federated 2020-06-16 23:52:31 +03:00
Alexey Milovidov
2024d2de54 Update test 2020-06-16 22:10:25 +03:00
Alexey Milovidov
bf4c82dbd8 Update test 2020-06-16 22:04:19 +03:00
Nikita Mikhaylov
fc06f99476 build and test fixes 2020-06-16 21:07:41 +03:00
Ivan Blinkov
7e2bb1fd83 Merge branch 'master' of github.com:ClickHouse/ClickHouse into sentry 2020-06-16 16:02:55 +03:00
franklee
264e44ecef support distributed DDLs on cross replication clusters.
(cherry picked from commit fd09994d91)
2020-06-16 11:53:27 +03:00
Anton Popov
b19d48a11c Merge remote-tracking branch 'upstream/master' into HEAD 2020-06-16 06:37:55 +03:00
Alexey Milovidov
bd330cfeb6 Update test 2020-06-16 05:56:50 +03:00
alexey-milovidov
9b734ffded
Update http_server.py 2020-06-16 03:21:20 +03:00
Anton Popov
a3ac224ae4 in-memory parts: sync insert to replicated 2020-06-15 22:57:12 +03:00
Vitaly Baranov
a40885fa84 Add new command SHOW ACCESS. 2020-06-15 22:07:47 +03:00
Vitaly Baranov
9fe47df2e8 Support multiple users/roles in SHOW CREATE USER(ROLE, etc.) and SHOW GRANTS FOR commands.
Support syntax "SHOW CREATE USER ALL" and "SHOW GRANTS FOR ALL".
2020-06-15 22:07:47 +03:00
Vitaly Baranov
4187edd9f9 Split integration test 'test_grant_and_revoke' into two tests. 2020-06-15 22:07:47 +03:00
Vitaly Baranov
4bd00b02e2 Improve syntax of CREATE QUOTA. Now resource types and key types could be written with underscores.
Also rename columns key_type=>keys and source=>storage in table system.quotas.
2020-06-15 20:10:34 +03:00
Vitaly Baranov
9f31184d76 Support for multiple names in one CREATE/ALTER command. 2020-06-15 20:10:28 +03:00
Alexander Tokmakov
def0158638 configure query handler as default 2020-06-15 14:33:44 +03:00
kssenii
9e1b8b2872 Better exchanges, fix build, better comments, better tests 2020-06-14 18:36:56 +00:00
zhang2014
e1317ef8ae ISSUES-7572 fix test failure 2020-06-14 09:44:05 +08:00
Azat Khuzhin
9386478a77 Add test for load_balancing algorithms 2020-06-14 01:09:22 +03:00
kssenii
dcd7b7351c Support headers-exchange type 2020-06-13 21:47:22 +00:00
kssenii
9c49398728 Fix tests 2020-06-13 18:44:17 +00:00
kssenii
3b0a3e00c0 Some fixes 2020-06-12 18:09:49 +00:00
zhang2014
8d9b770da4 ISSUES-7572 fix defaults config level & add replicas_status and prometheus handler 2020-06-13 00:15:02 +08:00
zhang2014
1c55aa0333 ISSUES-7572 add integration test 2020-06-12 18:19:03 +08:00
Azat Khuzhin
103eb17107 Force table creation on SYSTEM FLUSH LOGS (v2)
After this patch SYSTEM FLUSH LOGS will force system.*_log table
creatoins (only for enabled tables of course).

This will avoid such hacks like:

   set log_queries=1;
   select 1;
   system flush logs;

This is the second version of the patch, since first has a deadlock [1]
(reported by @alesapin). This version does not use separate lock and do
not issue CREATE TABLE from the query execution thread, instead it
activate flushing thread to do so, hence this should be the same as if
the table will be created during flush.

  [1]: https://gist.github.com/alesapin/d915d1deaa27d49aa31223daded02be2

Fixes: #11563
Cc: @alesapin
Cc: @nikitamikhaylov
2020-06-11 23:12:23 +03:00
kssenii
626eb53baa Fix multiple bindings for single queue & rm hardcoded strings 2020-06-11 11:13:13 +00:00
Ivan Blinkov
ce36f409c9 Merge branch 'master' of github.com:ClickHouse/ClickHouse into sentry 2020-06-11 13:34:58 +03:00
kssenii
9350472ee4 Support multiple bindings 2020-06-11 10:29:08 +00:00
alesapin
5a9a63e9a1
Revert "Force table creation on SYSTEM FLUSH LOGS" 2020-06-11 13:22:24 +03:00
Ivan Blinkov
b70ed921ea Merge branch 'master' of github.com:ClickHouse/ClickHouse into sentry 2020-06-11 12:22:13 +03:00
alexey-milovidov
8e9c2dbf85
Merge pull request #11582 from ClickHouse/fix_test_replica_fetch
Better integration test test_always_fetch_merged.
2020-06-11 06:51:56 +03:00
kssenii
18820814f5 Merge 2020-06-10 23:25:33 +00:00
kssenii
d7b2694806 Support all exchange types 2020-06-10 23:06:23 +00:00
Nikita Mikhaylov
425c20eeb8
Merge pull request #11563 from azat/SYSTEM-FLUSH-LOGS-force-table-creation
Force table creation on SYSTEM FLUSH LOGS
2020-06-11 02:03:34 +04:00
Nikita Mikhaylov
4bf46ed288
Merge pull request #11573 from nikitamikhaylov/copier-test-fix
Fix copier test
2020-06-11 00:38:27 +04:00
alexey-milovidov
123a017057
Merge pull request #11528 from azat/use_compact_format_in_distributed_parts_names-fix
Fix shard_num/replica_num for <node> (breaks use_compact_format_in_distributed_parts_names)
2020-06-10 22:02:51 +03:00
alesapin
e221a64c4b Better test 2020-06-10 18:56:18 +03:00
Nikita Mikhaylov
93b0d5b29b done 2020-06-10 15:47:34 +03:00
Ivan Blinkov
90ee4d52f4 merge master 2020-06-10 13:18:41 +03:00
Azat Khuzhin
8a78cffe5c Force table creation on SYSTEM FLUSH LOGS 2020-06-09 21:11:08 +03:00
Alexander Tokmakov
6bb68329f8 Merge branch 'master' into merging_external_source_cassandra 2020-06-09 19:51:14 +03:00
Ivan Blinkov
6f7064928f Merge branch 'master' of github.com:ClickHouse/ClickHouse into sentry 2020-06-09 19:07:57 +03:00
Ivan Blinkov
5b3fef526e Merge branch 'master' of github.com:ClickHouse/ClickHouse into sentry 2020-06-09 11:51:29 +03:00
MovElb
e6dcece2fd return tcp_port 2020-06-08 22:39:02 +03:00
Azat Khuzhin
eee2fb867a Update test_distributed_format to cover remote_servers via <node> 2020-06-08 22:32:06 +03:00
Azat Khuzhin
222bbe95d6 Cover load_balancing for Distributed INSERT w/o internal_replication 2020-06-08 21:58:56 +03:00
MovElb
fc981a2869 fix for review 2020-06-08 15:05:49 +03:00
alesapin
483c60fadd Merging #8377 2020-06-08 14:25:30 +03:00
kssenii
17e7cc03c0 Add consumer failure handler 2020-06-08 01:11:48 +00:00
tavplubix
686c0539db
Merge pull request #11487 from ClickHouse/improve_dns_cache
Use DNSResolver to check if user is allowed to connect from an address
2020-06-07 19:55:03 +03:00
Alexander Tokmakov
0cf8015f4a use DNSResolver to check if user is allowed to connect 2020-06-07 00:02:29 +03:00
Ivan
058821fa02
Merge branch 'master' into kafka_better_settings 2020-06-06 19:50:38 +03:00
Ivan
c8808e89fd
Update test.py 2020-06-06 19:48:03 +03:00
Ivan Blinkov
653a9afda0 Merge branch 'master' of github.com:ClickHouse/ClickHouse into sentry 2020-06-05 22:51:28 +03:00
alesapin
212df30fc5 Add test for different ttl versions 2020-06-04 17:18:54 +03:00
alesapin
b163052d1b
Merge pull request #11134 from GrigoryPervakov/custom-auth
Add default credentials and custom headers for s3 storage.
2020-06-04 16:46:01 +03:00
Mikhail Filimonov
26d93fdfba Fix the test, adjust default for queued.min.messages 2020-06-04 14:14:24 +02:00
Alexander Tokmakov
64c013610a fix 2020-06-04 01:03:49 +03:00
Alexander Tokmakov
e67837bc4a cleenup 2020-06-04 00:11:17 +03:00
Mikhail Filimonov
bf1e5db0ee Tests from issue #11308, from issue #4116 2020-06-03 19:01:45 +02:00
Anton Popov
1ce09e1faa Merge remote-tracking branch 'upstream/master' into polymorphic-parts 2020-06-03 16:27:54 +03:00
Alexander Tokmakov
e3aa20708a Merge branch 'master' into merging_external_source_cassandra 2020-06-03 14:55:02 +03:00
Alexander Tokmakov
73926b2cf9 support loading from multiple partitions with complex key 2020-06-03 14:54:26 +03:00
alesapin
d113a1cde7 More clear test 2020-06-02 21:47:30 +03:00
alesapin
6253e9b97b Revert disabled tests 2020-06-02 21:41:29 +03:00
alesapin
46fcff26b0 Disable flaky tests 2020-06-02 21:14:16 +03:00
Pervakov Grigorii
bc9381406f Add default credentials and custom headers for s3 table functions. 2020-06-02 20:48:49 +03:00
alesapin
ffa553ad91 Fix test 2020-06-02 18:11:51 +03:00
alesapin
e5a2ae4637 Remove unused import 2020-06-02 11:46:08 +03:00
alesapin
96ec552b51 Fix flaky ttl test 2020-06-02 11:42:42 +03:00
Ivan Blinkov
4bd678a3fd Merge branch 'master' of github.com:ClickHouse/ClickHouse into sentry 2020-06-02 08:21:30 +03:00
alesapin
5d54e18541 Fix sync_async test (remove timeout) 2020-06-01 22:35:56 +03:00
Ivan Blinkov
6bd4282727 Merge branch 'master' of github.com:ClickHouse/ClickHouse into sentry 2020-06-01 21:49:56 +03:00
kssenii
d3b069e37b Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into add-storage-rabbitmq-read-only 2020-06-01 18:25:36 +00:00
kssenii
5939422b85 Add tests for insert part 2020-06-01 17:02:14 +00:00
alexey-milovidov
19c6e0e5ae
Merge pull request #11307 from ClickHouse/remove-system-tables-lazy-load
Remove "system_tables_lazy_load" option
2020-06-01 16:26:23 +03:00
Alexander Tokmakov
62761eddcc Merge branch 'master' into merging_external_source_cassandra 2020-06-01 14:44:46 +03:00
Ivan Blinkov
89212fb174 Merge branch 'sentry' of github.com:blinkov/ClickHouse; branch 'master' of github.com:ClickHouse/ClickHouse into sentry 2020-06-01 14:14:44 +03:00
alesapin
c4d520d831 Fix part_log test 2020-06-01 12:12:52 +03:00
alesapin
c22e8f6b9b
Merge pull request #11283 from filimonov/kafka_virtual_column_headers
Virtual columns for Kafka headers
2020-06-01 12:06:00 +03:00
alesapin
364ebe9246
Merge pull request #11260 from filimonov/kafka_virtual_column_timestamp_ms
Add _timestamp_ms virtual columns to Kafka engine
2020-06-01 12:04:17 +03:00
Ivan Blinkov
fcc7ff0ef9 Merge branch 'master' of github.com:ClickHouse/ClickHouse into sentry 2020-06-01 08:42:03 +03:00
alexey-milovidov
92c56afed1
Merge pull request #11320 from ClickHouse/revert-revert-disable-flacky-tests
Disable flacky test #8840
2020-06-01 00:10:53 +03:00
alexey-milovidov
9a362eb02e
Merge pull request #11252 from filimonov/kafka-clientid
Kafka clientid (finishing #11073)
2020-05-31 18:37:30 +03:00
alexey-milovidov
fb1a2fa26b
Merge pull request #11256 from filimonov/librdkafka_1_4_2
Update librdkafka to version 1.4.2
2020-05-31 18:34:55 +03:00
Alexey Milovidov
5192ebdc23 Fix test with obsolete assumption 2020-05-31 18:10:52 +03:00
Alexey Milovidov
87cf123ef8 Merge branch 'master' into remove-system-tables-lazy-load 2020-05-31 18:06:08 +03:00
alexey-milovidov
ece21b353c
Merge pull request #11312 from ClickHouse/debug-bad-test
Debug bad test "mysql_federated"
2020-05-31 17:32:56 +03:00
Alexey Milovidov
2529df016a Disable flacky test #8840 2020-05-31 17:08:09 +03:00
kssenii
e80b405359 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into add-storage-rabbitmq-read-only 2020-05-31 10:30:53 +00:00
Alexey Milovidov
ff54b4c82b Retain some parts of the modification 2020-05-30 21:43:14 +03:00
Alexey Milovidov
9b4d6ac818 Revert test 2020-05-30 21:42:19 +03:00
alexey-milovidov
3eea042d16
Merge pull request #11243 from ClickHouse/remove-experimental-use-processors-flag-4
Remove some code.
2020-05-30 21:05:14 +03:00
MovElb
b4b5c90343 squash 2020-05-30 20:05:05 +03:00
Alexey Milovidov
6604b6aa18 Debug bad test "mysql_federated" 2020-05-30 20:03:28 +03:00
Alexey Milovidov
496fed5ed3 Remove "system_tables_lazy_load" option 2020-05-30 17:24:09 +03:00
Nikolai Kochetov
c43976b6c5 Update test. 2020-05-30 11:31:07 +03:00
Ivan Blinkov
95ee742ee7 merge master 2020-05-29 22:56:10 +03:00
Ivan Blinkov
4ef322274d Add integration test 2020-05-29 22:53:16 +03:00
Alexander Tokmakov
8921041706 Merge branch 'master' into merging_external_source_cassandra 2020-05-29 18:20:39 +03:00
alexey-milovidov
304c6a1ee3
Merge pull request #11278 from vitlibar/fix-crash-set-default-role-with-wrong-args
Fix crash when SET DEFAULT ROLE is called with wrong arguments.
2020-05-29 16:24:42 +03:00
Nikita Mikhaylov
9233997b24
Merge pull request #11233 from nikitamikhaylov/cache-getstring-bugfix
Cache-dictionary getString() bugfix
2020-05-29 16:32:35 +04:00
Mikhail Filimonov
b885337454 Virtual columns for accessing kafka message headers 2020-05-29 10:44:10 +02:00
Vitaly Baranov
2d12b4d3ac Fix crash when SET DEFAULT ROLE is called with wrong arguments. 2020-05-29 09:54:27 +03:00
Mikhail Filimonov
03430b1763 Change the test, accept new librdkafka behaviour 2020-05-28 23:11:29 +02:00
Mikhail Filimonov
e39c4cdf71 Add _timestamp_ms virtual columns to Kafka engine 2020-05-28 19:41:57 +02:00
Vitaly Baranov
d7cc703233
Merge pull request #11080 from vitlibar/add-authentication-type-to-system-users
Show authentication type in system.users table
2020-05-28 20:20:41 +03:00
Mikhail Filimonov
6b694d54b4 Better kafka client.id 2020-05-28 15:39:55 +02:00
Vitaly Baranov
98172deffc Show authentication type in table system.users and while executing SHOW CREATE USER query. 2020-05-28 08:34:10 +03:00
alexey-milovidov
b430af82e5
Merge pull request #11232 from vitlibar/add-test-row_policy-affects-only-user-assigned
Add a test for row policy
2020-05-28 01:16:48 +03:00
Alexander Tokmakov
905bce4aeb fix 2020-05-27 23:53:35 +03:00
Anton Popov
d8342e5b12 in-memory parts: better restore and clear stale wal files 2020-05-27 23:05:55 +03:00
Nikita Mikhaylov
ec479839d9 fixed 2020-05-27 22:44:22 +03:00
Alexander Kuzmenkov
640df68e05
Merge pull request #11184 from ClickHouse/enable-log-queries
Enable log_queries by default
2020-05-27 20:55:31 +03:00
Vitaly Baranov
bb0045a242 Add test for row policy that policy defined in users.xml affects only the user it assigned to. 2020-05-27 20:37:43 +03:00
Alexander Tokmakov
f099ce19a7 fix 2020-05-27 16:54:39 +03:00
alexey-milovidov
992f0dfec5
Merge pull request #11149 from filimonov/kafka_reschedule
Fixed reschedule issue in Kafka
2020-05-27 13:26:55 +03:00
alesapin
3399e573d1
Merge pull request #11199 from ClickHouse/fix_primary_key_method_call
Fix primary key check
2020-05-27 11:55:12 +03:00
Ivan Blinkov
d941c483b2
Update test.py 2020-05-27 11:25:36 +03:00
filimonov
c73b8372e7
Update test.py 2020-05-27 07:44:13 +02:00
Mikhail Filimonov
efc0b97707 Fix Kafka performance issue related to reschedules based on limits, which were always applied. 2020-05-27 07:39:06 +02:00
Alexander Tokmakov
940132adc4 Merge branch 'master' into merging_external_source_cassandra 2020-05-27 00:13:57 +03:00
Ivan Blinkov
4a92ad11ec
Update test.py 2020-05-26 23:27:31 +03:00
Alexander Tokmakov
310d522528 minimal implementation 2020-05-26 22:21:18 +03:00
kssenii
ad1c0de8db Merge 2020-05-26 17:45:39 +00:00
kssenii
14c67c6ae6 Fixes 2020-05-26 17:34:57 +00:00
Vitaly Baranov
2c8a355f19
Merge pull request #11081 from vitlibar/fix-no-password-mode
Fix settings NO_PASSWORD authentication mode in users.xml.
2020-05-26 14:20:34 +03:00
alesapin
5780240e88 Fix primry key check 2020-05-26 12:46:04 +03:00
alexey-milovidov
d4acd1af3a
Merge pull request #11179 from excitoon-favorites/s3globfix
Fixed S3 globbing which could fail in case of more than 1000 keys and some backends
2020-05-26 02:45:42 +03:00
filimonov
73a0ef6c0e
Fix for the hang during deletion of engine=Kafka (one more time) (#11145)
* Added flag for safer rdkafka destruction, but more testing detected another hang case, which has no straigt solutions and can be workarounded currenly only by draining the consumer queue, so destructor is back

* After review fixes

* After review fixes2

* After review fixes3
2020-05-26 00:13:10 +03:00
alexey-milovidov
7201018079
Update test.py 2020-05-26 00:05:15 +03:00
Vladimir Chebotarev
e013edce4b Added test for multi-page S3 globbing. 2020-05-25 15:57:27 +03:00
Vitaly Baranov
eeb4cbc433 Fix settings NO_PASSWORD authentication mode in users.xml. 2020-05-25 11:35:26 +03:00
alesapin
73458c1574
Merge pull request #8840 from excitoon-favorites/returnttltests
Revert "Disable some flappy tests"
2020-05-25 11:29:07 +03:00
Alexander Tokmakov
ac54d470da Merge branch 'master' into merging_external_source_cassandra 2020-05-22 17:27:40 +03:00
Pavel Kovalenko
1165c44acf Enable test_replicated_mergee_tree_s3 2020-05-22 14:55:30 +03:00
Pavel Kovalenko
89b9fb6d41 Create 'root' S3 bucket before CH is started. 2020-05-22 14:48:08 +03:00
alexey-milovidov
b82c633716
Merge pull request #11048 from filimonov/kafka_missed_data_during_drop
Fixes the potential missed data during termination of Kafka engine table
2020-05-22 14:11:10 +03:00
alesapin
138e4562f3 Skip flacky test 2020-05-22 13:38:56 +03:00
alesapin
b9dfa61774
Merge pull request #11042 from CurtizJ/modify-ttl
Apply TTL for old data, after ALTER MODIFY TTL query
2020-05-22 11:12:14 +03:00
Alexander Kuzmenkov
fecd84d3c0
Merge pull request #10915 from ClickHouse/aku/mongodb-uri
Support MongoDB URI
2020-05-21 23:02:12 +03:00
Alexander Tokmakov
f40fadc3d6 fix segfault 2020-05-21 18:29:18 +03:00
alexey-milovidov
4a237faede
Merge pull request #11074 from Jokser/memory-leak-in-register-disk-s3
Fix memory leak in registerDiskS3
2020-05-21 12:42:46 +03:00
Alexander Tokmakov
31b6f5f0d2 Merge branch 'master' into merging_external_source_cassandra 2020-05-20 23:44:53 +03:00
Alexander Tokmakov
4b30b3168c try fix build 2020-05-20 23:26:39 +03:00
kssenii
4dc659b763 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into add-storage-rabbitmq-read-only 2020-05-20 18:17:41 +00:00
alexey-milovidov
07924f0ae1
Merge pull request #11029 from azat/system_tables_lazy_load
Disable system_tables_lazy_load by default
2020-05-20 21:15:09 +03:00
Pavel Kovalenko
d98c1589ed Better error handling in Proxy Resolver. 2020-05-20 19:01:05 +03:00
Anton Popov
d62fe980ef Merge remote-tracking branch 'upstream/master' into modify-ttl 2020-05-20 16:52:30 +03:00
Vladimir Chebotarev
c0947ab609 Minor fixes in test_ttl_move. 2020-05-20 12:59:06 +03:00
Vladimir Chebotarev
a9a7da8e68 Fixed test_ttl_move::test_alter_multiple_ttls. 2020-05-20 12:59:06 +03:00
Vladimir Chebotarev
b9f35aad02 Revert "Disable some flappy tests"
This reverts commit e6958c0e49.
2020-05-20 12:59:06 +03:00
kssenii
1760f01f74 Add tests for RabbitMQ read-only part 2020-05-20 09:42:56 +00:00
kssenii
41b99edc04 Add base for RabbitMQ integration tests 2020-05-20 09:22:12 +03:00
Anton Popov
bd3e7307d0 fix integration test 2020-05-20 01:43:16 +03:00
Alexander Kuzmenkov
bc34e0ff94 fixup 2020-05-19 23:12:10 +03:00
Mikhail Filimonov
b50480cbde Fixes the potential missed data during termination of Kafka engine table 2020-05-19 18:55:37 +02:00
alesapin
a17f034271 Bump compose version to 2.3, and make tmpfs for zookeeper optional 2020-05-19 18:27:10 +03:00
Anton Popov
35b916433a fix TTL with defaults after modify 2020-05-19 16:06:35 +03:00
Azat Khuzhin
f57ac3d3f0 Update test_part_log_table
- system_tables_lazy_load
- SYSTEM FLUSH LOGS
2020-05-19 10:47:47 +03:00
Azat Khuzhin
249a1eb7f9 Fix test_server_initialization, but looking into default database only 2020-05-19 10:43:37 +03:00
Alexander Tokmakov
175b7aedf3 Merge branch 'master' into merging_external_source_cassandra 2020-05-19 05:21:27 +03:00
Azat Khuzhin
04aa6dd7e3 Update test_system_tables_lazy_load to cover both cases and make it run 2020-05-19 03:03:45 +03:00
alesapin
b4652625c7 Try to enable skipped tests 2020-05-18 13:02:52 +03:00
alexey-milovidov
6d34f24605
Merge branch 'master' into complex_key_direct 2020-05-17 11:55:01 +03:00
alexey-milovidov
7ee35f102d
Merge pull request #10867 from azat/dist-INSERT-load-balancing
Respect prefer_localhost_replica/load_balancing on INSERT into Distributed
2020-05-17 11:11:35 +03:00
alexey-milovidov
5297d1e86a
Merge pull request #10928 from vitlibar/check-access-once-for-dictget
dictGet() checks access once
2020-05-17 09:27:59 +03:00
alexey-milovidov
a3346e9331
Merge pull request #10912 from ClickHouse/static-mutate
Static mutate
2020-05-17 09:05:35 +03:00
alexey-milovidov
0fd0711b51
Merge pull request #10910 from filimonov/kafka_drop_hang_fix
Fix for the hang during deletion of engine=Kafka
2020-05-17 07:13:54 +03:00
alesapin
d0b56a4c7d
Merge pull request #10887 from ClickHouse/vzakaznikov-add_alter_rename_column_to_distributed
Vzakaznikov add alter rename column to distributed
2020-05-16 12:54:32 +03:00
Nikolai Kochetov
c957154fef
Merge pull request #10952 from ClickHouse/fix-distributed-queries-incompatibility-19.16-20.1
Fix incompatibility of two-level aggregation between 19.16 and 20.1
2020-05-16 10:17:15 +03:00
tavplubix
cc4ddfd89e
Merge pull request #10901 from ClickHouse/merging_10554
Merging #10554
2020-05-15 23:23:02 +03:00
Mikhail Filimonov
791f3a6c90 Merge branch 'kafka_drop_hang_fix' of github.com:filimonov/ClickHouse into kafka_drop_hang_fix 2020-05-15 22:20:45 +02:00
Mikhail Filimonov
405cce2c53 Another variant of fix. It looks like we do not need destructor at all 2020-05-15 22:19:21 +02:00
Nikolai Kochetov
fb38c2a30b
Remove experimental_use_processors setting, part 1. (#10924)
Remove experimental_use_processors setting, part 1.
2020-05-15 22:28:10 +03:00
Nikolai Kochetov
7d6ac4a87b Added test. 2020-05-15 22:21:30 +03:00
Nikolai Kochetov
c4a07812f7 Try fix build. 2020-05-15 18:48:19 +03:00
alesapin
6fb9a19a40 Ignore some tests 2020-05-15 17:33:50 +03:00
Anton Popov
c61f1dbac8 Merge remote-tracking branch 'upstream/master' into polymorphic-parts 2020-05-15 16:19:39 +03:00
Anton Popov
11b4bc7189
Merge pull request #10889 from CurtizJ/tuple-literal
Fix backward compatibility with tuples and distributed.
2020-05-15 15:39:03 +03:00
Vitaly Baranov
d92ac9ea47
Merge branch 'master' into RBAC-10 2020-05-15 14:12:43 +03:00
Артем Стрельцов
be731ad62e Merge branch 'master' of github.com:yandex/ClickHouse into complex_key_direct 2020-05-15 12:01:09 +03:00
Anton Popov
14e1a46a8c Merge remote-tracking branch 'upstream/master' into polymorphic-parts 2020-05-15 03:48:27 +03:00
Anton Popov
4c03f48703 in-memory parts: better restoring 2020-05-15 03:39:15 +03:00
Vitaly Baranov
201c88f64f Get dictionary and check access rights only once per each call of any function reading external dictionaries. 2020-05-15 03:14:14 +03:00
Alexander Tokmakov
6a496ce9dc better test 2020-05-15 00:51:21 +03:00
Anton Popov
4c0cbc78a9 trigger CI 2020-05-14 23:44:52 +03:00
Alexander Kuzmenkov
99d50063f3 Support MongoDB URI 2020-05-14 14:36:49 +03:00
Vitaly Baranov
c30587196a Add system tables for users, roles and grants. 2020-05-14 14:12:20 +03:00
Vitaly Baranov
a14f322723 Add system tables for settings profiles. 2020-05-14 14:12:15 +03:00
filimonov
f97c14f7be
bit better comment 2020-05-14 12:18:17 +02:00
Mikhail Filimonov
6499d702f9 After review fixes 2020-05-14 12:15:38 +02:00
Mikhail Filimonov
a1013f1e71 Fix for the hang during deletion of engine=Kafka 2020-05-14 10:38:02 +02:00
Azat Khuzhin
dac0b7d1f5 Create table with the same load_balancing policy in test_insert_distributed_load_balancing 2020-05-14 03:29:03 +03:00
alexey-milovidov
f8195a577c
Merge pull request #10744 from Jokser/s3-proxy-resolver
S3 with proxy resolver
2020-05-14 02:19:10 +03:00
Azat Khuzhin
de1d529e86 Cover nearest_hostname in test_insert_distributed_load_balancing 2020-05-14 01:50:56 +03:00
Alexander Tokmakov
b1ed51df6e add simple test 2020-05-13 22:47:35 +03:00
Vitaly Baranov
5b84121d81 Improve system tables for quotas. Remove function currentQuota(). 2020-05-13 19:40:48 +03:00
Vitaly Baranov
e64e2ebdf6 Improve system table for row policies. Remove function currentRowPolicies(). 2020-05-13 19:40:48 +03:00
Vitaly Baranov
9a89a04c1f Improve TSV class in test tools: now it can get a table as a list of lists. 2020-05-13 19:40:48 +03:00
Vitaly Baranov
dd8b29b4fb Use enum Type instead of std::type_index to represent the type of IAccessEntity.
This change simplifies handling of access entities in access storages.
2020-05-13 19:40:48 +03:00
alesapin
774f9fccc5
Update test.py 2020-05-13 18:25:55 +03:00
Anton Popov
d13a11b421 fix backward compatibility with tuples and distributed 2020-05-13 17:14:05 +03:00
alesapin
1c4564d9ed Simplify rename tests 2020-05-13 15:56:32 +03:00
alesapin
352c402cf2 Merge branch 'add_alter_rename_column_to_distributed' of https://github.com/vzakaznikov/ClickHouse into vzakaznikov-add_alter_rename_column_to_distributed 2020-05-13 14:14:23 +03:00
Azat Khuzhin
0ea3411137 Add integration test for load balancing for Distributed INSERT 2020-05-13 02:51:17 +03:00
alesapin
35a9a203f1
Update test.py 2020-05-12 18:01:43 +03:00
Артем Стрельцов
10f6817fdd added new layout to integration test 2020-05-12 18:00:08 +03:00
Vitaliy Zakaznikov
3505ccc2fc Increasing zookeeper_session_timeout setting to 15 sec. 2020-05-11 20:27:19 +02:00
Vitaliy Zakaznikov
1efc372c0c Fixing test_rename_with_parallel_select. 2020-05-11 20:09:45 +02:00
alexey-milovidov
ddc84163a7
Merge pull request #10486 from azat/dist-send-on-INSERT
Fix distributed send that are scheduled by INSERT query
2020-05-11 06:28:35 +03:00
Vitaliy Zakaznikov
089371ddfb Reverting test so that it can pass. 2020-05-08 14:48:24 +02:00
Vitaliy Zakaznikov
dd5dd5de32 Updating test_rename_with_parallel_ttl_move to check if parts got moves.
Adding renaming of the time column used inside the TTL expression after insert.
2020-05-08 13:35:50 +02:00
Pavel Kovalenko
5cc0927874 Add comment explaining protocol for proxy resolver configuration. 2020-05-08 14:07:26 +03:00
Pavel Kovalenko
8602f7b47c Minor updates in proxy resolver parameters naming. 2020-05-08 13:58:56 +03:00
Pavel Kovalenko
6165c2aa99 Add possibility to use proxy resolver in DiskS3. 2020-05-08 13:53:12 +03:00
Vitaliy Zakaznikov
eb3c6ca0d8 Adding configuration files. 2020-05-08 12:36:37 +02:00
Vitaliy Zakaznikov
65f139f374 Adding more integration tests for alter rename column. 2020-05-07 21:00:17 +02:00
Vitaliy Zakaznikov
abe28968f4 Adding tests. 2020-05-07 15:50:42 +02:00
alexey-milovidov
eeac7aa313
Merge pull request #10622 from kekekekule/layout_direct
Add direct layout for dictionaries
2020-05-07 01:05:29 +03:00
Артем Стрельцов
b2993c314c fixes relevant to review 2020-05-07 00:59:31 +03:00
alexey-milovidov
4df7dd8c2b
Merge pull request #10656 from azat/kafka-consumer-hang
Kafka cleanup
2020-05-07 00:20:31 +03:00
Anton Popov
387041a97e Merge remote-tracking branch 'upstream/master' into polymorphic-parts 2020-05-06 19:22:07 +03:00
Anton Popov
4878c91d07 in-memory parts: better restore from wal 2020-05-06 14:57:38 +03:00
Артем Стрельцов
1428188e21 fixed test for direct layout & fixed data load for FileDictionarySource 2020-05-06 03:52:13 +03:00
Azat Khuzhin
7ab0c3493c Add integration test for kafka consumer hang
This test triggers heartbeat failrues which leads to
REBALANCE_IN_PROGRESS which causes hang.
2020-05-04 18:46:30 +03:00
Alexey Milovidov
7ddad8cc01 Fix integration test 2020-05-04 17:51:29 +03:00
Azat Khuzhin
fc5f0bfe52 Enable librdkafka debugging in test_storage_kafka 2020-05-04 17:23:09 +03:00
Azat Khuzhin
12871bf26e Drop resolved TODO from test_storage_kafka 2020-05-04 17:23:09 +03:00
Nikolay Degterinsky
a3e557a5d2 documentation is added & added 'direct' layout into integragion test 2020-05-03 15:55:22 +03:00
Azat Khuzhin
14fccf572f Fix false-positive failures of the test_distributed_storage_configuration
After first INSERT for disk2 there should not be created any per-shard
directory, so find(1) should report an error, like:

  find: '/disk2/data/test/dist_foo/default@127%2E0%2E0%2E2:9000': No such file or directory"

But sometimes output can be fixed, and output of wc(1) will goes first
and python's int() will parse it and not fail, but if find(1) stderr
will goes first the int() will fail to parse.

And here is an example of such mixing:

  $ docker run --name alpine --rm -it alpine top
  $ docker exec alpine sh -c 'echo foo >&2 | wc -c'
  foo
  0
  $ docker exec alpine sh -c 'echo foo >&2 | wc -c'
  0
  foo
2020-05-03 14:48:00 +03:00
Azat Khuzhin
0a75dc626b Add some comments int test_distributed_storage_configuration 2020-05-03 14:46:44 +03:00
alexey-milovidov
a235533d5f
Merge pull request #10576 from Jokser/s3-with-dynamic-proxies
S3 with dynamic proxy configuration
2020-05-03 01:25:13 +03:00
alexey-milovidov
d38ea6fc1c
Merge pull request #10608 from ClickHouse/fix_drop_dns_cache
Improve DROP DNS CACHE
2020-05-02 22:10:58 +03:00
Alexander Tokmakov
9ca144cab9 drop access cache on DROP DNS CACHE 2020-05-01 01:29:47 +03:00
Anton Popov
aa723d245f Merge remote-tracking branch 'upstream/master' into polymorphic-parts 2020-04-30 18:27:39 +03:00
alesapin
15e8f37839
Merge pull request #10531 from CurtizJ/polymorphic-parts-2
Fix index corruption in merges with compact parts.
2020-04-30 12:15:25 +03:00
Anton Popov
42997bce86 im-memory parts: replication 2020-04-29 20:14:49 +03:00
Pavel Kovalenko
e5e84960ea S3 with proxy integration test and fixes. 2020-04-29 11:40:29 +03:00
Anton Popov
1789d6fa82 add a test just in case 2020-04-29 02:07:11 +03:00
tavplubix
11c3493676
Merge pull request #10547 from ClickHouse/zhang2014/feature/ISSUES-5436
Merging #7572
2020-04-28 12:40:48 +03:00
Alexander Tokmakov
5a1d22a363 remove redundant configs from test 2020-04-28 02:05:15 +03:00
Alexander Tokmakov
e72a484beb minor fixes 2020-04-28 02:05:15 +03:00
Anton Popov
eaf80c5f18 add integration test for compact parts 2020-04-27 16:37:05 +03:00
zhang2014
81230944a4 ISSUES-5436 add integration test 2020-04-27 18:49:32 +08:00
Alexander Tokmakov
04d6b59ac0 Merge branch 'master' into database_atomic 2020-04-23 17:31:37 +03:00
zhang2014
0070f75218 ISSUES-5436 fix integration test failure & add test 2020-04-23 17:11:20 +08:00
alexey-milovidov
829a7a551c
Merge pull request #10446 from CurtizJ/fix-mysql-test
Fix mysql integration test
2020-04-23 00:25:25 +03:00
Nikita Mikhaylov
3cf2016867
Merge pull request #10188 from nikitamikhaylov/quorum_bug
insert_quorum vs drop partition or ttl
2020-04-23 00:11:57 +04:00
Anton Popov
47213ebfe1 fix mysql test 2020-04-22 23:09:07 +03:00
Nikita Mikhaylov
f1ee08778f
Merge pull request #10414 from nikitamikhaylov/copier-sample-offset
cluster copier with sample offset
2020-04-22 20:31:17 +04:00
Alexander Tokmakov
fefbbd37df Merge branch 'master' into database_atomic 2020-04-22 17:02:30 +03:00
Nikita Mikhaylov
1d5d6582a0 fix test 2020-04-22 14:35:18 +03:00
alexey-milovidov
7065a8ba9c
Merge pull request #10422 from azat/fallback_to_stale_replicas-over-skip_unavailable_shards
Prefer fallback_to_stale_replicas over skip_unavailable_shards
2020-04-22 09:20:25 +03:00
Azat Khuzhin
e0f58b1ca1 Cover fallback_to_stale_replicas in conjunction with skip_unavailable_shards 2020-04-22 01:47:22 +03:00
Nikita Mikhaylov
15de7e4fa7 first try 2020-04-21 20:37:40 +03:00
alesapin
dec2e65aa5 Add test for alter on cluster 2020-04-21 16:47:00 +03:00
Ilya Yatsishin
82b0f31e37
Merge pull request #10335 from qoega/move_docker_to_docker
Move integration tests docker files to docker/ directory.
2020-04-21 15:10:42 +03:00
Nikita Mikhaylov
2173bcf28e Merge branch 'master' of github.com:ClickHouse/ClickHouse into quorum_bug 2020-04-21 14:35:06 +03:00
alexey-milovidov
4ecc86beca
Merge pull request #9950 from ClickHouse/aku/literal-columns
Create unique columns for literals
2020-04-21 02:30:17 +03:00
tavplubix
1a067484c8
Merge pull request #10137 from kekekekule/direct_queries
Add custom settings support for certain dictionary sources
2020-04-21 01:21:32 +03:00
alexey-milovidov
ab922d44d5
Merge pull request #10379 from ClickHouse/only_fetch_repliac
Add setting always_fetch_merged_part
2020-04-21 00:07:00 +03:00
alexey-milovidov
69b6f135e7
Merge pull request #10382 from excitoon-favorites/altercodec
Allowed to alter column in non-modifying data mode when the same type is specified
2020-04-20 22:54:53 +03:00
Alexander Kuzmenkov
da7eeb31d0
Update test.py 2020-04-20 22:37:50 +03:00
alesapin
e1fa39d801 fix test 2020-04-20 18:17:34 +03:00
Alexander Kuzmenkov
672c952d39
Update test.py 2020-04-20 17:44:21 +03:00
Vladimir Chebotarev
82985ff594 Allowed to alter column in non-modifying data mode when the same type is specified. 2020-04-20 14:15:06 +03:00
Alexander Tokmakov
b29bddac12 Merge branch 'master' into database_atomic 2020-04-20 14:09:09 +03:00
alesapin
1bc84ec8b4 Fix comments 2020-04-20 13:56:23 +03:00
alesapin
8767ea7efa Add setting which restrict replica to merge parts by itself and always prefer dowloading from other replicas. 2020-04-20 13:53:29 +03:00
alexey-milovidov
e2d85501fe
Merge pull request #10366 from ClickHouse/fix-test-insert-batching
Fix flacky integration test
2020-04-20 10:53:38 +03:00
Alexey Milovidov
e06dc573b4 Fix flacky integration test 2020-04-20 06:15:29 +03:00
Alexey Milovidov
99667a38c3 Added a test from Svyatoslav Tkhon Il Pak @DeifyTheGod #9642 2020-04-19 22:56:34 +03:00
zhang2014
8105a9bbe0 ISSUES-5436 fix review suggestions 2020-04-20 02:26:06 +08:00
tai
dafba9d66a ISSUES-5436 add integration test for custom http 2020-04-20 02:25:43 +08:00
alexey-milovidov
aac7cc7330
Merge pull request #10126 from Jokser/replicated-merge-tree-s3
Support ReplicatedMergeTree over S3
2020-04-18 16:13:04 +03:00
alexey-milovidov
bdc8dfe04b
Added a change from @azat in #10277 2020-04-18 14:48:51 +03:00
Vitaly Baranov
b9ea0a33a7 Fix flaky test test_settings_constraints_distributed. 2020-04-18 11:23:11 +03:00
Артем Стрельцов
948efff076 Merge branch 'master' of github.com:yandex/ClickHouse into direct_queries 2020-04-17 23:11:10 +03:00
Yatsishin Ilya
a0ce15befd Move integration tests docker files to docker/ directory. Rename image -> runner. 2020-04-17 19:01:16 +03:00
Yatsishin Ilya
f2136bc286 improvements 2020-04-17 11:42:51 +03:00
Nikita Mikhaylov
9a80eb6e47 Merge branch 'master' of github.com:ClickHouse/ClickHouse into quorum_bug 2020-04-16 21:47:34 +03:00
alesapin
9bf8f00c3d Fix test 2020-04-15 20:52:05 +03:00
alexey-milovidov
2a48b0ecd7
Merge pull request #10184 from xzkostyan/feature-zookeeper-ssl
Optional secured communication between ClickHouse and Zookeeper
2020-04-15 07:09:14 +03:00
Nikita Mikhaylov
91011bc700
bump 2020-04-15 03:04:12 +04:00
Nikita Mikhaylov
89dc40d492
Update test.py 2020-04-14 21:05:10 +03:00
Yatsishin Ilya
dcec80e6dd update README in intergration 2020-04-14 10:15:02 +03:00
Yatsishin Ilya
51567df6e6 output call duration in junit report 2020-04-14 10:15:01 +03:00
Yatsishin Ilya
e5be0c1059 fix integration/test_distributed_ddl/test_replicated_alter 2020-04-14 10:15:01 +03:00
Nikita Mikhaylov
89f80a6353
Merge branch 'master' into quorum_bug 2020-04-13 23:25:55 +04:00
Alexander Tokmakov
6c0d9723e0 Merge branch 'master' into database_atomic 2020-04-13 18:47:47 +03:00
Nikita Mikhaylov
441bb13d4a better 2020-04-13 18:21:05 +03:00
Nikita Mikhaylov
d5c055ab03 remove logs 2020-04-13 15:13:13 +03:00
Pavel Kovalenko
46c0b65c95 Minor fix in MergeTree over S3 tests. 2020-04-13 12:20:38 +03:00
Konstantin Lebedev
df28eca407 Add test for communication between ClickHouse and Zookeeper over SSL 2020-04-13 10:49:16 +03:00
Konstantin Lebedev
eaba5c6c73 Remove mutable defaults from helpers/cluster.py 2020-04-12 17:36:48 +03:00
Alexander Tokmakov
5e6d4b9449 Merge branch 'master' into database_atomic 2020-04-12 16:35:44 +03:00
BohuTANG
e7f399f652 MySQLHandler: max_allowed_packet returned by default when server setup with select variables 2020-04-12 13:37:39 +08:00
alexey-milovidov
9203db0ad5
Merge pull request #10140 from BohuTANG/20200409_bug_fix_mysql_handshake_scramble
Fix scramble issue for native mysql-connector-java(JDBC)
2020-04-12 03:53:19 +03:00
alexey-milovidov
30ec2a3ce2
Merge pull request #10179 from vzakaznikov/live_view_over_distributed
Initial support for live view tables over distributed
2020-04-12 01:41:42 +03:00
Nikita Mikhaylov
a8d72d01c3 mvp fix 2020-04-11 00:29:54 +03:00
Vitaly Baranov
ca634f603a Revert resetting the settings to their defaults after each query in TCPHandler. 2020-04-10 21:09:59 +03:00
Vitaliy Zakaznikov
7d076d7f3d Removing comments. 2020-04-10 14:09:28 -04:00
Vitaliy Zakaznikov
16c10851d3 Adding more tests to test_distributed_over_live_view.
Updating test_live_view_over_distributed to be more robust.
2020-04-10 13:47:47 -04:00
Vitaliy Zakaznikov
c37ba8243d Starting to add test_distributed_over_live_view tests. 2020-04-10 13:01:10 -04:00
Артем Стрельцов
758500893e fixed test 2020-04-10 19:09:44 +03:00
Vitaliy Zakaznikov
201c65f49b Adding test_live_view_over_distributed integration test. 2020-04-10 11:23:04 -04:00
Alexander Tokmakov
033d7f9b32 Merge branch 'master' into database_atomic 2020-04-10 17:12:09 +03:00
BohuTANG
87cc8de8e2 Merge remote-tracking branch 'ck/master' into 20200409_bug_fix_mysql_handshake_scramble 2020-04-10 11:10:41 +08:00
Alexander Tokmakov
a6d0aacd53 fix test 2020-04-09 21:02:27 +03:00
Pavel Kovalenko
ee36750482 Set storage policy explicitly in MergeTree over S3 tests. 2020-04-09 18:36:13 +03:00
Артем Стрельцов
5a70a77c4a Merge branch 'master' into direct_queries 2020-04-09 17:29:37 +03:00
Vitaly Baranov
4d93577791 PREWHERE can be used now by user without row filtering. 2020-04-09 10:22:51 +03:00
Vitaly Baranov
d548c7e381 Simplify DCL for creating quotas. 2020-04-09 10:22:51 +03:00
Vitaly Baranov
23ac1ee87c readonly user now can execute SHOW CREATE for access entities. 2020-04-09 10:22:51 +03:00
Vitaly Baranov
c97d12a19c Enable access management by default for all integration tests. 2020-04-09 10:22:51 +03:00
Vitaly Baranov
36a5b57ac4 Use "CREATE SETTINGS PROFILE name SETTINGS INHERIT parent" instead of "CREATE SETTINGS PROFILE name SETTINGS PROFILE parent". 2020-04-09 10:22:51 +03:00
BohuTANG
17256e0f1e add java client integation tests 2020-04-09 10:53:40 +08:00
Konstantin Lebedev
b666f60af8 Optional secured communication between ClickHouse and Zookeeper 2020-04-09 01:40:54 +03:00
BohuTANG
f48fdda678
Enhanced compatibility with native mysql-connector-java(JDBC) (#10021)
* Skip the `/* comments */ SELECT @@variables ...` from mysql-connector-java setup for MySQL Handler #9336

mysql-connector setup query:
/* mysql-connector-java-5.1.38 ( Revision: ${revinfo.commit} ) */SELECT  @@session.auto_increment_increment AS auto_increment_increment, @@character_set_client AS character_set_client, @@character_set_connection AS character_set_connection, @@character_set_results AS character_set_results, @@character_set_server AS character_set_server, @@init_connect AS init_connect, @@interactive_timeout AS interactive_timeout...

ClickHouse side Error:
{} <Error> executeQuery: Code: 62, e.displayText() = DB::Exception: Syntax error: failed at position 74: @@session.auto_increment_increment AS auto_increment_increment, @@character_set_client AS character_set_client, @@character_set_connection AS character_set_conn. Expected one of: CAST, NULL...

Client side Exception:
java.sql.SQLException: Syntax error: failed at position 74: @@session.auto_increment_increment AS auto_increment_increment, @@character_set_client AS character_set_client, @@character_set_connection AS character_set_conn. Expected one of: CAST...

* add repalce 'SHOW VARIABLES' for mysql-connector-java-5.1.34 #9336

* Add java client(JDBC) integration test to test_mysql_protocol

* shift out java tests from dbms

* Update MySQLHandler.cpp

* Update MySQLHandler.cpp

* test_mysql_protocol: add Test.java exit code 1 when expection

Co-authored-by: alexey-milovidov <milovidov@yandex-team.ru>
2020-04-09 00:52:19 +03:00
Артем Стрельцов
c0051d9cd9 fixed bug with ClickHouseDictionarySource & test for all sources added 2020-04-09 00:48:00 +03:00
alexey-milovidov
db4270b60c
Merge pull request #10077 from zhang2014/fix/ISSUES-10056
ISSUES-10056 support identifier argument for MySQL Database engine
2020-04-08 22:59:09 +03:00
Alexander Tokmakov
dd1590830b Merge branch 'master' into database_atomic 2020-04-08 22:00:46 +03:00
zhang2014
9eb96b87db ISSUES-10056 reused evaluateConstantExpressionOrIdentifierAsLiteral 2020-04-09 01:31:28 +08:00
zhang2014
9ed708b902 ISSUES-10056 add some check and support identifier argument for MySQL Database Engine 2020-04-09 01:31:27 +08:00
Pavel Kovalenko
eca6caa8db Integration tests for MergeTree over S3 code cleanup. 2020-04-08 15:48:16 +03:00
Pavel Kovalenko
89fe81ed62 Integration test for ReplicatedMergeTree over S3 fixes. 2020-04-08 14:56:31 +03:00
Pavel Kovalenko
bc349a563a Merge branch 'master' into replicated-merge-tree-s3 2020-04-08 13:53:30 +03:00
Pavel Kovalenko
4ec77fee8b Integration test for ReplicatedMergeTree over S3. 2020-04-08 13:53:17 +03:00
alesapin
ded306f016 Fix adaptive granularity compatibility 2020-04-08 12:51:04 +03:00
alexey-milovidov
6d80ab1eed
Merge pull request #9811 from vitlibar/RBAC-8
RBAC-8
2020-04-08 05:47:55 +03:00
Alexander Tokmakov
135197aa75 fixes 2020-04-08 04:02:00 +03:00
alexey-milovidov
09a397a68f
Merge pull request #9997 from azat/dist-on-dist-fixes
Fix Distributed-over-Distributed with one only shard in nested table
2020-04-08 03:45:29 +03:00
alexey-milovidov
d20dfea6ed
Merge pull request #10095 from ClickHouse/fix_replica_start_from_old_version
Fix replicated tables startup when updating from old version
2020-04-08 02:11:12 +03:00
Vitaly Baranov
42b8ed3ec6 Implement "ON CLUSTER" clause for access control SQL. 2020-04-07 23:31:59 +03:00
Vitaly Baranov
bc3e2cb48c Add the option "access_control_path" to server config. 2020-04-07 23:31:59 +03:00
Vitaly Baranov
b71ff6160a Add the "access_management" option to users.xml which enables a user to manage access rights.
The option is turned off by default.
2020-04-07 23:31:54 +03:00
Vitaly Baranov
e5d8f05251 Rename sql command "CREATE POLICY" -> "CREATE ROW POLICY", "CREATE POLICY" is now an alias. 2020-04-07 23:20:38 +03:00
alesapin
82a87bc0d2 Fix replicated tables startup when updating from old version 2020-04-07 18:28:29 +03:00
Olga Khvostikova
834e458f26 Fix behaviour of globs in filepath with leading zeros 2020-04-07 16:46:12 +03:00
Nikita Mikhaylov
0c0eff36d1 move 2020-04-06 23:34:04 +03:00
alesapin
f0124ffc2b Fix runner script 2020-04-06 21:30:51 +03:00
Alexander Tokmakov
08bae4668d Merge branch 'master' into database_atomic 2020-04-06 16:18:07 +03:00
Vasily Nemkov
b441e8a408 Integration test for Distributed over Distributed (from #8640) 2020-04-04 13:47:34 +03:00
Alexander Tokmakov
9c67d2716e Merge branch 'master' into database_atomic 2020-04-03 03:19:11 +03:00
alesapin
918e145ea5 Fix integration test 2020-04-02 11:51:21 +03:00
Ivan Lezhankin
c0a595355a Move more dbms/tests to top-level 2020-04-02 03:32:39 +03:00
Ivan
97f2a2213e
Move all folders inside /dbms one level up (#9974)
* Move some code outside dbms/src folder
* Fix paths
2020-04-02 02:51:21 +03:00
Azat Khuzhin
5070b8a76a Update test_insert_distributed_async_send for recent block conversion changes
After the implicit conversion had been added, String and
Nullable(String) successfully converted, let's use UInt64 over
Nullable(String).
2021-02-02 21:38:29 +03:00