thevar1able/ClickHouse
1
0
Fork 0
mirror of https://github.com/ClickHouse/ClickHouse.git synced 2024-09-24 02:30:51 +00:00
Code Issues Packages Projects Releases Wiki Activity
50,481 Commits 8,939 Branches 1,766 Tags 2 GiB
c7618ea99e
Commit Graph

984 Commits

Author SHA1 Message Date
Pavel Kovalenko
69b4bc6f33 Proper error handling during insert into MergeTree with S3. 2020-10-06 12:38:00 +03:00
alexey-milovidov
53ce5e3892
Merge pull request #15551 from azat/for-user-limits-over-distributed 
Pass through *_for_user settings via Distributed with cluster-secure
 2020-10-04 04:18:20 +03:00
Azat Khuzhin
84583faa43 Fix test_distributed_inter_server_secret under ASAN 
And also cover both cases:
- settings from DDL
- settings from TCP protocol
 2020-10-03 11:16:31 +03:00
alexey-milovidov
75fb73956e
Merge pull request #15238 from ianton-ru/multi_delete_in_s3 
Use S3 multi object delete
 2020-10-03 03:48:06 +03:00
Azat Khuzhin
f25c1742b8 Pass through *_for_user settings via Distributed with cluster-secure 
In cluster-secure case the user on shards (remote) is equal to the user
on the initiator, so those settings can be safely applied.
 2020-10-03 02:04:47 +03:00
Alexander Tokmakov
6b2da861dc Merge branch 'master' into write_structure_of_table_functions 2020-10-02 20:46:58 +03:00
Azat Khuzhin
9cb3c743bd
Convert to python3 (#15007) 2020-10-02 19:54:07 +03:00
alexey-milovidov
9808d0be81
Merge pull request #15376 from excitoon-favorites/fixs3storage 
Fixed compression in S3 storage
 2020-10-01 04:30:32 +03:00
tavplubix
2f95609f98
Merge pull request #15448 from ClickHouse/allow_synchronous_drop_for_atomic_db 
Allow synchronous DROP/DETACH TABLE for Atomic
 2020-10-01 01:14:31 +03:00
tavplubix
34e4932c8f
Update test.py 2020-09-30 19:16:35 +03:00
Vladimir Chebotarev
b460024356 Fixed bug in GZIP compression in S3 storage. 2020-09-30 16:09:55 +03:00
Vladimir Chebotarev
a38c7ff2a8 Somehow uncompressed PUT works and gzipped PUT doesn't, in S3 storage. 2020-09-30 15:04:42 +03:00
Vladimir Chebotarev
b7a6f15f19 Added test for GZIP in S3 storage. 2020-09-30 13:55:44 +03:00
tavplubix
c9eeb149fd
Merge pull request #15384 from zhang2014/fix/ISSUES-15365 
ISSUES-15365 fix attach mysql database database
 2020-09-30 11:27:15 +03:00
tavplubix
a4b4895b26
Merge pull request #15435 from ClickHouse/ADQM-160-fix 
Try merge #14265 again
 2020-09-30 11:21:55 +03:00
alexey-milovidov
0c07c2d3a3
Merge pull request #15089 from ClickHouse/codecs_for_nested_types 
Codecs for nested types
 2020-09-30 07:18:19 +03:00
Alexander Tokmakov
5d19ed04f6 allow synchronous drop/detach table for Atomic 2020-09-29 16:47:08 +03:00
Alexander Tokmakov
6ebfd1aaf6 fix 2020-09-29 11:58:04 +03:00
Alexander Tokmakov
a7d3a024c7 Revert "Revert "Test and doc for PR12771 krb5 + cyrus-sasl + kerberized kafka"" 
This reverts commit c298c633a7.
 2020-09-29 11:56:37 +03:00
alesapin
bd531bb045
Merge pull request #15396 from ClickHouse/yet_another_retry 
Fix some flaky tests: test_mysql_federated and 00652_replicated_mutations_zookeeper
 2020-09-29 09:51:41 +03:00
zhang2014
a3bc152f73 ISSUES-15365 try fix integration test failure 2020-09-29 14:37:19 +08:00
zhang2014
18985645d9 ISSUES-15365 try fix integration test failure 2020-09-29 12:17:54 +08:00
zhang2014
9e94c077e7 IESSUES-15365 try fix integration test 2020-09-29 10:39:30 +08:00
tavplubix
4578d89819
Merge pull request #15348 from ClickHouse/replicate_default_args 
Continuation of #14791
 2020-09-28 18:53:02 +03:00
zhang2014
b14fb0e8d5 ISSUES-15365 try fix integration test 2020-09-28 23:00:01 +08:00
alesapin
a526a767df Fix some flaky tests 2020-09-28 14:17:07 +03:00
zhang2014
7e90e00f1a ISSUES-15365 add integration test 2020-09-28 18:27:02 +08:00
Nikita Mikhaylov
73573472e9
Merge pull request #15299 from CurtizJ/fix-mysql-hung 
Fix hang of queries with a lot of subqueries to same mysql table
 2020-09-28 12:51:35 +03:00
Anton Ivashkin
c2b692f2c7 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into multi_delete_in_s3 2020-09-28 12:00:34 +03:00
Anton Ivashkin
c18cdec77c Use S3 multi object delete 
Some strange with s3_with_proxy test
 2020-09-28 11:47:04 +03:00
Alexander Tokmakov
b0d99217fb Merge branch 'master' into write_structure_of_table_functions 2020-09-27 14:26:47 +03:00
Alexander Tokmakov
34addcf61f add review suggestions 2020-09-26 22:18:28 +03:00
alesapin
d1bb6b6555
Update test.py 2020-09-26 11:47:26 +03:00
alesapin
8f9ec30315 Delete flaky test 2020-09-25 19:23:57 +03:00
alesapin
af0bb5bd26 One more time 2020-09-25 19:15:34 +03:00
alesapin
ada193e7b7 Add diff 2020-09-25 16:33:33 +03:00
alesapin
54fa67838e Add flaky test 2020-09-25 16:32:00 +03:00
Anton Popov
085f63a9bf fix hang of queries with a lot of subqueries to same mysql table 2020-09-25 14:12:48 +03:00
tavplubix
b96157e32b
Merge branch 'master' into enable_atomic_database_by_default 2020-09-25 13:42:39 +03:00
alesapin
9bf27fb42a
Merge pull request #15110 from nikitamikhaylov/split-huge-dictionary-test 
Splitting test_dictionaries_all_layouts_and_sources
 2020-09-25 10:16:28 +03:00
Alexander Tokmakov
fb826557b7 Merge branch 'master' into enable_atomic_database_by_default 2020-09-25 02:04:01 +03:00
Vitaly Baranov
0605808ed1
Merge pull request #14492 from vitlibar/use-previous-users-xml-if-failed-to-reload 
Use previous users.xml if failed to reload
 2020-09-24 16:25:19 +03:00
tavplubix
c298c633a7
Revert "Test and doc for PR12771 krb5 + cyrus-sasl + kerberized kafka" 2020-09-24 16:10:24 +03:00
alesapin
96c419974c Merge branch 'master' into codecs_for_nested_types 2020-09-24 10:28:20 +03:00
nikitamikhaylov
c64ac8596c better 2020-09-23 22:36:47 +03:00
nikitamikhaylov
2d4bdcfec0 file and executables 2020-09-23 22:31:47 +03:00
Alexander Tokmakov
f0f91f84af Merge branch 'master' into enable_atomic_database_by_default 2020-09-23 21:50:15 +03:00
Alexander Tokmakov
a8266a3d3c fix DDDL with cross-replication and Atomic 2020-09-23 21:28:59 +03:00
Ilya Yatsishin
7dad84ea6b
Merge pull request #14265 from arenadata/ADQM-160 
Test and doc for PR12771 krb5 + cyrus-sasl + kerberized kafka
 2020-09-23 19:02:58 +03:00
Anton Popov
4b795c7b6a
temporarily run test with wide parts only 2020-09-22 18:58:14 +03:00
Alexander Tokmakov
7fcf20e48c enable more tests 2020-09-22 17:29:09 +03:00
nikitamikhaylov
c9cfdffcd7 mongo uri 2020-09-22 16:52:56 +03:00
alesapin
9b6b5ae08d More tests 2020-09-22 16:16:42 +03:00
Alexander Tokmakov
91cbd49e85 fix tests 2020-09-22 00:09:50 +03:00
nikitamikhaylov
d87f3660ee done 2020-09-21 23:19:46 +03:00
Ilya Golshtein
494e59e7c1 DOCKER_KERBEROS_KDC_TAG 2020-09-21 19:12:31 +03:00
Alexander Tokmakov
13e41cdd20 try enable atomic database by default 2020-09-21 13:55:34 +03:00
alexey-milovidov
3e0509af69
Merge pull request #13573 from amosbird/rms 
specific ReplicatedMergeTree settings
 2020-09-21 01:36:33 +03:00
Vitaly Baranov
33efb36714 Use previous users.xml if failed to reload. 2020-09-19 16:21:12 +03:00
alexey-milovidov
eb9ee723c3
Merge pull request #11913 from ClickHouse/compact-parts-by-default 
Enable compact parts by default for small parts
 2020-09-19 15:31:15 +03:00
tavplubix
6e0bdaf46d
Merge pull request #14535 from zhang2014/fix/datetime 
ISSUES-4006 support decimal data type for MaterializedMySQL
 2020-09-19 14:05:32 +03:00
alexey-milovidov
c1402d62db
Merge pull request #14892 from vzakaznikov/fix_test_distributed_over_live_view2 
Fixing tests/integration/test_distributed_over_live_view/test.py
 2020-09-19 13:59:05 +03:00
alexey-milovidov
1fcebce926
Merge pull request #15000 from Jokser/disable-ttl-move-on-insert 
Option to disable TTL move on data part insert
 2020-09-19 13:45:02 +03:00
alexey-milovidov
3463d97f8c
Merge pull request #14973 from amosbird/bm2 
Ignore key constraints when doing mutations.
 2020-09-19 13:44:30 +03:00
alexey-milovidov
988b20a32c
Merge pull request #14684 from azat/parallel-distributed_ddl 
Allow parallel execution of distributed DDL
 2020-09-18 22:18:17 +03:00
Pavel Kovalenko
1fc3aa3ea8 Fixed test_disabled_ttl_move_on_insert test 2020-09-18 22:10:49 +03:00
Pavel Kovalenko
77be35a2b8 Fixed test_disabled_ttl_move_on_insert test 2020-09-18 21:59:56 +03:00
Amos Bird
d842cb704f
Allow mutations to work with key constraints. 2020-09-19 02:40:02 +08:00
Alexander Tokmakov
1ca9a92b21 Merge branch 'master' into write_structure_of_table_functions 2020-09-18 21:09:23 +03:00
Pavel Kovalenko
da04a130ed Add option to disable ttl move on data part insert - minor fixes. 2020-09-18 20:45:30 +03:00
Pavel Kovalenko
0da19ab46d Add option to disable ttl move on data part insert 2020-09-18 18:30:00 +03:00
Anton Popov
d1e90e0e4b fix tests 2020-09-18 03:05:51 +03:00
zhang2014
64032e22a2 Merge branch 'master' into fix/datetime 2020-09-18 00:28:09 +08:00
Vitaly Baranov
3356d75b23
Merge pull request #13156 from azat/cluster-secure 
Secure inter-cluster query execution (with initial_user as current query user) [v3]
 2020-09-17 17:11:00 +03:00
Ilya Golshtein
624a4c4d55 kdc Dockerfile integrated 2020-09-17 16:51:34 +03:00
Ilya Golshtein
1862f58cf5 forgotten empty clickhouse_path dir 2020-09-17 16:51:34 +03:00
Ilya Golshtein
75836acddc code review changes 2020-09-17 16:51:34 +03:00
Ilya Golshtein
bcdb2277bd distutils=>shutil 2020-09-17 16:51:34 +03:00
Ilya Golshtein
23853cc8cf fix conflict resolution mistake 2020-09-17 16:51:34 +03:00
Ilya Golshtein
96c2a7c77e kerberized kafka test works after merge 2020-09-17 16:51:34 +03:00
Ilya Golshtein
1808a1e36c short krb ticket lifetime, Dockerile renamed 2020-09-17 16:51:34 +03:00
Ilya Golshtein
c227f91636 remove_files improved, proper docker images, tiny cleanup 2020-09-17 16:51:34 +03:00
Ilya Golshtein
a2e72ec37a test via runner is Ok, switched to custom images 2020-09-17 16:51:34 +03:00
Ilya Golshtein
2d5c31d588 test_storage_kerberized_kafka cleanup + negative test 2020-09-17 16:51:34 +03:00
Ilya Golshtein
c12fa26fe3 kerberized kafka test works 2020-09-17 16:51:34 +03:00
alexey-milovidov
2886b38c03
Merge branch 'master' into fix_test_distributed_over_live_view2 2020-09-17 13:06:39 +03:00
Nikolai Kochetov
339521fadb
Update test.py 2020-09-17 11:48:27 +03:00
sundy-li
544b2cb20d add configChanged method for zookeeper 
fix logic error && skip reload testkeeper
 2020-09-17 13:33:45 +08:00
Vitaliy Zakaznikov
bf9feb6865 Removing usage of time.sleep in tests/integration/test_distributed_over_live_view/test.py 2020-09-16 22:07:58 -04:00
Anton Popov
8e9828d2ff Merge remote-tracking branch 'upstream/master' into HEAD 2020-09-16 21:07:35 +03:00
alexey-milovidov
84b210f93e
Merge pull request #14864 from bharatnc/ncb/format-integration-tests 
Format and cleanup imports form all *.py integration test files
 2020-09-16 20:40:57 +03:00
alesapin
e173658422 Fix integration test 2020-09-16 19:53:58 +03:00
alesapin
d9057eb2c1
Merge pull request #14855 from ClickHouse/fix_flaky_test_6 
Flaky tests fixes
 2020-09-16 09:47:51 +03:00
bharatnc
b75963d370 Format and optimize imports in integration test files 
This PR formats all the `*.py` files found under the `tests/integration`
folder. It also reorders the imports and cleans up a bunch of unused
imports.

The formatting also takes care of other things like wrapping lines and
fixing spaces and indents such that the tests look more readable.
 2020-09-15 23:10:54 -07:00
alexey-milovidov
7fb0291c09
Merge pull request #14854 from zhang2014/fix/ISSUES-14809 
ISSUES-14809 fix MaterializeMySQL empty transaction unstable test case
 2020-09-16 00:44:51 +03:00
alesapin
3b34345abb Less flaky tests 2020-09-15 18:42:46 +03:00
Vitaly Baranov
74d5b43fe6
Merge pull request #14828 from vitlibar/change-columns-of-system-user-directories 
Add 'params' column to system.user_directories table.
 2020-09-15 18:25:50 +03:00
alesapin
6130cd7365 More stable test_no_ttl_merges_in_busy_pool 2020-09-15 17:53:55 +03:00
zhang2014
1c659de8b1 ISSUES-14809 fix MaterializeMySQL empty transaction test failure 2020-09-15 22:44:18 +08:00
Anton Popov
3e855daefd Merge remote-tracking branch 'upstream/master' into HEAD 2020-09-15 15:31:29 +03:00
Anton Popov
f725f8deee fix more tests 2020-09-15 02:14:14 +03:00
Vitaly Baranov
0f53b449fd Add 'params' column to system.user_directories table. 2020-09-15 01:51:53 +03:00
Azat Khuzhin
0159c74f21 Secure inter-cluster query execution (with initial_user as current query user) [v3] 
Add inter-server cluster secret, it is used for Distributed queries
inside cluster, you can configure in the configuration file:

  <remote_servers>
      <logs>
          <shard>
              <secret>foobar</secret> <!-- empty -- works as before -->
              ...
          </shard>
      </logs>
  </remote_servers>

And this will allow clickhouse to make sure that the query was not
faked, and was issued from the node that knows the secret. And since
trust appeared it can use initial_user for query execution, this will
apply correct *_for_user (since with inter-server secret enabled, the
query will be executed from the same user on the shards as on initator,
unlike "default" user w/o it).

v2: Change user to the initial_user for Distributed queries if secret match
v3: Add Protocol::Cluster package
v4: Drop Protocol::Cluster and use plain Protocol::Hello + user marker
v5: Do not use user from Hello for cluster-secure (superfluous)
 2020-09-15 01:36:28 +03:00
Azat Khuzhin
2fce2b21a8 Use pytest.raises(match=) in test_allowed_client_hosts 
Since pytest.raises() produces excinfo not exception, hence at least
str(excinfo.value) should be used to match the exception message.
 2020-09-15 01:36:28 +03:00
alesapin
58f4e5f967
Merge pull request #14755 from vitlibar/fix-permission-denied-in-integration-tests 
Fix access denied on opening file /var/lib/clickhouse/status in integration tests.
 2020-09-14 22:08:21 +03:00
Anton Popov
ac9ba23bdf fix more tests 2020-09-14 15:49:04 +03:00
alesapin
0c04f4d008
Update cluster.py 2020-09-14 10:01:20 +03:00
Vitaly Baranov
421eeeccef Add the section user_directories to the default config. 2020-09-12 23:04:28 +03:00
alexey-milovidov
c2f762e20a
Merge pull request #14748 from vitlibar/skip-access-storages-with-same-path 
Skip access storages with same path while reading the main config.
 2020-09-12 14:20:02 +03:00
alesapin
2c6567eb88
Merge pull request #14745 from kssenii/fix-rabbit-tests-crash 
Fix crashes in RabbitMQ tests
 2020-09-12 09:53:14 +03:00
Vitaly Baranov
1e849f2975 Fix permission denied on opening file /var/lib/clickhouse/status in integration tests. 2020-09-12 03:18:18 +03:00
Azat Khuzhin
9c7f3a9a74 Add test_distributed_ddl_parallel 2020-09-12 02:33:17 +03:00
Vitaly Baranov
e2c2a679ef Skip access storages with same path while reading the main config. 2020-09-12 01:34:46 +03:00
alesapin
36019596c1 Disable flaky test 2020-09-11 20:08:23 +03:00
alesapin
2c4047b280 Revert accident changes 2020-09-11 20:07:00 +03:00
alesapin
c0dafb0283 Disable test 2020-09-11 20:04:55 +03:00
kssenii
31dbfd07e2 remove tests crash reason 2020-09-11 16:16:24 +00:00
Nikita Mikhaylov
468089a4cd
Merge pull request #14514 from bharatnc/ncb/event_time_microseconds_metric_logs 
add event_time_microseconds field to asynchronous_metric_log & metric_log system tables
 2020-09-11 16:14:00 +04:00
zhang2014
7ff7ee6aac ISSUES-4006 try fix integration test 2020-09-11 15:37:14 +08:00
Anton Popov
fa6d88b3b2 fix more tests 2020-09-10 21:43:02 +03:00
Anton Popov
6031e6bae9 fix tests 2020-09-10 20:09:19 +03:00
tavplubix
4581e3a18a
Merge pull request #14563 from bharatnc/ncb/zk-conn-fail-do-cleanup 
ReplicatedMergeTree - cleanup data directory after Zookeeper exceptions
 2020-09-10 19:19:57 +03:00
bharatnc
397ebdb855 remove sleep from unit test 2020-09-10 08:55:39 -07:00
Alexander Tokmakov
20b3823770 do not remove directory on attach 2020-09-10 13:21:13 +03:00
zhang2014
5b3e9eaaf0 Merge branch 'master' into fix/datetime 2020-09-10 17:26:26 +08:00
zhang2014
338b69201d ISSUES-4006 add test decimal when dump stage 2020-09-10 17:20:28 +08:00
bharatnc
31b0bd481c Integration tests - more accurate tests 2020-09-10 00:35:25 -07:00
bharatnc
05a80518a1 Merge remote-tracking branch 'upstream/master' into ncb/event_time_microseconds_metric_logs 2020-09-09 17:58:29 -07:00
bharatnc
2ad63d2b4d AsynchronousMetricLog - refactor integration test 2020-09-09 17:56:21 -07:00
bharatnc
0a3f7d0fcc AsynchronousMetricsLog - add improved tests 
This adds integration tests to test the asynchronous_metric_log table
for event_time_microseconds field.

Asynchronous metrics are updated once every 60s, so this setting needs
to be overridden for having those metrics available in time so that the
tests can run. So the `asynchronous_metric_update_period_s` setting is
being overriden to be 2s.
 2020-09-09 17:50:39 -07:00
Alexander Tokmakov
dee1fefeb4 add more tests 2020-09-09 20:39:49 +03:00
alesapin
cdb72add35
Merge pull request #14619 from ClickHouse/better_copy_dir 
Better recursive database copy in integration tests
 2020-09-09 19:38:55 +03:00
bharatnc
fe6d6f16ea Merge remote-tracking branch 'upstream/master' into ncb/zk-conn-fail-do-cleanup 2020-09-09 09:25:34 -07:00
bharatnc
d1d3af7501 StorageReplicatedMergeTree - more improvements to integration test 2020-09-09 09:24:18 -07:00
zhang2014
6ed3f7fb86 ISSUES-4006 try fix integration test failure when mysql 5.7 2020-09-09 23:42:03 +08:00
zhang2014
094897fe69 Merge branch 'master' into fix/datetime 2020-09-09 23:37:54 +08:00
alesapin
bd14c79b0b
Merge pull request #14494 from ClickHouse/recompression_in_background 
Recompression TTL
 2020-09-09 17:46:01 +03:00
Alexander Tokmakov
d278d849e4 Merge branch 'master' into write_structure_of_table_functions 2020-09-09 17:12:35 +03:00
Vasily Nemkov
3973a17530
MySql datatypes dateTime64 and decimal (#11512) 2020-09-09 15:18:02 +03:00
alesapin
98f19a5d50 Better permissions 2020-09-09 14:29:53 +03:00
alesapin
f5bef34be6 Fix configs for test_default_database_on_cluster 2020-09-09 14:28:59 +03:00
alesapin
150d8d4e79 Better recursive copy in integration tests 2020-09-09 14:11:59 +03:00
Winter Zhang
3d1d64ec60
Fix currentDatabase function cannot be used in ON CLUSTER ddl query. (#14211) 2020-09-09 12:58:59 +03:00
alesapin
485b104898 Use max ttl and add introspection to system parts about recompression 2020-09-09 12:15:42 +03:00
alesapin
a696cf12f6 Merge branch 'master' into recompression_in_background 2020-09-09 10:12:03 +03:00
alesapin
9548d69792
Merge pull request #14581 from ClickHouse/fix_flaky_test_3 
Add retries to several integration tests
 2020-09-09 10:04:37 +03:00
bharatnc
f37814b367 Merge remote-tracking branch 'upstream/master' into ncb/zk-conn-fail-do-cleanup 2020-09-08 23:45:20 -07:00
bharatnc
48bf65d63d StorageReplicatedMergeTree - improve integration test 2020-09-08 23:45:04 -07:00
Winter Zhang
62ef728b2f
ISSUES-4006 try fix test failure 2020-09-09 10:52:14 +08:00
Anton Popov
032f4ba6f3
Merge pull request #14532 from CurtizJ/fix-redis-test 
Rework test for redis dictionary
 2020-09-09 02:38:09 +03:00