thevar1able/ClickHouse
1
0
Fork 0
mirror of https://github.com/ClickHouse/ClickHouse.git synced 2024-09-21 01:00:48 +00:00
Code Issues Packages Projects Releases Wiki Activity
44,417 Commits 8,935 Branches 1,766 Tags 2 GiB
2753cb58b6
Commit Graph

459 Commits

Author SHA1 Message Date
Azat Khuzhin
bd45592539 Fix test_distributed_load_balancing flaps (due to config reload) 
At startup, server loads configuration files.

However ConfigReloader does not know about already loaded files (files
is empty()), hence it will always reload the configuration just after
server starts (+ 2 seconds, reload timeout).

And on configuration reload the clusters will be re-created, so some
internal stuff will be reseted:
- error_count
- last_used (round_robing)

And if the reload will happen during round_robin test it will start
querying from the beginning, so let's issue config reload just after
start to avoid reload in the middle of the test execution.
 2020-06-21 12:01:15 +03:00
Alexey Milovidov
25af2d0b0a Fix bad integration test "always_fetch_merged" 2020-06-20 21:21:29 +03:00
Azat Khuzhin
9bfda65134 Add a test for distributed_replica_max_ignored_errors 2020-06-20 11:21:08 +03:00
alesapin
4b6db63fff Fix alter key when materialized column passed 2020-06-19 13:53:20 +03:00
Mikhail Filimonov
9609bd9dee Kafka better states, formats based on PeekableReadBuffer, and other minor fixes. 
Add formats tests, fixes for JSONCompactEachRowWithNamesAndTypes, TSVWithNamesAndTypes. Some CR fixes
Add sanitizing for kafka_max_block_size and kafka_poll_max_batch_size
 2020-06-19 10:49:05 +02:00
Azat Khuzhin
4572b1ede7 Cover re-parsing of metadata from zookeeper 2020-06-17 21:05:26 +03:00
Vitaly Baranov
7011401cd4
Merge pull request #11670 from vitlibar/rbac-improve-parser-multiple-entities 
RBAC: improve syntax
 2020-06-17 16:26:02 +03:00
Nikita Mikhaylov
ff0262626a
Merge pull request #11645 from azat/load-balancing-round-robin 
Add round_robin load_balancing
 2020-06-17 14:34:59 +04:00
Nikita Mikhaylov
edec79cf69
Merge pull request #11703 from nikitamikhaylov/merging-alter-query 
Merging #11508
 2020-06-17 12:47:34 +04:00
Nikita Mikhaylov
ab04a6bb62
Merge pull request #11615 from azat/SYSTEM-FLUSH-LOGS-force-table-creation-v2 
Force table creation on SYSTEM FLUSH LOGS (v2)
 2020-06-17 11:09:19 +04:00
alexey-milovidov
8eb811140a
Merge pull request #11717 from ClickHouse/fix-test-mysql-federated 
Added retries to test_mysql_federated
 2020-06-17 09:26:33 +03:00
Alexey Milovidov
3e7ac1f9ab Added retries to test_mysql_federated 2020-06-16 23:52:31 +03:00
Alexey Milovidov
2024d2de54 Update test 2020-06-16 22:10:25 +03:00
Alexey Milovidov
bf4c82dbd8 Update test 2020-06-16 22:04:19 +03:00
Nikita Mikhaylov
fc06f99476 build and test fixes 2020-06-16 21:07:41 +03:00
Ivan Blinkov
7e2bb1fd83 Merge branch 'master' of github.com:ClickHouse/ClickHouse into sentry 2020-06-16 16:02:55 +03:00
franklee
264e44ecef support distributed DDLs on cross replication clusters. 
(cherry picked from commit fd09994d91)
 2020-06-16 11:53:27 +03:00
Anton Popov
b19d48a11c Merge remote-tracking branch 'upstream/master' into HEAD 2020-06-16 06:37:55 +03:00
Alexey Milovidov
bd330cfeb6 Update test 2020-06-16 05:56:50 +03:00
alexey-milovidov
9b734ffded
Update http_server.py 2020-06-16 03:21:20 +03:00
Anton Popov
a3ac224ae4 in-memory parts: sync insert to replicated 2020-06-15 22:57:12 +03:00
Vitaly Baranov
a40885fa84 Add new command SHOW ACCESS. 2020-06-15 22:07:47 +03:00
Vitaly Baranov
9fe47df2e8 Support multiple users/roles in SHOW CREATE USER(ROLE, etc.) and SHOW GRANTS FOR commands. 
Support syntax "SHOW CREATE USER ALL" and "SHOW GRANTS FOR ALL".
 2020-06-15 22:07:47 +03:00
Vitaly Baranov
4187edd9f9 Split integration test 'test_grant_and_revoke' into two tests. 2020-06-15 22:07:47 +03:00
Vitaly Baranov
4bd00b02e2 Improve syntax of CREATE QUOTA. Now resource types and key types could be written with underscores. 
Also rename columns key_type=>keys and source=>storage in table system.quotas.
 2020-06-15 20:10:34 +03:00
Vitaly Baranov
9f31184d76 Support for multiple names in one CREATE/ALTER command. 2020-06-15 20:10:28 +03:00
Alexander Tokmakov
def0158638 configure query handler as default 2020-06-15 14:33:44 +03:00
kssenii
9e1b8b2872 Better exchanges, fix build, better comments, better tests 2020-06-14 18:36:56 +00:00
zhang2014
e1317ef8ae ISSUES-7572 fix test failure 2020-06-14 09:44:05 +08:00
Azat Khuzhin
9386478a77 Add test for load_balancing algorithms 2020-06-14 01:09:22 +03:00
kssenii
dcd7b7351c Support headers-exchange type 2020-06-13 21:47:22 +00:00
kssenii
9c49398728 Fix tests 2020-06-13 18:44:17 +00:00
kssenii
3b0a3e00c0 Some fixes 2020-06-12 18:09:49 +00:00
zhang2014
8d9b770da4 ISSUES-7572 fix defaults config level & add replicas_status and prometheus handler 2020-06-13 00:15:02 +08:00
zhang2014
1c55aa0333 ISSUES-7572 add integration test 2020-06-12 18:19:03 +08:00
Azat Khuzhin
103eb17107 Force table creation on SYSTEM FLUSH LOGS (v2) 
After this patch SYSTEM FLUSH LOGS will force system.*_log table
creatoins (only for enabled tables of course).

This will avoid such hacks like:

   set log_queries=1;
   select 1;
   system flush logs;

This is the second version of the patch, since first has a deadlock [1]
(reported by @alesapin). This version does not use separate lock and do
not issue CREATE TABLE from the query execution thread, instead it
activate flushing thread to do so, hence this should be the same as if
the table will be created during flush.

  [1]: https://gist.github.com/alesapin/d915d1deaa27d49aa31223daded02be2

Fixes: #11563
Cc: @alesapin
Cc: @nikitamikhaylov
 2020-06-11 23:12:23 +03:00
kssenii
626eb53baa Fix multiple bindings for single queue & rm hardcoded strings 2020-06-11 11:13:13 +00:00
Ivan Blinkov
ce36f409c9 Merge branch 'master' of github.com:ClickHouse/ClickHouse into sentry 2020-06-11 13:34:58 +03:00
kssenii
9350472ee4 Support multiple bindings 2020-06-11 10:29:08 +00:00
alesapin
5a9a63e9a1
Revert "Force table creation on SYSTEM FLUSH LOGS" 2020-06-11 13:22:24 +03:00
Ivan Blinkov
b70ed921ea Merge branch 'master' of github.com:ClickHouse/ClickHouse into sentry 2020-06-11 12:22:13 +03:00
alexey-milovidov
8e9c2dbf85
Merge pull request #11582 from ClickHouse/fix_test_replica_fetch 
Better integration test test_always_fetch_merged.
 2020-06-11 06:51:56 +03:00
kssenii
18820814f5 Merge 2020-06-10 23:25:33 +00:00
kssenii
d7b2694806 Support all exchange types 2020-06-10 23:06:23 +00:00
Nikita Mikhaylov
425c20eeb8
Merge pull request #11563 from azat/SYSTEM-FLUSH-LOGS-force-table-creation 
Force table creation on SYSTEM FLUSH LOGS
 2020-06-11 02:03:34 +04:00
Nikita Mikhaylov
4bf46ed288
Merge pull request #11573 from nikitamikhaylov/copier-test-fix 
Fix copier test
 2020-06-11 00:38:27 +04:00
alexey-milovidov
123a017057
Merge pull request #11528 from azat/use_compact_format_in_distributed_parts_names-fix 
Fix shard_num/replica_num for <node> (breaks use_compact_format_in_distributed_parts_names)
 2020-06-10 22:02:51 +03:00
alesapin
e221a64c4b Better test 2020-06-10 18:56:18 +03:00
Nikita Mikhaylov
93b0d5b29b done 2020-06-10 15:47:34 +03:00
Ivan Blinkov
90ee4d52f4 merge master 2020-06-10 13:18:41 +03:00
Azat Khuzhin
8a78cffe5c Force table creation on SYSTEM FLUSH LOGS 2020-06-09 21:11:08 +03:00
Alexander Tokmakov
6bb68329f8 Merge branch 'master' into merging_external_source_cassandra 2020-06-09 19:51:14 +03:00
Ivan Blinkov
6f7064928f Merge branch 'master' of github.com:ClickHouse/ClickHouse into sentry 2020-06-09 19:07:57 +03:00
Ivan Blinkov
5b3fef526e Merge branch 'master' of github.com:ClickHouse/ClickHouse into sentry 2020-06-09 11:51:29 +03:00
MovElb
e6dcece2fd return tcp_port 2020-06-08 22:39:02 +03:00
Azat Khuzhin
eee2fb867a Update test_distributed_format to cover remote_servers via <node> 2020-06-08 22:32:06 +03:00
Azat Khuzhin
222bbe95d6 Cover load_balancing for Distributed INSERT w/o internal_replication 2020-06-08 21:58:56 +03:00
MovElb
fc981a2869 fix for review 2020-06-08 15:05:49 +03:00
alesapin
483c60fadd Merging #8377 2020-06-08 14:25:30 +03:00
kssenii
17e7cc03c0 Add consumer failure handler 2020-06-08 01:11:48 +00:00
tavplubix
686c0539db
Merge pull request #11487 from ClickHouse/improve_dns_cache 
Use DNSResolver to check if user is allowed to connect from an address
 2020-06-07 19:55:03 +03:00
Alexander Tokmakov
0cf8015f4a use DNSResolver to check if user is allowed to connect 2020-06-07 00:02:29 +03:00
Ivan
058821fa02
Merge branch 'master' into kafka_better_settings 2020-06-06 19:50:38 +03:00
Ivan
c8808e89fd
Update test.py 2020-06-06 19:48:03 +03:00
Ivan Blinkov
653a9afda0 Merge branch 'master' of github.com:ClickHouse/ClickHouse into sentry 2020-06-05 22:51:28 +03:00
alesapin
212df30fc5 Add test for different ttl versions 2020-06-04 17:18:54 +03:00
alesapin
b163052d1b
Merge pull request #11134 from GrigoryPervakov/custom-auth 
Add default credentials and custom headers for s3 storage.
 2020-06-04 16:46:01 +03:00
Mikhail Filimonov
26d93fdfba Fix the test, adjust default for queued.min.messages 2020-06-04 14:14:24 +02:00
Alexander Tokmakov
64c013610a fix 2020-06-04 01:03:49 +03:00
Alexander Tokmakov
e67837bc4a cleenup 2020-06-04 00:11:17 +03:00
Mikhail Filimonov
bf1e5db0ee Tests from issue #11308, from issue #4116 2020-06-03 19:01:45 +02:00
Anton Popov
1ce09e1faa Merge remote-tracking branch 'upstream/master' into polymorphic-parts 2020-06-03 16:27:54 +03:00
Alexander Tokmakov
e3aa20708a Merge branch 'master' into merging_external_source_cassandra 2020-06-03 14:55:02 +03:00
Alexander Tokmakov
73926b2cf9 support loading from multiple partitions with complex key 2020-06-03 14:54:26 +03:00
alesapin
d113a1cde7 More clear test 2020-06-02 21:47:30 +03:00
alesapin
6253e9b97b Revert disabled tests 2020-06-02 21:41:29 +03:00
alesapin
46fcff26b0 Disable flaky tests 2020-06-02 21:14:16 +03:00
Pervakov Grigorii
bc9381406f Add default credentials and custom headers for s3 table functions. 2020-06-02 20:48:49 +03:00
alesapin
ffa553ad91 Fix test 2020-06-02 18:11:51 +03:00
alesapin
e5a2ae4637 Remove unused import 2020-06-02 11:46:08 +03:00
alesapin
96ec552b51 Fix flaky ttl test 2020-06-02 11:42:42 +03:00
Ivan Blinkov
4bd678a3fd Merge branch 'master' of github.com:ClickHouse/ClickHouse into sentry 2020-06-02 08:21:30 +03:00
alesapin
5d54e18541 Fix sync_async test (remove timeout) 2020-06-01 22:35:56 +03:00
Ivan Blinkov
6bd4282727 Merge branch 'master' of github.com:ClickHouse/ClickHouse into sentry 2020-06-01 21:49:56 +03:00
kssenii
d3b069e37b Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into add-storage-rabbitmq-read-only 2020-06-01 18:25:36 +00:00
kssenii
5939422b85 Add tests for insert part 2020-06-01 17:02:14 +00:00
alexey-milovidov
19c6e0e5ae
Merge pull request #11307 from ClickHouse/remove-system-tables-lazy-load 
Remove "system_tables_lazy_load" option
 2020-06-01 16:26:23 +03:00
Alexander Tokmakov
62761eddcc Merge branch 'master' into merging_external_source_cassandra 2020-06-01 14:44:46 +03:00
Ivan Blinkov
89212fb174 Merge branch 'sentry' of github.com:blinkov/ClickHouse; branch 'master' of github.com:ClickHouse/ClickHouse into sentry 2020-06-01 14:14:44 +03:00
alesapin
c4d520d831 Fix part_log test 2020-06-01 12:12:52 +03:00
alesapin
c22e8f6b9b
Merge pull request #11283 from filimonov/kafka_virtual_column_headers 
Virtual columns for Kafka headers
 2020-06-01 12:06:00 +03:00
alesapin
364ebe9246
Merge pull request #11260 from filimonov/kafka_virtual_column_timestamp_ms 
Add _timestamp_ms virtual columns to Kafka engine
 2020-06-01 12:04:17 +03:00
Ivan Blinkov
fcc7ff0ef9 Merge branch 'master' of github.com:ClickHouse/ClickHouse into sentry 2020-06-01 08:42:03 +03:00
alexey-milovidov
92c56afed1
Merge pull request #11320 from ClickHouse/revert-revert-disable-flacky-tests 
Disable flacky test #8840
 2020-06-01 00:10:53 +03:00
alexey-milovidov
9a362eb02e
Merge pull request #11252 from filimonov/kafka-clientid 
Kafka clientid (finishing #11073)
 2020-05-31 18:37:30 +03:00
alexey-milovidov
fb1a2fa26b
Merge pull request #11256 from filimonov/librdkafka_1_4_2 
Update librdkafka to version 1.4.2
 2020-05-31 18:34:55 +03:00
Alexey Milovidov
5192ebdc23 Fix test with obsolete assumption 2020-05-31 18:10:52 +03:00
Alexey Milovidov
87cf123ef8 Merge branch 'master' into remove-system-tables-lazy-load 2020-05-31 18:06:08 +03:00
alexey-milovidov
ece21b353c
Merge pull request #11312 from ClickHouse/debug-bad-test 
Debug bad test "mysql_federated"
 2020-05-31 17:32:56 +03:00
Alexey Milovidov
2529df016a Disable flacky test #8840 2020-05-31 17:08:09 +03:00
kssenii
e80b405359 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into add-storage-rabbitmq-read-only 2020-05-31 10:30:53 +00:00
Alexey Milovidov
ff54b4c82b Retain some parts of the modification 2020-05-30 21:43:14 +03:00
Alexey Milovidov
9b4d6ac818 Revert test 2020-05-30 21:42:19 +03:00
alexey-milovidov
3eea042d16
Merge pull request #11243 from ClickHouse/remove-experimental-use-processors-flag-4 
Remove some code.
 2020-05-30 21:05:14 +03:00
MovElb
b4b5c90343 squash 2020-05-30 20:05:05 +03:00
Alexey Milovidov
6604b6aa18 Debug bad test "mysql_federated" 2020-05-30 20:03:28 +03:00
Alexey Milovidov
496fed5ed3 Remove "system_tables_lazy_load" option 2020-05-30 17:24:09 +03:00
Nikolai Kochetov
c43976b6c5 Update test. 2020-05-30 11:31:07 +03:00
Ivan Blinkov
95ee742ee7 merge master 2020-05-29 22:56:10 +03:00
Ivan Blinkov
4ef322274d Add integration test 2020-05-29 22:53:16 +03:00
Alexander Tokmakov
8921041706 Merge branch 'master' into merging_external_source_cassandra 2020-05-29 18:20:39 +03:00
alexey-milovidov
304c6a1ee3
Merge pull request #11278 from vitlibar/fix-crash-set-default-role-with-wrong-args 
Fix crash when SET DEFAULT ROLE is called with wrong arguments.
 2020-05-29 16:24:42 +03:00
Nikita Mikhaylov
9233997b24
Merge pull request #11233 from nikitamikhaylov/cache-getstring-bugfix 
Cache-dictionary getString() bugfix
 2020-05-29 16:32:35 +04:00
Mikhail Filimonov
b885337454 Virtual columns for accessing kafka message headers 2020-05-29 10:44:10 +02:00
Vitaly Baranov
2d12b4d3ac Fix crash when SET DEFAULT ROLE is called with wrong arguments. 2020-05-29 09:54:27 +03:00
Mikhail Filimonov
03430b1763 Change the test, accept new librdkafka behaviour 2020-05-28 23:11:29 +02:00
Mikhail Filimonov
e39c4cdf71 Add _timestamp_ms virtual columns to Kafka engine 2020-05-28 19:41:57 +02:00
Vitaly Baranov
d7cc703233
Merge pull request #11080 from vitlibar/add-authentication-type-to-system-users 
Show authentication type in system.users table
 2020-05-28 20:20:41 +03:00
Mikhail Filimonov
6b694d54b4 Better kafka client.id 2020-05-28 15:39:55 +02:00
Vitaly Baranov
98172deffc Show authentication type in table system.users and while executing SHOW CREATE USER query. 2020-05-28 08:34:10 +03:00
alexey-milovidov
b430af82e5
Merge pull request #11232 from vitlibar/add-test-row_policy-affects-only-user-assigned 
Add a test for row policy
 2020-05-28 01:16:48 +03:00
Alexander Tokmakov
905bce4aeb fix 2020-05-27 23:53:35 +03:00
Anton Popov
d8342e5b12 in-memory parts: better restore and clear stale wal files 2020-05-27 23:05:55 +03:00
Nikita Mikhaylov
ec479839d9 fixed 2020-05-27 22:44:22 +03:00
Alexander Kuzmenkov
640df68e05
Merge pull request #11184 from ClickHouse/enable-log-queries 
Enable log_queries by default
 2020-05-27 20:55:31 +03:00
Vitaly Baranov
bb0045a242 Add test for row policy that policy defined in users.xml affects only the user it assigned to. 2020-05-27 20:37:43 +03:00
Alexander Tokmakov
f099ce19a7 fix 2020-05-27 16:54:39 +03:00
alexey-milovidov
992f0dfec5
Merge pull request #11149 from filimonov/kafka_reschedule 
Fixed reschedule issue in Kafka
 2020-05-27 13:26:55 +03:00
alesapin
3399e573d1
Merge pull request #11199 from ClickHouse/fix_primary_key_method_call 
Fix primary key check
 2020-05-27 11:55:12 +03:00
Ivan Blinkov
d941c483b2
Update test.py 2020-05-27 11:25:36 +03:00
filimonov
c73b8372e7
Update test.py 2020-05-27 07:44:13 +02:00
Mikhail Filimonov
efc0b97707 Fix Kafka performance issue related to reschedules based on limits, which were always applied. 2020-05-27 07:39:06 +02:00
Alexander Tokmakov
940132adc4 Merge branch 'master' into merging_external_source_cassandra 2020-05-27 00:13:57 +03:00
Ivan Blinkov
4a92ad11ec
Update test.py 2020-05-26 23:27:31 +03:00
Alexander Tokmakov
310d522528 minimal implementation 2020-05-26 22:21:18 +03:00
kssenii
ad1c0de8db Merge 2020-05-26 17:45:39 +00:00
kssenii
14c67c6ae6 Fixes 2020-05-26 17:34:57 +00:00
Vitaly Baranov
2c8a355f19
Merge pull request #11081 from vitlibar/fix-no-password-mode 
Fix settings NO_PASSWORD authentication mode in users.xml.
 2020-05-26 14:20:34 +03:00
alesapin
5780240e88 Fix primry key check 2020-05-26 12:46:04 +03:00
alexey-milovidov
d4acd1af3a
Merge pull request #11179 from excitoon-favorites/s3globfix 
Fixed S3 globbing which could fail in case of more than 1000 keys and some backends
 2020-05-26 02:45:42 +03:00
filimonov
73a0ef6c0e
Fix for the hang during deletion of engine=Kafka (one more time) (#11145) 
* Added flag for safer rdkafka destruction, but more testing detected another hang case, which has no straigt solutions and can be workarounded currenly only by draining the consumer queue, so destructor is back

* After review fixes

* After review fixes2

* After review fixes3
 2020-05-26 00:13:10 +03:00
alexey-milovidov
7201018079
Update test.py 2020-05-26 00:05:15 +03:00
Vladimir Chebotarev
e013edce4b Added test for multi-page S3 globbing. 2020-05-25 15:57:27 +03:00
Vitaly Baranov
eeb4cbc433 Fix settings NO_PASSWORD authentication mode in users.xml. 2020-05-25 11:35:26 +03:00
alesapin
73458c1574
Merge pull request #8840 from excitoon-favorites/returnttltests 
Revert "Disable some flappy tests"
 2020-05-25 11:29:07 +03:00
Alexander Tokmakov
ac54d470da Merge branch 'master' into merging_external_source_cassandra 2020-05-22 17:27:40 +03:00
Pavel Kovalenko
1165c44acf Enable test_replicated_mergee_tree_s3 2020-05-22 14:55:30 +03:00
Pavel Kovalenko
89b9fb6d41 Create 'root' S3 bucket before CH is started. 2020-05-22 14:48:08 +03:00
alexey-milovidov
b82c633716
Merge pull request #11048 from filimonov/kafka_missed_data_during_drop 
Fixes the potential missed data during termination of Kafka engine table
 2020-05-22 14:11:10 +03:00
alesapin
138e4562f3 Skip flacky test 2020-05-22 13:38:56 +03:00