Commit Graph

358 Commits

Author SHA1 Message Date
Azat Khuzhin
9386478a77 Add test for load_balancing algorithms 2020-06-14 01:09:22 +03:00
kssenii
dcd7b7351c Support headers-exchange type 2020-06-13 21:47:22 +00:00
kssenii
9c49398728 Fix tests 2020-06-13 18:44:17 +00:00
kssenii
3b0a3e00c0 Some fixes 2020-06-12 18:09:49 +00:00
zhang2014
8d9b770da4 ISSUES-7572 fix defaults config level & add replicas_status and prometheus handler 2020-06-13 00:15:02 +08:00
zhang2014
1c55aa0333 ISSUES-7572 add integration test 2020-06-12 18:19:03 +08:00
Azat Khuzhin
103eb17107 Force table creation on SYSTEM FLUSH LOGS (v2)
After this patch SYSTEM FLUSH LOGS will force system.*_log table
creatoins (only for enabled tables of course).

This will avoid such hacks like:

   set log_queries=1;
   select 1;
   system flush logs;

This is the second version of the patch, since first has a deadlock [1]
(reported by @alesapin). This version does not use separate lock and do
not issue CREATE TABLE from the query execution thread, instead it
activate flushing thread to do so, hence this should be the same as if
the table will be created during flush.

  [1]: https://gist.github.com/alesapin/d915d1deaa27d49aa31223daded02be2

Fixes: #11563
Cc: @alesapin
Cc: @nikitamikhaylov
2020-06-11 23:12:23 +03:00
kssenii
626eb53baa Fix multiple bindings for single queue & rm hardcoded strings 2020-06-11 11:13:13 +00:00
kssenii
9350472ee4 Support multiple bindings 2020-06-11 10:29:08 +00:00
alesapin
5a9a63e9a1
Revert "Force table creation on SYSTEM FLUSH LOGS" 2020-06-11 13:22:24 +03:00
alexey-milovidov
8e9c2dbf85
Merge pull request #11582 from ClickHouse/fix_test_replica_fetch
Better integration test test_always_fetch_merged.
2020-06-11 06:51:56 +03:00
kssenii
18820814f5 Merge 2020-06-10 23:25:33 +00:00
kssenii
d7b2694806 Support all exchange types 2020-06-10 23:06:23 +00:00
Nikita Mikhaylov
425c20eeb8
Merge pull request #11563 from azat/SYSTEM-FLUSH-LOGS-force-table-creation
Force table creation on SYSTEM FLUSH LOGS
2020-06-11 02:03:34 +04:00
Nikita Mikhaylov
4bf46ed288
Merge pull request #11573 from nikitamikhaylov/copier-test-fix
Fix copier test
2020-06-11 00:38:27 +04:00
alexey-milovidov
123a017057
Merge pull request #11528 from azat/use_compact_format_in_distributed_parts_names-fix
Fix shard_num/replica_num for <node> (breaks use_compact_format_in_distributed_parts_names)
2020-06-10 22:02:51 +03:00
alesapin
e221a64c4b Better test 2020-06-10 18:56:18 +03:00
Nikita Mikhaylov
93b0d5b29b done 2020-06-10 15:47:34 +03:00
Azat Khuzhin
8a78cffe5c Force table creation on SYSTEM FLUSH LOGS 2020-06-09 21:11:08 +03:00
Alexander Tokmakov
6bb68329f8 Merge branch 'master' into merging_external_source_cassandra 2020-06-09 19:51:14 +03:00
MovElb
e6dcece2fd return tcp_port 2020-06-08 22:39:02 +03:00
Azat Khuzhin
eee2fb867a Update test_distributed_format to cover remote_servers via <node> 2020-06-08 22:32:06 +03:00
Azat Khuzhin
222bbe95d6 Cover load_balancing for Distributed INSERT w/o internal_replication 2020-06-08 21:58:56 +03:00
MovElb
fc981a2869 fix for review 2020-06-08 15:05:49 +03:00
alesapin
483c60fadd Merging #8377 2020-06-08 14:25:30 +03:00
kssenii
17e7cc03c0 Add consumer failure handler 2020-06-08 01:11:48 +00:00
tavplubix
686c0539db
Merge pull request #11487 from ClickHouse/improve_dns_cache
Use DNSResolver to check if user is allowed to connect from an address
2020-06-07 19:55:03 +03:00
Alexander Tokmakov
0cf8015f4a use DNSResolver to check if user is allowed to connect 2020-06-07 00:02:29 +03:00
Ivan
058821fa02
Merge branch 'master' into kafka_better_settings 2020-06-06 19:50:38 +03:00
Ivan
c8808e89fd
Update test.py 2020-06-06 19:48:03 +03:00
alesapin
212df30fc5 Add test for different ttl versions 2020-06-04 17:18:54 +03:00
alesapin
b163052d1b
Merge pull request #11134 from GrigoryPervakov/custom-auth
Add default credentials and custom headers for s3 storage.
2020-06-04 16:46:01 +03:00
Mikhail Filimonov
26d93fdfba Fix the test, adjust default for queued.min.messages 2020-06-04 14:14:24 +02:00
Alexander Tokmakov
64c013610a fix 2020-06-04 01:03:49 +03:00
Alexander Tokmakov
e67837bc4a cleenup 2020-06-04 00:11:17 +03:00
Mikhail Filimonov
bf1e5db0ee Tests from issue #11308, from issue #4116 2020-06-03 19:01:45 +02:00
Alexander Tokmakov
e3aa20708a Merge branch 'master' into merging_external_source_cassandra 2020-06-03 14:55:02 +03:00
Alexander Tokmakov
73926b2cf9 support loading from multiple partitions with complex key 2020-06-03 14:54:26 +03:00
alesapin
d113a1cde7 More clear test 2020-06-02 21:47:30 +03:00
alesapin
6253e9b97b Revert disabled tests 2020-06-02 21:41:29 +03:00
alesapin
46fcff26b0 Disable flaky tests 2020-06-02 21:14:16 +03:00
Pervakov Grigorii
bc9381406f Add default credentials and custom headers for s3 table functions. 2020-06-02 20:48:49 +03:00
alesapin
ffa553ad91 Fix test 2020-06-02 18:11:51 +03:00
alesapin
e5a2ae4637 Remove unused import 2020-06-02 11:46:08 +03:00
alesapin
96ec552b51 Fix flaky ttl test 2020-06-02 11:42:42 +03:00
alesapin
5d54e18541 Fix sync_async test (remove timeout) 2020-06-01 22:35:56 +03:00
kssenii
d3b069e37b Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into add-storage-rabbitmq-read-only 2020-06-01 18:25:36 +00:00
kssenii
5939422b85 Add tests for insert part 2020-06-01 17:02:14 +00:00
alexey-milovidov
19c6e0e5ae
Merge pull request #11307 from ClickHouse/remove-system-tables-lazy-load
Remove "system_tables_lazy_load" option
2020-06-01 16:26:23 +03:00
Alexander Tokmakov
62761eddcc Merge branch 'master' into merging_external_source_cassandra 2020-06-01 14:44:46 +03:00
alesapin
c4d520d831 Fix part_log test 2020-06-01 12:12:52 +03:00
alesapin
c22e8f6b9b
Merge pull request #11283 from filimonov/kafka_virtual_column_headers
Virtual columns for Kafka headers
2020-06-01 12:06:00 +03:00
alesapin
364ebe9246
Merge pull request #11260 from filimonov/kafka_virtual_column_timestamp_ms
Add _timestamp_ms virtual columns to Kafka engine
2020-06-01 12:04:17 +03:00
alexey-milovidov
92c56afed1
Merge pull request #11320 from ClickHouse/revert-revert-disable-flacky-tests
Disable flacky test #8840
2020-06-01 00:10:53 +03:00
alexey-milovidov
9a362eb02e
Merge pull request #11252 from filimonov/kafka-clientid
Kafka clientid (finishing #11073)
2020-05-31 18:37:30 +03:00
alexey-milovidov
fb1a2fa26b
Merge pull request #11256 from filimonov/librdkafka_1_4_2
Update librdkafka to version 1.4.2
2020-05-31 18:34:55 +03:00
Alexey Milovidov
5192ebdc23 Fix test with obsolete assumption 2020-05-31 18:10:52 +03:00
Alexey Milovidov
87cf123ef8 Merge branch 'master' into remove-system-tables-lazy-load 2020-05-31 18:06:08 +03:00
alexey-milovidov
ece21b353c
Merge pull request #11312 from ClickHouse/debug-bad-test
Debug bad test "mysql_federated"
2020-05-31 17:32:56 +03:00
Alexey Milovidov
2529df016a Disable flacky test #8840 2020-05-31 17:08:09 +03:00
kssenii
e80b405359 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into add-storage-rabbitmq-read-only 2020-05-31 10:30:53 +00:00
Alexey Milovidov
ff54b4c82b Retain some parts of the modification 2020-05-30 21:43:14 +03:00
Alexey Milovidov
9b4d6ac818 Revert test 2020-05-30 21:42:19 +03:00
alexey-milovidov
3eea042d16
Merge pull request #11243 from ClickHouse/remove-experimental-use-processors-flag-4
Remove some code.
2020-05-30 21:05:14 +03:00
MovElb
b4b5c90343 squash 2020-05-30 20:05:05 +03:00
Alexey Milovidov
6604b6aa18 Debug bad test "mysql_federated" 2020-05-30 20:03:28 +03:00
Alexey Milovidov
496fed5ed3 Remove "system_tables_lazy_load" option 2020-05-30 17:24:09 +03:00
Nikolai Kochetov
c43976b6c5 Update test. 2020-05-30 11:31:07 +03:00
Alexander Tokmakov
8921041706 Merge branch 'master' into merging_external_source_cassandra 2020-05-29 18:20:39 +03:00
alexey-milovidov
304c6a1ee3
Merge pull request #11278 from vitlibar/fix-crash-set-default-role-with-wrong-args
Fix crash when SET DEFAULT ROLE is called with wrong arguments.
2020-05-29 16:24:42 +03:00
Nikita Mikhaylov
9233997b24
Merge pull request #11233 from nikitamikhaylov/cache-getstring-bugfix
Cache-dictionary getString() bugfix
2020-05-29 16:32:35 +04:00
Mikhail Filimonov
b885337454 Virtual columns for accessing kafka message headers 2020-05-29 10:44:10 +02:00
Vitaly Baranov
2d12b4d3ac Fix crash when SET DEFAULT ROLE is called with wrong arguments. 2020-05-29 09:54:27 +03:00
Mikhail Filimonov
03430b1763 Change the test, accept new librdkafka behaviour 2020-05-28 23:11:29 +02:00
Mikhail Filimonov
e39c4cdf71 Add _timestamp_ms virtual columns to Kafka engine 2020-05-28 19:41:57 +02:00
Vitaly Baranov
d7cc703233
Merge pull request #11080 from vitlibar/add-authentication-type-to-system-users
Show authentication type in system.users table
2020-05-28 20:20:41 +03:00
Mikhail Filimonov
6b694d54b4 Better kafka client.id 2020-05-28 15:39:55 +02:00
Vitaly Baranov
98172deffc Show authentication type in table system.users and while executing SHOW CREATE USER query. 2020-05-28 08:34:10 +03:00
alexey-milovidov
b430af82e5
Merge pull request #11232 from vitlibar/add-test-row_policy-affects-only-user-assigned
Add a test for row policy
2020-05-28 01:16:48 +03:00
Alexander Tokmakov
905bce4aeb fix 2020-05-27 23:53:35 +03:00
Nikita Mikhaylov
ec479839d9 fixed 2020-05-27 22:44:22 +03:00
Alexander Kuzmenkov
640df68e05
Merge pull request #11184 from ClickHouse/enable-log-queries
Enable log_queries by default
2020-05-27 20:55:31 +03:00
Vitaly Baranov
bb0045a242 Add test for row policy that policy defined in users.xml affects only the user it assigned to. 2020-05-27 20:37:43 +03:00
Alexander Tokmakov
f099ce19a7 fix 2020-05-27 16:54:39 +03:00
alexey-milovidov
992f0dfec5
Merge pull request #11149 from filimonov/kafka_reschedule
Fixed reschedule issue in Kafka
2020-05-27 13:26:55 +03:00
alesapin
3399e573d1
Merge pull request #11199 from ClickHouse/fix_primary_key_method_call
Fix primary key check
2020-05-27 11:55:12 +03:00
Ivan Blinkov
d941c483b2
Update test.py 2020-05-27 11:25:36 +03:00
filimonov
c73b8372e7
Update test.py 2020-05-27 07:44:13 +02:00
Mikhail Filimonov
efc0b97707 Fix Kafka performance issue related to reschedules based on limits, which were always applied. 2020-05-27 07:39:06 +02:00
Alexander Tokmakov
940132adc4 Merge branch 'master' into merging_external_source_cassandra 2020-05-27 00:13:57 +03:00
Ivan Blinkov
4a92ad11ec
Update test.py 2020-05-26 23:27:31 +03:00
Alexander Tokmakov
310d522528 minimal implementation 2020-05-26 22:21:18 +03:00
kssenii
ad1c0de8db Merge 2020-05-26 17:45:39 +00:00
kssenii
14c67c6ae6 Fixes 2020-05-26 17:34:57 +00:00
Vitaly Baranov
2c8a355f19
Merge pull request #11081 from vitlibar/fix-no-password-mode
Fix settings NO_PASSWORD authentication mode in users.xml.
2020-05-26 14:20:34 +03:00
alesapin
5780240e88 Fix primry key check 2020-05-26 12:46:04 +03:00
alexey-milovidov
d4acd1af3a
Merge pull request #11179 from excitoon-favorites/s3globfix
Fixed S3 globbing which could fail in case of more than 1000 keys and some backends
2020-05-26 02:45:42 +03:00
filimonov
73a0ef6c0e
Fix for the hang during deletion of engine=Kafka (one more time) (#11145)
* Added flag for safer rdkafka destruction, but more testing detected another hang case, which has no straigt solutions and can be workarounded currenly only by draining the consumer queue, so destructor is back

* After review fixes

* After review fixes2

* After review fixes3
2020-05-26 00:13:10 +03:00
alexey-milovidov
7201018079
Update test.py 2020-05-26 00:05:15 +03:00
Vladimir Chebotarev
e013edce4b Added test for multi-page S3 globbing. 2020-05-25 15:57:27 +03:00