Commit Graph

383 Commits

Author SHA1 Message Date
Alexander Tokmakov
ba0fcec993 add background cleanup of store/ subdirs 2022-06-21 12:35:47 +02:00
kssenii
e974ab61e6 Fix 2022-06-15 11:31:45 +02:00
kssenii
4813b90281 Merge master 2022-06-13 21:32:00 +02:00
kssenii
aaf9a46f07 Merge master 2022-06-11 15:56:05 +02:00
Kseniia Sumarokova
580a30c6ae
Merge pull request #37859 from KinderRiven/support_max_request_cache_size
Support to set max cache size for per query in local cache
2022-06-10 16:17:18 +02:00
KinderRiven
6c76be9db1 fix config 2022-06-08 16:11:12 +08:00
KinderRiven
e0819f346a fix test 2022-06-08 16:04:47 +08:00
KinderRiven
b853f6e68c fix unit_test 2022-06-08 14:19:59 +08:00
Vitaly Baranov
d199478169
Merge pull request #37303 from ClickHouse/fix_trash
Try to fix some trash
2022-06-07 10:17:39 +02:00
Alexander Tokmakov
a893595025
Merge pull request #37596 from hanfei1991/hanfei/zk-write
Support insert into system.zookeeper
2022-06-02 15:09:07 +03:00
kssenii
e3647585aa Fix tests 2022-06-01 19:58:28 +02:00
kssenii
aa60de8f63 Merge master 2022-06-01 15:32:01 +02:00
Alexander Tokmakov
75f49a48e1 Merge branch 'master' into fix_trash 2022-06-01 14:20:46 +02:00
Han Fei
dd7e609585 add zk_write.xml 2022-06-01 17:08:19 +08:00
kssenii
53b6b76218 Better, add test 2022-05-31 15:33:56 +02:00
alesapin
59a070778d More quite logging for S3 tests 2022-05-29 14:48:04 +02:00
Alexander Tokmakov
4e52f45695 Merge branch 'master' into fix_trash 2022-05-28 19:43:19 +02:00
kssenii
b9618ea71c Fix checks 2022-05-28 01:17:08 +02:00
kssenii
0b350ce391 Fix checks 2022-05-27 20:52:30 +02:00
kssenii
25b1ed526d Merge master 2022-05-27 16:50:45 +02:00
Kseniia Sumarokova
f5d69506b4
Merge pull request #37516 from KinderRiven/improve_local_cache
Control cache downloads to avoid negative optimization of local caches
2022-05-27 11:53:17 +02:00
KinderRiven
55379f0d03 fix config 2022-05-26 20:59:31 +08:00
KinderRiven
ab4614dee5 fix 2022-05-26 16:39:50 +08:00
KinderRiven
f5a186c774 add test for local cache download 2022-05-26 16:36:26 +08:00
kssenii
b89a4edc04 Merge master 2022-05-25 20:55:04 +02:00
Alexander Tokmakov
4618429201 fixes 2022-05-24 18:53:52 +02:00
Alexander Tokmakov
bb5f04efaf Merge branch 'master' into fix_trash 2022-05-24 17:45:51 +02:00
Alexander Tokmakov
d0f998fb88 Merge branch 'master' into fix_trash 2022-05-23 21:25:56 +02:00
kssenii
9aa20193d5 Merge master 2022-05-22 00:56:20 +02:00
Alexander Tokmakov
c48410b574 fix trash in my code 2022-05-21 02:05:02 +02:00
Alexander Tokmakov
44f2d4529a better waiting, add fault injection 2022-05-20 22:10:01 +02:00
kssenii
e501a5a106 Update tests config 2022-05-19 15:55:07 +02:00
Alexander Tokmakov
538b5cd536 fix more trash 2022-05-18 14:06:52 +02:00
Alexander Tokmakov
5590adeffa fix more trash 2022-05-17 23:04:24 +02:00
Azat Khuzhin
01e1c5345a Add separate CLUSTER grant
In case you have different roles for the same user on multiple clusters,
ON CLUSTER query can help to overcome some limitations.

Consider the following example:
- cluster_with_data, dev_user (readonly=2)
- stage_cluster, dev_user (readonly=0)

So when you will execute the following query from stage_cluster, it will
be successfully executed, since ON CLUSTER queries has different system
profile:

    DROP DATABASE default ON CLUSTER cluster_with_data

This is not 100% safe, but at least something.

Note, that right now only ON CLUSTER query it self is supported, but
separate clusters are not (i.e. GRANT CLUSTER some_cluster_name TO
default), since right now grants sticked to database+.

v2: on_cluster_queries_require_cluster_grant
v3: fix test and process flags as bit mask
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-05-16 13:57:45 +03:00
kssenii
47ff7b6132 Fixes after merge 2022-05-13 19:22:22 +02:00
kssenii
58faaf0ea3 Merge master 2022-05-13 18:51:07 +02:00
Alexander Tokmakov
c23bc01196 Merge branch 'master' into zookeeper_client_fault_injection 2022-05-11 17:20:42 +02:00
Kruglov Pavel
23bd9390a6
Merge pull request #36997 from vitlibar/users-without-assigned-policies-can-view-rows
Users without assigned row policies can view rows
2022-05-09 12:04:50 +02:00
Vitaly Baranov
69bec2f377 Users without assigned row policies can view rows now. 2022-05-07 14:50:24 +02:00
Alexey Milovidov
8b26c5fe02
Merge pull request #36838 from ClickHouse/config-update
Disable `merge_tree_metadata_cache` by default
2022-05-06 01:59:01 +03:00
Nikita Mikhaylov
928971b59c Enable metadata cache in tests 2022-05-01 21:13:27 +00:00
KinderRiven
1db2bcf4dc rebase master 2022-05-01 19:46:55 +08:00
KinderRiven
b68bccae51 fix config 2022-05-01 19:45:16 +08:00
KinderRiven
7d0789472c fix 2022-05-01 19:45:16 +08:00
Nikita Taranov
92f8244932
Fix certs (finishing pr #36457) (#36747) 2022-05-01 12:59:19 +02:00
kssenii
0c43b7b08a Merge master 2022-04-26 16:10:47 +02:00
kssenii
a395532d54 Add support for exact right bounded reads for some other buffers 2022-04-26 12:56:40 +02:00
Kseniia Sumarokova
3215faca72
Update storage_conf.xml 2022-04-25 21:15:38 +02:00
kssenii
a76a35d3ce Better drop cache 2022-04-25 19:20:25 +02:00
kssenii
7f78196b68 Update config 2022-04-13 15:11:40 +02:00
Alexander Tokmakov
49c35f3261 Merge branch 'master' into mvcc_prototype 2022-04-08 13:34:40 +02:00
kssenii
6c8e073a61 Merge master 2022-04-01 16:48:29 +02:00
Alexander Tokmakov
6591d1ceb7 Merge branch 'master' into mvcc_prototype 2022-04-01 15:38:46 +02:00
Alexander Tokmakov
307a2ca579 Merge branch 'master' into zookeeper_client_fault_injection 2022-03-31 15:32:41 +02:00
Alexander Tokmakov
287d858fda Merge branch 'master' into mvcc_prototype 2022-03-29 16:24:12 +02:00
kssenii
44157e5c80 Merge master 2022-03-29 02:19:32 +02:00
kssenii
1d49a85963 Merge master 2022-03-28 22:51:56 +02:00
kssenii
a2013ebe2b Better 2022-03-28 22:40:27 +02:00
Alexander Tokmakov
208b242188 Merge branch 'master' into mvcc_prototype 2022-03-28 19:58:06 +02:00
kssenii
200abb51dc Better test 2022-03-25 12:48:23 +01:00
kssenii
6769b84638 Merge master 2022-03-24 20:47:43 +01:00
kssenii
d9d9f3bc6d Fix 2022-03-24 19:10:53 +01:00
kssenii
d4161b5925 Add optin read_from_cache_if_exists_otherwise_bypass_cache (for merges) 2022-03-23 20:24:00 +01:00
kssenii
8c1be8950e Improve test 2022-03-23 16:55:18 +01:00
Alexander Tokmakov
94f616b48e Merge branch 'master' into merging_30325 2022-03-21 13:23:45 +01:00
Alexander Tokmakov
5c760fd7ce Merge branch 'master' into zookeeper_client_fault_injection 2022-03-21 11:57:40 +01:00
Alexander Tokmakov
c2ac8d4a5c review fixes 2022-03-16 21:05:34 +01:00
Alexander Tokmakov
9702b5177d Merge branch 'master' into mvcc_prototype 2022-03-14 21:45:38 +01:00
kssenii
f081edce74 Turn on cache for all s3 tests 2022-03-01 17:54:46 +01:00
kssenii
26f58274b6 Fix stateful test 2022-02-22 12:05:43 +01:00
kssenii
353ffacca3 Add test 2022-02-17 19:57:04 +01:00
Alexander Tokmakov
dae044f86b Merge branch 'master' into mvcc_prototype 2022-02-17 13:49:37 +03:00
kssenii
47f94120da Merge master 2022-02-16 14:43:28 +01:00
kssenii
f9622d44f0 Try add stateful tests 2022-02-16 14:18:55 +01:00
alesapin
18f08ed932
Revert "Revert "Add func tests run with s3"" 2022-02-01 10:20:06 +03:00
alexey-milovidov
cbfcd45be3
Revert "Add func tests run with s3" 2022-02-01 05:46:13 +03:00
alesapin
c219a53b4a Add func tests run with s3 2022-01-30 17:28:52 +03:00
Alexander Tokmakov
e0304c2a58 review fixes, write tid into mutation entry 2022-01-28 20:47:37 +03:00
Alexander Tokmakov
e9a5a64a71 Merge branch 'master' into mvcc_prototype 2022-01-19 21:41:23 +03:00
mergify[bot]
e492fe0a0f
Merge branch 'master' into zookeeper_client_fault_injection 2022-01-17 15:26:16 +00:00
Alexander Tokmakov
e1a41fc694 add system log for introspection 2022-01-14 17:03:00 +03:00
JackyWoo
569ce62e8d use session_timeout as session timeout uper bound 2021-12-30 17:18:51 +08:00
JackyWoo
ad7f206840 change max_session_timeout_ms default value from 30000 to 100000 2021-12-29 21:05:27 +08:00
JackyWoo
d35e5f8319 add lower bound session timeout to keeper 2021-12-29 20:59:01 +08:00
Alexander Tokmakov
7fcb79ae72 Merge branch 'master' into mvcc_prototype 2021-12-07 14:39:29 +03:00
alesapin
525011db81
Merge pull request #31799 from ClickHouse/fix_default_keeper_port
Fix default keeper port
2021-11-29 16:31:36 +03:00
alesapin
dc6afadea3 Fix default keeper port 2021-11-25 14:01:30 +03:00
kssenii
20c59b66f9 ClickHouse dictionary support named collections 2021-11-25 01:51:38 +03:00
Alexander Tokmakov
06bed68f6e Merge branch 'master' into mvcc_prototype 2021-11-17 23:03:19 +03:00
mergify[bot]
66f7b81b5e
Merge branch 'master' into zookeeper_client_fault_injection 2021-11-17 09:41:12 +00:00
tavplubix
c5ec95a196
Update keeper_port.xml 2021-11-16 15:03:01 +03:00
Alexander Tokmakov
92eec74ad7 Merge branch 'master' into mvcc_prototype 2021-11-06 21:08:36 +03:00
Azat Khuzhin
0047d2eb4f Remove metric_log/part_log overrides in tests (enabled by default) 2021-11-03 08:39:36 +03:00
zhangxiao871
45c12f9b2a merge from master 2021-11-01 18:32:56 +08:00
Alexander Tokmakov
35b5cb9571 Merge branch 'master' into zookeeper_client_fault_injection 2021-10-25 19:03:37 +03:00
alesapin
490ca93162
Merge pull request #30372 from ClickHouse/update_keeper_config
Updatable keeper configuration.
2021-10-25 10:37:03 +03:00
Alexander Tokmakov
27ca943863 add fault injection in ZooKeeper client 2021-10-22 18:59:38 +03:00
alesapin
26d40a6622 Update tests configs 2021-10-20 10:56:29 +03:00
zhangxiao871
77c22dce3c Zookeeper load balancing settings 2021-10-18 18:53:42 +08:00
kssenii
1de55cfeb4 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into remote-connection 2021-10-11 11:33:35 +00:00
kssenii
5a87b6eb4f Predefined configuration for table function remote 2021-10-06 05:55:09 +00:00
Filatenkov Artur
d41ef6a9f8
Update CORS.xml 2021-10-01 17:08:22 +03:00
Filatenkov Artur
8959b348a1
Merge branch 'ClickHouse:master' into add_CORS 2021-10-01 14:42:46 +03:00
Filatenkov Artur
36b699659e
Update CORS.xml 2021-09-29 14:32:04 +03:00
Alexander Tokmakov
72b1b2e360 Merge branch 'master' into mvcc_prototype 2021-09-23 22:53:27 +03:00
Filatenkov Artur
ec5ae5d86a
Update CORS.xml 2021-09-22 15:23:08 +03:00
Artur
2cffa98a60 add test and comments in config 2021-09-22 12:22:21 +00:00
Alexey Milovidov
e513a5db32 Change <yandex> to <clickhouse> in configs 2021-09-20 01:38:53 +03:00
Filatenkov Artur
c23fe5baf6
Improve codec for encr 19896 (#27476)
* change syntax of encrypted command

* commit all encrypted changes

* correct encryption

* correct config for test

* add tests and correct code style and typos

* correct test

* fix unbundled build

* add log warning messages

* improve code according to review comments

* correct nonce

* correct errors found by fuzzing

* improve codec AES_128_GCM_SIV. Add AES_256_GCM_SIV. Add sections for last in tests. Improve documentation

* Update CompressionCodecEncrypted.h

* Update 01683_codec_encrypted.sql

* correct compression factory after changes in master

* correct behavior with wrong key in data

* correct fuzzer

* add connection for fuzzer with fix for compression_encrypted

* refactor code

* add load from config with throwing errors on server start

* fix typos and check style

* Update Server.cpp

* correct loading and reading

* refactor code. fix uninitialized value

* refactor code

* move defines from server to cpp file

* correct build

* remove repeated code

* correct namespace

* fix code style
2021-09-13 11:25:36 +03:00
alesapin
8b8b0043c1 Fix logger conf 2021-09-03 14:20:09 +03:00
alesapin
497c225203 Test log level for CI 2021-09-03 13:07:40 +03:00
mergify[bot]
b81d479de4
Merge branch 'master' into stress-thread-fuzzer 2021-08-31 11:56:30 +00:00
alesapin
b4646f5016
Update keeper_port.xml 2021-08-30 12:49:11 +03:00
tavplubix
703101fe4d
Merge pull request #27931 from ClickHouse/wait_for_all_replicas_timeouts
Avoid too long waiting for inactive replicas
2021-08-27 14:31:36 +03:00
Azat Khuzhin
91621cfcd2 Fix reading of custom TLD w/o new line at EOF
Fixes: #28177
2021-08-27 00:43:21 +03:00
mergify[bot]
d75fbdf5f1
Merge branch 'master' into stress-thread-fuzzer 2021-08-21 11:12:52 +00:00
Alexander Tokmakov
9ef0b00803 fix config 2021-08-20 17:12:42 +03:00
mergify[bot]
02b4e56e6a
Merge branch 'master' into break_some_tests 2021-08-20 13:24:17 +00:00
tavplubix
64bfe21a1b
Fix test 00443_preferred_block_size_bytes.sh (#27846)
* Update 00443_preferred_block_size_bytes.sh

* Update clickhouse-test

* Update clickhouse-test

* Update database_replicated.xml
2021-08-20 00:25:14 +03:00
alesapin
e75dc73c65 Bigger startup timeout 2021-08-18 11:14:32 +03:00
Alexander Tokmakov
285a5848b5 fix 2021-08-13 14:27:55 +03:00
PHO
6425dd001a
Add a codec AES_128_GCM_SIV for encrypting columns on disk (#19896)
* Add a codec Encrypted() for encrypting columns on disk

While this is implemented as a compression codec, it does not actually compress data. It instead encrypts data on disk. The key is obtained by executing a user-specified command at the server startup, or if it's not specified the codec refuses to process any data. For now the only supported cipher is 'AES-128-GCM-SIV'.
2021-07-30 12:12:33 +03:00
Vadim Volodin
918a4e8ab3 Supported cluster macros inside table function 'cluster' 2021-07-29 12:12:29 +03:00
Alexander Tokmakov
c74bfbf991 Merge branch 'master' into mvcc_prototype 2021-07-28 22:21:48 +03:00
mergify[bot]
2929cf3ba8
Merge branch 'master' into system_zookeeper_log 2021-07-26 08:40:55 +00:00
Alexey Milovidov
09449cc101 Whitespaces 2021-07-21 04:47:56 +03:00
Alexander Tokmakov
4165ba2a01 add system.zookeeper_log 2021-07-09 17:05:35 +03:00
Alexander Tokmakov
02d966dcc9 fix 2021-05-31 21:28:36 +03:00
Azat Khuzhin
73ab415c4c Preserve errors for INSERT into Distributed
Before this patch (and after #22208) the INSERT may fail with "Cannot
schedule a task" because the pool in DistributedBlockOutputStream
already throws exception and simply fail in writeSuffix().
2021-04-28 22:33:29 +03:00
Azat Khuzhin
91fc2fc87f tests/config/config.d/clusters.xml: fix indent 2021-04-28 21:26:12 +03:00
alesapin
b67cb5392b Missed setting 2021-04-14 22:48:52 +03:00
alesapin
f13eade50e Upload keeper logs from stateless tests 2021-04-14 18:04:57 +03:00
alesapin
80d441ec95 Reset timeouts to default 2021-04-06 19:11:29 +03:00
tavplubix
0bb3b90c50
Update database_replicated.xml 2021-04-01 20:06:49 +03:00
Alexander Tokmakov
24fc120076 Merge branch 'master' into test_multiple_nodes 2021-03-30 10:40:38 +03:00
alesapin
5e3ebb3e0e
Merge pull request #22274 from ClickHouse/rename_keeper
Rename NuKeeper and TestKeeper to Keeper in all places
2021-03-30 10:39:22 +03:00
flynn
858d1fe593
Fix table function clusterAllReplicas return wrong _shard_num (#21498)
* Fix deadlock in delete mutations when predicate contains table itself

* Fix table function clusterAllReplicas return wrong _shard_num

fix build on gcc-10

better

update test

fix

fix

fix

fix

fix

fix cluster config

Co-authored-by: alesapin <alesapin@gmail.com>
2021-03-29 23:21:08 +03:00
Alexander Tokmakov
9925110713 rename other occurrances 2021-03-29 23:04:50 +03:00
Alexander Tokmakov
ccd31d1b72 Merge remote-tracking branch 'ch/rename_keeper' into test_multiple_nodes 2021-03-29 22:44:40 +03:00
alesapin
be132a32a2 More renames 2021-03-29 11:24:56 +03:00
tavplubix
710c491f63
Update database_replicated.xml 2021-03-17 19:50:56 +03:00
Alexander Tokmakov
ff79be8af9 fix 2021-03-16 23:01:20 +03:00
Alexander Tokmakov
ab07b3b516 Merge branch 'distributed_ddl_improvements' into test_multiple_nodes 2021-03-15 21:22:24 +03:00
Alexander Tokmakov
e62e256e77 fix 2021-03-13 13:22:48 +03:00
Alexander Tokmakov
8e00ff7898 try run two nodes with Replicated db and NuKeeper 2021-03-13 04:25:13 +03:00
Alexander Tokmakov
4d19c84d90 Merge branch 'master' into distributed_ddl_improvements 2021-03-09 20:06:41 +03:00
Alexander Tokmakov
5c5d11cfce enable some tests 2021-03-09 03:48:37 +03:00
alesapin
9e7a848169 Simplify config 2021-03-04 16:48:06 +03:00
alesapin
7556a3d723 Enable snapshots 2021-03-04 11:00:26 +03:00
alesapin
0f733828c2 Missed config 2021-03-03 19:44:06 +03:00
alesapin
e447dd72f4 Disable snapshots 2021-02-21 17:00:10 +03:00
alesapin
5bf8c42e04 Fix config 2021-02-21 10:18:39 +03:00
alesapin
331de3d653 Trying to add tests more stable 2021-02-21 00:08:19 +03:00
alesapin
5b597fdf44 Force sync setting and ability to start with broken log 2021-02-18 13:23:48 +03:00
alesapin
d3e87701d4 Persistent storage 2021-02-16 22:02:18 +03:00
alesapin
c1550814ca Disable snapshots for tests 2021-02-15 10:30:08 +03:00
alesapin
b130fbfd78 Add coordination settings 2021-02-09 17:47:18 +03:00
alesapin
d265e3b419 Less timeouts 2021-02-02 11:02:25 +03:00
alesapin
365bf65f5a Fix install script 2021-02-01 17:14:59 +03:00
alesapin
dea4b5009b Some server initialization 2021-01-25 15:29:12 +03:00
alesapin
d873439846
Merge pull request #15236 from ClickHouse/run_func_tests_in_parallel
Collect list of non-parallel test
2020-12-16 19:29:32 +03:00
Alexander Kuzmenkov
fb1221148d
Merge pull request #17748 from azat/custom-TLD
Add ability to use custom TLD list
2020-12-11 12:42:19 +03:00
Azat Khuzhin
352a1eea34 Use new top_level_domains_path 2020-12-09 21:08:31 +03:00
Azat Khuzhin
8875767b87 Add a test for custom TLD 2020-12-09 21:08:30 +03:00
alesapin
3d0dbbe411 Fix build 2020-12-08 17:49:18 +03:00
alesapin
b68aa1c76d Merge branch 'master' into run_func_tests_in_parallel 2020-12-03 17:22:09 +03:00
Alexey Milovidov
3e2447391b Support for PROXY protocol 2020-12-03 00:05:51 +03:00
alesapin
fb86eaf6fc Better errors and better config 2020-11-25 16:19:09 +03:00
alesapin
b8fb44a7b9 Merge with master 2020-11-23 11:05:50 +03:00
Azat Khuzhin
dd0fccae47 Disable rotation of the logs in tests (on CI)
Right now due to rotation the archive with the clickhouse-server.log
maybe not full, for example:
- not full - https://clickhouse-test-reports.s3.yandex.net/16947/caf5f98db2ae39dd911f7d1fc0a7c2cc382b1c53/functional_stateless_tests_(ubsan)/clickhouse-server.log (no messages about server start)
- full     - https://clickhouse-test-reports.s3.yandex.net/16993/d1f52dc72d417580c4088cf3880593176416bea2/functional_stateless_tests_(thread).html

And sometimes rotated part may include relative part of the log, so it
is better to disable it.
2020-11-19 01:08:47 +03:00
alesapin
7d32873cb9 Add missed file 2020-11-11 19:59:13 +03:00
alesapin
df02bb2315 Change test config 2020-11-11 17:00:28 +03:00
alesapin
e2ece9ef0a Merge branch 'master' into run_func_tests_in_parallel 2020-11-09 13:24:47 +03:00
Azat Khuzhin
c057e86040 Fix path masking in system.distribution_queue for multiple nodes 2020-11-06 21:04:50 +03:00
Azat Khuzhin
b2e17916e4 Mask password in data_path in the system.distribution_queue 2020-11-06 00:10:25 +03:00
alesapin
7d735b4725
Update max_concurrent_queries.xml 2020-10-13 13:40:00 +03:00
alesapin
2b66180c70 Merge branch 'master' into run_func_tests_in_parallel 2020-10-09 10:25:35 +03:00
Anton Popov
e0bc669423 run check with wide parts 2020-10-07 21:53:34 +03:00
alesapin
a257751924 Ignore max concurrent queries in tests 2020-10-06 10:13:55 +03:00
Alexander Tokmakov
34addcf61f add review suggestions 2020-09-26 22:18:28 +03:00
Alexander Tokmakov
fb826557b7 Merge branch 'master' into enable_atomic_database_by_default 2020-09-25 02:04:01 +03:00
alesapin
b8861ad6cc Move config files to directories 2020-09-24 13:21:34 +03:00