thevar1able/ClickHouse
1
0
Fork 0
mirror of https://github.com/ClickHouse/ClickHouse.git synced 2024-12-14 02:12:21 +00:00
Code Issues Packages Projects Releases Wiki Activity
120,352 Commits 9,330 Branches 1,783 Tags 2.1 GiB
db5cb96050
Commit Graph

7012 Commits

Author SHA1 Message Date
Vitaly Baranov
c48c20fac8 Use combined checksums for encrypted immutable files. 2023-05-16 14:27:27 +02:00
Vitaly Baranov
101aa6eff0 Add function copyS3FileFromDisk(). 2023-05-16 14:25:37 +02:00
Vitaly Baranov
fd2731845c Simplify interface of IBackupWriter: Remove supportNativeCopy() function. 2023-05-16 14:25:36 +02:00
robot-clickhouse
b3fc7d1a86 Automatic style fix 2023-05-16 11:15:15 +00:00
alesapin
a4f84cecfd Retry connection expired in test_rename_column/test.py 2023-05-16 13:05:36 +02:00
Kseniia Sumarokova
e2112576f0
Fix black check 2023-05-16 12:21:32 +02:00
avogar
f9e0eb47d7 Merge branch 'master' of github.com:ClickHouse/ClickHouse into urlCluster 2023-05-15 16:35:24 +00:00
Alexander Tokmakov
05ae7b2c2d fix some tests 2023-05-15 18:28:12 +02:00
AVMusorin
418a61a68c
Allow using Alias column type for KafkaEngine 
```
create table kafka
(
 a UInt32,
 a_str String Alias toString(a)
) engine = Kafka;

create table data
(
  a UInt32;
  a_str String
) engine = MergeTree
order by tuple();

create materialized view data_mv to data
(
  a UInt32,
  a_str String
) as
select a, a_str from kafka;
```
Alias type works as expected in comparison with MATERIALIZED/EPHEMERAL
or column with default expression.

Ref: https://github.com/ClickHouse/ClickHouse/pull/47138

Co-authored-by: Azat Khuzhin <a3at.mail@gmail.com>
 2023-05-15 15:39:58 +02:00
Sema Checherinda
a1ee7d52e1
Merge pull request #49432 from CheSema/lost-blobs 
all s3-blobs removed when merge aborted, remove part from failed fetch without unlock keper
 2023-05-12 13:19:27 +02:00
Nikita Mikhaylov
66badcd59c
Merge pull request #49725 from vitlibar/incremental-backup-append-table-def 
Fix writing appended files to incremental backups
 2023-05-12 11:37:49 +02:00
kssenii
c9e752fdc5 Fix 2023-05-12 00:10:49 +02:00
Vitaly Baranov
478140f8b4 Fix LimitSeekableReadBuffer. 2023-05-11 22:58:05 +02:00
Vitaly Baranov
ec011b9113
Merge branch 'master' into user-grants-from-config 2023-05-11 17:08:06 +02:00
avogar
3ee8de792c Merge branch 'master' of github.com:ClickHouse/ClickHouse into urlCluster 2023-05-11 12:46:20 +00:00
kssenii
bd59effd9a Merge remote-tracking branch 'upstream/master' into fix-pg-sync-tables-exception-broken-sync 2023-05-11 13:29:55 +02:00
Sema Checherinda
66e3712dca
Merge branch 'master' into lost-blobs 2023-05-11 08:23:25 +02:00
Alexey Milovidov
65d28a959f Update integration tests (1/2) 2023-05-11 04:26:29 +02:00
kssenii
383fc06761 Fix 2023-05-09 16:10:53 +02:00
Nikolay Degterinsky
39deaf4f2a
Merge pull request #49632 from evillique/fix-ssl-test 
Try to fix integration test 'test_ssl_cert_authentication'
 2023-05-09 11:53:21 +02:00
Alexey Milovidov
a8bdb20fc4
Merge pull request #48787 from ClickHouse/background-memory-tracker 
Add MemoryTracker for the background tasks [Resubmit]
 2023-05-09 07:58:36 +03:00
Alexey Milovidov
9a73a04fe3
Merge pull request #42587 from ClickHouse/compress-marks-primary-key-by-default 
Compress marks and primary key by default
 2023-05-09 06:43:10 +03:00
Alexander Tokmakov
5629d73bdb
Merge pull request #49560 from ClickHouse/fix_dictionaries_loading_order 
Fix dictionaries loading order
 2023-05-08 16:07:40 +03:00
Nikolay Degterinsky
ee4ce7db47 Fix style 2023-05-08 12:33:24 +00:00
Smita Kulkarni
f20901d9d3 Merge branch 'master' into Follow_up_Backup_Restore_concurrency_check_node_2 2023-05-08 13:53:19 +02:00
Alexey Milovidov
e083acc361 Merge branch 'compress-marks-primary-key-by-default' of github.com:ClickHouse/ClickHouse into compress-marks-primary-key-by-default 2023-05-08 07:02:55 +02:00
Alexey Milovidov
88d0d94933 Update test 2023-05-08 07:02:41 +02:00
Alexey Milovidov
3cf1da7bf3
Merge branch 'master' into deprecate-in-memory-parts 2023-05-08 01:38:00 +03:00
Alexander Tokmakov
abf6c60ad2 Merge branch 'master' into fix_dictionaries_loading_order 2023-05-08 00:31:03 +02:00
Nikolay Degterinsky
c841a187ab Try to fix integration test 'test_ssl_cert_authentication' 2023-05-07 18:34:34 +00:00
robot-clickhouse
fe76bde5b5 Automatic style fix 2023-05-07 16:33:07 +00:00
Alexey Milovidov
a2daeb849e Merge branch 'master' into compress-marks-primary-key-by-default 2023-05-07 18:25:01 +02:00
Alexey Milovidov
ea9249b0ac Merge branch 'compress-marks-primary-key-by-default' of github.com:ClickHouse/ClickHouse into compress-marks-primary-key-by-default 2023-05-07 18:24:51 +02:00
Alexey Milovidov
1ae8a5be3b Update a test 2023-05-07 18:24:38 +02:00
Alexey Milovidov
9eba74c1e1
Update test_vertical_merges_from_compact_parts.py 2023-05-07 17:45:45 +03:00
Alexey Milovidov
27e1357ee6
Update test_in_memory_parts_still_read.py 2023-05-07 17:42:18 +03:00
robot-clickhouse
fd82979961 Automatic style fix 2023-05-07 02:00:24 +00:00
Alexey Milovidov
d8f5667ba6 Follow-up for #49576 2023-05-07 03:59:35 +02:00
Alexey Milovidov
6e46a4e0ea
Update test_in_memory_parts_still_read.py 2023-05-07 04:56:09 +03:00
Alexey Milovidov
3b6edbacab Update tests 2023-05-07 03:45:17 +02:00
Alexey Milovidov
de3e66385c Merge branch 'master' into compress-marks-primary-key-by-default 2023-05-07 02:40:25 +02:00
Alexey Milovidov
e8228cb0d2
Merge pull request #49530 from ClickHouse/optimize-query-log 
Optimize the system.query_log and system.query_thread_log tables by applying LowCardinality when appropriate
 2023-05-07 03:36:30 +03:00
Alexey Milovidov
07027be872
Update test_in_memory_parts_still_read.py 2023-05-07 02:09:37 +03:00
Alexey Milovidov
8f1123dfb8
Update test_in_memory_parts_still_read.py 2023-05-06 18:23:54 +03:00
Alexey Milovidov
bffc441b84
Merge pull request #49576 from ClickHouse/remove-test_merge_tree_s3_restore 
Remove `test_merge_tree_s3_restore`
 2023-05-06 18:13:47 +03:00
Alexey Milovidov
fe00e668f1
Merge pull request #49579 from ClickHouse/remove-obsolete-test 
Remove obsolete test about deprecated feature
 2023-05-06 18:11:05 +03:00
Alexey Milovidov
846f2d57af Fix error found by AST Fuzzer 2023-05-06 00:55:56 +02:00
Alexey Milovidov
be2834da58 Remove obsolete test about deprecated feature 2023-05-06 00:02:45 +02:00
Alexey Milovidov
75a2589a42
Merge branch 'master' into deprecate-in-memory-parts 2023-05-06 00:49:59 +03:00
Alexey Milovidov
e4d122323f Add a new test 2023-05-05 23:43:22 +02:00
Alexey Milovidov
290bf0ae58 Remove a test for in-memory parts 2023-05-05 23:29:48 +02:00
Alexey Milovidov
8a548170f8 Remove obsolete test 2023-05-05 23:25:47 +02:00
Alexey Milovidov
9436aef893 Remove test_merge_tree_s3_restore 2023-05-05 22:44:07 +02:00
Alexey Milovidov
79ad150454
Merge pull request #49323 from ClickHouse/low-cardinality-fix-progress 
Fix progress bar for LowCardinality fields with shared dictionaries
 2023-05-05 23:34:27 +03:00
Smita Kulkarni
b0c408faa4 Merge branch 'master' into Follow_up_Backup_Restore_concurrency_check_node_2 2023-05-05 17:51:33 +02:00
Alexander Tokmakov
dd1bbf7c78 fix another issue with dependencies 2023-05-05 16:27:12 +02:00
Nikolay Degterinsky
9934eae315
Merge pull request #48983 from evillique/mongodb-array-type 
Add `Array` data type to MongoDB
 2023-05-05 16:02:07 +02:00
Nikolay Degterinsky
7a727bbbe3
Merge pull request #49520 from IvanTakarlikov-st/it-grammar-fixes 
Fix some grammar mistakes in documentation, code and tests
 2023-05-05 15:45:58 +02:00
Alexander Tokmakov
6cf3e5b77a fix race on loading dictionaries 2023-05-05 15:25:18 +02:00
wangxiaobo
f704c0dfec
Implement SYSTEM DROP REPLICA from auxillary ZooKeeper clusters (#48932) 
* multiple zookeeper drop replica bug fix.

* add an integration test.

* format code.

* set stay_alive=True for test.

* style check bug fix.

* add check for is_active

* format code

* remove table_settings and has_metadata_out param.
 2023-05-05 14:11:11 +03:00
Kseniia Sumarokova
7c203dbcd2
Merge pull request #49481 from snikch/master 
Fix postgres database setting
 2023-05-05 12:53:51 +02:00
Alexey Milovidov
f77d087404 Merge branch 'master' into low-cardinality-fix-progress 2023-05-05 06:43:37 +02:00
Alexey Milovidov
09f171822e Merge branch 'master' into deprecate-in-memory-parts 2023-05-05 06:43:23 +02:00
Alexey Milovidov
6b809a1829 Remove a test 2023-05-05 06:43:21 +02:00
Alexey Milovidov
14f5e785d6 Fix test 2023-05-05 06:42:40 +02:00
Alexey Milovidov
ab1a1ea5b7
Merge pull request #49490 from ClickHouse/fix-s3cluster-with-headers 
Correctly handle s3Cluster arguments
 2023-05-05 05:31:23 +03:00
Ivan Takarlikov
339fb0c2c1
Merge branch 'master' into it-grammar-fixes 2023-05-04 15:57:09 -03:00
Sema Checherinda
93c1209ea5 fix black style 2023-05-04 19:40:41 +02:00
Ivan Takarlikov
8873856ce5 Fix some grammar mistakes in documentation, code and tests 2023-05-04 13:35:18 -03:00
Konstantin Bogdanov
c93a131019
Add an integration test for shutdown_wait_unfinished_queries (#49469) 2023-05-04 17:21:08 +02:00
Dmitry Novik
befcdbcc6d
Merge pull request #47630 from ClickHouse/revert-47476-revert_46622 
Fix user MemoryTracker counter in async inserts
 2023-05-04 16:57:41 +02:00
Alexander Gololobov
f77cc89464
Merge pull request #49470 from ClickHouse/remove_no_delay_flag 
Replace `NO DELAY` with `SYNC` in tests
 2023-05-04 11:57:01 +02:00
alesapin
412b161104
Merge pull request #48791 from kssenii/better-local-object-storage 
Make local object storage work consistently with s3 object storage, fix problem with append, make it configurable as independent storage
 2023-05-04 11:47:43 +02:00
alesapin
89caf40840
Merge pull request #46528 from myrrc/feature/show-secrets-option 
Show secrets in `SHOW` and `SELECT` queries
 2023-05-04 11:21:30 +02:00
Antonio Andelic
8769ac2187 Correctly append arguments 2023-05-04 08:30:45 +00:00
Nikolay Degterinsky
ed9a9ecd57 Fixes 2023-05-04 02:45:25 +00:00
Mal Curtis
5727585d95 s/use_tables_cache/use_table_cache 2023-05-03 23:40:12 +00:00
Alexey Milovidov
261907c143 Merge branch 'master' into deprecate-in-memory-parts 2023-05-04 01:07:38 +02:00
wangxiaobo
2924837c7e
Fix Attaching a table with non-existent ZK path does not increase the ReadonlyReplica metric (#48954) 
* Attaching a table with non-existent ZK path does not increase the ReadonlyReplica metric bug fix.

* add integration test.

* add integration test.

* Update test.py

* format code

* format code
 2023-05-03 22:41:20 +03:00
Alexander Tokmakov
83b12ec5ca replace NO DELAY with SYNC in tests 2023-05-03 20:08:49 +02:00
Dmitry Novik
2a664521c2 Make sure async insert happends 2023-05-03 17:12:21 +00:00
Anton Popov
c9705d6bf1
Merging #49066 (Better error handling during loading of parts) (#49430) 
* catch filesystem error when loading parts

* better exception handling during part loading

---------

Co-authored-by: cangyin <excangyin@gmail.com>
Co-authored-by: Nikita Mikhaylov <mikhaylovnikitka@gmail.com>
 2023-05-03 19:10:06 +02:00
Sema Checherinda
3ba490e4d6 test when merge canceled with s3 2023-05-03 10:39:03 +02:00
Sean Haynes
1d51bc90f0 Add a test to check max_rows_to_read_leaf behaviour 
In ClickHouse v22.3, querying a distributed table through a view
results in a max_rows_to_read_leaf limit reached exception being
raised on the root executor despite the row limit for each leaf node
not being reached.

This is fixed in ClickHouse v23.3, but Adding this integration test
to catch any issues in the future
 2023-05-03 08:47:37 +01:00
Dmitry Novik
93e8ecf4ff Update test 2023-05-03 01:33:26 +02:00
Alexey Milovidov
f449df85b6 Deprecate in-memory parts 2023-05-03 00:31:09 +02:00
Nikita Taranov
f43e916d42 impl 2023-05-02 22:07:30 +00:00
Dmitry Novik
bab112a1bc
Merge branch 'master' into revert-47476-revert_46622 2023-05-02 20:54:25 +02:00
pufit
2964ca5c84 Specify grants for users in users.xml 2023-05-01 20:24:02 -04:00
Sema Checherinda
ff648b7b36 mute the bug, will open new pr with fix 2023-05-01 21:53:05 +02:00
Sema Checherinda
e3647571f2 explicit drop table for tests 2023-05-01 20:45:20 +02:00
Sema Checherinda
02b7c2fe90 clearing s3 between tests in a robust way 2023-05-01 20:45:10 +02:00
Nikolay Degterinsky
65e743735a Merge remote-tracking branch 'upstream/master' into mongodb-array-type 2023-05-01 16:33:01 +00:00
robot-clickhouse
96e4afd89c Automatic style fix 2023-05-01 16:10:08 +00:00
Dmitry Novik
fd5dd103b3 Use non-default user in test 2023-05-01 18:02:08 +02:00
alesapin
5b24a84fc0 Apply black check 2023-05-01 14:02:07 +02:00
alesapin
17effd4f6d Fix black 2023-05-01 14:01:42 +02:00
alesapin
21f58df9f7 Finally fix flaky test 2023-05-01 13:58:10 +02:00
robot-clickhouse
ab97dbcf1e Automatic style fix 2023-04-30 17:27:15 +00:00
alesapin
b22a54d6cc fix 2023-04-30 19:10:12 +02:00
alesapin
6281606fcf More debug info 2023-04-30 19:08:04 +02:00
alesapin
c6f91afad7 Add more debug to test (it's not flaky on my setup) 2023-04-30 19:07:15 +02:00
alesapin
a1e9236b53 Fix tests which depend on detached files count 2023-04-30 19:06:36 +02:00
Kseniia Sumarokova
7d867d7632
Merge pull request #49225 from MikhailBurdukov/mongo_dict_tls 
Connection options for MongoDB dictionaries
 2023-04-29 11:37:45 +02:00
pufit
9d6169df00 Merge remote-tracking branch 'origin/46229-repl-clickhouse-keeper' into 46229-repl-clickhouse-keeper 
# Conflicts:
#	tests/integration/test_keeper_client/test.py
 2023-04-28 14:11:45 -04:00
pufit
30bc74c859 Fix tests 2023-04-28 14:09:24 -04:00
Mike Kot
2d20658885
Merge branch 'master' into feature/show-secrets-option 2023-04-28 20:19:35 +03:00
Mike Kot
f1d0ed367d separate name for format setting 2023-04-28 13:39:38 +00:00
Mike Kot
7bffa89e96 add all 3 settings 2023-04-28 13:22:36 +00:00
kssenii
298ed454ce Merge remote-tracking branch 'upstream/master' into better-local-object-storage 2023-04-28 13:26:55 +02:00
robot-clickhouse
711d8d4442 Automatic style fix 2023-04-28 03:19:21 +00:00
pufit
39ae0c1c4e Fix tests 2023-04-27 22:51:52 -04:00
Mike Kot
b24de29c70 reverting mr changes 2023-04-27 20:37:12 +00:00
Mike Kot
357cde95e9 Merge branch 'master' into feature/show-secrets-option 2023-04-27 20:19:40 +00:00
Alexey Milovidov
96826cfca6
Merge pull request #49161 from ClickHouse/nickitat-patch-11 
Align connect timeout with aws sdk default
 2023-04-27 18:33:47 +03:00
Kseniia Sumarokova
45e2d296f9
Merge branch 'master' into better-local-object-storage 2023-04-27 14:54:04 +02:00
Alexey Milovidov
aac037f51c
Merge pull request #46765 from zk-kiger/improve_cluster_table_funcion_skip_unavailable_shards 
add skip_unavailable_shards setting for table function cluster
 2023-04-27 14:54:18 +03:00
Nikolay Degterinsky
ea55222131
Merge pull request #44674 from evillique/add_default_password_type 
Add default password type
 2023-04-27 13:25:58 +02:00
MikhailBurdukov
b229a28e94
Merge branch 'master' into mongo_dict_tls 2023-04-26 23:39:27 +03:00
MikhailBurdukov
ca68cd85d4 Fix style 2023-04-26 20:10:10 +00:00
MikhailBurdukov
389c0af922 Fix style 2023-04-26 19:36:34 +00:00
MikhailBurdukov
d76430fe90 Added options handling for mongoo dict 2023-04-26 19:19:10 +00:00
Nikita Taranov
3f09e0be4e fix tests 2023-04-26 13:24:42 +00:00
Vitaly Baranov
681442f86c Fix test_encrypted_disk_replication 2023-04-26 15:22:33 +02:00
Alexey Milovidov
23132fbdbc
Merge branch 'master' into improve_cluster_table_funcion_skip_unavailable_shards 2023-04-26 13:54:39 +03:00
Nikolay Degterinsky
a8d124ac0f
Merge branch 'master' into add_default_password_type 2023-04-26 12:53:23 +02:00
Alexey Milovidov
e2bedf170b
Merge pull request #49107 from ClickHouse/Avogar-patch-2 
Fix flaky integration test test_async_query_sending
 2023-04-26 13:48:08 +03:00
Kseniia Sumarokova
b92234ed90
Merge branch 'master' into fix-postgres-setting 2023-04-25 23:55:13 +02:00
Alexey Milovidov
1a42148262
Merge branch 'master' into improve_cluster_table_funcion_skip_unavailable_shards 2023-04-25 00:44:58 +03:00
Nikolay Degterinsky
2fe3a69ba1 Merge remote-tracking branch 'upstream/master' into add_default_password_type 2023-04-24 18:51:32 +00:00
pufit
1985fb785e
Merge pull request #48262 from ClickHouse/42497-inherit-grant 
GRANT CURRENT GRANTS implementation
 2023-04-24 11:11:10 -04:00
Kruglov Pavel
50dd836586
Fix flaky integration test test_async_query_sending 2023-04-24 16:37:54 +02:00
kssenii
277393fd8d Fix 2023-04-24 14:45:41 +02:00
alesapin
516a0c9784
Merge pull request #48862 from ClickHouse/fix-zero-copy-replication-drop-detached-parts 
Fix unexpected part name error when trying to drop a ignored detached part with zero copy replication
 2023-04-24 12:57:25 +02:00
Alexey Milovidov
3ae7bf754b Merge branch 'master' into compress-marks-primary-key-by-default 2023-04-23 22:46:13 +02:00
Alexey Milovidov
67de39c2d9
Merge pull request #48727 from ClickHouse/parallel-processing-from-storages 
Parallelize query processing right after reading FROM ...
 2023-04-23 23:10:32 +03:00
Alexey Milovidov
31000978f4
Merge branch 'master' into improve_cluster_table_funcion_skip_unavailable_shards 2023-04-23 16:18:48 +03:00
kssenii
d8023806a9 Merge remote-tracking branch 'upstream/master' into better-local-object-storage 2023-04-23 12:39:34 +02:00
Nikolay Degterinsky
b599d0bd01 Better 2023-04-21 22:03:56 +00:00
Alexey Milovidov
ded4b17d2c
Merge pull request #48989 from evillique/fix-ssl 
Add fallback to password auth after failed SSL auth
 2023-04-21 21:42:59 +03:00
Dmitry Novik
cbc4ba6737 Add sleep 2023-04-21 16:50:41 +00:00
Dmitry Novik
e23105b322 Merge remote-tracking branch 'origin/master' into revert-47476-revert_46622 2023-04-21 16:40:04 +00:00
Nikolay Degterinsky
fb3c0f05df Add test 2023-04-21 14:22:14 +00:00
alesapin
ac40eab79d Remove outdated test 2023-04-21 15:24:29 +02:00
avogar
c949f0ebf5 Merge branch 'master' of github.com:ClickHouse/ClickHouse into urlCluster 2023-04-21 14:13:33 +02:00
kssenii
e58c16318f Merge remote-tracking branch 'upstream/master' into better-local-object-storage 2023-04-21 12:49:40 +02:00
kssenii
88f412ad23 Fix upgrade check, fix integration test 2023-04-21 12:44:08 +02:00
Kruglov Pavel
9749448eb0
Merge pull request #47229 from Avogar/non-blocking-connect 
Improve async reading from socket
 2023-04-21 10:38:50 +02:00
Alexey Milovidov
98ae9be734
Revert "Added tests for ClickHouse apps help and fixed help issues" 2023-04-21 01:54:34 +03:00
Kruglov Pavel
fb139e9a87
Fix style 2023-04-20 19:58:01 +02:00
avogar
fd8e510819 Add tests 2023-04-20 17:35:34 +00:00
Nikolay Degterinsky
ae100defa2 Add Array data type to MongoDB 2023-04-20 15:51:10 +00:00
Vladimir C
99ac321f5d
Merge pull request #48664 from ClickHouse/vdimir/http_tmp_buffer_fs_cache 2023-04-20 14:15:30 +02:00
Vladimir C
ad516d2349
Merge pull request #48795 from ClickHouse/vdimir/fix-cluster-discovery-47176 2023-04-20 11:56:07 +02:00
Kseniia Sumarokova
5a8efd3261
Update cluster.py 2023-04-19 17:35:57 +02:00
vdimir
33ee94f08f Add CREATE TABLE tbl ON CLUSTER to test_cluster_discovery 2023-04-19 16:44:54 +02:00
vdimir
d6416a1321 Store clusters from ClusterDiscovery in separate map 2023-04-19 16:44:54 +02:00
vdimir
c7bdd24bdb Test wait_end_of_query in test_temporary_data_in_cache 2023-04-19 16:44:21 +02:00
Kseniia Sumarokova
6843874e8a
Merge pull request #48903 from ClickHouse/vdimir/fix_test_storage_delta 
Fix order by in test_storage_delta
 2023-04-19 15:43:57 +02:00
Kruglov Pavel
2ad161d2b7
Merge branch 'master' into non-blocking-connect 2023-04-19 13:39:40 +02:00
Igor Nikonov
2455334009 Merge remote-tracking branch 'origin/master' into parallel-processing-from-storages 2023-04-18 21:42:51 +00:00
Igor Nikonov
b236db82c9
Merge pull request #48863 from ClickHouse/fix_test_store_cleanup_disk_s3 
Fix: do not run test_store_cleanup_disk_s3 in parallel
 2023-04-18 22:44:03 +02:00
Ilya Yatsishin
ebb1b990f2
Merge pull request #45819 from qoega/clickhouse-help 2023-04-18 21:46:36 +02:00
vdimir
e34dcabeca
Fix order by in test_storage_delta 2023-04-18 14:25:21 +00:00
Sema Checherinda
d5fd0c4664
Merge pull request #48843 from ClickHouse/fix-test-concurrent-alter-move-and-drop 
Try fix flacky test_concurrent_alter_move_and_drop
 2023-04-18 16:21:17 +02:00
robot-clickhouse-ci-1
0e4dd315bd
Merge pull request #48856 from hanfei1991/hanfei/suppress-45435 
suppress assert of progress for test_system_replicated_fetches
 2023-04-18 14:15:38 +02:00
robot-clickhouse
c53f2b763f Automatic style fix 2023-04-17 16:17:02 +00:00
Igor Nikonov
1deaf788f4 Fix: do not run test_store_cleanup_disk_s3 in parallel 2023-04-17 16:00:34 +00:00
Michael Lex
51c9ae05fb Fix unexpected part name error when trying to drop a ignored detache partition with zero copy replication 
Before this fix, the integration test failed with this error

E           Code: 233. DB::Exception: Received from 172.22.0.9:9000. DB::Exception: Unexpected part name: ignored_all_0_0_0 for format version: 1. Stack trace:
E
E           0. /home/ubuntu/clickhouse/contrib/llvm-project/libcxx/include/exception:134: std::exception::capture() @ 0x19bc7d02 in /usr/bin/clickhouse
E           1. /home/ubuntu/clickhouse/contrib/llvm-project/libcxx/include/exception:112: std::exception::exception[abi:v15000]() @ 0x19bc7ccd in /usr/bin/clickhouse
E           2. /home/ubuntu/clickhouse/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x3194fae0 in /usr/bin/clickhouse
E           3. /home/ubuntu/clickhouse/src/Common/Exception.cpp:89: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x2268ae6e in /usr/bin/clickhouse
E           4. /home/ubuntu/clickhouse/src/Common/Exception.h:54: DB::Exception::Exception(String&&, int, bool) @ 0x19bbb00a in /usr/bin/clickhouse
E           5. /home/ubuntu/clickhouse/src/Common/Exception.h:81: DB::Exception::Exception<String const&, StrongTypedef<unsigned int, DB::MergeTreeDataFormatVersionTag>&>(int, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<StrongTypedef<unsigned int, DB::MergeTreeDataFormatVersionTag>&>::type>, String const&, StrongTypedef<unsigned int, DB::MergeTreeDataFormatVersionTag>&) @ 0x2c4f318c in /usr/bin/clickhouse
E           6. /home/ubuntu/clickhouse/src/Storages/MergeTree/MergeTreePartInfo.cpp:23: DB::MergeTreePartInfo::fromPartName(String const&, StrongTypedef<unsigned int, DB::MergeTreeDataFormatVersionTag>) @ 0x2c4f0867 in /usr/bin/clickhouse
E           7. /home/ubuntu/clickhouse/src/Storages/StorageReplicatedMergeTree.cpp:8305: DB::(anonymous namespace)::getParentLockedBlobs(std::shared_ptr<DB::ZooKeeperWithFaultInjection> const&, String const&, String const&, StrongTypedef<unsigned int, DB::MergeTreeDataFormatVersionTag>, Poco::Logger*) @ 0x2bca90f7 in /usr/bin/clickhouse
 2023-04-17 15:57:41 +00:00
Dmitry Novik
6f501f983e
Update test.py 2023-04-17 17:47:03 +02:00
Han Fei
ae67375769 suppress test_system_replicated_fetches 2023-04-17 16:58:36 +02:00
serxa
4370abf3c4 Try fix flacky test_concurrent_alter_move_and_drop 2023-04-17 10:33:59 +00:00
Kseniia Sumarokova
8bc0a3a899
Merge pull request #48759 from kssenii/fix-mysql-named-collection 
Fix some settings of mysql dictionary with named collection
 2023-04-17 11:18:04 +02:00
Alexey Milovidov
82fe9d4dbe
Merge pull request #48789 from vitlibar/fix-flaky-test-backup-all 
Fix flaky test test_backup_all
 2023-04-17 06:24:58 +03:00
Kseniia Sumarokova
000a63d61c
Merge pull request #48803 from vitlibar/allow-integration-tests-without-spark 
Allow running integration tests without spark
 2023-04-16 11:54:21 +02:00
Igor Nikonov
cdd9aef6f7 Merge remote-tracking branch 'origin/master' into parallel-processing-from-storages 2023-04-15 12:35:32 +00:00
Kseniia Sumarokova
8a548b7901
Merge branch 'master' into fix-flaky-test_upgrade_while_mutation 2023-04-15 13:19:14 +02:00
Kseniia Sumarokova
9e7d8000a3
Update cluster.py 2023-04-15 13:00:38 +02:00
Vitaly Baranov
80d6b82ac9 Allow starting integration tests without spark. 2023-04-15 11:29:03 +02:00
robot-clickhouse
6c03b2ef0c Automatic style fix 2023-04-14 20:38:11 +00:00
Igor Nikonov
60dbb7b406 Merge remote-tracking branch 'origin/master' into parallel-processing-from-storages 2023-04-14 20:11:51 +00:00
Igor Nikonov
9e92c26d53 Fix test_storage_mysql/test.py::test_settings_connection_wait_timeout 2023-04-14 20:10:57 +00:00
Smita Kulkarni
74c6ca558b Removed line from test_disallow_concurrrency for CI checks 2023-04-14 18:03:46 +02:00
Vitaly Baranov
39705ee205 Fix flaky test test_backup_all[True]. 2023-04-14 18:00:52 +02:00
Dmitry Novik
cf5d9a175a Revert "Merge pull request #48760 from ClickHouse/revert-46089-background-memory-tracker" 
This reverts commit a61ed33223, reversing
changes made to 5f01b8a2b5.
 2023-04-14 16:34:19 +02:00
Igor Nikonov
4dfad9ed9d Try to fix flaky intergration test 
test_storage_mysql/test.py:test_settings_connection_wait_timeout
 2023-04-14 14:33:33 +00:00
Vitaly Baranov
8989f3a243
Merge pull request #48741 from vitlibar/fix-zero-copy-replication-on-encrypted-disks 
Fix zero-copy-replication on encrypted disks.
 2023-04-14 16:18:04 +02:00
Kseniia Sumarokova
fd85f0b108
Update tests/integration/test_version_update_after_mutation/test.py 
Co-authored-by: alesapin <alesapin@clickhouse.com>
 2023-04-14 16:11:37 +02:00
kssenii
5bc9a98aab Fxi 2023-04-14 15:35:39 +02:00
Kseniia Sumarokova
6a0d9a37ce
Merge branch 'master' into fix-mysql-named-collection 2023-04-14 12:03:51 +02:00
Kseniia Sumarokova
54518bf928
Merge branch 'master' into better-tests-for-data-lakes 2023-04-13 23:45:12 +02:00
Igor Nikonov
fa6346008a Merge remote-tracking branch 'origin/master' into parallel-processing-from-storages 2023-04-13 20:55:18 +00:00
robot-clickhouse
39df2bde85 Automatic style fix 2023-04-13 20:52:16 +00:00
Igor Nikonov
eacbd2bf1e Fix test_storage_mysql/test_settings_connection_wait_timeout 2023-04-13 20:26:23 +00:00
Alexander Tokmakov
af1bf08663
Revert "Add MemoryTracker for the background tasks" 2023-04-13 21:05:02 +03:00
kssenii
ad48e1d010 Fox 2023-04-13 19:36:25 +02:00
kssenii
6f53784f22 Merge remote-tracking branch 'upstream/master' into better-tests-for-data-lakes 2023-04-13 15:56:40 +02:00
kssenii
b9811573be Better 2023-04-13 15:10:49 +02:00
Dmitry Novik
467ecf45e1
Merge pull request #46089 from ClickHouse/background-memory-tracker 
Add MemoryTracker for the background tasks
 2023-04-13 13:29:27 +02:00
Vitaly Baranov
6b71cb1c35 Fix zero-copy-replication on encrypted disks. 2023-04-13 13:15:18 +02:00
Sema Checherinda
3ada33db56
Merge pull request #48674 from CheSema/more_logs_47882 
show result of minio listings for test test_attach_detach_partition
 2023-04-13 11:46:19 +02:00
kssenii
37691e573a Fix black check, add with_spark 2023-04-13 11:12:24 +02:00
Kseniia Sumarokova
b6c17759f4
Merge pull request #48636 from kssenii/fix-error-in-cache 
Fix possible error from cache
 2023-04-13 11:03:11 +02:00
Antonio Andelic
1f7cca6439
Merge pull request #48699 from ClickHouse/fix-flaky-keeper-session 
Fix flaky `test_keeper_session`
 2023-04-13 09:44:46 +02:00
pufit
aa0f3bc994 Solve pr issues 2023-04-12 20:28:17 -04:00
Alexander Tokmakov
75f18b1198
Revert "Check simple dictionary key is native unsigned integer" 2023-04-13 01:32:19 +03:00
kssenii
0c8d65b759 Fix java error 2023-04-12 23:12:49 +02:00
Alexey Milovidov
4d74e3da4d
Merge branch 'master' into improve_cluster_table_funcion_skip_unavailable_shards 2023-04-12 22:13:52 +03:00
Alexey Milovidov
9a3030803e
Merge pull request #48596 from azat/ci/second_deadlock_stack 
Add second_deadlock_stack=1 for TSan on CI and fix some lock-order-inversion problems
 2023-04-12 22:11:06 +03:00
alesapin
8067cfcb51
Merge pull request #46946 from ClickHouse/revert-46909-revert-45911-mutations_rename_hang 
Fix several `RENAME COLUMN` bugs
 2023-04-12 19:07:48 +02:00
Kseniia Sumarokova
17bb707752
Merge branch 'master' into fix-error-in-cache 2023-04-12 17:40:15 +02:00
Antonio Andelic
4ed1d6063a
fix 2023-04-12 16:57:25 +02:00
Antonio Andelic
0d6589a126
use sync 2023-04-12 16:56:11 +02:00
Antonio Andelic
c06b757284 Wait for ephemeral node 2023-04-12 12:54:42 +00:00
kssenii
18723b1a44 Better 2023-04-12 14:38:39 +02:00
Anton Popov
1520f3e924
Merge pull request #48335 from lzydmxy/check_sample_dict_key_is_correct 
Check simple dictionary key is native unsigned integer
 2023-04-12 14:27:39 +02:00
MikhailBurdukov
2cd3512a5d
ClickHouse startup error when loading a distributed table that depends on a dictionary (#48419) 
* Test for start failure.

* Handling the dictionary as shard key.

* Added integration test and fixed style

* Revert extra test

* Fix style

* Fix style

* Refactoring

* Fix build

* style fix
 2023-04-12 15:06:02 +03:00
Sema Checherinda
cc17014516 show result of minio listings for test test_attach_detach_partition 2023-04-12 10:09:25 +02:00
SmitaRKulkarni
dd64eaed66
Merge pull request #47985 from Algunenano/zk_retry_timeout 
Do not continue retrying to connect to ZK if the query is killed or over limits
 2023-04-12 08:49:47 +02:00
Yatsishin Ilya
514bb8aff5 Merge remote-tracking branch 'origin' into clickhouse-help 2023-04-12 06:45:22 +00:00
pufit
078b8f5399 Small refactor, additional tests 2023-04-11 19:55:59 -04:00
alesapin
a72ee0b85e Merge remote-tracking branch 'origin/master' into revert-46909-revert-45911-mutations_rename_hang 2023-04-11 20:14:43 +02:00
robot-ch-test-poll1
17aecb797c
Merge pull request #48642 from ClickHouse/Avogar-patch-3 
Fix flaky test test_drop_replica_and_achieve_quorum
 2023-04-11 17:45:53 +02:00
Dmitry Novik
06e6794fc0 Merge remote-tracking branch 'origin/master' into background-memory-tracker 2023-04-11 15:29:35 +00:00
kssenii
e32c98e412 Close spark session 2023-04-11 17:25:32 +02:00
Alexander Tokmakov
d85ede23a3
Merge pull request #48610 from azat/tests/fix-log-level 
Fix flakiness of test_store_cleanup in case of image rebuild
 2023-04-11 17:39:39 +03:00
Anton Popov
5b8db57fe8
Merge branch 'master' into retry-loading-of-parts 2023-04-11 15:51:40 +02:00
Kruglov Pavel
2445375971
Fix flaky test test_drop_replica_and_achieve_quorum 2023-04-11 14:11:24 +02:00
SmitaRKulkarni
e2010c0257
Merge branch 'master' into zk_retry_timeout 2023-04-11 14:05:52 +02:00
Nikolay Degterinsky
7606336fd8 Merge remote-tracking branch 'upstream/master' into add_default_password_type 2023-04-11 11:59:45 +00:00
Kseniia Sumarokova
f4aa62ebc8
Merge branch 'master' into fix-error-in-cache 2023-04-11 13:40:46 +02:00
Yatsishin Ilya
b5b65d2149 Merge remote-tracking branch 'origin' into clickhouse-help 2023-04-11 11:24:48 +00:00
kssenii
6717eab355 Fix 2023-04-11 12:35:59 +02:00
Nikolay Degterinsky
908be1e324 Fix tests 2023-04-10 22:04:10 +00:00
Azat Khuzhin
7cd4009c3d Fix flakiness of test_store_cleanup in case of image rebuild 
The log level will be substituted from "test" to "trace" in case of the
tag is not "latest", the assumption behind this I guess is that it
should not try to use "test" log level for older versions.

But, it could have per-PR image in case of changes in the Dockerfile, so
it is better to check for self.with_installed_binary, since actually any
parameters except this will use new clickhouse binary anyway.

CI: https://s3.amazonaws.com/clickhouse-test-reports/48596/a1272e8536265929255fdf5020836f057859e425/integration_tests__tsan__[1/6].html
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-04-10 20:31:06 +02:00
Kseniia Sumarokova
65259d964b
Merge pull request #48167 from lzydmxy/add_columns_for_system_storage_policies 
Add columns for table `system.storage_policies`
 2023-04-10 18:32:13 +02:00
Azat Khuzhin
a1272e8536 Pass existing TSAN_OPTIONS to integration tests and append new options 
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-04-10 15:17:43 +02:00
Azat Khuzhin
bbee1a36be Add a comment for use_sigaltstack=0 ASan option 
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-04-10 15:06:40 +02:00
Raúl Marín
45ad555c39
Merge branch 'master' into zk_retry_timeout 2023-04-10 10:04:16 +02:00
Nikolay Degterinsky
7957752128 Merge remote-tracking branch 'upstream/master' into add_default_password_type 2023-04-10 02:25:46 +00:00
Alexey Milovidov
db61140607
Merge branch 'master' into improve_cluster_table_funcion_skip_unavailable_shards 2023-04-09 08:03:23 +03:00
lzydmxy
d0a37f8798 fix test test_multiple_disks 2023-04-08 01:44:43 +08:00
lzydmxy
f951ff2968 fix format 2023-04-08 00:38:44 +08:00
lzydmxy
b88fef12de update Failed tests 2023-04-07 23:57:08 +08:00
Antonio Andelic
36eabc57d2 Sync replicas after inserts 2023-04-07 07:49:19 +00:00
kssenii
0f02349473 Fix 2023-04-06 14:14:22 +02:00
pufit
a3c5acb106 Additional tests 2023-04-05 22:52:48 -04:00
Mikhail f. Shiryaev
14d6373bc7
Merge pull request #48393 from ClickHouse/kerberized-kafka-error 
Kerberized kafka error
 2023-04-05 23:56:35 +02:00
Alexey Milovidov
6d9cc3eeed
Merge branch 'master' into vitlibar-fix-test-backup-all 2023-04-06 00:48:06 +03:00
Anton Popov
4fb7e0ec3c add retries to loading of data parts 2023-04-05 21:23:57 +00:00
kssenii
c59d7a4bb3 Fix 2023-04-05 20:32:37 +02:00
kssenii
be13ce76f4 Merge remote-tracking branch 'upstream/master' into better-tests-for-data-lakes 2023-04-05 18:47:08 +02:00
kssenii
e632dc5cdd Try to understand why some tests fail in CI, but locally pass 2023-04-05 16:28:27 +02:00
Antonio Andelic
f7586e38ed Fix flaky test_keeper_snapshots 2023-04-05 08:56:01 +00:00
Antonio Andelic
e428ed5543
Merge pull request #48384 from ClickHouse/less-flaky-keeper-test 
Fix flaky `test_keeper_mntr_data_size`
 2023-04-05 09:59:28 +02:00
robot-clickhouse
3c89d3f49d Automatic style fix 2023-04-05 01:00:27 +00:00
pufit
8441b0a3e1 Fix comments, tests, docs 2023-04-04 20:43:15 -04:00
kssenii
c379eb7c29 Fix style check 2023-04-04 22:59:16 +02:00
kssenii
f44c53b97a Merge remote-tracking branch 'upstream/master' into better-tests-for-data-lakes 2023-04-04 22:41:22 +02:00
kssenii
8c0be0c3be Checkpoints 2023-04-04 22:40:05 +02:00
Vitaly Baranov
d73df94a56
Update test.py 2023-04-04 20:20:46 +02:00
Raúl Marín
0e17b3b147 Merge remote-tracking branch 'blessed/master' into zk_retry_timeout 2023-04-04 18:53:55 +02:00
Nikita Mikhaylov
fa5b2bd4a5
Added Keeper retries for backups operations (#47224) 2023-04-04 18:12:08 +02:00
Mikhail f. Shiryaev
5bcbdc958a
Reduce probability of reusing the same port 2023-04-04 17:18:24 +02:00
Mikhail f. Shiryaev
a42af5e4ac
Simplify get_free_port helper function 2023-04-04 16:56:42 +02:00
Antonio Andelic
a164adc0b4 less flaky test_keeper_mntr_data_size 2023-04-04 12:56:39 +00:00
Antonio Andelic
4efa707fe3
Merge branch 'master' into alternative-keeper-configs 2023-04-04 09:53:19 +02:00
Alexey Milovidov
1ff20e790e Merge branch 'compress-marks-primary-key-by-default' of github.com:ClickHouse/ClickHouse into compress-marks-primary-key-by-default 2023-04-04 01:05:32 +02:00
Alexey Milovidov
01728d6d39 Fix tests 2023-04-04 01:05:06 +02:00
Alexey Milovidov
de8f7a5ad6
Merge pull request #48189 from vitlibar/backup-all 
Support BACKUP ALL command
 2023-04-04 01:57:23 +03:00
kssenii
bbe8c121a1 Fix black 2023-04-03 23:05:25 +02:00
kssenii
75b11bceb5 Fix style check 2023-04-03 21:27:05 +02:00
kssenii
18a9a670c3 Better 2023-04-03 20:56:10 +02:00
kssenii
8915f49b7d Merge remote-tracking branch 'upstream/master' into better-tests-for-data-lakes 2023-04-03 17:43:42 +02:00
Antonio Andelic
f5e97fbb66 Merge branch 'master' into alternative-keeper-configs 2023-04-03 15:06:52 +00:00
kssenii
6e1cf1907d Better 2023-04-03 16:57:49 +02:00
Raúl Marín
8fdf87982c Merge remote-tracking branch 'blessed/master' into zk_retry_timeout 2023-04-03 10:26:18 +02:00
Alexey Milovidov
ef1e282d4c
Merge branch 'master' into compress-marks-primary-key-by-default 2023-04-03 06:28:48 +03:00
Alexey Milovidov
d8e8dc39e8 Fix test 2023-04-03 01:29:55 +02:00
Kseniia Sumarokova
d2522a2dba
Merge pull request #48312 from kssenii/merging-ilejn-dict-named-collection 
Merging #46323
 2023-04-02 18:12:44 +02:00
Vitaly Baranov
225fee16dc Fix test "test_backup_all" and add more test cases. 2023-04-01 19:46:59 +02:00
kssenii
ccb5b25724 One more test 2023-04-01 18:21:49 +02:00
Alexander Tokmakov
48b23dd012
Fix race between DROP MatView and RESTART REPLICAS (#47863) 
* fix race between drop mv and restart replicas

* unrelated: fix bad exception messages

* fix test

* fix

* fix

* fix

* fix

* fix test

* fix

* fix test

* Update 02437_drop_mv_restart_replicas.sh

* fix tests
 2023-04-01 15:26:00 +03:00
kssenii
1721b70070 Merge remote-tracking branch 'upstream/master' into ilejn-dict-named-collection 2023-04-01 13:18:26 +02:00
Alexander Tokmakov
9552b37414
Merge pull request #48267 from ClickHouse/fix_some_tests2 
Fix some tests
 2023-03-31 22:03:00 +03:00
pufit
65f2516079 separate integration tests for keeper-client 2023-03-31 12:41:22 +00:00
robot-clickhouse
e6d01c617b Automatic style fix 2023-03-31 12:41:22 +00:00
pufit
7dc6ff02c3 use keeper-client in integration tests 2023-03-31 12:41:22 +00:00
kssenii
80fbd69222 Black cehck 2023-03-31 13:01:40 +02:00
Alexander Tokmakov
f54fd15112 fix 2023-03-31 12:58:11 +02:00
Alexander Tokmakov
81375431d9 fix some tests 2023-03-31 01:07:08 +02:00
kssenii
f1fe44e43d Better 2023-03-30 23:09:12 +02:00
Alexey Milovidov
e4fa53ae9b
Merge pull request #48170 from ClickHouse/more-stable-keeper-map-test 
Try making KeeperMap test more stable
 2023-03-30 22:57:08 +03:00
kssenii
bb1df7cbb6 Fix test 2023-03-30 18:29:55 +02:00
kssenii
319417062f Merge remote-tracking branch 'upstream/master' into better-tests-for-data-lakes 2023-03-30 18:29:46 +02:00
kssenii
60efa3cae7 Fixes for hudi 2023-03-30 18:25:54 +02:00
Antonio Andelic
80cb121d2a
Merge pull request #48092 from ClickHouse/nosign-keyword-for-s3 
Add support for `NOSIGN` keyword and `no_sign_request` config for S3
 2023-03-30 18:10:56 +02:00
Alexander Tokmakov
131395b00f
Merge pull request #48171 from aalexfvk/add_option_disable_on_cluster_queries 
Add allow_distributed_ddl_queries option to the cluster config
 2023-03-30 17:29:02 +03:00
Antonio Andelic
d6c71533fa Move keeper map tests to stateless 2023-03-30 13:41:13 +00:00
Antonio Andelic
4dadc53961 Merge branch 'master' into more-stable-keeper-map-test 2023-03-30 06:41:48 +00:00
Vitaly Baranov
42c2ccb7cc Support BACKUP ALL command. 2023-03-30 00:11:13 +02:00
kssenii
bb698a6ed4 Fix black check 2023-03-29 23:54:44 +02:00
kssenii
71d02d76f5 Better 2023-03-29 20:01:21 +02:00
Vitaly Baranov
4478c6b60e Make test test_disallow_concurrency less flaky. 2023-03-29 19:55:13 +02:00
Aleksei Filatov
0ac9dcd723 Add allow_distributed_ddl_queries option to the cluster config 2023-03-29 18:15:46 +03:00
Alexey Milovidov
cc345853e7
Merge pull request #47594 from ClickHouse/decimal256-various 
Add specializations for Decimal256 in various places
 2023-03-29 17:33:20 +03:00
Alexander Tokmakov
c5b6ed410d
Merge pull request #48130 from ClickHouse/support_undrop_table 
Merging "Support undrop table"
 2023-03-29 16:49:58 +03:00
Vitaly Baranov
481a7a76ac
Simplify backup coordination for file infos (#48095) 
* Remove obsolete code for archive suffixes.

* Simplify backup coordination, stop using it for restoring.

* Build all file infos before writing to backup. Decrease number of znodes.

* Split long values before writing to ZooKeeper.

* Use separate mutexes for unrelated activities.

* Make test test_disallow_concurrency less flaky.

* Add comments and test for backup_keeper_value_max_size.
 2023-03-29 15:19:40 +02:00
Antonio Andelic
4ea9f96b1b Lower number of processes in KeeperMap test 2023-03-29 12:46:49 +00:00
kssenii
fcc8e4223c Merge remote-tracking branch 'upstream/master' into better-tests-for-data-lakes 2023-03-29 14:13:27 +02:00
Antonio Andelic
44e95aa65f Merge branch 'master' into nosign-keyword-for-s3 2023-03-29 11:10:03 +00:00
Antonio Andelic
7b1ad221b2 Address PR comments 2023-03-29 11:08:44 +00:00
Kseniia Sumarokova
9e8bbe4bfe
Merge pull request #47987 from kssenii/try-fix-rabbitmq-test 
Try fix rabbitmq test
 2023-03-29 12:20:05 +02:00
Alexander Tokmakov
a1076005c7 Merge branch 'master' into support_undrop_table 2023-03-28 22:03:31 +02:00
kssenii
82b642c9c6 Fix style check 2023-03-28 21:57:14 +02:00
kssenii
1573790fe7 Better 2023-03-28 20:51:25 +02:00
Yatsishin Ilya
26aacd3d2d Merge remote-tracking branch 'origin/master' into clickhouse-help 2023-03-28 16:57:58 +00:00
kssenii
13f29a7242 Better 2023-03-28 18:57:24 +02:00
kssenii
04b28bf822 Merge remote-tracking branch 'upstream/master' into better-tests-for-data-lakes 2023-03-28 15:39:24 +02:00
Igor Nikonov
259df04415 Merge remote-tracking branch 'origin/master' into decimal256-various 2023-03-28 13:36:53 +00:00
Kruglov Pavel
292539b90e
Merge pull request #47981 from kssenii/better-delegate-disks-handle-mutual-path 
Fix case when (optional) path is not added to encrypted disk configuration
 2023-03-28 13:52:50 +02:00
kssenii
57226fcb25 Review fixes 2023-03-28 11:43:15 +02:00
Raúl Marín
920bb62ae1 Fix integration tests 2023-03-28 10:46:22 +02:00
robot-clickhouse
6bf48796a9 Automatic style fix 2023-03-28 07:29:36 +00:00
Antonio Andelic
160aa186bb Add support for NOSIGN keyword and no_sign_request config 2023-03-28 07:05:35 +00:00
kssenii
f8b45a00ec Fix 2023-03-27 19:20:48 +02:00
kssenii
314ee12442 Fix checks 2023-03-27 19:20:11 +02:00
Raúl Marín
d2cb4eb9fb Add integration test 2023-03-27 16:40:15 +02:00
xiedeyantu
5a18e0d5a5 support undrop table 2023-03-27 22:16:36 +08:00
Kruglov Pavel
bc92e3184e
Merge branch 'master' into non-blocking-connect 2023-03-27 13:50:50 +02:00
Antonio Andelic
93f5920e02
Merge branch 'master' into alternative-keeper-configs 2023-03-27 10:00:21 +02:00
robot-ch-test-poll3
b18c051943
Merge pull request #47970 from ClickHouse/rs/fix-catboost 
Fix "Field value too long" in catboostEvaluate()
 2023-03-26 04:16:42 +02:00
robot-clickhouse
e46ec88ccb Automatic style fix 2023-03-25 18:26:36 +00:00
Robert Schulze
b46ea5572d
Fix expected results 2023-03-25 18:06:03 +00:00
Kruglov Pavel
713ecb2492
Merge branch 'master' into non-blocking-connect 2023-03-24 22:55:45 +01:00
kssenii
36cc6fee51 Rewrite data lakes (part 1) 2023-03-24 22:35:12 +01:00
Alexander Gololobov
a1e4f70c18
Merge branch 'master' into keeper_batch_bytes_size_limit 2023-03-24 22:08:05 +01:00
kssenii
5a4525742d Drop table after test 2023-03-24 18:53:00 +01:00
kssenii
08054b79a8 Try fix 2023-03-24 18:45:27 +01:00
Maksim Kita
5cb2d30563
Merge pull request #47316 from ClickHouse/vdimir/transform_external_query_analyzer 
Support transformQueryForExternalDatabase for analyzer
 2023-03-24 17:53:00 +01:00
kssenii
16ebfcc3f8 Better delegate disks handle mutual path 2023-03-24 16:21:19 +01:00
Kruglov Pavel
f3f93dd06c
Merge branch 'master' into non-blocking-connect 2023-03-24 15:59:40 +01:00
SmitaRKulkarni
17cff78393
Removed SYSTEM SYNC from test test_concurrent_backups_on_same_node. (#47944) 2023-03-24 14:56:48 +01:00
Alexander Gololobov
afe3af230f Limit keeper request batching by size in bytes 2023-03-24 14:41:09 +01:00
Mikhail f. Shiryaev
290ee6bbf1
Merge pull request #47790 from CurtizJ/apply-black-to-all-files 
Apply black formatter to all python scripts
 2023-03-24 14:20:50 +03:00
Robert Schulze
3628d11405
Fix "Field value too long" in catboostEvaluate() 
Fixes #47616
 2023-03-24 11:02:55 +00:00
Mikhail f. Shiryaev
4f2c336cfc
Update black version, run it for the repository 2023-03-24 11:54:38 +01:00
Antonio Andelic
52541e5e23
Merge pull request #47885 from ClickHouse/more-s3-events 
Add more S3 write profile events
 2023-03-24 09:48:34 +01:00
Alexander Tokmakov
4c9b63ccc0
Merge pull request #47916 from ClickHouse/fix_logical_error_in_distributed 
Fix logical error in DistributedSink
 2023-03-24 04:43:45 +03:00
Alexander Tokmakov
cd7d1fb990
Revert "Revert "Revert "Backup_Restore_concurrency_check_node""" 2023-03-24 04:35:50 +03:00
Kruglov Pavel
3ee12e21fb
Merge branch 'master' into non-blocking-connect 2023-03-23 20:53:44 +01:00
Antonio Andelic
3ae09c6ce8
Merge branch 'master' into more-s3-events 2023-03-23 18:23:53 +01:00
Anton Popov
0ee8dfad53 apply black formatter 2023-03-23 15:33:23 +00:00
Antonio Andelic
d6cbc5d05b Fix tests 2023-03-23 15:01:51 +00:00
Vitaly Baranov
f49cab91c0
Merge pull request #47002 from ilejn/orphaned_role 
Tests for orphaned role fix
 2023-03-23 14:09:34 +01:00
Vitaly Baranov
1d9bfca68d
Merge pull request #47919 from vitlibar/improve-replicated-used-defined-functions 
Improve replicated user defined functions
 2023-03-23 14:07:08 +01:00
Alexander Tokmakov
eeb5a4c241 fix an unrelated flaky test 2023-03-23 13:48:02 +01:00
Antonio Andelic
9ea8dc4e98 Merge branch 'master' into alternative-keeper-configs 2023-03-23 09:22:46 +00:00
Antonio Andelic
b57e82ded6 Add S3 write profile events 2023-03-23 09:05:41 +00:00
SmitaRKulkarni
04822a63e1
Merge pull request #47586 from ClickHouse/revert-47581-revert-47216-Backup_Restore_concurrency_check_node 
Revert "Revert "Backup_Restore_concurrency_check_node""
 2023-03-23 10:02:00 +01:00
Vitaly Baranov
14cae25bd3 Allow start without ZooKeeper. 2023-03-23 02:47:50 +01:00
Alexander Tokmakov
a6a2a3fba1
Merge pull request #47871 from ClickHouse/non_parallel_test_server_reload 
Make test_server_reload non-parallel
 2023-03-22 18:27:34 +03:00
Yatsishin Ilya
5786aba5eb Merge remote-tracking branch 'origin/master' into clickhouse-help 2023-03-22 14:08:22 +00:00
Antonio Andelic
65b99ec6a7 Merge branch 'master' into alternative-keeper-configs 2023-03-22 12:22:57 +00:00
vdimir
6919db3d46 Fix test_mysql_protocol 2023-03-22 08:59:04 +01:00
vdimir
c2f0583dc6 Adjust test_mysql_protocol and others for analyzer 2023-03-22 08:59:04 +01:00
Alexander Tokmakov
0a7e7637aa make test_server_reload non-parallel 2023-03-22 00:50:47 +01:00
kssenii
716bbe1a97 Fix style check, black check 2023-03-21 22:19:05 +01:00
Vitaly Baranov
a70b627897
Merge pull request #47851 from vitlibar/fix-test_replicated_merge_tree_encryption_codec 
Fix test test_replicated_merge_tree_encryption_codec
 2023-03-21 21:25:50 +01:00
kssenii
19819f12f3 Better 2023-03-21 20:19:30 +01:00
robot-clickhouse
2d2183f54f Automatic style fix 2023-03-21 18:54:56 +00:00
Smita Kulkarni
9c822c70c5 Updated retry_count and sleep_time for checking BACKUP_CREATED query as it might take longer to create backup due to increase in data size 2023-03-21 19:34:19 +01:00
kssenii
d9053b8a7c Fix 2023-03-21 17:42:50 +01:00
kssenii
6486c4421e Fix hudi test 2023-03-21 17:20:26 +01:00
Vitaly Baranov
840e825282 Fix test test_replicated_merge_tree_encryption_codec. 2023-03-21 14:29:00 +01:00
kssenii
eceb54b001 Hudi tests 2023-03-21 12:51:14 +01:00
Kseniia Sumarokova
3c550b4314
Merge pull request #46647 from kssenii/named-collections-finish 
Named collections: finish replacing old code for storages
 2023-03-21 12:36:46 +01:00
Ilya Golshtein
5091b4e224 orphaned role - expiration_time => expiration_time_seconds 2023-03-21 08:44:08 +01:00
Ilya Golshtein
c3ce0aa3ba orphaned role - cache expiration time and timeout in tests decreased 2023-03-20 23:21:25 +01:00
Ilya Golshtein
4166b3bb09 orphaned role - xml indentation fix 2023-03-20 23:21:25 +01:00
Ilya Golshtein
c9691b943d orphaned role - make stylecheck happy 2023-03-20 23:21:25 +01:00
Ilya Golshtein
e1d1ead941 orphaned role - tests only 2023-03-20 23:21:25 +01:00
kssenii
34b247900f Better test 2023-03-20 16:53:54 +01:00
kssenii
75624c52f7 Merge remote-tracking branch 'upstream/master' into named-collections-granular-access 2023-03-20 16:38:14 +01:00
Vitaly Baranov
198409e12a
Merge pull request #46085 from aalexfvk/alexfvk/store_udf_in_zookeeper 
Replication of user-defined SQL functions using ZooKeeper
 2023-03-20 13:41:29 +01:00
Kruglov Pavel
1d12e85d55
Merge branch 'master' into non-blocking-connect 2023-03-20 13:23:55 +01:00
kssenii
cae3b335d6 Merge remote-tracking branch 'upstream/master' into named-collections-finish 2023-03-20 11:23:22 +01:00
robot-clickhouse
826dd397b1 Automatic style fix 2023-03-20 09:58:42 +00:00
Smita Kulkarni
722404ca64 Disallow concurrency for backup restore test, added another insert block to data and setting mutations_sync 2023-03-20 10:34:55 +01:00
Alexey Milovidov
698fcba525
Merge branch 'master' into fix-mysql-leak 2023-03-20 07:37:01 +03:00
Alexey Milovidov
4a44dafdee Merge branch 'master' into decimal256-various 2023-03-20 03:30:14 +01:00
kssenii
ea375ef989 Fix memory leak 2023-03-20 00:40:06 +01:00
Alexander Tokmakov
f1df91cd09
Merge pull request #47659 from ClickHouse/fix_993 
Fixes for 993 and friends
 2023-03-18 14:46:43 +03:00
Antonio Andelic
593ac89cb9
Merge pull request #47687 from ClickHouse/fix-mntr-data-size-test 
Try making `test_keeper_mntr_data_size` less flaky
 2023-03-18 10:09:25 +01:00
Alexey Milovidov
26d17fe560 Merge branch 'master' of github.com:ClickHouse/ClickHouse into decimal256-various 2023-03-17 22:15:16 +01:00
Nikolay Degterinsky
7fb171f84d
Merge pull request #47596 from evillique/native-client-ssl 
Add SSL User Certificate authentication to the native protocol
 2023-03-17 21:27:58 +01:00
kssenii
f776f4ff46 Merge remote-tracking branch 'upstream/master' into better-tests-for-data-lakes 2023-03-17 19:45:28 +01:00
kssenii
e48d8d12e7 Fixes for hudi 2023-03-17 19:44:30 +01:00
Alexander Tokmakov
d11aee2b0c
Merge branch 'master' into fix_993 2023-03-17 21:28:23 +03:00
Antonio Andelic
86a409e7a9 Assert znode count 2023-03-17 16:07:12 +00:00
Alexander Tokmakov
dfd8b2670a fix tests, update docs 2023-03-17 14:15:03 +01:00
robot-clickhouse
2198ea2d89 Automatic style fix 2023-03-17 12:19:16 +00:00
kssenii
bb0beb7449 Merge remote-tracking branch 'upstream/master' into named-collections-finish 2023-03-17 13:02:36 +01:00
alesapin
e44fca8bb9 Add test 2023-03-17 12:56:31 +01:00
Aleksei Filatov
886b530963 [rev: 1] Fix review remarks 2023-03-17 13:56:05 +03:00
Aleksei Filatov
cf6ca10c83 Tests for replicated system.functions 2023-03-17 13:56:05 +03:00
Aleksei Filatov
1321f87eee Tests for replication UDF to ZooKeeper 2023-03-17 13:56:04 +03:00
alesapin
efa0622a84
Merge pull request #47631 from ClickHouse/fix_wait_for_zero_copy_lock 
Fix wait for zero copy lock during move
 2023-03-17 11:15:55 +01:00
Alexander Tokmakov
8b8215f91a fix some other tests, add logs for further debugging 2023-03-16 16:40:08 +01:00
pufit
f4d9b4a888
Merge pull request #47086 from pkit/pkit/insert_http_body 
use http request body in predefined http handlers
 2023-03-15 17:41:05 -04:00
alesapin
586b8a4733 Add test 2023-03-15 22:38:42 +01:00
Dmitry Novik
be40218a9a
Revert "Revert #46622 (test_async_insert_memory)" 2023-03-15 22:14:54 +01:00
Alexander Tokmakov
6a653060ff
Merge pull request #47213 from azat/interserver-mode-v2 
Reimplement interserver mode to avoid replay attacks
 2023-03-15 16:26:50 +03:00
avogar
b603ce63f1 Fix more tests 2023-03-15 12:18:33 +00:00
Vitaly Baranov
00c05f7f8b
Merge pull request #47546 from vitlibar/use-server-side-copy-for-restore 
Use server-side copy for restore from S3 to S3.
 2023-03-15 11:28:29 +01:00
Robert Schulze
145eed9455
Merge pull request #46485 from ClibMouse/KRB_CVE_Fix 
Update krb5 to 1.20.1-final to mitigate CVE-2022-42898
 2023-03-15 11:00:06 +01:00
Azat Khuzhin
bcf381c5ae Reimplement interserver mode to avoid replay attacks 
Prevous implementation (DBMS_MIN_REVISION_WITH_INTERSERVER_SECRET)
accepts the salt from the client, which make it useless.

Reimplement the protocol to send the salt by the server and use it in
the client instead.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-03-15 08:28:43 +01:00
Alexey Milovidov
f859b3258a Add support for Decimal256 in MySQL tables 2023-03-15 04:45:26 +01:00
Vitaly Baranov
25356786ea Simplify the implementation, create new utility function copyS3FileToDisk(). 2023-03-14 23:34:44 +01:00
Nikolay Degterinsky
eddda2eb73 Add SSL authentication to the native protocol 2023-03-14 22:10:08 +00:00
Smita Kulkarni
8cd36d2a36 Removed generated file cluster_for_concurrency_test.xml 2023-03-14 20:30:44 +01:00
Smita Kulkarni
e863e49a49 Renamed cluster configuration xml to cluster_for_disallow_concurrency_test.xml for disallow_concurreny of backup and restore test 2023-03-14 20:26:19 +01:00
SmitaRKulkarni
8db4964ebc
Revert "Revert "Backup_Restore_concurrency_check_node"" 2023-03-14 20:23:43 +01:00
Yatsishin Ilya
45c5275bfb Merge remote-tracking branch 'origin/master' into clickhouse-help 2023-03-14 17:27:25 +00:00
Alexander Tokmakov
773cd5a686
Revert "Backup_Restore_concurrency_check_node" 2023-03-14 18:55:08 +03:00
Vitaly Baranov
859082c4b7
Merge pull request #47216 from ClickHouse/Backup_Restore_concurrency_check_node 
Backup_Restore_concurrency_check_node
 2023-03-14 13:36:43 +01:00
Alexander Tokmakov
5a1ee881f8
Merge pull request #47547 from ClickHouse/filter_too_frequent_logs 
Hide too noisy log messages, fix some tests
 2023-03-14 13:53:21 +03:00
Alexander Tokmakov
ba6c6255a3 hide too noisy log messages, fix some tests 2023-03-14 00:23:36 +01:00
Vitaly Baranov
1cf1ce07fe Use server-side copy during restore from S3 to S3. 2023-03-13 23:50:13 +01:00
Alexey Milovidov
a411ae10b5
Merge pull request #47486 from ClickHouse/revert_25674 
Remove "asynchronous connection drain"
 2023-03-13 21:40:39 +03:00
Alexander Tokmakov
ee6c18cbc6
Better error after failed Ordinary-to-Atomic conversion (#47487) 
* better error on failed Ordinary-to-Atomic conversion

* fix test

* Update loadMetadata.cpp
 2023-03-13 19:13:49 +03:00
MeenaRenganathan22
dc1e125b31 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into KRB_CVE_Fix 2023-03-13 06:54:47 -07:00
alesapin
8db0d26519
Merge branch 'master' into revert-46909-revert-45911-mutations_rename_hang 2023-03-13 14:48:20 +01:00
Smita Kulkarni
f76b97cb51 Set num of nodes to 4 for backup restore disallow concurrency test 2023-03-13 10:42:43 +01:00
SmitaRKulkarni
9a35a434f8
Merge branch 'master' into Backup_Restore_concurrency_check_node 2023-03-13 10:04:32 +01:00
Alexander Tokmakov
7b1b238d0b Revert "Merge pull request #25674 from amosbird/distributedreturnconnection" 
This reverts commit 5ffd99dfd4, reversing
changes made to 2796aa333f.
 2023-03-11 19:09:47 +01:00
Alexander Tokmakov
0359b3e336 Revert "Merge pull request #46622 from ClickHouse/async-insert-memory-fix" 
This reverts commit 67469ad46b, reversing
changes made to 678e4250cd.
 2023-03-11 17:01:10 +01:00
Dmitry Novik
4f24a7bd11 Merge remote-tracking branch 'origin/master' into background-memory-tracker 2023-03-10 18:57:45 +00:00
MeenaRenganathan22
f4f7336fd0 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into KRB_CVE_Fix 2023-03-10 09:08:02 -08:00
alesapin
588cc0f159
Merge branch 'master' into revert-46909-revert-45911-mutations_rename_hang 2023-03-09 14:54:10 +01:00
kssenii
0240ad4c68 Add spark to tests, rewrite tests, fix bug 2023-03-08 15:45:35 +01:00
MeenaRenganathan22
ed5b19f5f8 Fixed the integration test failures related with HDFS and KAFKA 2023-03-08 06:11:17 -08:00
Yatsishin Ilya
6cde37093a Merge remote-tracking branch 'origin/master' into clickhouse-help 2023-03-08 13:34:18 +00:00
alesapin
4423be8332
Merge branch 'master' into revert-46909-revert-45911-mutations_rename_hang 2023-03-08 12:59:07 +01:00
Antonio Andelic
816a9c1099
Merge branch 'master' into custom-key-parallel-replicas 2023-03-08 11:06:30 +01:00
Igor Nikonov
cc5b97b624
Merge pull request #46997 from AndyBys/log-level-change 
Change level log in executeQuery
 2023-03-08 10:36:21 +01:00
Alexey Milovidov
e2aff59a2d
Merge pull request #47106 from kssenii/allow-nested-disks-in-custom-disks 
Allow nested custom disks
 2023-03-08 03:00:55 +03:00
Alexander Tokmakov
ffd55d951d
Merge branch 'master' into followup_46681 2023-03-07 23:38:06 +03:00
Robert Schulze
5b91631722
Merge pull request #47138 from AVMusorin/disallow-default-columns-kafka-engine 
Prohibit DEFAULT/EPHEMERAL/ALIAS/MATERIALIZED columns in KafkaEngine
 2023-03-07 20:36:46 +01:00
Alexander Tokmakov
7ce20f5cd2 fix tests 2023-03-07 14:25:28 +01:00
Antonio Andelic
35c15e6ef8 Merge branch 'master' into custom-key-parallel-replicas 2023-03-07 09:37:38 +00:00
Alexey Milovidov
7d48eae0f6
Merge pull request #47256 from ClickHouse/keeper-4lw-clean-resources 
Add Keeper 4LW for cleaning resources
 2023-03-07 04:23:15 +03:00
Igor Nikonov
838ff88abe
Merge branch 'master' into log-level-change 2023-03-06 18:00:49 +01:00
Antonio Andelic
9e3794f7d7 Skip for sanitizer builds 2023-03-06 14:36:53 +00:00
Mike Kot
1fca58b694
Merge branch 'master' into feature/show-secrets-option 2023-03-06 15:46:54 +03:00
Mike Kot
00dfb27eb9 rm secrets test from fasttest, correct 02117 2023-03-06 15:45:48 +03:00
kssenii
cb3dd3c200 Fix flaky test 2023-03-06 13:06:31 +01:00
Han Fei
b7eef62458
Merge pull request #45491 from azat/dist/async-send-refactoring 
[RFC] Rewrite distributed sends to avoid using filesystem as a queue, use in-memory queue instead
 2023-03-06 12:32:33 +01:00
Antonio Andelic
3a184880c6 Add test for clrs 2023-03-05 17:18:53 +00:00
kssenii
b8d33f4d38 Fix test 2023-03-05 13:46:23 +01:00
kssenii
d9e75e5c0a Fix test 2023-03-05 13:13:32 +01:00
kssenii
8f2d75cef8 Fix tests 2023-03-05 12:56:00 +01:00
Alexey Milovidov
41c79b0c42
Merge pull request #46086 from ClickHouse/fix-data-size 
Fix data size calculation in Keeper
 2023-03-05 14:11:36 +03:00
Sema Checherinda
85178c9609
Merge pull request #47102 from CheSema/merge-mutate-do-thread-group 
do flushUntrackedMemory when context switches
 2023-03-03 20:23:25 +01:00
robot-clickhouse
cebe323bef Automatic style fix 2023-03-03 15:56:11 +00:00
Smita Kulkarni
d2dbd5f293 Updated to use tryGet instead of get for checking stage of backups/restores in concurrency check and updated tests by increasing data size to have a longer backup/restore to ensure the overlap and increased timeout correspondingly. 2023-03-03 16:48:14 +01:00
AVMusorin
0f2ae72141
prohibit DEFAULT/EPHEMERAL/ALIAS in KafkaEngine 2023-03-03 16:25:42 +01:00
robot-clickhouse
46667d43d8 Automatic style fix 2023-03-03 15:25:25 +00:00
Antonio Andelic
737cf8e149 Better 2023-03-03 15:14:49 +00:00
Antonio Andelic
cd4100cb19
Merge branch 'master' into fix-data-size 2023-03-03 15:33:43 +01:00
Alexander Tokmakov
5be681c5f6
Merge pull request #47152 from ClickHouse/fix_flaky_test_replicated_database 
Use unique names and paths in `test_replicated_database`
 2023-03-03 17:15:27 +03:00
Alexander Tokmakov
cadaf06829
Merge pull request #46681 from ClickHouse/fix_insert_cancellation_in_native_protocol 
Fix queries cancellation when a client dies
 2023-03-03 16:27:20 +03:00
kssenii
0fa3fb3592 Fix show grants for user which has all grants 2023-03-03 14:04:32 +01:00
Konstantin Bogdanov
1bbf5acd47
Pass headers from StorageURL to WriteBufferFromHTTP (#46996) 
* Pass headers from StorageURL to WriteBufferFromHTTP

* Add a test

* Lint

* `time.sleep(1)`

* Start echo server earlier

* Add proper handling for mock server start

* Automatic style fix

---------

Co-authored-by: robot-clickhouse <robot-clickhouse@users.noreply.github.com>
 2023-03-03 13:55:52 +01:00
Sema Checherinda
bc8b34f74b adjust test test_seekable_formats 2023-03-03 13:16:46 +01:00
Kseniia Sumarokova
386663953c
Merge branch 'master' into named-collections-finish 2023-03-03 12:23:38 +01:00
Antonio Andelic
a6da64aac0
Merge pull request #46824 from ClickHouse/fix-single-thread-parquet 
Use initial range for fetching file size in HTTP read buffer
 2023-03-03 09:23:22 +01:00
kssenii
cd7cd0526b Fix tests 2023-03-02 21:21:04 +01:00
kssenii
0c4bb3c80f Merge remote-tracking branch 'upstream/master' into named-collections-granular-access 2023-03-02 19:08:29 +01:00
robot-clickhouse
fdcbec4fee Automatic style fix 2023-03-02 17:35:56 +00:00
Alexander Tokmakov
c518f3690e Merge branch 'master' into fix_insert_cancellation_in_native_protocol 2023-03-02 18:24:08 +01:00
Alexander Tokmakov
fc8ea01c2b use unique names and paths in test_replicated_database 2023-03-02 18:23:31 +01:00
Yatsishin Ilya
d4304d2028 Merge remote-tracking branch 'origin/master' into clickhouse-help 2023-03-02 16:16:18 +00:00
AndyB
cf245538b9 checker fix 2023-03-02 14:31:38 +00:00
Antonio Andelic
01cf9c94f4 Merge branch 'master' into custom-key-parallel-replicas 2023-03-02 14:28:42 +00:00
Antonio Andelic
5328a0777b Merge branch 'master' into fix-single-thread-parquet 2023-03-02 13:45:27 +00:00
kssenii
2883861795 Merge remote-tracking branch 'upstream/master' into allow-nested-disks-in-custom-disks 2023-03-02 14:30:58 +01:00
alesapin
915b4ea56a
Merge branch 'master' into revert-46909-revert-45911-mutations_rename_hang 2023-03-02 14:29:21 +01:00
Constantine Peresypkin
c4ae17e495
fix black 2023-03-02 14:23:22 +01:00
Kseniia Sumarokova
e95c4b6379
Merge pull request #47011 from kssenii/fix-azure-test 
Fix flaky azure test
 2023-03-02 13:59:43 +01:00
Constantine Peresypkin
fdc6de2a27 use http request body in predefined http handlers 
adds a new "virtual" parameter `__request_body`
which can be used in http rules, see below

tremendously helps in producing arbitrary REST interfaces

for example:

```xml
<http_handlers>
  <rule>
    <methods>POST</methods>
    <url>/ingest</url>
    <handler>
      <type>predefined_query_handler</type>
      <query>INSERT INTO events(id, data) SELECT {id:UInt32}, {__request_body:String}</query>
    </handler>
  </rule>
</http_handlers>
```
 2023-03-02 12:51:48 +01:00
alesapin
189836307c Merge branch 'revert-46909-revert-45911-mutations_rename_hang' of github.com:ClickHouse/ClickHouse into revert-46909-revert-45911-mutations_rename_hang 2023-03-02 12:49:06 +01:00
Kruglov Pavel
ce8e49a9a0
Merge pull request #45693 from Avogar/fix-kafka-protobuf 
Fix formats parser resetting, test processing bad messages in kafka
 2023-03-02 11:50:45 +01:00
AndyB
657afa849e logger level in test 2023-03-01 23:35:09 +00:00
robot-clickhouse
54336f7c98 Automatic style fix 2023-03-01 20:12:00 +00:00
alesapin
46f25d53b3 Merge branch 'master' into revert-46909-revert-45911-mutations_rename_hang 2023-03-01 20:09:12 +01:00
kssenii
f3e3b916c9 Allow nested custom disks 2023-03-01 19:55:59 +01:00
Alexander Gololobov
f64d08bd5c Enable lightweight delete support by default 2023-03-01 19:35:55 +01:00
alesapin
ebba37b18f
Merge pull request #47010 from ClickHouse/zero_copy_fetch 
Fix bug in zero-copy replication disk choice during fetch
 2023-03-01 15:55:00 +01:00
Alexander Tokmakov
a97e15e36f Merge branch 'master' into fix_insert_cancellation_in_native_protocol 2023-03-01 14:26:41 +01:00
Kseniia Sumarokova
b9bb7bcce3
Update test.py 2023-03-01 13:14:53 +01:00
Kseniia Sumarokova
adf2d56a2d
Update test.py 2023-03-01 12:35:01 +01:00
AVMusorin
99329d8682 Improve tests for Distributed INSERT 
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-02-28 23:17:37 +01:00
Antonio Andelic
6e28406751 Merge branch 'master' into fix-data-size 2023-02-28 20:09:29 +00:00
pufit
29296cb004
Merge pull request #46550 from ClickHouse/46231-systerm-server-settings 
Implement `system.server_settings`
 2023-02-28 11:23:15 -05:00
robot-clickhouse
38d026ca6e Automatic style fix 2023-02-28 14:29:24 +00:00
Antonio Andelic
919122948f More fixes and add tests 2023-02-28 14:22:44 +00:00
robot-clickhouse
82be8eb468 Automatic style fix 2023-02-28 13:56:14 +00:00
kssenii
ef58249115 Fix 2023-02-28 14:52:11 +01:00
alesapin
bb7571427b Fix bug in zero-copy replica disk choice during fetch 2023-02-28 14:48:46 +01:00
kssenii
de81a5f92d Fix integration tests 2023-02-28 13:36:52 +01:00
robot-clickhouse
979c62af4f Automatic style fix 2023-02-28 11:24:39 +00:00
alesapin
967a47d870 Fix bug with readonly storages 2023-02-28 12:17:43 +01:00
kssenii
f43e00c3ca Add order by to test to fix flakyness 2023-02-28 11:32:33 +01:00
kssenii
69cdf401a4 Add test for materialized view with materialized postgresql 2023-02-27 22:29:16 +01:00
Mike Kot
c799bd094b
Merge branch 'master' into feature/show-secrets-option 2023-02-27 18:43:14 +03:00
kssenii
03c9eeb106 Fix tests 2023-02-27 14:29:20 +01:00
Mike Kot
62acc7a6cf setting and some docs 2023-02-27 13:18:21 +00:00
avogar
0ef83b10ce Fix style 2023-02-27 13:01:07 +00:00
alesapin
e3961c118a
Revert "Revert "Fix several RENAME COLUMN bugs."" 2023-02-27 12:27:57 +01:00
zk_kiger
4f05eeeff9
Merge branch 'master' into improve_cluster_table_funcion_skip_unavailable_shards 2023-02-27 17:15:02 +08:00
robot-clickhouse
5f7220e498 Automatic style fix 2023-02-26 18:15:55 +00:00
Smita Kulkarni
4c5d39725c Updated node to check BACKUP_CREATED to node1 in test_concurrent_backups_on_different_nodes 2023-02-26 19:08:26 +01:00
Smita Kulkarni
10c92b6cb0 Increased ddl timeout during DROP of table and updated node for concurrent backups on different node 2023-02-26 19:06:31 +01:00
Alexey Milovidov
9ac48dddb8
Merge pull request #46888 from vitlibar/fix-test_async_backups_to_same_destination 
Fix test test_async_backups_to_same_destination.
 2023-02-26 11:36:18 +03:00
Robert Schulze
5e68d50b39
Merge pull request #46752 from ClickHouse/rs/periods-in-kafka-topics 
Allow configuration of Kafka topics with periods
 2023-02-26 07:49:28 +01:00
Alexey Milovidov
8f40bbd5b4
Revert "Fix several RENAME COLUMN bugs." 2023-02-26 05:47:05 +03:00
Alexey Milovidov
0e01991eb7
Update test.py 2023-02-26 04:33:56 +03:00
Alexey Milovidov
936f57e7b2
Merge pull request #46887 from ClickHouse/fix-flaky-test-12 
Fix flaky `test_concurrent_queries_restriction_by_query_kind`
 2023-02-26 04:30:51 +03:00
Alexey Milovidov
eb89ab471f
Merge pull request #45911 from ClickHouse/mutations_rename_hang 
Fix several `RENAME COLUMN` bugs.
 2023-02-26 01:56:40 +03:00
Alexey Milovidov
656af55831
Merge pull request #46384 from ClickHouse/fixes_for_993 
Fixes for 993
 2023-02-26 01:55:20 +03:00
Vitaly Baranov
2d38c89e2a Fix test test_async_backups_to_same_destination. 2023-02-25 23:38:40 +01:00
Alexey Milovidov
c58468ce8d
Merge branch 'master' into fix-attach-table-function-name-normalizer 2023-02-26 01:30:34 +03:00
Alexey Milovidov
63982a2093
Delete config.xml 2023-02-26 01:29:29 +03:00
Alexey Milovidov
5781eb67cb
Update test.py 2023-02-26 01:28:13 +03:00
Alexey Milovidov
88704c4d9f Fix flaky test_concurrent_queries_restriction_by_query_kind 2023-02-25 22:23:29 +01:00
Robert Schulze
fbba9e319d
Merge branch 'master' into rs/periods-in-kafka-topics 2023-02-25 21:45:20 +01:00
SmitaRKulkarni
4109fbd7cf
Merge pull request #46517 from azat/tests/fix-backup-restore-flakiness 
Fix flakiness of test_backup_restore_on_cluster/test_disallow_concurrency
 2023-02-25 19:54:21 +01:00
Alexander Tokmakov
cad1e0b768 fix 2023-02-25 01:18:34 +01:00
kssenii
6224ca9cd6 Fix 2023-02-24 17:08:05 +01:00
kssenii
357ffcb61f More review fixes 2023-02-24 16:53:16 +01:00
kssenii
8b40723fed Better fix 2023-02-24 16:19:36 +01:00
kssenii
f2a9109fe1 Merge remote-tracking branch 'upstream/master' into named-collections-granular-access 2023-02-24 15:20:46 +01:00
kssenii
0555ca2724 Review fixes 2023-02-24 14:44:47 +01:00
Yatsishin Ilya
76e7e15f67 black and tty 2023-02-24 13:36:43 +00:00
avogar
c6a30d23aa Add separate test 2023-02-24 12:31:09 +00:00
Kruglov Pavel
2150b836b1
Merge branch 'master' into fix-kafka-protobuf 2023-02-24 12:48:07 +01:00
Robert Schulze
6906cafa99
Change to S3 cfg syntax 2023-02-23 20:04:41 +00:00
Alexander Tokmakov
f76c42348b
Merge pull request #46402 from lzydmxy/apply_move_partition_to_all_replicas 
Apply `ALTER TABLE ON CLUSTER MOVE PARTITION TO DISK|VOLUME` to all replicas.
 2023-02-23 19:42:54 +03:00
Kruglov Pavel
bda1ce7367
Update test.py 2023-02-23 14:47:29 +01:00
Kseniia Sumarokova
7e064ccbd4
Merge pull request #46667 from kssenii/hide-named-collections-under-setting 
Allow to hide only values from system.named_collections while making collection visible
 2023-02-23 11:44:50 +01:00
Kseniia Sumarokova
30a8eb0c2f
Merge pull request #46670 from kssenii/hide-disk-setting 
Hide arguments of custom disk merge tree setting
 2023-02-23 11:42:53 +01:00
kigerzhang
af5a8ce74c style check 2023-02-23 17:18:56 +08:00
kigerzhang
f74f3718a0 add skip_unavailable_shards setting for table function cluste 2023-02-23 17:05:51 +08:00
Alexey Milovidov
0db943e596
Merge pull request #46687 from ClickHouse/tavplubix-patch-5 
Disable flaky test_ttl_move_memory_usage.py
 2023-02-23 10:27:25 +03:00
Robert Schulze
81bf43157f
Allow configuration of Kafka topics with periods 
The Kafka table engine allows global configuration and per-Kafka-topic
configuration. The latter uses syntax <kafka_TOPIC>, e.g. for topic
"football":

  <kafka_football>
      <retry_backoff_ms>250</retry_backoff_ms>
      <fetch_min_bytes>100000</fetch_min_bytes>
  </kafka_football>

Some users had to find out the hard way that such configuration doesn't
take effect if the topic name contains a period, e.g. "sports.football".
The reason is that ClickHouse configuration framework already uses
periods as level separators to descend the configuration hierarchy.
(Besides that, per-topic configuration at the same level as global
configuration could be considered ugly.)

Note that Kafka topics may contain characters "a-zA-Z0-9._-" (*) and
a tree-like topic organization using periods is quite common in
practice.

This PR deprecates the existing per-topic configuration syntax (but
continues to support it for backward compat) and introduces a new
per-topic configuration syntax below the global Kafka configuration of
the form:

<kafka>
   <topic name="football">
       <retry_backoff_ms>250</retry_backoff_ms>
       <fetch_min_bytes>100000</fetch_min_bytes>
   </topic>
</kafka>

The period restriction doesn't apply to XML attributes, so <topic
name="sports.football"> will work. Also, everything Kafka-related is
below <kafka>.

Considered but rejected alternatives:
- Extending Poco ConfigurationView with custom separators (e.g."/"
  instead of "."). Won't work easily because ConfigurationView only
  builds a path but defers descending the configuration tree to the
  normal configuration classes.
- Reloading the configuration file in StorageKafka (instead of reading
  the loaded file) but with a custom separator. This mode is supported
  by XML configuration. Too ugly and error-prone since the true
  configuration is composed from multiple configuration files.

(*) https://stackoverflow.com/a/37067544
 2023-02-22 20:35:09 +00:00
Alexander Gololobov
b0427c2e3c
Merge pull request #46660 from ClickHouse/fix_backup_test 
Fix integration test: terminate old version without wait
 2023-02-22 15:20:26 +01:00
Antonio Andelic
7f5fb77ed5
Increase table retries in cluster copier tests (#46590) 2023-02-22 15:09:48 +01:00
Yatsishin Ilya
80857638c1 Merge remote-tracking branch 'origin/master' into clickhouse-help 2023-02-22 13:58:17 +00:00
kssenii
c4761d6cc6 Fix checks 2023-02-22 14:27:43 +01:00
kssenii
f0ca3ef207 Merge remote-tracking branch 'upstream/master' into named-collections-granular-access 2023-02-22 14:02:29 +01:00
Alexander Tokmakov
fba2ec30a2 fix style check 2023-02-22 13:53:43 +01:00
lzydmxy
ec8b6c5590 add __init__.py for integration test test_move_partition_to_disk_on_cluster 2023-02-22 19:57:56 +08:00
kssenii
ceff5f41d1 Fix tests 2023-02-22 12:27:07 +01:00
Dmitry Novik
67469ad46b
Merge pull request #46622 from ClickHouse/async-insert-memory-fix 
Fix MemoryTracker counters for async inserts
 2023-02-22 12:27:05 +01:00
Kseniia Sumarokova
3f0d93d6e6
Merge pull request #46656 from ClickHouse/kssenii-patch-6 
Update postgres_utility.py
 2023-02-22 11:35:03 +01:00
Alexander Tokmakov
c009c2f4cb
Update test_ttl_move_memory_usage.py 2023-02-22 00:50:21 +03:00
kssenii
08b0e3c630 Fix style check 2023-02-21 18:27:37 +01:00
kssenii
9a7c71b78e Allow to hide only values from system.named_collections 2023-02-21 18:07:57 +01:00
Igor Nikonov
bf05082984
Merge branch 'master' into keeper-retries-by-default 2023-02-21 17:59:55 +01:00
robot-clickhouse
af677c7dcd Automatic style fix 2023-02-21 16:08:13 +00:00
alesapin
1d4352d82a Fix integration test: terminate old version without wait 2023-02-21 17:01:19 +01:00
Kruglov Pavel
341a776617
Disable test 2023-02-21 16:41:05 +01:00
Kseniia Sumarokova
3df7a10ac7
Update postgres_utility.py 2023-02-21 16:25:11 +01:00
Kseniia Sumarokova
655e7f29f7
Merge pull request #46595 from kssenii/update-rabbit-producer 
Fix rabbitmq test
 2023-02-21 16:18:55 +01:00
Kseniia Sumarokova
a45480c11e
Merge pull request #46596 from ClickHouse/kssenii-patch-7 
Fix meilisearch test flakyness
 2023-02-21 14:23:07 +01:00
Kseniia Sumarokova
09a979f106
Merge branch 'master' into update-rabbit-producer 2023-02-21 11:50:30 +01:00
robot-clickhouse
93aabf8c66 Automatic style fix 2023-02-21 02:06:16 +00:00
Dmitry Novik
573ce50403 Fix test 2023-02-21 01:44:10 +00:00
Dmitry Novik
16a9ac9118 Try to add test 2023-02-21 00:52:54 +00:00
robot-clickhouse
abeb1c5ba8 Automatic style fix 2023-02-20 23:49:25 +00:00
Alexey Milovidov
4a2bd6e0aa Adapt a test 2023-02-21 00:43:10 +01:00
Alexey Milovidov
dc4b52e54e Adapt a test 2023-02-21 00:41:40 +01:00
Alexey Milovidov
40d11ce422 Adapt a test 2023-02-21 00:39:32 +01:00
Kruglov Pavel
828a06b511
Merge branch 'master' into fix-kafka-protobuf 2023-02-20 21:45:43 +01:00
Kseniia Sumarokova
47604ad77e
Merge pull request #46106 from kssenii/return-materialized-postrgesql-tests-back 
Enable disabled MaterializedPostgreSQL tests back in CI
 2023-02-20 19:04:58 +01:00
kssenii
0a36398847 Update test 2023-02-20 16:53:06 +01:00
Kseniia Sumarokova
0d9a541441
Update test.py 2023-02-20 16:43:10 +01:00
kssenii
80a0aa1327 Merge remote-tracking branch 'upstream/master' into return-materialized-postrgesql-tests-back 2023-02-20 14:37:39 +01:00
kssenii
591510c20e Uodate test 2023-02-20 14:36:53 +01:00
Kseniia Sumarokova
514e3cbf90
Update test.py 2023-02-20 14:29:04 +01:00
kssenii
361678ad73 rabbitmq-test-fix 2023-02-20 14:16:40 +01:00
lzydmxy
ccf87a6afd add integration test for move partition to disk on cluster 2023-02-20 16:52:55 +08:00
Azat Khuzhin
0859bbb08b Compress tar archives with zstd in intergration tests 
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-02-18 21:54:38 +01:00
pufit
5b10fafbb0 Additional tests 2023-02-18 13:45:33 -05:00
Alexey Milovidov
f073cd470f
Merge pull request #46478 from ClickHouse/fix_test_store_cleanup 
Fix some flaky integration tests
 2023-02-18 17:33:02 +03:00
Kseniia Sumarokova
b0ea047e76
Merge pull request #46533 from kssenii/fix-disk-setting 
Allow `disk` merge tree setting in query to override config merge tree setting `storage_policy`
 2023-02-18 12:36:54 +01:00
kssenii
ee7eb8a7dc Fix test 2023-02-18 12:28:55 +01:00
Azat Khuzhin
fb35a6852e More flakiness fiexes for test_backup_restore_on_cluster/test_disallow_concurrency 
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-02-18 11:13:32 +01:00
kssenii
30748eace8 Fix black check 2023-02-17 21:02:16 +01:00