thevar1able/ClickHouse
1
0
Fork 0
mirror of https://github.com/ClickHouse/ClickHouse.git synced 2024-12-01 03:52:15 +00:00
Code Issues Packages Projects Releases Wiki Activity
135,859 Commits 9,191 Branches 1,782 Tags 2.2 GiB
f94b5e95b2
Commit Graph

8731 Commits

Author SHA1 Message Date
robot-clickhouse
129e0349b7 Automatic style fix 2023-12-08 02:33:04 +00:00
Alexey Milovidov
d810bea8e3 Fix test 2023-12-08 03:17:13 +01:00
Alexey Milovidov
01135211e9 Fix test 2023-12-08 03:12:54 +01:00
Alexey Milovidov
ce9e134043 Merge branch 'master' into CurtizJ-fix-ttl-non-deterministic 2023-12-08 03:10:09 +01:00
Vitaly Baranov
b4cac92e28 Add some comments. 2023-12-07 22:18:49 +01:00
robot-clickhouse
f7c3304045 Automatic style fix 2023-12-07 19:42:33 +00:00
Nikita Mikhaylov
0b5b042153 Add test 2023-12-07 20:09:44 +01:00
Azat Khuzhin
2c6604ec24 Allow nodes in config with from_env/from_zk and non empty element with replace=1 
Such nodes in config are useful as a nodes with default values, that can
be overwritten from ZooKeeper/env.

So after this patch the following is valid, and is interpreted as
default value 86400, and can be overwritten via env:

```xml
<asynchronous_metrics_update_period_s replace="1" from_env="CH_ASYNCHRONOUS_METRICS_UPDATE_PERIOD_S">86400</asynchronous_metrics_update_period_s>
```

While the following is not:

```xml
<asynchronous_metrics_update_period_s             from_env="CH_ASYNCHRONOUS_METRICS_UPDATE_PERIOD_S">86400</asynchronous_metrics_update_period_s>
```

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-12-07 18:01:40 +01:00
Igor Nikonov
94fb23af0b Merge remote-tracking branch 'origin/master' into pr-custom-key-failover 2023-12-07 11:52:40 +00:00
kssenii
188d4d66c9 Merge with master 2023-12-07 12:45:36 +01:00
kssenii
0486631f4c Fxi 2023-12-07 12:44:00 +01:00
robot-clickhouse
6cf7f75fb4 Automatic style fix 2023-12-07 10:11:44 +00:00
kssenii
246eeee2df Merge remote-tracking branch 'origin/master' into materialized-postgres-escape-publication 2023-12-07 10:48:15 +01:00
kssenii
56b20b6d36 Merge remote-tracking branch 'origin/master' into add-a-test-for-issue-with-table-override 2023-12-07 10:46:08 +01:00
kssenii
bbddd330c6 Add forgotten change 2023-12-07 10:46:00 +01:00
Kseniia Sumarokova
b3f22449f6
Merge pull request #57515 from ClickHouse/fix-materialized-pg-issue-with-incorrect-connection-options 
MaterializedPostgreSQL: fix issue #41922, add test for #41923
 2023-12-07 10:42:14 +01:00
Nikolay Degterinsky
995b51ef73 Allow avoiding resolving hostnames in DDLWorker 2023-12-07 03:43:26 +00:00
Ryan Jacobs
ca790b6eec
apply python style check 2023-12-06 19:26:50 -08:00
Ryan Jacobs
7d41426935
test_storage_postgresql: Add test_postgres_array_ndim_error_messges() 
Tests:

1. View with array column cannot be empty --> error message
2. View cannot have empty array --> error message
3. View cannot have NULL array value --> error message
4. Ensures PG identifiers that require quoting do not crash ClickHouse.

These apply to views that contain arrays.
 2023-12-06 18:39:09 -08:00
kssenii
f461b5b2d0 Add a test 2023-12-06 23:39:34 +01:00
Alexey Milovidov
05bc8ef1e0
Merge pull request #57548 from ClickHouse/s3queue_production_ready 
`S3Queue` is production ready
 2023-12-06 22:21:08 +01:00
Ryan Jacobs
119c2864a0
test_storage_postgresql: mixed-case identifier on array column 2023-12-06 12:59:58 -08:00
robot-clickhouse
4dab2515dc Automatic style fix 2023-12-06 19:46:41 +00:00
kssenii
6321576ff8 Add a test 2023-12-06 20:27:41 +01:00
robot-clickhouse
ec5726c1e6 Automatic style fix 2023-12-06 18:58:03 +00:00
kssenii
6368d060b7 Add a test 2023-12-06 19:39:18 +01:00
vdimir
8f32293104
Merge pull request #57416 from ClickHouse/vdimir/fix_test_encrypted_disk 
Change type of s3_cache in test_encrypted_disk
 2023-12-06 14:37:40 +01:00
Alexey Milovidov
f8de7f6bc2 Merge branch 'master' into s3queue_production_ready 2023-12-06 12:25:29 +01:00
Kseniia Sumarokova
e02883cd4a
Merge branch 'master' into fix-materialized-pg-issue-with-incorrect-connection-options 2023-12-06 12:16:04 +01:00
Igor Nikonov
b4922eece4 Merge remote-tracking branch 'origin/master' into pr-custom-key-failover 2023-12-06 10:44:30 +00:00
Alexey Milovidov
76bbeaa676 S3Queue is production ready 2023-12-05 21:10:19 +01:00
Kseniia Sumarokova
f56fe785e8
Update test.py 2023-12-05 18:40:56 +01:00
MikhailBurdukov
c41511e51c ignore_on_cluster_for_grants 2023-12-05 15:11:32 +00:00
Nikolay Degterinsky
a776a5cac5
Merge pull request #57483 from joelynch/stop-listen-tcp-secure 
bugfix: correctly parse SYSTEM STOP LISTEN TCP SECURE
 2023-12-05 15:25:34 +01:00
robot-clickhouse
fee17abf7a Automatic style fix 2023-12-05 12:40:11 +00:00
kssenii
0d313acd03 Fix 2023-12-05 13:22:35 +01:00
Igor Nikonov
71204c2a82 Merge remote-tracking branch 'origin/master' into pr-custom-key-failover 2023-12-05 12:00:45 +00:00
Alexey Milovidov
1f752b79db
Merge pull request #55894 from bharatnc/ncb/hostname-system-log-tables 
add hostname column to system log tables
 2023-12-05 06:42:43 +01:00
Alexey Milovidov
10d65a1ade
Merge pull request #55559 from azat/s3-fix-excessive-reads 
Add ability to disable checksums for S3 to avoid excessive input file read
 2023-12-05 06:34:21 +01:00
Bharat Nallan Chakravarthy
942802f308 few more test cases 2023-12-04 14:01:43 -08:00
joelynch
b312a9f4ee
bugfix: parse system stop listen tcp secure 2023-12-04 19:56:35 +01:00
Alexey Milovidov
02439eee58
Merge pull request #49351 from ClickHouse/async-loader-integration 
Asynchronous loading of tables
 2023-12-04 17:16:12 +01:00
vdimir
a4ae90de0d
Merge pull request #57275 from ClickHouse/vdimir/merge_task_tmp_data 
Background merges correctly use temporary data storage in the cache
 2023-12-04 14:52:20 +01:00
vdimir
27589f5b0e
Enable temporary_data_in_cache in test_encrypted_disk 2023-12-04 10:34:17 +00:00
vdimir
b2e29d1416
Change type of s3_cache in test_encrypted_disk 2023-12-04 10:34:13 +00:00
Bharat Nallan Chakravarthy
25d1d59c6d fix tests 2023-12-03 20:16:16 -08:00
Bharat Nallan Chakravarthy
440dc66a5c Merge remote-tracking branch 'upstream/master' into ncb/hostname-system-log-tables 2023-12-03 15:19:47 -08:00
Vitaly Baranov
366095affc Fix test test_create_or_drop_tables_during_backup. 2023-12-04 00:15:31 +01:00
Sema Checherinda
32e3b2657b
Merge pull request #57205 from CheSema/zero-locks-leak 
fix zero-copy locks leaking
 2023-12-02 15:54:12 +01:00
Han Fei
fc0f080cb4 fix black 2023-12-01 20:39:38 +01:00
JackyWoo
8a68d51261
Add index to table system.numbers (#50909) 2023-12-01 19:59:25 +01:00
Han Fei
e4da317f05 fix test 2023-12-01 18:07:45 +01:00
Nikolai Kochetov
0b4131546a
Merge pull request #56813 from jsc0218/SystemTablesFilterEngine 
Able to Filter Engine When Scanning System Tables
 2023-12-01 16:02:27 +01:00
alesapin
fb98b212c5
Merge pull request #57311 from ClickHouse/make_alter_mat_view_non_experimental 
Make alter materialized view non experimental
 2023-12-01 12:18:43 +01:00
robot-clickhouse
a1219d0efd Automatic style fix 2023-11-30 21:12:29 +00:00
Igor Nikonov
b67bccd374 Integration test: custom key with failover 2023-11-30 20:54:53 +00:00
Sema Checherinda
60bf17ce8a fix style 2023-11-30 21:13:56 +01:00
Sema Checherinda
42f648f0d2 relock block when sessin expired 2023-11-30 21:13:56 +01:00
alesapin
17ac9e3409 Fix test 2023-11-30 19:42:12 +01:00
Igor Nikonov
7ab093c5d4 Fix existing intergation test 2023-11-30 18:42:03 +00:00
vdimir
b9860648c1
Remove temporary_data_in_cache from test_merge_tree_s3 2023-11-30 13:27:32 +00:00
Kruglov Pavel
575ee1e665
Merge pull request #56868 from zvonand/zvonand-fileCluster 
Introduce `fileCluster` table function
 2023-11-30 13:49:53 +01:00
Han Fei
a316b70917 Merge branch 'master' into hanfei/keeper_soft_limit 2023-11-30 12:29:40 +01:00
Alexander Tokmakov
a2dc2d9a53
Mark a setting obsolete (#57336) 
* Update Settings.h

* Update InterpreterUndropQuery.cpp

* Update 02888_obsolete_settings.reference

* Update test.py

* Update 02681_undrop_query.sql

* Update 02681_undrop_query_uuid.sh
 2023-11-29 19:24:11 +01:00
Alexander Tokmakov
97b63bbbca
Merge pull request #57339 from ClickHouse/fix_ddlworker_hostname_change 
Ignore finished ON CLUSTER tasks if hostname changed
 2023-11-29 17:46:17 +01:00
Nikolai Kochetov
823ba2db46
Merge pull request #57075 from yariks5s/s3_links_fix 
S3-style links bug fix
 2023-11-29 17:41:08 +01:00
vdimir
b5babe1692
MergeTask uses temporary data storage 2023-11-29 16:18:32 +00:00
zvonand
c329e382ab resolve conflicts 2023-11-29 16:03:07 +01:00
Han Fei
4c0efb0262
Merge pull request #53240 from hanfei1991/hanfei/statistic 
use statistic to order prewhere conditions better
 2023-11-29 12:26:44 +01:00
Nikolai Kochetov
731a1bfcf8 Cleanup 2023-11-29 11:11:58 +00:00
Alexander Tokmakov
84abbafcc5 ignore finished ddl tasks if hostname changed 2023-11-29 02:06:52 +01:00
Nikolai Kochetov
4d906d6e3c Cleanup 2023-11-28 18:35:19 +00:00
Yarik Briukhovetskyi
ad9583d6e9
style fix 2023-11-28 19:13:37 +01:00
Yarik Briukhovetskyi
a83a046d54 added tests 2023-11-28 17:33:46 +00:00
Nikolai Kochetov
08a7575984 Re-implement filtering a bit. 2023-11-28 16:17:35 +00:00
Han Fei
6733438adc Merge branch 'master' into hanfei/statistic 2023-11-28 16:35:00 +01:00
zvonand
c306d21b54 merge master + resolve conflicts 2023-11-28 15:51:21 +01:00
Han Fei
3aa4a6ae2c check integration test 2023-11-28 14:47:31 +01:00
Antonio Andelic
9dd4783675 Merge branch 'master' into fix-readonly-replica 2023-11-28 10:43:29 +00:00
vdimir
ae09d04578
Merge pull request #57154 from ClickHouse/vdimir/params_test_check_table 
Minor changes in test_check_table
 2023-11-28 11:10:26 +01:00
Han Fei
7bd2ea3add Merge branch 'master' into hanfei/statistic 2023-11-27 23:31:23 +01:00
Han Fei
8e1b61cc13 fix style 2023-11-27 22:03:05 +01:00
Nikolai Kochetov
e1b00b3ee0 Merge branch 'master' into SystemTablesFilterEngine 2023-11-27 18:54:21 +00:00
Han Fei
347efc669e support memory soft limit for keeper 2023-11-27 18:28:10 +01:00
Antonio Andelic
2ea44adefd Add test 2023-11-27 15:05:56 +00:00
Antonio Andelic
9707796869 Ignore comments when comparing column descriptions 2023-11-27 12:25:41 +00:00
MikhailBurdukov
6f19e8ebd1
Merge branch 'master' into native_copy_for_s3_disks 2023-11-27 14:25:36 +03:00
MikhailBurdukov
c10c30832c Review fix 2023-11-27 10:58:30 +00:00
Kruglov Pavel
b10e46b2bc
Merge pull request #57126 from Avogar/size-virtual-column 
Add _size virtual column to s3/file/hdfs/url/azureBlobStorage engines
 2023-11-27 10:12:18 +01:00
Bharat Nallan Chakravarthy
6454687fa6 Merge remote-tracking branch 'upstream/master' into ncb/hostname-system-log-tables 2023-11-26 16:24:18 -08:00
Azat Khuzhin
1168b7910b Update test_throttling with enabled s3_disable_checksum 
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-11-26 20:03:33 +01:00
Vitaly Baranov
4fed61e8ca
Merge pull request #57146 from vitlibar/fix-test_replicated_merge_tree_encryption_codec_different_keys_2 
Fix test test_replicated_merge_tree_encryption_codec/test.py::test_different_keys
 2023-11-25 09:36:33 +01:00
Alexey Milovidov
c478acab42
Merge pull request #57206 from azat/tests/test_distributed_storage_configuration 
Fix test_distributed_storage_configuration flakiness
 2023-11-25 02:57:51 +01:00
Sema Checherinda
abd399705e
Merge pull request #57025 from CheSema/s3_engine_heavy_write_check_mem 
test_s3_engine_heavy_write_check_mem: turn test off
 2023-11-24 21:07:35 +01:00
Azat Khuzhin
d0b4917fd3 Fix test_distributed_storage_configuration flakiness 
It fails [1] due to extra reservation on disk2 for some system.*_log
tables, sure we can turn them off, but better to fix it explicitly with
a separate policy.

  [1]: https://s3.amazonaws.com/clickhouse-test-reports/0/98cddf5312722e403dcea429639ac13dc6cada33/integration_tests__tsan__[2_6].html

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-11-24 20:28:18 +01:00
Alexey Milovidov
411660c267 Fix integration tests 2023-11-24 17:35:56 +01:00
Vitaly Baranov
5769a88b92
Merge pull request #57133 from vitlibar/change-default-for-wait_dictionaries_load_at_startup 
Change the default for wait_dictionaries_load_at_startup to true
 2023-11-24 17:09:05 +01:00
Vitaly Baranov
683827c6df Add comment. 2023-11-24 14:01:52 +01:00
vdimir
3b4f70a811
Minor changes in test_check_table 2023-11-23 16:24:11 +00:00
Vitaly Baranov
eabdc76e7c Fix test test_replicated_merge_tree_encryption_codec/test.py::test_different_keys 2023-11-23 15:36:11 +01:00
Vitaly Baranov
5f461ff780 Change the default for "wait_dictionaries_load_at_startup" to true, 
and use this setting only if "dictionaries_lazy_load" is false.
 2023-11-23 14:45:42 +01:00
Aleksei Filatov
1a03f5f7f4 Merge remote-tracking branch 'upstream/master' into add_cancellation_point_for_moving_background_operation 2023-11-23 16:43:33 +03:00
avogar
e3afb4182b Fix tests 2023-11-23 11:10:41 +00:00
serxa
0fc25fbda8 Merge branch 'master' into async-loader-integration 2023-11-23 09:32:43 +00:00
jsc0218
aba2f0e4b2 Fix Style 2023-11-22 20:02:15 +00:00
jsc0218
a1bde09c9c move the test from stateless to integration 2023-11-22 19:13:13 +00:00
Kruglov Pavel
b84e3cf683
Merge branch 'master' into size-virtual-column 2023-11-22 19:25:00 +01:00
avogar
193f8a5d23 Add test for azure 2023-11-22 18:12:50 +00:00
zvonand
5153798aeb Introduced fileCluster table function 
Added fileCluster function
Added test and docs
 2023-11-22 15:06:04 +01:00
Kruglov Pavel
9fb1acc947
Merge pull request #56810 from Avogar/iceberg-metadata-files 
Iceberg metadata files
 2023-11-22 14:40:04 +01:00
Sema Checherinda
adf4ade00a
Update tests/integration/test_merge_tree_s3/test.py 2023-11-22 13:38:15 +01:00
Kseniia Sumarokova
e4f66b8469
Merge pull request #55158 from kssenii/fs-cache-improvement 
fs cache improvement for big reads
 2023-11-21 21:50:00 +01:00
Nikita Mikhaylov
087a0a6043
Merge pull request #57040 from ClickHouse/fix-rabbitmq-supress-tsan-in-test 
Fix: suppress TSAN in RabbitMQ test
 2023-11-21 17:52:36 +01:00
Sema Checherinda
63bd45fa5f
Update tests/integration/test_merge_tree_s3/test.py 2023-11-21 17:42:37 +01:00
vdimir
a139ae97eb
Merge pull request #52918 from ClickHouse/vdimir/s3_blob_log 
Add system table with blob storage operations log
 2023-11-21 17:40:42 +01:00
Vitaly Baranov
4052ae8bfd
Merge pull request #57007 from vitlibar/fix-dropping-tables-in-test_create_or_drop_tables_during_backup 
Fix dropping tables in test_create_or_drop_tables_during_backup
 2023-11-21 17:16:16 +01:00
Sema Checherinda
2e1c142d6d black style 2023-11-21 14:03:49 +01:00
Igor Nikonov
08b2740d0f Fix: supress test with tsan 2023-11-21 11:26:14 +00:00
Kseniia Sumarokova
d384762123
Merge branch 'master' into fs-cache-improvement 2023-11-21 11:24:52 +01:00
Kseniia Sumarokova
f960036d76
Merge pull request #56874 from ClickHouse/kssenii-patch-8 
Update test_storage_s3_queue/test.py
 2023-11-21 11:13:00 +01:00
vdimir
15234474d7
Implement system table blob_storage_log 2023-11-21 09:18:25 +00:00
Sema Checherinda
524edd8460 turn test off 2023-11-21 00:08:20 +01:00
Alexey Milovidov
6a1955cb34 Merge branch 'master' of github.com:ClickHouse/ClickHouse into remove-useless-install 2023-11-20 21:34:31 +01:00
Sema Checherinda
485f1834d8
Merge pull request #56938 from CheSema/lz4-buffering 
Lz4 compression: buffer block in a rare case
 2023-11-20 20:33:30 +01:00
Kseniia Sumarokova
9454b203e1
Merge branch 'master' into kssenii-patch-8 2023-11-20 20:19:21 +01:00
Vitaly Baranov
897cd06bcf Fix dropping tables in test "test_create_or_drop_tables_during_backup". 2023-11-20 19:31:53 +01:00
avogar
f537bad469 Merge branch 'master' of github.com:ClickHouse/ClickHouse into schema-inference-union 2023-11-20 14:32:50 +00:00
Sema Checherinda
a7fc8d4b99 test_merge_tree_s3 counts errors, turn off s3_use_adaptive_timeouts 2023-11-20 15:04:14 +01:00
avogar
872556a5d4 Merge branch 'master' of github.com:ClickHouse/ClickHouse into schema-inference-union 2023-11-20 14:03:36 +00:00
Kseniia Sumarokova
4c7daf5167
Fix 2023-11-20 14:55:23 +01:00
Sema Checherinda
f999337dae
Revert "Revert "s3 adaptive timeouts"" 2023-11-20 14:53:22 +01:00
Alexander Tokmakov
5031f239c3
Revert "s3 adaptive timeouts" 2023-11-20 14:28:59 +01:00
robot-clickhouse
05b608cd76 Automatic style fix 2023-11-20 10:12:45 +00:00
Smita Kulkarni
961bf074da Initial draft version of adding backup support to AzureBlobStorage 2023-11-20 10:56:10 +01:00
Alexey Milovidov
241cc2abf4 Merge branch 'master' into remove-useless-install 2023-11-20 01:12:08 +01:00
Bharat Nallan Chakravarthy
d08512d8c0 Merge remote-tracking branch 'upstream/master' into ncb/hostname-system-log-tables 2023-11-19 14:06:40 -08:00
Igor Nikonov
b9a28028e4
Merge branch 'master' into test-rabbitmq-with-secure-connection 2023-11-19 21:33:09 +01:00
Alexey Milovidov
9367dcc276
Merge pull request #56975 from rschu1ze/unflake-test_backward_compat 
Add exclude for tryBase64Decode to backward compat test (follow-up to #56913)
 2023-11-19 16:41:42 +01:00
Robert Schulze
a3c9f13ac9
Add exclude for tryBase64Decode to backward compat test (follow-up to #56913) 
Fixes #56969
 2023-11-19 15:33:58 +00:00
Antonio Andelic
ab234a87a8
Merge pull request #56960 from ClickHouse/fix-test_keeper_auth 
Fix `test_keeper_auth`
 2023-11-19 16:09:04 +01:00
Sema Checherinda
a950595c24
Merge pull request #56314 from CheSema/s3-aggressive-timeouts 
s3 adaptive timeouts
 2023-11-19 14:12:14 +01:00
serxa
9023f61349 Merge branch 'master' into async-loader-integration 2023-11-19 13:05:58 +00:00
Antonio Andelic
7c81d9b2b7 Fix test_keeper_auth 2023-11-18 19:38:33 +00:00
Antonio Andelic
274f2c71f2
Merge pull request #56460 from ClickHouse/keeper-map-backup-restore 
Backup/Restore for KeeperMap tables
 2023-11-18 19:27:36 +01:00
Antonio Andelic
9eaafff3d2
Merge pull request #56715 from incfly/keeper-az-fix 
Fix keeper availability zone configuration.
 2023-11-18 19:24:24 +01:00
Alexey Milovidov
74319b5cbd
Merge pull request #56082 from Algunenano/less_diff_images 
See what happens if we use less different docker images in integration tests
 2023-11-18 17:24:28 +01:00
Sema Checherinda
6d5a5f9fcd buffer result if out copacity is not enough 2023-11-17 17:31:00 +01:00
Raúl Marín
4d5becb4de Adapt test_storage_s3/test.py::test_predefined_connection_configuration 2023-11-17 15:01:54 +01:00
Raúl Marín
7074bdb3bb Merge remote-tracking branch 'blessed/master' into access-control-and-named-collections-by-default 2023-11-17 14:53:02 +01:00
Kruglov Pavel
4e6f265e3e
Fix tests 2023-11-17 14:36:48 +01:00
Alexey Milovidov
5f9db3b248
Merge pull request #56794 from ClickHouse/early-exit-interserver-authentication-failure 
Early disconnect if there is authentication failure with interserver secret
 2023-11-17 13:36:09 +01:00
Antonio Andelic
803d9668e2 Merge branch 'master' into keeper-map-backup-restore 2023-11-17 10:11:59 +00:00
Antonio Andelic
f8794e72e7
Merge pull request #56858 from ClickHouse/better-test_keeper_broken_logs 
Fix `test_keeper_broken_logs`
 2023-11-17 10:36:05 +01:00
Antonio Andelic
8b30a54b48
Merge pull request #56835 from ClickHouse/better-test_keeper_reconfig_replace_leader 
More stable `test_keeper_reconfig_replace_leader`
 2023-11-17 10:35:26 +01:00
Aleksei Filatov
163b8a814e Fix clang-tidy issues and disable parallel execution of tests 2023-11-17 11:02:07 +03:00
Jianfei Hu
ef79bf6467 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into keeper-az-fix 2023-11-16 21:58:02 +00:00
Bharat Nallan Chakravarthy
7434dd9e0a Merge remote-tracking branch 'upstream/master' into ncb/hostname-system-log-tables 2023-11-16 11:17:45 -08:00
Kseniia Sumarokova
2a1467b8da
Update test_storage_s3_queue/test.py 2023-11-16 19:33:17 +01:00
Alexey Milovidov
2941f30678 Merge branch 'master' of github.com:ClickHouse/ClickHouse into early-exit-interserver-authentication-failure 2023-11-16 18:15:09 +01:00
Kseniia Sumarokova
a2ed756eec
Merge branch 'master' into fs-cache-improvement 2023-11-16 17:49:26 +01:00
robot-clickhouse
d03a1aab7b Automatic style fix 2023-11-16 16:39:57 +00:00
Igor Nikonov
34f8bf8da5 Merge remote-tracking branch 'origin/master' into test-rabbitmq-with-secure-connection 2023-11-16 16:27:25 +00:00
Igor Nikonov
49c58e7609 Disable RabbitMQ secure connection test in intergatiion test with TSAN 2023-11-16 16:24:09 +00:00
Konstantin Bogdanov
4cc2d6baa5
Merge pull request #56694 from ClickHouse/fix-configuration-merge-issue 
Fix configuration merge for nodes with substitution attributes
 2023-11-16 15:19:09 +01:00
Antonio Andelic
bb68321fc1 More stable test_keeper_reconfig_replace_leader 2023-11-16 13:31:39 +00:00
Antonio Andelic
bdf038191a better test_keeper_broken_logs 2023-11-16 13:08:48 +00:00
Igor Nikonov
b9d083e68d Merge remote-tracking branch 'origin/master' into test-rabbitmq-with-secure-connection 2023-11-16 13:05:10 +00:00
Igor Nikonov
4d16c096a1 Use ports from cluster 2023-11-16 13:03:20 +00:00
alesapin
437a911d7b
Merge pull request #56809 from ClickHouse/add_async_moves_execution 
Implement asynchronous execute of `ALTER TABLE ... MOVE ... TO DISK|VOLUME`
 2023-11-16 12:47:31 +01:00
Antonio Andelic
203f83c2c2 Merge branch 'master' into keeper-map-backup-restore 2023-11-16 11:31:11 +00:00
Sema Checherinda
7d37c0e070
Update tests/integration/test_merge_tree_s3_failover/configs/config.d/storage_conf.xml 
Co-authored-by: Nikita Taranov <nickita.taranov@gmail.com>
 2023-11-16 12:29:21 +01:00
Sema Checherinda
ebd42187ad
Update tests/integration/test_merge_tree_s3_failover/configs/config.d/storage_conf.xml 
Co-authored-by: Nikita Taranov <nickita.taranov@gmail.com>
 2023-11-16 12:29:15 +01:00
Vitaly Baranov
342e6c7546
Merge pull request #56782 from vitlibar/add-config-setting-wait_dictionaries_load_at_startup 
Add config setting "wait_dictionaries_load_at_startup"
 2023-11-16 11:51:29 +01:00
Aleksei Filatov
21a17f8334 Add cancellation hook for moving background operation 2023-11-16 13:37:51 +03:00
Vitaly Baranov
946e02ecbc
Merge pull request #56268 from vitlibar/add-script-backup-view 
Add an external utility to view backups and to extract information from them
 2023-11-16 11:17:16 +01:00
Robert Schulze
44bd0598a3
Merge pull request #56799 from slvrtrn/fix-binary-mysql-nullable-columns 
Fix incorrect nullable columns reporting in MySQL binary protocol
 2023-11-16 01:12:46 +01:00
Alexey Milovidov
3067ca64df
Merge pull request #56573 from mkmkme/mkmkme/reload-config 
Update `query_masking_rules` when reloading the config
 2023-11-16 00:27:01 +01:00
Alexey Milovidov
09bec3c754 Fix integration test 2023-11-16 00:16:02 +01:00
Konstantin Bogdanov
67796b18bb
Add missing test config files 2023-11-15 19:36:23 +01:00
robot-clickhouse
af2f986215 Automatic style fix 2023-11-15 17:48:54 +00:00
avogar
808c3f36ed Remove prints from test 2023-11-15 17:47:10 +00:00
avogar
28522d56b7 Support Iceberg metadata files for metastore tables 2023-11-15 17:45:07 +00:00
Alexander Sapin
3e26161eaa Implement asynchronous excute of ALTER TABLE ... MOVE ... TO DISK|VOLUME 2023-11-15 18:33:59 +01:00
Vitaly Baranov
21a283049c Add the test for clickhouse_backupview to CI. 2023-11-15 17:40:53 +01:00
Alexander Tokmakov
bf10989515
Fix unexpected parts handling (#56693) 
* fix unexpected parts handling

* Automatic style fix

* fix

---------

Co-authored-by: robot-clickhouse <robot-clickhouse@users.noreply.github.com>
 2023-11-15 16:54:47 +01:00
slvrtrn
9e3ba55070 Fix incorrect nullable columns reporting in MySQL binary protocol 2023-11-15 16:53:38 +01:00
Mikhail Koviazin
08d0a160ae
test_reload_query_masking_rules: don't rely on num of events 
Due to the fact that integration tests are run in parallel and there
might be no ClickHouse restart between several tests, relying on
`system.events` in the test is fragile as it can be affected by previous
tests. This commit removes any assumptions regarding `system.events`
from the test and tries to keep it robust.
 2023-11-15 17:48:24 +02:00
Antonio Andelic
c3f7c8792a
Merge pull request #56763 from ClickHouse/disable-compress-logs-default 
Disable compressed logs by default in Keeper
 2023-11-15 16:17:14 +01:00
Antonio Andelic
d567e718eb Merge branch 'master' into keeper-map-backup-restore 2023-11-15 11:51:27 +00:00
Vitaly Baranov
308654195c Add config setting "wait_dictionaries_load_at_startup". 2023-11-15 11:48:50 +01:00
Antonio Andelic
5309dc05ef Fix test 2023-11-15 07:42:19 +00:00
Alexey Milovidov
37e48e76fe
Merge pull request #56768 from vitlibar/fix-flaky-test_replicated_merge_tree_encryption_codec 
Fix flaky test_replicated_merge_tree_encryption_codec.
 2023-11-15 07:46:06 +01:00
Vitaly Baranov
3d95ac5f2a Fix flaky test_replicated_merge_tree_encryption_codec. 2023-11-14 21:53:23 +01:00
robot-clickhouse
369aaef92f Automatic style fix 2023-11-14 20:26:32 +00:00
Igor Nikonov
cd909ffc48 Test RabbitMQ with secure connection 2023-11-14 20:13:09 +00:00
Jianfei Hu
9df2775f08 reduce timeout and setTimeout earlier. 
Signed-off-by: Jianfei Hu <hujianfei258@gmail.com>
 2023-11-14 17:58:16 +00:00
Sema Checherinda
b9cc1580e0
Merge pull request #56367 from canhld94/ch_table_reinit_new_disk 
Adding new disk to storage configuration without restart
 2023-11-14 15:54:22 +01:00
Antonio Andelic
2f9ac9b49c Address comments 2023-11-14 14:33:34 +00:00
MikhailBurdukov
1aea8186c7 Enable s3 native copy for scenario: from s3 to s3. 2023-11-14 13:53:48 +00:00
robot-clickhouse
cc3dfafd7b
Automatic style fix 2023-11-14 13:07:45 +01:00
Konstantin Bogdanov
2fddc17642
Add test 2023-11-14 13:07:38 +01:00
Mikhail Koviazin
9e1357dd7e
Update query_masking_rules when reloading the config 
Fixes #56449
 2023-11-14 14:03:28 +02:00
Sema Checherinda
3075bd9745 track clickhouse high level retries 2023-11-14 11:34:12 +01:00
Sema Checherinda
bb0b6afe14 reduce cuncurrent request number to the minio in test_storage_s3 2023-11-14 11:34:12 +01:00
Sema Checherinda
1a7be21a66 adjust tests 2023-11-14 11:34:12 +01:00
Sema Checherinda
338c51745f fix style 2023-11-14 11:34:12 +01:00
Sema Checherinda
ab2594154e add tests 2023-11-14 11:34:12 +01:00
Jianfei Hu
554d907189 Fix the keeper_server availability zone configuration. 
Signed-off-by: Jianfei Hu <hujianfei258@gmail.com>
 2023-11-13 23:42:51 +00:00
Jianfei Hu
d3517140d9 Revert "Revert "Add /keeper/availability-zone node to allow server load balancing within AZ."" 
This reverts commit e5aad4a6fd.
 2023-11-13 19:03:27 +00:00
Bharat Nallan Chakravarthy
d90b8b6fba Merge remote-tracking branch 'upstream/master' into ncb/hostname-system-log-tables 2023-11-13 08:43:37 -08:00
robot-clickhouse
a9725f22e1 Automatic style fix 2023-11-13 12:38:02 +00:00
Antonio Andelic
59480205d4 Merge branch 'master' into keeper-map-backup-restore 2023-11-13 12:21:26 +00:00
Antonio Andelic
e3c66f8a63 Merge branch 'master' into more-reliable-log-handling-keeper 2023-11-13 12:14:57 +00:00
Antonio Andelic
99d521becf More reliable log handling in Keeper 2023-11-13 12:09:13 +00:00
Alexey Milovidov
5099859ccd
Merge pull request #56656 from ClickHouse/delete-a-file-2 
Delete a file (2)
 2023-11-13 10:17:13 +01:00
Alexey Milovidov
3807dcc469 Delete a file (2) 2023-11-13 07:08:21 +01:00
Alexey Milovidov
f48527b53a Merge branch 'concurrency' of github.com:ClickHouse/ClickHouse into concurrency 2023-11-13 02:57:14 +01:00
Alexey Milovidov
7ac931c29d Merge branch 'master' into concurrency 2023-11-13 02:56:56 +01:00
Alexey Milovidov
812b8c2bc1 Fix test; delete strange file 2023-11-12 00:56:57 +01:00
Pradeep Chhetri
2ec76f2140 Fix test 2023-11-11 16:47:43 +08:00
Pradeep Chhetri
d0922782ed Revert "Revert "Add 4-letter command for yielding/resigning leadership"" 
This reverts commit e1766b96d9.
 2023-11-11 15:37:49 +08:00
Alexey Milovidov
e1766b96d9
Revert "Add 4-letter command for yielding/resigning leadership" 2023-11-11 05:45:02 +03:00
Alexey Milovidov
e5aad4a6fd
Revert "Add /keeper/availability-zone node to allow server load balancing within AZ." 2023-11-11 05:43:58 +03:00
Alexey Milovidov
28c89ad1c8
Merge pull request #56544 from jmaicher/fix/flaky-ldap-integration-test 
Fix flaky LDAP integration tests
 2023-11-10 17:00:54 +01:00
Alexey Milovidov
461b80a781
Merge pull request #56570 from ClickHouse/fix-keeper-test_cmd_crst 
Fix `test_keeper_four_word_command/test.py::test_cmd_crst`
 2023-11-10 16:57:42 +01:00
Nikolay Degterinsky
a6ebeb8422
Merge pull request #56484 from evillique/fix-on-cluster 
Fix ON CLUSTER queries without database on initial node
 2023-11-10 13:40:41 +01:00
Nikolay Degterinsky
07b2cdb614
Merge pull request #56491 from evillique/fix-alter-comment-on-cluster 
Fix ALTER COMMENT queries ON CLUSTER
 2023-11-10 13:35:26 +01:00
vdimir
051efccf6c
Delete unnecessary file 
<!---
A technical comment, you are free to remove or leave it as it is when PR is created
The following categories are used in the next scripts, update them accordingly
utils/changelog/changelog.py
tests/ci/cancel_and_rerun_workflow_lambda/app.py
-->
### Changelog category (leave one):

- Not for changelog (changelog entry is not required)
 2023-11-10 11:31:05 +01:00
Kseniia Sumarokova
e48df94772
Merge pull request #56377 from ClickHouse/minor-improvements-for-s3-queue 
Minor improvements for S3Queue
 2023-11-10 11:28:09 +01:00
Antonio Andelic
5364f4e9f8 Fix test 2023-11-10 09:59:43 +00:00
Julian Maicher
c3dc106980 Reformat with black 2023-11-10 04:28:21 +01:00
Julian Maicher
4e1965167e Fix flaky LDAP integration tests 
Use LDAP hostname with regular DNS lookup to check if LDAP is online.
Before that, we used the IP address that was extracted via the docker
client (not via DNS lookup) and it could happen that LDAP was reachable
via the IP, thus passing the online check, but not via DNS lookup, which
led to test failures (e.g. LDAP not reachable from ClickHouse instance).
 2023-11-09 21:24:52 +01:00
Mike Kot
785183bb3c Keeper reconfig -- sleep before removing leader to avoid losing accepted 
but uncommitted commands
 2023-11-09 16:22:44 +00:00
robot-clickhouse
188a88fa33 Automatic style fix 2023-11-09 16:15:14 +00:00
Antonio Andelic
f9895ab37b Small fixes and add test 2023-11-09 15:56:57 +00:00
Kseniia Sumarokova
b05a66b9b5
Update test.py 2023-11-09 13:04:46 +01:00
Antonio Andelic
e9542e4153
Merge pull request #54957 from ClickHouse/49507_Support_compression_for_keeper_protocol 
Support compression for keeper protocol
 2023-11-09 10:00:19 +01:00
Nikolay Degterinsky
96f558f51a Fix ALTER COMMENT queries ON CLUSTER 2023-11-09 06:19:00 +00:00
Nikolay Degterinsky
cc0d447c52 Fix ON CLUSTER queries without local database 2023-11-08 23:30:35 +00:00
Alexander Tokmakov
32567e16e7
Merge pull request #56429 from ClickHouse/tavplubix-patch-9 
Fix `test_attach_without_fetching`
 2023-11-08 14:37:15 +01:00
robot-clickhouse
c064488bbf Automatic style fix 2023-11-08 11:48:09 +00:00
kssenii
dfcc94fff0 Fix test 2023-11-08 12:29:40 +01:00
kssenii
dbea50738b Merge remote-tracking branch 'origin/master' into fs-cache-improvement 2023-11-08 11:53:54 +01:00
Sema Checherinda
2ffd51fb36
Merge pull request #56421 from CheSema/move-to-server-settings 
move storage_metadata_write_full_object_key setting to the server scope
 2023-11-08 11:06:39 +01:00
Antonio Andelic
788c66027c
Merge pull request #56104 from incfly/keeper-az 
Add /keeper/availability-zone node to allow server load balancing within AZ.
 2023-11-08 09:46:24 +01:00
Alexander Tokmakov
fc1bd0efd5
Update test.py 2023-11-07 19:44:16 +01:00
Sema Checherinda
8216a24abe move storage_metadata_write_full_object_key setting to the server scope 2023-11-07 17:14:46 +01:00
Kseniia Sumarokova
cc3144ea2d
Merge pull request #56370 from ClickHouse/kssenii-patch-6 
Update test_storage_s3_queue/test.py
 2023-11-07 16:29:34 +01:00
Kseniia Sumarokova
d436414ec6
Merge pull request #56376 from ClickHouse/disable-s3-queue-test-for-ordered-mode 
Update test_storage_s3_queue
 2023-11-07 16:27:52 +01:00
serxa
19aa1375fc Merge branch 'master' into async-loader-integration 2023-11-07 10:25:38 +00:00
Pradeep Chhetri
361472b29e Add 4-letter command for yielding/resigning leadership 2023-11-07 13:58:45 +08:00
Jianfei Hu
033bb19198 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into keeper-az 2023-11-07 02:50:54 +00:00
Jianfei Hu
b552bf6928 fix the test node count. 
Signed-off-by: Jianfei Hu <hujianfei258@gmail.com>
 2023-11-07 02:50:46 +00:00
Alexander Tokmakov
cf6ab2e110
Merge pull request #56282 from ClickHouse/fix_unexpected_parts_after_truncate 
Fix unexpected parts after drop range
 2023-11-06 21:03:57 +01:00
Sema Checherinda
a5e17dc919
Merge pull request #55566 from CheSema/remote-blobs-naming 
feature: storage_metadata_write_full_object_key
 2023-11-06 16:41:49 +01:00
robot-clickhouse
d55a0bd686 Automatic style fix 2023-11-06 15:04:45 +00:00
kssenii
f2c0434c4d Merge remote-tracking branch 'origin/master' into minor-improvements-for-s3-queue 2023-11-06 15:51:11 +01:00
kssenii
8db2aca832 Add a test 2023-11-06 15:48:04 +01:00
kssenii
3ecce143fc Restrict modes for the test 2023-11-06 14:44:24 +01:00
Kseniia Sumarokova
036922e3b4
Update test.py 2023-11-06 12:21:13 +01:00
Sema Checherinda
cf07fd79fc remove unstable test 2023-11-06 12:00:23 +01:00
Duc Canh Le
4c21ba7b6f tables auto initialize new disks without restart 
Signed-off-by: Duc Canh Le <duccanh.le@ahrefs.com>
 2023-11-06 10:26:48 +00:00
Alexander Tokmakov
155bdfcf0d fix 2023-11-04 22:50:19 +01:00
Arthur Passos
b6e205dcdf
Add ClickHouse setting to disable tunneling for HTTPS requests over HTTP proxy (#55033) 
* initial commit. integ tests passing, need to re-run unit & my own personal tests

* partial refactoring to remove Protocol::ANY

* improve naming

* remove all usages of ProxyConfiguration::Protocol::ANY

* fix ut

* blabla

* support url functions as well

* support for HTTPS requests over HTTP proxy with tunneling off

* remove gtestabc

* fix silly mistake

* ...

* remove usages of httpclientsession::proxyconfig in src/

* got you

* remove stale comment

* it seems like I need reasonable defaults

* fix ut

* add some comments

* remove no longer needed header

* matrix out

* add https over http proxy with no tunneling

* soem docs

* partial refactoring

* rename to use_tunneling_for_https_requests_over_http_proxy

* improve docs

* use shorter version

* remove useless test

* rename the setting

* update

* fix typo

* fix setting docs typo

* move ); up

* move ) up
 2023-11-04 13:47:52 -04:00
robot-clickhouse
6ad8e789f6 Automatic style fix 2023-11-04 14:56:15 +00:00
Alexander Tokmakov
9acd3707cb fix tests 2023-11-04 15:44:55 +01:00
Jianfei Hu
b426cfe462 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into keeper-az 
Signed-off-by: Jianfei Hu <hujianfei258@gmail.com>
 2023-11-03 16:42:29 +00:00
Kruglov Pavel
6345d94d2b
Fix test 2023-11-03 16:27:04 +00:00
vdimir
a70d0c5203
Merge pull request #56264 from azat/rocksdb/block-based-table-options 
Add ability to specify BlockBasedTableOptions for rocksdb
 2023-11-03 10:15:19 +01:00
vdimir
55a1baf029
Merge pull request #56022 from ClickHouse/vdimir/check_all_tables 
Add CHECK query for all the tables
 2023-11-03 10:10:42 +01:00
Jianfei Hu
136efba321 integration test working and std::exception_ptr. 
Signed-off-by: Jianfei Hu <hujianfei258@gmail.com>
 2023-11-03 02:24:42 +00:00
Alexander Tokmakov
e88fa10aa2
Merge pull request #56142 from ClickHouse/make_replicated_start_more_robust 
Better process broken parts on table start for replicated tables
 2023-11-02 20:11:22 +01:00
Jianfei Hu
06ff714e2e add configuration option and integration test(wip). 
Signed-off-by: Jianfei Hu <hujianfei258@gmail.com>
 2023-11-02 16:21:24 +00:00
Alexander Tokmakov
76e6b75ae2
Merge pull request #56214 from ClickHouse/hide-setup-plan 
Improve integrations tests
 2023-11-02 16:59:40 +01:00
avogar
940449dd59 Try to fix azure test 2023-11-02 15:09:53 +00:00
serxa
e97edf5285 Merge branch 'master' into async-loader-integration 2023-11-02 14:56:32 +00:00
Azat Khuzhin
decf85baca Add ability to specify BlockBasedTableOptions for rocksdb 
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-11-02 15:36:00 +01:00
Sema Checherinda
90b64bcdb9 backward compatibility and implementation feature storage_metadata_write_full_object_key 2023-11-02 15:20:55 +01:00
Raúl Marín
39163b4e31
Merge pull request #56175 from amosbird/fix-flaky-jbod-balancer 
Fix flaky test of jbod balancer.
 2023-11-02 13:19:21 +01:00
Mikhail f. Shiryaev
28463cdcd3
Do not print --setup-plan to integration tests logs 2023-11-02 08:50:03 +01:00
Alexander Sapin
abc1dfc203 Fix test 2023-11-01 20:38:09 +01:00
Amos Bird
aea0c8dddc
Add wait_until_fully_merged. 2023-11-02 01:50:09 +08:00
robot-clickhouse
2a24d15204 Automatic style fix 2023-11-01 16:06:24 +00:00
Alexander Sapin
bfcd8b7de5 Better logging and tests 2023-11-01 16:50:02 +01:00
Azat Khuzhin
c25d6cd624
Rename directory monitor concept into background INSERT (#55978) 
* Limit log frequence for "Skipping send data over distributed table" message

After SYSTEM STOP DISTRIBUTED SENDS it will constantly print this
message.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>

* Rename directory monitor concept into async INSERT

Rename the following query settings (with preserving backward
compatiblity, by keeping old name as an alias):
- distributed_directory_monitor_sleep_time_ms -> distributed_async_insert_sleep_time_ms
- distributed_directory_monitor_max_sleep_time_ms -> distributed_async_insert_max_sleep_time_ms
- distributed_directory_monitor_batch -> distributed_async_insert_batch_inserts
- distributed_directory_monitor_split_batch_on_failure -> distributed_async_insert_split_batch_on_failure

Rename the following table settings (with preserving backward
compatiblity, by keeping old name as an alias):
- monitor_batch_inserts -> async_insert_batch
- monitor_split_batch_on_failure -> async_insert_split_batch_on_failure
- directory_monitor_sleep_time_ms -> async_insert_sleep_time_ms
- directory_monitor_max_sleep_time_ms -> async_insert_max_sleep_time_ms

And also update all the references:

    $ gg -e directory_monitor_ -e monitor_ tests docs | cut -d: -f1 | sort -u | xargs sed -e 's/distributed_directory_monitor_sleep_time_ms/distributed_async_insert_sleep_time_ms/g' -e 's/distributed_directory_monitor_max_sleep_time_ms/distributed_async_insert_max_sleep_time_ms/g' -e 's/distributed_directory_monitor_batch_inserts/distributed_async_insert_batch/g' -e 's/distributed_directory_monitor_split_batch_on_failure/distributed_async_insert_split_batch_on_failure/g' -e 's/monitor_batch_inserts/async_insert_batch/g' -e 's/monitor_split_batch_on_failure/async_insert_split_batch_on_failure/g' -e 's/monitor_sleep_time_ms/async_insert_sleep_time_ms/g' -e 's/monitor_max_sleep_time_ms/async_insert_max_sleep_time_ms/g' -i

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>

* Rename async_insert for Distributed into background_insert

This will avoid amigibuity between general async INSERT's and INSERT
into Distributed, which are indeed background, so new term express it
even better.

Mostly done with:

    $ git di HEAD^ --name-only | xargs sed -i -e 's/distributed_async_insert/distributed_background_insert/g' -e 's/async_insert_batch/background_insert_batch/g' -e 's/async_insert_split_batch_on_failure/background_insert_split_batch_on_failure/g' -e 's/async_insert_sleep_time_ms/background_insert_sleep_time_ms/g' -e 's/async_insert_max_sleep_time_ms/background_insert_max_sleep_time_ms/g'

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>

* Mark 02417_opentelemetry_insert_on_distributed_table as long

CI: https://s3.amazonaws.com/clickhouse-test-reports/55978/7a6abb03a0b507e29e999cb7e04f246a119c6f28/stateless_tests_flaky_check__asan_.html
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>

---------

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-11-01 15:09:39 +01:00
Kruglov Pavel
5533258091
Merge pull request #55477 from Avogar/streaming-errors 
Allow to save unparsed records and errors in RabbitMQ, NATS and FileLog engines
 2023-11-01 14:35:35 +01:00
Kseniia Sumarokova
e5efc42633
Merge branch 'master' into fs-cache-improvement 2023-11-01 10:47:36 +01:00
Raúl Marín
f2f84fe6b7 Adapt version changes 2023-10-31 18:24:33 +01:00
Raúl Marín
957671bf74 Adapt to work with releases without DROP SYNC 2023-10-31 18:06:28 +01:00
Raúl Marín
52a3d37ebe Try reducing number of different images 2023-10-31 17:20:07 +01:00
Amos Bird
c75cd615c3
Fix flaky test of jbod balancer. 2023-10-31 23:03:55 +08:00
Kseniia Sumarokova
b57906609c
Merge pull request #56011 from kssenii/fix-flaky-s3-queue-test 
test_storage_s3_queue - add debug info
 2023-10-31 11:25:02 +01:00
Smita Kulkarni
3fdf0daf1b Merge branch 'master' into 49507_Support_compression_for_keeper_protocol 2023-10-31 10:43:28 +01:00
Kruglov Pavel
50c53fdbfd
Increase number of attempts in test 2023-10-30 20:51:03 +01:00
avogar
7eefb72c53 Merge branch 'master' of github.com:ClickHouse/ClickHouse into schema-inference-union 2023-10-30 19:44:26 +00:00
avogar
7689961a8f Try to fix test with azuer 2023-10-30 19:44:02 +00:00
Raúl Marín
19c2ad5c9b
Merge pull request #56116 from azat/tests/fix-test_format_schema_on_server 
Fix test_format_schema_on_server flakiness
 2023-10-30 12:02:14 +01:00
Kseniia Sumarokova
41e2111534
Merge branch 'master' into fix-flaky-s3-queue-test 2023-10-30 11:24:12 +01:00
Azat Khuzhin
b87ebb2a83 Fix test_format_schema_on_server flakiness 
Sometimes the requests library detect the encoding incorrectly, and
because this test compares binary data it fails.

Here is an example of successfull attempt:

    2023-10-30 07:32:37 [ 654 ] DEBUG : http://172.16.1.2:8123 "GET /?query=SELECT+%2A+FROM+test.simple+FORMAT+Protobuf+SETTINGS+format_schema%3D%27simple%3AKeyValuePair%27 HTTP/1.1" 200 None (connectionpool.py:546, _make_request)
    2023-10-30 07:32:37 [ 654 ] DEBUG : Encoding detection: utf_8 will be used as a fallback match (api.py:480, from_bytes)
    2023-10-30 07:32:37 [ 654 ] DEBUG : Encoding detection: Found utf_8 as plausible (best-candidate) for content. With 0 alternatives. (api.py:487, from_bytes)

And here is failed [1]:

    2023-10-29 18:12:56 [ 525 ] DEBUG : http://172.16.9.2:8123 "GET /?query=SELECT+%2A+FROM+test.simple+FORMAT+Protobuf+SETTINGS+format_schema%3D%27message_tmp%3AMessageTmp%27 HTTP/1.1" 200 None (connectionpool.py:547, _make_request)
    2023-10-29 18:12:56 [ 525 ] DEBUG : Encoding detection: Found utf_16_be as plausible (best-candidate) for content. With 1 alternatives. (api.py:487, from_bytes)
    E       AssertionError: assert '܈Ē͡扣܈Ȓͤ敦' == '\x07\x08\x01\x12\x03abc\x07\x08\x02\x12\x03def'
    E         - abcdef
    E         + ܈Ē͡扣܈Ȓͤ敦

  [1]: https://s3.amazonaws.com/clickhouse-test-reports/56030/c7f392500e93863638c9ca9bd56c93b3193091f3/integration_tests__release__[3_4].html

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-10-30 08:45:47 +01:00
Han Fei
19cdc6dfe2 Merge branch 'master' into hanfei/statistic 2023-10-30 04:53:18 +01:00
Azat Khuzhin
c7f392500e Fix incorrect free space accounting for least_used JBOD policy 
Before least_used fails to detect when the disk started to have more
space, it works only when the disk starts to have less space.

The reason for this is that it uses priority_queue, and once the disk
goes at the bottom of the queue, free space will not be updated for it
until it will be selected again.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-10-29 17:36:31 +01:00
Alexey Milovidov
243499aad1
Merge pull request #55796 from ClickHouse/Fix_azurite_port 
Fix azurite port issue
 2023-10-28 00:40:24 +02:00
Bharat Nallan Chakravarthy
ebd03fbd77 add a test 2023-10-27 11:02:51 -07:00
vdimir
60c93cefbe
Add test for CHECK ALL TABLES 2023-10-27 15:22:11 +00:00
Smita Kulkarni
960927a323 Updated name to use_compression 2023-10-27 14:53:54 +02:00
Kseniia Sumarokova
8984ba9c7e
Merge branch 'master' into fix-flaky-s3-queue-test 2023-10-27 14:14:24 +02:00
Sergei Trifonov
a5d7c2b6a2
Merge branch 'master' into async-loader-integration 2023-10-27 10:39:12 +02:00
Kruglov Pavel
570b66f027
Merge branch 'master' into schema-inference-union 2023-10-26 19:26:00 +02:00
Konstantin Bogdanov
ecafc77e0f
Merge pull request #55521 from ClickHouse/fix-query-params-with-custom-http-handlers 
Fix Query Parameters not working with custom HTTP handlers
 2023-10-26 18:34:37 +02:00
kssenii
5d700605a5 Merge remote-tracking branch 'upstream/master' into fix-flaky-s3-queue-test 2023-10-26 17:18:26 +02:00
Smita Kulkarni
d1d8f4b2e1 Merge branch 'master' into 49507_Support_compression_for_keeper_protocol 2023-10-26 16:56:03 +02:00
Alexander Tokmakov
fa963d60d0
Merge pull request #55641 from evillique/resubmit-cluster-groups 
Resubmit #54421
 2023-10-26 15:53:53 +02:00
helifu
4015176d27
A small fix (#55938) 2023-10-26 13:19:58 +02:00
robot-clickhouse
c4d498f961 Automatic style fix 2023-10-26 09:57:22 +00:00
Smita Kulkarni
ec21560a3b Added new changes to test_azure_blob_storage_zero_copy_replication 2023-10-26 11:40:44 +02:00
vdimir
1d5f75fd71
Merge pull request #53404 from ClickHouse/vdimir/check_table_improvements2 
Improve CHECK TABLE system query, support checking part
 2023-10-26 10:57:44 +02:00
Nikolay Degterinsky
97c99132e0 Simplify the implementation 2023-10-25 19:02:48 +00:00
Smita Kulkarni
72f6a3b029 Removed unwanted conversion 2023-10-25 17:09:58 +02:00
kssenii
de8064da6e Debug info 2023-10-25 12:31:00 +02:00
xuzifu666
010cc6918a
Add get_direct_children_number command to keeper-client (#55898) 2023-10-24 17:02:54 +02:00
serxa
749cdb9954 Merge branch 'master' into async-loader-integration 2023-10-24 10:09:49 +00:00
Smita Kulkarni
1b52418174 Updated with master 2023-10-23 22:17:23 +02:00
Smita Kulkarni
7b1c0c471c Merge branch 'master' into Fix_azurite_port 2023-10-23 22:13:56 +02:00
vdimir
2245a4fba8
Fix test_store_cleanup/test.py after rebase 2023-10-23 12:33:35 +00:00
vdimir
7583394c9c
Support CHECK TABLE ... PART ... query 2023-10-23 12:33:35 +00:00
robot-clickhouse
35d8fa212d Automatic style fix 2023-10-23 12:28:02 +00:00
Smita Kulkarni
ad09c4a37a Updated to use f-strings 2023-10-23 14:13:14 +02:00
Kruglov Pavel
32da07b4ee
Merge pull request #55695 from Avogar/restrict-iceberg 
Fixes and improvements for Iceberg storage
 2023-10-23 13:58:23 +02:00
vdimir
3332f70275
upd 2023-10-23 10:56:06 +00:00
vdimir
e84fc76292
Deterministic result for CHECK TABLE in tests 2023-10-23 09:36:39 +00:00
Kruglov Pavel
6f61ccfe28
Merge branch 'master' into schema-inference-union 2023-10-20 22:54:11 +02:00
avogar
6934e27e8b Add union mode for schema inference to infer union schema of files with different schemas 2023-10-20 20:46:41 +00:00
Alexander Tokmakov
f899254e2c
Merge pull request #55430 from arthurpassos/properly_split_remote_proxy_http_https 
Properly split remote proxy http https
 2023-10-20 21:15:34 +02:00
Aleksei Filatov
0a1f3f205c
Add external HTTP Basic authenticator (#55199) 2023-10-20 19:24:19 +02:00
SmitaRKulkarni
4dcba9d97b
Merge pull request #54738 from ClickHouse/Fix_azure_test_by_using_unique_names 
Fix azure test by using unique names
 2023-10-20 15:04:01 +02:00
Raúl Marín
07e3f10958
Merge pull request #55860 from jrdi/filesystem-cache-docs 
Add load_metadata_threads to the documentation
 2023-10-20 14:59:47 +02:00
Smita Kulkarni
c98782bd2b Merge branch 'master' into 49507_Support_compression_for_keeper_protocol 2023-10-20 14:47:17 +02:00
robot-clickhouse
68b789d7a1 Automatic style fix 2023-10-20 12:40:28 +00:00
Konstantin Bogdanov
1edf5ff981
Fix test_system_start_stop_listen 2023-10-20 14:18:44 +02:00
Smita Kulkarni
6adc297371 Merge branch 'master' into 49507_Support_compression_for_keeper_protocol 2023-10-20 13:53:45 +02:00
Sema Checherinda
6feac7bab7
Merge pull request #55850 from CheSema/fix_test 
fix node setting in the test
 2023-10-20 12:47:43 +02:00
Konstantin Bogdanov
b2d930652b
Add a test for configuration blocks order affecting HTTP handlers behavior 2023-10-20 12:45:54 +02:00
helifu
57d60dc4f2
Add a new column xid for zookeeper_connection (#50702) 
* Refactor the code

* Add a new column xid for zookeeper_connection

* Support hostnames in the configuration

* Fix a typo

* Fix a typo

* Fix a typo

* Fix a bug about connect_time

* Update test case

* Update test case

* Fix a special build check error

* Resolve conflicts caused by rebase.

* Update failed test case

* Refactor the code according to comment

* Fix two compilation errors
 2023-10-20 11:38:44 +02:00
Jordi Villar
01093d4698 Remove deprecated setting do_not_evict_index_and_mark_files 2023-10-20 09:27:46 +02:00
Alexey Milovidov
5d1cc1425a
Merge pull request #55813 from Algunenano/test_dictionaries_redis 
Attemp to fix test_dictionaries_redis flakiness
 2023-10-20 03:43:38 +02:00
Sema Checherinda
194eca91f8 fix node setting in the test 2023-10-20 00:35:35 +02:00
Kruglov Pavel
85e3c31f14
Merge pull request #55769 from AVMusorin/capn-proto-drop-cache 
Added test to check CapnProto cache
 2023-10-19 15:59:46 +02:00
Sema Checherinda
835d2dfcd6
Merge pull request #54770 from CheSema/increase-s3-retries-count 
increase s3_retry_attempts
 2023-10-19 14:17:56 +02:00
Smita Kulkarni
af5349f76b Merge branch 'master' into 49507_Support_compression_for_keeper_protocol 2023-10-19 12:03:40 +02:00
Raúl Marín
297eda83fc Attemp to fix test_dictionaries_redis flakiness 2023-10-19 11:59:13 +02:00
Aleksandr Musorin
9a155ba747 Added test to check CapnProto cache 
Since current getting schema for CapnProto doesn't use cache, the
integration test was for the future if someone add cache.

Also, I was curious how schema cache affects performance and I compared reading binary files
with Protobuf (I guess it works the same for CapnProto).

```
for i in {1..1000}; do clickhouse-client -q \
  "select * from test.simple format Protobuf settings format_schema='/format_schemas/simple:KeyValuePair'" > simple-protobuf${i}.bin; done

clickhouse-client --time -q "select * from file('simple-protobuf{1..999}.bin', 'Protobuf') format Null settings format_schema = 'simple:KeyValuePair'"
```

Protobuf with cache and without works with approximately the same
time.
 2023-10-19 09:00:39 +02:00
Sema Checherinda
1308f26ccc Update test.py 2023-10-19 01:34:36 +02:00
robot-clickhouse
a2d4372ee8 Automatic style fix 2023-10-18 20:39:41 +00:00
Smita Kulkarni
9d6cd0e9a2 Upadted to get free port for azurite 2023-10-18 22:20:39 +02:00
Kseniia Sumarokova
4e0122a299
Merge pull request #54422 from kssenii/s3-queue-fixes 
Fixes for storage `S3Queue`
 2023-10-18 21:51:51 +02:00
Kseniia Sumarokova
998e068d73
Merge pull request #55774 from kssenii/fix-mat-pg-test 
Fix test test_postgresql_replica_database_engine_2/test.py::test_replica_consumer
 2023-10-18 21:49:29 +02:00
Sema Checherinda
dfdd2ee77c fix tests, to avoid timeouts do less retries 2023-10-18 16:36:45 +02:00
Kseniia Sumarokova
e4e92913cf
Merge pull request #55261 from azat/tests/fix-integration-results-parser 
Do not allow tests with state ERROR be overwritten by PASSED
 2023-10-18 16:13:19 +02:00
avogar
be9e84c194 Fix style 2023-10-18 11:09:39 +00:00
kssenii
663c2611ee Fix 2023-10-18 13:05:29 +02:00
kssenii
33118442dd Fix black check 2023-10-18 13:01:35 +02:00
kssenii
babbdd9202 Fxi 2023-10-18 12:08:47 +02:00
Kseniia Sumarokova
fff6a8dcc8
Temporarily disable flaky test 2023-10-18 11:35:53 +02:00
kssenii
22bab4bcc3 Fix configs 2023-10-18 11:26:44 +02:00
Alexey Milovidov
79eccfb642
Merge pull request #55678 from azat/fix-OR-resubmit 
Fix filtering by virtual columns with OR filter in query (resubmit)
 2023-10-17 20:33:19 +02:00
avogar
323486f9e8 Add tests 2023-10-17 18:10:47 +00:00
Kseniia Sumarokova
7cedfeff12
Merge pull request #55145 from kssenii/materialized-pg-allow-unique-identifier 
Allow to have several MaterializedPostgreSQL tables following the same Postgres table
 2023-10-17 18:47:32 +02:00
Han Fei
4b23142775
Merge branch 'master' into hanfei/statistic 2023-10-17 16:40:31 +02:00
Smita Kulkarni
01a85522d9 Merge branch 'master' into 49507_Support_compression_for_keeper_protocol 2023-10-17 11:39:20 +02:00
Kseniia Sumarokova
c220cc65d6
Update test.py 2023-10-17 11:35:15 +02:00
Kseniia Sumarokova
550a658236
Merge pull request #55144 from kssenii/fix-iceberg-metadata-parsing 
Fix storage Iceberg files retrieval
 2023-10-17 11:31:07 +02:00
kssenii
4464c86895 Merge remote-tracking branch 'origin/master' into s3-queue-fixes 2023-10-17 11:16:52 +02:00
robot-clickhouse
c68bf8058c
Automatic style fix 2023-10-17 00:14:20 +02:00
Konstantin Bogdanov
d38e75e358
Add a test case for param_-prefixed parameters for predefined query handlers 2023-10-17 00:14:20 +02:00
Konstantin Bogdanov
cf1c2a667e
Add a negative test case for query handler 2023-10-17 00:14:20 +02:00
Kseniia Sumarokova
96c518be5b
Merge branch 'master' into s3-queue-fixes 2023-10-16 22:19:13 +02:00
Kseniia Sumarokova
3e9a1cf69f
Merge branch 'master' into fix-iceberg-metadata-parsing 2023-10-16 22:18:52 +02:00
Kseniia Sumarokova
c31299d86c
Merge branch 'master' into materialized-pg-allow-unique-identifier 2023-10-16 22:18:23 +02:00
Kseniia Sumarokova
b525f1c28a
Update test.py 2023-10-16 17:30:20 +02:00
Azat Khuzhin
b0fbd79808 Fix test_system_merges after optimization for "x OR 1" conditions 
After the previous patch "x OR 1" will not execute "x", and because of
this test_system_merges::test_mutation_simple started to fail since
"sleep" function did not executed.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-10-16 15:57:34 +02:00
Raúl Marín
51837eff33 Enable test_query_is_lock_free[detach table] for the analyzer 2023-10-16 12:49:17 +00:00
serxa
0e17da22eb Merge branch 'master' into async-loader-integration 2023-10-16 11:08:29 +00:00
kssenii
34d804686a Fix black check 2023-10-16 13:03:12 +02:00
kssenii
3cd175d11d Fix test 2023-10-16 13:01:36 +02:00
Antonio Andelic
a3360cb3f5
Merge pull request #55485 from guoxiaolongzte/keeper_client_add_get_all_children_number_command 
keeper_client add get_all_children_number command
 2023-10-16 08:45:38 +02:00
guoxiaolong
98af58d7cf fix test error 2023-10-16 10:02:31 +08:00
Kseniia Sumarokova
17ce951ed7
Update test.py 2023-10-15 18:12:01 +02:00
Kseniia Sumarokova
2015a0fc17
Merge branch 'master' into fix-iceberg-metadata-parsing 2023-10-15 18:03:53 +02:00
kssenii
f3056b1643 Add a test 2023-10-15 18:02:34 +02:00
Kseniia Sumarokova
e0668e9ea0
Update test.py 2023-10-15 14:19:44 +02:00
Kseniia Sumarokova
b26115eabe
Merge branch 'master' into materialized-pg-allow-unique-identifier 2023-10-15 14:17:32 +02:00
Kseniia Sumarokova
0cab773e7b
Merge pull request #55564 from kssenii/add-test-toast 
Add a test
 2023-10-15 14:12:57 +02:00
Nikolay Degterinsky
c1fba94d67 Resubmit #54421 
This reverts commit 3e60451ac7.
 2023-10-14 19:04:01 +00:00
Smita Kulkarni
13ffebf559 Merge branch 'master' into 49507_Support_compression_for_keeper_protocol 2023-10-14 20:08:49 +02:00
robot-clickhouse-ci-1
b41bdf38e0
Merge pull request #55627 from azat/tests/fix-test_system_merges 
Fix flakiness of test_system_merges (by increasing sleep interval properly)
 2023-10-14 17:50:04 +02:00
Alexey Milovidov
8d8df4fe56
Merge pull request #55605 from ClickHouse/add_test_back2 
Add back a test that was removed by mistake
 2023-10-14 17:49:08 +02:00
Azat Khuzhin
0fb6ed5af7 Fix flakiness of test_system_merges (by increasing sleep interval properly) 
CI: https://s3.amazonaws.com/clickhouse-test-reports/55418/769ed2e19d46fcb9cb6a678a0da6d6f2fc5d239e/integration_tests__tsan__[4_6].html
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-10-14 10:30:56 +02:00
Azat Khuzhin
e3976a5e50 Do not allow tests with state ERROR be overwritten by PASSED 
In the ERROR case there can be sanitizers issues, that should not be
hidden, like right now it is doing for
`test_s3_table_functions/test.py::test_s3_table_functions_timeouts`
test [1], but I was lucky enough to trigger this in [2].

  [1]: https://s3.amazonaws.com/clickhouse-test-reports/55247/e99b0f46961733fa8ba10e490279dbcb0cdd67ad/integration_tests__asan__[5_6].html
  [2]: https://s3.amazonaws.com/clickhouse-test-reports/55245/918d65d6707c69ab541cdb56a076cdb83845d3ed/integration_tests__asan__[5_6].html

Though there could be also other issues, like with dependent services,
but still, let's try.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-10-14 09:34:00 +02:00
Smita Kulkarni
c15b85074f Updated to include compression in clickhouse_common_io 2023-10-13 20:23:46 +02:00
Kseniia Sumarokova
310e922b40
Merge branch 'master' into materialized-pg-allow-unique-identifier 2023-10-13 19:14:50 +02:00
Kseniia Sumarokova
4555f2dd7f
Merge branch 'master' into add-test-toast 2023-10-13 19:14:17 +02:00
Alexander Tokmakov
3e60451ac7 Revert "Merge pull request #54421 from evillique/cluster-groups" 
This reverts commit 211c80e1a0, reversing
changes made to b53a98217c.
 2023-10-13 18:55:51 +02:00
Alexander Tokmakov
e40aa72883
Merge pull request #54826 from JackyWoo/lb_nearest_host_name 
Add load balancing hostname_levenshtein_distance
 2023-10-13 17:23:02 +02:00
Alexander Tokmakov
80778727d3 add back a test that was removed by mistake 2023-10-13 16:35:42 +02:00
kssenii
b6b124f5a9 Usability improvement 2023-10-13 14:16:56 +02:00
robot-clickhouse
a0491065e5 Automatic style fix 2023-10-13 11:40:14 +00:00
Smita Kulkarni
e8271685a9 Added basic test 2023-10-13 13:20:02 +02:00
kssenii
d64b990712 Merge remote-tracking branch 'origin/master' into s3-queue-fixes 2023-10-13 12:13:56 +02:00
kssenii
34915a8a5e Fix black check 2023-10-12 19:47:39 +02:00
kssenii
ed520baa06 Fix black check 2023-10-12 19:42:09 +02:00
robot-clickhouse-ci-1
211c80e1a0
Merge pull request #54421 from evillique/cluster-groups 
Add replica groups to Replicated database engine
 2023-10-12 18:14:42 +02:00
kssenii
049db971e6 Add a test 2023-10-12 17:59:00 +02:00
Nikolay Degterinsky
20e16be27b Fixes & improvements 2023-10-12 15:02:08 +00:00
kssenii
1917a882b7 Better 2023-10-12 16:36:19 +02:00
Han Fei
42dc61abf5 Merge branch 'master' into hanfei/statistic 2023-10-12 16:19:45 +02:00
guoxiaolong
7d5c15dfc9 fix python CheckSytel 2023-10-12 22:01:37 +08:00
guoxiaolong
369ebf3c4f fix CheckSytel 2023-10-12 21:15:52 +08:00
guoxiaolong
6e927325e4 fix CheckSytel 2023-10-12 20:32:36 +08:00
Smita Kulkarni
c4326e3a45 Merge branch 'master' into Fix_azure_test_by_using_unique_names 2023-10-12 12:18:31 +02:00
JackyWoo
1f553f3d65 Merge branch 'master' into lb_nearest_host_name 2023-10-12 10:19:17 +08:00
guoxiaolong
8b47bf5e7e fix CheckSytel 2023-10-12 09:58:42 +08:00
avogar
6c91c2b860 Add documentation 2023-10-11 17:35:18 +00:00
robot-ch-test-poll1
80aa9cad51
Merge pull request #55479 from slvrtrn/fix-mysql-datetime-incompatibilities 
Fix MySQL text protocol DateTime formatting and LowCardinality(Nullable(T)) types reporting
 2023-10-11 16:56:26 +02:00
Arthur Passos
0baee0c612 remove useless http resolver 2023-10-11 10:52:31 -03:00
Arthur Passos
cd0c15759b fix tests 2023-10-11 10:10:19 -03:00
guoxiaolong
f7e64ff200 add test_keeper_client 2023-10-11 20:45:38 +08:00
alesapin
21e0cb0b18
Merge pull request #55468 from ClickHouse/fix_out_of_bound_disk_web 
Fix out of bound error in system.remote_data_paths + disk web
 2023-10-11 12:54:00 +02:00
slvrtrn
76da9cf780 Remove old Java client tests 
Revert Java client docker image JDK bump (no AArch64 available)
 2023-10-10 20:35:51 +02:00
slvrtrn
e06d3ca1a5 Fix MySQL text protocol DateTime 
Introduce `removeLowCardinalityAndNullable` function
Fix incorrect removeLowCar/removeNullable usages
Add more MySQL text protocol tests
Deprecate old Java client tests
Use JDK 17 for test MySQL Java container
 2023-10-10 19:51:09 +02:00
Vitaly Baranov
2af66dd9e9
Merge pull request #55089 from vitlibar/improve-hiding-secrets-in-logs 
Improve hiding secrets in logs
 2023-10-10 19:02:40 +02:00
avogar
1afd655bbc Allow to save unparsed records and errors in RabbitMQ, NATS and FileLog engines 2023-10-10 16:21:33 +00:00
robot-clickhouse-ci-2
a9cb206044
Merge pull request #55453 from ClickHouse/update-rabbitq 
Fix test that never worked test_rabbitmq_random_detach
 2023-10-10 17:05:44 +02:00
robot-clickhouse
d500ebcb73 Automatic style fix 2023-10-10 14:21:35 +00:00
alesapin
b677318415 Add oneliner to test 2023-10-10 15:59:33 +02:00
Kruglov Pavel
5ded0005a3
Merge pull request #55064 from AVMusorin/system-drop-format-cache 
Allow drop cache for Protobuf format
 2023-10-10 14:23:11 +02:00
Robert Schulze
24fecaeb7d
Merge pull request #55427 from slvrtrn/mysql-boolean-format-fix 
Fix MySQL interface boolean representation
 2023-10-10 13:11:33 +02:00
alesapin
666c690b4f
Merge pull request #55309 from ClickHouse/fix_redundant_check 
Fix bug with inability to drop detached partition in replicated merge tree on top of S3 without zero copy
 2023-10-10 11:48:00 +02:00
robot-clickhouse
9640e09f38 Automatic style fix 2023-10-10 08:38:11 +00:00
Yatsishin Ilya
1f72bd85e9 fix test that never worked 2023-10-10 08:25:04 +00:00
Yatsishin Ilya
47512f7b40 try another fix 2023-10-10 07:42:30 +00:00
Alexey Milovidov
68ce6b9b00
Merge pull request #55424 from ClickHouse/update-rabbitq 
Updated RabbitMQ image and fixed log retrieval in failed tests.
 2023-10-10 03:32:21 +02:00
Alexey Milovidov
b50889a8ff
Merge pull request #55186 from ClickHouse/remove-in-memory-data-parts 
Remove the support for in memory data parts (part 2)
 2023-10-09 23:53:25 +02:00
Arthur Passos
63562cbb20 Merge branch 'master' into properly_split_remote_proxy_http_https 2023-10-09 17:58:29 -03:00
Alexey Milovidov
04ed4ece7a
Merge pull request #55208 from arthurpassos/add_option_to_set_env_variables_for_a_single_node_integration_tests 
Add option to set env variables for a single node in integration tests
 2023-10-09 22:37:04 +02:00
robot-clickhouse
1a67e61729 Automatic style fix 2023-10-09 19:10:41 +00:00
slvrtrn
e31cfdefa7 Report Bool as TINYINT in MySQL text and binary 2023-10-09 20:51:58 +02:00
Yatsishin Ilya
686c3b458d Updated RabbitMQ image and fixed log retrieval in failed tests. 2023-10-09 18:39:39 +00:00
slvrtrn
b0b4f6c5b7 Fix MySQL interface boolean representation 2023-10-09 20:30:28 +02:00
Alexey Milovidov
df037e079d
Merge pull request #54873 from ClickHouse/remove-flaky-ssl-tests 
Remove tests
 2023-10-09 15:22:07 +02:00
Alexey Milovidov
ce8ead34a6
Update cluster.py 2023-10-09 16:00:02 +03:00
Han Fei
fcb19b4f77 Merge branch 'master' into hanfei/statistic 2023-10-09 14:24:58 +02:00
Alexey Milovidov
e0258582ae
Merge pull request #55338 from azat/fix-CreatingSetsTransform-data-race 
Fix data-race in CreatingSetsTransform (on errors) due to throwing shared exception
 2023-10-09 13:27:10 +02:00
Alexey Milovidov
b0d9a42835
Merge pull request #55355 from azat/tests/fix-test_max_rows_to_read_leaf_with_view 
Fix test_max_rows_to_read_leaf_with_view flakiness (due to prefer_localhost_replica)
 2023-10-09 13:19:50 +02:00
Aleksandr Musorin
8d0c961af0 Allow drop cache for protobuf format 
Before it was impossible to update Protobuf schema without server
restart. With this commit, it is enough to send query `SYSTEM DROP
SCHEMA FORMAT CACHE [FOR Protobuf]`.
 2023-10-09 10:41:15 +02:00
Azat Khuzhin
9f82eef1b6 Fix test_max_rows_to_read_leaf_with_view flakiness (due to prefer_localhost_replica) 
CI: https://s3.amazonaws.com/clickhouse-test-reports/0/186bd9c85974f641a70581a704a43ebdb6d302a8/integration_tests__asan__analyzer__[4_6]/integration_run_parallel1_0.log
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-10-09 06:56:53 +02:00
Alexey Milovidov
8ac56a7b9f Remove old test 2023-10-09 01:09:03 +02:00
Alexey Milovidov
61caa9a660
Merge pull request #55245 from azat/bump-minio 
Upgrade MinIO to support accepting non signed requests
 2023-10-08 22:46:01 +02:00
Azat Khuzhin
dee435f8f4 Add a test for data-race in CreatingSetsTransform 
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-10-08 21:45:44 +02:00
Azat Khuzhin
2a27a8b0bf tests/test_throttling: check the maximum execution time as well 
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-10-08 07:31:33 +02:00
Azat Khuzhin
c883da2b26 tests/test_throttling: adjust delays due to HTTPS usage 
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-10-08 07:31:33 +02:00
Azat Khuzhin
9c8096455e tests: switch test_throttling to S3 over https to make it more production like 
One interesting thing about S3 C++ SDK is that it can read file multiple
times for calculating checksums and signature, but the last is not done
for the https protocol, though the checksum "could".

And indeed it does, since default checksum algorithm (MD5) does not
support streaming, and so it always calculated, regardless of the
protocol, however everything else (CRC*/SHA*) supports streamming and
actually will not be calculated for https at all!

This will be fixed in the follow up patch.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-10-08 07:31:33 +02:00
Azat Khuzhin
4179ff7111 Adjust the test_storage_delta::test_multiple_log_files after MinIO upgrade 
After upgrade MinIO stopped handling of objects with leading slash:

    (Pdb) p minio_client.fput_object(bucket_name='root', object_name='/test_multiple_log_files/_delta_log/00000000000000000001.json', file_path='/test_multiple_log_files/_delta_log/00000000000000000001.json').http_headers
    HTTPHeaderDict({'Accept-Ranges': 'bytes', 'Content-Length': '0', 'ETag': '"f1f3276c787b3f6724b9a8edb313c4fa"', 'Server': 'MinIO', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains', 'Vary': 'Origin, Accept-Encoding', 'X-Amz-Id-2': '7987905dee74cdeb212432486a178e511309594cee7cb75f892cd53e35f09ea4', 'X-Amz-Request-Id': '178B9B0904A9640D', 'X-Content-Type-Options': 'nosniff', 'X-Xss-Protection': '1; mode=block', 'Date': 'Fri, 06 Oct 2023 19:22:27 GMT'})
    (Pdb) p list(minio_client.list_objects('root', '/test_multiple_log_files/_delta_log/'))
    []
    (Pdb) p minio_client.get_object(bucket_name='root', object_name='/test_multiple_log_files/_delta_log/00000000000000000001.json').read()
    b'{"commitInfo":{"timestamp":1696618985577,"operation":"WRITE","operationParameters":{"mode":"Overwrite","partitionBy":"[]"},"readVersion":0,"isolationLevel":"Serializable","isBlindAppend":false,"operationMetrics":{"numFiles":"1","numOutputRows":"100","numOutputBytes":"2459"},"engineInfo":"Apache-Spark/3.3.2 Delta-Lake/2.3.0","txnId":"2a69a4c9-f72e-4ac9-9374-bdff96707edf"}}\n{"add":{"path":"part-00000-9ff4728b-d5fe-49ac-a773-e2d6e01f4139-c000.parquet","partitionValues":{},"size":2459,"modificationTime":1696618985310,"dataChange":true,"stats":"{\\"numRecords\\":100,\\"minValues\\":{\\"col-ab7641d2-f0a9-4ffb-ae37-27087d13dfc8\\":0,\\"col-6cbfced4-5921-4e3b-9226-558171c11949\\":\\"1\\"},\\"maxValues\\":{\\"col-ab7641d2-f0a9-4ffb-ae37-27087d13dfc8\\":99,\\"col-6cbfced4-5921-4e3b-9226-558171c11949\\":\\"99\\"},\\"nullCount\\":{\\"col-ab7641d2-f0a9-4ffb-ae37-27087d13dfc8\\":0,\\"col-6cbfced4-5921-4e3b-9226-558171c11949\\":0}}"}}\n{"remove":{"path":"part-00000-7c29f5d9-e14d-419a-a273-58d07775e1e9-c000.parquet","deletionTimestamp":1696618985576,"dataChange":true,"extendedFileMetadata":true,"partitionValues":{},"size":2459}}\n'
    (Pdb) p list(minio_client.list_objects(bucket_name='root', prefix='test_multiple_log_files/', recursive=True))
    [<minio.datatypes.Object object at 0x7ffff1ec2fe0>, <minio.datatypes.Object object at 0x7ffff1ec39d0>, <minio.datatypes.Object object at 0x7ffff1ec2590>, <minio.datatypes.Object object at 0x7ffff1ec3dc0>, <minio.datatypes.Object object at 0x7ffff1ec3a00>, <minio.datatypes.Object object at 0x7ffff1ec3fa0>, <minio.datatypes.Object object at 0x7ffff1ec3f40>, <minio.datatypes.Object object at 0x7ffff1ec2770>]

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-10-08 07:30:13 +02:00
Alexey Milovidov
b38d4b5b0f
Merge pull request #55119 from jmaicher/fix/54318/deadlock-ldap-role-update 
Fix deadlock in LDAP assigned role update
 2023-10-08 00:38:10 +02:00
alesapin
ec69b28386 Black 2023-10-07 21:18:54 +02:00
alesapin
77d96e67d1 Merge branch 'fix_redundant_check' of github.com:ClickHouse/ClickHouse into fix_redundant_check 2023-10-07 21:18:39 +02:00
alesapin
aa130b74e5 Fix offsets bug 2023-10-07 21:18:23 +02:00
robot-clickhouse
041a9c8180 Automatic style fix 2023-10-07 17:27:42 +00:00
alesapin
eec64ba1d9 Fix bug with inability to drop detached partition in replicated merge tree on top of S3 without zero copy 2023-10-07 19:09:47 +02:00
JackyWoo
784fe880eb Merge branch 'master' into lb_nearest_host_name 2023-10-07 09:04:26 +08:00
Arthur Passos
d54186df30 tmp 2023-10-04 17:21:41 -03:00
Arthur Passos
5e158f8a7d fix black 2023-10-04 10:57:38 -03:00
Arthur Passos
c904cd42e4 add back import os 2023-10-04 10:27:28 -03:00
Han Fei
ba878fb43a support rename 2023-10-04 00:58:26 +02:00
Arthur Passos
fec4c392af opsy 2023-10-03 14:22:25 -03:00
Arthur Passos
3412dc89c6 rename setting 2023-10-03 13:53:38 -03:00
Arthur Passos
032a74ec3a make sure instance env variables override global ones 2023-10-03 10:33:55 -03:00
Arthur Passos
9695bf5db9 Revert "rename setting" 
This reverts commit 0b97cd49e8.
 2023-10-02 18:26:31 -03:00
Arthur Passos
0b97cd49e8 rename setting 2023-10-02 18:21:20 -03:00
Arthur Passos
3813e59b49 minor 2023-10-02 18:19:41 -03:00
Arthur Passos
e74e7ae19a more docs 2023-10-02 16:09:35 -03:00
Arthur Passos
23074c2c03 add comment 2023-10-02 16:04:02 -03:00
Arthur Passos
5eda3dfc39 add exclusive_environment_variables option to inte gtests 2023-10-02 15:59:15 -03:00
Alexey Milovidov
9200b121ac
Merge pull request #55189 from ClickHouse/remove-meilisearch 
Remove Meilisearch
 2023-10-01 01:57:04 +03:00
Alexey Milovidov
5ef68f0b36 Fix integration test 2023-09-30 23:03:35 +02:00
Julian Maicher
7db4023928 style: Apply black formatter 2023-09-30 07:04:05 +02:00
Julian Maicher
19f8f365b2 test: Add IT that reproduces deadlock 2023-09-30 07:03:25 +02:00
Alexey Milovidov
180562adfb
Merge pull request #55132 from ClickHouse/fix_deadlock_backups 
Fix deadlock in backups
 2023-09-30 07:20:19 +03:00
Alexey Milovidov
5ebd8ef41d Remove Meilisearch 2023-09-30 06:02:38 +02:00
Alexey Milovidov
d8b5713023 Remove the removal of broken detached parts 2023-09-30 01:47:44 +02:00
alesapin
54c48df486 Fix test 2023-09-29 14:03:58 +02:00
Nikolai Kochetov
8468e90a01
Merge pull request #55105 from ClickHouse/split-compatibility-tests 
Clean data dir and always start an old server version in aggregate functions compatibility test.
 2023-09-29 13:47:14 +02:00
Alexey Milovidov
8f9a227de1
Merge pull request #54931 from yariks5s/s3_style_url 
s3-style URL fix
 2023-09-29 07:12:01 +03:00
Nikolay Degterinsky
6539d52b9e
Merge pull request #50372 from helifu/master3 
Support dynamic adjustment of log level in Keeper
 2023-09-28 23:47:49 +02:00
Sema Checherinda
f73eef9ed8
Merge pull request #54697 from CheSema/s3_retry_cancelation_point 
add cancelation point to s3 retries
 2023-09-28 19:01:09 +02:00
Han Fei
d6c1c0e805 refine tests and support drop columns with statistic 2023-09-28 18:35:18 +02:00
robot-clickhouse
87e434304c Automatic style fix 2023-09-28 15:47:24 +00:00
Nikolai Kochetov
1326d9935f Clean data dir and always start an old server version in aggregate functions compatibility test. 2023-09-28 15:28:26 +00:00
yariks5s
ad94e08b0b made using macroses 2023-09-28 15:17:15 +00:00
Igor Nikonov
6132382044
Merge pull request #54987 from ClickHouse/fix-test-parallel-replicas-over-distributed 
Fix test parallel replicas over distributed
 2023-09-28 14:20:57 +02:00
Vitaly Baranov
22cdc012d1 Add test cases. 2023-09-28 13:02:07 +02:00
Sema Checherinda
013a44db94 style fix 2023-09-28 00:15:14 +02:00
Sema Checherinda
e629a17218 add cancelation point to s3 retries 2023-09-28 00:15:06 +02:00
yariks5s
d94e989391 black check 2023-09-27 20:27:48 +00:00
yariks5s
adf1af63a5 added tests, moved domains to config 2023-09-27 18:53:05 +00:00
robot-clickhouse-ci-1
7a825c1417
Merge pull request #54427 from Avogar/json-object-as-tuple-inference 
Add new features to schema inference for JSON formats
 2023-09-27 20:12:45 +02:00
kssenii
c579f5b321 Fix style check 2023-09-27 20:10:05 +02:00
kssenii
e0ff76a7f9 Fix 2023-09-27 18:44:53 +02:00
Han Fei
76b9d43dc4 make code beautiful 2023-09-27 11:01:53 +02:00
JackyWoo
f3bf1f8da9 Fix code style 2023-09-27 12:56:06 +08:00
JackyWoo
5da03e8ba5 Add load balancing test_hostname_levenshtein_distance 2023-09-27 10:46:39 +08:00
Alexey Milovidov
9518f68683
Merge pull request #54976 from vitlibar/use-pregenerated-grpc-protocol-pb2 
Use pregenerated gRPC protocol pb2 files to fix test flakyness.
 2023-09-26 23:09:34 +03:00
Han Fei
4e7745f757 Merge branch 'master' into hanfei/statistic 2023-09-26 21:43:53 +02:00
Alexey Milovidov
29d3b34dfc
Merge pull request #54090 from ClickHouse/remove-current-status 
Remove CurrentStatusInfo
 2023-09-26 21:38:07 +03:00
Han Fei
8cb9fe0154 refine code 2023-09-26 19:16:01 +02:00
George Gamezardashvili
0ce30ab6d5
SSH keys authentication (#41109) 
Added new type of authentication based on SSH keys. It works only for Native TCP protocol.

Co-authored-by: Nikita Mikhaylov <nikitamikhaylov@clickhouse.com>
Co-authored-by: Robert Schulze <robert@clickhouse.com>
 2023-09-26 17:50:19 +02:00
Vitaly Baranov
d39bd7154f Use pregenerated gRPC protocol pb2 files to fix test flakyness. 2023-09-26 17:28:19 +02:00
Antonio Andelic
e7c8363f6f
Merge pull request #48855 from ClickHouse/keeper-operation-create-if-not-exists 
Implement `createIfNotExists` in Keeper natively
 2023-09-26 16:04:51 +02:00
Kruglov Pavel
bea80ab5b7
Merge branch 'master' into json-object-as-tuple-inference 2023-09-26 15:23:08 +02:00
János Benjamin Antal
6d254aa557 Remove tests 2023-09-26 09:02:12 +00:00
avogar
6dcaa387b1 Fix style 2023-09-25 22:15:41 +00:00
avogar
cabb3ddaae Fix tests 2023-09-25 21:45:11 +00:00
Kruglov Pavel
92de61ca5b Use less attempts 2023-09-25 21:04:12 +02:00
avogar
4fb12f8703 Add retries to rests test_async_query_sending/test_async_connect 2023-09-25 21:04:12 +02:00
kssenii
3b54b6be88 Add system tables 2023-09-25 20:04:15 +02:00
Anton Popov
0ebc22e851
Merge branch 'master' into long-column-names 2023-09-25 16:55:14 +02:00
Igor Nikonov
5a62f4cb99 Merge remote-tracking branch 'origin/master' into fix-test-parallel-replicas-over-distributed 2023-09-25 12:22:35 +00:00
robot-clickhouse
6224a4fcfa Automatic style fix 2023-09-25 12:21:14 +00:00
Igor Nikonov
9a788c3cac Fix: sync replicas to get consisten result 2023-09-25 12:21:12 +00:00
Smita Kulkarni
b142756c5d Added fixture to delete all files 2023-09-25 14:08:05 +02:00
kssenii
e4256eb268 Better 2023-09-25 13:44:45 +02:00
kssenii
47050c2605 Merge remote-tracking branch 'upstream/master' into s3-queue-fixes 2023-09-25 13:42:52 +02:00
alesapin
75b2f90923
Merge pull request #54772 from Avogar/less-flaky-async-tests 
Add retries to rests test_async_query_sending/test_async_connect
 2023-09-25 12:05:11 +02:00
Smita Kulkarni
fab4594ccb Merge branch 'master' into Fix_azure_test_by_using_unique_names 2023-09-25 10:35:29 +02:00
Alexey Milovidov
580f3c1a01 Merge branch 'master' into remove-current-status 2023-09-24 20:56:17 +02:00
Alexey Milovidov
664ac27cf2
Merge pull request #54507 from ClickHouse/flush-logs-for-system-backup-logs-test 
Flush logs for system.backup_log test.
 2023-09-23 22:33:21 +03:00
Alexander Tokmakov
21ffbd88de
Merge pull request #54859 from ClickHouse/fix_zero_copy_locks 
Fix zero copy locks with hardlinks
 2023-09-22 18:27:03 +02:00
Antonio Andelic
176baa6695 Merge branch 'master' into keeper-operation-create-if-not-exists 2023-09-22 13:47:30 +00:00
Vitaly Baranov
3a2ca1f69c
Merge pull request #51261 from evillique/users-valid-until 
Add VALID UNTIL clause for users
 2023-09-22 12:38:30 +02:00
Antonio Andelic
316f42def6
Merge pull request #54745 from ClickHouse/keeper-reduce-batch-size 
Revert default batch size for Keeper
 2023-09-21 17:44:33 +02:00
Pavel Novitskiy
853e3f0aa7
Add drop table IF EMPTY (#48915) 2023-09-21 09:20:18 -04:00
Antonio Andelic
13815a96bf
Fix test 2023-09-21 09:07:40 +02:00
Alexander Tokmakov
ec80068611 add a test for no such key 2023-09-20 22:37:24 +02:00
Nikolai Kochetov
2dc2b2050e
Update test.py 2023-09-20 17:16:50 +02:00
Antonio Andelic
b65b1ee97b Merge branch 'master' into keeper-operation-create-if-not-exists 2023-09-20 13:56:36 +00:00
Alexey Milovidov
d31a6f253e
Merge pull request #54816 from azat/tests/fix-test_backup_restore_on_cluster 
Fix test_backup_restore_on_cluster/test.py::test_stop_other_host_during_backup flakiness
 2023-09-20 13:30:19 +03:00
alesapin
2ff36b6e0c
Merge pull request #54768 from ClickHouse/better_exception_in_check_data_part 
Better exception message in checkDataPart
 2023-09-20 12:04:46 +02:00
Azat Khuzhin
56dca144cc Fix test_backup_restore_on_cluster/test.py::test_stop_other_host_during_backup flakiness 
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-09-20 07:09:51 +02:00
alesapin
accbe24e08 Fix test 2023-09-19 18:42:46 +02:00
Kruglov Pavel
a02b6d03d7
Use less attempts 2023-09-19 13:32:49 +02:00
Anton Popov
624782bd8f Merge remote-tracking branch 'upstream/master' into HEAD 2023-09-18 23:13:20 +00:00