thevar1able/ClickHouse
1
0
Fork 0
mirror of https://github.com/ClickHouse/ClickHouse.git synced 2024-12-15 19:02:04 +00:00
Code Issues Packages Projects Releases Wiki Activity
153,219 Commits 9,326 Branches 1,783 Tags 2.1 GiB
2dd9d31d8f
Commit Graph

10510 Commits

Author SHA1 Message Date
Robert Schulze
8dec996686
Fix non-deterministic result order in test_storage_mysql.test_mysql_distributed 2024-08-14 09:50:19 +00:00
Marco Vilas Boas
0a1f61fcbd
Merge branch 'ClickHouse:master' into marco-vb/x509-san-support-wildcard 2024-08-14 10:15:30 +01:00
Alexey Milovidov
b2b0f9e661 Merge branch 'master' into fix-test-throttling 2024-08-14 04:55:51 +02:00
Alexey Milovidov
393b16bd8e Merge branch 'master' into fix-trash-in-aws-s3 2024-08-14 04:55:05 +02:00
avogar
f82822c993 Merge branch 'master' of github.com:ClickHouse/ClickHouse into json-data-type 2024-08-13 17:14:30 +00:00
Daniil Ivanik
f9f41405cc
Merge branch 'master' into divanik/add_local_and_azure_iceberg_support 2024-08-13 18:24:02 +02:00
Igor Nikonov
5339717c11 Merge remote-tracking branch 'origin/master' into pr-local-plan 2024-08-13 16:16:31 +00:00
Nikita Taranov
dd3fa7c3b6
Merge pull request #61793 from nickitat/keep_alive_max_reqs 
Implement `max_keep_alive_requests` setting for server
 2024-08-13 15:06:43 +00:00
divanik
be92986eda Possibly fix broken tests and build 2024-08-13 14:48:54 +00:00
Igor Nikonov
e42b58082b Merge remote-tracking branch 'origin/master' into pr-local-plan 2024-08-13 14:30:33 +00:00
Yarik Briukhovetskyi
086c0f03a6
Merge pull request #65997 from yariks5s/hive_style_partitioning 
Implementing Hive-style partitioning
 2024-08-13 10:04:21 +00:00
Yakov Olkhovskiy
93a922f169 merge master 2024-08-13 03:28:25 +00:00
Alexey Milovidov
995b29cb07 Merge branch 'master' of github.com:ClickHouse/ClickHouse into more-strict-tryparse 2024-08-13 02:38:40 +02:00
Alexey Milovidov
85344d27f1 Merge branch 'master' of github.com:ClickHouse/ClickHouse into fix-test-throttling 2024-08-13 02:08:43 +02:00
Alexey Milovidov
aa38315673 Merge branch 'master' of github.com:ClickHouse/ClickHouse into fix-trash-in-aws-s3 2024-08-12 23:54:45 +02:00
Alexey Milovidov
203857020f
Merge pull request #68178 from ClickHouse/fix-68177 
Fix `test_cluster_all_replicas`
 2024-08-12 21:52:13 +00:00
Kruglov Pavel
01b2e67f2e
Merge branch 'master' into json-data-type 2024-08-12 23:32:35 +02:00
János Benjamin Antal
ac6826392d
Merge pull request #67554 from ClickHouse/fix-message-queue-sink-from-http-interface 
Fix message queue sink from http interface
 2024-08-12 21:29:14 +00:00
János Benjamin Antal
eaa5715a02
Merge pull request #68200 from ClickHouse/remove-log-engine-from-kafka-integration-tests 
Remove Log engine from Kafka integration tests
 2024-08-12 20:44:53 +00:00
Alexey Milovidov
74fb08198c Merge branch 'master' into fix-68177 2024-08-12 18:39:06 +02:00
Alexey Milovidov
58ed71bf11
Merge pull request #68181 from ClickHouse/fix-leftovers 
Fix leftovers
 2024-08-12 16:22:17 +00:00
avogar
cfd854882b Merge branch 'master' of github.com:ClickHouse/ClickHouse into json-data-type 2024-08-12 15:57:57 +00:00
marco-vb
2068fbb157 Added support for single wildcard usage in x509 SubjectAltName user identification (both DNS and URI). 2024-08-12 15:39:52 +00:00
János Benjamin Antal
897b8d5a88 Try to give more chances to node2 to steal some work 2024-08-12 15:21:01 +00:00
divanik
58dd01d8b6 Add docs 2024-08-12 13:45:00 +00:00
Nikita Taranov
633b15d7a4 Merge branch 'master' into cpu_cgroup_aware 2024-08-12 14:18:36 +01:00
divanik
411e8f7cfb Remove unnecessary changes 2024-08-12 12:44:22 +00:00
divanik
0810703d6b Roll out strange changes 2024-08-12 12:38:38 +00:00
divanik
bbf1008886 Fix test 2024-08-12 12:15:54 +00:00
avogar
9296d4ecfb Merge branch 'master' of github.com:ClickHouse/ClickHouse into json-data-type 2024-08-12 11:55:39 +00:00
János Benjamin Antal
737948470d Fix syntax 2024-08-12 11:54:34 +00:00
Sema Checherinda
5e836bc20e
Merge pull request #67472 from ClickHouse/chesema-02765 
speed up system flush logs
 2024-08-12 11:51:55 +00:00
János Benjamin Antal
8f124710ef Remove Log engine from Kafka integration tests 
It doesn't work well when `thread_per_consumer` is used as writer can make readers starve when `shared_time_mutex` prefers writes over reads.
 2024-08-12 10:27:21 +00:00
Yarik Briukhovetskyi
8bc89ac8df
Merge branch 'master' into hive_style_partitioning 2024-08-12 11:44:45 +02:00
divanik
52de06514a Merge branch 'master' of github.com:ClickHouse/ClickHouse into divanik/add_local_and_azure_iceberg_support 2024-08-12 09:14:39 +00:00
Alexey Milovidov
6f189e9eb7 Fix leftovers 2024-08-12 07:17:17 +02:00
Alexey Milovidov
b3504def35 Fix leftovers 2024-08-12 07:15:08 +02:00
Alexey Milovidov
20b97a45bf Fix fundamentally broken test CC @azat 2024-08-12 07:09:42 +02:00
Alexey Milovidov
5acf9f6f81 Fix test_cluster_all_replicas 2024-08-12 07:01:52 +02:00
Alexey Milovidov
c2cb8e6c7d Merge branch 'master' of github.com:ClickHouse/ClickHouse into fix-trash-in-aws-s3 2024-08-12 01:04:17 +02:00
Igor Nikonov
d04db7e26d Merge remote-tracking branch 'origin/master' into pr-local-plan 2024-08-11 20:11:32 +00:00
Alexander Tokmakov
7de1c4bfc3
Merge pull request #68051 from ClickHouse/tavplubix-patch-10 
Update test_drop_is_lock_free/test.py
 2024-08-11 11:21:38 +00:00
János Benjamin Antal
79a964bfff Merge remote-tracking branch 'origin/master' into fix-message-queue-sink-from-http-interface 2024-08-10 21:53:57 +00:00
János Benjamin Antal
556f669878 Separate test into separate file to pass bugfix check 2024-08-10 21:53:22 +00:00
alesapin
c945209427
Merge pull request #68003 from ClickHouse/ignore_broken_projections_on_start 
Ignore disappeared projections on start
 2024-08-10 19:34:40 +00:00
Alexey Milovidov
dfedcae505 Merge branch 'master' of github.com:ClickHouse/ClickHouse into fix-trash-in-aws-s3 2024-08-10 19:52:21 +02:00
Alexey Milovidov
e7215d1029
Merge pull request #67959 from jkartseva/fix-flaky-test-storage-s3-queue 
Fix flaky `test_storage_s3_queue/test.py::test_multiple_tables_streaming_sync_distributed`
 2024-08-10 00:12:09 +00:00
Alexey Milovidov
b8508b3688 Merge branch 'master' of github.com:ClickHouse/ClickHouse into fix-trash-in-aws-s3 2024-08-09 21:43:40 +02:00
Alexey Milovidov
0ccac1e7ff Merge branch 'master' into more-strict-tryparse 2024-08-09 20:22:37 +02:00
Sema Checherinda
99b9db9ba7 Merge branch 'master' into chesema-02765 2024-08-09 19:54:44 +02:00
Yarik Briukhovetskyi
701c787eea
Merge branch 'ClickHouse:master' into hive_style_partitioning 2024-08-09 17:53:49 +02:00
kruglov
97eded0ac7 Fixed test_dependent_loading. event_time_microseconds has two dates connected with "\n" 2024-08-09 18:29:31 +03:00
Alexey Milovidov
9d91b600ca Add a test 2024-08-09 16:27:35 +02:00
Alexey Milovidov
9a6d98cd20 Update test 2024-08-09 16:15:28 +02:00
Antonio Andelic
0d38aa98ce Merge branch 'master' into read-cgroup-memory-usage-async-metrics 2024-08-09 15:44:47 +02:00
János Benjamin Antal
21be195dd8 Revert unnecessary change 2024-08-09 13:14:09 +00:00
János Benjamin Antal
2900c7006e Merge remote-tracking branch 'origin/master' into fix-message-queue-sink-from-http-interface 2024-08-09 13:06:58 +00:00
Sema Checherinda
1e67b46b57
Merge pull request #67684 from ClickHouse/chesema-rewrite-storage-policy 
rework usage of custom table's disks
 2024-08-09 12:36:29 +00:00
Nikita Taranov
ffa1371dde Merge branch 'master' into keep_alive_max_reqs 2024-08-09 12:24:45 +01:00
Yarik Briukhovetskyi
aebb07884b
Merge branch 'master' into hive_style_partitioning 2024-08-09 11:53:14 +02:00
divanik
b67b7a62a4 Merge branches 'divanik/add_local_and_azure_iceberg_support' and 'master' of github.com:ClickHouse/ClickHouse into divanik/add_local_and_azure_iceberg_support 2024-08-09 09:40:32 +00:00
alesapin
bc20b637ea Add missing file 2024-08-08 21:47:23 +02:00
Miсhael Stetsyuk
ef294f0dab
Merge pull request #67913 from ClickHouse/add-replication-lag-and-recovery-time-metrics-resubmit 
[resubmit] add replication lag and recovery time metrics
 2024-08-08 16:37:30 +00:00
Yarik Briukhovetskyi
a5fcf85fb6
Merge branch 'master' into hive_style_partitioning 2024-08-08 17:54:53 +02:00
Alexander Tokmakov
33ba78ee42
Update test.py 2024-08-08 17:47:12 +02:00
János Benjamin Antal
c9adfe246b
Merge pull request #57625 from ClickHouse/kafka-zookeeper 
Kafka ZooKeeper
 2024-08-08 14:02:27 +00:00
kruglov
cab274e1b6 Fixed error on generated columns in MaterializedPostgreSQL 2024-08-08 16:50:53 +03:00
Yarik Briukhovetskyi
edccd30016
Merge branch 'ClickHouse:master' into hive_style_partitioning 2024-08-08 14:52:33 +02:00
Nikita Mikhaylov
4c289aa2dc
Merge pull request #64183 from vitlibar/ts-engine 
Add new TimeSeries table engine to handle Prometheus protocols
 2024-08-08 12:03:12 +00:00
Ilya Yatsishin
f21a48dac6
Merge pull request #67064 from zvonand/hdfs-double-asterisk 
Add `**` to `hdfs` docs, add test for `**` in `hdfs`
 2024-08-08 11:12:55 +00:00
Sema Checherinda
0939e7f922 Merge branch 'master' into chesema-02765 2024-08-08 12:57:04 +02:00
Sema Checherinda
69ac203c9f fix tests 2024-08-08 12:56:33 +02:00
Yarik Briukhovetskyi
6384488826
Merge branch 'ClickHouse:master' into hive_style_partitioning 2024-08-08 11:45:01 +02:00
János Benjamin Antal
92be2db5b6 Merge remote-tracking branch 'origin/master' into kafka-zookeeper 2024-08-08 08:01:43 +00:00
Andrey Zvonov
29d701aea7
Forgot to drop table in test 2024-08-08 10:51:57 +03:00
Julia Kartseva
d6ecabb41d Fix flaky test_storage_s3_queue/test.py::test_multiple_tables_streaming_sync_distributed 
Disable parallel processing for the Ordered mode for the
test_storage_s3_queue/test.py::test_multiple_tables_streaming_sync_distributed
test.

The reason for this is that the load between the processing nodes is
too uneven when s3queue_processing_threads_num != 1,
e.g.:

```
$ grep res1 pytest.log
2024-08-07 07:15:58 [ 575 ] DEBUG : res1 size: 13300, res2 size: 1700, total_rows: 15000 (test.py:813, test_multiple_tables_streaming_sync_distributed)
```

In CIs environment, there are rare cases when one of the processors handles all the workload,
while the other is busy-waiting, and the test fails on assert:

When s3queue_processing_threads_num == 1, the workload is evenly
distributed:

```
$ grep res1 pytest.log
2024-08-07 07:26:52 [ 586 ] DEBUG : res1 size: 7200, res2 size: 7800, total_rows: 15000 (test.py:813, test_multiple_tables_streaming_sync_distributed)
```

This change only fixes test flakiness. Further investigation of the Order
mode parallelism is required.
 2024-08-08 06:13:36 +00:00
Alexey Milovidov
ae6139e66c
Merge pull request #68007 from ClickHouse/qoega-patch-7 
Follow up for #67843
 2024-08-08 01:38:54 +00:00
Yarik Briukhovetskyi
9e3a2931d2
Merge branch 'master' into hive_style_partitioning 2024-08-07 23:59:34 +02:00
Yarik Briukhovetskyi
c6c0a44b93
fix flaky tests 2024-08-07 23:57:19 +02:00
Nikita Fomichev
755b06b455
Merge pull request #67793 from ClickHouse/flaky-test_reload_after_fail_by_timer 
Integration tests: fix flaky `test_dictionaries_update_and_reload::test_reload_after_fail_by_timer`
 2024-08-07 21:36:54 +00:00
Nikita Mikhaylov
f37e0c7fc6 Merge branch 'master' of github.com:ClickHouse/ClickHouse into ts-engine 2024-08-07 21:01:13 +00:00
Nikita Mikhaylov
b2722d8832 Disallow LowCardinality type for external tables 2024-08-07 20:54:40 +00:00
Alexey Milovidov
8b3e85dd8d
Merge pull request #67785 from arenadata/ADQM-FixedTestRaceCondition 
Fixed session_log related tests race condition on logout
 2024-08-07 20:01:48 +00:00
Nikita Taranov
1082792950 fix test 2024-08-07 20:21:50 +01:00
Andrey Zvonov
c6482a092b
Merge branch 'master' into hdfs-double-asterisk 2024-08-07 21:42:00 +03:00
Ilya Yatsishin
7341dcefd4
Follow up for #67843 2024-08-07 20:36:23 +02:00
Ilya Yatsishin
ac4bed2f42
Merge pull request #67843 from qoega/improve-integration-tests-3 
Improve integration tests 3
 2024-08-07 18:06:37 +00:00
robot-clickhouse
94398996b2 Automatic style fix 2024-08-07 17:47:22 +00:00
János Benjamin Antal
d992431f96 Make tests more sturdier for flaky test check 2024-08-07 17:27:24 +00:00
Sema Checherinda
06d154055f adjust tests 2024-08-07 19:19:33 +02:00
divanik
f5e993df2a Add tests 2024-08-07 16:46:33 +00:00
alesapin
ad678cb5a8 Ignore disappeared projections on start 2024-08-07 18:24:03 +02:00
János Benjamin Antal
b3c30b05d6 Make test_kafka_insert repeatable 2024-08-07 13:22:22 +00:00
János Benjamin Antal
139fe624c2 Fix typos 2024-08-07 13:16:47 +00:00
Nikita Taranov
49871bacc1 fix test 2024-08-07 12:37:39 +01:00
János Benjamin Antal
8b5c8e5361 Merge remote-tracking branch 'origin/master' into kafka-zookeeper 2024-08-07 11:33:21 +00:00
iceFireser
3a89b7034f modify integration test 2024-08-07 19:16:22 +08:00
divanik
299af052f8 Merge branch 'master' of github.com:ClickHouse/ClickHouse into divanik/add_local_and_azure_iceberg_support 2024-08-07 11:13:53 +00:00
Sema Checherinda
272941021f
Merge pull request #66279 from ClickHouse/chesema-processor-onCancel 
merge tree sink cancel delayed_chunk
 2024-08-07 11:12:22 +00:00
robot-clickhouse
b9f564f6f4 Automatic style fix 2024-08-07 11:12:21 +00:00
Ilya Yatsishin
47111eb5af
Merge pull request #67511 from ClickHouse/revert-67507-revert-66536-external-replace-to-null 
Revert "Revert "Add settings to replace external engines to Null during create""
 2024-08-07 10:38:04 +00:00
Sema Checherinda
633f700df6 adjust tests 2024-08-07 12:23:23 +02:00
robot-clickhouse
00efd5fc0d Automatic style fix 2024-08-07 12:21:41 +02:00
Sema Checherinda
86267418f9 fix tests, rework recreation tables conditions, add log about ignored logs 2024-08-07 12:21:41 +02:00
iceFireser
7d42101593 Re-trigger ci 2024-08-07 14:19:40 +08:00
pufit
3b642e7f91
Merge pull request #66364 from azat/cluster-inter-server-secret-fix 
Fix cluster() for inter-server secret (preserve initial user as before)
 2024-08-07 04:58:12 +00:00
max-vostrikov
0aed98f3f0
Merge pull request #67596 from ClickHouse/test_parquet_page_index 
added tests for page index in parquet files
 2024-08-07 00:15:07 +00:00
Alexey Gerasimchuck
a43ed76ae8 Fixed session log parallel/sequenced test work within a single fixture 2024-08-06 22:20:12 +00:00
Nikita Taranov
f54083a1d8
Merge branch 'master' into cpu_cgroup_aware 2024-08-06 23:13:40 +02:00
Nikita Taranov
053285dc1c Merge branch 'master' into keep_alive_max_reqs 2024-08-06 20:55:48 +01:00
Ilya Yatsishin
881d57a764
Merge branch 'master' into revert-67507-revert-66536-external-replace-to-null 2024-08-06 21:04:17 +02:00
Yatsishin Ilya
8cfcf341ae fix 2024-08-06 18:26:52 +00:00
MikhailBurdukov
012ea3cc6d Rebase 2024-08-06 15:32:04 +00:00
MikhailBurdukov
4143eea587 Add test to skip parallel 2024-08-06 15:21:50 +00:00
MikhailBurdukov
3ebc3852f4 Allow filtering ip addresses by ip family in DNS resolver 2024-08-06 15:21:49 +00:00
Michael Stetsyuk
df2675fad0 [resubmit] add replication lag and recovery time metrics 2024-08-06 15:06:02 +00:00
Azat Khuzhin
bdfaffa9d7 tests: make test_distributed_inter_server_secret idempotent 
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2024-08-06 16:59:23 +02:00
Sema Checherinda
0eb6a41f57 Merge branch 'master' into chesema-processor-onCancel 2024-08-06 16:36:28 +02:00
divanik
c4e29466de qMerge branch 'master' of github.com:ClickHouse/ClickHouse into divanik/add_local_and_azure_iceberg_support 2024-08-06 11:59:47 +00:00
Andrey Zvonov
7d45424d31 specify files in test: 2024-08-06 11:18:47 +00:00
Andrey Zvonov
97f1cfc232 add ** glob to hdfs docs 2024-08-06 11:18:47 +00:00
Nikita Mikhaylov
80d2686013 Merge branch 'master' of github.com:ClickHouse/ClickHouse into ts-engine 2024-08-06 13:12:03 +02:00
Yarik Briukhovetskyi
27cdbb54d7
fix black 2024-08-06 13:10:03 +02:00
Nikita Mikhaylov
4e2b6a5e49 Fix docs and a test 2024-08-06 13:06:34 +02:00
Sema Checherinda
995187006a rework custom table's disk usage 2024-08-06 13:05:23 +02:00
Yarik Briukhovetskyi
aa3d8086c3
fix integration tests 2024-08-06 12:30:39 +02:00
Nikita Mikhaylov
b4a6f249ab
Merge pull request #66438 from ClickHouse/analyzer-beta 
Analyzer is finally Beta
 2024-08-06 09:39:29 +00:00
Nikita Mikhaylov
4829ba31d3 Actually fix a test 2024-08-05 21:18:53 +00:00
Azat Khuzhin
0dccc34a20 Fix cluster() for inter-server secret (preserve initial user as before) 
The behaviour of cluster() with inter-server secret had been changed in #63013,
after it started to use "default" user, and this introduces a
regression.

The intention of that patch was to adjust only remote(), since it only
it accept custom user, which should be ignored.

Fixes: https://github.com/ClickHouse/ClickHouse/issues/66287
Fixes: https://github.com/ClickHouse/ClickHouse/issues/66352
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2024-08-05 20:24:24 +02:00
Azat Khuzhin
9d7710684b tests/test_distributed_inter_server_secret: get_query_user_info return list 
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2024-08-05 20:24:24 +02:00
divanik
9e85f89e95 Merge branch 'master' of github.com:ClickHouse/ClickHouse into divanik/add_local_and_azure_iceberg_support 2024-08-05 16:15:28 +00:00
Nikita Mikhaylov
6f025090eb Merge branch 'master' of github.com:ClickHouse/ClickHouse into ts-engine 2024-08-05 17:46:14 +02:00
Nikita Mikhaylov
2c78122717
Merge pull request #67667 from zvonand/fix-ldap-entrypoint-2 
Even better healthcheck for ldap
 2024-08-05 15:31:59 +00:00
Nikita Mikhaylov
330aae9517 Even better test 2024-08-05 15:29:15 +00:00
Nikita Mikhaylov
0301af99e5 Fixed a bunch of tests 2024-08-05 15:29:15 +00:00
Nikita Mikhaylov
4e9c3baa25 Move analyzer to Beta stage 2024-08-05 15:29:14 +00:00
Yarik Briukhovetskyi
d080f863ea
fix black 2024-08-05 17:07:17 +02:00
Yarik Briukhovetskyi
9b06753bb7
Merge branch 'master' into hive_style_partitioning 2024-08-05 17:02:27 +02:00
Yatsishin Ilya
3e633ad0d0 more changes 2024-08-05 14:43:28 +00:00
robot-clickhouse
5d9d5bf919 Automatic style fix 2024-08-05 16:34:55 +02:00
Sema Checherinda
462fe8b7ff repro for #67478 2024-08-05 16:34:55 +02:00
János Benjamin Antal
7551c2602b
Merge pull request #67566 from ClickHouse/fix-flaky-test_system_kafka_consumers_rebalance 
Fix flaky `test_system_kafka_consumers_rebalance`
 2024-08-05 13:01:46 +00:00
Alexey Milovidov
f1a096e8f6
Merge pull request #67723 from ClickHouse/fix-log-and-exception-messages-formatting 
Fix test `00002_log_and_exception_messages_formatting`
 2024-08-05 12:34:33 +00:00
János Benjamin Antal
8f6476adb7 Merge remote-tracking branch 'origin/master' into kafka-zookeeper 2024-08-05 12:26:00 +00:00
Alexey Milovidov
243eb515d6
Merge pull request #66671 from azat/mongodb-uuid-type 
Support true UUID type for MongoDB engine
 2024-08-05 12:25:17 +00:00
János Benjamin Antal
0da44ad047
Merge pull request #67394 from ClickHouse/add-debug-to-s3-queue-shards-distributed 
Print debug info in `test_storage_s3_queue/test.py::test_shards_distributed`
 2024-08-05 12:23:40 +00:00
Yarik Briukhovetskyi
fd1e354e85
fix flaky check for integration tests 2024-08-05 13:43:06 +02:00
maxvostrikov
e0362b00f5 squash! fix for parallel execution 2024-08-05 11:52:07 +02:00
Nikita Fomichev
bd6c7a504d Integration tests: fix flaky test_dictionaries_update_and_reload::test_reload_after_fail_by_timer 2024-08-05 11:45:49 +02:00
János Benjamin Antal
230b5150c2 Merge remote-tracking branch 'origin/master' into fix-message-queue-sink-from-http-interface 2024-08-05 09:14:13 +00:00
János Benjamin Antal
f816158dbc Address review comments 2024-08-05 09:11:55 +00:00
János Benjamin Antal
517bb64636 Merge remote-tracking branch 'origin/master' into fix-flaky-test_system_kafka_consumers_rebalance 2024-08-05 09:04:37 +00:00
Nikita Fomichev
29f1d9df36 Integration tests: fix flaky test_dictionaries_update_and_reload::test_reload_after_fail_by_timer 2024-08-05 10:03:49 +02:00
Alexey Gerasimchuck
e5134e14ea Disabled parallel run 2024-08-05 07:59:51 +00:00
Alexey Gerasimchuck
6897178c41 fixed typo 2024-08-04 22:29:03 +00:00
Alexey Gerasimchuck
b2ec479cee Fixed race condition in session log tests 2024-08-04 22:23:08 +00:00
Alexey Milovidov
4504326b2a Merge branch 'no-flaky-check' into fix-log-and-exception-messages-formatting 2024-08-05 00:03:25 +02:00
Alexey Milovidov
a449ffe6fc Merge branch 'master' into fix-test_delayed_replica_failover 2024-08-04 22:58:18 +02:00
Azat Khuzhin
a49924b383 tests: avoid leaving leftovers after test_storage_mongodb (fixes flaky chec) 
CI: https://s3.amazonaws.com/clickhouse-test-reports/66671/2f00c962711e13ca00af324366421fe4593b4ce6/integration_tests_flaky_check__asan_.html
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2024-08-04 22:01:08 +02:00
Alexey Milovidov
6f9d78d873
Merge pull request #67743 from azat/tests/test_storage_rabbitmq 
Try to fix RabbitMQ test failures
 2024-08-04 19:26:23 +02:00
Nikita Fomichev
c4a0e7665c
Merge pull request #67747 from azat/tests/test_ttl_move 
Fix test_ttl_move::test_alter_with_merge_work flakiness
 2024-08-04 16:47:24 +00:00
Alexey Milovidov
6fd4552fad Merge branch 'master' into fix-log-and-exception-messages-formatting 2024-08-04 18:08:28 +02:00
Alexey Milovidov
fbd3e122e1
Merge pull request #67512 from ClickHouse/divanik/fix_retry_integration_tests_decorator 
[Green CI] Test `test_storage_azure_blob_storage/test.py` is flaky
 2024-08-04 15:46:55 +00:00
Azat Khuzhin
062490e1b4 tests: fix test_ttl_move::test_alter_with_merge_work flakiness 
Increase timeout for TTL DELETE, since otherwise if other routines will
take too long, the part will be removed when it should be still be on
"external" disk:

    2024.08.04 03:48:53.803032 [ 622 ] {} <Information> default.mt_test_alter_with_merge_work_1722743323 (9dc6904a-f082-4f06-be7a-efe4733e811c): Will drop empty part all_1_3_4_4

And this is how part_log looks like:

    SELECT
        event_time,
        event_type,
        rows,
        part_name,
        error,
        database,
        disk_name
    FROM system.part_log
    WHERE `table` = 'mt_test_alter_with_merge_work_1722743323'
    ORDER BY event_time ASC

    Query id: a118b3cd-e4fe-45a5-b675-d73bdd887d79

        ┌──────────event_time─┬─event_type─┬─rows─┬─part_name───┬─error─┬─database─┬─disk_name─┐
     1. │ 2024-08-04 03:48:44 │ NewPart    │    2 │ all_1_1_0   │     0 │ default  │ jbod1     │
     2. │ 2024-08-04 03:48:44 │ NewPart    │    2 │ all_2_2_0   │     0 │ default  │ jbod2     │
     3. │ 2024-08-04 03:48:45 │ NewPart    │    2 │ all_3_3_0   │     0 │ default  │ jbod1     │
     4. │ 2024-08-04 03:48:46 │ MutatePart │    2 │ all_1_1_0_4 │     0 │ default  │ jbod1     │
     5. │ 2024-08-04 03:48:46 │ MutatePart │    2 │ all_2_2_0_4 │     0 │ default  │ jbod2     │
     6. │ 2024-08-04 03:48:46 │ MutatePart │    2 │ all_3_3_0_4 │     0 │ default  │ jbod1     │
     7. │ 2024-08-04 03:48:47 │ MovePart   │    2 │ all_1_1_0_4 │     0 │ default  │ external  │
     8. │ 2024-08-04 03:48:47 │ MovePart   │    2 │ all_3_3_0_4 │     0 │ default  │ jbod2     │
     9. │ 2024-08-04 03:48:47 │ MergeParts │    6 │ all_1_3_1_4 │     0 │ default  │ jbod2     │
    10. │ 2024-08-04 03:48:48 │ MovePart   │    6 │ all_1_3_1_4 │     0 │ default  │ external  │
    11. │ 2024-08-04 03:48:52 │ MergeParts │    4 │ all_1_3_2_4 │     0 │ default  │ external  │
    12. │ 2024-08-04 03:48:53 │ MergeParts │    0 │ all_1_3_3_4 │     0 │ default  │ external  │ # rows==0
    13. │ 2024-08-04 03:48:53 │ MergeParts │    0 │ all_1_3_4_4 │     0 │ default  │ external  │
        └─────────────────────┴────────────┴──────┴─────────────┴───────┴──────────┴───────────┘

CI: https://s3.amazonaws.com/clickhouse-test-reports/66671/2f00c962711e13ca00af324366421fe4593b4ce6/integration_tests__tsan__[5_6].html
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2024-08-04 14:25:18 +02:00
Azat Khuzhin
47dbc5e05b tests: add debug info into test_ttl_move::test_alter_with_merge_work 
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2024-08-04 14:16:40 +02:00
Azat Khuzhin
f0aaac3bd1 tests: remove useless retries from test_ttl_move::test_alter_with_merge_work 
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2024-08-04 14:14:42 +02:00
Azat Khuzhin
dc527b6fd1 tests: detailed errors for RabbitMQ startup 
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2024-08-04 09:07:05 +02:00
Azat Khuzhin
264be9c598 tests: increase timeout for RabbitMQ startup 
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2024-08-04 09:06:50 +02:00
Azat Khuzhin
59e5a09b49 Use RabbitMQ without management in tests (attempt to improve startup) 
Sometimes startup can take ~90 seconds [1]:

    2024-08-03 23:11:38.756067+00:00 [info] <0.9.0> Time to start RabbitMQ: 94651980 us

Unlike normally ~10 [2]:

    2024-08-04 00:33:07.016137+00:00 [info] <0.9.0> Time to start RabbitMQ: 10082489 us

  [1]: https://s3.amazonaws.com/clickhouse-test-reports/67737/b4e3bbcb82158bea4f5db1d9f5c28cfb741d1d51/integration_tests__asan__old_analyzer__[4_6].html
  [2]: https://s3.amazonaws.com/clickhouse-test-reports/66671/2f00c962711e13ca00af324366421fe4593b4ce6/integration_tests__asan__old_analyzer__[4_6].html

I've tried locally, the difference is very small, 3135665 us
(+management) vs (2740747 us), but still something, and who knows how it
works under pressure.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2024-08-04 09:04:41 +02:00
Alexey Milovidov
6a20f777f6
Merge pull request #67428 from ClickHouse/enable-text-log 
Enable `text_log` by default
 2024-08-03 23:02:40 +00:00
Alexey Milovidov
a051eb2a5d Fix tests 2024-08-04 00:24:17 +02:00
Azat Khuzhin
2f00c96271 Support true UUID type for MongoDB engine 
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2024-08-03 23:51:41 +02:00
Alexey Milovidov
60648e5240
Revert "Add replication lag and recovery time metrics" 2024-08-03 18:41:17 +02:00
Vitaly Baranov
bd22140fa4 Add test. 2024-08-03 16:20:23 +02:00
divanik
fb2f15c3b5 Merge branch 'master' of github.com:ClickHouse/ClickHouse into divanik/fix_retry_integration_tests_decorator 2024-08-03 13:59:48 +00:00
Miсhael Stetsyuk
14fce8b8da
Merge pull request #66704 from ClickHouse/add-S3DiskNoKeyErrors-metric 
Add S3DiskNoKeyErrors metric
 2024-08-03 12:44:33 +00:00
Antonio Andelic
1b20d47202
Merge pull request #67665 from ClickHouse/fix-udf-reload 
Fix reloading SQL UDFs with UNION
 2024-08-03 08:05:12 +00:00
Alexey Milovidov
74adf3d3fc Merge branch 'master' into enable-text-log 2024-08-03 02:33:37 +02:00
Alexey Milovidov
7af5340e6e
Merge pull request #67362 from ClickHouse/vdimir/test_cache_evicted_by_temporary_data 
Trying to fix test_cache_evicted_by_temporary_data and print debug info
 2024-08-03 00:31:09 +00:00
Alexey Milovidov
94f8855f6e
Merge pull request #67597 from ClickHouse/kssenii-patch-12 
Update check_rabbitmq_is_available
 2024-08-03 00:30:31 +00:00
Alexey Milovidov
dbb059912d
Merge pull request #67672 from ClickHouse/integration-tests-fix-ports 
Integration tests: fix ports clashing problem
 2024-08-03 00:29:58 +00:00
Antonio Andelic
10e28236b9 Merge branch 'master' into fix-udf-reload 2024-08-02 21:31:32 +02:00
Alexey Milovidov
743bd5fd6d Merge branch 'master' into enable-text-log 2024-08-02 17:49:04 +02:00
Miсhael Stetsyuk
f1df59d6c9
Merge pull request #66703 from ClickHouse/add-replication-lag-and-recovery-time-metrics 
Add replication lag and recovery time metrics
 2024-08-02 15:21:43 +00:00
Nikita Fomichev
1fd9464947
Merge pull request #67454 from ClickHouse/24.7-testing-and-docs 
24.7 add missing documentation and testing
 2024-08-02 15:00:47 +00:00
Nikita Fomichev
664e131f4f Integration tests: fix ports clashing problem 4 2024-08-02 16:09:48 +02:00
Antonio Andelic
c2dd62256a
Merge pull request #67658 from ClickHouse/fix-flaky-test_replicated_table_attach 
Fix flaky `test_replicated_table_attach`
 2024-08-02 13:54:19 +00:00
alesapin
a930c768c3
Merge pull request #67449 from ClickHouse/divanik/add_docs_about_docker_runner_image_relaunch 
[Docs] Building integration tests runner docker image for a local testing
 2024-08-02 13:22:59 +00:00
Nikita Fomichev
5256e8e6d0 Integration tests: fix ports clashing problem 3 2024-08-02 14:36:49 +02:00
Nikita Fomichev
a64e625f0b Integration tests: fix ports clashing problem 2 2024-08-02 14:03:27 +02:00
maxvostrikov
c9b29ad113 squash! fix for parallel execution 2024-08-02 13:53:48 +02:00
Julia Kartseva
528187410f
Merge pull request #65751 from jkartseva/store-plain-rw-metadata-separately 
Store `plain_rewritable` disk metadata in the separate `'__meta'` layout; add flat object storage directory structure
 2024-08-02 11:52:59 +00:00
robot-clickhouse
34cba1bdda Automatic style fix 2024-08-02 11:46:12 +00:00
Michael Stetsyuk
7d45529fe8 randomize query id in test_checking_s3_blobs_paranoid 2024-08-02 12:37:40 +01:00
Nikita Fomichev
7d1e958097 Integration tests: fix ports clashing problem 2024-08-02 13:32:59 +02:00
Michael Stetsyuk
092c837119 randomize table name in test_storage_delta 2024-08-02 12:14:37 +01:00
vdimir
02e4843605
test_cache_evicted_by_temporary_data drop cache 2024-08-02 10:37:52 +00:00
Antonio Andelic
76e2e886db Merge branch 'master' into fix-udf-reload 2024-08-02 12:37:13 +02:00
Andrey Zvonov
064c0eb958 even better healthcheck for ldap 2024-08-02 10:35:32 +00:00
vdimir
eb3fd60f3e
Trying to fix test_cache_evicted_by_temporary_data and print debug info 2024-08-02 10:18:52 +00:00
serxa
8724c5ad52 Merge branch 'master' into s3-streams-scheduler 2024-08-02 09:52:55 +00:00
Yarik Briukhovetskyi
35c4ee9268
Merge branch 'ClickHouse:master' into hive_style_partitioning 2024-08-02 11:30:33 +02:00
Antonio Andelic
6c8f458b0b Fix reloading SQL UDFs with UNION 2024-08-02 11:13:41 +02:00
Michael Stetsyuk
9c05a0ad5a rm dirs in test_storage_delta 2024-08-02 09:34:32 +01:00
Pablo Marcos
dc65c0aa07 Fix doc for parallel test execution 
Copy-pasterino strikes again. I forgot to remove the single quote.
With it, pytest thinks the whole argument is a file:

(no name '/ClickHouse/tests/integration/test_storage_s3_queue/test.py::test_max_set_age -- --count 10 -n 5' in any of [<Module test.py>])
 2024-08-02 07:17:09 +00:00
Antonio Andelic
774cba09df Fix flaky test_replicated_table_attach 2024-08-02 08:49:47 +02:00
iceFireser
5ebb2c54b0 Re-trigger ci 2024-08-02 14:07:44 +08:00
Julia Kartseva
d6da86dad2 Store plain_rewritable metadata in a separate layout 2024-08-02 04:28:07 +00:00
Alexey Katsman
a596f0b6d1
Merge pull request #67506 from alexkats/fix-mask 
[Green CI] Fix potentially flaky test_mask_sensitive_info integration test
 2024-08-01 20:55:56 +00:00
Igor Nikonov
36036c3da9 Merge remote-tracking branch 'origin/master' into pr-local-plan 2024-08-01 20:33:41 +00:00
Yarik Briukhovetskyi
cdf8e5572c
Merge branch 'master' into hive_style_partitioning 2024-08-01 20:12:40 +02:00
Antonio Andelic
1d8e886d7b
Merge pull request #67448 from ClickHouse/keeper-map-retries 
Add Keeper retries in `KeeperMap`
 2024-08-01 17:19:19 +00:00
Antonio Andelic
bf98336819
Merge pull request #67595 from ClickHouse/update-minio 
Update minio in integration tests
 2024-08-01 16:19:28 +00:00
Alexey Milovidov
3603252f03 Merge branch 'master' into enable-text-log 2024-08-01 17:34:21 +02:00
Igor Nikonov
7082a9797e Merge remote-tracking branch 'origin/master' into pr-local-plan 2024-08-01 14:22:26 +00:00
Alex Katsman
0913f0189b Don't count a search query as a search pattern match 2024-08-01 14:08:50 +00:00
Michael Stetsyuk
1d85f9b1cb fix remove_local_directory_contents 2024-08-01 14:58:11 +01:00
Alexander Tokmakov
c0bd2120c8
Merge pull request #66519 from XuJia0210/feature_disable_insertion_and_mutation 
Feature disable insertion and mutation
 2024-08-01 13:35:25 +00:00
Vitaly Baranov
67f85fb43b
Merge pull request #67494 from vitlibar/fix-test_mutation 
Fix test test_backup_restore_on_cluster/test.py::test_mutation
 2024-08-01 12:49:47 +00:00
maxvostrikov
a8e7c8ae9a fix for parallel execution 2024-08-01 14:45:46 +02:00
Alexander Tokmakov
3e61ff2553
Merge pull request #67590 from pamarcos/fix-test_zookeeper_config_load_balancing 
Fix test_zookeeper_config_load_balancing after adding the xdist worker name to the instance
 2024-08-01 12:13:04 +00:00
Kseniia Sumarokova
2c018d6f4d
Update cluster.py 2024-08-01 13:38:41 +02:00
Yarik Briukhovetskyi
f6f85f90c3
Merge branch 'ClickHouse:master' into hive_style_partitioning 2024-08-01 13:15:20 +02:00
robot-clickhouse
572ad2f6fe Automatic style fix 2024-08-01 11:12:00 +00:00
maxvostrikov
928d5df3f0 added tests for https://github.com/ClickHouse/ClickHouse/pull/65475 
Support writting page index into parquet file
 2024-08-01 12:32:43 +02:00
Antonio Andelic
c77f6d78d9 Update minio 2024-08-01 12:09:58 +02:00
Pablo Marcos
da3a37c561 Improve regex to take into account the xdist name in the instance 2024-08-01 09:38:34 +00:00
Robert Schulze
64526e6e3a
Merge pull request #67435 from rschu1ze/multiquery-followup 
Remove obsolete `--multiquery` parameter from tests
 2024-08-01 09:12:41 +00:00
Antonio Andelic
7db4065898 Add retries to create 2024-08-01 10:34:53 +02:00
Antonio Andelic
c2df527a32 Reduce fault rate 2024-08-01 08:42:54 +02:00
Antonio Andelic
d571e517fa Merge branch 'master' into keeper-map-retries 2024-08-01 08:41:06 +02:00
János Benjamin Antal
0e36db5437 Do not check the value of num_messages_read because it is not reliable 
librdkafka usually polls both messages on the first SELECT, but sometimes only one. If it polls only one message first, then it will read two messages before rebalancing at the second SELECT from the table. This means it usually reads a single message twice (thus num_messages_read = 4 is usually fine as 1 discarded message + 3 actually consumed message). But when only one message is read in the first SELECT, then 2 messages are discarded, thus num_messages_read will be 5 as 2 discarded message + 3 actually consumed messages.
 2024-07-31 22:09:04 +00:00
Alexey Milovidov
26e42036b3 Merge branch 'master' into enable-text-log 2024-07-31 22:46:56 +02:00
robot-clickhouse
bada9ea9be Automatic style fix 2024-07-31 17:30:32 +00:00
János Benjamin Antal
e7fc206069 Add test 2024-07-31 17:20:01 +00:00
János Benjamin Antal
1e9a621b54
Merge branch 'master' into kafka-zookeeper 2024-07-31 19:16:03 +02:00
robot-clickhouse
f9c9d85e41 Automatic style fix 2024-07-31 16:51:05 +00:00
Yarik Briukhovetskyi
fac73a0944
Merge branch 'master' into hive_style_partitioning 2024-07-31 18:25:08 +02:00
Pablo Marcos
3332faa014
Merge pull request #67035 from pamarcos/fix-flaky-test_storage_s3_queue-test_max_set_age 
[Green CI] Fix test test_storage_s3_queue/test.py::test_max_set_age
 2024-07-31 16:09:34 +00:00
Robert Schulze
d0a030f03e
Merge remote-tracking branch 'ClickHouse/master' into multiquery-followup 2024-07-31 15:39:33 +00:00
serxa
a45027f22c Fix flaky test_delayed_replica_failover 2024-07-31 15:22:48 +00:00
divanik
67f4792b77 Style check 2024-07-31 14:16:40 +00:00
Michael Stetsyuk
27f4f468b9 make it possible to rerun test_recovery_time_metric multiple times 2024-07-31 14:55:00 +01:00
robot-clickhouse
7dbd3d7534 Automatic style fix 2024-07-31 13:51:48 +00:00
Michael Stetsyuk
31c142a96d make it possible to rerun test_storage_delta and test_checking_s3_blobs_paranoid 2024-07-31 14:44:54 +01:00
Antonio Andelic
6b7c5eb5da Fix drop 2024-07-31 14:43:58 +02:00
Pablo Marcos
15e0033016 Bring back the strict check 
Also update the doc.
 2024-07-31 12:09:52 +00:00
divanik
d5f8540fbb Fix 2024-07-31 12:00:09 +00:00
Ilya Yatsishin
4bf7aa1950
Revert "Revert "Add settings to replace external engines to Null during create"" 2024-07-31 13:30:14 +02:00
Igor Nikonov
936e3d9a21 Merge remote-tracking branch 'origin/master' into pr-local-plan 2024-07-31 11:04:01 +00:00