138 Commits

Author	SHA1	Message	Date
kssenii	0929f66516	Update test	2024-11-08 17:01:09 +01:00
Kseniia Sumarokova	2c59fce5b4	Update test.py	2024-11-07 17:44:41 +01:00
kssenii	8f6439e4e9	Allow to change more settings, better tests	2024-10-28 17:12:17 +01:00
kssenii	f3f9ffc883	Extend test	2024-10-25 16:21:35 +02:00
kssenii	0f66694468	Remove change	2024-10-24 20:19:46 +02:00
kssenii	0eddccbcc5	Resolve conflicts with master, support reset setting	2024-10-24 20:17:47 +02:00
kssenii	c83c282dda	Merge remote-tracking branch 'origin/master' into s3queue-allow-alter-settings	2024-10-24 19:03:50 +02:00
Kseniia Sumarokova	6e17093e5a	Fix test	2024-10-21 11:35:20 +02:00
robot-clickhouse	09a9837f69	Automatic style fix	2024-10-18 17:11:39 +00:00
kssenii	6a3d109444	Support system.s3/azure_queue_log	2024-10-18 18:51:28 +02:00
kssenii	3d95774197	Fix settings and metadata divergence	2024-10-18 18:03:05 +02:00
robot-clickhouse	c125d20b48	Automatic style fix	2024-10-18 14:49:40 +00:00
kssenii	4bcf90fcd4	Better	2024-10-18 16:43:21 +02:00
kssenii	945fefda70	Better	2024-10-18 15:26:25 +02:00
robot-clickhouse	5fb5e65e14	Automatic style fix	2024-10-17 17:52:12 +00:00
kssenii	5a5563ba73	Allow to alter s3queue settings	2024-10-17 19:41:52 +02:00
kssenii	b7fa520781	Add s3queue check if cloud mode	2024-10-16 16:31:51 +02:00
Kseniia Sumarokova	752a1ec466	Merge pull request #70141 from ClickHouse/refactor-object-storage-read ... Refactor reading from object storage	2024-10-03 10:14:28 +00:00
kssenii	0c00272d3f	Fix tests	2024-10-02 13:34:25 +02:00
robot-clickhouse	72d1c8e36d	Automatic style fix	2024-10-01 11:08:39 +00:00
kssenii	94c434086d	Fix	2024-10-01 13:02:31 +02:00
Kseniia Sumarokova	123d0cfa0b	Update test.py	2024-10-01 12:55:03 +02:00
Kseniia Sumarokova	719258a612	Update test.py	2024-10-01 12:48:04 +02:00
robot-clickhouse	7c6ce8611c	Automatic style fix	2024-09-27 10:19:49 +00:00
kssenii	f0a49e4b64	Merge remote-tracking branch 'origin' into fix-s3-queue-with-replicated-database	2024-09-26 12:44:20 +02:00
Kseniia Sumarokova	3a9c22bec0	Update test.py	2024-09-25 11:58:23 +02:00
kssenii	ebfc1a9b5a	Allow tables to start on upgrade 24.5 -> 24.6 if sharded mode was used	2024-09-19 13:58:59 +02:00
kssenii	54c2a8d0a7	Fix test	2024-09-19 12:38:08 +02:00
kssenii	a2450db286	Fix test	2024-09-18 20:03:45 +02:00
kssenii	373927d6a5	Fix tracked_files_ttl_sec	2024-09-18 19:25:18 +02:00
robot-clickhouse	ac0845a0a5	Automatic style fix	2024-09-17 10:54:56 +00:00
kssenii	f5861578d0	Update test	2024-09-17 12:48:51 +02:00
kssenii	c31ff58526	Adjust changes after merge with master	2024-09-16 13:01:28 +02:00
robot-clickhouse	c0a42ef877	Automatic style fix	2024-09-11 15:42:12 +00:00
Kseniia Sumarokova	abe8f29bf8	Update test	2024-09-11 17:32:20 +02:00
kssenii	3644adb589	Fix style check	2024-09-10 14:07:20 +02:00
kssenii	05ec50623c	Update test check	2024-09-10 13:55:33 +02:00
kssenii	e1ad411cb6	Fix	2024-09-09 13:42:38 +02:00
János Benjamin Antal	d18b6c63d4	Change name of default azurite container to avoid clashing with azure blob storage tests	2024-08-15 09:41:03 +00:00
János Benjamin Antal	7b1bca2b48	Add missing assertion	2024-08-14 16:55:59 +00:00
János Benjamin Antal	61b96ed749	Make rest of the tests repeatable	2024-08-14 16:43:26 +00:00
János Benjamin Antal	4827b8bb1c	Make S3Queue tests repeatable	2024-08-14 14:56:02 +00:00
János Benjamin Antal	fc9929dc3d	Make tests with azurite repeatable	2024-08-14 14:15:05 +00:00
János Benjamin Antal	897b8d5a88	Try to give more chances to node2 to steal some work	2024-08-12 15:21:01 +00:00
Julia Kartseva	d6ecabb41d	Fix flaky test_storage_s3_queue/test.py::test_multiple_tables_streaming_sync_distributed ... Disable parallel processing for the Ordered mode for the test_storage_s3_queue/test.py::test_multiple_tables_streaming_sync_distributed test. The reason for this is that the load between the processing nodes is too uneven when s3queue_processing_threads_num != 1, e.g.: ``` $ grep res1 pytest.log 2024-08-07 07:15:58 [ 575 ] DEBUG : res1 size: 13300, res2 size: 1700, total_rows: 15000 (test.py:813, test_multiple_tables_streaming_sync_distributed) ``` In CIs environment, there are rare cases when one of the processors handles all the workload, while the other is busy-waiting, and the test fails on assert: When s3queue_processing_threads_num == 1, the workload is evenly distributed: ``` $ grep res1 pytest.log 2024-08-07 07:26:52 [ 586 ] DEBUG : res1 size: 7200, res2 size: 7800, total_rows: 15000 (test.py:813, test_multiple_tables_streaming_sync_distributed) ``` This change only fixes test flakiness. Further investigation of the Order mode parallelism is required.	2024-08-08 06:13:36 +00:00
János Benjamin Antal	0da44ad047	Merge pull request #67394 from ClickHouse/add-debug-to-s3-queue-shards-distributed ... Print debug info in `test_storage_s3_queue/test.py::test_shards_distributed`	2024-08-05 12:23:40 +00:00
Pablo Marcos	15e0033016	Bring back the strict check ... Also update the doc.	2024-07-31 12:09:52 +00:00
robot-clickhouse	f7f2a9872d	Automatic style fix	2024-07-29 16:02:14 +00:00
János Benjamin Antal	28ae671875	Print debug info	2024-07-29 15:52:25 +00:00
Pablo Marcos	4cf7e6a79d	Remove logging traces to help debugging	2024-07-29 11:15:03 +00:00