138 Commits

Author	SHA1	Message	Date
Pablo Marcos	5b9427dc56	Fix test flakiness ... - Increase from 10s to 20s the max_age. Removes flakiness due to the files in minio still present in following execution, even if the cleanup stage of the test is clearly removing them. - Use a busy-loop to check conditions directly, removing the unnecessary sleep.	2024-07-29 10:36:18 +00:00
Pablo Marcos	59f9c12504	Increase sleep time make sure there is a new failure ... The previous sleep was already adding +5s to make sure the TTL was properly applied, so we'd rather use the same value here instead of just 1s.	2024-07-25 14:37:50 +00:00
Pablo Marcos	f03d4bb7d5	Format with black	2024-07-24 15:10:25 +00:00
Pablo Marcos	91b7001df6	Refactor test to improve it ... - Create wait_for_condition that checks greedily for a period of time - Remove redundant checks - Allow other tests running in parallel to have `ObjectStorageQueueFailedFiles` errors	2024-07-24 12:08:31 +00:00
Pablo Marcos	b25cad23ed	Use unique names for tables and files	2024-07-24 11:42:51 +00:00
kssenii	21f0eb2eec	Do not use async initialization of readers in s3queue	2024-07-02 18:13:49 +02:00
Kseniia Sumarokova	258e2f0421	Update test.py	2024-06-26 16:45:02 +02:00
kssenii	2ba697dcae	Merge remote-tracking branch 'origin' into add-azure-queue-storage	2024-06-26 13:05:56 +02:00
kssenii	95b1651ba6	Better pytest	2024-06-25 13:56:01 +02:00
kssenii	a066b78c4d	Merge remote-tracking branch 'origin' into s3queue-improvements	2024-06-21 12:27:32 +02:00
kssenii	5447145c7a	Fix test	2024-06-21 11:53:01 +02:00
robot-clickhouse	da55a213ef	Automatic style fix	2024-06-20 16:38:11 +00:00
kssenii	5904847316	Fix tests	2024-06-20 18:32:00 +02:00
robot-clickhouse	dc6fa85bc3	Automatic style fix	2024-06-19 14:37:55 +00:00
kssenii	c47c8d603e	Add AzureQueue	2024-06-19 16:30:57 +02:00
kssenii	78ccd03dd6	A few code renames in preparation for AzureQueue	2024-06-19 14:50:43 +02:00
Kseniia Sumarokova	959467f8fa	Update test.py	2024-06-19 14:03:24 +02:00
kssenii	1c415479f0	Do not release buckets until the files are commited	2024-06-18 18:58:38 +02:00
kssenii	0f2c2cc9bf	Fix tests	2024-06-17 17:11:17 +02:00
kssenii	366e801cea	Commit by limit	2024-06-14 14:24:06 +02:00
kssenii	1e435eb353	Fix tests	2024-06-11 19:01:24 +02:00
kssenii	bc294ef51f	S3Queue small fixes	2024-06-10 19:39:37 +02:00
kssenii	2a69c00d09	Merge remote-tracking branch 'origin/s3queue-fix-ordered-mode' into s3queue-fix-ordered-mode	2024-05-30 16:34:00 +02:00
kssenii	9238045eea	Add bucket versioning	2024-05-30 16:33:40 +02:00
robot-clickhouse	75bfa1746b	Automatic style fix	2024-05-30 13:07:17 +00:00
kssenii	b3a58a6294	Merge remote-tracking branch 'origin/s3queue-fix-ordered-mode' into s3queue-fix-ordered-mode	2024-05-30 14:58:12 +02:00
kssenii	ee4d5e4260	Fix remaining tests	2024-05-30 14:57:50 +02:00
robot-clickhouse	39dd2735a3	Automatic style fix	2024-05-29 19:44:48 +00:00
kssenii	59eed8086c	Fixes	2024-05-29 21:37:42 +02:00
robot-clickhouse	92fd1f08c9	Automatic style fix	2024-05-24 17:23:56 +00:00
kssenii	cfbf1cc1e2	S3Queue rework ordered mode	2024-05-24 11:47:32 +02:00
robot-clickhouse	98360e8c57	Automatic style fix	2024-05-14 14:37:26 +00:00
kssenii	cdf619b21e	Review fixes	2024-05-14 16:30:31 +02:00
Kseniia Sumarokova	1c527e86aa	Update test.py	2024-05-13 19:16:05 +02:00
kssenii	4b270e9078	Add a test	2024-05-13 17:15:26 +02:00
Dmitry Novik	b74a0359e5	Update integration tests	2024-03-20 13:43:18 +01:00
kssenii	12cd566681	Update config for test	2024-03-19 11:47:53 +01:00
kssenii	d008ee725f	Add a test	2024-02-12 20:23:21 +01:00
robot-clickhouse	fe829cac48	Automatic style fix	2024-02-01 11:43:55 +00:00
kssenii	3a16427e00	Fix test	2024-02-01 12:35:01 +01:00
kssenii	f7a5f09a0f	Add one more test	2024-01-31 22:59:25 +01:00
kssenii	361b2f107b	Allow to define a starting point for s3queue ordered mode	2024-01-31 21:28:18 +01:00
kssenii	145f6a31cb	Fix	2024-01-30 16:29:40 +01:00
kssenii	df7d3b8a40	Allocate current shard number from keeper	2024-01-29 19:36:16 +01:00
kssenii	ef252d8376	Validate settings with keeper, add a test	2024-01-29 12:36:00 +01:00
kssenii	7f8f379d7f	Parallel & disrtibuted processing for ordered mode	2024-01-24 16:32:15 +01:00
robot-clickhouse	29173a602e	Automatic style fix	2024-01-08 02:39:19 +00:00
Sema Checherinda	d5f86f671d	fix and test that S3Clients reused	2024-01-07 02:19:06 +01:00
kssenii	529a1d67cb	Fix	2023-12-28 12:48:56 +01:00
Alexey Milovidov	76bbeaa676	S3Queue is production ready	2023-12-05 21:10:19 +01:00
Kseniia Sumarokova	4c7daf5167	Fix	2023-11-20 14:55:23 +01:00
Kseniia Sumarokova	2a1467b8da	Update test_storage_s3_queue/test.py	2023-11-16 19:33:17 +01:00
Kseniia Sumarokova	e48df94772	Merge pull request #56377 from ClickHouse/minor-improvements-for-s3-queue ... Minor improvements for S3Queue	2023-11-10 11:28:09 +01:00
Kseniia Sumarokova	b05a66b9b5	Update test.py	2023-11-09 13:04:46 +01:00
robot-clickhouse	c064488bbf	Automatic style fix	2023-11-08 11:48:09 +00:00
kssenii	dfcc94fff0	Fix test	2023-11-08 12:29:40 +01:00
Kseniia Sumarokova	cc3144ea2d	Merge pull request #56370 from ClickHouse/kssenii-patch-6 ... Update test_storage_s3_queue/test.py	2023-11-07 16:29:34 +01:00
robot-clickhouse	d55a0bd686	Automatic style fix	2023-11-06 15:04:45 +00:00
kssenii	f2c0434c4d	Merge remote-tracking branch 'origin/master' into minor-improvements-for-s3-queue	2023-11-06 15:51:11 +01:00
kssenii	8db2aca832	Add a test	2023-11-06 15:48:04 +01:00
kssenii	3ecce143fc	Restrict modes for the test	2023-11-06 14:44:24 +01:00
Kseniia Sumarokova	036922e3b4	Update test.py	2023-11-06 12:21:13 +01:00
kssenii	5d700605a5	Merge remote-tracking branch 'upstream/master' into fix-flaky-s3-queue-test	2023-10-26 17:18:26 +02:00
helifu	4015176d27	A small fix (#55938)	2023-10-26 13:19:58 +02:00
kssenii	de8064da6e	Debug info	2023-10-25 12:31:00 +02:00
kssenii	b6b124f5a9	Usability improvement	2023-10-13 14:16:56 +02:00
kssenii	c579f5b321	Fix style check	2023-09-27 20:10:05 +02:00
kssenii	e0ff76a7f9	Fix	2023-09-27 18:44:53 +02:00
kssenii	3b54b6be88	Add system tables	2023-09-25 20:04:15 +02:00
kssenii	e4256eb268	Better	2023-09-25 13:44:45 +02:00
kssenii	6846fe3c58	Fxi	2023-09-15 14:21:08 +02:00
kssenii	342755d35e	Better	2023-09-14 18:41:31 +02:00
kssenii	220a67eca7	Better	2023-09-08 16:38:05 +02:00
kssenii	7338b560a8	S3Queue fixes	2023-09-07 19:17:21 +02:00
Alexey Milovidov	061821d731	Update test	2023-09-03 00:03:15 +02:00
kssenii	aa21fc58ce	Fix style check	2023-08-23 11:48:08 +02:00
kssenii	27b559bcda	Fxi	2023-08-23 11:34:34 +02:00
kssenii	d87162f43c	Fix	2023-08-02 17:09:47 +02:00
kssenii	6e99e5c453	Fix another flaky test	2023-07-30 13:27:01 +02:00
kssenii	f82364d2c9	Fix flaky test	2023-07-21 17:03:30 +02:00
Sergey Katkovskiy	bc7c67e33f	code review fixes	2023-05-25 23:29:16 +03:00
Sergey Katkovskiy	446cf3c847	handle failed files	2023-05-10 18:17:26 +03:00
Sergey Katkovskiy	d37622434f	fix tests	2023-05-09 07:04:36 +03:00
Sergey Katkovskiy	a8d56b2290	fix ordered mode + more tests	2023-05-08 10:26:52 +03:00
Sergey Katkovskiy	c24ec8f83f	fix	2023-05-04 11:58:09 +03:00
Sergey Katkovskiy	7498ed23b1	check meta, reformat code, add tests	2023-05-04 10:04:04 +03:00
Sergey Katkovskiy	f21c838f11	add some tests	2023-05-02 17:27:53 +03:00
Sergey Katkovskiy	624d846fea	add template for tests	2023-05-01 15:51:31 +03:00