János Benjamin Antal
0da44ad047
Merge pull request #67394 from ClickHouse/add-debug-to-s3-queue-shards-distributed
...
Print debug info in `test_storage_s3_queue/test.py::test_shards_distributed`
2024-08-05 12:23:40 +00:00
Pablo Marcos
15e0033016
Bring back the strict check
...
Also update the doc.
2024-07-31 12:09:52 +00:00
robot-clickhouse
f7f2a9872d
Automatic style fix
2024-07-29 16:02:14 +00:00
János Benjamin Antal
28ae671875
Print debug info
2024-07-29 15:52:25 +00:00
Pablo Marcos
4cf7e6a79d
Remove logging traces to help debugging
2024-07-29 11:15:03 +00:00
Pablo Marcos
5b9427dc56
Fix test flakiness
...
- Increase from 10s to 20s the max_age. Removes flakiness due to
the files in minio still present in following execution, even
if the cleanup stage of the test is clearly removing them.
- Use a busy-loop to check conditions directly, removing the
unnecessary sleep.
2024-07-29 10:36:18 +00:00
Pablo Marcos
59f9c12504
Increase sleep time make sure there is a new failure
...
The previous sleep was already adding +5s to make sure
the TTL was properly applied, so we'd rather use the
same value here instead of just 1s.
2024-07-25 14:37:50 +00:00
Pablo Marcos
f03d4bb7d5
Format with black
2024-07-24 15:10:25 +00:00
Pablo Marcos
91b7001df6
Refactor test to improve it
...
- Create wait_for_condition that checks greedily for a period of time
- Remove redundant checks
- Allow other tests running in parallel to have `ObjectStorageQueueFailedFiles` errors
2024-07-24 12:08:31 +00:00
Pablo Marcos
b25cad23ed
Use unique names for tables and files
2024-07-24 11:42:51 +00:00
kssenii
21f0eb2eec
Do not use async initialization of readers in s3queue
2024-07-02 18:13:49 +02:00
Kseniia Sumarokova
258e2f0421
Update test.py
2024-06-26 16:45:02 +02:00
kssenii
2ba697dcae
Merge remote-tracking branch 'origin' into add-azure-queue-storage
2024-06-26 13:05:56 +02:00
kssenii
95b1651ba6
Better pytest
2024-06-25 13:56:01 +02:00
kssenii
a066b78c4d
Merge remote-tracking branch 'origin' into s3queue-improvements
2024-06-21 12:27:32 +02:00
kssenii
5447145c7a
Fix test
2024-06-21 11:53:01 +02:00
robot-clickhouse
da55a213ef
Automatic style fix
2024-06-20 16:38:11 +00:00
kssenii
5904847316
Fix tests
2024-06-20 18:32:00 +02:00
robot-clickhouse
dc6fa85bc3
Automatic style fix
2024-06-19 14:37:55 +00:00
kssenii
c47c8d603e
Add AzureQueue
2024-06-19 16:30:57 +02:00
kssenii
78ccd03dd6
A few code renames in preparation for AzureQueue
2024-06-19 14:50:43 +02:00
Kseniia Sumarokova
959467f8fa
Update test.py
2024-06-19 14:03:24 +02:00
kssenii
1c415479f0
Do not release buckets until the files are commited
2024-06-18 18:58:38 +02:00
kssenii
0f2c2cc9bf
Fix tests
2024-06-17 17:11:17 +02:00
kssenii
366e801cea
Commit by limit
2024-06-14 14:24:06 +02:00
kssenii
1e435eb353
Fix tests
2024-06-11 19:01:24 +02:00
kssenii
bc294ef51f
S3Queue small fixes
2024-06-10 19:39:37 +02:00
kssenii
2a69c00d09
Merge remote-tracking branch 'origin/s3queue-fix-ordered-mode' into s3queue-fix-ordered-mode
2024-05-30 16:34:00 +02:00
kssenii
9238045eea
Add bucket versioning
2024-05-30 16:33:40 +02:00
robot-clickhouse
75bfa1746b
Automatic style fix
2024-05-30 13:07:17 +00:00
kssenii
b3a58a6294
Merge remote-tracking branch 'origin/s3queue-fix-ordered-mode' into s3queue-fix-ordered-mode
2024-05-30 14:58:12 +02:00
kssenii
ee4d5e4260
Fix remaining tests
2024-05-30 14:57:50 +02:00
robot-clickhouse
39dd2735a3
Automatic style fix
2024-05-29 19:44:48 +00:00
kssenii
59eed8086c
Fixes
2024-05-29 21:37:42 +02:00
robot-clickhouse
92fd1f08c9
Automatic style fix
2024-05-24 17:23:56 +00:00
kssenii
cfbf1cc1e2
S3Queue rework ordered mode
2024-05-24 11:47:32 +02:00
robot-clickhouse
98360e8c57
Automatic style fix
2024-05-14 14:37:26 +00:00
kssenii
cdf619b21e
Review fixes
2024-05-14 16:30:31 +02:00
Kseniia Sumarokova
1c527e86aa
Update test.py
2024-05-13 19:16:05 +02:00
kssenii
4b270e9078
Add a test
2024-05-13 17:15:26 +02:00
Dmitry Novik
b74a0359e5
Update integration tests
2024-03-20 13:43:18 +01:00
kssenii
d008ee725f
Add a test
2024-02-12 20:23:21 +01:00
robot-clickhouse
fe829cac48
Automatic style fix
2024-02-01 11:43:55 +00:00
kssenii
3a16427e00
Fix test
2024-02-01 12:35:01 +01:00
kssenii
f7a5f09a0f
Add one more test
2024-01-31 22:59:25 +01:00
kssenii
361b2f107b
Allow to define a starting point for s3queue ordered mode
2024-01-31 21:28:18 +01:00
kssenii
145f6a31cb
Fix
2024-01-30 16:29:40 +01:00
kssenii
df7d3b8a40
Allocate current shard number from keeper
2024-01-29 19:36:16 +01:00
kssenii
ef252d8376
Validate settings with keeper, add a test
2024-01-29 12:36:00 +01:00
kssenii
7f8f379d7f
Parallel & disrtibuted processing for ordered mode
2024-01-24 16:32:15 +01:00