Commit Graph

101302 Commits

Author SHA1 Message Date
Azat Khuzhin
ac27bc0193 Add trailing slash (/) in S3ObjectStorage::getDirectoryContents()
Otherwise it returns only the directory itself.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-11-10 18:08:41 +01:00
Azat Khuzhin
d3e0f16873 Remove common root path in MetadataStorageFromPlainObjectStorage::listDirectory()
This path should not leak into users/outside, since later it can be
passed to other APIs, i.e. exists() and so on.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-11-10 18:08:41 +01:00
Azat Khuzhin
9296bfb161 Handle list_object_keys_size for Azure
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-11-10 18:08:41 +01:00
Azat Khuzhin
2cbc61df18 Fix ATTACH FROM s3_plain for wide part
Previously because of incorrect
MetadataStorageFromPlainObjectStorage::exists(), that used
S3ObjectStorage::exists() before, which works only for existing keys,
not some intermediate path.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-11-10 18:08:41 +01:00
Azat Khuzhin
41884d3b88 Optimize MetadataStorageFromPlainObjectStorage::getFileSize()
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-11-10 18:08:41 +01:00
Azat Khuzhin
7b7ae175df Add max_keys for IObjectStorage::findAllFiles()
v2: Fix google-default-arguments for IObjectStorage::findAllFiles()
v3: Update max_keys for S3 requests in S3ObjectStorage::findAllFiles() loop
v4: Clarify things about max_keys vs list_object_keys_size in S3ObjectStorage::findAllFiles()
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-11-10 18:08:26 +01:00
Azat Khuzhin
434b9c14d8 Handle all entries for azure blob storage (not only first 5k)
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-11-10 17:42:32 +01:00
Azat Khuzhin
afc6c8bb73 tests: add ATTACH FROM s3_plain for wide part
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-11-10 17:42:32 +01:00
Alexander Tokmakov
545e1ae6c9
Merge pull request #43134 from ClickHouse/revert-42869-optimze_ttl_merge
Revert "Optimize TTL merge, completely expired parts can be removed in time"
2022-11-10 19:39:48 +03:00
Alexander Tokmakov
e415fc6e95
Revert "Optimize TTL merge, completely expired parts can be removed in time" 2022-11-10 19:38:55 +03:00
Dale Mcdiarmid
5c147262e9 add toc 2022-11-10 16:36:30 +00:00
robot-clickhouse
fe283af82b Automatic style fix 2022-11-10 16:08:05 +00:00
kssenii
a47aac3e2b Better system table structure 2022-11-10 17:07:17 +01:00
kssenii
bed7ac9442 Support arbitrary structure collections 2022-11-10 17:05:24 +01:00
Dmitry Novik
4e15d648e7 Add test_global_overcommit_tracker/__init__.py 2022-11-10 16:02:45 +00:00
Dmitry Novik
b1e942e14c Do not run global test with sanitizers 2022-11-10 16:00:10 +00:00
kssenii
c4f522b414 Support arbintrary structure collections 2022-11-10 16:32:15 +01:00
Dale Mcdiarmid
49e53e48f9 initial analysis 2022-11-10 15:32:06 +00:00
flynn
fc7311aab7 fix 2022-11-10 15:09:55 +00:00
Vitaly Baranov
6bc8b544ce
Merge branch 'master' into correct-error-message-after-dropping-current-user 2022-11-10 13:36:52 +01:00
Vitaly Baranov
59d45bc4c2
Merge branch 'master' into fix-backup-of-lazy-db 2022-11-10 13:36:22 +01:00
Igor Nikonov
c00f71327a Fix: backward-compatility check
- remove unused config for now
2022-11-10 12:31:22 +00:00
Igor Nikonov
f8c907c463
Revert "Revert " Keeper retries during insert (clean)"" 2022-11-10 13:14:04 +01:00
Mikhail f. Shiryaev
eec74e46e4
Move get_commit_filtered_statuses to commit_status_helper 2022-11-10 13:12:22 +01:00
Mikhail f. Shiryaev
e2de809532
Add typing to commit_status_helper.py 2022-11-10 13:12:20 +01:00
robot-clickhouse
98bb346a29 Automatic style fix 2022-11-10 12:05:41 +00:00
Nikolai Kochetov
77c0728e77 Fix aarch build. 2022-11-10 11:59:25 +00:00
Nikolai Kochetov
71437851b1
Update client.py 2022-11-10 12:56:00 +01:00
Vitaly Baranov
c003c90341
Merge pull request #39819 from quickhouse/transparentrowpolicies
Added applied row-level policies to `system.query_log`
2022-11-10 12:47:50 +01:00
Alexander Tokmakov
64e6a00f94
Merge pull request #43116 from ClickHouse/revert-42607-igor/insert_zk_retries_retry
Revert " Keeper retries during insert (clean)"
2022-11-10 14:12:58 +03:00
Alexander Tokmakov
fb8c527a2f
Revert " Keeper retries during insert (clean)" 2022-11-10 14:12:24 +03:00
Antonio Andelic
c50e795788 Fix expected ZXID 2022-11-10 11:04:51 +00:00
Igor Nikonov
1b9be27fdb
Merge pull request #42607 from ClickHouse/igor/insert_zk_retries_retry
Keeper retries during insert (clean)
2022-11-10 12:01:00 +01:00
Nikolai Kochetov
5ad15173bb
Merge pull request #43102 from ClickHouse/fix_projection_part
More stable test
2022-11-10 11:51:09 +01:00
Maksim Kita
8c333817e8
Merge pull request #42689 from ClickHouse/vdimir/identifier-resolver-fuse-sum
Support optimize_syntax_fuse_functions for sum/count/avg via analyzer
2022-11-10 13:05:12 +03:00
vdimir
961befb1f5
Not implemented for window frame type 'groups' in analyzer 2022-11-10 09:50:45 +00:00
Maksim Kita
3378c7f1b2
Merge pull request #43088 from ClickHouse/fix-ub-type-punning
Fix ub type punning
2022-11-10 12:49:44 +03:00
Maksim Kita
ba8e7fde3f
Merge pull request #43048 from kitaisreal/analyzer-array-join-with-join-improvements
Analyzer improve ARRAY JOIN with JOIN
2022-11-10 12:42:16 +03:00
Maksim Kita
40b7775a29
Merge pull request #43089 from kitaisreal/analyzer-table-expressions-aliases-improvements
Analyzer improve aliases support for table expressions
2022-11-10 12:32:34 +03:00
flynn
2d08c03bf9
Merge branch 'master' into hudi-udtf 2022-11-10 17:04:17 +08:00
Antonio Andelic
1954ff385d
Merge pull request #43076 from canhld94/ch_canh_minor
Better logging for mark range filtering on projection parts
2022-11-10 09:33:12 +01:00
Antonio Andelic
e512d7f036
Merge pull request #42619 from ClickHouse/jepen-multiple-tests
Extend Jepsen tests with support for server
2022-11-10 09:01:40 +01:00
robot-clickhouse
055e655145 Automatic style fix 2022-11-10 07:41:13 +00:00
Yakov Olkhovskiy
a5a1f5abf7 fix client.py - should use '--progress', return tests - they are working, fix help string 2022-11-10 07:33:54 +00:00
flynn
da77199bf5 fix style
fix style
2022-11-10 03:35:38 +00:00
flynn
6cbfab4e95 fix test 2022-11-10 03:10:25 +00:00
李扬
bcf5cad401
Merge branch 'master' into enable_max_splits 2022-11-10 10:47:47 +08:00
taiyang-li
628019d9d9 Merge branch 'enable_max_splits' of https://github.com/bigo-sg/ClickHouse into enable_max_splits 2022-11-10 10:47:10 +08:00
taiyang-li
c6449a1b23 fix bug 2022-11-10 10:46:51 +08:00
robot-clickhouse
eb612a699d Automatic style fix 2022-11-10 01:08:12 +00:00