Commit Graph

13667 Commits

Author SHA1 Message Date
Kseniia Sumarokova
dbc11b83fd
Merge branch 'master' into kssenii-patch-6 2023-08-01 18:40:20 +02:00
Vitaly Baranov
65bd8f5e81
Merge branch 'master' into backups-fix-tmp-files 2023-08-01 16:37:06 +02:00
Alexey Milovidov
4578d43f79
Merge pull request #52656 from Avogar/rename-setting-for-url-encoding
Rename setting disable_url_encoding to enable_url_encoding and add a test
2023-08-01 16:09:01 +03:00
János Benjamin Antal
a6861ea2f5
Merge pull request #52386 from ybogo/support-predefined-macro-in-kafka-settings
Add predefined macros support in Kafka engine settings
2023-08-01 14:49:01 +02:00
alesapin
0ee9797fb8
Merge pull request #51141 from ClickHouse/azure_blob_storage_sas_token
Azure blob storage sas token
2023-08-01 12:27:17 +02:00
robot-ch-test-poll4
5b67cff6b2
Merge pull request #52829 from ClickHouse/throw-s3-exception-whenever-possible
Throw S3Exception whenever possible.
2023-08-01 04:35:27 +02:00
Nikolai Kochetov
c4a00b8c68 Throw S3Exception whenever possible. 2023-07-31 15:39:20 +00:00
Vitaly Baranov
f5ffef4014
Merge pull request #52658 from arenadata/ADQM-984
Add s3_storage_class parameter in SETTINGS of BACKUP statement
2023-07-31 17:32:12 +02:00
Alexey Milovidov
bd3af7ebe6
Merge pull request #52754 from ClickHouse/analyzer-set-index-not
Analyzer: fix 00979_set_index_not.sql
2023-07-31 12:13:59 +03:00
Kseniia Sumarokova
8daeeedc8f
Merge pull request #52315 from xiedeyantu/add-alias
system.events and system.metrics tables add column name as an alias to event and metric
2023-07-30 22:37:31 +02:00
Anton Popov
0d8f852144
Merge pull request #52689 from CurtizJ/fix-extra-column-prewhere
Fix reading of unnecessary column in case of multistage `PREWHERE`
2023-07-30 15:30:53 +02:00
kssenii
20b76010ef Merge remote-tracking branch 'upstream/master' into kssenii-patch-6 2023-07-30 13:46:58 +02:00
Kseniia Sumarokova
08ef4d015c
Minor change 2023-07-30 13:36:52 +02:00
Alexey Milovidov
91e67c105f
Merge pull request #52569 from ClickHouse/Realize_parameterized_view_as_new_storage_view
Realize parameterized view as new view with parameters substitued
2023-07-30 05:46:51 +03:00
robot-clickhouse-ci-2
2dd69844dd
Merge pull request #52716 from canhld94/ch_use_same_poll_for_attach_n_fetch
Use same executor for GET_PART and ATTACH_PART
2023-07-29 22:27:08 +02:00
Igor Nikonov
23bc6755df
Merge branch 'master' into analyzer-set-index-not 2023-07-29 18:17:55 +02:00
Dmitry Novik
8f4527d9e0
Merge pull request #46740 from ClickHouse/query-tree-visitor
Refactor Query Tree visitor
2023-07-29 15:10:07 +02:00
Yury Bogomolov
ba081ed402
Merge branch 'master' into support-predefined-macro-in-kafka-settings 2023-07-29 15:00:21 +04:00
Smita Kulkarni
553304a81a Fixed clang tidy build by removing unued variable 2023-07-29 11:15:56 +02:00
Alexey Milovidov
9a8077265d
Merge branch 'master' into ch_use_same_poll_for_attach_n_fetch 2023-07-29 05:19:22 +03:00
Igor Nikonov
1c6ef97b33 Merge remote-tracking branch 'origin/master' into analyzer-set-index-not 2023-07-28 23:43:15 +00:00
Igor Nikonov
45b9614224 Remove debug logging 2023-07-28 23:42:58 +00:00
Igor Nikonov
2a40bc9055 Fix: __bitSwapLastTwo was applied to non BoolMask
- ActionsDAG was missing convertions to BoolMask - __bitWrapperFunc
2023-07-28 23:29:59 +00:00
Yury Bogomolov
b2ee4505fb review fixes 2023-07-28 16:06:03 +00:00
pufit
6211845ef0
Merge pull request #51303 from ClickHouse/deprecate-metadata-cache
Deprecate the `metadata_cache` feature
2023-07-28 10:31:02 -04:00
Dmitry Novik
e882adbc2b Merge remote-tracking branch 'origin/master' into query-tree-visitor 2023-07-28 14:22:42 +00:00
Alexander Tokmakov
39200606ec
Merge pull request #52174 from arenadata/ADQM-988
Added possibility to save logs on crash and options to configure logs buffer
2023-07-28 16:55:00 +03:00
Alexey Gerasimchuck
63b05da1f2 System logs improvements 2023-07-28 07:23:34 +00:00
robot-ch-test-poll3
d6e2e8b92c
Merge pull request #52653 from azat/virtual-columns-or
RFC: Fix filtering by virtual columns with OR expression
2023-07-28 09:18:36 +02:00
Roman Vasin
cfa06725cc
Merge branch 'master' into ADQM-984 2023-07-28 10:15:27 +03:00
Duc Canh Le
97e63d523f use same executor for GET_PART and ATTACH_PART 2023-07-28 07:08:11 +00:00
Dmitry Novik
18c1fd6f08 Refactor InDepthQueryTreeVisitorWithContext 2023-07-27 21:24:39 +00:00
Han Fei
4f9075e819
Merge pull request #52623 from hanfei1991/hanfei/MergeTreeDeduplicationLog
Fix stress test: check if storage shutdown before we operate MergeTreeDeduplicationLog
2023-07-27 20:50:17 +02:00
Azat Khuzhin
d40dbdee62 Fix usage of temporary directories during RESTORE
Previously during RESTORE you may get the following warning in logs:

    <Warning> TemporaryFileOnDisk: Temporary path 'tmp/21672kaaaaa' does not exist in './disks/s3_common_disk/'

The reason is that it uses not disks/s3_common_disk/tmp but instead
disks/s3_common_disk/disks/s3_common_disk/tmp path.

Fix this by adding TemporaryFileOnDisk::getRelativePath() and use it
when appropriate.

And now - `find disks`, does not shows any more temporary leftovers.

v2: rename getPath to getAbsolutePath
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-07-27 19:24:54 +02:00
Anton Popov
dfc06d2714 fix reading of unneded column in case of multistage prewhere 2023-07-27 16:15:23 +00:00
Azat Khuzhin
68aed0d16e RFC: Fix filtering by virtual columns with OR expression
Virtual columns did not supports queries with OR, for example query like
this (here `m` is the `Merge` table, see the test):

    select key from m where (value = 10 and _table = 'v1') or (value = 20 and _table = 'v1');

Will always leads to:

    Cannot find column `value` in source stream, there are only columns ...

The reason for this is that it actually executes the following queries:

    SELECT key, value FROM default.d1 WHERE ((value = 10) AND ('v1' = 'v1')) OR ((value = 20) AND ('v1' = 'v1'));
    SELECT key FROM default.d2 WHERE 0;

And this kind of filtering is used not only for `Merge` table but also:
- `_table` for `Merge` (already mentioned)
- `_file` for `File`
- `_idx` for `S3`
- and as well as filtering `system.*` tables by `database`/`table`/...

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-07-27 16:35:17 +02:00
Azat Khuzhin
5611b2fff4 Add a note about not working _table filter for Merge with analyzer
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-07-27 16:35:17 +02:00
Han Fei
9488567bf6
Update src/Storages/MergeTree/MergeTreeDeduplicationLog.cpp 2023-07-27 16:28:08 +02:00
Han Fei
f6ca013c53
Update src/Storages/MergeTree/MergeTreeDeduplicationLog.cpp 2023-07-27 16:28:00 +02:00
Han Fei
0d44d527ef
Update src/Storages/MergeTree/MergeTreeDeduplicationLog.cpp
Co-authored-by: Alexander Tokmakov <tavplubix@gmail.com>
2023-07-27 16:27:04 +02:00
Han Fei
f5dfb70f5c
Update src/Storages/MergeTree/MergeTreeDeduplicationLog.cpp 2023-07-27 16:12:20 +02:00
Han Fei
ce38d3c5ea address comment 2023-07-27 16:11:08 +02:00
Alexey Milovidov
671128140d Update autogenerated version to 23.8.1.1 and contributors 2023-07-27 15:34:05 +02:00
Alexander Tokmakov
f3dc6dd061
Revert "Added field refcount to system.remote_data_paths table" 2023-07-27 15:23:57 +03:00
avogar
b5fc34b770 Rename setting disable_url_encoding to enable_url_encoding and add a test 2023-07-27 12:20:33 +00:00
Alexander Tokmakov
228de12d94
Update ReplicatedMergeTreeQueue.cpp (#52648) 2023-07-27 13:59:23 +03:00
Alexey Milovidov
17b647f6b1
Merge pull request #52518 from CurtizJ/add-refcount-to-system-table
Added field `refcount` to `system.remote_data_paths` table
2023-07-27 12:13:24 +03:00
robot-ch-test-poll1
abc48a0b73
Merge pull request #52627 from ClickHouse/fix_build_with_clang15
Fix build with clang-15
2023-07-27 09:49:29 +02:00
robot-clickhouse
ddab6590b2
Merge pull request #52626 from ClickHouse/fix_deadlock_in_persistent_table_functions
Fix deadlocks in StorageTableFunctionProxy
2023-07-27 09:38:48 +02:00
robot-ch-test-poll1
a5e073ff7d
Merge pull request #52602 from CheSema/finalize-gindexstore
GinIndexStore: fix a bug when files are finalizated after first write,
2023-07-27 08:31:24 +02:00