thevar1able/ClickHouse
1
0
Fork 0
mirror of https://github.com/ClickHouse/ClickHouse.git synced 2024-12-17 03:42:48 +00:00
Code Issues Packages Projects Releases Wiki Activity
124,942 Commits 9,315 Branches 1,783 Tags 2.1 GiB
c2a593baf9
Commit Graph

14358 Commits

Author SHA1 Message Date
ltrk2
27a2d4d1c7
Merge branch 'master' into feature/mergetree-checksum-big-endian-support 2023-08-02 11:36:43 -04:00
ltrk2
ea28888763
Merge branch 'master' into feature/mergetree-checksum-on-big-endian 2023-08-02 11:36:26 -04:00
Nikolai Kochetov
b3bc3e89b6
Merge pull request #52837 from ClickHouse/cleanup-local-backup 
Cleanup localBackup
 2023-08-02 17:10:36 +02:00
Andrey Zvonov
2695502922
Merge branch 'master' into zvonand-globs-small-fix 2023-08-02 15:52:14 +02:00
zvonand
8f080a17de Merge branch 'zvonand-globs-small-fix' of github.com:zvonand/ClickHouse into zvonand-globs-small-fix 2023-08-02 15:51:48 +02:00
zvonand
c0f9dbbacb shorten 2023-08-02 15:51:27 +02:00
Anton Popov
ff137773e7
Merge branch 'master' into formats-with-subcolumns 2023-08-02 15:24:56 +02:00
Smita Kulkarni
2c47679918 Merge branch 'master' into azure_table_function_cluster 2023-08-02 14:19:45 +02:00
Yarik Briukhovetskyi
e811d5c4e9
Update attachInformationSchemaTables.cpp 2023-08-02 14:06:20 +02:00
Yarik Briukhovetskyi
dab77b044b
Update attachInformationSchemaTables.cpp 2023-08-02 13:23:18 +02:00
yariks5s
0174244fe1 fixed tests 2023-08-02 11:21:47 +00:00
Alexander Tokmakov
d8da47520b
Merge branch 'master' into fix_mutations_with_transactions 2023-08-02 13:56:59 +03:00
Kseniia Sumarokova
8180474e71
Merge branch 'master' into minor_improve_hdfs_read_buffer 2023-08-02 11:57:41 +02:00
Kseniia Sumarokova
a3dd2e5c2f
Merge pull request #48424 from ClickHouse/kssenii-patch-6 
Fix outdated cache configuration in s3 tests: s3_storage_policy_by_defau…
 2023-08-02 11:38:57 +02:00
Antonio Andelic
9423976b7a Add support for file globs 2023-08-02 07:42:56 +00:00
Alexander Tokmakov
d6a2c631da fix assertion in mutations with transactions 2023-08-01 21:16:22 +02:00
yariks5s
6db7eaf4d8 fixed ast 2023-08-01 19:14:11 +00:00
ltrk2
35c67f5010
Merge branch 'master' into feature/mergetree-checksum-on-big-endian 2023-08-01 13:41:30 -04:00
Antonio Andelic
2430ebabf5 Merge branch 'master' into add-reading-from-archives 2023-08-01 17:22:38 +00:00
Kseniia Sumarokova
8893670d98
Merge branch 'master' into s3queue 2023-08-01 18:42:32 +02:00
Kseniia Sumarokova
dbc11b83fd
Merge branch 'master' into kssenii-patch-6 2023-08-01 18:40:20 +02:00
Antonio Andelic
e366ca61f5 Merge branch 'master' into add-reading-from-archives 2023-08-01 15:33:20 +00:00
Vitaly Baranov
65bd8f5e81
Merge branch 'master' into backups-fix-tmp-files 2023-08-01 16:37:06 +02:00
Antonio Andelic
c24dc8e64e Multithreaded read of files from archives: 2023-08-01 13:48:49 +00:00
Sergei Trifonov
01196ac41f
Merge branch 'master' into concurrency-control-controllable 2023-08-01 15:40:50 +02:00
Alexey Milovidov
4578d43f79
Merge pull request #52656 from Avogar/rename-setting-for-url-encoding 
Rename setting disable_url_encoding to enable_url_encoding and add a test
 2023-08-01 16:09:01 +03:00
János Benjamin Antal
a6861ea2f5
Merge pull request #52386 from ybogo/support-predefined-macro-in-kafka-settings 
Add predefined macros support in Kafka engine settings
 2023-08-01 14:49:01 +02:00
kssenii
a14a6b56b3 Better 2023-08-01 14:31:05 +02:00
Andrey Zvonov
791c5b1393
Merge branch 'master' into zvonand-globs-small-fix 2023-08-01 14:00:57 +02:00
alesapin
0ee9797fb8
Merge pull request #51141 from ClickHouse/azure_blob_storage_sas_token 
Azure blob storage sas token
 2023-08-01 12:27:17 +02:00
kssenii
08f5ebf3e8 Fix test 2023-08-01 12:19:15 +02:00
kssenii
be458fd44b Fix style check 2023-08-01 12:06:25 +02:00
Kseniia Sumarokova
ccf9fa9641
Update ReadBufferFromHDFS.cpp 2023-08-01 11:55:08 +02:00
Nikolai Kochetov
433219e931
Update src/Storages/MergeTree/localBackup.cpp 
Co-authored-by: Sergei Trifonov <sergei@clickhouse.com>
 2023-08-01 11:50:56 +02:00
Kseniia Sumarokova
5880a0a372
Update ReadBufferFromHDFS.cpp 2023-08-01 11:50:31 +02:00
robot-ch-test-poll4
5b67cff6b2
Merge pull request #52829 from ClickHouse/throw-s3-exception-whenever-possible 
Throw S3Exception whenever possible.
 2023-08-01 04:35:27 +02:00
zvonand
e851be78bc fix fs_error on attempt to read unavailable dirs 2023-07-31 23:56:07 +02:00
Nikolai Kochetov
453463ba22 Cleaup on every iteration. 2023-07-31 19:47:23 +00:00
kssenii
75f6a50079 Add todo 2023-07-31 20:08:31 +02:00
kssenii
870a506a0b Some fixes 2023-07-31 20:07:23 +02:00
Nikolai Kochetov
c4a00b8c68 Throw S3Exception whenever possible. 2023-07-31 15:39:20 +00:00
Vitaly Baranov
f5ffef4014
Merge pull request #52658 from arenadata/ADQM-984 
Add s3_storage_class parameter in SETTINGS of BACKUP statement
 2023-07-31 17:32:12 +02:00
ltrk2
e869adf645 Improve function naming 2023-07-31 06:48:50 -07:00
kssenii
c13fdca23e Merge remote-tracking branch 'upstream/master' into s3queue 2023-07-31 15:32:56 +02:00
Kseniia Sumarokova
74c0574d51
Update ReadBufferFromHDFS.cpp 2023-07-31 15:22:16 +02:00
ltrk2
538349603d
Merge branch 'master' into feature/mergetree-checksum-on-big-endian 2023-07-31 09:18:53 -04:00
yariks5s
964e4311c3 reviewed changes 2023-07-31 13:03:56 +00:00
Antonio Andelic
9fb86f134b Fix tests 2023-07-31 12:04:27 +00:00
kssenii
5d167b4f03 Merge remote-tracking branch 'upstream/master' into system-sync-cache 2023-07-31 12:44:11 +02:00
Antonio Andelic
7df5c83046 Merge branch 'master' into add-reading-from-archives 2023-07-31 09:27:01 +00:00
Alexey Milovidov
bd3af7ebe6
Merge pull request #52754 from ClickHouse/analyzer-set-index-not 
Analyzer: fix 00979_set_index_not.sql
 2023-07-31 12:13:59 +03:00
Antonio Andelic
df45602165 Refactoring 2023-07-31 08:50:09 +00:00
Kseniia Sumarokova
dd85c3c114
Update ReadBufferFromHDFS.cpp 2023-07-30 22:40:11 +02:00
Kseniia Sumarokova
8daeeedc8f
Merge pull request #52315 from xiedeyantu/add-alias 
system.events and system.metrics tables add column name as an alias to event and metric
 2023-07-30 22:37:31 +02:00
Anton Popov
0d8f852144
Merge pull request #52689 from CurtizJ/fix-extra-column-prewhere 
Fix reading of unnecessary column in case of multistage `PREWHERE`
 2023-07-30 15:30:53 +02:00
kssenii
20b76010ef Merge remote-tracking branch 'upstream/master' into kssenii-patch-6 2023-07-30 13:46:58 +02:00
Kseniia Sumarokova
08ef4d015c
Minor change 2023-07-30 13:36:52 +02:00
Kseniia Sumarokova
30b6cf0713
Merge branch 'master' into minor_improve_hdfs_read_buffer 2023-07-30 13:33:24 +02:00
Alexey Milovidov
91e67c105f
Merge pull request #52569 from ClickHouse/Realize_parameterized_view_as_new_storage_view 
Realize parameterized view as new view with parameters substitued
 2023-07-30 05:46:51 +03:00
robot-clickhouse-ci-2
2dd69844dd
Merge pull request #52716 from canhld94/ch_use_same_poll_for_attach_n_fetch 
Use same executor for GET_PART and ATTACH_PART
 2023-07-29 22:27:08 +02:00
Igor Nikonov
23bc6755df
Merge branch 'master' into analyzer-set-index-not 2023-07-29 18:17:55 +02:00
Maksim Kita
d82a834bec Planner prepare filters for analysis 2023-07-29 19:17:14 +03:00
Dmitry Novik
8f4527d9e0
Merge pull request #46740 from ClickHouse/query-tree-visitor 
Refactor Query Tree visitor
 2023-07-29 15:10:07 +02:00
Yury Bogomolov
ba081ed402
Merge branch 'master' into support-predefined-macro-in-kafka-settings 2023-07-29 15:00:21 +04:00
Smita Kulkarni
553304a81a Fixed clang tidy build by removing unued variable 2023-07-29 11:15:56 +02:00
Alexey Milovidov
9a8077265d
Merge branch 'master' into ch_use_same_poll_for_attach_n_fetch 2023-07-29 05:19:22 +03:00
Igor Nikonov
1c6ef97b33 Merge remote-tracking branch 'origin/master' into analyzer-set-index-not 2023-07-28 23:43:15 +00:00
Igor Nikonov
45b9614224 Remove debug logging 2023-07-28 23:42:58 +00:00
Igor Nikonov
2a40bc9055 Fix: __bitSwapLastTwo was applied to non BoolMask 
- ActionsDAG was missing convertions to BoolMask - __bitWrapperFunc
 2023-07-28 23:29:59 +00:00
ltrk2
6c9a1b14ef
Merge branch 'master' into feature/mergetree-checksum-big-endian-support 2023-07-28 16:18:46 -04:00
ltrk2
cace04cc58
Merge branch 'master' into feature/mergetree-checksum-on-big-endian 2023-07-28 15:52:53 -04:00
Yury Bogomolov
b2ee4505fb review fixes 2023-07-28 16:06:03 +00:00
pufit
6211845ef0
Merge pull request #51303 from ClickHouse/deprecate-metadata-cache 
Deprecate the `metadata_cache` feature
 2023-07-28 10:31:02 -04:00
Dmitry Novik
e882adbc2b Merge remote-tracking branch 'origin/master' into query-tree-visitor 2023-07-28 14:22:42 +00:00
Alexander Tokmakov
39200606ec
Merge pull request #52174 from arenadata/ADQM-988 
Added possibility to save logs on crash and options to configure logs buffer
 2023-07-28 16:55:00 +03:00
yariks5s
96df21bbf5 implemented for all tables, fixed style and fast test 2023-07-28 13:35:13 +00:00
Antonio Andelic
e83e0ec2cd Fix build 2023-07-28 12:26:56 +00:00
Antonio Andelic
720d587e85 Merge branch 'master' into add-reading-from-archives 2023-07-28 08:49:00 +00:00
Alexey Gerasimchuck
63b05da1f2 System logs improvements 2023-07-28 07:23:34 +00:00
robot-ch-test-poll3
d6e2e8b92c
Merge pull request #52653 from azat/virtual-columns-or 
RFC: Fix filtering by virtual columns with OR expression
 2023-07-28 09:18:36 +02:00
Roman Vasin
cfa06725cc
Merge branch 'master' into ADQM-984 2023-07-28 10:15:27 +03:00
Duc Canh Le
97e63d523f use same executor for GET_PART and ATTACH_PART 2023-07-28 07:08:11 +00:00
Dmitry Novik
18c1fd6f08 Refactor InDepthQueryTreeVisitorWithContext 2023-07-27 21:24:39 +00:00
Al Korgun
ebbd662071
Merge branch 'ClickHouse:master' into fix-named-collections-on-cluster-23.7 2023-07-27 23:31:35 +03:00
Han Fei
4f9075e819
Merge pull request #52623 from hanfei1991/hanfei/MergeTreeDeduplicationLog 
Fix stress test: check if storage shutdown before we operate MergeTreeDeduplicationLog
 2023-07-27 20:50:17 +02:00
yariks5s
da53bca6e4 added tests 2023-07-27 18:29:50 +00:00
Azat Khuzhin
d40dbdee62 Fix usage of temporary directories during RESTORE 
Previously during RESTORE you may get the following warning in logs:

    <Warning> TemporaryFileOnDisk: Temporary path 'tmp/21672kaaaaa' does not exist in './disks/s3_common_disk/'

The reason is that it uses not disks/s3_common_disk/tmp but instead
disks/s3_common_disk/disks/s3_common_disk/tmp path.

Fix this by adding TemporaryFileOnDisk::getRelativePath() and use it
when appropriate.

And now - `find disks`, does not shows any more temporary leftovers.

v2: rename getPath to getAbsolutePath
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-07-27 19:24:54 +02:00
Raúl Marín
05427c2983 Style 2023-07-27 18:31:02 +02:00
Anton Popov
dfc06d2714 fix reading of unneded column in case of multistage prewhere 2023-07-27 16:15:23 +00:00
Raúl Marín
5c217467e8 Unify retries under checkQuorumPrecondition 2023-07-27 17:52:10 +02:00
Raúl Marín
3a831adcfb Improve retries on keeper session expiration 2023-07-27 17:37:04 +02:00
Azat Khuzhin
68aed0d16e RFC: Fix filtering by virtual columns with OR expression 
Virtual columns did not supports queries with OR, for example query like
this (here `m` is the `Merge` table, see the test):

    select key from m where (value = 10 and _table = 'v1') or (value = 20 and _table = 'v1');

Will always leads to:

    Cannot find column `value` in source stream, there are only columns ...

The reason for this is that it actually executes the following queries:

    SELECT key, value FROM default.d1 WHERE ((value = 10) AND ('v1' = 'v1')) OR ((value = 20) AND ('v1' = 'v1'));
    SELECT key FROM default.d2 WHERE 0;

And this kind of filtering is used not only for `Merge` table but also:
- `_table` for `Merge` (already mentioned)
- `_file` for `File`
- `_idx` for `S3`
- and as well as filtering `system.*` tables by `database`/`table`/...

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-07-27 16:35:17 +02:00
Azat Khuzhin
5611b2fff4 Add a note about not working _table filter for Merge with analyzer 
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-07-27 16:35:17 +02:00
Han Fei
9488567bf6
Update src/Storages/MergeTree/MergeTreeDeduplicationLog.cpp 2023-07-27 16:28:08 +02:00
Han Fei
f6ca013c53
Update src/Storages/MergeTree/MergeTreeDeduplicationLog.cpp 2023-07-27 16:28:00 +02:00
Han Fei
0d44d527ef
Update src/Storages/MergeTree/MergeTreeDeduplicationLog.cpp 
Co-authored-by: Alexander Tokmakov <tavplubix@gmail.com>
 2023-07-27 16:27:04 +02:00
Han Fei
f5dfb70f5c
Update src/Storages/MergeTree/MergeTreeDeduplicationLog.cpp 2023-07-27 16:12:20 +02:00
Han Fei
ce38d3c5ea address comment 2023-07-27 16:11:08 +02:00
Alexey Milovidov
671128140d Update autogenerated version to 23.8.1.1 and contributors 2023-07-27 15:34:05 +02:00
Alexander Tokmakov
f3dc6dd061
Revert "Added field refcount to system.remote_data_paths table" 2023-07-27 15:23:57 +03:00
avogar
b5fc34b770 Rename setting disable_url_encoding to enable_url_encoding and add a test 2023-07-27 12:20:33 +00:00
Alexander Tokmakov
228de12d94
Update ReplicatedMergeTreeQueue.cpp (#52648) 2023-07-27 13:59:23 +03:00
Alexey Milovidov
17b647f6b1
Merge pull request #52518 from CurtizJ/add-refcount-to-system-table 
Added field `refcount` to `system.remote_data_paths` table
 2023-07-27 12:13:24 +03:00
robot-ch-test-poll1
abc48a0b73
Merge pull request #52627 from ClickHouse/fix_build_with_clang15 
Fix build with clang-15
 2023-07-27 09:49:29 +02:00
Al Korgun
f026ccf11e
Merge branch 'ClickHouse:master' into fix-named-collections-on-cluster-23.7 2023-07-27 10:48:25 +03:00
robot-clickhouse
ddab6590b2
Merge pull request #52626 from ClickHouse/fix_deadlock_in_persistent_table_functions 
Fix deadlocks in StorageTableFunctionProxy
 2023-07-27 09:38:48 +02:00
Илья Коргун
5395d34fd7 Fix missing constructor call 2023-07-27 10:32:10 +03:00
robot-ch-test-poll1
a5e073ff7d
Merge pull request #52602 from CheSema/finalize-gindexstore 
GinIndexStore: fix a bug when files are finalizated after first write,
 2023-07-27 08:31:24 +02:00
robot-clickhouse-ci-1
b6bcc32acb
Merge pull request #52606 from nickitat/port_use_prewhere_cols 
Port one more optimisation to `MergeTreePrefetchedReadPool`
 2023-07-27 00:03:47 +02:00
Alexander Tokmakov
74f3e76b18 fix build with clang-15 2023-07-26 17:15:28 +02:00
Alexander Tokmakov
2479f1352a fix deadlocks in StorageTableFunctionProxy 2023-07-26 17:11:28 +02:00
chen
6bb1a3005e
Merge branch 'ClickHouse:master' into add-alias 2023-07-26 22:29:32 +08:00
Han Fei
dccbe875d2 check if storage shutdown before we operate MergeTreeDeduplicationLog 2023-07-26 15:37:58 +02:00
Sema Checherinda
1854a21fbd
Merge branch 'master' into finalize-gindexstore 2023-07-26 16:23:58 +03:00
Kruglov Pavel
0d34e97dbe
Merge branch 'master' into formats-with-subcolumns 2023-07-26 13:30:35 +02:00
Kruglov Pavel
15cc046883
Merge branch 'master' into better-progress-bar-2 2023-07-26 13:12:24 +02:00
Anton Popov
45542fd712
Merge branch 'master' into fix-drop-of-projection 2023-07-26 12:55:18 +02:00
Nikita Taranov
017d34d40f determine task size by prewhere columns 2023-07-26 12:54:50 +02:00
Roman Vasin
2cf79ac592 Merge branch 'master' of github.com:ClickHouse/ClickHouse into ADQM-984 2023-07-26 09:58:26 +00:00
Alexander Tokmakov
6bbed6262e
Merge branch 'master' into add_delay_for_replicated 2023-07-26 12:48:48 +03:00
Sema Checherinda
991584506f fix a bug when files are finalizated after first write 2023-07-26 12:42:18 +04:00
Nikita Mikhaylov
1dc9ca2c24
Merge pull request #52549 from ClickHouse/whitespace-before-comma 
Check for punctuation
 2023-07-25 20:30:36 +02:00
Anton Popov
2c7c38950d better check for lightweight deletes 2023-07-25 14:21:12 +00:00
Alexander Tokmakov
328d0a5269 fix 2023-07-25 14:50:27 +02:00
Anton Popov
568afbbec3 added field with refcount to system.remote_data_paths table 2023-07-25 12:33:15 +00:00
Smita Kulkarni
22fec136c1 Create new StorageView with substituted parameters for every SELECT query of a parameterized view 2023-07-25 14:04:55 +02:00
robot-ch-test-poll4
fe6cd14a48
Merge pull request #52527 from Algunenano/mergetree_cleanup 
Remove unused code
 2023-07-25 07:41:42 +02:00
Alexey Milovidov
21382afa2b Check for punctuation 2023-07-25 06:10:04 +02:00
Alexey Milovidov
168b84a592
Merge pull request #52337 from Avogar/no-decode-url 
Allow to disable decoding/encoding path in uri in URL engine
 2023-07-25 05:43:06 +03:00
Alexander Tokmakov
edc479bbf8 fix 2023-07-24 23:40:27 +02:00
Alexey Milovidov
3c034d563b
Merge pull request #52068 from azat/replicated-cluster-prep1 
Preparations for Trivial Support For Resharding (part1)
 2023-07-24 22:57:44 +03:00
Kseniia Sumarokova
265e1437a3
Merge branch 'master' into add-alias 2023-07-24 21:52:41 +02:00
Kseniia Sumarokova
e05e0ec557
Merge pull request #52318 from valbok/utf8-names 
MaterializedMySQL: Support unquoted utf-8 strings in DDL
 2023-07-24 21:49:33 +02:00
Kruglov Pavel
fec5675cd4
Merge branch 'master' into better-progress-bar-2 2023-07-24 19:59:38 +02:00
Alexander Tokmakov
032956dd1e fix 2023-07-24 18:42:02 +02:00
Alexey Milovidov
01993bef5b
Merge pull request #52489 from ClickHouse/incbin 
Faster startup of clickhouse-client and clickhouse-local
 2023-07-24 18:42:24 +03:00
Anton Popov
fbe9f8d0f6 fix recalculation of skip indexes and projcetion in ALTER DELETE 2023-07-24 14:14:12 +00:00
Alexander Tokmakov
faca49a905 Merge branch 'master' into add_delay_for_replicated 2023-07-24 16:07:38 +02:00
Nikolay Degterinsky
40652cf2de
Merge pull request #51899 from evillique/describe-table-settings 
Allow SETTINGS before FORMAT in DESCRIBE TABLE query
 2023-07-24 15:24:41 +02:00
Raúl Marín
c7239c64ea Remove unused code 2023-07-24 15:16:44 +02:00
Anton Popov
2471b032ab fix lightweight delete after drop of projection 2023-07-24 09:52:49 +00:00
Val Doroshchuk
efa638ef3c MaterializedMySQL: Support unquoted utf-8 strings in DDL 
Since ClickHouse does not support unquoted utf-8 strings but MySQL does.

Instead of fixing Lexer to recognize utf-8 chars as TokenType::BareWord,
suggesting to quote all unrecognized tokens before applying any DDL.

Actual parsing and validating the syntax will be done by particular Parser.

If there is any TokenType::Error, the query is unable to be parsed anyway.
Quoting such tokens can provide the support of utf-8 names.

See `tryQuoteUnrecognizedTokens` and `QuoteUnrecognizedTokensTest`.

mysql> CREATE TABLE 道.渠(...

is converted to

CREATE TABLE `道`.`渠`(...

Also fixed the bug with missing * while doing SELECT in full sync because db or table name are back quoted when not needed.
 2023-07-24 11:12:10 +02:00
Alexey Milovidov
f17844e9c2
Merge pull request #51037 from azat/dist/optimize_skip_unused_shards-join-fix 
Fix optimize_skip_unused_shards with JOINs
 2023-07-24 08:31:00 +03:00
Azat Khuzhin
4a33e027c5 Split StorageReplicatedMergeTree reading methods 
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-07-24 05:50:44 +02:00
Azat Khuzhin
83c0f03b98 Change signature of the updateSettingsForCluster() to avoid cluster requirement 
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-07-24 05:50:44 +02:00
Azat Khuzhin
d7f7f16fbc Introduce IStorage::supportsTrivialCountOptimization() 
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-07-24 05:50:44 +02:00
Alexey Milovidov
a1a79eee0f
Merge pull request #51383 from ClickHouse/fix-potentially-bad-code 
Remove suspicious code
 2023-07-24 06:46:31 +03:00
Alexey Milovidov
eb5038f3e9
Merge pull request #52295 from ClickHouse/allow_vertical_merges_from_compact_to_wide_parts 
Enable `allow_vertical_merges_from_compact_to_wide_parts` by default
 2023-07-24 06:44:33 +03:00
Alexey Milovidov
a17652a422 Merge branch 'master' into incbin 2023-07-24 05:33:52 +02:00
Alexey Milovidov
1bc83afa54
Merge branch 'master' into fix-potentially-bad-code 2023-07-24 03:02:57 +03:00
Alexey Milovidov
890bda177d Merge branch 'master' into allow_vertical_merges_from_compact_to_wide_parts 2023-07-24 00:57:48 +02:00
kssenii
f207e5bf11 Add TODO 2023-07-24 00:31:37 +02:00
Alexey Milovidov
1e467867e6 Attempt to fix LTO 2023-07-24 00:03:40 +02:00
Alexey Milovidov
7ff3579115
Merge pull request #49631 from ClickHouse/sparse-columns-by-default 
Enable Sparse columns by default
 2023-07-23 21:18:05 +03:00
SmitaRKulkarni
74e7ff9628
Merge branch 'master' into azure_blob_storage_sas_token 2023-07-23 18:21:06 +02:00
Alexey Milovidov
c8f8a23c71 Fix errors 2023-07-23 06:11:03 +02:00
Alexey Milovidov
4170d1458b Use incbin for resources, part 2 2023-07-23 06:11:03 +02:00
Alexey Milovidov
00d6f2ee08 Use incbin for resources, part 1 2023-07-23 06:11:03 +02:00
Alexey Milovidov
d9d8782684
Merge branch 'master' into dist/optimize_skip_unused_shards-join-fix 2023-07-23 01:29:38 +03:00
alesapin
d1fa105d60
Merge branch 'master' into add_delay_for_replicated 2023-07-23 00:12:29 +02:00
Igor Nikonov
2d33661594
Merge branch 'master' into fix-potentially-bad-code 2023-07-22 22:48:07 +02:00
robot-ch-test-poll3
c9eb144e15
Merge pull request #50826 from ucasfl/is_obsolete 
Add a column is_obsolete to system.settings and similar tables
 2023-07-22 22:43:11 +02:00
Alexey Milovidov
b869466a6a
Merge branch 'master' into sparse-columns-by-default 2023-07-22 19:34:29 +03:00
Kseniia Sumarokova
d34f2bed07
Merge pull request #51386 from bigo-sg/fix_hdfs_read_buffer_heap_overflow 
Fix heap overflow in read buffer from hdfs when read_until_position is not zero
 2023-07-22 15:00:58 +02:00
Kseniia Sumarokova
234a0fa7bc
Merge branch 'master' into add-alias 2023-07-22 14:48:49 +02:00
kssenii
4fc3d0b290 Merge remote-tracking branch 'upstream/master' into s3queue 2023-07-22 14:45:38 +02:00
Kseniia Sumarokova
6ea96f0686
Merge branch 'master' into minor_improve_hdfs_read_buffer 2023-07-22 14:37:56 +02:00
alesapin
6416fb6eed
Merge branch 'master' into add_delay_for_replicated 2023-07-22 12:11:39 +02:00
Azat Khuzhin
20625d75ab Fix optimize_skip_unused_shards with JOINs 
In case of JOIN query may contains conditions for other tables, while
optimize_skip_unused_shards was pretty dumb and failed to skip such
columns.

Fix this by removing JOIN before applying this optimization.

v2: restriction for analyzer
v3: ignore 01940_custom_tld_sharding_key under analyzer
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
Co-Authored-By: Alexey Milovidov <milovidov@clickhouse.com>
 2023-07-22 07:45:33 +02:00
Alexey Milovidov
9dc988981e
Merge branch 'master' into is_obsolete 2023-07-22 04:59:26 +03:00
Alexey Milovidov
8e04503d1c
Merge pull request #52325 from azat/mergetree-log-entries-time 
MergeTree/ReplicatedMergeTree should use server timezone for log entries
 2023-07-22 03:29:39 +03:00
robot-clickhouse
9280f4a9fd
Merge pull request #51958 from ClickHouse/prewhere_and_pk_columns 
Move conditions with columns from PK to the end of PREWHERE chain
 2023-07-22 00:05:41 +02:00
alesapin
ed97284bfa
Update src/Storages/StorageReplicatedMergeTree.cpp 2023-07-21 19:28:28 +02:00
Nikolai Kochetov
01cb502af3
Merge pull request #52151 from amosbird/fix_52075 
Fix incorrect projection analysis when aggregation expression contains monotonic functions
 2023-07-21 18:30:27 +02:00
Alexander Sapin
a2b170a18e Avoid exception which I didn't understand 2023-07-21 17:42:55 +02:00
Antonio Andelic
6ed97a944f
Merge pull request #49450 from myrrc/feature/keeper-dyn-reconf 
`reconfig` support for CH Keeper
 2023-07-21 15:59:25 +02:00
Nikolai Kochetov
b5cf644668
Check projection metadata the same way we check ordinary metadata. (#52361) 
* Check projection metadata the same way we check ordinary metadata.

* Allow aggregate projection to have empty PK

---------

Co-authored-by: Alexander Tokmakov <tavplubix@clickhouse.com>
 2023-07-21 16:23:04 +03:00
robot-clickhouse-ci-2
0db9c79886
Merge pull request #52332 from rschu1ze/better-formatsettings 
Minor: Less awkward IAST::FormatSettings
 2023-07-21 14:49:58 +02:00
robot-ch-test-poll4
62e01df545
Merge pull request #52104 from filimonov/last_removal_attempt_time_typo 
Fix typo last_removal_attemp_time
 2023-07-21 14:49:36 +02:00
Alexey Milovidov
dc0abd38a9
Merge pull request #52376 from Algunenano/hot_cold_zero_copy 
[RFC] Wait for zero copy replication lock even if some disks don't support it
 2023-07-21 15:28:41 +03:00
Antonio Andelic
59ad2d9acc
Merge branch 'master' into feature/keeper-dyn-reconf 2023-07-21 14:08:26 +02:00
ltrk2
90a2c460c6
Merge branch 'master' into feature/mergetree-checksum-big-endian-support 2023-07-21 08:07:18 -04:00
Alexander Tokmakov
d9161c7276
Merge pull request #52382 from ClickHouse/tavplubix-patch-8 
Less replication errors
 2023-07-21 14:58:25 +03:00
Kseniia Sumarokova
97c1b9d2cf
Merge branch 'master' into kssenii-patch-6 2023-07-21 13:56:28 +02:00
Kseniia Sumarokova
1c2fea4980
Merge pull request #52381 from ClickHouse/kssenii-patch-7 
Follow up to #49698
 2023-07-21 13:51:33 +02:00
Antonio Andelic
10c2d5dade
Merge branch 'master' into feature/keeper-dyn-reconf 2023-07-21 13:24:18 +02:00
Alexander Sapin
714a3a8d12 Don't do it on drop 2023-07-21 12:23:22 +02:00
Amos Bird
68e7583dbf
reorganize tests and add some comments 2023-07-21 14:54:51 +08:00
Amos Bird
9b0eb9cdd7
ignore ast opt when doing projection calc 2023-07-21 14:54:48 +08:00
Alexander Gololobov
fe7cff5c1c Added move_primary_key_columns_to_end_of_prewhere setting 2023-07-21 08:14:57 +02:00
Alexander Gololobov
51e81b37a4 Move condtions with columns from PK to the end of PREWHERE chain 2023-07-21 08:14:57 +02:00
Alexander Gololobov
06c1e686a4
Merge pull request #46365 from ClickHouse/split_prewhere_dag_test_enable 
Multi-stage PREWHERE enabled by default
 2023-07-21 08:13:55 +02:00
Yury Bogomolov
c8b128aad4 add predefined macros support in kafka engine settings 2023-07-21 01:06:49 +04:00
Alexander Tokmakov
09e6bbc0e2
Update DataPartsExchange.cpp 2023-07-20 21:10:59 +03:00
Kseniia Sumarokova
045ecdf71f
Update src/Storages/PostgreSQL/MaterializedPostgreSQLConsumer.cpp 
Co-authored-by: Alexander Tokmakov <tavplubix@clickhouse.com>
 2023-07-20 19:03:06 +02:00
Kseniia Sumarokova
500f1e6757
Follow up to #49698 2023-07-20 18:55:41 +02:00
kssenii
d2195cff11 Small fixes 2023-07-20 18:21:37 +02:00
Raúl Marín
13f8d72f54 Wait for zero copy replication lock even if some disks don't support it 2023-07-20 18:04:26 +02:00
robot-ch-test-poll
21f22c4043
Merge pull request #49698 from kssenii/fix-pg-sync-tables-exception-broken-sync 
Fix materialised pg syncTables
 2023-07-20 15:38:18 +02:00
Nikita Mikhaylov
668062dc29
Merge branch 'master' into no-keep-context-lock-while-calculating-access 2023-07-20 14:42:13 +02:00
avogar
fe934d3059 Make better 2023-07-20 12:38:41 +00:00
Nikita Mikhaylov
b8f73db4d1
Merge branch 'master' into happy_grandma 2023-07-20 14:26:31 +02:00
Alexander Tokmakov
2b29e3dc83
Update MergeTreeBackgroundExecutor.cpp (#52261) 2023-07-20 14:22:22 +03:00
Robert Schulze
bd761c365a
Make serializeAST() more regular 2023-07-20 10:39:26 +00:00
Alexander Gololobov
03a890f91c
Merge branch 'master' into filter_system_databases 2023-07-20 12:38:15 +02:00
Robert Schulze
25ddcc256b
Make IAST::FormatSettings more regular, pt. III 2023-07-20 10:34:05 +00:00
Robert Schulze
9933589c56
Merge pull request #52312 from rschu1ze/beautify-system-query-cache 
Beautify pretty-printing of the query string in SYSTEM.QUERY_CACHE
 2023-07-20 12:20:04 +02:00
Nikita Mikhaylov
ec20786940
Merge pull request #52347 from vitlibar/zooKeeper-retries-control-rethrows-with-original-callstack 
ZooKeeperRetriesControl rethrows with original callstack
 2023-07-20 12:14:04 +02:00
Vitaly Baranov
27ca367b2c ZooKeeperRetriesControl rethrows with original callstack. 2023-07-20 10:25:38 +02:00
avogar
2b8e4ebd4c Allow to disable decoding/encoding path in uri in URL engine 2023-07-19 19:48:39 +00:00
ltrk2
ba4072f049 Adapt changes around SipHash 2023-07-19 10:01:58 -07:00
ltrk2
51e2c58a53 Implement endianness-independent SipHash and MergeTree checksum serialization 2023-07-19 10:01:55 -07:00
ltrk2
dd411d8f54 Implement endianness-indepedent support for MergeTree checksums 2023-07-19 09:18:13 -07:00
Alexander Sapin
544081163d Remove redundant deactivate 2023-07-19 17:21:01 +02:00
Han Fei
6bbdf702ae
Merge branch 'master' into hanfei/support-insert-token 2023-07-19 17:05:12 +02:00
alesapin
b34655e743
Update src/Storages/StorageReplicatedMergeTree.cpp 
Co-authored-by: Alexander Tokmakov <tavplubix@clickhouse.com>
 2023-07-19 17:05:03 +02:00
Nikita Mikhaylov
4a3f5234af
Merge pull request #51038 from evillique/headers-blacklist 
Add HTTP header filtering
 2023-07-19 15:49:12 +02:00
Azat Khuzhin
53818dde8c MergeTree/ReplicatedMergeTree should use server timezone for log entries 
Otherwise session_timezone/use_client_time_zone will break things

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-07-19 15:25:15 +02:00
Robert Schulze
3eb23d899f
Merge remote-tracking branch 'rschu1ze/master' into beautify-system-query-cache 2023-07-19 12:55:09 +00:00
alesapin
45a7134478
Merge branch 'master' into feature/keeper-dyn-reconf 2023-07-19 14:04:59 +02:00
alesapin
f8fa79c30f
Merge branch 'master' into fix_test_producing_no_such_key 2023-07-19 11:59:23 +02:00
xiedeyantu
d0e886070c system.events and system.metrics tables add column name as an alias to event and metric 2023-07-19 17:39:00 +08:00
Robert Schulze
f22452c78c
Beautify pretty-printing of the query string in SYSTEM.QUERY_CACHE. 
Output of SYSTEM.QUERY_CACHE

- before this PR:

    SELECT * FROM system.query_cache

    Query id: 4989008b-b84c-4e57-bfe5-7fb551814812

    Row 1:
    ──────
    query:   	   SELECT 1 SETTINGS
    [...]

- after this PR:

    SELECT * FROM system.query_cache

    Query id: 4989008b-b84c-4e57-bfe5-7fb551814812

    Row 1:
    ──────
    query:   	   SELECT 1 SETTINGS use_query_cache = 1
    [...]
 2023-07-19 09:10:26 +00:00
Sema Checherinda
ed5310ce48
Merge branch 'master' into last_removal_attempt_time_typo 2023-07-19 10:23:25 +02:00
Han Fei
e8be6ec23f
Merge branch 'master' into hanfei/support-insert-token 2023-07-19 10:06:03 +02:00
SmitaRKulkarni
4456adfd4a
Merge branch 'master' into azure_table_function_cluster 2023-07-19 08:28:30 +02:00
robot-clickhouse-ci-1
32b765a4ba
Merge pull request #50559 from zvonand/zvonand-issue-49290 
Add support for multi-directory globs
 2023-07-19 06:24:38 +02:00
Alexey Milovidov
d666272b76 Enable allow_vertical_merges_from_compact_to_wide_parts by default 2023-07-19 05:29:12 +02:00
Alexey Milovidov
6a61786959 Merge branch 'master' into sparse-columns-by-default 2023-07-19 01:07:59 +02:00
Kseniia Sumarokova
1545ad3389
Merge branch 'master' into fix-pg-sync-tables-exception-broken-sync 2023-07-18 23:19:01 +02:00
Alexey Milovidov
6fd27b6cd8 Fix build 2023-07-18 22:19:35 +02:00
Alexey Milovidov
8cd2e7c7d6 Merge branch 'master' into fix-potentially-bad-code 2023-07-18 22:18:22 +02:00
alesapin
0502a4c73e Set startup event during shutdown 2023-07-18 19:09:01 +02:00
Smita Kulkarni
342af64428 Fixed issue when multiple requests attempt to create same container 2023-07-18 18:20:03 +02:00
alesapin
cf0b58a831
Merge pull request #52197 from ClickHouse/fix_sticky_mutations_test 
Fix sticky mutations test (and extremely rare race condition)
 2023-07-18 16:49:31 +02:00
avogar
3682254342 Fix hdfs tests 2023-07-18 13:49:23 +00:00
alesapin
24cf163e61 Merge branch 'master' into add_delay_for_replicated 2023-07-18 15:37:32 +02:00
alesapin
66531965f9
Merge pull request #52218 from ClickHouse/avoid_zero_copy 
Use one copy replication more agressively
 2023-07-18 14:46:52 +02:00
alesapin
f3f62097e5
Merge branch 'master' into fix_sticky_mutations_test 2023-07-18 14:46:24 +02:00
Ilya Yatsishin
73246b4788
Merge pull request #52056 from ClickHouse/ignore-create-index-query 
Allow to ignore CREATE INDEX query for better SQL syntax compatibility
 2023-07-18 14:40:38 +02:00
Nikolai Kochetov
58c5e91047
Merge pull request #52152 from amosbird/add_optimize_use_implicit_projections 
Disable implicit projections by default
 2023-07-18 14:32:04 +02:00
alesapin
c752acf3fc
Merge branch 'master' into avoid_zero_copy 2023-07-18 14:07:52 +02:00
Kruglov Pavel
64e88cde21
Merge branch 'master' into better-progress-bar-2 2023-07-18 13:37:53 +02:00
kssenii
353b0f817a Merge remote-tracking branch 'origin/fix-pg-sync-tables-exception-broken-sync' into fix-pg-sync-tables-exception-broken-sync 2023-07-18 12:26:17 +02:00
kssenii
0cfd12aba4 Fix 2023-07-18 12:24:04 +02:00
Raúl Marín
169c90a8c5 Merge remote-tracking branch 'blessed/master' into happy_grandma 2023-07-18 11:01:26 +02:00
Alexander Gololobov
44595b98d0 Update src/Storages/System/StorageSystemDatabases.cpp 
Co-authored-by: Nikolay Degterinsky <43110995+evillique@users.noreply.github.com>
 2023-07-18 08:25:38 +02:00
Alexander Gololobov
2f6bf4590b Filter databases list before querying potentially slow fields 2023-07-18 08:25:37 +02:00
Amos Bird
d8dd480cd7
Disable implicit projections by default 2023-07-18 09:50:41 +08:00
Alexey Milovidov
ffc6f246bf Merge branch 'master' into sparse-columns-by-default 2023-07-18 01:36:52 +02:00
Han Fei
4043174a81 fix special build 2023-07-17 23:46:45 +02:00
Nikolai Kochetov
a955d5621d Rename constants in KeyCondition analysis. 2023-07-17 18:53:12 +00:00
Alexander Sapin
2db14e36b4 Fix build 2023-07-17 19:15:07 +02:00
Kruglov Pavel
1dd05319b5
Merge branch 'master' into formats-with-subcolumns 2023-07-17 19:13:42 +02:00
Nikita Mikhaylov
ee0bbc0e54
Merge branch 'master' into headers-blacklist 2023-07-17 19:08:52 +02:00
Nikita Mikhaylov
11cc8b4adf
Merge branch 'master' into add_delay_for_replicated 2023-07-17 19:04:29 +02:00
Alexander Sapin
b70349852c Better message on timeout and fix test 2023-07-17 19:02:29 +02:00
Alexander Sapin
918e3f7712 Fix flaky test 2023-07-17 18:41:12 +02:00
SmitaRKulkarni
e4fb9e88f8
Merge branch 'master' into azure_table_function_cluster 2023-07-17 17:23:38 +02:00
SmitaRKulkarni
3bb7db45c4
Merge branch 'master' into azure_blob_storage_sas_token 2023-07-17 17:23:29 +02:00
Nikita Mikhaylov
0caa49d85f Fix build 2023-07-17 14:25:14 +00:00
kssenii
fe53cd3d74 Minor changes 2023-07-17 16:11:58 +02:00
Alexander Sapin
2ad1109dbd Avoid zero copy replication more agressively 2023-07-17 16:03:39 +02:00
Andrey Zvonov
d339c22a2f
Merge branch 'master' into zvonand-issue-49290 2023-07-17 16:43:15 +03:00
Vitaly Baranov
815a3857de Remove non-const function Context::getClientInfo(). 2023-07-17 15:02:07 +02:00
Nikita Mikhaylov
d5b97e4cc1
Merge branch 'master' into deprecate-metadata-cache 2023-07-17 15:00:27 +02:00
Nikita Mikhaylov
01cd7a1fd7 Better 2023-07-17 12:59:58 +00:00
Han Fei
b75c4ae2e5 Merge branch 'master' into hanfei/support-insert-token 2023-07-17 14:57:48 +02:00
kssenii
7359dd518f Merge remote-tracking branch 'upstream/master' into s3queue 2023-07-17 14:23:12 +02:00
Alexander Sapin
477b8f04b6 Fix sticky mutations test (and extremely rare race condition) 2023-07-17 13:09:34 +02:00
Antonio Andelic
61dc020b4d
Merge branch 'master' into feature/keeper-dyn-reconf 2023-07-17 12:50:17 +02:00
Raúl Marín
41bdcdabfa Create ZK ancestors optimistically 2023-07-17 12:02:32 +02:00
Kseniia Sumarokova
200dfc24b6
Merge branch 'master' into fix-pg-sync-tables-exception-broken-sync 2023-07-17 11:53:42 +02:00
Sergei Trifonov
381ab07e1b
Merge pull request #51496 from yariks5s/add-index-bytes-to-system-parts 
Add column primary_key_size to system.parts
 2023-07-17 10:39:56 +02:00
Alexey Milovidov
09b300cf07
Merge pull request #52143 from ClickHouse/remove-default-value 
Remove default argument value
 2023-07-16 19:22:30 +03:00
Alexander Gololobov
2f9043f16c Properly deal with columns computed at previous steps 2023-07-16 08:24:12 +02:00
robot-ch-test-poll
3b0a4040cd
Merge pull request #51876 from evillique/fix-mongodb-inserts 
Fix inserts into MongoDB tables
 2023-07-16 05:28:43 +02:00
Alexey Milovidov
9a421369d7
Merge pull request #49709 from amosbird/fix_49695 
Fix projection with optimize_aggregators_of_group_by_keys
 2023-07-16 04:10:54 +03:00
Alexey Milovidov
7e6551dbd0
Merge branch 'master' into fix-mongodb-inserts 2023-07-16 01:47:52 +03:00
Alexey Milovidov
095624fbd1 Remove default argument value 2023-07-15 23:33:11 +02:00
Han Fei
7761e5ef9d support async_deduplicate_token for async insert 2023-07-15 14:42:08 +02:00
Mikhail Filimonov
575de8d497 Fix typo last_removal_attemp_time 2023-07-14 07:04:17 +02:00
Roman Vasin
6c3b7f76d4 Add S3 storage class as 4th parameter 2023-07-13 16:00:01 +00:00
Yatsishin Ilya
2ee7a9846f fix 2023-07-12 12:47:24 +00:00
Amos Bird
52246ab5b5
Ignore setting constraints for projection ASTs 2023-07-12 10:34:36 +08:00
Yarik Briukhovetskyi
9afafa9554
Merge branch 'master' into add-index-bytes-to-system-parts 2023-07-11 14:51:46 +02:00
李扬
6aec25e681
Merge branch 'master' into fix_hdfs_read_buffer_heap_overflow 2023-07-11 10:03:09 +08:00
pufit
77e45e5669 Add DROP ROLE ... FROM and CREATE ROLE ... AT syntax 2023-07-10 20:23:03 -04:00
Andrey Zvonov
c030e9dbe4
Merge branch 'master' into zvonand-issue-49290 2023-07-10 11:01:26 +02:00
Azat Khuzhin
5835e72fd6 More generic approach to disable native copy 
Previous patch implements this only for BACKUP/RESTORE, but it can be
useful for regular disks as well, so add allow_native_copy for disks.

Note, that there is s3_allow_native_copy query setting, since it looks
redundant, since it make sense only for S3 disks, and not on a per query
basis.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-07-09 08:20:02 +02:00
Alexey Milovidov
4c20d482ba
Merge branch 'master' into is_obsolete 2023-07-09 08:49:00 +03:00
Alexey Milovidov
612a785fd0
Merge pull request #51674 from ClickHouse/system_jemalloc 
System table with jemalloc stats
 2023-07-09 08:48:05 +03:00
Alexey Milovidov
84600287a6
Merge pull request #50066 from bigo-sg/improve_geohash 
Allow geoHashEncode when its arguments are mixed with const and non-const columns
 2023-07-09 08:44:35 +03:00
robot-ch-test-poll4
8b329e83bd
Merge pull request #51959 from ClickHouse/fixes_for_transactions2 
Fix some issues with transactions
 2023-07-09 06:55:27 +02:00
robot-clickhouse-ci-1
4666838a5d
Merge pull request #49438 from azat/build/unwind 
Force libunwind usage (removes gcc_eh support)
 2023-07-09 05:38:34 +02:00
Alexey Milovidov
3d4800995f
Merge pull request #49732 from nickitat/impr_prefetch 
Improve reading with prefetch
 2023-07-09 06:10:58 +03:00
Alexey Milovidov
e2c8cea381
Merge pull request #51801 from ClickHouse/fix_broken_parts_handling 
Fix broken parts handling in `ReplicatedMergeTree`
 2023-07-09 05:32:51 +03:00
Alexey Milovidov
ab93967fb4
Merge pull request #51171 from ClickHouse/retry 
Decrease default timeouts for S3 and HTTP requests
 2023-07-09 03:49:56 +03:00
Azat Khuzhin
a10aa9ad50 Force libunwind usage (removes gcc_eh support) 
libunwind is reentrant and signal safe, and works faster then then
gcc_eh (plus it has some custom patches for problems that have been
found during it's usage in ClickHouse).

gcc_eh may be missing in the system (if gcc was not installed), and
even if it exists clickhouse uses -nodefaultlibs, so some care should be
made to make it work.

Also this library is tiny and there shouln't be any problem to require
it always (there is already tendency to require some contrib libraries,
i.e. poco).

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-07-08 20:55:50 +02:00
Alexey Milovidov
52277d6252
Merge pull request #51363 from azat/clickhouse-local-default-settings 
Use separate default settings for clickhouse-local
 2023-07-08 19:37:27 +03:00
Alexander Tokmakov
44ae3a0986 fix a bug in projections 2023-07-08 16:13:07 +02:00
Alexander Tokmakov
df31034820 rollback merge tasks on exception 2023-07-08 14:03:08 +02:00
Alexey Milovidov
b1d1918607
Merge branch 'master' into retry 2023-07-08 03:08:48 +03:00
Alexey Milovidov
236ee81266
Merge pull request #51847 from canhld94/ch_fix_segfault 
Fix segfault when create invalid EmbeddedRocksdb table
 2023-07-08 02:50:11 +03:00
Andrey Zvonov
3e8d0249e8
Merge branch 'master' into zvonand-issue-49290 2023-07-07 14:10:37 +02:00
Alexander Gololobov
05649c7b38 Removed duplicate header 2023-07-07 13:22:52 +02:00
Alexander Sapin
e618dd05cc Fix clang tidy and race 2023-07-07 13:03:44 +02:00
Alexey Milovidov
4a6a6fc4f2
Merge branch 'master' into disks-space-improvement 2023-07-07 13:43:04 +03:00
Alexey Milovidov
b5f9a170eb
Merge pull request #51848 from ClickHouse/many-fixes-3 
Many fixes [3]
 2023-07-07 13:29:49 +03:00
Duc Canh Le
5d6fb7b7b0
Merge branch 'master' into ch_fix_segfault 2023-07-07 13:13:33 +08:00
Nikolay Degterinsky
e98d136243
Merge branch 'master' into headers-blacklist 2023-07-07 04:44:06 +02:00
Alexander Tokmakov
fdbd59ec6c
Merge pull request #51135 from ClickHouse/fix_trash_in_disks 
Try to fix some trash in Disks and part moves
 2023-07-07 02:02:17 +03:00
Mike Kot
8b6376005a "reconfig" support for CH Keeper 2023-07-07 00:20:54 +03:00
avogar
8d634c992b Fix tests 2023-07-06 17:47:01 +00:00
Alexander Tokmakov
58793816a7 fix paranoid check 2023-07-06 19:06:35 +02:00
Alexander Sapin
8cdb181c39 Reduce logging level 2023-07-06 17:52:31 +02:00
Igor Nikonov
83af43b8ba
Merge pull request #51852 from ClickHouse/fix-misleading-naming-in-joins 
Change misleading name in joins: addJoinedBlock -> addBlockToJoin
 2023-07-06 17:27:26 +02:00
Igor Nikonov
7c0e50c4d5
Merge branch 'master' into fix-misleading-naming-in-joins 2023-07-06 17:26:38 +02:00
Alexander Tokmakov
abf36065b7 fix 2023-07-06 17:24:06 +02:00
Alexander Sapin
9ae0dc730c Review fixes + enable in ci 2023-07-06 17:15:26 +02:00
Nikolay Degterinsky
67e2dee7e2 Allow SETTINGS before FORMAT in DESCRIBE TABLE query 2023-07-06 14:29:58 +00:00
Kruglov Pavel
06de25451a
Merge branch 'master' into formats-with-subcolumns 2023-07-06 16:21:52 +02:00
Alexey Milovidov
6d8434c702 Merge branch 'master' into many-fixes-3 2023-07-06 16:17:32 +02:00
Alexey Milovidov
1fa21700ad Merge remote-tracking branch 'origin/less-flaky-test_start_stop_moves' into many-fixes-3 2023-07-06 16:17:13 +02:00
avogar
810d1ee069 Fix tests 2023-07-06 13:48:57 +00:00
Alexander Sapin
30bcc73c63 Merge branch 'master' into add_delay_for_replicated 2023-07-06 14:29:15 +02:00
Kseniia Sumarokova
e97e107bcc
Merge branch 'master' into add-separate-access-for-use-named-collections 2023-07-06 12:16:53 +02:00
Smita Kulkarni
56e45ba384 Added test for select query when container does not exist 2023-07-06 11:17:04 +02:00
Andrey Zvonov
cc0210f760
Merge branch 'master' into zvonand-issue-49290 2023-07-06 11:13:51 +02:00
Smita Kulkarni
2d3a148ffd Added option to check if container exists before attempting to read/create it, added this flag for all table functions, only used in azureBlobStorage 2023-07-06 10:56:07 +02:00
Alexander Gololobov
1336a9ec67 Better naming 2023-07-06 09:09:55 +02:00
Nikolay Degterinsky
b9fffacc65 Fix build 2023-07-06 06:31:09 +00:00
Nikolay Degterinsky
546f12dc85 Fix inserts to MongoDB tables 2023-07-06 05:05:27 +00:00
Alexey Milovidov
2e454ef89e
Merge branch 'master' into disks-space-improvement 2023-07-06 03:58:45 +03:00
Alexey Milovidov
1a24bface0
Merge branch 'master' into clickhouse-local-default-settings 2023-07-06 03:30:11 +03:00
Alexey Milovidov
89788f3d5b
Merge branch 'master' into fix-potentially-bad-code 2023-07-06 02:23:28 +03:00
Alexey Milovidov
2c592a6a2c
Merge pull request #51805 from ClickHouse/fix_for_parallel_replicas_and_empty_header 
Fix for parallel replicas not completely disabled by granule count threshold
 2023-07-06 01:46:52 +03:00
Alexey Milovidov
b28fa1f054 Merge branch 'many-fixes-3' of github.com:ClickHouse/ClickHouse into many-fixes-3 2023-07-05 23:54:48 +02:00
Alexey Milovidov
9bcc85d60f Merge branch 'fix-drop-column-sparse' of github.com:CurtizJ/ClickHouse into many-fixes-3 2023-07-05 23:54:27 +02:00
alesapin
66484a4dd0
Merge branch 'master' into add_delay_for_replicated 2023-07-05 20:03:34 +02:00
Kruglov Pavel
60cf8a4c94
Merge branch 'master' into better-progress-bar-2 2023-07-05 19:58:55 +02:00
avogar
d11cd0dc30 Fix tests 2023-07-05 17:56:03 +00:00
Igor Nikonov
bf190381f5 addJoinedBlock -> addBlockToJoin 2023-07-05 17:03:18 +00:00
alesapin
f2d106ffb7 Fix typos 2023-07-05 18:54:33 +02:00
alesapin
2fa45117ed Beter 2023-07-05 18:38:04 +02:00
alesapin
88d3e1723a Fixes and comments 2023-07-05 18:31:47 +02:00
alesapin
baee73fd96 Make shutdown of replicated tables softer 2023-07-05 18:11:25 +02:00
Duc Canh Le
8f1ed5c90d add more check + line break 2023-07-05 15:04:38 +00:00
Duc Canh Le
1da413e64e fix segfault when create invalid EmbeddedRocksdb table 2023-07-05 14:56:11 +00:00
Alexander Gololobov
5512c307db system.jemalloc_bins table 2023-07-05 14:34:03 +02:00
Anton Popov
cf809c25cd fix CLEAR COLUMN query 2023-07-05 11:24:29 +00:00
kssenii
80dabd1346 Merge remote-tracking branch 'upstream/master' into system-sync-cache 2023-07-05 12:58:11 +02:00
yariks5s
ba4cbd388b
Merge branch 'master' into add-index-bytes-to-system-parts 2023-07-05 12:33:56 +02:00
Kseniia Sumarokova
dcda3576d2
Merge branch 'master' into add-separate-access-for-use-named-collections 2023-07-05 12:05:49 +02:00
李扬
bb301cfbb0
Merge branch 'master' into improve_geohash 2023-07-05 17:57:03 +08:00
李扬
d81e8ff705
Merge branch 'master' into fix_hdfs_read_buffer_heap_overflow 2023-07-05 15:43:50 +08:00
Anton Popov
ede63a0f4e fix drop column with enabled sparse columns 2023-07-05 00:30:28 +00:00
Alexey Milovidov
5bb504db1c
Merge branch 'master' into fix_storage_buffer_reschedule 2023-07-05 02:10:07 +03:00
Alexey Milovidov
a4abb81194
Merge branch 'master' into bgmem 2023-07-05 01:54:43 +03:00
Alexey Milovidov
69d8923c4c Merge branch 'master' into fix-potentially-bad-code 2023-07-05 00:46:24 +02:00
Alexander Gololobov
c0629a38d1 Fix for incorrect result when parallel replicas not completely disabled 2023-07-04 23:50:19 +02:00
Alexey Milovidov
3371e038cf
Merge pull request #51498 from ClickHouse/vdimir/test_alter_moving_garbage_51342 
Fix `test_alter_moving_garbage`: lock between getActiveContainingPart and swapActivePart in parts mover
 2023-07-05 00:32:21 +03:00
Kruglov Pavel
a2805f8f44
Merge branch 'master' into formats-with-subcolumns 2023-07-04 23:27:03 +02:00
avogar
98aa6b317f Support reading subcolumns from file/s3/hdfs/url/azureBlobStorage table functions 2023-07-04 21:17:26 +00:00
Alexander Tokmakov
607a8a1c46 fix 2023-07-04 22:52:59 +02:00
Alexander Tokmakov
42222662e6 Merge branch 'master' into fix_broken_parts_handling 2023-07-04 22:46:35 +02:00
Alexey Milovidov
31f68c2c67 Merge branch 'master' into deprecate-metadata-cache 2023-07-04 22:28:14 +02:00
alesapin
1ea5261012 Intermediate version 2023-07-04 22:19:53 +02:00
Alexey Milovidov
2c96580a77
Merge branch 'master' into concurrency-control-controllable 2023-07-04 23:16:04 +03:00
Alexey Milovidov
4e8405cbda Merge branch 'master' into disks-space-improvement 2023-07-04 22:00:40 +02:00
Alexander Tokmakov
d987b94ed4 fix the way how broken parts are detached 2023-07-04 20:51:15 +02:00
yariks5s
0d0e59abc8
Update IMergeTreeDataPart.cpp 2023-07-04 12:08:58 +02:00
yariks5s
0e4cd16582
Update include brackets 2023-07-04 11:53:23 +02:00
yariks5s
60c6cc17fc
Update include brackets 
Co-authored-by: Sergei Trifonov <svtrifonov@gmail.com>
 2023-07-04 11:39:39 +02:00
flynn
69d20c0458
Merge branch 'master' into is_obsolete 2023-07-04 16:46:25 +08:00
李扬
3b860cd685
Merge branch 'master' into fix_hdfs_read_buffer_heap_overflow 2023-07-04 10:04:57 +08:00
yariks5s
ad0bff919c
Merge branch 'master' into add-index-bytes-to-system-parts 2023-07-04 00:26:03 +02:00
Anton Popov
fd4a14d56b
Merge branch 'master' into system.parts_column_modification_time 2023-07-03 23:28:03 +02:00
Vitaly Baranov
8dd1b7b8b9
Merge branch 'master' into add-hex-functions-for-cityhash 2023-07-03 18:00:33 +02:00
Nikolay Degterinsky
82e0237e67
Merge branch 'master' into headers-blacklist 2023-07-03 16:54:50 +02:00
yariks5s
b4bc8fe353
Merge branch 'master' into add-index-bytes-to-system-parts 2023-07-03 16:03:05 +02:00
kssenii
ac77f5fe6f Merge remote-tracking branch 'upstream/master' into add-separate-access-for-use-named-collections 2023-07-03 13:55:45 +02:00
Alexander Gololobov
eff94f5100
Merge pull request #51610 from ClickHouse/fix_move_in_to_prewhere 
Fix for moving 'IN' conditions to PREWHERE
 2023-07-03 13:55:32 +02:00
Azat Khuzhin
22e44ced8a Add column modification time into system.parts_columns 
This can be useful to obtain at least some time for the part after
mutations, since mutations will change the modification time of all
parts.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-07-03 13:34:05 +02:00
Alexander Tokmakov
ce5ca7d2a5
Merge pull request #51502 from ClickHouse/fix_logical_error_on_mutation 
Fix a logical error on mutation
 2023-07-03 12:52:59 +03:00
Alexander Tokmakov
392b70d6f8
fix merge_selecting_task scheduling (#51591) 
Co-authored-by: Alexey Milovidov <milovidov@clickhouse.com>
 2023-07-02 19:30:18 +03:00
Alexander Tokmakov
43dba76cbf
Merge branch 'master' into fix_logical_error_on_mutation 2023-07-02 19:30:00 +03:00
Vitaly Baranov
35d1b8448b
Merge branch 'master' into add-hex-functions-for-cityhash 2023-07-02 01:32:54 +02:00
yariks5s
e0b581d418
Merge branch 'master' into add-index-bytes-to-system-parts 2023-07-01 23:23:09 +02:00
Antonio Andelic
4f5926153f
Merge branch 'master' into fix-async-insert-dedup-for-merging-algorithms 2023-07-01 20:59:06 +02:00
Alexander Gololobov
f36f981f15 Move adding CreateSets to the end of optimizations, after applying key conditions and indexes 2023-07-01 20:05:18 +02:00
Alexander Gololobov
05d399c0b3 Handle subqueries and sets when collecting table columns 2023-07-01 20:05:18 +02:00
Kseniia Sumarokova
a8e2eb9686
Merge branch 'master' into minor_improve_hdfs_read_buffer 2023-07-01 13:19:21 +02:00
Antonio Andelic
5e1cfb0531 Avoid copying block if optimize_on_insert is false 2023-07-01 08:53:23 +00:00
Antonio Andelic
0c31055663 Merge branch 'master' into fix-async-insert-dedup-for-merging-algorithms 2023-07-01 08:34:22 +00:00
Nikolay Degterinsky
8dfa773f44
Merge branch 'master' into headers-blacklist 2023-06-30 23:40:17 +02:00
Sema Checherinda
80b23a59dc
Merge branch 'master' into less-logs-3 2023-06-30 22:59:55 +02:00
Sema Checherinda
fe17a9b589 do not log aborted for pending mutate/merge when shutdown 2023-06-30 19:36:32 +02:00
Alexey Milovidov
5ee7f47b03 Update autogenerated version to 23.7.1.1 and contributors 2023-06-30 17:09:56 +02:00
kssenii
c8ab68a5c3 Add test 2023-06-30 16:13:34 +02:00
Alexander Tokmakov
d572eff106
Merge branch 'master' into fix_logical_error_on_mutation 2023-06-30 15:12:35 +03:00
kssenii
5de869760d Merge remote-tracking branch 'upstream/master' into s3queue 2023-06-30 13:56:43 +02:00
Kseniia Sumarokova
349083e673
Update ReadBufferFromHDFS.cpp 2023-06-30 13:54:57 +02:00
Antonio Andelic
9a79fd6f70 Better 2023-06-30 11:51:20 +00:00
Antonio Andelic
24ae56b5dd Correctly apply async deduplication for nonordinary ReplicatedMergeTree tables 2023-06-30 11:02:16 +00:00
Michael Kolupaev
2b55734ccf
Fix MergeTreeMarksLoader segfaulting if marks file is longer than expected (#51636) 
Co-authored-by: Nikita Mikhaylov <mikhaylovnikitka@gmail.com>
 2023-06-30 11:52:03 +02:00
Alexey Milovidov
2f8118fef9
Merge branch 'master' into is_obsolete 2023-06-30 12:08:38 +03:00
Antonio Andelic
3b7f6a4324
Merge pull request #50796 from ClickHouse/keeper-add-api-version-config 
Add feature flags for Keeper API
 2023-06-30 09:20:52 +02:00
flynn
be2bd989db
Merge branch 'master' into is_obsolete 2023-06-30 10:35:04 +08:00
Alexey Milovidov
068b2b6ab9
Merge branch 'master' into vdimir/test_alter_moving_garbage_51342 2023-06-29 23:12:25 +03:00
Alexey Milovidov
b6a37fbf18
Merge branch 'master' into many-fixes-2 2023-06-29 22:36:33 +03:00
kssenii
72d1834bbd system sync filesystem cache 2023-06-29 18:13:54 +02:00
yariks5s
2c3440be41
Merge branch 'master' into add-index-bytes-to-system-parts 2023-06-29 16:59:43 +02:00
Vitaly Baranov
0cccba62cf Support getHexUIntLowercase() with CityHash_v1_0_2::uint128 parameter. 2023-06-29 15:29:37 +02:00
Alexander Tokmakov
bac126fe3e fix 2023-06-29 15:11:02 +02:00
avogar
f88c1fdf44 Fixes 2023-06-29 11:59:09 +00:00
Antonio Andelic
6e1aec6e0b
Merge branch 'master' into keeper-add-api-version-config 2023-06-29 11:36:49 +02:00
Igor Nikonov
def0adf8f4
Merge branch 'master' into many-fixes-2 2023-06-29 10:33:59 +02:00
Alexander Tokmakov
b27cf4e7ba fix 2023-06-29 00:15:45 +02:00
Alexander Tokmakov
296f9968c0 fix 2023-06-28 23:20:02 +02:00
avogar
4eeb431003 Merge branch 'master' of github.com:ClickHouse/ClickHouse into better-progress-bar-2 2023-06-28 18:53:08 +00:00
Alexander Tokmakov
372f5786c4 more optimal REPLACE_RANGE with zero-copy 2023-06-28 18:44:54 +02:00
Alexander Tokmakov
594ec09edf fix missing metadata_version.txt 2023-06-28 18:19:16 +02:00
Vitaly Baranov
5570863676
Merge branch 'master' into reorder-part-checksum-halves 2023-06-28 17:25:34 +02:00
yariks5s
5bfc65f787
Merge branch 'master' into add-index-bytes-to-system-parts 2023-06-28 13:28:29 +02:00
Nikita Mikhaylov
b8b0fd3abf
Slightly better code around packets for parallel replicas (#51451) 2023-06-28 12:30:15 +02:00
Andrey Zvonov
ae26ff27a1
Merge branch 'master' into zvonand-issue-49290 2023-06-28 12:13:05 +02:00
Smita Kulkarni
223b954205 Fixed glob iterator for table function cluster path without regex characters 2023-06-28 11:09:19 +02:00
Antonio Andelic
be852d554b Use magic_enum for values 2023-06-28 07:45:20 +00:00
李扬
748cd13fc3
Merge branch 'master' into improve_geohash 2023-06-28 15:02:05 +08:00
yariks5s
34094da1c4
Merge branch 'master' into add-index-bytes-to-system-parts 2023-06-28 00:19:13 +02:00
Alexander Tokmakov
1ed104417a fix race between executeMetadataAlter and initializeReplication 
(cherry picked from commit 1d47783e85)
 2023-06-27 23:24:02 +02:00
Alexey Milovidov
0db9d6be37
Merge branch 'master' into alter-table-add-comment 2023-06-27 22:56:22 +03:00
Alexander Tokmakov
f5327e79bb fix a logical error on mutation 2023-06-27 20:18:38 +02:00
yariks5s
c59ddf0c66 Resolved style check 2023-06-27 17:27:28 +00:00
vdimir
0b6d367bdb
Parts mover: lock between getActiveContainingPart and swapActivePart 2023-06-27 17:14:49 +00:00
yariks5s
f3f604ace4 added table with pk size 2023-06-27 17:06:09 +00:00
Smita Kulkarni
81b5ad3b26 Fixed else if syntax error 2023-06-27 16:51:17 +02:00
Nikita Mikhaylov
dc0dc227e0
Merge pull request #51455 from ClickHouse/many-fixes 
Many fixes
 2023-06-27 13:57:17 +02:00
李扬
ca28801968
Merge branch 'master' into fix_hdfs_read_buffer_heap_overflow 2023-06-27 18:14:34 +08:00
Antonio Andelic
efbe01b6bb Merge branch 'master' into keeper-add-api-version-config 2023-06-27 10:11:04 +00:00
Smita Kulkarni
9734871345 Merge branch 'master' into azure_table_function_cluster 2023-06-27 11:09:44 +02:00
SmitaRKulkarni
0762e981d8
Merge branch 'master' into azure_blob_storage_sas_token 2023-06-27 09:47:23 +02:00
SmitaRKulkarni
dcf581a985
Merge pull request #50936 from ClickHouse/Fix_race_azure_blob_storage_iterator 
Fix race azure blob storage iterator
 2023-06-27 09:27:45 +02:00
Alexey Milovidov
b5635887c3 Merge remote-tracking branch 'origin/refactor-subqueries-for-in' into many-fixes 2023-06-27 05:39:44 +02:00
李扬
25d984e2f2
Merge branch 'master' into improve_geohash 2023-06-27 10:05:02 +08:00
Robert Schulze
fae545ae5c
Merge pull request #51132 from rschu1ze/inefficient-query-cache 
Fix ineffective query cache for SELECTs with subqueries
 2023-06-26 16:54:54 +02:00
Andrey Zvonov
ddd8f6bba3
Merge branch 'master' into zvonand-issue-49290 2023-06-26 16:51:11 +02:00
Smita Kulkarni
8dafd66c8d Updated creating container using connection string 2023-06-26 16:35:16 +02:00
Nikolai Kochetov
4bfe75ce81
Merge branch 'master' into set-index-nullable-atoms 2023-06-26 14:34:42 +02:00
Smita Kulkarni
56c73cab0d Fix azure test fails and updated to work without create privileges 2023-06-26 13:30:22 +02:00
Alexander Tokmakov
eb649873b3
Unify merge predicate (#51344) 
* unify merge predicate

* Update BaseDaemon.cpp
 2023-06-26 13:48:21 +03:00
Alexey Milovidov
533a279f6c
Merge branch 'master' into alter-table-add-comment 2023-06-26 12:01:34 +03:00
李扬
0e15266170
Merge branch 'master' into improve_geohash 2023-06-26 14:54:44 +08:00
Alexey Milovidov
b8e6bd3299
Merge branch 'master' into refactor-subqueries-for-in 2023-06-26 06:05:12 +03:00
Vitaly Baranov
f1f0daa654 Show halves of checksums in "system.parts", "system.projection_parts" and error messages in the correct order. 2023-06-25 17:17:56 +02:00
taiyang-li
769169f820 fix heap overflow in read buffer from hdfs 2023-06-25 18:26:53 +08:00
flynn
0243542587
Merge branch 'master' into is_obsolete 2023-06-25 16:54:54 +08:00
Alexey Milovidov
27f41869a9 Remove code that I don't like 2023-06-25 09:11:42 +02:00
Azat Khuzhin
a7b14f87e0 Throw an error instead of silenty ignore storage_file_read_method=mmap in server 
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-06-24 23:42:31 +03:00
Alexey Milovidov
cca3f9937c
Merge branch 'master' into retry 2023-06-24 22:29:17 +03:00
Andrey Zvonov
0b6688ffe4
Merge branch 'master' into zvonand-issue-49290 2023-06-24 12:36:27 +02:00
Vitaly Baranov
3711430d9f Rename member fields of CityHash_v1_0_2::uint128: "first" -> "low64", "second" -> "high64". 2023-06-24 12:25:56 +02:00
Alexey Milovidov
2c69cff589
Merge branch 'master' into set-index-nullable-atoms 2023-06-24 10:18:20 +03:00
robot-clickhouse-ci-1
c66ff09627
Merge pull request #51253 from kssenii/delete-non-evictable-feature 
Delete feature do_not_evict_index_and_mark_files in fs cache
 2023-06-24 02:37:52 +02:00
Alexander Tokmakov
878000025d
Merge pull request #51297 from ClickHouse/fix-metadata-loading 
Fix metadata loading test
 2023-06-23 21:45:21 +03:00
Nikolai Kochetov
598da6207e Use inNull and add a comment. 2023-06-23 15:49:37 +00:00
avogar
21baa18969 Fix azure 2023-06-23 14:16:09 +00:00
avogar
938a9ee3c1 Better 2023-06-23 14:03:59 +00:00
Alexey Milovidov
945a119fc6
Merge pull request #51287 from ClickHouse/remove-live-view-alter 
Remove ALTER of LIVE VIEW
 2023-06-23 16:44:53 +03:00
avogar
c679dd400e Make better 2023-06-23 13:43:40 +00:00
Sema Checherinda
977cd03cf2
Merge branch 'master' into memory-leak 2023-06-23 15:35:53 +02:00
Anton Popov
43fd4a83ca
Merge branch 'master' into better-reporting-broken-parts 2023-06-23 14:57:23 +02:00
Smita Kulkarni
b5ad349c4f Removed unwanted atomic variables to non atomic 2023-06-23 14:34:24 +02:00
Robert Schulze
43c97d76bf
Merge pull request #44149 from zvonand/zvonand-implicit-tz 
Session time zones
 2023-06-23 14:28:49 +02:00
alesapin
eaf95306ed
Add random sleep for zero copy (#51282) 
* Add small sleep for zero copy replication merges and mutations

* Update src/Storages/MergeTree/MergeFromLogEntryTask.cpp

Co-authored-by: Sergei Trifonov <sergei@clickhouse.com>

* Update src/Storages/MergeTree/MergeFromLogEntryTask.cpp

Co-authored-by: Sergei Trifonov <sergei@clickhouse.com>

* Update src/Storages/MergeTree/MutateFromLogEntryTask.cpp

Co-authored-by: Nikita Mikhaylov <mikhaylovnikitka@gmail.com>

* Update src/Storages/MergeTree/MergeFromLogEntryTask.cpp

Co-authored-by: Sergei Trifonov <sergei@clickhouse.com>

* Update src/Storages/MergeTree/MutateFromLogEntryTask.cpp

* Fix darwin build

---------

Co-authored-by: Sergei Trifonov <sergei@clickhouse.com>
Co-authored-by: Nikita Mikhaylov <mikhaylovnikitka@gmail.com>
 2023-06-23 13:49:07 +02:00
Alexander Tokmakov
d57a6061ed
Merge pull request #51284 from ClickHouse/fix_check_table_structure 
Disable table structure check for secondary queries from Replicated db
 2023-06-23 13:04:33 +03:00
Smita Kulkarni
db8120722f Separated functionality of Iterator into GlobIterator and KeysIterator, added test for filter by file 2023-06-23 12:00:20 +02:00
Alexey Milovidov
7407330130
Merge branch 'master' into retry 2023-06-23 08:18:18 +03:00
Alexey Milovidov
1745535cb1 Add support for ALTER TABLE MODIFY COMMENT 2023-06-23 03:17:45 +02:00
Alexey Milovidov
f0563ae719 Remove the system.metadata_cache table 2023-06-23 02:32:28 +02:00
Alexey Milovidov
f14391faaa Change log level 2023-06-23 00:06:27 +02:00
Anton Popov
241d711264 better expception message 2023-06-22 22:03:40 +00:00
Alexey Milovidov
b5b2a2a41a Fix "metadata loading" test 2023-06-22 23:57:37 +02:00
Alexander Tokmakov
220520c516 fix 2023-06-22 21:45:10 +02:00
avogar
24fab7bfde Remove old includes 2023-06-22 18:48:15 +00:00
Alexey Milovidov
369ad0aea3 Remove ALTER of LIVE VIEW 2023-06-22 20:32:29 +02:00
Alexander Tokmakov
3afb0933a5 Merge branch 'master' into fix_trash_in_disks 2023-06-22 20:27:57 +02:00
avogar
f48cd0f926 Delete updateRowsProgressApprox implementation 2023-06-22 17:30:24 +00:00
avogar
cf082f2f9a Use read_bytes/total_bytes_to_read for progress bar in s3/file/url/... table functions 2023-06-22 17:24:43 +00:00
Alexander Tokmakov
8afb8bf13a disable table structure check for secondary queries from Replicated db 2023-06-22 19:06:28 +02:00
Michael Kolupaev
2498170253 Fix use-after-free in StorageURL when switching URLs 2023-06-22 16:24:12 +00:00
Andrey Zvonov
d4316c7189
Merge branch 'master' into zvonand-implicit-tz 2023-06-22 17:23:20 +02:00
Andrey Zvonov
18e7b029d5
Merge branch 'master' into zvonand-issue-49290 2023-06-22 17:20:24 +02:00
Nikolai Kochetov
22e49748b5 Cleanup. 2023-06-22 14:23:04 +00:00
Sema Checherinda
d0bb985061 fix other classes based on SinkToStorage 2023-06-22 14:33:25 +02:00
Anton Popov
ee68e85d31 better reporting of broken parts 2023-06-22 12:25:45 +00:00
Sema Checherinda
95349a405b release buffers with exception context 2023-06-22 13:00:13 +02:00
Nikolai Kochetov
a940031878 Merge branch 'master' into refactor-subqueries-for-in 2023-06-22 12:18:48 +02:00
Nikolai Kochetov
0af028ab3f Refactor a bit more. 2023-06-21 20:55:27 +00:00
Sema Checherinda
679f2c4aa4
Merge branch 'master' into memory-leak 2023-06-21 22:22:11 +02:00
Alexander Gololobov
333483bdce
Merge pull request #49181 from ClickHouse/get_rid_of_delete_on_destroy_marker 
Deprecate delete-on-destroy.txt
 2023-06-21 22:20:57 +02:00
Smita Kulkarni
5229544b55 Added function getCurrrentBatchAndScheduleNext to IObjectStorageIteratorAsync 2023-06-21 22:17:39 +02:00
Alexander Tokmakov
b7dd334d55
Merge branch 'master' into fix_trash_in_disks 2023-06-21 22:23:14 +03:00
Sema Checherinda
c2fa7a1030
Merge branch 'master' into memory-leak 2023-06-21 21:15:01 +02:00
Sema Checherinda
01de36f1fa
Merge pull request #50395 from CheSema/better-log 
require `finalize()` call before d-tor for all writes buffers
 2023-06-21 21:12:02 +02:00
kssenii
78ea4feca0 Merge remote-tracking branch 'upstream/master' into delete-non-evictable-feature 2023-06-21 20:52:08 +02:00
kssenii
9aa4647f4f Delete feature 2023-06-21 20:48:12 +02:00
Alexander Tokmakov
9157314b2a fix 2023-06-21 20:29:32 +02:00
Anton Popov
022b85ba0b
Merge pull request #51164 from CurtizJ/better-check-part-with-cache 
Better checking of data parts on disks with filesystem cache
 2023-06-21 20:08:53 +02:00
Michael Kolupaev
4a570a05c9 Decrease default timeouts for S3 and HTTP requests 2023-06-21 18:08:50 +00:00
Alexey Milovidov
c54433a1ac
Merge pull request #51131 from ClickHouse/nickitat-patch-11 
Small fix in `MergeTreePrefetchedReadPool`
 2023-06-21 20:31:49 +03:00
Dmitry Novik
bb97332599
Merge pull request #50441 from Algunenano/parallel_replicas_analyzer 
Support parallel replicas with the analyzer
 2023-06-21 17:28:06 +02:00
Alexander Gololobov
17a95a54e1
Merge pull request #51118 from ClickHouse/sys_zookeep_more_parallel_get 
Make more parallel get requests to ZooKeeper in system.zookeeper
 2023-06-21 17:07:21 +02:00
Alexander Tokmakov
318ac807c7 Merge branch 'master' into fix_trash_in_disks 2023-06-21 14:04:01 +02:00
Andrey Zvonov
b4f2e4020d
Merge branch 'master' into zvonand-implicit-tz 2023-06-21 13:41:35 +02:00
Kruglov Pavel
8f8cd97fd8
Merge pull request #51088 from Avogar/better-progress-bar 
Improve progress bar for file/s3/hdfs/url table functions. Step 1
 2023-06-21 12:42:25 +02:00
Alexander Gololobov
a23caab98c
Merge branch 'master' into sys_zookeep_more_parallel_get 2023-06-21 12:16:57 +02:00
Nikolai Kochetov
0149f905de
Update MergeTreeIndexSet.cpp 2023-06-21 11:26:54 +02:00
Alexander Tokmakov
8896e90ad6
Merge pull request #51207 from ClickHouse/fix_lost_forever_check 
Suppress check for covered parts in ZooKeeper
 2023-06-21 12:26:09 +03:00
Robert Schulze
dcfcbd8345
Merge remote-tracking branch 'rschu1ze/master' into inefficient-query-cache 2023-06-21 09:23:31 +00:00
Robert Schulze
9b959eb1fb
Merge pull request #49577 from tpanetti/mysql_compatible_types 
Change SHOW COLUMNS query to display MySQL types in MySQL Compatibility mode
 2023-06-21 11:04:22 +02:00
Robert Schulze
06e8590c8e
Merge pull request #50775 from rschu1ze/non-experimental-qpl-deflate 
Mark QPL_DEFLATE non-experimental but default: off-by-default
 2023-06-21 10:43:16 +02:00
Nikolay Degterinsky
e130a9fdb9
Fix build 2023-06-21 02:33:38 +02:00
Alexander Tokmakov
f973bd7516 suppress check for covered parts in zk 2023-06-20 23:53:32 +02:00
Nikolai Kochetov
5bda0b535d Fixing build. 2023-06-20 19:45:03 +00:00
Nikolai Kochetov
e4f057e304 Fix Set index with constant nullable comparison. 2023-06-20 19:40:37 +00:00
Sema Checherinda
9b0c3359cf
Merge branch 'master' into better-log 2023-06-20 20:37:36 +02:00
Alexey Milovidov
c097e6e53d
Merge pull request #50531 from kitaisreal/jit-infrastructure-refactoring 
JIT infrastructure refactoring
 2023-06-20 21:13:44 +03:00
Robert Schulze
bc7df2baca
Merge branch 'master' into non-experimental-qpl-deflate 2023-06-20 20:06:01 +02:00
Sema Checherinda
fd292dc730 work with comment on the PR 2023-06-20 20:02:04 +02:00
Nikolai Kochetov
5a1f819e7b Fix more tests. 2023-06-20 17:33:09 +00:00
Alexander Gololobov
7a1f8547f3 Simplify the code 2023-06-20 17:18:05 +02:00
Alexander Gololobov
816c6cdeb1 Simplify the code by using tryGetChildren 2023-06-20 16:56:50 +02:00
郭小龙
154d19ce72
The time format (connected_time field) is incorrect (#51026) 
* The time format (connected_time field) is incorrect

* Change the description and increase the field list display

* Update 02735_system_zookeeper_connection.reference

* Update 02735_system_zookeeper_connection.sql

* Update 02735_system_zookeeper_connection.sql

* Update 02735_system_zookeeper_connection.reference

* fix test

---------

Co-authored-by: Alexander Tokmakov <tavplubix@gmail.com>
Co-authored-by: Alexander Tokmakov <tavplubix@clickhouse.com>
 2023-06-20 16:57:55 +03:00
Anton Popov
31ece0c512 add test for check part with cache 2023-06-20 13:28:01 +00:00
avogar
1d80072c21 Fix tests and builds 2023-06-20 13:01:47 +00:00
Maksim Kita
7e5017dd31 Fixed tests 2023-06-20 11:42:22 +03:00
Andrey Zvonov
20f8b0b4f4
Merge branch 'master' into zvonand-issue-49290 2023-06-20 02:53:50 +02:00
Andrey Zvonov
07191ce10d
Merge branch 'master' into zvonand-implicit-tz 2023-06-20 00:24:53 +02:00
zvonand
4e61f93fde upd 2023-06-19 23:44:59 +02:00
zvonand
b16c30e521 upd for review 2023-06-19 23:06:08 +02:00
Nikolai Kochetov
7280078bc6 Refactoring a bit more. 2023-06-19 19:01:56 +00:00
Alexander Tokmakov
a2833b2060 remove AsyncTrashPoolExecutor 2023-06-19 19:58:23 +02:00
Anton Popov
1ef19dbe4d drop cache on check of broken part 2023-06-19 16:32:51 +00:00
Alexander Gololobov
44f1f036e8 Use multi-read requests for list and get 2023-06-19 16:47:17 +02:00
avogar
d492acbcd2 Fix tests 2023-06-19 13:36:29 +00:00
Smita Kulkarni
641d1ecfcc Merge branch 'master' into azure_table_function_cluster 2023-06-19 15:27:21 +02:00
Smita Kulkarni
9a5d917cb5 Fixed clang build issue 2023-06-19 14:59:21 +02:00
Nikolai Kochetov
8e7d06e0a4 Remove isReady from FutureSet iface. 2023-06-19 12:56:24 +00:00
Nikolai Kochetov
f3398f9908 Try to make more consisten type check for sets. 2023-06-19 12:17:52 +00:00
Raúl Marín
8fdcca4326
Merge branch 'master' into parallel_replicas_analyzer 2023-06-19 13:54:59 +02:00
Nikita Taranov
90ced1aebc use int64 2023-06-19 13:48:52 +02:00
Sema Checherinda
a2d5c91a28 cancel temp part with exception context when deduplication triggered 2023-06-19 12:52:20 +02:00
Alexander Tokmakov
a00842498e Merge branch 'master' into rmt_better_background_tasks_scheduling 2023-06-19 12:37:17 +02:00
Smita Kulkarni
86d0e542ea Merge branch 'master' into azure_blob_storage_sas_token 2023-06-19 07:38:39 +02:00
Sema Checherinda
e3f892f84a fix gtest with MemoryWriteBuffer, do not mute exception in ReplicatedMergeMutateTaskBase 2023-06-19 00:10:42 +02:00
Sema Checherinda
2bbfa279ec fix gtest_lru_file_cache, fix remove from pending 2023-06-18 21:05:00 +02:00
Smita Kulkarni
08b5196070 Updated to support passing sas token authentication 2023-06-18 19:54:31 +02:00
Sema Checherinda
ce7cd67981 finalize CascadeWriteBuffer 2023-06-18 17:35:12 +02:00
Alexander Tokmakov
76faacd23c try to fix some trash in Disks 2023-06-18 14:59:10 +02:00
Alexander Gololobov
59c11cb150 Make more parallel get requests to ZooKeeper 2023-06-18 08:26:37 +02:00
Alexey Milovidov
ce38d64c5a
Merge pull request #50856 from ClickHouse/relax-too-many-parts 
Relax "too many parts" further
 2023-06-18 01:49:46 +03:00
Robert Schulze
5311ebe1d2
Make query cache work effective with nested queries. 2023-06-17 20:27:25 +00:00
Alexander Tokmakov
b4e455430c
Merge branch 'master' into rmt_better_background_tasks_scheduling 2023-06-17 22:19:21 +03:00
Alexey Milovidov
c7a18c640e Slightly better diagnostics 2023-06-17 17:20:44 +02:00
Alexey Milovidov
61e423c5df Fix typo 2023-06-17 17:14:49 +02:00
Alexey Milovidov
98bc124317 Fix typo 2023-06-17 17:13:19 +02:00
Andrey Zvonov
278b2ec72a
Merge branch 'master' into zvonand-issue-49290 2023-06-17 13:50:01 +02:00
zvonand
b25555d445 update style 2023-06-17 13:49:15 +02:00
Alexey Milovidov
a18dc73271 Fix error 2023-06-16 23:12:01 +02:00
Alexey Milovidov
688d5d59af Merge branch 'master' into relax-too-many-parts 2023-06-16 23:08:29 +02:00
Alexey Milovidov
ec952d401d
Merge pull request #51114 from ClickHouse/clang-17-3 
Compatibility with clang-17
 2023-06-17 00:07:45 +03:00
Alexey Milovidov
d94e47a930 Compatibility with clang-17 2023-06-16 23:07:19 +02:00
Alexey Milovidov
4e45e39e25
Merge pull request #51099 from ClickHouse/fix_use_local_vars_after_exception 
Fix for part_names_mutex used after destruction
 2023-06-16 23:52:50 +03:00
Alexey Milovidov
782889a051
Merge pull request #51042 from ClickHouse/sys_zookeep_parallel_list 
Make multiple parallel list requests when reading from system.zookeeper
 2023-06-16 23:46:53 +03:00
Nikolai Kochetov
afa74f697c Refactor a bit. 2023-06-16 19:38:50 +00:00
zvonand
1c10578f14 update to master 2023-06-16 21:30:47 +02:00
Sema Checherinda
e8d4dedbcc fix build and tests 2023-06-16 19:52:52 +02:00
Alexander Gololobov
8289d8fefa Fix for part_names_mutex used after destruction 2023-06-16 18:46:07 +02:00
avogar
56789af0fa Remove loggig 2023-06-16 15:55:05 +00:00
avogar
3209ebe34b Improve progress bar for file/s3/hdfs/url table functions. Step 1 2023-06-16 15:51:18 +00:00
Nikita Taranov
841d58f6ba
Small fix in MergeTreePrefetchedReadPool 2023-06-16 16:58:01 +02:00
Sema Checherinda
47484faace do abort/cancel/deletion merge/mutate task with exception context 2023-06-16 16:48:21 +02:00
Sema Checherinda
b428f88f22 finalize hashing buffer 2023-06-16 16:38:18 +02:00
Sema Checherinda
1cb02e2710 do call finalize for all buffers 2023-06-16 16:38:18 +02:00
Nikolai Kochetov
df1ea0b572
Merge pull request #50489 from ClickHouse/vdimir/alter_moving_garbage 
Cleanup moving parts
 2023-06-16 15:39:32 +02:00
Kruglov Pavel
dcc3efe4b7
Merge pull request #50364 from Avogar/allow-skip-empty-files 
Allow to skip empty files in file/s3/url/hdfs table functions
 2023-06-16 14:59:49 +02:00
Alexander Tokmakov
9260a1bf2e
Merge pull request #51006 from ClickHouse/followup_50448 
Follow-up to #50448
 2023-06-16 15:32:12 +03:00
Kruglov Pavel
f8ddfb1fd8
Merge branch 'master' into allow-skip-empty-files 2023-06-16 13:23:41 +02:00
Andrey Zvonov
00a5df684b
Merge branch 'master' into zvonand-issue-49290 2023-06-16 02:53:07 +02:00
zvonand
4155d13d69 merge master and resolve conflict 2023-06-16 02:20:32 +02:00
Alexander Gololobov
f08fd758fa Make multiple parallel list requests 2023-06-15 18:45:10 +02:00
Alexander Tokmakov
b248ba730a
Merge pull request #50997 from vitlibar/use-hash_of_all_files-for-parts 
Use hash_of_all_files to check identity of parts during on-cluster backups
 2023-06-15 16:54:55 +03:00
Nikolay Degterinsky
9a25958be8 Add HTTP header filtering 2023-06-15 13:49:49 +00:00
Alexander Tokmakov
dc0a224f52 fix 2023-06-15 15:05:17 +02:00
avogar
870f3d1270 Fix comments 2023-06-15 12:59:46 +00:00
Andrey Zvonov
9e3ddeca34 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into zvonand-issue-49290 2023-06-15 14:21:44 +02:00
Kseniia Sumarokova
c15e7b93cb
Merge pull request #50976 from kssenii/fix-data-lakes-too-many-head-requests 
Fix data lakes slowness because of synchronous head requests
 2023-06-15 13:33:09 +02:00
Andrey Zvonov
02cf8a1bad
Update comment StorageFile.cpp 2023-06-15 14:09:38 +03:00