thevar1able/ClickHouse
1
0
Fork 0
mirror of https://github.com/ClickHouse/ClickHouse.git synced 2024-12-16 19:32:07 +00:00
Code Issues Packages Projects Releases Wiki Activity
122,650 Commits 9,319 Branches 1,783 Tags 2.1 GiB
1e2b0c8dc4
Commit Graph

13913 Commits

Author SHA1 Message Date
ltrk2
c010e1c9ff
Merge branch 'master' into feature/mergetree-checksum-on-big-endian 2023-08-04 08:31:57 -04:00
Duc Canh Le
8aaa46ca90 StorageJoin: do not create clone hash join with all columns 2023-08-04 11:07:33 +00:00
Kruglov Pavel
b1fe9ce8f7
Merge branch 'master' into formats-with-subcolumns 2023-08-04 13:01:12 +02:00
Antonio Andelic
d4d93331dd Merge branch 'master' into add-reading-from-archives 2023-08-04 09:00:20 +00:00
Vitaly Baranov
587877dba3
Merge branch 'master' into disable-fs-cache-for-backups 2023-08-04 01:15:23 +02:00
Alexander Tokmakov
968c79cf3f
Merge pull request #52956 from ClickHouse/fixes_for_databases 
Fix some issues with databases
 2023-08-03 19:13:41 +03:00
Kseniia Sumarokova
68b48a0bc0
Merge pull request #50063 from KevinyhZou/minor_improve_hdfs_read_buffer 
Minor improve HDFS ReadBuffer for read end of file
 2023-08-03 17:55:48 +02:00
avogar
f0eb22ac5f Fix build for S3Queue 2023-08-03 14:20:19 +00:00
ltrk2
a29b36612b
Merge branch 'master' into feature/mergetree-checksum-big-endian-support 2023-08-03 09:41:25 -04:00
ltrk2
84a77d1c21
Merge branch 'master' into feature/mergetree-checksum-on-big-endian 2023-08-03 09:41:16 -04:00
Anton Popov
92cb5e9ae3
Merge pull request #52687 from alkorgun/fix-named-collections-on-cluster-23.7 
Fix named collections on cluster 23.7
 2023-08-03 14:50:28 +02:00
Smita Kulkarni
2a681f1577 Removed unused function and fixed build after merge 2023-08-03 14:32:03 +02:00
Smita Kulkarni
68a10e7cae Merge branch 'master' into azure_table_function_cluster 2023-08-03 13:59:59 +02:00
Vitaly Baranov
e127d27453 Disable using fs cache for backup/restore #2. 2023-08-03 13:52:35 +02:00
Vitaly Baranov
f427c779eb Disable using fs cache for backup/restore. 2023-08-03 13:52:32 +02:00
Antonio Andelic
d9f136ce0c Add tests for globs 2023-08-03 10:42:47 +00:00
Alexander Tokmakov
7684e68008
Add system stop pulling replication log (#52881) 
* add system stop pulling replication log

* add const

* fix another stupid test

* Update test.py
 2023-08-03 13:34:43 +03:00
Alexander Tokmakov
9e0d27dc4d
don't create empty parts on drop partittion if we have a transaction (#52945) 2023-08-03 13:16:32 +03:00
Nikolai Kochetov
5d64e036ba
Merge pull request #52695 from yariks5s/in_schema_case_sensitiveness 
Information_schema case sensitiveness
 2023-08-03 12:15:31 +02:00
Smita Kulkarni
5cdc50b9ba Fixed style 2023-08-03 11:31:15 +02:00
Kseniia Sumarokova
73ac1bf84f
Merge branch 'master' into minor_improve_hdfs_read_buffer 2023-08-03 10:56:24 +02:00
Antonio Andelic
96bad0537a Merge branch 'master' into add-reading-from-archives 2023-08-03 08:36:42 +00:00
Alexander Tokmakov
48d736f8fd select only required columns from system.databases 2023-08-02 23:23:52 +02:00
Azat Khuzhin
cd74da4c03 Remove unused code in StorageSystemStackTrace 
This columns mask is actually useless, since the main thing is done
without out, in particular:
- detect does the signal should be sent to thread
- does the thread name should be read for this thread

And this cannot be done with columns mask, because multiple columns
depends on signals and thread names.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-08-02 21:25:00 +02:00
Anton Popov
d43e76b147 fix reading of empty Nested(Array(LowCardinality(...))) 2023-08-02 16:48:08 +00:00
ltrk2
27a2d4d1c7
Merge branch 'master' into feature/mergetree-checksum-big-endian-support 2023-08-02 11:36:43 -04:00
ltrk2
ea28888763
Merge branch 'master' into feature/mergetree-checksum-on-big-endian 2023-08-02 11:36:26 -04:00
Nikolai Kochetov
b3bc3e89b6
Merge pull request #52837 from ClickHouse/cleanup-local-backup 
Cleanup localBackup
 2023-08-02 17:10:36 +02:00
Anton Popov
ff137773e7
Merge branch 'master' into formats-with-subcolumns 2023-08-02 15:24:56 +02:00
Smita Kulkarni
2c47679918 Merge branch 'master' into azure_table_function_cluster 2023-08-02 14:19:45 +02:00
Yarik Briukhovetskyi
e811d5c4e9
Update attachInformationSchemaTables.cpp 2023-08-02 14:06:20 +02:00
Yarik Briukhovetskyi
dab77b044b
Update attachInformationSchemaTables.cpp 2023-08-02 13:23:18 +02:00
yariks5s
0174244fe1 fixed tests 2023-08-02 11:21:47 +00:00
Alexander Tokmakov
d8da47520b
Merge branch 'master' into fix_mutations_with_transactions 2023-08-02 13:56:59 +03:00
Kseniia Sumarokova
8180474e71
Merge branch 'master' into minor_improve_hdfs_read_buffer 2023-08-02 11:57:41 +02:00
Kseniia Sumarokova
a3dd2e5c2f
Merge pull request #48424 from ClickHouse/kssenii-patch-6 
Fix outdated cache configuration in s3 tests: s3_storage_policy_by_defau…
 2023-08-02 11:38:57 +02:00
Antonio Andelic
9423976b7a Add support for file globs 2023-08-02 07:42:56 +00:00
Alexander Tokmakov
d6a2c631da fix assertion in mutations with transactions 2023-08-01 21:16:22 +02:00
yariks5s
6db7eaf4d8 fixed ast 2023-08-01 19:14:11 +00:00
ltrk2
35c67f5010
Merge branch 'master' into feature/mergetree-checksum-on-big-endian 2023-08-01 13:41:30 -04:00
Antonio Andelic
2430ebabf5 Merge branch 'master' into add-reading-from-archives 2023-08-01 17:22:38 +00:00
Kseniia Sumarokova
8893670d98
Merge branch 'master' into s3queue 2023-08-01 18:42:32 +02:00
Kseniia Sumarokova
dbc11b83fd
Merge branch 'master' into kssenii-patch-6 2023-08-01 18:40:20 +02:00
Antonio Andelic
e366ca61f5 Merge branch 'master' into add-reading-from-archives 2023-08-01 15:33:20 +00:00
Vitaly Baranov
65bd8f5e81
Merge branch 'master' into backups-fix-tmp-files 2023-08-01 16:37:06 +02:00
Antonio Andelic
c24dc8e64e Multithreaded read of files from archives: 2023-08-01 13:48:49 +00:00
Alexey Milovidov
4578d43f79
Merge pull request #52656 from Avogar/rename-setting-for-url-encoding 
Rename setting disable_url_encoding to enable_url_encoding and add a test
 2023-08-01 16:09:01 +03:00
János Benjamin Antal
a6861ea2f5
Merge pull request #52386 from ybogo/support-predefined-macro-in-kafka-settings 
Add predefined macros support in Kafka engine settings
 2023-08-01 14:49:01 +02:00
kssenii
a14a6b56b3 Better 2023-08-01 14:31:05 +02:00
alesapin
0ee9797fb8
Merge pull request #51141 from ClickHouse/azure_blob_storage_sas_token 
Azure blob storage sas token
 2023-08-01 12:27:17 +02:00
kssenii
08f5ebf3e8 Fix test 2023-08-01 12:19:15 +02:00
kssenii
be458fd44b Fix style check 2023-08-01 12:06:25 +02:00
Kseniia Sumarokova
ccf9fa9641
Update ReadBufferFromHDFS.cpp 2023-08-01 11:55:08 +02:00
Nikolai Kochetov
433219e931
Update src/Storages/MergeTree/localBackup.cpp 
Co-authored-by: Sergei Trifonov <sergei@clickhouse.com>
 2023-08-01 11:50:56 +02:00
Kseniia Sumarokova
5880a0a372
Update ReadBufferFromHDFS.cpp 2023-08-01 11:50:31 +02:00
robot-ch-test-poll4
5b67cff6b2
Merge pull request #52829 from ClickHouse/throw-s3-exception-whenever-possible 
Throw S3Exception whenever possible.
 2023-08-01 04:35:27 +02:00
Nikolai Kochetov
453463ba22 Cleaup on every iteration. 2023-07-31 19:47:23 +00:00
kssenii
75f6a50079 Add todo 2023-07-31 20:08:31 +02:00
kssenii
870a506a0b Some fixes 2023-07-31 20:07:23 +02:00
Nikolai Kochetov
c4a00b8c68 Throw S3Exception whenever possible. 2023-07-31 15:39:20 +00:00
Vitaly Baranov
f5ffef4014
Merge pull request #52658 from arenadata/ADQM-984 
Add s3_storage_class parameter in SETTINGS of BACKUP statement
 2023-07-31 17:32:12 +02:00
ltrk2
e869adf645 Improve function naming 2023-07-31 06:48:50 -07:00
kssenii
c13fdca23e Merge remote-tracking branch 'upstream/master' into s3queue 2023-07-31 15:32:56 +02:00
Kseniia Sumarokova
74c0574d51
Update ReadBufferFromHDFS.cpp 2023-07-31 15:22:16 +02:00
ltrk2
538349603d
Merge branch 'master' into feature/mergetree-checksum-on-big-endian 2023-07-31 09:18:53 -04:00
yariks5s
964e4311c3 reviewed changes 2023-07-31 13:03:56 +00:00
Antonio Andelic
9fb86f134b Fix tests 2023-07-31 12:04:27 +00:00
Antonio Andelic
7df5c83046 Merge branch 'master' into add-reading-from-archives 2023-07-31 09:27:01 +00:00
Alexey Milovidov
bd3af7ebe6
Merge pull request #52754 from ClickHouse/analyzer-set-index-not 
Analyzer: fix 00979_set_index_not.sql
 2023-07-31 12:13:59 +03:00
Antonio Andelic
df45602165 Refactoring 2023-07-31 08:50:09 +00:00
Kseniia Sumarokova
dd85c3c114
Update ReadBufferFromHDFS.cpp 2023-07-30 22:40:11 +02:00
Kseniia Sumarokova
8daeeedc8f
Merge pull request #52315 from xiedeyantu/add-alias 
system.events and system.metrics tables add column name as an alias to event and metric
 2023-07-30 22:37:31 +02:00
Anton Popov
0d8f852144
Merge pull request #52689 from CurtizJ/fix-extra-column-prewhere 
Fix reading of unnecessary column in case of multistage `PREWHERE`
 2023-07-30 15:30:53 +02:00
kssenii
20b76010ef Merge remote-tracking branch 'upstream/master' into kssenii-patch-6 2023-07-30 13:46:58 +02:00
Kseniia Sumarokova
08ef4d015c
Minor change 2023-07-30 13:36:52 +02:00
Kseniia Sumarokova
30b6cf0713
Merge branch 'master' into minor_improve_hdfs_read_buffer 2023-07-30 13:33:24 +02:00
Alexey Milovidov
91e67c105f
Merge pull request #52569 from ClickHouse/Realize_parameterized_view_as_new_storage_view 
Realize parameterized view as new view with parameters substitued
 2023-07-30 05:46:51 +03:00
robot-clickhouse-ci-2
2dd69844dd
Merge pull request #52716 from canhld94/ch_use_same_poll_for_attach_n_fetch 
Use same executor for GET_PART and ATTACH_PART
 2023-07-29 22:27:08 +02:00
Igor Nikonov
23bc6755df
Merge branch 'master' into analyzer-set-index-not 2023-07-29 18:17:55 +02:00
Dmitry Novik
8f4527d9e0
Merge pull request #46740 from ClickHouse/query-tree-visitor 
Refactor Query Tree visitor
 2023-07-29 15:10:07 +02:00
Yury Bogomolov
ba081ed402
Merge branch 'master' into support-predefined-macro-in-kafka-settings 2023-07-29 15:00:21 +04:00
Smita Kulkarni
553304a81a Fixed clang tidy build by removing unued variable 2023-07-29 11:15:56 +02:00
Alexey Milovidov
9a8077265d
Merge branch 'master' into ch_use_same_poll_for_attach_n_fetch 2023-07-29 05:19:22 +03:00
Igor Nikonov
1c6ef97b33 Merge remote-tracking branch 'origin/master' into analyzer-set-index-not 2023-07-28 23:43:15 +00:00
Igor Nikonov
45b9614224 Remove debug logging 2023-07-28 23:42:58 +00:00
Igor Nikonov
2a40bc9055 Fix: __bitSwapLastTwo was applied to non BoolMask 
- ActionsDAG was missing convertions to BoolMask - __bitWrapperFunc
 2023-07-28 23:29:59 +00:00
ltrk2
6c9a1b14ef
Merge branch 'master' into feature/mergetree-checksum-big-endian-support 2023-07-28 16:18:46 -04:00
ltrk2
cace04cc58
Merge branch 'master' into feature/mergetree-checksum-on-big-endian 2023-07-28 15:52:53 -04:00
Yury Bogomolov
b2ee4505fb review fixes 2023-07-28 16:06:03 +00:00
pufit
6211845ef0
Merge pull request #51303 from ClickHouse/deprecate-metadata-cache 
Deprecate the `metadata_cache` feature
 2023-07-28 10:31:02 -04:00
Dmitry Novik
e882adbc2b Merge remote-tracking branch 'origin/master' into query-tree-visitor 2023-07-28 14:22:42 +00:00
Alexander Tokmakov
39200606ec
Merge pull request #52174 from arenadata/ADQM-988 
Added possibility to save logs on crash and options to configure logs buffer
 2023-07-28 16:55:00 +03:00
yariks5s
96df21bbf5 implemented for all tables, fixed style and fast test 2023-07-28 13:35:13 +00:00
Antonio Andelic
e83e0ec2cd Fix build 2023-07-28 12:26:56 +00:00
Antonio Andelic
720d587e85 Merge branch 'master' into add-reading-from-archives 2023-07-28 08:49:00 +00:00
Alexey Gerasimchuck
63b05da1f2 System logs improvements 2023-07-28 07:23:34 +00:00
robot-ch-test-poll3
d6e2e8b92c
Merge pull request #52653 from azat/virtual-columns-or 
RFC: Fix filtering by virtual columns with OR expression
 2023-07-28 09:18:36 +02:00
Roman Vasin
cfa06725cc
Merge branch 'master' into ADQM-984 2023-07-28 10:15:27 +03:00
Duc Canh Le
97e63d523f use same executor for GET_PART and ATTACH_PART 2023-07-28 07:08:11 +00:00
Dmitry Novik
18c1fd6f08 Refactor InDepthQueryTreeVisitorWithContext 2023-07-27 21:24:39 +00:00
Al Korgun
ebbd662071
Merge branch 'ClickHouse:master' into fix-named-collections-on-cluster-23.7 2023-07-27 23:31:35 +03:00
Han Fei
4f9075e819
Merge pull request #52623 from hanfei1991/hanfei/MergeTreeDeduplicationLog 
Fix stress test: check if storage shutdown before we operate MergeTreeDeduplicationLog
 2023-07-27 20:50:17 +02:00
yariks5s
da53bca6e4 added tests 2023-07-27 18:29:50 +00:00
Azat Khuzhin
d40dbdee62 Fix usage of temporary directories during RESTORE 
Previously during RESTORE you may get the following warning in logs:

    <Warning> TemporaryFileOnDisk: Temporary path 'tmp/21672kaaaaa' does not exist in './disks/s3_common_disk/'

The reason is that it uses not disks/s3_common_disk/tmp but instead
disks/s3_common_disk/disks/s3_common_disk/tmp path.

Fix this by adding TemporaryFileOnDisk::getRelativePath() and use it
when appropriate.

And now - `find disks`, does not shows any more temporary leftovers.

v2: rename getPath to getAbsolutePath
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-07-27 19:24:54 +02:00
Anton Popov
dfc06d2714 fix reading of unneded column in case of multistage prewhere 2023-07-27 16:15:23 +00:00
Azat Khuzhin
68aed0d16e RFC: Fix filtering by virtual columns with OR expression 
Virtual columns did not supports queries with OR, for example query like
this (here `m` is the `Merge` table, see the test):

    select key from m where (value = 10 and _table = 'v1') or (value = 20 and _table = 'v1');

Will always leads to:

    Cannot find column `value` in source stream, there are only columns ...

The reason for this is that it actually executes the following queries:

    SELECT key, value FROM default.d1 WHERE ((value = 10) AND ('v1' = 'v1')) OR ((value = 20) AND ('v1' = 'v1'));
    SELECT key FROM default.d2 WHERE 0;

And this kind of filtering is used not only for `Merge` table but also:
- `_table` for `Merge` (already mentioned)
- `_file` for `File`
- `_idx` for `S3`
- and as well as filtering `system.*` tables by `database`/`table`/...

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-07-27 16:35:17 +02:00
Azat Khuzhin
5611b2fff4 Add a note about not working _table filter for Merge with analyzer 
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-07-27 16:35:17 +02:00
Han Fei
9488567bf6
Update src/Storages/MergeTree/MergeTreeDeduplicationLog.cpp 2023-07-27 16:28:08 +02:00
Han Fei
f6ca013c53
Update src/Storages/MergeTree/MergeTreeDeduplicationLog.cpp 2023-07-27 16:28:00 +02:00
Han Fei
0d44d527ef
Update src/Storages/MergeTree/MergeTreeDeduplicationLog.cpp 
Co-authored-by: Alexander Tokmakov <tavplubix@gmail.com>
 2023-07-27 16:27:04 +02:00
Han Fei
f5dfb70f5c
Update src/Storages/MergeTree/MergeTreeDeduplicationLog.cpp 2023-07-27 16:12:20 +02:00
Han Fei
ce38d3c5ea address comment 2023-07-27 16:11:08 +02:00
Alexey Milovidov
671128140d Update autogenerated version to 23.8.1.1 and contributors 2023-07-27 15:34:05 +02:00
Alexander Tokmakov
f3dc6dd061
Revert "Added field refcount to system.remote_data_paths table" 2023-07-27 15:23:57 +03:00
avogar
b5fc34b770 Rename setting disable_url_encoding to enable_url_encoding and add a test 2023-07-27 12:20:33 +00:00
Alexander Tokmakov
228de12d94
Update ReplicatedMergeTreeQueue.cpp (#52648) 2023-07-27 13:59:23 +03:00
Alexey Milovidov
17b647f6b1
Merge pull request #52518 from CurtizJ/add-refcount-to-system-table 
Added field `refcount` to `system.remote_data_paths` table
 2023-07-27 12:13:24 +03:00
robot-ch-test-poll1
abc48a0b73
Merge pull request #52627 from ClickHouse/fix_build_with_clang15 
Fix build with clang-15
 2023-07-27 09:49:29 +02:00
Al Korgun
f026ccf11e
Merge branch 'ClickHouse:master' into fix-named-collections-on-cluster-23.7 2023-07-27 10:48:25 +03:00
robot-clickhouse
ddab6590b2
Merge pull request #52626 from ClickHouse/fix_deadlock_in_persistent_table_functions 
Fix deadlocks in StorageTableFunctionProxy
 2023-07-27 09:38:48 +02:00
Илья Коргун
5395d34fd7 Fix missing constructor call 2023-07-27 10:32:10 +03:00
robot-ch-test-poll1
a5e073ff7d
Merge pull request #52602 from CheSema/finalize-gindexstore 
GinIndexStore: fix a bug when files are finalizated after first write,
 2023-07-27 08:31:24 +02:00
robot-clickhouse-ci-1
b6bcc32acb
Merge pull request #52606 from nickitat/port_use_prewhere_cols 
Port one more optimisation to `MergeTreePrefetchedReadPool`
 2023-07-27 00:03:47 +02:00
Alexander Tokmakov
74f3e76b18 fix build with clang-15 2023-07-26 17:15:28 +02:00
Alexander Tokmakov
2479f1352a fix deadlocks in StorageTableFunctionProxy 2023-07-26 17:11:28 +02:00
chen
6bb1a3005e
Merge branch 'ClickHouse:master' into add-alias 2023-07-26 22:29:32 +08:00
Han Fei
dccbe875d2 check if storage shutdown before we operate MergeTreeDeduplicationLog 2023-07-26 15:37:58 +02:00
Sema Checherinda
1854a21fbd
Merge branch 'master' into finalize-gindexstore 2023-07-26 16:23:58 +03:00
Kruglov Pavel
0d34e97dbe
Merge branch 'master' into formats-with-subcolumns 2023-07-26 13:30:35 +02:00
Kruglov Pavel
15cc046883
Merge branch 'master' into better-progress-bar-2 2023-07-26 13:12:24 +02:00
Anton Popov
45542fd712
Merge branch 'master' into fix-drop-of-projection 2023-07-26 12:55:18 +02:00
Nikita Taranov
017d34d40f determine task size by prewhere columns 2023-07-26 12:54:50 +02:00
Roman Vasin
2cf79ac592 Merge branch 'master' of github.com:ClickHouse/ClickHouse into ADQM-984 2023-07-26 09:58:26 +00:00
Alexander Tokmakov
6bbed6262e
Merge branch 'master' into add_delay_for_replicated 2023-07-26 12:48:48 +03:00
Sema Checherinda
991584506f fix a bug when files are finalizated after first write 2023-07-26 12:42:18 +04:00
Nikita Mikhaylov
1dc9ca2c24
Merge pull request #52549 from ClickHouse/whitespace-before-comma 
Check for punctuation
 2023-07-25 20:30:36 +02:00
Anton Popov
2c7c38950d better check for lightweight deletes 2023-07-25 14:21:12 +00:00
Alexander Tokmakov
328d0a5269 fix 2023-07-25 14:50:27 +02:00
Anton Popov
568afbbec3 added field with refcount to system.remote_data_paths table 2023-07-25 12:33:15 +00:00
Smita Kulkarni
22fec136c1 Create new StorageView with substituted parameters for every SELECT query of a parameterized view 2023-07-25 14:04:55 +02:00
robot-ch-test-poll4
fe6cd14a48
Merge pull request #52527 from Algunenano/mergetree_cleanup 
Remove unused code
 2023-07-25 07:41:42 +02:00
Alexey Milovidov
21382afa2b Check for punctuation 2023-07-25 06:10:04 +02:00
Alexey Milovidov
168b84a592
Merge pull request #52337 from Avogar/no-decode-url 
Allow to disable decoding/encoding path in uri in URL engine
 2023-07-25 05:43:06 +03:00
Alexander Tokmakov
edc479bbf8 fix 2023-07-24 23:40:27 +02:00
Alexey Milovidov
3c034d563b
Merge pull request #52068 from azat/replicated-cluster-prep1 
Preparations for Trivial Support For Resharding (part1)
 2023-07-24 22:57:44 +03:00
Kseniia Sumarokova
265e1437a3
Merge branch 'master' into add-alias 2023-07-24 21:52:41 +02:00
Kseniia Sumarokova
e05e0ec557
Merge pull request #52318 from valbok/utf8-names 
MaterializedMySQL: Support unquoted utf-8 strings in DDL
 2023-07-24 21:49:33 +02:00
Kruglov Pavel
fec5675cd4
Merge branch 'master' into better-progress-bar-2 2023-07-24 19:59:38 +02:00
Alexander Tokmakov
032956dd1e fix 2023-07-24 18:42:02 +02:00
Alexey Milovidov
01993bef5b
Merge pull request #52489 from ClickHouse/incbin 
Faster startup of clickhouse-client and clickhouse-local
 2023-07-24 18:42:24 +03:00