Vladimir C
bb6fc853e3
Merge pull request #31442 from vdimir/cluster-discovery
2021-12-28 10:53:30 +03:00
lgbo-ustc
1ac697cad2
some modifications
2021-12-28 11:26:39 +08:00
kssenii
1f6ca619b7
Allow some killing
2021-12-27 22:42:56 +03:00
Anton Ivashkin
0465aef15d
Fixes by code review responces
2021-12-27 19:27:06 +03:00
Anton Popov
a83832c03e
fix flushing of in-memory parts
2021-12-27 18:54:28 +03:00
Kseniia Sumarokova
0178fb5e0b
Merge pull request #33214 from kssenii/external-database-fix-where-false
...
Fix WHERE 1=0 for external databases query
2021-12-27 18:53:52 +03:00
kssenii
55dfaef4de
Settings changes as key value
2021-12-27 17:45:00 +03:00
Kseniia Sumarokova
5fd952fe1b
Merge branch 'master' into materialized-postgresql-fix-cleanup
2021-12-27 17:25:51 +03:00
OnePiece
555b20bc2e
Update MergeTreePartsMover.cpp
2021-12-27 21:38:51 +08:00
OnePiece
47f0e3c72f
Update MergeTreePartsMover.cpp
2021-12-27 20:46:51 +08:00
kssenii
b90f53ffba
Fix unit tests
2021-12-27 15:31:49 +03:00
vdimir
5c47229797
fix whitespace in StorageSystemClusters.cpp
2021-12-27 15:26:07 +03:00
Amos Bird
1cbd05ae9e
Correctly prevent nullable primary keys if necessary.
2021-12-27 17:32:37 +08:00
kssenii
a1aab3a82d
Fix
2021-12-27 11:59:33 +03:00
Vladimir C
ea5f867289
Merge pull request #33179 from kssenii/materialized-postgresql-fix-detach-with-schema
2021-12-27 11:42:59 +03:00
Vladimir C
211a5a8d6b
Merge pull request #33159 from xuyatian/master
2021-12-27 11:40:59 +03:00
lgbo-ustc
0a39273fee
fixed code style
2021-12-27 15:47:22 +08:00
taiyang-li
2d6eb40879
fix style
2021-12-27 15:31:24 +08:00
Ilya Yatsishin
a7cf7b4d6f
Merge pull request #33124 from bigo-sg/inject_gitinfo
2021-12-27 10:21:12 +03:00
taiyang-li
dd882085d0
Merge branch 'hive_table' of https://github.com/bigo-sg/ClickHouse into bigo_hive_table
2021-12-27 15:14:43 +08:00
taiyang-li
9036b18c2f
merge master
2021-12-27 15:12:48 +08:00
lgbo-ustc
078521496a
modifications based on pr review
2021-12-27 15:10:48 +08:00
kssenii
9f17e7bad0
Fix ddl validation
2021-12-26 20:56:31 +03:00
taiyang-li
8daeefeebe
inject gitinfo
2021-12-26 15:46:38 +08:00
kssenii
2bcb122cd0
Clean up unused replication slots
2021-12-26 10:15:03 +03:00
kssenii
ef22ebad85
Better startup
2021-12-25 21:30:36 +03:00
kssenii
e663cb4574
Fix detaching-attaching table with schema
2021-12-25 19:51:55 +03:00
Kseniia Sumarokova
f8083450ab
Update ExternalDataSourceConfiguration.cpp
2021-12-25 17:43:00 +03:00
Kruglov Pavel
22dbaec11a
Merge pull request #33142 from Avogar/fix-s3-write
...
Don't allow to write into S3 if path contains globs
2021-12-25 16:07:38 +03:00
kssenii
59dd5ba063
Validate config keys for external dictionaries
2021-12-25 14:26:35 +03:00
taiyang-li
a88b2975c0
inject into system.build_options
2021-12-25 15:45:50 +08:00
Alexey Milovidov
f03cb4c762
Cleanup trash from Kafka and HDFS
2021-12-25 06:10:59 +03:00
Yatian Xu
565a38a2e3
fix incorrect metric: StorageBufferBytes
2021-12-24 17:49:59 -08:00
alexey-milovidov
888a5532a6
Merge pull request #33134 from ClickHouse/musl-check-2
...
Prepare ClickHouse to be built with musl-libc
2021-12-24 19:44:47 +03:00
avogar
58966e90e9
Don't allow to write into S3 if path contains globs
2021-12-24 17:13:35 +03:00
Nikita Mikhaylov
29fdc422d0
Merge pull request #32974 from nikitamikhaylov/hdfsCluster
...
Merging #32400
2021-12-24 16:02:54 +03:00
Alexey Milovidov
29d28c531f
Move code around to avoid dlsym on Musl
2021-12-24 12:25:27 +03:00
Alexey Milovidov
204cc11e29
Fix incorrect include
2021-12-24 12:25:26 +03:00
Anton Popov
1f67177d4d
fix optimize_read_in_order with preliminary merge and add some tests
2021-12-23 18:32:31 +03:00
lgbo-ustc
d29a4d0527
add trySet() in LRUCache
2021-12-23 16:16:33 +08:00
lgbo-ustc
ccc39bad80
move IRemoteFileMetadata info Storages/Cache
2021-12-23 15:56:33 +08:00
lgbo-ustc
a00ab6551b
compile error
2021-12-23 15:43:42 +08:00
lgbo-ustc
f0b22d2882
fixed code-style
2021-12-23 15:15:39 +08:00
alexey-milovidov
0f8295de98
Merge pull request #33046 from ClickHouse/fix-prefetch-for-lc
...
Fix preferch for LowCardinality.
2021-12-23 08:56:16 +03:00
lgbo-ustc
e19fd5bc76
update some comments
2021-12-23 12:01:44 +08:00
lgbo-ustc
d205f9ecab
codes refactor
2021-12-23 11:50:26 +08:00
Kseniia Sumarokova
639c2c1ce7
Merge pull request #32976 from Avogar/fix-hdfs-url-check
...
Fix hdfs url check
2021-12-22 23:57:49 +03:00
Kseniia Sumarokova
764bb1181f
Merge pull request #33017 from stigsb/table-overrides-drop-add-column-support
...
Remove the possibility of adding columns with table overrides
2021-12-22 22:30:21 +03:00
Dmitry Novik
1c83f31e51
Merge pull request #31885 from amosbird/optimizeprojectionmat
...
Optimize single part projection materialization
2021-12-22 19:36:40 +03:00
mergify[bot]
1e0642065b
Merge branch 'master' into deduplication_token_7461
2021-12-22 15:27:28 +00:00
Nikolai Kochetov
bb24a494ca
Fix preferch for LowCardinality.
2021-12-22 15:26:16 +03:00
Stig Bakken
1cc70ad524
Remove the possibility of adding columns with table overrides
...
(except ALIAS columns)
Supporting this properly requires more comprehensive changes.
2021-12-22 08:20:14 +01:00
Kseniia Sumarokova
484a4d62dd
Merge pull request #32835 from kssenii/fising-s3
...
Fix optimization with lazy seek for async reads from remote fs
2021-12-22 09:38:23 +03:00
Anton Ivashkin
e88b97dafb
Fix typos
2021-12-21 19:56:29 +03:00
Amos Bird
f00cc3b944
optimize single part projection materialization
2021-12-21 22:39:06 +08:00
ianton-ru
e6fd4bfb50
Merge branch 'master' into MDB-15474
2021-12-21 17:38:36 +03:00
Anton Ivashkin
33cbfc89ef
Move logic for replicated part to StorageReplicatedMergeTree class
2021-12-21 17:29:50 +03:00
Anton Ivashkin
0c0bf66334
Merge master
2021-12-21 17:27:54 +03:00
lgbo-ustc
1f59ce760c
typo
2021-12-21 19:06:00 +08:00
kssenii
ebcb66a361
Fix
2021-12-21 10:58:02 +03:00
taiyang-li
2597925724
merge master
2021-12-21 15:55:39 +08:00
taiyang-li
cff3c20742
Merge branch 'hive_table' of https://github.com/bigo-sg/ClickHouse into bigo_hive_table
2021-12-21 15:01:23 +08:00
taiyang-li
2fd63f9381
rename some symboles
2021-12-21 15:00:47 +08:00
taiyang-li
40aa359201
refactor storage hive
2021-12-21 14:44:31 +08:00
mergify[bot]
649226853d
Merge branch 'master' into fix-clang-tidy
2021-12-21 06:05:57 +00:00
lgbo-ustc
2e2354be40
1. add tryDel and getOrTrySet in LRUCache
...
2. fixed bugs in LRUCache for evicting elements
2021-12-21 10:39:59 +08:00
lgbo-ustc
2c67516432
1. fixed code style
...
2. fixed bugs in lru cache
2021-12-21 09:44:04 +08:00
kssenii
30996b2448
Fix
2021-12-21 01:19:51 +03:00
mergify[bot]
e21c04ff9c
Merge branch 'master' into fix-data-part-modification-time
2021-12-20 18:58:47 +00:00
Anton Ivashkin
c724b074ae
Remove zero-copy version converter
2021-12-20 20:23:25 +03:00
Maksim Kita
dd0d3de050
Merge pull request #32970 from kitaisreal/loops-remove-postfix-increment
...
Loops remove postfix increment
2021-12-20 19:51:07 +03:00
Nikita Mikhaylov
d9c13900f5
Fix build + style
2021-12-20 14:31:56 +00:00
Maksim Kita
ebff389701
Merge pull request #32972 from kitaisreal/containers-iteration-fix-erase
...
Containers iteration fix erase
2021-12-20 16:47:19 +03:00
Anton Ivashkin
f0b9a4327a
Use table UUID in zero-copy shared label in ZooKeeper
2021-12-20 16:19:00 +03:00
Zhichang Yu
869cdbeb44
added table function hdfsCluster
2021-12-20 13:14:44 +00:00
avogar
e31c18e9f8
Fix hdfs url check
2021-12-20 16:09:48 +03:00
Maksim Kita
51477adf1b
Updated additional cases
2021-12-20 15:55:07 +03:00
Nikolai Kochetov
2e62f086a1
Merge pull request #32751 from ClickHouse/fix-32668
...
Apply some more optimizations to NO_QUERY ast.
2021-12-20 15:47:25 +03:00
lgbo-ustc
71353ceede
refactor metadata class factory
2021-12-20 20:33:41 +08:00
Maksim Kita
3feab5a975
Containers iteration fix erase
2021-12-20 13:42:31 +03:00
taiyang-li
7192458601
fix code typo
2021-12-20 18:10:15 +08:00
save-my-heart
1abe978455
fix wrong modification_time after move part
2021-12-20 16:29:06 +08:00
Igor Nikonov
100ee92c64
insert_deduplication_token setting for INSERT statement
...
The setting allows a user to provide own deduplication semantic in Replicated*MergeTree
If provided, it's used instead of data digest to generate block ID
So, for example, by providing a unique value for the setting in each INSERT statement,
user can avoid the same inserted data being deduplicated
Inserting data within the same INSERT statement are split into blocks
according to the *insert_block_size* settings
(max_insert_block_size, min_insert_block_size_rows, min_insert_block_size_bytes).
Each block with the same INSERT statement will get an ordinal number.
The ordinal number is added to insert_deduplication_token to get block dedup token
i.e. <token>_0, <token>_1, ... Deduplication is done per block
So, to guarantee deduplication for two same INSERT queries,
dedup token and number of blocks to have to be the same
Issue: #7461
2021-12-19 13:15:45 +00:00
kssenii
e6ebb55c4e
Move to Interpreters
2021-12-17 22:19:10 +03:00
kssenii
dd902b6875
Merge remote-tracking branch 'upstream/master' into table-override-pg
2021-12-17 22:03:58 +03:00
Nikolai Kochetov
93a33d52dc
Merge branch 'fix-32668' of github.com:yandex/ClickHouse into fix-32668
2021-12-17 20:37:29 +03:00
Nikolai Kochetov
c8a92c046f
Another try
2021-12-17 20:36:37 +03:00
Kseniia Sumarokova
f6e7e11742
Merge pull request #32907 from kssenii/url-better
...
Better handling of globs for url storage
2021-12-17 19:08:38 +03:00
kssenii
40c266840c
Fixes
2021-12-17 18:16:29 +03:00
alesapin
6bd7e425c6
Merge pull request #22535 from CurtizJ/sparse-serialization
...
Sparse serialization and ColumnSparse
2021-12-17 15:26:17 +03:00
kssenii
b1794a47c3
StorageURL improve
2021-12-17 14:03:37 +03:00
Kseniia Sumarokova
77b3ebe44e
Merge pull request #32734 from kssenii/mysql-fix-timeouts
...
Allow to control connection timeouts for mysql
2021-12-17 10:13:33 +03:00
taiyang-li
d033fc4c24
merge master and fix conflict
2021-12-17 15:11:21 +08:00
kssenii
97222be3d9
Merge remote-tracking branch 'upstream/master' into table-override-pg
2021-12-17 01:14:28 +03:00
mergify[bot]
4722bc6649
Merge branch 'master' into fix_skipped_mutations
2021-12-16 13:25:00 +00:00
Maksim Kita
858d9f0f5f
StorageLiveView fix function style
2021-12-16 12:29:20 +03:00
Maksim Kita
33374f8b0a
Merge pull request #31062 from Enmk/Governance/view_comment
...
Views with comment
2021-12-16 12:27:12 +03:00
kssenii
7583c8007e
Some review fixes
2021-12-16 00:38:46 +03:00
Alexander Tokmakov
1b02136941
fix skipping of some mutations
2021-12-15 21:19:29 +03:00
kssenii
dc1f0c58fa
Merge remote-tracking branch 'upstream/master' into table-override-pg
2021-12-15 15:27:58 +03:00
Anton Popov
ec46cbef20
Merge pull request #32756 from CurtizJ/fix-index-hypothesis
...
Fix race in skipping index of type `hypothesis`
2021-12-15 15:26:35 +03:00
kssenii
2e813fe3cd
Update defaults
2021-12-15 08:18:43 +00:00
Anton Popov
2e388a72da
Merge pull request #32742 from nautaa/flush_in_memory_part
...
flush all InMemoryDataParts when wal is not enabled
2021-12-14 23:09:10 +03:00
Kseniia Sumarokova
bf415378be
Merge pull request #32607 from Vxider/watch-events-supports
...
Events clause support for Window View watch query
2021-12-14 23:08:24 +03:00
kssenii
47f549166d
Table Override for PostgreSQL
2021-12-14 20:36:43 +03:00
Anton Popov
16312e7e4a
Merge remote-tracking branch 'upstream/master' into HEAD
2021-12-14 18:58:17 +03:00
Anton Popov
84d6715e3d
fix race in skipping index of type hypothesis
2021-12-14 18:28:55 +03:00
Anton Popov
96070b414d
support read_in_order optimization if prefix of sorting key is fixed
2021-12-14 15:54:20 +03:00
nautaa
a96da58360
fix
2021-12-14 20:11:43 +08:00
nautaa
5545793555
Merge branch 'flush_in_memory_part' of github.com:nautaa/ClickHouse into flush_in_memory_part
2021-12-14 19:42:15 +08:00
nautaa
3469fb8165
fix
2021-12-14 19:40:35 +08:00
mergify[bot]
60a864f91c
Merge branch 'master' into flush_in_memory_part
2021-12-14 11:14:21 +00:00
Anton Popov
bbb981655d
Merge pull request #32695 from CurtizJ/fix-add-ttl
...
Fix `MATERIALIZE TTL` with `TTL WHERE` and `TTL GROUP BY`
2021-12-14 14:01:15 +03:00
taiyang-li
a0b90fa9ec
fix bugs and add some docs
2021-12-14 18:44:15 +08:00
taiyang-li
52c118856f
Merge branch 'hive_table' of https://github.com/bigo-sg/ClickHouse into bigo_hive_table
2021-12-14 17:37:45 +08:00
taiyang-li
ca3f7425a4
fix code
2021-12-14 17:37:31 +08:00
nautaa
0da3881ff4
flush all InMemoryDataParts when wal is not enabled
2021-12-14 16:31:17 +08:00
lgbo-ustc
248e933fc4
Add test for local cache
2021-12-14 16:06:30 +08:00
mergify[bot]
a5599d9fe2
Merge branch 'master' into watch-events-supports
2021-12-14 06:15:58 +00:00
lgbo-ustc
5fa84c79c3
fixed bugs
2021-12-14 14:05:35 +08:00
taiyang-li
8234d1176f
merge master
2021-12-14 10:39:21 +08:00
Kseniia Sumarokova
c9ec664094
Update MySQLHelpers.h
2021-12-14 01:25:53 +03:00
mergify[bot]
2b181d7107
Merge branch 'master' into mongo-extend-auth-2
2021-12-13 22:21:10 +00:00
kssenii
f0d0714e47
Pass timeouts for mysql
2021-12-13 22:12:33 +00:00
Kseniia Sumarokova
9eb2a4fe90
Merge pull request #32643 from nautaa/genarateRandom
...
support Date32 for genarateRandom engine
2021-12-13 20:38:41 +03:00
alexey-milovidov
fd9d40925a
Merge pull request #32640 from ClickHouse/fix-function-file
...
Fix surprisingly bad code in function `file`
2021-12-13 19:34:36 +03:00
kssenii
ddbeadd104
Done
2021-12-13 16:09:18 +00:00
Anton Popov
0b68980977
fix MATERIALIZE TTL with WHERE and GROUP BY
2021-12-13 17:21:05 +03:00
tavplubix
60fae3af76
Follow-up to #32140 ( #32667 )
...
* Update LeaderElection.h
* Update LeaderElection.h
2021-12-13 16:41:46 +03:00
Kruglov Pavel
52328f6abc
Merge pull request #32490 from ClickHouse/quote-more-identifiers
...
Fix issue with ambiguous query formatting in distributed queries.
2021-12-13 16:41:01 +03:00
Anton Popov
a241103714
Merge pull request #32359 from CurtizJ/fix-non-materialized-skip-index
...
Fix usage of non-materialized skip indexes
2021-12-13 14:43:58 +03:00
mergify[bot]
77be64f1f4
Merge branch 'master' into genarateRandom
2021-12-13 09:18:52 +00:00
Nikolai Kochetov
22e6fc1685
Merge pull request #32067 from amosbird/projection-fix23
...
Fix detaching parts with projections
2021-12-13 12:00:17 +03:00
nautaa
7cb3d24847
support Date32 for genarateRandom engine
2021-12-13 15:52:12 +08:00
mergify[bot]
47b18c959f
Merge branch 'master' into fix-non-materialized-skip-index
2021-12-13 07:03:02 +00:00
Alexey Milovidov
71926a3a97
Fix surprisingly bad code in function "file"
2021-12-13 07:57:54 +03:00
Vxider
f6dceb53a5
small update
2021-12-13 02:38:16 +00:00
Vxider
caad9f6c79
small update
2021-12-12 17:30:44 +00:00
mergify[bot]
dd4eaad2f3
Merge branch 'master' into watch-events-supports
2021-12-12 15:22:53 +00:00
李扬
8675086104
Merge branch 'master' into hive_table
2021-12-12 09:01:46 -06:00
alexey-milovidov
0486c5f341
Merge pull request #32220 from azat/mt-fix-minmax-for-empty-part
...
[RFC] Fix minmax partition index during merge in case of empty part in future parts
2021-12-12 14:45:10 +03:00
mergify[bot]
72606749ab
Merge branch 'master' into watch-events-supports
2021-12-12 09:51:52 +00:00
Kseniia Sumarokova
5dc7d7e3ef
Merge pull request #32584 from kssenii/rabbitmq-fix
...
rabbitmq fix
2021-12-12 12:34:09 +03:00
Vxider
7eb18ea21e
watch events support for window view
2021-12-12 07:45:55 +00:00
Alexey Milovidov
58ffe89643
Merge branch 'master' into quote-more-identifiers
2021-12-12 03:33:20 +03:00
kssenii
89db2c57f4
Fix
2021-12-12 00:19:06 +03:00
Azat Khuzhin
ca9c5dc4eb
Fix LOGICAL_ERROR for MATERIALIZED VIEW over table functions (i.e. numbers())
...
Replace LOGICAL_ERROR with QUERY_IS_NOT_SUPPORTED_IN_MATERIALIZED_VIEW
in this case.
2021-12-11 11:04:47 +03:00
Kseniia Sumarokova
7e0bc290da
Merge pull request #32460 from kssenii/mongo-extend-auth
...
Allow empty credentials for mongo engine
2021-12-11 10:42:15 +03:00
Kseniia Sumarokova
1865e37109
Merge pull request #32498 from Vxider/rename-window-view-functions
...
Rename window-view function to time window function
2021-12-10 22:07:53 +03:00
Kseniia Sumarokova
f5e949b88e
Ping CI
2021-12-10 18:12:27 +03:00
tavplubix
25427719d4
Try fix 'Directory tmp_merge_<part_name>' already exists ( #32201 )
...
* try fix 'directory tmp_merge_<part_name>' already exists
* fix
* fix
* fix
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2021-12-10 16:29:51 +03:00
vxider
52fa82b4d4
rename window-view function to time window function
2021-12-10 09:43:44 +00:00
taiyang-li
02b877c978
move remote buffer from src/IO to src/Storages
2021-12-10 10:27:53 +08:00
Alexey Milovidov
5c90ed2ed9
Unambiguous formatting of distributed queries
2021-12-10 00:55:14 +03:00
kssenii
f5a77fca39
Done
2021-12-09 14:44:25 +00:00
Kseniia Sumarokova
2091008c15
Merge pull request #32324 from Vxider/rename-window-functions
...
Rename window functions in WindowView
2021-12-09 16:19:21 +03:00
Nikita Mikhaylov
dbf5091016
Parallel reading from replicas ( #29279 )
2021-12-09 13:39:28 +03:00
taiyang-li
0eef092ded
fix building
2021-12-09 16:57:33 +08:00
mergify[bot]
b11a1ded8d
Merge branch 'master' into rename-window-functions
2021-12-09 08:10:41 +00:00
robot-clickhouse
f2ccddb7be
Auto version update to [21.13.1.1] [54458]
2021-12-09 00:33:01 +03:00
tavplubix
2de543cbfb
Merge pull request #32389 from ClickHouse/tavplubix-patch-4
...
Follow-up to #32140
2021-12-09 00:18:26 +03:00
Anton Popov
ea67abf3f0
fix custom serializations in native protocol
2021-12-08 21:59:36 +03:00
Anton Popov
61a5f8a61a
add comments
2021-12-08 18:56:30 +03:00
Anton Popov
d8367334a3
Merge remote-tracking branch 'upstream/master' into HEAD
2021-12-08 18:26:19 +03:00
Mikhail f. Shiryaev
03927f5fc6
Revert "graphite: split tagged/plain rollup rules (for merges perfomance)"
...
This reverts commit 303552f515
.
2021-12-08 15:49:21 +01:00
Nikita Mikhaylov
398d2f5984
Fix
2021-12-08 12:36:55 +00:00
tavplubix
785d79531d
Update StorageReplicatedMergeTree.cpp
2021-12-08 15:27:32 +03:00
mergify[bot]
ed0c36bf32
Merge branch 'master' into rename-window-functions
2021-12-07 21:04:53 +00:00
Anton Popov
dd7387729b
fix usage of non-materialized skip indexes
2021-12-07 20:21:27 +03:00
tavplubix
4f46ac6b30
Remove LeaderElection ( #32140 )
...
* remove LeaderElection
* try fix tests
* Update test.py
* Update test.py
2021-12-07 19:55:55 +03:00
Mikhail f. Shiryaev
5fc20b3e6a
Merge pull request #25122 from msaf1980/rollup_rules_type
...
GraphiteMergeTree Rollup rules type
2021-12-07 10:18:08 +01:00
vxider
c4c517bb8a
rename window functions
2021-12-07 08:14:00 +00:00
Kseniia Sumarokova
926fd568c7
Merge pull request #32113 from FrankChen021/url_http_header
...
Set Content-Type in HTTP packets issued from URL engine
2021-12-07 08:52:36 +03:00
Kseniia Sumarokova
e2cf5c6075
Merge pull request #32232 from Vxider/fix-window-view-parser
...
Fix window view parser
2021-12-06 23:33:43 +03:00
Kseniia Sumarokova
7e261245d3
Merge pull request #32256 from taiyang-li/default_for_hdfs
...
Support default expression for storage hdfs and optimize fetching when source is column oriented
2021-12-06 23:32:01 +03:00
Kseniia Sumarokova
a2dfa883cb
Merge pull request #32049 from leosunli/32039
...
#32039 Make HDFS replication configurable in WriteBufferFromHDFSImpl#WriteBu…
2021-12-06 20:24:29 +03:00
msaf1980
303552f515
graphite: split tagged/plain rollup rules (for merges perfomance)
2021-12-06 16:49:08 +01:00
vxider
2f4f2d9d5e
Merge branch 'master' of https://github.com/ClickHouse/ClickHouse
2021-12-06 14:06:00 +00:00
mergify[bot]
52904a4973
Merge branch 'master' into default_for_hdfs
2021-12-06 13:19:49 +00:00
Nikolai Kochetov
f064f2cdaa
Use seq_cst semantic for MergeTreeBackgroundExecutor mertic. ( #32125 )
2021-12-06 15:21:39 +03:00
lgbo-ustc
dd70209623
fixed code style
2021-12-06 18:19:36 +08:00
lgbo-ustc
5913d67553
fixed code style
2021-12-06 16:51:49 +08:00
vxider
e7a4312768
add comments
2021-12-06 08:41:56 +00:00
Nikolai Kochetov
91c4c89c66
Merge pull request #31636 from Algunenano/pull_timeout
...
Check max_execution_time in the pipeline and pulling executors
2021-12-06 11:33:39 +03:00
lgbo-ustc
3c56a5deac
refector
...
1. Make the lru cache pilicy in RemoteReadBufferCache into Common/UnreleasableLRUCache.h
2. If try to use local cached file fail, the RemoteReadBuffer::create() return the original ReadBuffer
3. Remove LocalFileReader
4. RemoteCacheController does not hold a context now, and the download process starts in RemoteReadBufferCache
once a new RemoteCacheController is create successly
5. Make an abstract class RemoteFileMetaDataBase for descripting a remote file meta data.
6. Remote file meta data need to a version, can cache multi-version for a file now
2021-12-06 16:17:32 +08:00
vxider
b68136d1e4
small code style update
2021-12-06 07:12:21 +00:00
leosunli
6f611eec91
Fix bug
...
Signed-off-by: leosunli <lisheng.sun08@gmail.com>
2021-12-06 14:32:32 +08:00
Kseniia Sumarokova
4017bb8f78
Update WriteBufferFromHDFS.h
2021-12-06 14:32:32 +08:00
leosunli
e81a1dbe6a
Make HDFS replication configurable in WriteBufferFromHDFSImpl#WriteBufferFromHDFSImpl
...
Signed-off-by: leosunli <lisheng.sun08@gmail.com>
2021-12-06 14:32:31 +08:00
leosunli
5be58a8839
Make HDFS replication configurable in WriteBufferFromHDFSImpl#WriteBufferFromHDFSImpl
...
Signed-off-by: leosunli <lisheng.sun08@gmail.com>
2021-12-06 14:32:31 +08:00
sunlisheng
ef77f45f59
Make HDFS replication configurable in WriteBufferFromHDFSImpl#WriteBufferFromHDFSImpl
...
Signed-off-by: sunlisheng <lisheng.sls@alibaba-inc.com>
2021-12-06 14:32:31 +08:00
taiyang-li
9d1e63be0f
1. support default expression for storage hdfs; 2. optimize storage hdfs when format is column oriented
2021-12-06 11:54:45 +08:00
lgbo-ustc
01940c3f01
coding refinement
...
1. make remote file meta data be a abstract class
2. make cache controller download process be started by RemoteReadBufferCache
2021-12-06 10:30:59 +08:00
Azat Khuzhin
82e0e9d27c
Fix minmax partition index during merge in case of empty part in future parts
...
It is possible to get empty part in future parts, during merging, that
can be created in case of there is information about this part in
zookeeper, but no replicas has it
(StorageReplicatedMergeTree::createEmptyPartInsteadOfLost())
And this may incorrectly initialize min value, which will be updated
after one more merge (since during that merge there will be no more
information about empty part) or OPTIMIZE.
2021-12-04 21:49:49 +03:00
vxider
78ceb5c883
add illegal arg check
2021-12-04 14:18:10 +00:00
vxider
c522c06755
fix windowview parser
2021-12-04 12:30:04 +00:00
taiyang-li
c678c8101e
fix some bugs
2021-12-04 16:41:35 +08:00
Kseniia Sumarokova
7b1d4631bf
Update FileLogSource.cpp
2021-12-03 18:56:29 +03:00
kssenii
adaa32b41b
Fix inner table name
2021-12-03 15:52:57 +03:00
frank chen
898db5b468
Resolve review comments
...
Signed-off-by: frank chen <frank.chen021@outlook.com>
2021-12-03 19:47:05 +08:00
kssenii
0470525ea3
Fix
2021-12-03 13:39:27 +03:00
tavplubix
17f8193435
Merge pull request #32157 from ClickHouse/fix_active_replicas_count_quorum
...
Fix active replicas count in quorum inserts
2021-12-03 12:39:36 +03:00
SuperDJY
5d7dfc6eb9
fix storage join settings with persistency ( #32066 )
2021-12-03 12:06:58 +03:00
Anton Popov
f6be3d16fd
Merge pull request #24820 from kssenii/versioning
...
Versioning of aggregate function states
2021-12-03 01:41:44 +03:00
tavplubix
4606376734
Update ReplicatedMergeTreeSink.cpp
2021-12-02 21:51:23 +03:00
Alexander Tokmakov
252192bc6d
fix active replicas count in quorum inserts
2021-12-02 21:02:11 +03:00
Anton Ivashkin
98bae1b313
Fix tests
2021-12-02 16:25:45 +03:00
tavplubix
1f4b14f68b
Merge pull request #32119 from ClickHouse/tavplubix-patch-4
...
Fix data race in `removePartAndEnqueueFetch(...)`
2021-12-02 15:25:38 +03:00
taiyang-li
2f4e7e1d4e
merge master
2021-12-02 19:48:21 +08:00
tavplubix
5400c5899d
Merge pull request #32063 from ClickHouse/fix_detach_dir_exists
...
Fix 'directory exists' error when detaching part
2021-12-02 14:04:21 +03:00
tavplubix
e9489ccd6f
Update StorageReplicatedMergeTree.cpp
2021-12-02 13:18:02 +03:00
mergify[bot]
cba9f3f14c
Merge branch 'master' into url_http_header
2021-12-02 09:13:41 +00:00
mergify[bot]
0f19807b97
Merge branch 'master' into Governance/view_comment
2021-12-02 08:19:03 +00:00
taiyang-li
9ec8272186
refactor hive text input format
2021-12-02 16:14:25 +08:00
kssenii
8edf146687
Merge branch 'master' of github.com:ClickHouse/ClickHouse into versioning
2021-12-02 07:57:14 +00:00
frank chen
8e9f4949e4
Set Content-Type in HTTP packets issued from URL engine
...
Signed-off-by: frank chen <frank.chen021@outlook.com>
2021-12-02 15:49:34 +08:00
Anton Ivashkin
e0a16a483e
Merge master
2021-12-01 19:03:31 +03:00
Kseniia Sumarokova
87574e8bf6
Merge pull request #31053 from kssenii/rabbit-kafka-select-commit
...
rabbitmq/kafka allow to commit on select only under setting
2021-12-01 18:23:08 +03:00
Amos Bird
8dbc7a8dae
Fix detaching parts with projections
2021-12-01 23:21:17 +08:00
tavplubix
7ae45b9d52
Update IMergeTreeDataPart.cpp
2021-12-01 18:00:40 +03:00
Alexander Tokmakov
57e4f3698c
fix 'directory exists' error when detaching part
2021-12-01 17:24:26 +03:00
Anton Ivashkin
80ab73c691
Fix Zero-Copy replication lost locks, fix remove used remote data in DROP DETACHED PART
2021-12-01 16:11:26 +03:00
Anton Popov
54f51444c0
Merge remote-tracking branch 'upstream/master' into HEAD
2021-12-01 15:49:02 +03:00
tavplubix
b623a387af
Merge pull request #31887 from ClickHouse/fix_cannot_create_empty_part
...
Parse partition key value from `partition_id` when need to create part in empty partition
2021-12-01 15:38:46 +03:00
alesapin
4b3079b0a5
Merge pull request #32037 from excitoon-favorites/flexiblemutations3
...
Minor fixes for `StorageMergeTree`
2021-12-01 13:36:46 +03:00
Vladimir Chebotarev
e8e3411ebc
Minor fixes for StorageMergeTree
.
2021-12-01 11:18:07 +03:00
Kseniia Sumarokova
3ab014d796
Merge pull request #31648 from michael1589/master
...
basic access authentication for http/https
2021-12-01 09:47:55 +03:00
Kseniia Sumarokova
a97938e2d1
Merge pull request #28933 from kssenii/materialized-postgresql-fix
...
MaterializedPostgreSQL: fully support non-default postgres schema
2021-12-01 09:37:12 +03:00
lgbo-ustc
aaa5d8f002
rewrite thread pool in remote file cache
2021-12-01 10:45:25 +08:00
Anton Popov
21c0aa4a1b
Merge pull request #31823 from amosbird/fixnullablekey
...
Fix invalid cast of nullable type when nullable primary key is used
2021-11-30 21:44:27 +03:00
Kseniia Sumarokova
3c348a2998
Merge pull request #8331 from Vxider/window-view
...
Support for Stream Processing
2021-11-30 18:20:12 +03:00
michael1589
a74cf9cfb0
Merge branch 'master' of https://github.com/michael1589/ClickHouse
2021-11-30 20:48:35 +08:00
michael1589
92feada9e6
Merge branch 'ClickHouse:master' into master
2021-11-30 20:48:10 +08:00
michael1589
f2f8826621
build check fail
2021-11-30 20:46:54 +08:00
Kseniia Sumarokova
18e200b1e2
Merge pull request #31967 from ucasfl/fix-filelog
...
Fix FileLog engine unnesessary create meta data directory when create table failed
2021-11-30 15:38:05 +03:00
Alexander Tokmakov
caaae03df3
change to switch-case
2021-11-30 15:29:05 +03:00
mergify[bot]
d729cd50b3
Merge branch 'master' into fixnullablekey
2021-11-30 11:44:35 +00:00
tavplubix
78224ef273
Merge pull request #31738 from ClickHouse/fix_segfault_on_attach_partition
...
Fix segfault on attach parititon
2021-11-30 14:32:50 +03:00
taiyang-li
d213500a3e
remove blank at end of line
2021-11-30 18:23:24 +08:00
kssenii
0e24eebc80
Merge branch 'master' of github.com:ClickHouse/ClickHouse into materialized-postgresql-fix
2021-11-30 12:26:10 +03:00
alesapin
438fa60902
Merge pull request #21326 from excitoon-favorites/flexiblemutations2
...
Skip mutations of unrelated partitions in `StorageMergeTree`
2021-11-30 12:15:29 +03:00
lgbo-ustc
b023dd34c0
fixed code style
2021-11-30 17:11:58 +08:00
kssenii
f658a8c181
Small simplification, some comments
2021-11-30 11:16:24 +03:00
taiyang-li
440fa9b69c
implement getMissingValues for ORC/Parquet/Arrow
2021-11-30 15:44:59 +08:00
michael1589
80dd01e66b
style check fail
2021-11-30 15:18:26 +08:00
michael1589
3f56dde858
style check fail
2021-11-30 15:07:18 +08:00
taiyang-li
cacf516e3e
calculate column value by default expression & apply defaults_for_omitted_fields_ in ArrowColumnToCHColumn
2021-11-30 14:52:26 +08:00
feng lv
0efabb39cf
Fix FileLog engine unnesessary create meta data directory when create table failed.
...
fix style
2021-11-30 04:39:55 +00:00
kssenii
b0415b6482
Fix tests under Replicated database engine
2021-11-29 23:34:52 +03:00
Alexander Tokmakov
2cf4b51029
fix
2021-11-29 21:54:46 +03:00
Raúl Marín
a7ae715950
Merge remote-tracking branch 'blessed/master' into pull_timeout
2021-11-29 19:51:18 +01:00
Alexander Tokmakov
56b613068b
fix
2021-11-29 21:47:08 +03:00
Anton Ivashkin
0f9038ebed
Zero-copy: move shared mark outside table node in ZooKeeper
2021-11-29 19:05:31 +03:00
kssenii
2ea4e7c4e7
Better
2021-11-29 15:05:02 +00:00
Amos Bird
29c87b2f44
Fix nullable key
2021-11-29 20:49:01 +08:00
taiyang-li
d0546f5c9c
apply swithc use_local_cache_for_remote_fs
2021-11-29 18:39:50 +08:00
taiyang-li
03e7f0f6f7
extract hivemetastore client from context
2021-11-29 18:23:57 +08:00
kssenii
2f0fe4a21f
Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into rabbit-kafka-select-commit
2021-11-29 10:08:14 +00:00
taiyang-li
c7a0fe467f
fix code stylke
2021-11-29 16:22:43 +08:00
Vladimir Chebotarev
100e61ab0e
Rebase fix.
2021-11-29 10:15:00 +03:00
taiyang-li
fd4462db64
fix code style
2021-11-29 13:01:03 +08:00
taiyang-li
e67407b5c5
fix code style
2021-11-29 11:30:11 +08:00
michael1589
1bf49ab637
style check fail
2021-11-28 21:51:39 +08:00
michael1589
efeb9b59c8
Merge branch 'ClickHouse:master' into master
2021-11-28 16:59:17 +08:00
michael1589
70264b37a1
style check fail
2021-11-28 16:47:26 +08:00
Alexey Milovidov
1ded1e7181
Remove some trash from build
2021-11-28 08:05:24 +03:00
vxider
e27a158b92
fix typo
2021-11-27 17:53:07 +00:00
michael1589
dbfe637f7b
Merge branch 'ClickHouse:master' into master
2021-11-27 23:30:25 +08:00
Alexander Tokmakov
2fb00172a9
try parse partition key value from partition_id
2021-11-27 15:07:08 +03:00
taiyang-li
08cc4306b6
fix typos
2021-11-27 18:56:43 +08:00
kssenii
be3b4ca8fe
Merge branch 'master' of github.com:ClickHouse/ClickHouse into versioning
2021-11-27 09:44:31 +00:00
kssenii
515261f5dd
Better
2021-11-27 09:40:46 +00:00
Alexey Milovidov
870800e54b
Add a comment
2021-11-27 03:00:00 +03:00
Alexey Milovidov
5d2ccd4289
Experiment with the order of sources
2021-11-27 02:55:04 +03:00
Alexey Milovidov
a96e4fe393
More reproducible builds
2021-11-27 02:24:09 +03:00
Raúl Marín
7781fc12ed
Reduce dependencies on ASTSelectWithUnionQuery.h
...
521 -> 77 files requiring changes
2021-11-26 19:27:16 +01:00
vxider
82a53a5e54
fix typo
2021-11-26 18:23:50 +00:00
Raúl Marín
f0ee0724ac
Reduce dependencies on ASTSelectQuery.h
...
243 -> 152
2021-11-26 18:35:24 +01:00
Raúl Marín
b2cfa70541
Reduce dependencies on ASTFunction.h
...
481 -> 230
2021-11-26 18:21:54 +01:00
Raúl Marín
91bf938075
Reduce dependencies on ASTLiteral.h
...
590 -> 537
2021-11-26 17:54:57 +01:00
Raúl Marín
051dddd8df
Reduce dependencies on ASTIdentifier.h
...
Goes from rebuilding 483 objects to 165 when it's modified
2021-11-26 16:49:40 +01:00
alexey-milovidov
d7939a3b61
Merge pull request #31838 from ClickHouse/reproducible-build-3
...
Reproducible builds (3)
2021-11-26 15:48:48 +03:00
Raúl Marín
c498b7ba59
Move limits check to ProcessList
2021-11-26 12:44:39 +01:00
Raúl Marín
be60759e68
Merge remote-tracking branch 'blessed/master' into pull_timeout
2021-11-26 11:37:19 +01:00
Kseniia Sumarokova
c786c0a52a
Merge pull request #31749 from kssenii/clickhouse-dictionary-conf
...
ClickHouse dictionary source support named collections
2021-11-26 10:55:03 +03:00
taiyang-li
d35e2a1c83
Merge branch 'master' into hive_table
2021-11-26 11:44:50 +08:00
Alexey Milovidov
79f6f5a202
More reproducible builds
2021-11-26 05:44:08 +03:00
kssenii
223048d395
Merge branch 'master' of github.com:ClickHouse/ClickHouse into vxider-window-view
2021-11-26 01:06:06 +03:00
michael1589
fe501d4dd4
fix merge error
2021-11-25 23:03:01 +08:00
Vladimir Chebotarev
bb2f21b1ad
Rebase fix.
2021-11-25 17:11:54 +03:00
Vladimir Chebotarev
e414fa01e0
Rebase fix.
2021-11-25 17:11:54 +03:00
Vladimir Chebotarev
c6e73d7b60
Synced clearOldMutations()
with rest of changes.
2021-11-25 17:11:54 +03:00
Vladimir Chebotarev
7bbaa14aee
Better comment.
2021-11-25 17:11:54 +03:00
Vladimir Chebotarev
ec1f909d74
Fixed wrong lock order.
2021-11-25 17:11:54 +03:00
Vladimir Chebotarev
12f36206cf
Deadlock fix.
2021-11-25 17:11:54 +03:00
Vladimir Chebotarev
84ffcb479b
Additional comments.
2021-11-25 17:11:52 +03:00
Vladimir Chebotarev
e0a453aadf
Minor fix.
2021-11-25 17:11:29 +03:00
Vladimir Chebotarev
863f3565ad
Test fixes.
2021-11-25 17:11:28 +03:00
Vladimir Chebotarev
390416b24d
Rebase fix.
2021-11-25 17:11:28 +03:00
Vladimir Chebotarev
30cd133418
Fixed duplication commands bug.
2021-11-25 17:11:28 +03:00