Alexey Milovidov
9969a73d50
Merge branch 'master' into azat-merge-distributed-join-fix
2020-11-23 12:43:15 +03:00
taichong
5c3d4b2245
add network partition integration test for MaterializeMySQL
2020-11-23 15:47:44 +08:00
robot-clickhouse
dc19fba36f
Auto version update to [20.13.1.1] [54444]
2020-11-23 10:29:26 +03:00
feng lv
18491d8920
fix
2020-11-23 05:30:36 +00:00
Alexey Milovidov
fbbf439338
Merge branch 'master' into Enmk-DateTime64_fixes_comparison
2020-11-23 05:46:17 +03:00
Alexander Tokmakov
60a5782c75
fix AST formatting in log messages
2020-11-22 20:23:12 +03:00
tavplubix
5cc9cb01cd
Merge pull request #16751 from amosbird/globalcontext
...
Make global_context consistent.
2020-11-22 18:46:17 +03:00
alesapin
9c8b0da382
Merge pull request #16033 from nvartolomei/nv/parts-uuid
...
Add unique identifiers IMergeTreeDataPart structure
2020-11-22 16:13:19 +03:00
Nikolai Kochetov
cf678b6092
Merge branch 'master' into order-inputs-in-action-dag
2020-11-21 13:54:50 +03:00
Pavel Kruglov
623dc2df7a
Update comment
2020-11-20 17:32:39 +03:00
Pavel Kruglov
ca3fe49a2a
Make setting global
2020-11-20 17:29:13 +03:00
Nicolae Vartolomei
7c8bc1c04e
Use JSON metadata in WAL
2020-11-20 13:49:17 +00:00
Nicolae Vartolomei
040aba9f85
Add uuid.txt to checksums for parts stored on disk
...
We are breaking backwards compatibility anyway (but agted by a setting)
2020-11-20 13:49:17 +00:00
Nicolae Vartolomei
94293ca3ce
Assign UUIDs to parts only when configured to do so
...
Avoid breaking backwards compatibility by default for now.
2020-11-20 13:49:17 +00:00
Amos Bird
1d9d586e20
Make global_context consistent.
2020-11-20 18:23:14 +08:00
Alexander Kuzmenkov
b05ac888bd
Merge remote-tracking branch 'origin/master' into HEAD
2020-11-20 12:50:08 +03:00
Pavel Kruglov
4c30857759
Minor change
2020-11-20 01:22:40 +03:00
Azat Khuzhin
5297417050
Fix Merge(Distributed()) with JOIN
2020-11-20 00:07:30 +03:00
Alexander Kuzmenkov
0d43e4c448
fixup
2020-11-19 20:16:45 +03:00
alesapin
3f01096c86
Less verbose logging when fetch is impossible
2020-11-19 20:03:20 +03:00
alesapin
2623d35f68
Merge pull request #17120 from ClickHouse/fix_granularity_on_block_borders
...
Fix index granularity calculation on block borders
2020-11-19 18:36:07 +03:00
Nicolae Vartolomei
746f8e45f5
All new parts must have uuids
2020-11-19 13:18:03 +00:00
Nicolae Vartolomei
425dc4b11b
Add unique identifiers IMergeTreeDataPart structure
...
For now uuids are not generated at all, they are present only if the
part is updated manually (as you can see in the integration test).
The only place where they can be seen today by an end user is in
`system.parts` table. I was looking for hiding this column behind an
option but couldn't find an easy way to do that.
Likely this is also required for WAL, but need to think how not to break
compatibility.
Relates to #13574 , https://github.com/ClickHouse/ClickHouse/issues/13574
Next 1: In the upcoming PR the plan is to integrate de-duplication based on
these fingerprints in the query pipeline.
Next 2: We'll enable automatic generation of uuids and come up with a
way for conditionally sending uuids when processing distributed queries
only when part movement is in progress.
2020-11-19 13:14:25 +00:00
Alexander Kuzmenkov
bcf15170ed
Merge remote-tracking branch 'origin/master' into HEAD
2020-11-19 15:29:51 +03:00
Peng Jian
10cefe4f51
fix code style
2020-11-19 15:44:47 +08:00
Peng Jian
3c86c8b3c9
fix test cases
2020-11-19 15:44:47 +08:00
Peng Jian
091f7065cd
fix build
2020-11-19 15:44:47 +08:00
Peng Jian
2df0c3e0b0
Add helper function for extracting zookeeper name and path.
2020-11-19 15:44:47 +08:00
Peng Jian
a0683ce460
Support mulitple ZooKeeper clusters
2020-11-19 15:44:47 +08:00
Alexander Kuzmenkov
f8fd365d15
compile
2020-11-18 20:49:51 +03:00
Alexander Kuzmenkov
1570320e20
fixes for context hierarchy
2020-11-18 20:43:18 +03:00
alesapin
7080f424e2
Fix bug for skip indices and make code more complex
2020-11-18 15:04:13 +03:00
filimonov
258170b325
Update ReplicatedMergeTreeMergeStrategyPicker.cpp
2020-11-18 08:45:44 +01:00
Mikhail Filimonov
234c671e52
After CR fixes
2020-11-18 08:45:44 +01:00
Mikhail Filimonov
97fef77ed1
execute_merges_on_single_replica
2020-11-18 08:45:33 +01:00
Nikolai Kochetov
13eceff55c
Remove Converting transform and step.
2020-11-17 20:16:55 +03:00
alesapin
389b883534
Fix index granularity calculation on block borders
2020-11-17 12:37:13 +03:00
alexey-milovidov
b494b18748
Merge pull request #17108 from ClickHouse/ya-make-owners
...
Add "OWNER" to ya.make files.
2020-11-17 05:19:46 +03:00
Alexey Milovidov
24f4fa6edf
Follow Arcadia ya.make rules
2020-11-17 00:16:50 +03:00
Alexey Milovidov
3df04ce0c2
Follow Arcadia ya.make rules
2020-11-16 21:24:58 +03:00
tavplubix
88de1b052c
Merge pull request #16048 from ClickHouse/materialized-view-check-stack-size
...
Fix possible stack overflow in materialized views.
2020-11-16 12:02:27 +03:00
Alexander Tokmakov
5c6191f798
fix
2020-11-16 00:31:52 +03:00
Anton Popov
de5ead0c40
add setting remove_empty_parts
2020-11-15 05:24:47 +03:00
alexey-milovidov
915d96fee0
Merge pull request #16955 from nikitamikhaylov/fix-typos
...
Fix typos
2020-11-14 17:17:37 +03:00
alexey-milovidov
8ef4bfc0b5
Merge pull request #16968 from amosbird/blocktypemismatch
...
Fix missing conversion of unmutated parts
2020-11-14 17:16:51 +03:00
Vasily Nemkov
e8ef167d78
Fixed 01087_table_function_generate for DateTime64
2020-11-14 09:28:52 +03:00
Anton Ivashkin
15b5d3a55a
Merge master
2020-11-13 19:32:35 +03:00
Anton Ivashkin
026f7e0a27
Add 's3_max_redirects' setting
2020-11-13 19:31:51 +03:00
Nikolai Kochetov
ed98b48845
Merge pull request #16618 from ClickHouse/actions-dag-f14
...
Actions dag 2
2020-11-13 18:34:51 +03:00
alesapin
b2a8b6135d
then
2020-11-13 16:24:14 +03:00
alesapin
b8e33bd35b
Add comments
2020-11-13 15:42:26 +03:00
alesapin
8d3858fc22
Merge pull request #16895 from CurtizJ/remove-empty-parts
...
Remove empty parts after they were pruned by TTL [2]
2020-11-13 10:00:18 +03:00
Amos Bird
fdf979d5ce
Fix missing conversion of unmutated parts
2020-11-13 11:45:50 +08:00
nikitamikhaylov
c0940f2ebd
done
2020-11-13 02:27:18 +03:00
alesapin
bbd85c3b2d
Merge pull request #16390 from ClickHouse/add_separate_pool_for_fetches
...
Add separate pool for fetches
2020-11-12 22:42:28 +03:00
Anton Popov
4cecd89e84
fix dropping of empty parts
2020-11-12 20:37:54 +03:00
tavplubix
e0dc004b95
Merge pull request #16885 from amosbird/dd
...
Disable ATTACH/DETACH TABLE <DICTIONARY>
2020-11-12 16:34:21 +03:00
Anton Popov
0aa35d53c7
Merge remote-tracking branch 'upstream/master' into HEAD
2020-11-12 14:31:58 +03:00
feng lv
b1cc582668
fix conflict
2020-11-12 10:42:53 +00:00
alesapin
2cac5e5d97
Merge pull request #16875 from CurtizJ/refactor-alter-partition
...
Avoid code duplication in alterPartition
2020-11-12 13:19:59 +03:00
alesapin
a8d466a645
Merge branch 'master' into add_separate_pool_for_fetches
2020-11-12 12:51:02 +03:00
Nikolai Kochetov
46f70dd0de
Merge branch 'master' into actions-dag-f14
2020-11-12 11:54:44 +03:00
feng lv
b7e5c6ed4d
fix conflict
2020-11-12 02:26:21 +00:00
sundyli
5ef809931e
Merge branch 'master' into storage-rocksdb
2020-11-12 08:26:27 +08:00
tavplubix
058aa8f85e
Merge pull request #16824 from ClickHouse/replace_stringstreams_with_buffers
...
Replace std::*stringstreams with DB::*Buffers
2020-11-12 01:11:44 +03:00
Anton Popov
0a6d93d929
Update MergeTreeData.h
2020-11-11 21:17:41 +03:00
Nikolai Kochetov
58c4a7b890
Some renames.
2020-11-11 19:52:27 +03:00
Anton Popov
2497598a49
Remove empty parts after they were pruned by TTL
2020-11-11 19:19:43 +03:00
Anton Popov
c01870076d
Update MergeTreeData.h
2020-11-11 19:09:01 +03:00
Amos Bird
134786afd5
Disable ATTACH/DETACH TABLE <DICTIONARY>
2020-11-11 23:04:49 +08:00
Anton Popov
6f0dc08ba7
avoid code duplication in alterPartition
2020-11-11 16:34:07 +03:00
Alexander Tokmakov
7da5e92754
fix
2020-11-11 13:41:12 +03:00
Pavel Kruglov
148dc71d0e
Fix StorageMergeTree.h
2020-11-11 13:38:00 +03:00
Pavel Kruglov
287d71b363
Fix build
2020-11-11 13:34:32 +03:00
Nikolai Kochetov
1846bb3cac
Merge branch 'master' into actions-dag-f14
2020-11-11 13:08:57 +03:00
sundy-li
579f4c50ed
improve rocksdb-cmake build
2020-11-11 17:39:23 +08:00
sundy-li
d8376a2d60
Merge branch 'storage-rocksdb' of github.com:sundy-li/ClickHouse into storage-rocksdb
2020-11-11 13:19:30 +08:00
feng lv
fec4080d42
Merge branch 'master' of github.com:ClickHouse/ClickHouse into union-distinct
2020-11-11 03:10:10 +00:00
sundy-li
c56d1212a2
rocksdb-cmake && fix iteration bug && improve tests
2020-11-11 09:39:09 +08:00
Alexey Milovidov
765c9eaeed
Fix improper error handling
2020-11-11 09:08:53 +08:00
Alexey Milovidov
07fbab9645
More normal
2020-11-11 09:08:53 +08:00
Alexey Milovidov
33599ae9b0
Remove unneeded dir
2020-11-11 09:08:53 +08:00
Alexey Milovidov
73e2f1b7ed
Improve performance two times
2020-11-11 09:08:53 +08:00
Alexey Milovidov
0001433b82
Better code
2020-11-11 09:08:53 +08:00
Alexey Milovidov
3915d65c2f
Fix bad wording
2020-11-11 09:08:53 +08:00
Alexey Milovidov
6376c8db7e
Make code slightly better
2020-11-11 09:08:53 +08:00
Alexey Milovidov
742ffdd145
Update ya.make
2020-11-11 09:08:53 +08:00
Alexey Milovidov
630aa9b0c3
Rename Rocksdb to RocksDB
2020-11-11 09:08:53 +08:00
sundy-li
46c01eb7a2
improve unbundle build
2020-11-11 09:08:53 +08:00
sundy-li
fb7066d73d
* fix fasttest and cmake && pipline for all_scan
...
* unique the keys
* add inputstream && outputstream
2020-11-11 09:08:53 +08:00
sundy-li
f95a66b584
add supportsIndexForIn && supportsParallelInsert, support parallel reading
2020-11-11 09:08:52 +08:00
sundy-li
fced1a0e28
fix extract keys
2020-11-11 09:08:52 +08:00
sundy-li
c7617173c4
add sync_file_range for glibc-compatibility
2020-11-11 09:08:52 +08:00
sundy-li
84dab52e45
skip rocksdb test in fasttest
2020-11-11 09:08:52 +08:00
sundy-li
b092ebe40d
add primary key for StorageEmbeddedRocksdb
2020-11-11 09:08:52 +08:00
sundy-li
1fa4906dd2
update cmake && remove useless codes
2020-11-11 09:08:52 +08:00
sundy-li
6f98a9e1c8
fix styles
2020-11-11 09:08:52 +08:00
root
e9de5b6ad4
Add StorageEmbeddedRocksdb Engine
2020-11-11 09:08:52 +08:00
Pavel Kruglov
dd06ff4f94
Minor change
2020-11-11 00:02:11 +03:00
Pavel Kruglov
1c35b47073
Add checking select decision in merge
2020-11-10 23:52:26 +03:00
Pavel Kruglov
c648f62629
Merge branch 'master' of github.com:ClickHouse/ClickHouse into optimize_final_optimization
2020-11-10 22:58:21 +03:00
Alexander Tokmakov
b94cc5c4e5
remove more stringstreams
2020-11-10 21:22:26 +03:00
Nikolai Kochetov
c6575c9032
Update ExpressionActions constructur
2020-11-10 19:27:55 +03:00
Nikolai Kochetov
1db8e77371
Add comments. Update ActionsDAG::Index
2020-11-10 17:54:59 +03:00
Pavel Kruglov
9120189d8a
Add SelectPartsDecision enum class
2020-11-10 17:42:56 +03:00
Nikolai Kochetov
07fe3a6347
Fix build.
2020-11-10 15:14:05 +03:00
Nikolai Kochetov
195c941c4e
Merge branch 'master' into storage-read-query-plan
2020-11-10 15:02:22 +03:00
alesapin
2e357516a6
Merge branch 'master' into add_separate_pool_for_fetches
2020-11-10 13:53:08 +03:00
Nikolai Kochetov
046830967c
Try fix tests.
2020-11-10 13:26:26 +03:00
Vladimir Chebotarev
059357d51e
ALTER UPDATE/DELETE ... IN PARTITION with partition pruning in ReplicatedMergeTree (#13403 )
...
Co-authored-by: Alexander Kazakov <Akazz@users.noreply.github.com>
2020-11-10 13:23:46 +03:00
Nikolai Kochetov
363c1e05c0
Try fix tests.
2020-11-10 12:35:05 +03:00
feng lv
9194985d48
Merge branch 'master' of github.com:ClickHouse/ClickHouse into union-distinct
2020-11-10 06:09:39 +00:00
Alexander Tokmakov
5cdfcfb307
remove other stringstreams
2020-11-09 22:12:44 +03:00
Nikolai Kochetov
e41b1ae52b
Empty commit.
2020-11-09 19:35:43 +03:00
Alexander Tokmakov
62ff00ee8b
use WriteBuffer in formatAST(...)
2020-11-09 19:05:40 +03:00
alesapin
ea7fe94aa9
Merge pull request #15511 from nvartolomei/nv/drop-detached-part-quorum-possible-solution
...
ALTER TABLE ... DROP|DETACH PART
2020-11-09 18:00:30 +03:00
alexey-milovidov
e47ed55d32
Merge pull request #14977 from achimbab/indexOf_bloomfilter
...
Fix indexOf() to use BloomFilter
2020-11-09 17:58:42 +03:00
Nikolai Kochetov
99cc9b1ec0
Fix build
2020-11-09 16:20:56 +03:00
Nikolai Kochetov
8c4db34f9d
Update after merge.
2020-11-09 14:58:11 +03:00
Nikolai Kochetov
6717c7a0af
Merge branch 'master' into actions-dag-f14
2020-11-09 14:57:48 +03:00
tavplubix
67099f28ac
Merge pull request #16591 from ClickHouse/aku/create-file
...
Support `SETTINGS` clause for File engine
2020-11-09 14:15:42 +03:00
alesapin
e347f4b72f
Add some comments
2020-11-09 12:14:20 +03:00
alesapin
72046313d4
Merge branch 'master' into nvartolomei-drop-part
2020-11-09 10:02:02 +03:00
alesapin
4e846d2197
Merge branch 'master' into add_separate_pool_for_fetches
2020-11-09 10:00:21 +03:00
alexey-milovidov
f39457bc77
Merge pull request #16788 from azat/fix-use_compact_format_in_distributed_parts_names
...
Apply use_compact_format_in_distributed_parts_names for each INSERT (with internal_replication)
2020-11-08 23:23:10 +03:00
Alexey Milovidov
8bb10ac3d8
Fix improper error handling
2020-11-08 20:29:16 +03:00
Alexey Milovidov
fa29c2f00d
More normal
2020-11-08 20:22:21 +03:00
Alexey Milovidov
e072d18a83
Remove unneeded dir
2020-11-08 20:13:17 +03:00
Alexey Milovidov
1250006e4e
Improve performance two times
2020-11-08 20:09:41 +03:00
Alexey Milovidov
2d9f07e601
Better code
2020-11-08 19:24:58 +03:00
alexey-milovidov
0e6ae4aff7
Merge pull request #16253 from amosbird/pf
...
Prune partition in verbatim way.
2020-11-08 18:58:02 +03:00
Alexey Milovidov
2ea93f4b67
Fix bad wording
2020-11-08 18:52:55 +03:00
Alexey Milovidov
4353a56790
Make code slightly better
2020-11-08 18:45:24 +03:00
Alexey Milovidov
7d0f1d33c6
Update ya.make
2020-11-08 18:43:05 +03:00
Alexey Milovidov
c89a363980
Rename Rocksdb to RocksDB
2020-11-08 18:41:16 +03:00
Alexey Milovidov
e75230dee3
Merge branch 'master' into sundy-li-storage-rocksdb
2020-11-08 17:51:44 +03:00
Alexey Milovidov
3f5839c83c
Add one more case
2020-11-08 16:45:57 +03:00
Alexey Milovidov
8e1a2fc9e4
Fix UB and overflow
2020-11-08 16:41:25 +03:00
alexey-milovidov
8264bd900b
Update MergeTreeIndexConditionBloomFilter.cpp
2020-11-08 16:17:03 +03:00
alexey-milovidov
85f7eadc4f
Update MergeTreeIndexConditionBloomFilter.cpp
2020-11-08 16:14:32 +03:00
alexey-milovidov
dfa35a5e6d
Update MergeTreeIndexConditionBloomFilter.cpp
2020-11-08 16:11:18 +03:00
Alexey Milovidov
cc012e2cc7
Merge branch 'master' into achimbab-indexOf_bloomfilter
2020-11-08 14:42:03 +03:00
alexey-milovidov
2d427eb1e8
Merge pull request #16496 from ClickHouse/register-formats
...
Fix inconsistency in FormatFactory
2020-11-08 14:27:33 +03:00
alexey-milovidov
f4ba5f1f9a
Merge pull request #16772 from ClickHouse/fix-stringstream
...
Fix "server failed to start" error
2020-11-08 14:27:08 +03:00
Azat Khuzhin
04db0834bf
Apply use_compact_format_in_distributed_parts_names for each INSERT (with internal_replication)
...
Before this patch use_compact_format_in_distributed_parts_names was
applied only from default profile (at server start) for
internal_replication=1, and was ignored on INSERT.
2020-11-08 03:05:52 +03:00
Alexey Milovidov
ba4ae00121
Whitespace
2020-11-08 00:30:40 +03:00
Alexey Milovidov
1ea3afadbc
Merge with master
2020-11-08 00:28:39 +03:00
Alexey Milovidov
5314185e25
Merge branch 'master' into azat-optimize_skip_unused_shards-optimization
2020-11-08 00:17:59 +03:00
Alexey Milovidov
dba57529f8
Merge branch 'master' of github.com:yandex/ClickHouse into fix-stringstream
2020-11-07 22:03:38 +03:00
feng lv
1ca7dcb0a8
fix conflict
2020-11-07 11:44:29 +00:00
