sundy-li
b092ebe40d
add primary key for StorageEmbeddedRocksdb
2020-11-11 09:08:52 +08:00
sundy-li
1fa4906dd2
update cmake && remove useless codes
2020-11-11 09:08:52 +08:00
sundy-li
6f98a9e1c8
fix styles
2020-11-11 09:08:52 +08:00
root
e9de5b6ad4
Add StorageEmbeddedRocksdb Engine
2020-11-11 09:08:52 +08:00
Pavel Kruglov
dd06ff4f94
Minor change
2020-11-11 00:02:11 +03:00
Pavel Kruglov
1c35b47073
Add checking select decision in merge
2020-11-10 23:52:26 +03:00
Pavel Kruglov
c648f62629
Merge branch 'master' of github.com:ClickHouse/ClickHouse into optimize_final_optimization
2020-11-10 22:58:21 +03:00
Alexander Tokmakov
b94cc5c4e5
remove more stringstreams
2020-11-10 21:22:26 +03:00
Nikolai Kochetov
c6575c9032
Update ExpressionActions constructur
2020-11-10 19:27:55 +03:00
Nikolai Kochetov
1db8e77371
Add comments. Update ActionsDAG::Index
2020-11-10 17:54:59 +03:00
Pavel Kruglov
9120189d8a
Add SelectPartsDecision enum class
2020-11-10 17:42:56 +03:00
Nikolai Kochetov
07fe3a6347
Fix build.
2020-11-10 15:14:05 +03:00
Nikolai Kochetov
195c941c4e
Merge branch 'master' into storage-read-query-plan
2020-11-10 15:02:22 +03:00
alesapin
2e357516a6
Merge branch 'master' into add_separate_pool_for_fetches
2020-11-10 13:53:08 +03:00
Nikolai Kochetov
046830967c
Try fix tests.
2020-11-10 13:26:26 +03:00
Vladimir Chebotarev
059357d51e
ALTER UPDATE/DELETE ... IN PARTITION
with partition pruning in ReplicatedMergeTree
(#13403 )
...
Co-authored-by: Alexander Kazakov <Akazz@users.noreply.github.com>
2020-11-10 13:23:46 +03:00
Nikolai Kochetov
363c1e05c0
Try fix tests.
2020-11-10 12:35:05 +03:00
feng lv
9194985d48
Merge branch 'master' of github.com:ClickHouse/ClickHouse into union-distinct
2020-11-10 06:09:39 +00:00
Alexander Tokmakov
5cdfcfb307
remove other stringstreams
2020-11-09 22:12:44 +03:00
Nikolai Kochetov
e41b1ae52b
Empty commit.
2020-11-09 19:35:43 +03:00
Alexander Tokmakov
62ff00ee8b
use WriteBuffer in formatAST(...)
2020-11-09 19:05:40 +03:00
alesapin
ea7fe94aa9
Merge pull request #15511 from nvartolomei/nv/drop-detached-part-quorum-possible-solution
...
ALTER TABLE ... DROP|DETACH PART
2020-11-09 18:00:30 +03:00
alexey-milovidov
e47ed55d32
Merge pull request #14977 from achimbab/indexOf_bloomfilter
...
Fix indexOf() to use BloomFilter
2020-11-09 17:58:42 +03:00
Nikolai Kochetov
99cc9b1ec0
Fix build
2020-11-09 16:20:56 +03:00
Nikolai Kochetov
8c4db34f9d
Update after merge.
2020-11-09 14:58:11 +03:00
Nikolai Kochetov
6717c7a0af
Merge branch 'master' into actions-dag-f14
2020-11-09 14:57:48 +03:00
tavplubix
67099f28ac
Merge pull request #16591 from ClickHouse/aku/create-file
...
Support `SETTINGS` clause for File engine
2020-11-09 14:15:42 +03:00
alesapin
e347f4b72f
Add some comments
2020-11-09 12:14:20 +03:00
alesapin
72046313d4
Merge branch 'master' into nvartolomei-drop-part
2020-11-09 10:02:02 +03:00
alesapin
4e846d2197
Merge branch 'master' into add_separate_pool_for_fetches
2020-11-09 10:00:21 +03:00
alexey-milovidov
f39457bc77
Merge pull request #16788 from azat/fix-use_compact_format_in_distributed_parts_names
...
Apply use_compact_format_in_distributed_parts_names for each INSERT (with internal_replication)
2020-11-08 23:23:10 +03:00
Alexey Milovidov
8bb10ac3d8
Fix improper error handling
2020-11-08 20:29:16 +03:00
Alexey Milovidov
fa29c2f00d
More normal
2020-11-08 20:22:21 +03:00
Alexey Milovidov
e072d18a83
Remove unneeded dir
2020-11-08 20:13:17 +03:00
Alexey Milovidov
1250006e4e
Improve performance two times
2020-11-08 20:09:41 +03:00
Alexey Milovidov
2d9f07e601
Better code
2020-11-08 19:24:58 +03:00
alexey-milovidov
0e6ae4aff7
Merge pull request #16253 from amosbird/pf
...
Prune partition in verbatim way.
2020-11-08 18:58:02 +03:00
Alexey Milovidov
2ea93f4b67
Fix bad wording
2020-11-08 18:52:55 +03:00
Alexey Milovidov
4353a56790
Make code slightly better
2020-11-08 18:45:24 +03:00
Alexey Milovidov
7d0f1d33c6
Update ya.make
2020-11-08 18:43:05 +03:00
Alexey Milovidov
c89a363980
Rename Rocksdb to RocksDB
2020-11-08 18:41:16 +03:00
Alexey Milovidov
e75230dee3
Merge branch 'master' into sundy-li-storage-rocksdb
2020-11-08 17:51:44 +03:00
Alexey Milovidov
3f5839c83c
Add one more case
2020-11-08 16:45:57 +03:00
Alexey Milovidov
8e1a2fc9e4
Fix UB and overflow
2020-11-08 16:41:25 +03:00
alexey-milovidov
8264bd900b
Update MergeTreeIndexConditionBloomFilter.cpp
2020-11-08 16:17:03 +03:00
alexey-milovidov
85f7eadc4f
Update MergeTreeIndexConditionBloomFilter.cpp
2020-11-08 16:14:32 +03:00
alexey-milovidov
dfa35a5e6d
Update MergeTreeIndexConditionBloomFilter.cpp
2020-11-08 16:11:18 +03:00
Alexey Milovidov
cc012e2cc7
Merge branch 'master' into achimbab-indexOf_bloomfilter
2020-11-08 14:42:03 +03:00
alexey-milovidov
2d427eb1e8
Merge pull request #16496 from ClickHouse/register-formats
...
Fix inconsistency in FormatFactory
2020-11-08 14:27:33 +03:00
alexey-milovidov
f4ba5f1f9a
Merge pull request #16772 from ClickHouse/fix-stringstream
...
Fix "server failed to start" error
2020-11-08 14:27:08 +03:00
Azat Khuzhin
04db0834bf
Apply use_compact_format_in_distributed_parts_names for each INSERT (with internal_replication)
...
Before this patch use_compact_format_in_distributed_parts_names was
applied only from default profile (at server start) for
internal_replication=1, and was ignored on INSERT.
2020-11-08 03:05:52 +03:00
Alexey Milovidov
ba4ae00121
Whitespace
2020-11-08 00:30:40 +03:00
Alexey Milovidov
1ea3afadbc
Merge with master
2020-11-08 00:28:39 +03:00
Alexey Milovidov
5314185e25
Merge branch 'master' into azat-optimize_skip_unused_shards-optimization
2020-11-08 00:17:59 +03:00
Alexey Milovidov
dba57529f8
Merge branch 'master' of github.com:yandex/ClickHouse into fix-stringstream
2020-11-07 22:03:38 +03:00
feng lv
1ca7dcb0a8
fix conflict
2020-11-07 11:44:29 +00:00
alexey-milovidov
8dbd04a229
Merge pull request #16727 from azat/distribution_queue-masking
...
Mask password in data_path in the system.distribution_queue
2020-11-07 13:40:41 +03:00
Alexander Kuzmenkov
79f759fb6c
Merge remote-tracking branch 'origin/master' into HEAD
2020-11-07 11:54:11 +03:00
Alexander Kuzmenkov
3c60f6cec2
make a separate settings collection + some cleanup
2020-11-07 11:53:39 +03:00
Alexey Milovidov
fd84d16387
Fix "server failed to start" error
2020-11-07 03:14:53 +03:00
Azat Khuzhin
c057e86040
Fix path masking in system.distribution_queue for multiple nodes
2020-11-06 21:04:50 +03:00
sundy-li
e55824c3df
improve unbundle build
2020-11-07 00:28:11 +08:00
sundy-li
94cb974f42
* fix fasttest and cmake && pipline for all_scan
...
* unique the keys
* add inputstream && outputstream
2020-11-06 23:47:26 +08:00
sundy-li
c88ede4f97
add supportsIndexForIn && supportsParallelInsert, support parallel reading
2020-11-06 23:47:01 +08:00
sundy-li
8dd9d166dc
fix extract keys
2020-11-06 23:47:01 +08:00
sundy-li
88250fec5d
add sync_file_range for glibc-compatibility
2020-11-06 23:46:44 +08:00
sundy-li
1f4a63b6c6
skip rocksdb test in fasttest
2020-11-06 23:46:44 +08:00
sundy-li
09bcc16669
add primary key for StorageEmbeddedRocksdb
2020-11-06 23:46:05 +08:00
sundy-li
546d7da12e
update cmake && remove useless codes
2020-11-06 23:45:41 +08:00
sundy-li
2f5e903c10
fix styles
2020-11-06 23:45:41 +08:00
root
e474bcca8e
Add StorageEmbeddedRocksdb Engine
2020-11-06 23:45:13 +08:00
alexey-milovidov
7fb53b205c
Merge pull request #16637 from azat/mt-read_in_order-spread-fix
...
Fix spreading for ReadInOrderOptimizer with expression in ORDER BY
2020-11-06 17:36:03 +03:00
Nikolai Kochetov
c10f733587
Merge branch 'master' into storage-read-query-plan
2020-11-06 15:43:46 +03:00
Nikolai Kochetov
9aeb757da4
Merge branch 'master' into actions-dag-f14
2020-11-06 15:04:20 +03:00
Amos Bird
2b0085c106
Pruning is different from counting
2020-11-06 19:58:03 +08:00
Amos Bird
aa436a3cb1
Transform single point
2020-11-06 14:59:55 +08:00
Amos Bird
30bf5e6d26
Prune partition in verbatim way.
2020-11-06 09:56:13 +08:00
Azat Khuzhin
b2e17916e4
Mask password in data_path in the system.distribution_queue
2020-11-06 00:10:25 +03:00
Azat Khuzhin
f23995d290
Remove empty directories for async INSERT at start of Distributed engine
...
Will be created by DistributedBlockOutputStream on demand.
2020-11-05 23:50:30 +03:00
Azat Khuzhin
59cdc964a1
Do not store reference to BackgroundSchedulePool in DirectoryMonitor (useless)
2020-11-05 23:43:34 +03:00
robot-clickhouse
f7b7854ace
Auto version update to [20.12.1.1] [54443]
2020-11-05 21:52:50 +03:00
alexey-milovidov
ee3e289ec2
Merge pull request #15983 from ClickHouse/no_background_pool_no_more
...
Replace BackgroundProcessingPool with SchedulePool task and ThreadPool.
2020-11-05 21:38:22 +03:00
alexey-milovidov
39cd1c0371
Merge pull request #16700 from ClickHouse/better-arcadia
...
Improve Arcadia
2020-11-05 15:34:34 +03:00
Anton Popov
bea0984d12
Merge pull request #16642 from kitaisreal/bloom-filter-index-added-big-int-and-uuid-support
...
BloomFilter index added big integers and UUID support
2020-11-05 15:26:08 +03:00
Alexander Kuzmenkov
2efbcbaa14
Merge remote-tracking branch 'origin/master' into HEAD
2020-11-05 14:28:56 +03:00
Alexander Kuzmenkov
14f31f5117
add support of settings to URL, fix url and file table functions
2020-11-05 14:28:20 +03:00
Alexey Milovidov
b56486510f
Improve Arcadia
2020-11-05 12:55:01 +03:00
Alexander Kuzmenkov
faf1f1e0cd
Merge remote-tracking branch 'origin/master' into HEAD
2020-11-05 11:09:11 +03:00
Maksim Kita
7dd749fc4c
BloomFilter index added big integers and UUID support
2020-11-04 23:41:10 +03:00
Alexey Milovidov
1bcf22d42f
Fix 'max_parallel_replicas' without sampling.
2020-11-04 18:59:14 +03:00
Alexey Milovidov
f7c77b4a25
Fix unit tests
2020-11-04 13:14:23 +03:00
alexey-milovidov
4fede5b008
Merge pull request #16438 from azat/errorCode-v2
...
Add errorCodeToName() and system.errors
2020-11-04 12:40:47 +03:00
alexey-milovidov
0456cb2a09
Merge pull request #16638 from azat/simplify-ReadInOrderOptimizer
...
[RFC] Do not pass StoragePtr to ReadInOrderOptimizer::getInputOrder()
2020-11-04 11:29:06 +03:00
alesapin
20043e77bb
Merge branch 'master' into nvartolomei-drop-part
2020-11-04 10:22:23 +03:00
Azat Khuzhin
2389406c21
Fix spreading for ReadInOrderOptimizer with expression in ORDER BY
...
This will fix optimize_read_in_order/optimize_aggregation_in_order with
max_threads>0 and expression in ORDER BY
2020-11-04 07:07:26 +03:00
alexey-milovidov
8a3f38f332
Merge branch 'master' into errorCode-v2
2020-11-04 01:40:41 +03:00
alexey-milovidov
df83291603
Merge pull request #16612 from ClickHouse/alter-name-collision
...
Fix possible name collision in calculation of DEFAULT expression.
2020-11-04 01:34:31 +03:00
Nikolai Kochetov
54a9b80a11
Fix build
2020-11-03 22:30:58 +03:00
Nikolai Kochetov
4984fdc693
Fix build
2020-11-03 22:28:50 +03:00
Nikolai Kochetov
3e012265d3
Fix build
2020-11-03 22:26:55 +03:00
Nikolai Kochetov
7b61f5d641
Refactor more
2020-11-03 22:05:47 +03:00
Azat Khuzhin
e7f15dff55
Do not pass StoragePtr to ReadInOrderOptimizer::getInputOrder()
...
Looks like this is not required anymore, since #11745
2020-11-03 21:22:46 +03:00
alesapin
faca9d9b91
Check max bytes on disk
2020-11-03 18:41:46 +03:00
Nikolai Kochetov
6767a226fc
Merge branch 'master' into actions-dag-f14
2020-11-03 15:21:06 +03:00
Nikolai Kochetov
07a7c46b89
Refactor ExpressionActions [Part 3]
2020-11-03 14:28:28 +03:00
alexey-milovidov
11fc6fd8c9
Merge pull request #16584 from ClickHouse/drop_table_task_better_scheduling
...
Better scheduling of drop table task
2020-11-03 14:22:51 +03:00
Anton Popov
85ab1e9bc3
Merge pull request #15938 from Avogar/select_final
...
Select final
2020-11-03 13:49:47 +03:00
alesapin
6e32e17a7d
Merge branch 'master' into alter-name-collision
2020-11-03 13:16:34 +03:00
alesapin
da8ac948bf
Disallow to drop parts with parallel quorum
2020-11-03 12:24:10 +03:00
alesapin
294489f6ad
Merge branch 'master' into nvartolomei-drop-part
2020-11-03 10:19:03 +03:00
alesapin
01898be459
Merge pull request #16606 from ClickHouse/better_serialize_last_index_row
...
Simplier serialization of last index column
2020-11-03 09:59:50 +03:00
Anton Popov
a3a8e18637
Merge branch 'master' into select_final
2020-11-03 00:00:43 +03:00
Alexander Kuzmenkov
f10a5207f4
Merge pull request #16601 from ClickHouse/ban_aggregate_function_in_primary_key
...
Restrict to use non-comparable types in primary key
2020-11-02 23:27:46 +03:00
Alexey Milovidov
e6d8ab2270
Fix possible name collision in ALTER
2020-11-02 21:37:23 +03:00
alesapin
dac6705995
DROP PART and clear blocks in a single zookeeper op
2020-11-02 20:30:59 +03:00
Alexander Tokmakov
ac32809b6a
fix #16482
2020-11-02 19:40:39 +03:00
alesapin
364607d87d
Merge with master
2020-11-02 19:18:18 +03:00
alesapin
67d22b3e57
Merge branch 'master' into nvartolomei-drop-part
2020-11-02 19:09:09 +03:00
Alexander Kuzmenkov
548ac9d57b
Merge remote-tracking branch 'origin/master' into HEAD
2020-11-02 17:37:30 +03:00
alesapin
7f8560e0c0
Merge pull request #16538 from amosbird/fp2
...
Allow fetching duplicate parts to detach
2020-11-02 16:10:42 +03:00
feng lv
4d722bc52c
fix conflict
2020-11-02 12:52:12 +00:00
alesapin
fbda80ac89
Simplier storage of last index column
2020-11-02 15:19:37 +03:00
alesapin
360548180c
Remove redundant include
2020-11-02 14:42:25 +03:00
alesapin
f3b3025719
Ban non comparable types in primary key
2020-11-02 14:39:27 +03:00
feng lv
1a34abadbc
fix
...
fix
fix
2020-11-02 10:46:58 +00:00
alesapin
8b0d9fbc07
Merge branch 'no_background_pool_no_more' into add_separate_pool_for_fetches
2020-11-02 10:54:09 +03:00
Alexander Kuzmenkov
99ee127620
Support SETTINGS
clause for File engine
...
Accept the usual user settings related to file formats.
Most of the diff are the mechanistic code changes required to allow
providing the required FormatSettings to the format factory. The File
engine then extracts these settings from the `CREATE` query, and specifies
them when creating the format parser.
2020-11-02 10:50:38 +03:00
alesapin
101aa9e931
Merge branch 'master' into no_background_pool_no_more
2020-11-02 10:49:19 +03:00
feng lv
3dce3c6a21
fix
2020-11-02 05:28:37 +00:00
alesapin
ae53092536
Merge branch 'master' into system_fetches_table
2020-10-31 18:45:17 +03:00
tavplubix
db146ee615
Merge pull request #16555 from ClickHouse/yet_another_fix_for_00993
...
Better logging in replication queue, fix flacky test
2020-10-31 14:38:15 +03:00
Azat Khuzhin
e07473f1ea
Update comment for StorageSystemErrors
2020-10-31 11:29:17 +03:00
tavplubix
ce6c44eb9f
Update ReplicatedMergeTreeQueue.cpp
2020-10-30 18:47:58 +03:00
Alexander Tokmakov
cf8202d36e
better logging, fix flacky test
2020-10-30 15:41:39 +03:00
alesapin
be183027b3
Merge pull request #16516 from zlobober/remove_g0
...
Remove -g0 form Arcadia build settings.
2020-10-30 13:58:08 +03:00
alesapin
15ba4dd851
Review fix
2020-10-30 11:52:11 +03:00
alesapin
b34960bffa
Merge branch 'master' into system_fetches_table
2020-10-30 11:33:37 +03:00
Azat Khuzhin
3661769e1b
Remove some absolute changes for errorCodeToName/system.errors
2020-10-30 09:04:22 +03:00
Amos Bird
18c5abc44e
Allow fetching duplicate parts to detach
2020-10-30 10:55:50 +08:00
Azat Khuzhin
ce9897bfd8
Fix readability-container-size-empty in StorageSystemErrors.cpp
2020-10-30 00:07:40 +03:00
Nikolai Kochetov
1c106691b5
Merge pull request #16423 from amosbird/jbodread
...
Balanced reading from JBOD
2020-10-29 19:22:45 +03:00
Maxim Akhmedov
3627fabfb9
Remove -g0 form Arcadia build settings.
2020-10-29 17:37:23 +03:00
alesapin
0e07afb821
Merge branch 'no_background_pool_no_more' into add_separate_pool_for_fetches
2020-10-29 12:53:55 +03:00
alesapin
40fc512e79
Merge branch 'master' into no_background_pool_no_more
2020-10-29 12:53:34 +03:00
Azat Khuzhin
b42f77a791
Covert error codes list to lookup table and drop generation of them.
2020-10-29 10:55:41 +03:00
Azat Khuzhin
b2e2322895
Add system.errors table
...
Contains error codes with number of times they have been triggered.
Columns:
- `name` ([String](../../sql-reference/data-types/string.md)) — name of the error (`errorCodeToName`).
- `code` ([Int32](../../sql-reference/data-types/int-uint.md)) — code number of the error.
- `value` ([UInt64](../../sql-reference/data-types/int-uint.md)) - number of times this error has been happened.
**Example**
``` sql
SELECT *
FROM system.errors
WHERE value > 0
ORDER BY code ASC
LIMIT 1
┌─name─────────────┬─code─┬─value─┐
│ CANNOT_OPEN_FILE │ 76 │ 1 │
└──────────────────┴──────┴───────┘
2020-10-29 10:55:38 +03:00
Nikolai Kochetov
671d2b7f1b
Update MergeTreeReadPool.cpp
...
Fix comment
2020-10-29 10:04:23 +03:00
alexey-milovidov
0faf2bc7e3
Merge pull request #16332 from ClickHouse/fix-queue-processing-of-very-large-entries
...
Fix processing of very large entries in queue
2020-10-29 09:09:29 +03:00
alexey-milovidov
bf3acecf6f
Merge pull request #16032 from Avogar/mysql_bug
...
Don't touch MySQL database if it's unnecessary
2020-10-29 04:14:26 +03:00
Nikolai Kochetov
10bad32fb4
Refactor code a little bit. Add comment.
2020-10-29 00:52:26 +03:00
Amos Bird
f995ef9797
Balanced reading from JBOD
2020-10-29 04:05:07 +08:00
alesapin
57c3935a26
Merge pull request #16426 from kssenii/rabbit-optimize
...
Optimize rabbitmq engine
2020-10-28 22:24:22 +03:00
alesapin
9830ff1003
Merge pull request #16094 from nvartolomei/nv/wal-metadata-compatibility
...
RFC: Add metadata section to MergeTreeWriteAheadLog
2020-10-28 15:54:46 +03:00
alesapin
8e8bdeb5d7
Merge pull request #16434 from ClickHouse/fix_fake_race_on_merges_list
...
Fix fake race condition on system.merges merge_algorithm
2020-10-28 15:51:53 +03:00
alesapin
0931658c2f
Merge branch 'master' into add_separate_pool_for_fetches
2020-10-28 14:20:56 +03:00
tavplubix
cd70dc82cd
Merge pull request #16409 from azat/drop-distributed-fix
...
Fix DROP TABLE for Distributed (racy with INSERT)
2020-10-28 14:10:32 +03:00
alesapin
3c31a5134e
Fix bug
2020-10-28 14:03:26 +03:00
tavplubix
4a63f1271b
Merge pull request #16244 from ClickHouse/fix_race_data_parts_exchange_endpoint
...
Fix race on StorageReplicatedMergeTree::data_parts_exchange_endpoint
2020-10-28 13:25:55 +03:00
alesapin
c10370f98d
Merge branch 'master' into fix-queue-processing-of-very-large-entries
2020-10-28 11:19:34 +03:00
alesapin
617e42ddb4
Merge branch 'master' into rabbit-optimize
2020-10-28 10:24:05 +03:00
alesapin
1c9e24b5e2
Merge branch 'master' into system_fetches_table
2020-10-28 10:20:04 +03:00
kssenii
4b59882c30
Remove redundant, add virt col
2020-10-27 20:34:31 +00:00
Alexander Kuzmenkov
6509f1eb39
Merge branch 'master' into minumum
2020-10-27 21:38:23 +03:00
Azat Khuzhin
fc14fde24a
Fix DROP TABLE for Distributed (racy with INSERT)
...
<details>
```
drop() on T1275:
0 DB::StorageDistributed::drop (this=0x7f9ed34f0000) at ../contrib/libcxx/include/__hash_table:966
1 0x000000000d557242 in DB::DatabaseOnDisk::dropTable (this=0x7f9fc22706d8, context=..., table_name=...)
at ../contrib/libcxx/include/new:340
2 0x000000000d6fcf7c in DB::InterpreterDropQuery::executeToTable (this=this@entry=0x7f9e42560dc0, query=...)
at ../contrib/libcxx/include/memory:3826
3 0x000000000d6ff5ee in DB::InterpreterDropQuery::execute (this=0x7f9e42560dc0) at ../src/Interpreters/InterpreterDropQuery.cpp:50
4 0x000000000daa40c0 in DB::executeQueryImpl (begin=<optimized out>, end=<optimized out>, context=..., internal=<optimized out>,
stage=DB::QueryProcessingStage::Complete, has_query_tail=false, istr=0x0) at ../src/Interpreters/executeQuery.cpp:420
5 0x000000000daa59df in DB::executeQuery (query=..., context=..., internal=internal@entry=false, stage=<optimized out>,
may_have_embedded_data=<optimized out>) at ../contrib/libcxx/include/string:1487
6 0x000000000e1369e6 in DB::TCPHandler::runImpl (this=this@entry=0x7f9ddf3a9000) at ../src/Server/TCPHandler.cpp:254
7 0x000000000e1379c9 in DB::TCPHandler::run (this=0x7f9ddf3a9000) at ../src/Server/TCPHandler.cpp:1326
8 0x000000001086fac7 in Poco::Net::TCPServerConnection::start (this=this@entry=0x7f9ddf3a9000)
at ../contrib/poco/Net/src/TCPServerConnection.cpp:43
9 0x000000001086ff2b in Poco::Net::TCPServerDispatcher::run (this=0x7f9e4eba5c00)
at ../contrib/poco/Net/src/TCPServerDispatcher.cpp:114
10 0x00000000109dbe8e in Poco::PooledThread::run (this=0x7f9e4a2d2f80) at ../contrib/poco/Foundation/src/ThreadPool.cpp:199
11 0x00000000109d78f9 in Poco::ThreadImpl::runnableEntry (pThread=<optimized out>)
at ../contrib/poco/Foundation/include/Poco/SharedPtr.h:401
12 0x00007f9fc3cccea7 in start_thread (arg=<optimized out>) at pthread_create.c:477
13 0x00007f9fc3bebeaf in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
StorageDistributedDirectoryMonitor on T166:
0 DB::StorageDistributedDirectoryMonitor::StorageDistributedDirectoryMonitor (this=0x7f9ea7ab1400, storage_=..., path_=...,
pool_=..., monitor_blocker_=..., bg_pool_=...) at ../src/Storages/Distributed/DirectoryMonitor.cpp:81
1 0x000000000dbf684e in std::__1::make_unique<> () at ../contrib/libcxx/include/memory:3474
2 DB::StorageDistributed::requireDirectoryMonitor (this=0x7f9ed34f0000, disk=..., name=...)
at ../src/Storages/StorageDistributed.cpp:682
3 0x000000000de3d5fa in DB::DistributedBlockOutputStream::writeToShard (this=this@entry=0x7f9ed39c7418, block=..., dir_names=...)
at ../src/Storages/Distributed/DistributedBlockOutputStream.cpp:634
4 0x000000000de3e214 in DB::DistributedBlockOutputStream::writeAsyncImpl (this=this@entry=0x7f9ed39c7418, block=...,
shard_id=shard_id@entry=79) at ../src/Storages/Distributed/DistributedBlockOutputStream.cpp:539
5 0x000000000de3e47b in DB::DistributedBlockOutputStream::writeSplitAsync (this=this@entry=0x7f9ed39c7418, block=...)
at ../contrib/libcxx/include/vector:1546
6 0x000000000de3eab0 in DB::DistributedBlockOutputStream::writeAsync (block=..., this=0x7f9ed39c7418)
at ../src/Storages/Distributed/DistributedBlockOutputStream.cpp:141
7 DB::DistributedBlockOutputStream::write (this=0x7f9ed39c7418, block=...)
at ../src/Storages/Distributed/DistributedBlockOutputStream.cpp:135
8 0x000000000d73b376 in DB::PushingToViewsBlockOutputStream::write (this=this@entry=0x7f9ea7a8cf58, block=...)
at ../src/DataStreams/PushingToViewsBlockOutputStream.cpp:157
9 0x000000000d7853eb in DB::AddingDefaultBlockOutputStream::write (this=0x7f9ed383d118, block=...)
at ../contrib/libcxx/include/memory:3826
10 0x000000000d740790 in DB::SquashingBlockOutputStream::write (this=0x7f9ed383de18, block=...)
at ../contrib/libcxx/include/memory:3826
11 0x000000000d68c308 in DB::CountingBlockOutputStream::write (this=0x7f9ea7ac6d60, block=...)
at ../contrib/libcxx/include/memory:3826
12 0x000000000ddab449 in DB::StorageBuffer::writeBlockToDestination (this=this@entry=0x7f9fbd56a000, block=..., table=...)
at ../src/Storages/StorageBuffer.cpp:747
13 0x000000000ddabfa6 in DB::StorageBuffer::flushBuffer (this=this@entry=0x7f9fbd56a000, buffer=...,
check_thresholds=check_thresholds@entry=true, locked=locked@entry=false, reset_block_structure=reset_block_structure@entry=false)
at ../src/Storages/StorageBuffer.cpp:661
14 0x000000000ddac415 in DB::StorageBuffer::flushAllBuffers (reset_blocks_structure=false, check_thresholds=true, this=0x7f9fbd56a000)
at ../src/Storages/StorageBuffer.cpp:605
shutdown() on T1275:
0 DB::StorageDistributed::shutdown (this=0x7f9ed34f0000) at ../contrib/libcxx/include/atomic:1612
1 0x000000000d6fd938 in DB::InterpreterDropQuery::executeToTable (this=this@entry=0x7f98530c79a0, query=...)
at ../src/Storages/TableLockHolder.h:12
2 0x000000000d6ff5ee in DB::InterpreterDropQuery::execute (this=0x7f98530c79a0) at ../src/Interpreters/InterpreterDropQuery.cpp:50
3 0x000000000daa40c0 in DB::executeQueryImpl (begin=<optimized out>, end=<optimized out>, context=..., internal=<optimized out>,
stage=DB::QueryProcessingStage::Complete, has_query_tail=false, istr=0x0) at ../src/Interpreters/executeQuery.cpp:420
4 0x000000000daa59df in DB::executeQuery (query=..., context=..., internal=internal@entry=false, stage=<optimized out>,
may_have_embedded_data=<optimized out>) at ../contrib/libcxx/include/string:1487
5 0x000000000e1369e6 in DB::TCPHandler::runImpl (this=this@entry=0x7f9ddf3a9000) at ../src/Server/TCPHandler.cpp:254
6 0x000000000e1379c9 in DB::TCPHandler::run (this=0x7f9ddf3a9000) at ../src/Server/TCPHandler.cpp:1326
7 0x000000001086fac7 in Poco::Net::TCPServerConnection::start (this=this@entry=0x7f9ddf3a9000)
at ../contrib/poco/Net/src/TCPServerConnection.cpp:43
8 0x000000001086ff2b in Poco::Net::TCPServerDispatcher::run (this=0x7f9e4eba5c00)
at ../contrib/poco/Net/src/TCPServerDispatcher.cpp:114
9 0x00000000109dbe8e in Poco::PooledThread::run (this=0x7f9e4a2d2f80) at ../contrib/poco/Foundation/src/ThreadPool.cpp:199
10 0x00000000109d78f9 in Poco::ThreadImpl::runnableEntry (pThread=<optimized out>)
at ../contrib/poco/Foundation/include/Poco/SharedPtr.h:401
11 0x00007f9fc3cccea7 in start_thread (arg=<optimized out>) at pthread_create.c:477
12 0x00007f9fc3bebeaf in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
```
</details>
2020-10-27 21:19:36 +03:00
alesapin
3ec5fc7a4c
Add explicit
2020-10-27 18:29:06 +03:00
alesapin
60f2d822d7
Fix fake race condition on system.merges merge_algorithm
2020-10-27 18:27:12 +03:00
Alexander Kuzmenkov
60544ad46e
Merge pull request #16373 from ClickHouse/better-rethrow
...
Better exceptions rethrow
2020-10-27 16:38:32 +03:00
alesapin
6253d1466a
Fix comments
2020-10-27 16:09:14 +03:00
alesapin
3d3d246bdc
Rename table
2020-10-27 16:07:50 +03:00
alesapin
e40c509392
More clear callback name
2020-10-27 16:00:40 +03:00
alesapin
f35edfb2a5
Remove some unused fields
2020-10-27 15:57:55 +03:00
alesapin
ee4e6caf70
Remove redundant metric increment
2020-10-27 15:52:49 +03:00
alesapin
3824fcb076
Rename file and some tweaks
2020-10-27 15:47:42 +03:00
alesapin
31d63efdac
Fix style
2020-10-27 15:26:10 +03:00
alesapin
dca35b1913
Add awesome test for fetch
2020-10-27 15:24:10 +03:00
kssenii
a48bc83763
Fix style
2020-10-27 12:04:07 +00:00
Pavel Kruglov
331545fe0d
Fix typo
2020-10-27 14:29:36 +03:00
Mikhail Filimonov
41971e073a
Fix typos reported by codespell
2020-10-27 12:04:03 +01:00
kssenii
db03cd7dd7
Much more optimal queues setup
2020-10-27 11:00:01 +00:00
kssenii
7beddceadd
Fix bug that caused awful CPU usage
2020-10-27 10:02:27 +00:00
kssenii
cd0dbcb9d8
Minimize event loop lifetime
2020-10-27 10:01:39 +00:00
alesapin
d6130f13ef
Add table to system tables
2020-10-27 10:21:49 +03:00
alesapin
880f4bbd05
System fetches
2020-10-26 19:38:35 +03:00
Alexander Kuzmenkov
5a70e26c70
Merge remote-tracking branch 'origin/master' into HEAD
2020-10-26 19:21:13 +03:00
alesapin
9ed4668dbb
Refactor common part of background list
2020-10-26 15:40:55 +03:00
alesapin
47ebc9f74e
Add separate pool for fetches
2020-10-26 14:02:47 +03:00
alesapin
d5d0819698
Merge branch 'master' into no_background_pool_no_more
2020-10-26 12:58:51 +03:00
alexey-milovidov
3aa49204d6
Update MergeTreeSettings.cpp
2020-10-26 07:39:20 +03:00
hchen9
d9bc486c0e
Fix StorageJoin and StorageSet
2020-10-25 20:57:19 -07:00
hchen9
c25a3e4e7b
Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into trivial_count_seq
2020-10-25 20:51:09 -07:00
Alexey Milovidov
d5e277f080
Better exceptions rethrow
2020-10-26 06:35:57 +03:00
hchen9
824c04f873
Fix conflict code
2020-10-25 18:12:17 -07:00
Alexey Milovidov
22a89fca01
Fix processing very large entries in queue
2020-10-25 05:57:03 +03:00
Alexey Milovidov
a2d888f19f
Fix processing very large entries in queue
2020-10-25 05:57:03 +03:00
Ivan
1d170f5745
ASTTableIdentifier Part #1 : improve internal representation of ASTIdentifier name ( #16149 )
...
* Use only |name_parts| as primary name source
* Restore legacy logic for table restoration
* Fix build
* Fix tests
* Add pytest server config
* Fix tests
* Fixes due to review
2020-10-24 21:46:10 +03:00
alexey-milovidov
c579611420
Merge pull request #16306 from azat/Set-Join-total-rows-bytes
...
Add total_rows/total_bytes support for Set/Join
2020-10-24 07:26:32 +03:00
alexey-milovidov
6037982343
Merge pull request #16284 from ClickHouse/primary_key_without_order_by
...
Add ability to specify PRIMARY KEY without ORDER BY
2020-10-24 06:05:04 +03:00
Alexey Milovidov
13b8dce792
Update contributors
2020-10-24 00:26:22 +03:00
hchen9
feaab260d8
Fix conflict
2020-10-23 12:54:33 -07:00
Azat Khuzhin
4d1385ef19
Add total_rows/total_bytes support for Set/Join
2020-10-23 21:11:55 +03:00
alesapin
bc331a8029
Better set
2020-10-23 19:34:41 +03:00
alesapin
b28894c43b
More compatible way
2020-10-23 19:31:51 +03:00
alesapin
59ca0d071c
Fix comment
2020-10-23 14:17:37 +03:00
alesapin
69f2f9838e
Add ability to specify PRIMARY KEY without ORDER BY
2020-10-23 14:16:27 +03:00
alesapin
39e47c5338
Less strange lambdas
2020-10-23 11:54:00 +03:00
Alexander Kuzmenkov
5cbf645de4
Merge remote-tracking branch 'origin/master' into tmp
2020-10-22 19:48:02 +03:00
alesapin
3c559c699f
Merge branch 'blind_fix_of_read_in_order' into no_background_pool_no_more
2020-10-22 17:16:46 +03:00
alesapin
1d07ece5d1
Fix clang tidy warning
2020-10-22 17:15:56 +03:00
alesapin
7a63b373f9
Merge branch 'blind_fix_of_read_in_order' into no_background_pool_no_more
2020-10-22 15:47:11 +03:00
alesapin
4b65d5469f
Fix some unrelated performance issues in select parts for merge
2020-10-22 15:41:01 +03:00
Nikolai Kochetov
a42fd18390
Try fix tests.
2020-10-22 15:01:22 +03:00
Nikolai Kochetov
7fa045cff8
Merge branch 'master' into storage-read-query-plan
2020-10-22 13:31:10 +03:00
alesapin
945dd3aa59
Merge branch 'master' into blind_fix_of_read_in_order
2020-10-22 10:37:37 +03:00
alexey-milovidov
adeba6bdd8
Merge pull request #15074 from amosbird/btc
...
Extend trivial count optimization.
2020-10-22 02:50:57 +03:00
Alexander Tokmakov
ac42199ae5
fix race on StorageReplicatedMergeTree::data_parts_exchange_endpoint
2020-10-21 22:25:22 +03:00
Kruglov Pavel
0b75885c8a
Merge branch 'master' into select_final
2020-10-21 20:42:39 +03:00
Pavel Kruglov
89fdeb4e15
Fix style, move setting and add checking level>0
2020-10-21 20:35:31 +03:00
Nikolai Kochetov
a0da588f06
Merge branch 'master' into new-block-for-functions-4
2020-10-21 16:16:58 +03:00
alexey-milovidov
0b7430dda1
Merge pull request #16206 from ClickHouse/fix-memory-tracking
...
Fix multiple issues with memory tracking
2020-10-21 14:34:22 +03:00
alesapin
c53f59dece
Merge pull request #15984 from ClickHouse/fix_insert_mv_dangling_ref
...
Fix possibly dangling reference to target table of MV
2020-10-21 12:13:51 +03:00
alesapin
11ea6d7911
Merge branch 'blind_fix_of_read_in_order' into no_background_pool_no_more
2020-10-21 11:39:48 +03:00
alesapin
b45d42bb9c
Maybe devirtualization can help
2020-10-21 11:35:36 +03:00
alesapin
9f47c82bbd
Sleep a little when pool is full
2020-10-21 11:31:57 +03:00
alesapin
b1a13d4884
Merge branch 'blind_fix_of_read_in_order' into no_background_pool_no_more
2020-10-21 10:30:09 +03:00
Nikolai Kochetov
68c9a57788
Merge branch 'master' into new-block-for-functions-4
2020-10-21 09:17:25 +03:00
Alexey Milovidov
2619efadc8
Fix multiple issues with memory tracking
2020-10-21 03:31:34 +03:00
alexey-milovidov
8084ce75cb
Merge pull request #16105 from azat/allow_nondeterministic_optimize_skip_unused_shards
...
Add allow_nondeterministic_optimize_skip_unused_shards
2020-10-21 00:16:26 +03:00
alesapin
c77b154398
Better locks in merge tree
2020-10-21 00:10:55 +03:00
alesapin
8097c696de
Trying another fix
2020-10-20 23:05:20 +03:00
alexey-milovidov
75a02112bc
Merge pull request #15592 from sundy-li/readonly-metrics
...
sub ReadonlyReplica metric when detach readonly tables
2020-10-20 19:17:52 +03:00
alesapin
439bbd9861
Blind performance fix
2020-10-20 18:30:46 +03:00
Vladimir Chebotarev
aa5f207fd4
Added disable_merges
option for volumes in multi-disk configuration ( #13956 )
...
Co-authored-by: Alexander Kazakov <Akazz@users.noreply.github.com>
2020-10-20 18:10:24 +03:00
Nikolai Kochetov
a1d5adf8d5
Merge branch 'master' into new-block-for-functions-4
2020-10-20 16:16:08 +03:00
alesapin
30ca17b09b
Comment to settings
2020-10-20 16:12:25 +03:00
alesapin
7256d01579
Normal backoff value instead of 10 seconds
2020-10-20 16:11:01 +03:00
Alexander Kuzmenkov
84908df6d8
fix setting parent from HTTP traceparent
2020-10-20 14:35:13 +03:00
alesapin
ce8ee01d75
Fix background moves start
2020-10-20 14:27:50 +03:00
alesapin
d126aa8a09
Merge branch 'master' into no_background_pool_no_more
2020-10-20 12:54:42 +03:00
alexey-milovidov
5e46e7c670
Merge pull request #15723 from Jokser/idempotent-part-move
...
Possibility to move part to another disk/volume if first attempt was failed
2020-10-20 04:26:50 +03:00
alexey-milovidov
124379cccc
Update IMergeTreeDataPart.h
2020-10-20 04:24:30 +03:00
alexey-milovidov
26517ff08d
Update IMergeTreeDataPart.h
2020-10-20 04:23:23 +03:00
Nikolai Kochetov
bc58637ec2
Fixing build.
2020-10-19 21:37:44 +03:00
Alexander Kuzmenkov
6dcfd26b29
Merge remote-tracking branch 'origin/master' into tmp
2020-10-19 21:36:30 +03:00
Alexander Kuzmenkov
defcd29b31
Merge pull request #16036 from ClickHouse/stress_test_improvemets
...
Minor improvements of stress test
2020-10-19 16:12:30 +03:00
Nicolae Vartolomei
af76ff1dbf
RFC: Add metadata section to MergeTreeWriteAheadLog
...
Current WAL format doesn't seem to be extendable without breaking
reverse compatibility.
This PR proposes to introduces a metadata section
for each action in the WAL to which optional fields can be added.
Adding new fields is trivial and doesn't have to break backwards
compatibility if these are not critical for correctness.
Metadata contains the minimum version of the reader allowed
to interpret it.
Removing fields is not supported.
2020-10-19 12:16:31 +01:00
alesapin
514a95c292
Fixup
2020-10-19 12:06:51 +03:00
alesapin
cb139abe2a
Better schedule after job already running
2020-10-19 11:47:15 +03:00
alesapin
e09713ece1
Merge branch 'master' into no_background_pool_no_more
2020-10-19 10:58:31 +03:00
alesapin
963bc57835
Merge pull request #16011 from ClickHouse/fix_alter_add_and_modify_order_by
...
Fix alter sorting key for ReplicatedVersionedCollapsingMergeTree
2020-10-19 10:31:13 +03:00
Azat Khuzhin
9b8abd44ab
Add allow_nondeterministic_optimize_skip_unused_shards
2020-10-17 01:07:02 +03:00
Alexander Tokmakov
c19d2efd88
add more holders
2020-10-16 20:16:58 +03:00
alesapin
518ba2ceb2
Safe random generator
2020-10-16 16:48:12 +03:00
Alexander Tokmakov
026896835c
fixes
2020-10-16 15:20:30 +03:00
alesapin
c22c760ac1
Fix unit test build
2020-10-16 13:18:56 +03:00
alesapin
7edbe4d276
Add some comments
2020-10-16 13:12:31 +03:00
Pavel Kovalenko
a474bdcabf
Merge remote-tracking branch 'origin/master' into idempotent-part-move
2020-10-16 13:02:40 +03:00
alesapin
0fb1f74b2e
Trying to schedule better
2020-10-16 11:00:15 +03:00
alesapin
280d0c55c2
Merge branch 'master' into no_background_pool_no_more
2020-10-16 10:25:02 +03:00
Alexey Milovidov
6c3aad34be
Avoid stack overflow in materialized views, part 2: sanity check
2020-10-16 03:19:45 +03:00
Alexey Milovidov
ffd3d2519e
Avoid stack overflow in materialized views, part 1
2020-10-16 03:13:17 +03:00
Kruglov Pavel
5aba639430
Update test
2020-10-15 22:01:18 +03:00
sundy-li
153be93544
sub ReadonlyReplica when detach readonly tables
2020-10-15 22:01:18 +03:00
Pavel Kruglov
6c1e0e3df8
Change default to false
2020-10-15 19:40:20 +03:00
alesapin
4c1f5cab13
Sleep less in background task
2020-10-15 19:10:22 +03:00
Pavel Kruglov
d6fc6d35fa
Fix style
2020-10-15 19:08:24 +03:00
Pavel Kruglov
ee8a9d2cf1
Don't touch MySQL database if it's unnecessary
2020-10-15 18:57:17 +03:00
Alexander Kuzmenkov
bc7b5f6bb4
Merge remote-tracking branch 'origin/master' into tmp
2020-10-15 17:15:05 +03:00
Vitaly Baranov
5f261cec3c
Merge pull request #15199 from filimonov/non_delimited_protobuf
...
ProtobufSingle format
2020-10-15 16:58:39 +03:00
alesapin
629506445d
Better backoff policy
2020-10-15 16:57:50 +03:00
Pavel Kovalenko
ed61c5681b
Use 'moving' directory instead of 'detached' when move part to another disk/volume.
2020-10-15 16:55:13 +03:00
alesapin
60d14352f8
Merge branch 'master' into no_background_pool_no_more
2020-10-15 16:34:14 +03:00
Alexander Kuzmenkov
f366b366ae
Merge pull request #15987 from filimonov/background-pool-count_no_work_done-bug
...
Fix the bug when NOTHING_TO_DO events wrongly increment count_no_work_done
2020-10-15 16:11:57 +03:00
alesapin
2002289003
Fix bug in alter primary key for replicated versioned collapsing merge tree
2020-10-15 16:02:39 +03:00
Alexander Kuzmenkov
b4378b004f
Merge remote-tracking branch 'origin/master' into tmp
2020-10-15 16:01:41 +03:00
Pavel Kruglov
f5fac575f4
don't postprocess single parts
2020-10-15 15:22:41 +03:00
Pavel Kruglov
25c39689c3
Check expired ttl
2020-10-15 15:15:02 +03:00
tavplubix
1003de75ed
Update StorageMaterializedView.cpp
2020-10-15 15:06:44 +03:00
alesapin
dccf51b316
Remove redundant logging
2020-10-15 14:08:39 +03:00
tavplubix
6dc2f00347
Update StorageMaterializedView.cpp
2020-10-15 13:57:47 +03:00
alesapin
84b0c22044
fix possible deadlock
2020-10-15 13:54:50 +03:00
alesapin
374949051c
Add thread safety
2020-10-15 13:41:36 +03:00
alesapin
e84eda176a
Add test and slightly refactored
2020-10-15 13:22:02 +03:00
alesapin
583d7042e9
Get rid of some deadlocks
2020-10-15 11:29:18 +03:00
Nikolai Kochetov
e8038ae84f
Merge pull request #15857 from amosbird/e2
...
Refactor processors.
2020-10-15 10:45:00 +03:00
alesapin
c5419083e3
Better method name
2020-10-15 10:43:50 +03:00
alesapin
3394c22c03
Fix race and clang-tidy
2020-10-15 10:39:27 +03:00
Mikhail Filimonov
ace2e99cb3
Fix the bug when NOTHING_TO_DO events wrongly increment count_no_work_done
2020-10-14 23:08:47 +02:00
alesapin
3e3505258f
No sleep when we have job
2020-10-14 22:33:36 +03:00
alesapin
ae8ed99805
Missed change
2020-10-14 21:35:03 +03:00
alesapin
7265792510
Less files
2020-10-14 21:33:41 +03:00
alesapin
a535a089d1
Some style fixes
2020-10-14 19:09:18 +03:00
alesapin
fc25b6cd72
Remove background processing pool
2020-10-14 18:26:00 +03:00
alesapin
6a4911dc57
Remove some garbage
2020-10-14 18:05:14 +03:00
alesapin
483893cdd4
Slightly refactored code
2020-10-14 17:56:42 +03:00
Vitaly Baranov
997570780d
Merge branch 'master' into non_delimited_protobuf
2020-10-14 16:26:57 +03:00
alesapin
0b14a31ba9
Get rid of background processing pool
2020-10-14 15:44:10 +03:00
alesapin
4014e0f08d
Something very similar to working code
2020-10-14 15:32:35 +03:00
Alexander Tokmakov
72b1339656
Revert "Revert "Write structure of table functions to metadata""
...
This reverts commit c65d1e5c70
.
2020-10-14 15:19:29 +03:00
tavplubix
c65d1e5c70
Revert "Write structure of table functions to metadata"
2020-10-14 13:59:29 +03:00
alesapin
efd3126b5d
Moving pool
2020-10-14 10:22:48 +03:00