Commit Graph

13240 Commits

Author SHA1 Message Date
Alexey Milovidov
6a271adad3 Added max_parts_in_total threshold to MergeTree tables 2019-05-02 17:48:54 +03:00
ivan-kush
3ecb66d965 debug stress address 2019-05-02 16:42:09 +03:00
Alexey Milovidov
4dc0170d2c CIDR functions: better code #5095 2019-05-02 16:04:24 +03:00
ivan-kush
591325468b make_unique 2019-05-02 14:54:34 +03:00
alexey-milovidov
478b721b36
Merge pull request #5167 from yandex/remove-useless-code-in-columns-description
Removed bad and useless code in ColumnsDescription
2019-05-02 02:16:36 +03:00
Alexey Milovidov
0381a6a1ec Better code for CIDR to range functions #5095 2019-05-02 01:09:24 +03:00
Alexey Milovidov
3fa2784e7c Removed unneeded file #5095 2019-05-02 01:00:56 +03:00
alexey-milovidov
2dccdb18eb
Merge pull request #5095 from PerformanceVision/CIDR_MASK
Functions for calculate lower and high range of an IP address using a CIDR mask
2019-05-02 01:00:29 +03:00
Alexey Milovidov
1be21e3cb6 Removed bad and useless code in ColumnsDescription 2019-05-02 00:43:05 +03:00
alexey-milovidov
d4b4a9425b
Merge pull request #5154 from yandex/fix-low-cardinality-keys-in-set-index
LowCardinality keys in set index
2019-05-01 20:19:04 +03:00
ivan-kush
6ac5aa5e49 restart performance 2019-05-01 18:46:17 +03:00
ivan-kush
4a3a1fc6d9 return transactions cleaning 2019-05-01 15:43:43 +03:00
Ivan Kushnarenko
e38f6e08d8 debug tsan refactor trash 2019-05-01 13:26:49 +03:00
proller
83a35d7644 Update contributors 2019-04-30 22:46:07 +03:00
Vitaly Baranov
2dfe73eefc
Merge pull request #5156 from vitlibar/settings-constraints-remove-thread-local
Get rid of thread_local in SettingsConstraints.cpp
2019-04-30 20:40:52 +03:00
alexey-milovidov
35471f4234
Update in.cpp 2019-04-30 20:26:56 +03:00
Nikolai Kochetov
be91f09417 Merge branch 'master' into fix-low-cardinality-keys-in-set-index 2019-04-30 20:26:18 +03:00
Danila Kutenin
7a2e40da28 pragma once in header file 2019-04-30 19:48:33 +03:00
Danila Kutenin
3f1523a80a
Merge pull request #5070 from danlark1/master
Upgrade our LZ4 decompression with the new reference implementation optimizations
2019-04-30 19:29:24 +03:00
alexey-milovidov
e7ec3b9eb8
Merge pull request #5136 from PerformanceVision/basename
Add a basename function
2019-04-30 19:15:35 +03:00
alexey-milovidov
b88c981902
Update basename.cpp 2019-04-30 19:15:08 +03:00
alexey-milovidov
39b696f9df
Update basename.cpp 2019-04-30 19:14:53 +03:00
Ivan
dede124449
Fixes after premature merge of #5139 (#5143)
* Implement move-constructor via move-assignment operator.
* Reimplement copy-ctor via copy-assignment operator too.
2019-04-30 19:05:39 +03:00
Nikolai Kochetov
6a3966cd08
Update PreparedSets.h 2019-04-30 17:46:17 +03:00
Vitaly Baranov
19259ab5e3 Get rid of thread_local in SettingsConstraints.cpp 2019-04-30 17:09:10 +03:00
Nikolai Kochetov
6b2656b02c Remove LowCardinality from types in PreparedSetKey. #5031 2019-04-30 13:34:12 +03:00
Guillaume Tassery
ee742f38d9 Formatting 2019-04-30 13:53:09 +07:00
吴健
acbeedad38 Fix null problem in FunctionIn 2019-04-30 11:50:30 +08:00
Danila Kutenin
0d3ff520c6 Typos 2019-04-30 00:44:17 +03:00
Danila Kutenin
8089759205 Remove bad headers 2019-04-30 00:43:05 +03:00
alexey-milovidov
109726d533
Update basename.cpp 2019-04-30 00:40:54 +03:00
Danila Kutenin
d38f4cd3a7 Almost empty 2019-04-30 00:36:53 +03:00
alexey-milovidov
0a34e05130
Merge pull request #5138 from CurtizJ/limit-by-offset
Added support of LIMIT n, m BY clause.
2019-04-30 00:17:29 +03:00
Ivan
6291c4098f
Revert "Merge pull request #5139 from abyss7/fix-self-move" (#5150)
This reverts commit bd1f8fe97a, reversing
changes made to 5d1091bfee.
2019-04-29 23:33:26 +03:00
Danila Kutenin
436029bf64 No AVX but remain wildcopy 32 2019-04-29 22:30:14 +03:00
alexey-milovidov
bd1f8fe97a
Merge pull request #5139 from abyss7/fix-self-move
Remove move-assignment to prevent possible self-move
2019-04-29 17:08:23 +03:00
Ivan Lezhankin
9a1aee4c2e Remove move-assignment to prevent possible self-move 2019-04-29 16:47:28 +03:00
CurtizJ
7766f5c0c3 added offset for limit by 2019-04-29 16:12:39 +03:00
Vitaly Baranov
5d1091bfee
Merge pull request #5130 from vitlibar/settings-refactoring
Templatize settings.
2019-04-29 15:53:21 +03:00
Guillaume Tassery
95141804fb Add a basename function 2019-04-29 16:40:44 +07:00
tai
b394a79af3 try fix batch async insert settings for Distributed 2019-04-29 17:02:23 +08:00
tai
0d39968233 Suport settings for async(#4852)
There is no hash operation on Settings. Because it is less valuable for hash operations.

And I dont know how to write a testcase.
2019-04-29 17:02:23 +08:00
alexey-milovidov
1d69a73424
Merge pull request #5119 from nicelulu/update_24
modification retention function
2019-04-29 04:51:18 +03:00
alexey-milovidov
0a88bcbb48
Merge pull request #5129 from kvinty/msd-radix-sort
[WIP] Add MSD radix sort
2019-04-29 04:50:27 +03:00
alexey-milovidov
8d2941fa60
Update RadixSort.h 2019-04-29 04:50:18 +03:00
Vitaly Baranov
28d9a80072 Rename macro APPLY_FOR_SETTINGS => LIST_OF_SETTINGS. 2019-04-29 03:22:59 +03:00
Vitaly Baranov
5beaf33a9f Get rid of code duplication, use templates. 2019-04-29 03:22:59 +03:00
Ivan Kushnarenko
bdbe97276c remove groups 2019-04-27 23:15:10 +03:00
Ivan
9edbbc637a
Fix segmentation fault on iterator double-free inside RWLock (#5127)
* Store the key instead of iterator, which may get invalidated by erasure from another instance.
* Add test
2019-04-27 22:12:35 +03:00
Evgenii Pravda
91ccf2ab20 Fixes 2019-04-27 20:52:43 +03:00
ivan-kush
26b3910b7d tsan debug 2019-04-27 20:01:30 +03:00
ivan-kush
40be74ac65 refactor 2019-04-27 18:27:57 +03:00
Ivan Kushnarenko
cb51558bdf check build clang7 splitted 2019-04-27 11:24:50 +03:00
Vitaly Baranov
1b8c01e940 Transform comments for MergeTreeSettings into descriptions. 2019-04-27 01:09:16 +03:00
Vitaly Baranov
738a49f534 Use iterators instead of macros APPLY_FOR_SETTINGS and others. 2019-04-27 01:09:16 +03:00
Vitaly Baranov
7801671225 Use shared_ptr to avoid copying SettingsConstraints 2019-04-27 01:09:16 +03:00
Vitaly Baranov
7e3c8d6022 Implement new constraints: "min" and "readonly". 2019-04-27 01:09:16 +03:00
Evgenii Pravda
568ef78803 Add MSD radix sort 2019-04-27 01:07:32 +03:00
Vitaly Baranov
77e7838c30 Implemented iterators in the SettingsCollection template class 2019-04-26 19:11:05 +03:00
Vitaly Baranov
d43e7a8960 Implement max constraints for number settings. 2019-04-26 19:11:05 +03:00
Vitaly Baranov
8277e9d8f1 Refactoring of Settings based on new template class SettingsCollection.
Add new class SettingsConstraints.
2019-04-26 19:11:05 +03:00
Vitaly Baranov
b24c69743e Use the same parameters in all APPLY_FOR_SETTINGS macros. 2019-04-26 19:11:05 +03:00
821008736@qq.com
02e9cc8f2d fix retention function 2019-04-26 17:36:35 +08:00
Guillaume Tassery
f21004ed7e IPv4CIDRtoIPv4Range and IPv6CIDRtoIPv6Range return now an IP 2019-04-26 13:30:07 +07:00
Danila Kutenin
f86cf7bd11 Correct cpu dispatch, nounroll for clang 2019-04-26 00:53:22 +03:00
ivan-kush
ba61e16093 style 2019-04-26 00:37:57 +03:00
ivan-kush
86af5fc0c2 Merge remote-tracking branch 'upstream/master' into feat/parallel-alter-modify 2019-04-25 22:48:44 +03:00
ivan-kush
af02fe4a96 Merge remote-tracking branch 'origin/feat/parallel-alter-modify' into feat/parallel-alter-modify 2019-04-25 22:33:09 +03:00
ivan-kush
33201fa9a8 rev 2019-04-25 21:57:43 +03:00
Danila Kutenin
3501f633e4 Cosmetics 2019-04-25 21:35:58 +03:00
Danila Kutenin
5c68881b72 Really faster LZ4 now, cpu dispatch in ClickHouse 2019-04-25 21:34:32 +03:00
Danila Kutenin
71d87a49b2 Merge branch 'master' of https://github.com/yandex/ClickHouse 2019-04-25 19:19:01 +03:00
Alexey Milovidov
661c840fbe Code cleanups after #4439 2019-04-25 04:16:26 +03:00
alexey-milovidov
445f51c01e
Merge pull request #4439 from kvinty/kvinty-radix-sort
Use radixSort in ORDER BY + add performance test
2019-04-25 02:45:38 +03:00
proller
c6d0e095e0
Prepare cmake for new contrib/poco (#5062) 2019-04-25 00:33:04 +03:00
alexey-milovidov
1de889c201
Merge pull request #5081 from Akazz/master
Support for header specified order of columns in TSVWithNames/CSVWithNames formats
2019-04-24 18:59:09 +03:00
alexey-milovidov
d2a4aa964d
Merge pull request #5026 from PerformanceVision/uniq_array
Add an optional max_size parameter to groupUniqArray
2019-04-24 14:34:39 +03:00
proller
ba4687e110
Cmake: dont use LINK_MODE (but use BUILD_SHARED_LIBS) (#5091) 2019-04-24 12:06:28 +03:00
Guillaume Tassery
68b0144178 Remove unused header and some typo in comment for IPv6 range function 2019-04-24 13:26:28 +07:00
Guillaume Tassery
efd780f20d Apply fix for IPv6 range function when we use a column with more than one element 2019-04-24 12:19:36 +07:00
Guillaume Tassery
0e67d424da Code reformating for ip range function 2019-04-24 11:18:17 +07:00
alexey-milovidov
3db650861d
Update AggregateFunctionGroupUniqArray.h 2019-04-24 01:40:16 +03:00
Alexey Milovidov
b52f1257a9 Removed useless include 2019-04-23 19:48:46 +03:00
Guillaume Tassery
56393de68e Handle UB case for CIDR IP range function and add documentation 2019-04-23 19:28:25 +07:00
Guillaume Tassery
8dee4fe5d1 Add function for get an ipv4 range using an ipv4 and a cidr mask 2019-04-23 14:02:23 +07:00
alexey-milovidov
0cf40e0029
Merge pull request #5082 from yandex/pvs-studio-fixes-3
Resolved some of PVS-Studio warnings
2019-04-22 22:06:07 +03:00
Alexander Kazakov
ecc6da1429 Fixed missing includes 2019-04-22 20:02:34 +03:00
Alexander Kazakov
c7a4b2ec75 Fixed style 2019-04-22 19:53:54 +03:00
alexey-milovidov
b1cf026b5b
Merge pull request #5080 from abyss7/issue-4736
Do not drop Kafka Consumer buffers after deletion of stream
2019-04-22 19:18:33 +03:00
Alexey Milovidov
58d7d1e451 Resolved some of PVS-Studio warnings 2019-04-22 19:07:09 +03:00
Danila Kutenin
6c0e7bb9ac Merge branch 'master' of https://github.com/yandex/ClickHouse 2019-04-22 18:27:09 +03:00
Alexander Kazakov
bde1845bdc Better naming 2019-04-22 17:00:51 +03:00
Alexander Kazakov
d90bab5e33 In [T|C]SVWithNames formats start using column information from header 2019-04-22 16:31:17 +03:00
Ivan Lezhankin
94bba1918f Do not drop Kafka consumer buffers after closing stream 2019-04-22 16:23:05 +03:00
Guillaume Tassery
153c9d6455 Add function for get an IP range from a CIDR 2019-04-22 18:21:59 +07:00
hcz
3bbe57adac
Rename AggregateFunctionsStatisticsSimple.cpp to AggregateFunctionStatisticsSimple.cpp 2019-04-22 17:31:01 +08:00
Danila Kutenin
cabcaf673a Comments 2019-04-21 20:41:45 +03:00
Danila Kutenin
2caf3d39ff Faster LZ4 decompression because of new release 2019-04-21 20:31:15 +03:00
Alexander Kozhikhov
6c7f2cbc37 asan 2019-04-21 19:08:55 +03:00
Alexander Kozhikhov
fd07c97097 Merge branch 'master' of https://github.com/yandex/ClickHouse 2019-04-21 18:43:29 +03:00
Alexander Kozhikhov
0bedabb5e4 review fixes 2019-04-21 17:44:39 +03:00
Alexander Kozhikhov
ef98afb6a6 review fixes 2019-04-21 17:42:37 +03:00
Alexander Kozhikhov
daf4690d37 review fixes 2019-04-21 17:32:42 +03:00
Alexander Kozhikhov
b6d2c9f4d2 some review fixes 2019-04-21 02:22:42 +03:00
alexey-milovidov
e62999d8b9
Fixed typo in comment. 2019-04-20 23:25:19 +03:00
Danila Kutenin
e914d0d67a Just update LZ4 2019-04-20 15:47:16 +03:00
Evgenii Pravda
5a773ed67c Fix nulls order 2019-04-20 02:04:17 +03:00
Evgenii Pravda
bc4eb309e2 Trying to defeat gcc 8 (2) 2019-04-20 02:04:17 +03:00
Evgenii Pravda
6157ddba0d Trying to defeat gcc 8 2019-04-20 02:04:17 +03:00
Evgenii Pravda
fecf0a3630 Some fixes 2019-04-20 02:04:17 +03:00
Evgenii Pravda
f1e842cdf6 Use radixSort when possible 2019-04-20 02:04:17 +03:00
Alexey Milovidov
ee1a843609 COWPtr: improvements (C++ Russia 2019, suggested by Alexey Malov) 2019-04-19 23:22:06 +03:00
Danila Kutenin
c7731b32f1 Try safe version 2019-04-19 15:34:56 +03:00
Alexey Milovidov
b0b369b30f Fixed typo #5010 2019-04-18 22:46:59 +03:00
Alexey Milovidov
642b09c8d6 Added clarifications #5010 2019-04-18 22:45:46 +03:00
alesapin
21c1e71b0e
Merge pull request #5052 from yandex/fix_max_block_rows_with_adaptive_granularity
Use fixed_granularity as upper bound for adaptive granularity
2019-04-18 22:23:37 +03:00
alesapin
33b228c276 Fix own test 2019-04-18 19:33:28 +03:00
alesapin
214bf77b17
Merge pull request #5012 from nvartolomei/nv/lb-first-or-random
Add FIRST_OR_RANDOM Load Balancing policy
2019-04-18 18:54:04 +03:00
alesapin
1c899edc27
Update ConnectionPoolWithFailover.cpp 2019-04-18 18:53:39 +03:00
alesapin
d812ae7024 Use fixed_granularity as upper bound for adaptive granularity 2019-04-18 18:06:45 +03:00
alexey-milovidov
ab27970fd7
Merge pull request #5028 from mhsekhavat/patch-1
Fix settings.max_partitions_per_insert_block type
2019-04-18 16:39:17 +03:00
Danila Kutenin
0d70325fb8 try decompress fast 2019-04-18 16:20:47 +03:00
proller
ad42179bec Remove rvo_test 2019-04-18 15:25:30 +03:00
Danila Kutenin
2c7fed45da try decompress fast 2019-04-18 14:37:20 +03:00
Ivan
118bea2be6
Enable predicate push-down optimization by default. (#4846)
* Enable predicate push-down optimization by default.
* Forbid push-downs for some JOIN cases.
* Fix existing tests
* Forbid optimization if a select query has ARRAY JOIN on any side.
2019-04-18 13:39:25 +03:00
Vitaly Baranov
345ae9aaa5
Merge pull request #5037 from vitlibar/fix-ubsan-errors
Fix ubsan errors
2019-04-17 23:39:01 +03:00
proller
525726a5e2
Remove pocoext (#5036) 2019-04-17 20:36:58 +03:00
Vitaly Baranov
7ef7a2d767 Disable ubsan error "outside the range of representable values" in bitSwapLastTwo.cpp 2019-04-17 19:14:31 +03:00
Vitaly Baranov
58a9105038 Fix ubsan error "outside the range of representable values" in convertFieldToType.cpp 2019-04-17 19:10:40 +03:00
alexey-milovidov
7b201a9491
Merge pull request #4986 from 4ertus2/ast
Partially fix distributed_product_mode=local columns access
2019-04-17 17:59:01 +03:00
proller
1b020827f0 Move Poco/Ext/ThreadNumber.h to common/getThreadNumber.h (#5016) 2019-04-17 17:53:54 +03:00
Guillaume Tassery
b8bc308685 Merge branch 'uniq_array' of github.com:PerformanceVision/ClickHouse into uniq_array 2019-04-17 17:24:28 +07:00
Guillaume Tassery
a96e3c470e Reformate code for optional parameter for groupUniqArray 2019-04-17 17:24:02 +07:00
Mohammad Hossein Sekhavat
322079e2af
Fix settings.max_partitions_per_insert_block type
The `max_partitions_per_insert_block` field is of `size_t` type, rather than `Boolean`
2019-04-17 10:16:02 +00:00
Guillaume Tassery
340e1380f4
Merge branch 'master' into uniq_array 2019-04-17 17:06:23 +07:00
Artem Zuikov
29c92372a2
Merge pull request #4993 from 4ertus2/asof
Radix sort for ASOF JOIN
2019-04-16 21:31:21 +03:00
alexey-milovidov
76b6d43a53
Merge pull request #5001 from 4ertus2/bugs
Fix select distinct with join
2019-04-16 20:08:15 +03:00
Vitaly Baranov
f0c7e56603
Merge pull request #4962 from vitlibar/resolve-dictionary-depends-on-dictionary
Resolve correctly when dictionary depends on dictionary
2019-04-16 17:37:54 +03:00
Danila Kutenin
0abde66822 isValidUTF8 movemask is a bad choice, let's use testz 2019-04-16 15:49:22 +03:00
chertus
041f299979 Merge branch 'master' into bugs 2019-04-16 15:48:56 +03:00
chertus
a519e7f01a Merge branch 'master' into asof 2019-04-16 15:48:28 +03:00
Vitaly Baranov
39c71075fa Don't wait for the reloading when it's been doing in another thread. 2019-04-16 14:40:36 +03:00
Nicolae Vartolomei
c2ec23c953
Add FIRST_OR_RANDOM Load Balancing policy
For cross-replication topology setups load_balancing=in_order works best
as nodes handle equal amount of load and usually they hit only 1/n of
data (n = number of replicas), which makes page cache usage more
efficient.

The problem is when one node of the shard goes down. If one replica goes
down, the next one in config will handle twice the usual load while
remaining ones will handle usual traffic.

Closes #4820.
2019-04-15 23:31:40 +01:00
Vitaly Baranov
6d96443440 Resolve correctly when dictionary depends on dictionary 2019-04-15 20:40:45 +03:00
alesapin
faeb95cfd7
Merge branch 'master' into adaptive_index_granularity 2019-04-15 19:36:36 +03:00
chertus
7697b18b07 enable RadixSort for ASOF JOIN over UInt32 2019-04-15 17:09:39 +03:00
Guillaume Tassery
2a6ff2f240 Code refactoring for the new size parameter on the GroupUniqArray aggregation function 2019-04-15 18:32:43 +07:00
chertus
9c80466230 add comment 2019-04-15 14:22:51 +03:00
alesapin
8cd18c0723
Merge pull request #4991 from yandex/fix_ddl_on_relicated_table
Do not send queries received from DDLWorker to leader replica
2019-04-15 13:07:55 +03:00
Anton Popov
7f93f9ad2f TTL for columns and tables (#4212)
Add TTL for columns and tables.
2019-04-15 12:30:45 +03:00