Commit Graph

1024 Commits

Author SHA1 Message Date
Alexey Milovidov
da583760c4 Added "system.licenses" table 2020-05-11 05:39:01 +03:00
Alexey Milovidov
6a3055a924 Added a comment 2020-05-11 03:38:35 +03:00
Alexey Milovidov
f8d2e599a6 Added a comment 2020-05-11 03:37:31 +03:00
Alexey Milovidov
fe19ca9955 Improve performance two times 2020-05-11 03:36:14 +03:00
Alexey Milovidov
75860eb674 Improve performance 20% 2020-05-11 03:23:47 +03:00
Alexey Milovidov
49e57c555d Fixed code; added a test 2020-05-11 03:16:50 +03:00
Alexey Milovidov
2438a510b0 Merge branch 'fuzz_functions' of https://github.com/xolm/ClickHouse into xolm-fuzz_functions 2020-05-11 02:42:55 +03:00
Alexey Milovidov
20a7889909 Integrate a change from Vitaly Stoyan #10788 2020-05-11 02:39:49 +03:00
alexey-milovidov
f359d75bbc
Merge pull request #10788 from vitstn/patch-1
Update ya.make
2020-05-11 02:38:43 +03:00
Andrew Onyshchuk
330f06328f Use src_type for convertion in KeyCondition 2020-05-10 18:17:54 -05:00
Andrei Nekrashevich
84ed5b118c fix 2020-05-10 22:31:47 +03:00
Alexey Milovidov
20808de08c Merge remote-tracking branch 'origin/master' into even-more-warnings 2020-05-10 22:28:16 +03:00
Andrei Nekrashevich
c3873495c9 fix and performance test template 2020-05-10 22:07:02 +03:00
vitstn
be6fba82f9
Update ya.make 2020-05-10 20:51:32 +03:00
Azat Khuzhin
7342f46394 Fix setting type for the memory_profiler_sample_probability 2020-05-10 15:49:31 +03:00
Azat Khuzhin
5c89cdbe61 Fix distributed send retries on distributed_directory_monitor_{max_,}sleep_time_ms > 5min
In this case error_count can be decreased before checking it for
rescheduling send.

And actually this can be a problem not only when
distributed_directory_monitor_{max_,}sleep_time_ms > 5min, because all
threads can be occupated and the real timeout between sends will be > 5min.
2020-05-10 12:37:38 +03:00
Alexey Milovidov
36d9d646a9 Fix race condition in ReplicatedMergeTreeQueue 2020-05-10 05:18:10 +03:00
Alexey Milovidov
ce59ad8e04 Merge branch 'master' into even-more-warnings 2020-05-10 03:49:12 +03:00
alexey-milovidov
21fe2bdc92
Merge pull request #10780 from cw9/cw9-patch-1
Fix comment for merge_tree_max_bytes_to_use_cache
2020-05-10 03:47:52 +03:00
Alexey Milovidov
fd26550a70 Remove commented code before merge #10580 2020-05-10 03:41:52 +03:00
Alexey Milovidov
d9257a8682 Merge branch 'arrow-io-format' of https://github.com/FawnD2/ClickHouse into FawnD2-arrow-io-format 2020-05-10 03:26:10 +03:00
alexey-milovidov
992e58923a
Merge pull request #10588 from excitoon-favorites/fixmutations
Fixed handling condition variable for synchronous mutations
2020-05-10 03:20:41 +03:00
Alexey Milovidov
cb08d2b910 Fix build 2020-05-10 03:04:14 +03:00
Alexey Milovidov
9ab19f98ee Fix build 2020-05-10 02:54:04 +03:00
Alexey Milovidov
dda2151f71 Fix build 2020-05-10 02:35:20 +03:00
alexey-milovidov
63c4a7661f
Merge pull request #10715 from CurtizJ/pk-function
Fix usage of primary key wrapped into a function.
2020-05-10 02:08:59 +03:00
Alexey Milovidov
a576a4fbcd Enable extra warnings for base, utils, programs 2020-05-10 01:59:34 +03:00
Alexey Milovidov
fb32dbe6ee Enable more warnings 2020-05-10 00:44:33 +03:00
alexey-milovidov
d459f07eee
Update randomString.cpp 2020-05-09 21:54:23 +03:00
alexey-milovidov
4a66b10669
Update randomString.cpp 2020-05-09 21:52:27 +03:00
Nikolai Kochetov
540e1004ca Remove useless code. 2020-05-09 21:43:16 +03:00
Nikolai Kochetov
8d6413accb try fix tests. 2020-05-09 21:43:16 +03:00
Nikolai Kochetov
5cf705c9df Try fix tests. 2020-05-09 21:43:16 +03:00
Nikolai Kochetov
66111a6744 Try nut update scalars for only_analyze. 2020-05-09 21:43:16 +03:00
Nikolai Kochetov
5cc0d5e537 Do not calculate subqueries when only_analyze enabled. 2020-05-09 21:43:16 +03:00
Nikolai Kochetov
884c93ed93 Do not calculate subqueries when only_analyze enabled. 2020-05-09 21:43:16 +03:00
Nikolai Kochetov
18e4df1e85 Create local context for query analyzing in PushingToViewsBlockOutputStream. 2020-05-09 21:43:16 +03:00
Nikolai Kochetov
c6b9580e9e Create local context for query analyzing in PushingToViewsBlockOutputStream. 2020-05-09 21:43:16 +03:00
Nikolai Kochetov
df17eda9c8 Try disable scalars with only_analyse flag. 2020-05-09 21:43:16 +03:00
Nikolai Kochetov
086831e74c Fix tests. 2020-05-09 21:43:16 +03:00
Nikolai Kochetov
abef634d1f Fix scalars for MV. 2020-05-09 21:43:16 +03:00
alexey-milovidov
e41e998f4a
Merge pull request #10758 from bgiard/master
Fix serialize/deserialize of denominator of Average functions
2020-05-09 21:22:16 +03:00
alexey-milovidov
42de5192fd
Merge pull request #10772 from azat/fix-system-logs-init
Avoid std::terminate in case of exception from SystemLogs::SystemLogs
2020-05-09 19:35:26 +03:00
alexey-milovidov
8f7ee19a2d
Merge pull request #10760 from amosbird/shared-build-fix
Shared build fix
2020-05-09 19:33:31 +03:00
alexey-milovidov
f9db45fcc2
Merge pull request #10763 from azat/unbundled-build-poco-fix
Fix build with unbundled Poco
2020-05-09 18:27:00 +03:00
Azat Khuzhin
c42943850f Avoid std::terminate in case of exception from SystemLogs::SystemLogs
Since, at least, this will hide the real exception
2020-05-09 16:25:58 +03:00
alexey-milovidov
699ef4ff52
Merge pull request #10741 from hczhcz/patch-0422
Fix OrNull and OrDefault
2020-05-09 04:38:32 +03:00
alexey-milovidov
5992bae69a
Merge pull request #10736 from ClickHouse/extract-groups-range-check
Added range check for extractGroups function
2020-05-09 04:21:56 +03:00
Azat Khuzhin
150dd81e3b Fix build with unbundled Poco 2020-05-09 01:22:12 +03:00
Amos Bird
9d908f48e1
Shared build fix 2020-05-09 04:55:08 +08:00
Chao Wang
bc5f9d5322
Fix comment for merge_tree_max_bytes_to_use_cache 2020-05-08 16:39:00 -04:00
Baudouin Giard
be2cf70da8 Fix serialize/deserialize of denominator of Average functions
Use writeBinary/readBinary to serialize/deserialize the denominator of Average functions.

Previously it would be transmitted as an unsigned int, which means its value would get corrupted when doing an avgWeighted over a floating point number.

Note: this commit is not backwards compatible!

Signed-off-by: Baudouin Giard <bgiard@bloomberg.net>
2020-05-08 15:10:47 -04:00
Nikolai Kochetov
e365bf422e Delay exception for PushingToViewsBlockOutputStream mvs. 2020-05-08 17:48:10 +03:00
Ivan
85d783c247
Poco contrib refactoring (#10396)
* Remove config_common.h
* Refactor libcpuid contrib
* Remove support for libcpuinfo
* Define USE_CPUID in Arcadia
* Refactor Poco libraries
2020-05-08 17:11:19 +03:00
Pavel Kovalenko
8d8dc3035c Fix naming. 2020-05-08 16:10:21 +03:00
Pavel Kovalenko
8602f7b47c Minor updates in proxy resolver parameters naming. 2020-05-08 13:58:56 +03:00
Pavel Kovalenko
6165c2aa99 Add possibility to use proxy resolver in DiskS3. 2020-05-08 13:53:12 +03:00
hcz
8a60e22223 Fix OrNull and OrDefault 2020-05-08 17:52:54 +08:00
Vladimir Chebotarev
28631f461e Fixed handling of condition variable for synchronous mutations. 2020-05-08 12:01:06 +03:00
Alexey Milovidov
1f0d95e5c3 Added range check for extractGroups function 2020-05-08 02:31:15 +03:00
Alexey Milovidov
048e26dabf Fix "Arcadia" build 2020-05-07 23:40:18 +03:00
Alexey Milovidov
8690b6e702 Fix "Arcadia" build 2020-05-07 23:17:57 +03:00
alexey-milovidov
07f7f3f33b
Merge pull request #10734 from ClickHouse/fix-generate-random-with-nested
Fix generate random with nested
2020-05-07 22:02:43 +03:00
Alexey Milovidov
8d3e68a30b Fix "Arcadia" build 2020-05-07 21:57:04 +03:00
Andrei Nekrashevich
43bc55ab5f randomString function 2020-05-07 18:36:11 +03:00
Andrei Nekrashevich
28685a80f5 ClickHouse: functions for fuzzing 2020-05-07 17:54:33 +03:00
Nikolai Kochetov
c22f7a0864 Try fix header for GenerateRandom. 2020-05-07 17:14:56 +03:00
alexey-milovidov
6edb0ea962
Merge pull request #10721 from ClickHouse/fix-10489
Fix reading from field.
2020-05-07 15:55:40 +03:00
Anton Popov
5fe74b1a3e
Merge pull request #10686 from CurtizJ/fix-nultiple-sets
Fix multiple usages of 'IN' operator
2020-05-07 15:39:41 +03:00
Alexey Milovidov
2a3e7f8076 Fix "Arcadia" build 2020-05-07 15:36:56 +03:00
alexey-milovidov
3e583ef45e
Merge pull request #10712 from ClickHouse/merging-extract-groups
Merging #10534
2020-05-07 15:34:41 +03:00
Alexey Milovidov
4a1f9f41fb Update ya.make for Arcadia build 2020-05-07 15:33:50 +03:00
Alexey Milovidov
fce23f4535 Update ya.make for Arcadia build 2020-05-07 15:32:33 +03:00
Alexey Milovidov
c85fec6c67 Update ya.make for Arcadia build 2020-05-07 15:31:28 +03:00
Alexey Milovidov
0e00e3049e Regenerate ya.make file 2020-05-07 15:27:42 +03:00
Alexey Milovidov
efeb2acb6b Fix build 2020-05-07 15:19:42 +03:00
tavplubix
04a24c59dc
Add tests with DatabaseAtomic (#10714)
* add tests with DatabaseAtomic

* fix
2020-05-07 14:29:58 +03:00
Alexey Milovidov
6efe0376de Fix build 2020-05-07 12:06:11 +03:00
Nikolai Kochetov
0d57b9ded0 Fix reading from field. 2020-05-07 11:58:06 +03:00
Alexey Milovidov
dea8d366c9 Loose some limitation 2020-05-07 04:29:31 +03:00
Alexey Milovidov
b81b4832fe Fix style 2020-05-07 04:25:46 +03:00
Alexey Milovidov
c73453fa86 Less indirection 2020-05-07 04:25:06 +03:00
Alexey Milovidov
2642d23861 Fixed error 2020-05-07 04:06:23 +03:00
Alexey Milovidov
495d18bb64 Added missing function "extractGroups" 2020-05-07 03:55:54 +03:00
Alexey Milovidov
da2c2c3edf Great simplification 2020-05-07 03:40:25 +03:00
Alexey Milovidov
5d1f36872b Fixed style 2020-05-07 02:51:41 +03:00
Alexey Milovidov
1e690510b6 Fixed style 2020-05-07 02:51:09 +03:00
Alexey Milovidov
466da445e1 Every function in its own file, part 13 2020-05-07 02:21:13 +03:00
Anton Popov
cbbd8e521c fix usage of primary key wrapped into a function with 'FINAL' modifier and 'ORDER BY' optimization 2020-05-07 01:27:35 +03:00
alexey-milovidov
eeac7aa313
Merge pull request #10622 from kekekekule/layout_direct
Add direct layout for dictionaries
2020-05-07 01:05:29 +03:00
alexey-milovidov
d0b61f9d61
Merge pull request #10711 from ClickHouse/h3-range-check
Range check in function h3EdgeAngle
2020-05-07 01:00:57 +03:00
Артем Стрельцов
b2993c314c fixes relevant to review 2020-05-07 00:59:31 +03:00
alexey-milovidov
4df7dd8c2b
Merge pull request #10656 from azat/kafka-consumer-hang
Kafka cleanup
2020-05-07 00:20:31 +03:00
Alexey Milovidov
7d332ab705 Minor improvements 2020-05-06 23:00:54 +03:00
Alexey Milovidov
5f498ad9d9 Range check in h3EdgeAngle function 2020-05-06 22:35:59 +03:00
alexey-milovidov
01e7c6bbcf
Merge pull request #10534 from Enmk/multiExtractAll
extractAllGroups(haystack, re_needle) function
2020-05-06 22:23:36 +03:00
Nikolai Kochetov
152923aaa4
Merge pull request #10667 from palasonic1/palasonic-fix-params-order
fix order of params in AggregatingTransform constructor
2020-05-06 21:47:41 +03:00
alexey-milovidov
e4b3234df9
Merge pull request #10664 from ClickHouse/fix-10655
Fix 10655
2020-05-06 21:34:10 +03:00
alexey-milovidov
f2705cf608
Merge pull request #10698 from ClickHouse/fix-10674
Do not filter totals
2020-05-06 21:30:11 +03:00
Артем Стрельцов
9088f220ee style fix 2020-05-06 16:59:48 +03:00
Nikolai Kochetov
c72b0a45bc Do not filter totals. 2020-05-06 14:30:17 +03:00
Nikolai Kochetov
bd9df858ed
Merge pull request #10660 from ClickHouse/fix-10566
Fix 10566
2020-05-06 11:56:44 +03:00
Anton Popov
19528007fd fix multiple usages of 'IN' operator with the same set 2020-05-06 03:57:44 +03:00
Артем Стрельцов
1428188e21 fixed test for direct layout & fixed data load for FileDictionarySource 2020-05-06 03:52:13 +03:00
Артем Стрельцов
50d2b4c26f code review fixes & added exception in case lifetime parameter presence in config 2020-05-06 02:43:06 +03:00
bobrovskij artemij
a2916c23a5 fixes/style 2020-05-06 02:42:44 +03:00
Артем Стрельцов
a51440cc31 significantly improved performance 2020-05-05 21:49:22 +03:00
Артем Стрельцов
eb5488faeb std::unordered_map -> HashMap 2020-05-05 19:18:21 +03:00
FawnD2
ea87bd1c64 Merge branch 'master' into arrow-io-format 2020-05-05 18:52:44 +03:00
Vasily Nemkov
87b2d90725 extractAllGroups(haystack, re_needle) function
Function that extracts from haystack all matching non-overlapping groups with regular expressions,
and put those into Array(Array(String)) column.

Example:
:) SELECT extractAllGroups('abc=111, def=222, "jkl mno"="444 foo bar"', '("[^"]+"|\\w+)=("[^"]+"|\\w+)');

┌─extractAllGroups('abc=111, def=222, "jkl mno"="444 foo bar"', '("[^"]+"|\\w+)=("[^"]+"|\\w+)')─┐
│ [['abc','def','"jkl mno"'],['111','222','"444 foo bar"']]                                      │
└────────────────────────────────────────────────────────────────────────────────────────────────┘
2020-05-05 17:41:31 +03:00
alexey-milovidov
114f09cfca
Merge pull request #10666 from NanoBjorn/refactor-volume
Volumes and storages refactoring
2020-05-05 16:25:26 +03:00
FawnD2
19022cb670 Remove redundant includes. Style fix 2020-05-05 15:56:54 +03:00
alexey-milovidov
c54f6d5a66
Merge pull request #10546 from kyprizel/master
Lexer, ast, checksum and column specs fuzzers added
2020-05-05 14:50:55 +03:00
alexey-milovidov
e908d1cd01
Revert "Partial fix of clang build stack unwinding (omit-frame-pointer)" 2020-05-05 14:36:32 +03:00
FawnD2
aaf4f4ad61 Add missing Float16 for parquet format 2020-05-05 04:46:04 +03:00
alexey-milovidov
09756a036a
Merge pull request #10645 from ClickHouse/check-suspicious-codecs
Check for suspicious codecs #4966
2020-05-04 23:33:59 +03:00
Maxim Serebryakov
3691400a60 fix order of params in AggregatingTransform 2020-05-04 23:26:33 +03:00
Gleb Novikov
6e6a195c13 Style fixes, removed redundant includes 2020-05-04 23:20:51 +03:00
Gleb Novikov
c637d99e07 Volumes and storages refactoring:
1. Moved Volume to separate file
  2. Created IVolume interface and implemented current behaviour in implementation of new interface — VolumeJBOD
  3. Replaced all old volume usages with new VolumeJBOD. Where it is unnecessary to have JBOD — left just IVolume.
  4. Removed old Volume completely
  5. Moved StoragePolicy to separated files
  6. Moved DiskSelector to separated files
  7. Removed DiskSpaceMonitor file
2020-05-04 23:15:38 +03:00
Nikolai Kochetov
b23b02094f Added comments. 2020-05-04 22:17:52 +03:00
Nikolai Kochetov
ee65f3eedc Init all input ports in GroupingAggregatedTransform. 2020-05-04 21:07:56 +03:00
Nikolai Kochetov
4e27c33451 Init all input ports in GroupingAggregatedTransform. 2020-05-04 20:59:07 +03:00
Nikolai Kochetov
97dde2bcdf Fix limit for MergingSorted with fast-forward optimization. 2020-05-04 20:16:16 +03:00
alesapin
d47d28d51f Fix mutations assignment 2020-05-04 19:30:39 +03:00
FawnD2
f0201f7aca Move ORC to Input only formats 2020-05-04 18:04:20 +03:00
Alexey Milovidov
a198dce505 Fix double space 2020-05-04 17:55:37 +03:00
FawnD2
2f8435813c Remove unused stream 2020-05-04 17:49:13 +03:00
FawnD2
da0a908d27 Remove unused stream 2020-05-04 17:47:09 +03:00
Alexey Milovidov
87fb6bf081 Better exception message 2020-05-04 17:46:32 +03:00
FawnD2
b492e92d41 Remove extra check 2020-05-04 17:32:36 +03:00
FawnD2
182de47012 Use file reader for Arrow format 2020-05-04 17:30:42 +03:00
Alexey Milovidov
301c6137e4 Better exception messages; fixed error; updated tests 2020-05-04 17:25:54 +03:00
Azat Khuzhin
61c5df5662 Drop claimed from the KafkaBlockInputStream 2020-05-04 17:23:09 +03:00
Azat Khuzhin
a10cfc3ae5 Pass stream_cancelled to the copyData as stub in StorageKafka 2020-05-04 17:23:09 +03:00
Azat Khuzhin
c69217e9f3 Force destrying of kafka buffers from the shutdown in StorageKafka 2020-05-04 17:23:09 +03:00
Azat Khuzhin
9e14db2091 Add missing kafka settings into docs 2020-05-04 17:23:05 +03:00
Anton Okhitin
7366227115 Fix arcadia build 2020-05-04 16:47:08 +03:00
FawnD2
6d6d04903f Remove check 2020-05-04 16:33:20 +03:00
FawnD2
a044766d58 Remove check 2020-05-04 16:26:20 +03:00
FawnD2
17450811d4 Move getHeader at the beginning of generate() 2020-05-04 16:19:25 +03:00
FawnD2
83148289d8 Rename arg 2020-05-04 16:01:37 +03:00
Артем Стрельцов
0f23713488 fixed bug with dictIsIn 2020-05-04 12:53:06 +03:00
alexey-milovidov
443c64abc0
Merge pull request #10638 from ClickHouse/fix-ubsan-hashtable
Fix UBSan report in HashTable
2020-05-04 04:50:25 +03:00
Артем Стрельцов
05d4e41949 minor fix 2020-05-04 04:28:54 +03:00
FawnD2
7b23844b32 Common order of precompiled checks 2020-05-04 03:58:10 +03:00
FawnD2
02e12215e7 Apply reducing memory usage optimization for seekable files to ORC format 2020-05-04 03:52:28 +03:00
alexey-milovidov
6b0bffcdab
Update CompressionFactory.cpp 2020-05-04 03:47:41 +03:00
Alexey Milovidov
99c18c5a09 Check for suspicious codecs #4966 2020-05-04 03:11:49 +03:00
FawnD2
a554177724 Simplify ORC format 2020-05-04 02:23:20 +03:00
alexey-milovidov
884c2aa631
Merge pull request #10641 from ClickHouse/storage-buffer-nullptr-dereference
Fix nullptr dereference in StorageBuffer
2020-05-04 02:01:57 +03:00