thevar1able/ClickHouse
1
0
Fork 0
mirror of https://github.com/ClickHouse/ClickHouse.git synced 2024-12-16 03:12:43 +00:00
Code Issues Packages Projects Releases Wiki Activity
95,145 Commits 9,326 Branches 1,783 Tags 2.1 GiB
001aca3b47
Commit Graph

29696 Commits

Author SHA1 Message Date
pzhdfy
848a349e42 fix potential netlink leak when init fail in TaskStatsInfoGetter 2022-08-04 11:37:27 +08:00
Alexey Milovidov
9e46abc560
Merge pull request #39420 from amosbird/better-projection1-fix1 
Normalize AggregateFunction types and state representations
 2022-08-04 03:06:55 +03:00
Nikolay Degterinsky
71cb055ecc
Merge pull request #39812 from guowangy/applyFunction-multi-thread 
KeyCondition: optimize applyFunction in multi-thread scenario
 2022-08-04 01:36:47 +02:00
Alexey Milovidov
fe95703a49
Merge pull request #39586 from guowangy/bytes-to-bits-mask 
Improve bytes to bits mask transform for SSE/AVX/AVX512
 2022-08-04 02:33:58 +03:00
Alexey Milovidov
f474eb957d
Merge pull request #39758 from ClickHouse/tsan_clang_15 
Try clang-15 for build with tsan
 2022-08-04 01:56:52 +03:00
Kseniia Sumarokova
bd5610b732
Merge branch 'master' into update-azure-lib 2022-08-03 23:00:57 +02:00
Yakov Olkhovskiy
1680be19ca some refactoring 2022-08-03 16:36:52 -04:00
Yakov Olkhovskiy
2e34b384c1 update tcp protocol, add quota_key 2022-08-03 15:44:08 -04:00
Alexander Tokmakov
a269cf29e4 remove unused dirs from store on all disks 2022-08-03 19:49:16 +02:00
Alexander Tokmakov
b8ffaabdd8 add chmod and stat to IDisk 2022-08-03 19:47:36 +02:00
Anton Popov
04f6a85070 fix mutations 2022-08-03 17:34:46 +00:00
Kruglov Pavel
b84e65bb3b
Merge pull request #39716 from arthurpassos/fix_scalar_cte_with_lc_result 
Unwrap LC column in IExecutablefunction::executeWithoutSparseColumns
 2022-08-03 18:53:37 +02:00
Maksim Kita
e6efb47aa3
Merge pull request #39850 from kitaisreal/select-query-has-join-method 
Add hasJoin method into ASTSelectQuery
 2022-08-03 18:50:25 +02:00
Nikita Taranov
4943202921
Improve memory usage during memory efficient merging of aggregation results (#39429) 2022-08-03 17:56:59 +02:00
Anton Popov
5da32fafb3 fix ALTER MODIFY COLUMN from nested 2022-08-03 15:08:38 +00:00
Antonio Andelic
56ca93ca3f Block memory tracker in Keeper during commit 2022-08-03 14:14:57 +00:00
root
b2d87a9376 Merge branch 'Structured-Logging-Support' of github.com:ClibMouse/ClickHouse into Structured-Logging-Support 2022-08-03 06:37:00 -07:00
root
d58ae78712 removed default color enable in OwnPatternFormatter constructor calling 2022-08-03 06:30:48 -07:00
Nikita Mikhaylov
f144eae388
Fix typo and extra dots in exception messages from OverCommitTracker (#39858) 2022-08-03 15:23:07 +02:00
Igor Nikonov
9eef299e11
Merge pull request #39103 from tonickkozlov/tonickkozlov/37032/do-not-optimize-functions-shadowing-args 
Do not optimize GROUP BY functions that shadow their arguments
 2022-08-03 15:06:42 +02:00
alesapin
f608e62c27 Fix call 2022-08-03 14:17:31 +02:00
alesapin
56a4d26e87 Better total part size calculation on mutation 2022-08-03 14:15:45 +02:00
Anton Popov
6b15ee2bd9
Merge pull request #39685 from CurtizJ/hash-functions-map 
Allow to execute hash functions with arguments of type `Map`
 2022-08-03 13:51:16 +02:00
Antonio Andelic
05467e315f
Merge pull request #39698 from ClickHouse/update-digest-version 
Update Keeper version for digest
 2022-08-03 13:13:00 +02:00
alesapin
86561509c5
Merge pull request #39673 from ClickHouse/fix-rollback-inconsistency-keeper 
Rollback request in Keeper if storing log fails
 2022-08-03 13:03:31 +02:00
Maksim Kita
3e6b663020 ASTSelectQuery added hasJoin method 2022-08-03 11:25:45 +02:00
Robert Schulze
00a7c8733b
Merge pull request #39633 from guowangy/filter-vbmi2 
ColumnVector: optimize filter with AVX512VBMI2 compress store
 2022-08-03 09:23:24 +02:00
Antonio Andelic
cbff608d0b
Merge branch 'master' into update-digest-version 2022-08-03 07:53:38 +02:00
Igor Nikonov
30782a2b05 Test: distinct sorted is not used on const column 2022-08-02 17:44:43 +00:00
Kruglov Pavel
6b2186bfeb
Merge branch 'master' into numbers-schema-inference 2022-08-02 19:34:53 +02:00
Kruglov Pavel
8a351724de
Update settings changes history 2022-08-02 19:31:20 +02:00
Anton Popov
2a5b023b0f
Merge pull request #39800 from CurtizJ/fix-cannot-read-all-data 
Fix `CANNOT_READ_ALL_DATA` with `pread_threadpool`.
 2022-08-02 16:06:13 +02:00
Nikolay Degterinsky
6405439976
Merge pull request #39558 from evillique/fix-logs 
Fix logs rotation issue
 2022-08-02 15:49:14 +02:00
Mallik Hassan
87bde54ee5
Merge branch 'ClickHouse:master' into Structured-Logging-Support 2022-08-02 10:44:05 -03:00
root
0fad007220 changing OwnPatternFormatter.cpp to its original version 2022-08-02 06:42:50 -07:00
Anton Popov
a333cc4146 Merge remote-tracking branch 'upstream/master' into HEAD 2022-08-02 12:57:43 +00:00
Anton Popov
2312d8ceea
Merge pull request #39696 from BiteTheDDDDt/fix_0729 
fix align of AggregateFunctionDistinct
 2022-08-02 14:27:01 +02:00
Arthur Passos
e9b124b4bc Don't use default implementation for LC columns in Scalar functions 2022-08-02 09:17:53 -03:00
Anton Popov
f94d4d4877
Merge branch 'master' into hash-functions-map 2022-08-02 13:26:54 +02:00
Igor Nikonov
56697125d3 Merge remote-tracking branch 'origin/master' into distinct_sorted_simplify 2022-08-02 11:18:46 +00:00
Anton Kozlov
ce70f3dacb fixed 02303_query_kind test; added logging in 02352_grouby_shadows_arg test 2022-08-02 10:50:27 +00:00
Alexander Tokmakov
82b50e79cf
Merge branch 'master' into tsan_clang_15 2022-08-02 13:00:55 +03:00
Alexander Tokmakov
5050e0aca5
Revert "Limit number of analyze for one query" 2022-08-02 12:48:31 +03:00
Nikolai Kochetov
a3bf9496d4
Merge pull request #39799 from ClickHouse/fix-extra-column-after-array-join-optimization 
Fix extra column after ARRAY JOIN optimization.
 2022-08-02 10:35:35 +02:00
Wangyang Guo
91e3e2f18b KeyCondition: optimize applyFunction in multi-thread scenario 
Construct and deconstruct args (ColumnsWithTypeAndName) will inc/dec
ref_count (actually this is a atomic lock inc/dec operation) to share_ptr,
which may share the same DataTypePtr among different threads. This will
have a lock contention issue in large parallel situation.

The patch try to minimize `args` scope and reduce unnecessary
construct/destory of instances. It will improve the performance in
multi-thread cases.
 2022-08-02 16:16:16 +08:00
Antonio Andelic
b3b3c371f0
Update KeeperStorage.h 2022-08-02 09:20:02 +02:00
Amos Bird
b98e645ff7
Revert "test what will be wrong if state returns norm type" 
This reverts commit 55802099bc.
 2022-08-02 11:33:45 +08:00
root
433b961d5c changed code for expected seg fault 2022-08-01 20:21:48 -07:00
Alexey Milovidov
316528817b
Merge pull request #39179 from azat/fsync-profile-events 
Add profile events for fsync
 2022-08-02 05:44:35 +03:00
Amos Bird
c8aaa32f9c
Revert "Another test" 
This reverts commit 69347028c5.
 2022-08-02 10:43:48 +08:00
Wangyang Guo
6a7213291b Merge master and resolve conflict 2022-08-02 10:40:40 +08:00
Alexey Milovidov
b1919d045f
Update ThreadPoolReader.cpp 2022-08-02 05:34:14 +03:00
Wangyang Guo
ce3411b0ff Merge master and solve conflict 2022-08-02 10:27:01 +08:00
Nikolay Degterinsky
90b08d6fae
Merge branch 'master' into fix-logs 2022-08-02 02:55:29 +02:00
Anton Popov
64cbecf0c8 fix build on non linux systems 2022-08-02 00:13:20 +00:00
Anton Popov
5d6804dd65
Merge branch 'master' into fix_0729 2022-08-01 21:14:46 +02:00
Amos Bird
69347028c5
Another test 2022-08-02 03:08:25 +08:00
Anton Popov
43e8ca5ba8 fix CANNOT_READ_ALL_DATA with pread_threadpool 2022-08-01 18:40:21 +00:00
Nikolai Kochetov
77c143aa23 Fix extra column after ARRAY JOIN optimization. 2022-08-01 17:56:27 +00:00
Alexey Milovidov
3de747a6e2
Merge pull request #39746 from ClickHouse/cleanup-projection-setting 
Cleanup usages of `allow_experimental_projection_optimization` setting, part 1
 2022-08-01 19:21:30 +03:00
Alexander Tokmakov
0d68b1c67f fix build with clang-15 2022-08-01 18:00:54 +02:00
Maksim Kita
31891322a5
Merge pull request #39681 from pkit/pkit/executable_settings 
add settings for executable table func
 2022-08-01 17:59:52 +02:00
Robert Schulze
bf574b9154
Merge pull request #39760 from ClickHouse/bit-fiddling 
Use std::popcount, ::countl_zero, ::countr_zero functions
 2022-08-01 17:04:51 +02:00
Amos Bird
55802099bc
test what will be wrong if state returns norm type 2022-08-01 21:04:16 +08:00
Amos Bird
8ab475ccf3
Fix another case 2022-08-01 21:04:15 +08:00
Amos Bird
09c99d8440
Fix tests 2022-08-01 21:04:14 +08:00
Amos Bird
f84e5b6827
Allow to format DataTypePtr 2022-08-01 21:04:13 +08:00
Amos Bird
0e746c1afa
More format refactor 2022-08-01 21:04:13 +08:00
Amos Bird
f11d0484f3
Normalize everything else 2022-08-01 21:04:11 +08:00
Anton Popov
8a3ec52b5e
Merge pull request #39752 from CurtizJ/fix-index-analysis 
Fix index analysis with tuples and `IN`
 2022-08-01 14:41:46 +02:00
Anton Popov
eeb9366010
Merge pull request #39731 from CurtizJ/fix-send-logs-level-test 
Fix redirecting of logs to stdout in clickhouse-client
 2022-08-01 14:22:49 +02:00
Alexander Tokmakov
80f9ba9186
Merge pull request #39690 from ClickHouse/show-addresses-in-stack-traces 
Configuration parameter to hide addresses in stack traces
 2022-08-01 14:20:37 +03:00
Kruglov Pavel
1c1e7eb0cd
Fix duplicate lines 2022-08-01 13:16:23 +02:00
Kruglov Pavel
a0d51601bf
Update EscapingRuleUtils.cpp 2022-08-01 13:07:48 +02:00
Kruglov Pavel
dfdfabec94
Merge pull request #39218 from evillique/file_default_value 
Add default argument to the function `file`
 2022-08-01 13:04:19 +02:00
Kruglov Pavel
42136b7630
Merge pull request #39647 from Avogar/fix-arrow-strings 
Fix strings in dictionary in Arrow format
 2022-08-01 12:46:07 +02:00
Kruglov Pavel
6457c069a9
Merge pull request #39293 from kssenii/fix-positional-args-case 
Fix positional arguments in case of unneeded columns pruning
 2022-08-01 12:42:18 +02:00
Antonio Andelic
9ec27c0ab4
Merge pull request #39757 from ClickHouse/fix-rocksdb-filter-with-params 
Use params correctly for filtering by key in EmbeddedRocksDB
 2022-08-01 12:17:10 +02:00
Wangyang Guo
6a67147584 ColumnVector: refactory to use TargetSpecific::Default::doFilterAligned 2022-08-01 13:41:02 +08:00
Wangyang Guo
b05be56eef ColumnVector: naming style fix 2022-08-01 10:16:15 +08:00
Dmitry Novik
ab5a147065
Merge pull request #38725 from azat/fix-order-by-projection 
Fix ORDER BY that matches projections ORDER BY
 2022-08-01 00:32:59 +02:00
Robert Schulze
d39259a4c0
More conversions 2022-07-31 22:06:02 +00:00
Azat Khuzhin
3e627e2861 Add profile events for fsync 
The following new provile events had been added:

- FileSync - Number of times the F_FULLFSYNC/fsync/fdatasync function was called for files.
- DirectorySync - Number of times the F_FULLFSYNC/fsync/fdatasync function was called for directories.
- FileSyncElapsedMicroseconds - Total time spent waiting for F_FULLFSYNC/fsync/fdatasync syscall for files.
- DirectorySyncElapsedMicroseconds - Total time spent waiting for F_FULLFSYNC/fsync/fdatasync syscall for directories.

v2: rewrite test to sh with retries
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2022-07-31 23:19:30 +03:00
Nikolai Kochetov
22fbfe19a4 Merge branch 'master' into use-dag-in-key-condition 2022-07-31 21:54:12 +02:00
Alexey Milovidov
ccef227494
Merge pull request #38185 from vdimir/analyze_stuck 
Limit number of analyze for one query
 2022-07-31 22:53:09 +03:00
kssenii
687f0fabfc Move some dependencies 2022-07-31 20:17:22 +03:00
Robert Schulze
a7734672b9
Use std::popcount, ::countl_zero, ::countr_zero functions 
- Introduced with the C++20 <bit> header

- The problem with __builtin_c(l|t)z() is that 0 as input has an
  undefined result (*) and the code did not always check. The std::
  versions do not have this issue.

- In some cases, we continue to use buildin_c(l|t)z(), (e.g. in
  src/Common/BitHelpers.h) because the std:: versions only accept
  unsigned inputs (and they also check that) and the casting would be
  ugly.

(*) https://gcc.gnu.org/onlinedocs/gcc/Other-Builtins.html
 2022-07-31 15:16:51 +00:00
Robert Schulze
52d08d9db4
Merge pull request #39520 from ClickHouse/no-split-binary 
Remove SPLIT_BINARY
 2022-07-31 14:23:31 +02:00
Robert Schulze
0f2177127b
Merge pull request #39751 from ClickHouse/enable-getoskernelversion 
Enable SQL function getOSKernelVersion() on all platforms
 2022-07-31 14:09:46 +02:00
Nikolai Kochetov
eaeb0446c7
Merge pull request #39705 from ClickHouse/avoid-recursive-dtor-for-ast 
Avoid recursive destruction of AST.
 2022-07-31 12:59:20 +02:00
Antonio Andelic
eea1aaef2c Use params for filtering by key in EmbeddedRocksDB 2022-07-31 10:44:01 +00:00
Alexander Gololobov
d259c4fa6c
Merge pull request #39747 from ClickHouse/fix-double-escaping-json 
Fix double escaping in the metadata of FORMAT JSON
 2022-07-31 11:28:25 +02:00
Robert Schulze
4d7627e45e
Fix include 2022-07-31 07:36:40 +00:00
Anton Popov
095e400075 fix index analysis with tuples and IN 2022-07-31 00:38:52 +00:00
Alexey Milovidov
d285648a37
Merge branch 'master' into shell-command-wait-pid-refactoring 2022-07-31 02:57:46 +03:00
Anton Popov
74eb8119ef
Merge branch 'master' into fix-custom-serializations 2022-07-31 01:51:52 +02:00
Alexey Milovidov
22bc89690d
Merge pull request #39222 from azat/fix-http-session 
Do not report "Failed communicating with" on and on for parts exchange
 2022-07-31 02:24:05 +03:00
Alexey Milovidov
8fb70abe3e
Merge pull request #39178 from azat/dist-insert-log 
Add connection info for Distributed sends log message
 2022-07-31 02:22:22 +03:00
Robert Schulze
8ca236de08
Enable SQL function getOSKernelVersion() on all platforms 
Follow up to PR #38615
 2022-07-30 22:36:47 +00:00
Igor Nikonov
83e1dd1172
Merge branch 'master' into ordinary_distinct_small_refact 2022-07-31 00:23:21 +02:00
Robert Schulze
85773e0926
Merge pull request #38615 from liyinsg/simplified_function_registration_interface 
Simplified function registration interface
 2022-07-31 00:18:37 +02:00
Alexey Milovidov
4828be7fc4 Fix double escaping in the metadata of FORMAT JSON 2022-07-30 23:56:41 +02:00
Alexey Milovidov
441f2feb49 Cleanup usages of allow_experimental_projection_optimization setting, part 1 2022-07-30 23:40:21 +02:00
Igor Nikonov
7245ddcc20 Simple refactoring: ordinary DISTINCT implementation 2022-07-30 20:25:56 +00:00
Alexey Milovidov
2bdc926572
Merge pull request #39687 from vitlibar/fix-reading-from-encrypted-disk 
Fix seeking while reading from encrypted disk
 2022-07-30 23:09:15 +03:00
Igor Nikonov
a7cfad105e
Merge branch 'master' into distinct_sorted_simplify 2022-07-30 21:57:53 +02:00
Igor Nikonov
3be51a6dea Construct DistinctSortedTransform only when it makes sense 
otherwise fallback to DistinctTransform (i.e. ordinary distinct)
 2022-07-30 19:41:03 +00:00
Robert Schulze
b52843d5fd
Merge pull request #37951 from zvonand/dt64_timeslots 
Fix timeSlots for DateTime64
 2022-07-30 20:49:05 +02:00
Constantine Peresypkin
b9d7cd6a5d add settings for executable table func 
SELECT * FROM executable('<script name>', '<format>', '<columns>', (SELECT * FROM table), SETTINGS max_command_execution_time=100, command_termination_timeout=100)

fixes #38908
 2022-07-30 20:02:56 +02:00
kssenii
d66c108a04 Fix 2022-07-30 18:42:22 +03:00
Alexey Milovidov
fbedb70f8b
Merge branch 'master' into fix-logs 2022-07-30 18:37:09 +03:00
Alexey Milovidov
5eea7ce18d
Merge branch 'master' into fix-reading-from-encrypted-disk 2022-07-30 18:30:00 +03:00
Maksim Kita
acb0137dbb
Merge pull request #39718 from kitaisreal/join-enums-refactoring 
Join enums refactoring
 2022-07-30 13:53:08 +02:00
Antonio Andelic
7cdad88327 Create snapshot on shutdown 2022-07-30 11:34:17 +00:00
Alexey Milovidov
c9700efab7
Merge branch 'master' into fix-reading-from-encrypted-disk 2022-07-30 05:30:59 +03:00
Alexey Milovidov
1e974b55ea
Merge branch 'master' into analyze_stuck 2022-07-30 04:56:21 +03:00
Alexey Milovidov
8f348edbbd
Merge pull request #39000 from ClickHouse/avx-enablement 
Avx enablement
 2022-07-30 04:51:07 +03:00
Alexey Milovidov
3fa1a775d9
Merge branch 'master' into bytes-to-bits-mask 2022-07-30 04:39:09 +03:00
Alexey Milovidov
c0d7b6efc3 Suggestions from @tavplubix 2022-07-30 01:45:06 +02:00
Alexey Milovidov
4aa96767d5 Merge branch 'master' of github.com:ClickHouse/ClickHouse into show-addresses-in-stack-traces 2022-07-30 01:44:04 +02:00
Igor Nikonov
d951154ef4 Proved NULLs direction when compare rows 2022-07-29 22:12:03 +00:00
Maksim Kita
8653562f52 Fixed build 2022-07-29 23:34:25 +02:00
Igor Nikonov
13dc1697fb Remove unnecessary initialization 2022-07-29 20:34:23 +00:00
Igor Nikonov
b44373ba8f Merge remote-tracking branch 'origin/master' into distinct_sorted_simplify 2022-07-29 20:33:26 +00:00
HarryLeeIBM
cc73b53116 Fix Endian issue in SipHash for s390x 2022-07-29 13:21:50 -07:00
Igor Nikonov
f6739c6c98
Merge pull request #39688 from ClickHouse/const_columns_in_distinct 
Fix DISTINCT: handle all const columns case correctly
 2022-07-29 22:03:20 +02:00
Igor Nikonov
7b0b38e997 DistinctSortedTransform works only if columns contains sort prefix of 
sort description
 2022-07-29 20:01:07 +00:00
Anton Popov
942f056ce5 fix redirecting of logs to stdout in client 2022-07-29 19:10:23 +00:00
kssenii
efff78819a Merge remote-tracking branch 'upstream/master' into fix-positional-args-case 2022-07-29 22:07:51 +03:00
Kruglov Pavel
ccd1e1bdb8
Merge branch 'master' into fix-cancel-insert-into-function 2022-07-29 20:27:32 +02:00
Alexander Gololobov
6099f66fd6
fixed type 2022-07-29 19:55:50 +02:00
Maksim Kita
8ba42876fc Fixed build 2022-07-29 19:35:15 +02:00
Nikolai Kochetov
117fda2d83
Update gtest_ast_deleter.cpp 2022-07-29 19:10:43 +02:00
Arthur Passos
f0f19874da fix style 2022-07-29 13:56:01 -03:00
Maksim Kita
8fc6bad4f4 Join enums refactoring 2022-07-29 18:35:05 +02:00
Arthur Passos
59fbd21024 Unwrap LC column in IExecutablefunction::executeWithoutSparseColumns 2022-07-29 12:03:09 -03:00
Alexander Tokmakov
07617df98e
Merge branch 'master' into fix_flaky_tests_ordinary 2022-07-29 18:02:05 +03:00
Nikolai Kochetov
59a11b32ad
Merge branch 'master' into use-dag-in-key-condition 2022-07-29 17:01:33 +02:00
Maksim Kita
683371978c
Merge pull request #39449 from kitaisreal/direct-dictionary-dict-has-multiple-same-keys-fix 
DirectDictionary improve performance of dictHas with duplicate keys
 2022-07-29 16:01:12 +02:00
Anton Kozlov
ae7fd5bf93 Default database resolution in distributed reads 2022-07-29 13:35:57 +00:00
Igor Nikonov
ae82bfb7f3 Merge remote-tracking branch 'origin/master' into distinct_sorted_simplify 2022-07-29 13:12:03 +00:00
Alexander Tokmakov
0cef018c29 clear mmapio cache when dropping table from Ordinary 2022-07-29 14:26:41 +02:00
Robert Schulze
3d1797f75f
Merge remote-tracking branch 'origin/master' into no-split-binary 2022-07-29 12:17:43 +00:00
Robert Schulze
a3c52f1140
Merge pull request #39679 from azat/fix-utils 
Fix utils build on CI
 2022-07-29 14:02:53 +02:00
Anton Popov
57e4fb2e30 Merge remote-tracking branch 'upstream/master' into HEAD 2022-07-29 11:42:11 +00:00
Anton Popov
bb551566e7 fix build 2022-07-29 11:41:53 +00:00
Nikolai Kochetov
ac90aa435e Avoid recursive destruction of AST. 2022-07-29 11:00:33 +00:00
Vitaly Baranov
2f3b27d1ac Fix seeking while reading from encrypted disk. 2022-07-29 12:45:29 +02:00
zvonand
b390bcfe7c fix wrong data type cast 2022-07-29 13:25:40 +03:00
Pxl
b4842860e3
Merge branch 'master' into fix_0729 2022-07-29 16:48:26 +08:00
Alexander Tokmakov
396e49d243
Merge pull request #39686 from azat/zookeeper_log.duration_ms 
Add duration_ms into system.zookeeper_log
 2022-07-29 11:40:30 +03:00
Azat Khuzhin
498c8b3c52 Fix clang-tidy in utils/examples 
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2022-07-29 11:36:51 +03:00
Antonio Andelic
3b96ff0fe4 Merge branch 'master' into fix-rollback-inconsistency-keeper 2022-07-29 07:53:00 +00:00
Li Yin
4088c0a7f3 Automated function registration 
Automated register all functions with below naming convention by
iterating through the symbols:
void DB::registerXXX(DB::FunctionFactory &)
 2022-07-29 15:39:50 +08:00
Antonio Andelic
21becb3030 Update version for digest 2022-07-29 07:36:19 +00:00
BiteTheDDDDt
cb68180cdf fix align of AggregateFunctionDistinct 2022-07-29 15:22:03 +08:00
Antonio Andelic
e3cb65a99a Rollback on failed preprocess 2022-07-29 06:51:53 +00:00
Alexey Milovidov
552b517e59 Allow to hide addresses in stack traces 2022-07-29 00:13:02 +02:00
Igor Nikonov
4af435bdda Fix: handle all const columns case correctly 2022-07-28 21:22:06 +00:00
Vitaly Baranov
3b6bacbf0b Add tests. 2022-07-28 22:38:50 +02:00
Yakov Olkhovskiy
0f1747b421
Merge pull request #39621 from amosbird/trivial-optimization 
Combining sumIf->countIf and multiIf->if opt.
 2022-07-28 16:08:36 -04:00
Igor Nikonov
f414af2348
Merge pull request #39538 from ClickHouse/fix_distinct_sorted 
Fix: DistinctSortedTransform doesn't take advantage of sorting
 2022-07-28 21:47:10 +02:00
Azat Khuzhin
e1f8cff3b4 Add duration_ms into system.zookeeper_log 
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2022-07-28 22:34:51 +03:00
Anton Popov
45da56d802 support hash functions with Map type 2022-07-28 19:15:19 +00:00
Kseniia Sumarokova
d044f35ed7
Merge pull request #39384 from kssenii/fix-window-view-segfailt 
Fix segfault in create window view on cluster
 2022-07-28 21:21:35 +03:00
root
bb8f7f6f0b style correction in OwnJSONPatternFormatter.cpp 2022-07-28 09:52:30 -07:00
root
bec7408a0c reflected change requests asked on July 27 2022-07-28 09:20:28 -07:00
Robert Schulze
199e254777
Merge remote-tracking branch 'origin/master' into no-split-binary 2022-07-28 15:54:22 +00:00
Antonio Andelic
c0a5d45258 Rollback on failed PreAppend 2022-07-28 14:06:45 +00:00
Anton Popov
04fd72cdef fix alter column rename 2022-07-28 13:19:23 +00:00
Antonio Andelic
1090d6bca7 Rollback request if storing log fails 2022-07-28 12:55:29 +00:00
Nikolai Kochetov
6919ae7c91 Fixing a test with indexHint 2022-07-28 12:24:16 +00:00
Vladimir C
ee515b8862
Merge pull request #39656 from HarryLeeIBM/hlee-s390x-bit-helpers 
Fix Endian issue in BitHelpers for s390x
 2022-07-28 13:31:14 +02:00
Antonio Andelic
15e999f8bc
Merge pull request #39096 from ClickHouse/keeper-version-check 
Add version for Keeper API
 2022-07-28 10:10:49 +02:00
Sergei Trifonov
edf6b02723
Merge pull request #37558 from ClickHouse/concurrency-control 
add concurrency control for pipeline executors
 2022-07-28 08:56:24 +02:00
Yakov Olkhovskiy
f1bc767ccf
Merge pull request #39627 from HarryLeeIBM/hlee-s390x-wide_int 
Fix wide integer unit tests on s390x platform
 2022-07-27 21:30:12 -04:00
Vitaly Baranov
f8ebe76826
Merge pull request #39503 from vitlibar/improve-system-backups-table 
Improve system.backups table
 2022-07-27 20:25:39 +02:00
Vladimir C
115506356c
Merge branch 'master' into refactor-prepared-sets 2022-07-27 19:57:23 +02:00
Nikolai Kochetov
6206e468a4 Ignor materialize function for ActionsDAG in PK analysis. 2022-07-27 17:02:48 +00:00
Nikolai Kochetov
51c4c9c957 Fixing build. 2022-07-27 15:45:23 +00:00
Anton Popov
56039c8780 fix alter of LowCardinality 2022-07-27 15:35:09 +00:00
Vladimir C
a8be51f4df
Merge pull request #39567 from Algunenano/progress_result_rows_and_bytes 
Add result_rows and result_bytes to progress reports
 2022-07-27 16:43:55 +02:00
Anton Popov
4cf0353892 try to fix Nested 2022-07-27 14:05:16 +00:00
HarryLeeIBM
3639ecfc56 Fix Endian issue in BitHelpers 2022-07-27 06:56:04 -07:00
Sergei Trifonov
05e4bd6c8b review fix 2022-07-27 15:36:50 +02:00
Igor Nikonov
377c04fbf1 Merge remote-tracking branch 'origin/master' into fix_distinct_sorted 2022-07-27 13:01:18 +00:00
Anton Popov
1547c010b9
Merge pull request #39432 from ClickHouse/distinct_sorted_chunk_perf_impr 
DISTINCT in order: perf improvement
 2022-07-27 14:17:58 +02:00
Alexander Tokmakov
344b69dea4
Merge pull request #39183 from azat/default-disk-check 
Forbid defining non-default disk with default path from <path>
 2022-07-27 15:14:50 +03:00
avogar
01a309d4e3 Fix strings in dictionary in Arrow format 2022-07-27 12:02:27 +00:00
Nikolai Kochetov
f9a8a4cd32 Fixing read-in-order for Merge 2022-07-27 12:00:55 +00:00
alesapin
2dfb547847
Merge pull request #39054 from SmitaRKulkarni/add-option-for-outfile-to-print-stdout 
Add an option to INTO OUTFILE to also print details to standard output.
 2022-07-27 13:51:38 +02:00
avogar
f925046dc4 Add more Pretty formats 2022-07-27 11:37:02 +00:00
vdimir
8eecb9ef82
upd PreparedSets: rename/change signature of methods, add comments 2022-07-27 11:22:16 +00:00
Nikolai Kochetov
873432fb53
Merge pull request #37849 from ClickHouse/bug-with-fill-date 
Enforce equality of WITH FILL type with ORDER BY column's type for date/time types.
 2022-07-27 12:27:53 +02:00
Vitaly Baranov
32e40e630e Fix removing "internal" column. 2022-07-27 12:24:21 +02:00
Alexander Tokmakov
44463cfca0
Merge pull request #39565 from ClickHouse/fix_39511 
Fix create/drop index on cluster
 2022-07-27 13:21:51 +03:00
Alexander Tokmakov
8fc075a527
Merge pull request #39619 from ClickHouse/try-do-enable-global-allocations-for-attach 
Replace MemoryTrackerBlockerInThread to LockMemoryExceptionInThread
 2022-07-27 13:13:04 +03:00
Vitaly Baranov
794eeb5d51 Split "total_size" to "uncompressed_size" and "compressed_size". 2022-07-27 10:36:56 +02:00
Igor Nikonov
64e51e56e7 Allocate memory for column arrays once 2022-07-27 08:22:07 +00:00
Igor Nikonov
12a7567402 Some polishing 2022-07-27 07:58:54 +00:00
Alexander Gololobov
9525bd19bf
Merge pull request #39592 from ClickHouse/fix-wrong-regexp-replace 
Fix wrong regexp replace
 2022-07-27 09:54:28 +02:00
Antonio Andelic
e62526720f Address PR comments 2022-07-27 07:51:30 +00:00
Igor Nikonov
589104fa6e Make building column arrays for chunk processing straightforward 2022-07-27 07:44:42 +00:00
Vitaly Baranov
e602e01232 Fix style. 2022-07-27 09:04:10 +02:00
Vitaly Baranov
a79fc17235 Add test for system.backups 2022-07-27 09:04:10 +02:00
Vitaly Baranov
51a2bf33e8 Rename backup statuses to CREATING_BACKUP, BACKUP_CREATED, BACKUP_FAILED, RESTORING, RESTORED, RESTORE_FAILED. 2022-07-27 09:04:10 +02:00
Vitaly Baranov
1cfe0b10f7 Add columns "total_size" and "num_files" to system.backups 2022-07-27 09:04:10 +02:00
Vitaly Baranov
35c267b3b1 Replace column "status_changed_time" with columns "start_time" and "end_time". 2022-07-27 09:04:10 +02:00
Vitaly Baranov
fc16a15ecf Rename column "uuid" -> "id" in system.backups and allow user to set it in a query. 2022-07-27 09:04:10 +02:00
Vitaly Baranov
131019ba49 Rename column "backup_name" -> "name" in system.backups. 2022-07-27 09:04:10 +02:00
Vitaly Baranov
d129be2a9e Remove column "backup_name" from the result of a BACKUP/RESTORE query 2022-07-27 09:04:10 +02:00
Vitaly Baranov
afd0982187 Remove column "internal" from system.backups 2022-07-27 09:04:10 +02:00
Vitaly Baranov
16a60b5e93
Merge pull request #39455 from vitlibar/fix-locks-add-tests 
Improve synchronization between hosts in distributed backup and fix locks
 2022-07-27 09:02:58 +02:00
Antonio Andelic
904a05ac21
Merge pull request #39496 from azat/custom-tld-exclamation-asterisk 
Add support of !/* (exclamation/asterisk) in custom TLDs
 2022-07-27 08:55:49 +02:00
Wangyang Guo
b77214792e ColumnVector: avoid calling resize too frequently 2022-07-27 13:30:44 +08:00
Wangyang Guo
6d7bfc3b2a ColumnVector: add unit test for filter 2022-07-27 13:30:44 +08:00
Wangyang Guo
d781ed5779 ColumnVector: bug fix for unit test failure 2022-07-27 13:30:44 +08:00
Wangyang Guo
7820e8278d ColumnVector: optimize filter with AVX512VBMI2 compress store 2022-07-27 13:30:43 +08:00
Wangyang Guo
e6752d687f TargetSpecific: add AVX512VBMI2 support 2022-07-27 13:30:43 +08:00
Wangyang Guo
50fdbcdc12 CpuId: add AVX512VBMI2 detection 2022-07-27 13:30:43 +08:00
Harry Lee
df6c0ab34f
Merge branch 'ClickHouse:master' into hlee-s390x-wide_int 2022-07-26 22:02:51 -04:00
Alexander Gololobov
a64aa00869
Merge pull request #37893 from zhangjmruc/feature/sql-standard-delete 
Support SQL standard "delete from ... where ..." syntax and lightweight implementation on merge tree tables
 2022-07-26 23:39:07 +02:00
Igor Nikonov
cac4d77d0b Merge remote-tracking branch 'origin/master' into distinct_sorted_chunk_perf_impr 2022-07-26 20:36:38 +00:00
Yakov Olkhovskiy
0055c9307d
style fix 2022-07-26 16:08:03 -04:00
HarryLeeIBM
d475086100 Fix wide integer unit test 2022-07-26 12:57:45 -07:00
Igor Nikonov
24f3a6905f
Merge branch 'master' into fix_distinct_sorted 2022-07-26 21:57:44 +02:00
Igor Nikonov
d196ab24d4 Calculate DISTINCT columns positions which form sort prefix in sort 
description once
 2022-07-26 19:55:29 +00:00
Yakov Olkhovskiy
d93c67e303 comment and test added 2022-07-26 15:28:11 -04:00
Nikolai Kochetov
f1818a9103 Make only one possible public ctor in MemoryTrackerBlockerInThread 2022-07-26 19:04:20 +00:00
Nikolai Kochetov
dcb86eca0b Make only one possible public ctor in MemoryTrackerBlockerInThread 2022-07-26 19:03:26 +00:00
Nikolai Kochetov
1adb021df6 Fixing tests. 2022-07-26 18:42:27 +00:00
vdimir
5ce2960f03
Get rid of SelectQueryInfoBase -> SelectQueryInfo 2022-07-26 18:39:09 +00:00
vdimir
11d37a8dc9
Properly initialize prepared_sets 2022-07-26 18:39:09 +00:00
vdimir
d9928ac93d
Add methods to SubqueryForSet, do not use refernce to SetPtr 2022-07-26 18:39:09 +00:00
vdimir
1e3fa2e01f
Refactor PreparedSets/SubqueryForSet 2022-07-26 18:39:02 +00:00
Nikolai Kochetov
fa0707b4e7 Review fixes. 2022-07-26 17:51:09 +00:00
Anton Popov
9321ca34cf try to fix Nested 2022-07-26 17:32:37 +00:00
Robert Schulze
7d653b3bd8
Merge pull request #39495 from ClickHouse/mark-qpl-deflate-experimental 
Mark new codec DEFLATE_QPL as experimental + cosmetics
 2022-07-26 19:00:21 +02:00
Amos Bird
5ad8314367
Combining sumIf->countIf and multiIf->if opt. 2022-07-26 23:55:13 +08:00
Nikolai Kochetov
33ce662d3e Replace MemoryTrackerBlockerInThread to LockMemoryExceptionInThread in some places. Reduced MemoryTrackerBlockerInThread level to User. 2022-07-26 15:22:00 +00:00
Kruglov Pavel
c683cb252f
Merge pull request #39227 from amosbird/rename-log1 
Rename log when rename merge tree tables
 2022-07-26 17:12:44 +02:00
root
6406bd998a style check correction in OwnFormattingChannel 2022-07-26 08:03:14 -07:00
Nikolai Kochetov
d7cc3831ea Push predicate over StorageMerge. 2022-07-26 15:01:39 +00:00
Nikolai Kochetov
c5110bb164 Add a query plan step for StorageMerge 2022-07-26 14:43:05 +00:00
Mallik Hassan
0e68ac4e4d
Update BaseDaemon.cpp 
removed conflict markers from BaseDaemon.cpp
 2022-07-26 11:34:17 -03:00
root
f7dcf23404 removed pFormattterJSON pointer from OwnFormattingChannel and reformatted Loggers and BaseDaemon to look nicer 2022-07-26 06:53:06 -07:00
Nikolai Kochetov
908c1d8cba
Merge pull request #39601 from ClickHouse/fix-chain-add-sink 
Fix Chain::addSink
 2022-07-26 14:54:44 +02:00
Vitaly Baranov
413024b4f4 Add call ZooKeeper::sync(). 2022-07-26 14:14:01 +02:00
Kseniia Sumarokova
7d448fc177
Merge pull request #39244 from kssenii/http-buffer-small-fixes 
Some small fixes for http read buffer, allow to retry partial content in case of 200ok
 2022-07-26 14:47:11 +03:00
Kruglov Pavel
c362551642
Merge pull request #39357 from Avogar/fix-protobuf-capnp-empty-message 
Fix schema inference in case of empty messages in Protobuf/CapnProto formats
 2022-07-26 12:33:28 +02:00
Kruglov Pavel
53159db782
Merge branch 'master' into numbers-schema-inference 2022-07-26 12:32:49 +02:00
Vitaly Baranov
f0cd564648 Changes after review and added comments. 2022-07-26 11:58:05 +02:00
Nikolai Kochetov
683a8866ef Fix Chain::addSink 2022-07-26 09:36:39 +00:00
Sergei Trifonov
24ab5fbb86 fix finish() condition to account only active threads 2022-07-26 11:32:45 +02:00
Vladimir C
d9e8e9b948
Merge pull request #39552 from filimonov/maxsplit-bug 
Fix bug with maxsplit in the splitByChar
 2022-07-26 11:14:27 +02:00
Vladimir C
3bd5ca9b6a
Merge pull request #39271 from vdimir/join-alg-setting 
Cleanup logic around join_algorithm setting, add docs
 2022-07-26 11:00:22 +02:00
Vladimir C
888417e788
Merge pull request #39556 from vdimir/asof_optimize_predicate_bug_37813 
Fix bug in ASOF JOIN with enable_optimize_predicate_expression
 2022-07-26 10:51:25 +02:00
Alexander Gololobov
0666ec2e1f
Merge branch 'master' into feature/sql-standard-delete 2022-07-26 10:42:39 +02:00
Raúl Marín
6e3a4b0a3d Add result_rows and result_bytes to progress reports and summary 2022-07-26 10:40:16 +02:00
Vitaly Baranov
c0ec6fd913 Use Poco::Event to simplify code. 2022-07-26 09:53:32 +02:00
Antonio Andelic
35b61cc94e Merge branch 'master' into keeper-version-check 2022-07-26 07:47:57 +00:00
Vitaly Baranov
76599d1231 Finally fix locking storages for reading during backup. 2022-07-26 08:58:33 +02:00
Mallik Hassan
968e867a0d
Update src/Loggers/Loggers.cpp 
Co-authored-by: Nikolay Degterinsky <43110995+evillique@users.noreply.github.com>
 2022-07-26 03:44:16 -03:00
Mallik Hassan
943affe2da
Update src/Daemon/BaseDaemon.cpp 
Co-authored-by: Nikolay Degterinsky <43110995+evillique@users.noreply.github.com>
 2022-07-26 03:43:04 -03:00
Alexey Milovidov
833b24b486 Fix the wrong REGEXP_REPLACE alias 2022-07-26 08:01:49 +02:00
Azat Khuzhin
1d4a7c7290 Add support of !/* (exclamation/asterisk) in custom TLDs 
Public suffix list may contain special characters (you may find format
here - [1]):
- asterisk (*)
- exclamation mark (!)

  [1]: https://github.com/publicsuffix/list/wiki/Format

It is easier to describe how it should be interpreted with an examples.

Consider the following part of the list:

    *.sch.uk
    *.kawasaki.jp
    !city.kawasaki.jp

And here are the results for `cutToFirstSignificantSubdomainCustom()`:

If you have only asterisk (*):

    foo.something.sheffield.sch.uk -> something.sheffield.sch.uk
    sheffield.sch.uk               -> sheffield.sch.uk

If you have exclamation mark (!) too:

    foo.kawasaki.jp                -> foo.kawasaki.jp
    foo.foo.kawasaki.jp            -> foo.foo.kawasaki.jp
    city.kawasaki.jp               -> city.kawasaki.jp
    some.city.kawasaki.jp          -> city.kawasaki.jp

TLDs had been verified wit the following script [2], to match with
python publicsuffix2 module.

  [2]: https://gist.github.com/azat/c1a7a9f1e3519793134ef4b1df5461a6

v2: fix StringHashTable padding requirements
Fixes: #39468
Follow-up for: #17748
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2022-07-26 08:34:30 +03:00
jianmei zhang
c1834d183b ReplicatedMergeTree support lightweight delete 2022-07-26 11:50:09 +08:00
root
1166181065 removed unwanted changes from BaseDaemon.cpp 2022-07-25 19:59:04 -07:00
root
f135a82141 Addressed changes requested by @evillique (Restructured OwnJSONPatternFormatter, used different version of writeJSONString() etc... 2022-07-25 19:39:13 -07:00
Wangyang Guo
be54d0b954 Columns: use AVX512BW vptestnmb to get mask 2022-07-26 10:27:14 +08:00
Wangyang Guo
d6fb682f71 Columns: remove static declaration to zero registers 
Static declaration will enforce an extra mem load. But zeroing register
does not need it (like: vpxor zmm, zmm, zmm).
 2022-07-26 10:27:01 +08:00
Vladimir Chebotaryov
f32d9c5539
Uppercase ROWS, GROUPS, RANGE in queries with windows. (#39410) 2022-07-25 22:53:53 +02:00
Kseniia Sumarokova
9abbb35cda
Fix integration test 2022-07-25 23:40:23 +03:00
Alexander Gololobov
25deba2c1b
Merge branch 'master' into feature/sql-standard-delete 2022-07-25 22:13:20 +02:00
Nikolai Kochetov
be9c7ed52c Add ReadFromMerge step. 2022-07-25 19:41:43 +00:00
Roman Vasin
b462366415 Merge branch 'master' of github.com:ClickHouse/ClickHouse into ADQM-485 2022-07-25 17:55:47 +00:00
Alexey Milovidov
c05190237a
Merge pull request #39551 from ClickHouse/freebsd_start_fix 
Fix for empty function name on FreeBSD build
 2022-07-25 20:52:03 +03:00
Roman Vasin
b412ea5f6d Improve generateRandom() for Date32; fix tests 01087_table_function_generate, 01277_fromUnixTimestamp64, 01691_DateTime64_clamp and 01702_toDateTime_from_string_clamping 2022-07-25 17:06:11 +00:00
Alexander Tokmakov
f1e1cff272 fix create/drop index on cluster 2022-07-25 18:00:54 +02:00
Alexander Tokmakov
778dcf6994
Merge pull request #39230 from Algunenano/improve_replicated_merge_logging 
Improve logging around replicated merges
 2022-07-25 18:42:12 +03:00
Kruglov Pavel
5aae0a2e04
Fix style 2022-07-25 17:20:01 +02:00
Mallik Hassan
b45e44b7e7
Merge branch 'ClickHouse:master' into Structured-Logging-Support 2022-07-25 12:10:41 -03:00
Alexander Gololobov
48de02a7b8 Capitalized const name 2022-07-25 16:32:16 +02:00
Alexander Gololobov
7b44950d1d More detailed comment 2022-07-25 16:14:33 +02:00
Nikolay Degterinsky
c4b72277df Fix logs rotation issue 2022-07-25 13:58:04 +00:00
vdimir
b6f640013d
Fix bug in ASOF JOIN with enable_optimize_predicate_expression 2022-07-25 12:58:34 +00:00
Antonio Andelic
04b03b6a90 Don't allow to overwrite on startup 2022-07-25 12:38:48 +00:00
Nikolai Kochetov
b70be40804
Merge branch 'master' into use-dag-in-key-condition 2022-07-25 14:30:22 +02:00
Nikolai Kochetov
1ce8e714d3 Fixing build. 2022-07-25 12:30:01 +00:00
Sergei Trifonov
d9d1381c3f Merge branch 'master' into concurrency-control 2022-07-25 14:16:46 +02:00
mergify[bot]
f667eff025
Merge branch 'master' into shell-command-wait-pid-refactoring 2022-07-25 11:42:05 +00:00
mergify[bot]
e53cf7fd9f
Merge branch 'master' into direct-dictionary-dict-has-multiple-same-keys-fix 2022-07-25 11:41:58 +00:00
Alexander Gololobov
dbcb7e5f1e Fix for empty function name on FreeBSD build 2022-07-25 13:11:36 +02:00
Mikhail Filimonov
33ee858d18
Fix bug with maxsplit in the splitByChar 2022-07-25 13:11:02 +02:00
Kruglov Pavel
83c7da6e88
Merge branch 'master' into fix-protobuf-capnp-empty-message 2022-07-25 13:02:41 +02:00
Kruglov Pavel
dd8667d3f9
Update settings description 2022-07-25 13:02:25 +02:00
Igor Nikonov
dc96a6270d Remove optimize_memory_usage flag 
Memory usage with DistinctSortedTransform fixed in #39538
 2022-07-25 10:27:33 +00:00
Robert Schulze
24c74da473
Merge pull request #39430 from azat/getauxval-fix 
Fix LSan by fixing getauxval() (resubmit v4)
 2022-07-25 10:43:09 +02:00
Alexey Milovidov
6fdcb009ff
Merge pull request #39533 from ClickHouse/now-in-block 
Add function `nowInBlock`
 2022-07-25 04:22:11 +03:00
Alexey Milovidov
388d06fda1
Merge pull request #39535 from ClickHouse/stringref 
Less usage of StringRef
 2022-07-25 04:06:11 +03:00