thevar1able/ClickHouse
1
0
Fork 0
mirror of https://github.com/ClickHouse/ClickHouse.git synced 2024-11-19 22:22:00 +00:00
Code Issues Packages Projects Releases Wiki Activity
53,580 Commits 9,144 Branches 1,778 Tags 2 GiB
cc3b5958b0
Commit Graph

8246 Commits

Author SHA1 Message Date
alesapin
12b6a54a24 Merge branch 'master' into try_rewrite_writer 2020-12-14 10:30:01 +03:00
alesapin
fd695c9ff4 Dive into debug 2020-12-14 10:28:42 +03:00
jianmei zhang
f829fbb928 Merge remote-tracking branch 'upstream/master' 2020-12-14 11:21:42 +08:00
jianmei zhang
2169e8f7f4 Fix issue #17160 by adding show settings like '...' 2020-12-14 10:33:51 +08:00
alexey-milovidov
5da9315ceb
Update readFloatText.h 2020-12-14 05:22:17 +03:00
alexey-milovidov
66b2424e33
Update readFloatText.h 2020-12-14 05:20:00 +03:00
Alexey Milovidov
6341521b10 Remove obsolete settings 2020-12-14 02:40:11 +03:00
Maksim Kita
1bccd6dff6 Fixed style issues 2020-12-14 00:50:55 +03:00
Azat Khuzhin
2bf226decc Fix typo in KafkaSettings comments 2020-12-14 00:38:10 +03:00
Maksim Kita
69127ca0ed Changed BlocksList to Blocks 2020-12-14 00:21:25 +03:00
Vitaly Baranov
9310437920 Fix access rights required for the merge() table function. 2020-12-13 23:34:53 +03:00
Maksim Kita
3c6df61e5c MemoryStorage read optimization 2020-12-13 22:24:15 +03:00
alexey-milovidov
8702809c9f
Merge pull request #17464 from amosbird/ddlworkermetric 
ddlworker max entry metric
 2020-12-13 21:28:03 +03:00
Maksim Kita
0be51cbabd Updated tests 2020-12-13 21:27:48 +03:00
alexey-milovidov
d8484d9c31
Merge pull request #18033 from ClickHouse/encode-xml-rename-files 
encodeXMLComponent: rename files after #17659
 2020-12-13 18:28:52 +03:00
alexey-milovidov
cd5f827265
Merge pull request #18047 from kitaisreal/space-saving-remove-last-element-from-map-fix 
HashTable erase added tests
 2020-12-13 18:27:01 +03:00
Alexander Tokmakov
0c80fce7f0 Merge branch 'master' into allow_atomic_database_inside_materialize_mysql 2020-12-13 17:56:50 +03:00
Maksim Kita
5d6036e9c8 Fixed style issues 2020-12-13 14:38:56 +03:00
Maksim Kita
06b047235a Fixed style issues 2020-12-13 14:35:52 +03:00
Maksim Kita
547f452ba9 HashTable erase added tests 2020-12-13 13:30:25 +03:00
alexey-milovidov
bce02de691
Merge pull request #17539 from azat/remerge_sort_lowered_memory_bytes_ratio 
Add remerge_sort_lowered_memory_bytes_ratio setting
 2020-12-13 04:38:50 +03:00
alexey-milovidov
8df4789113
Merge pull request #17845 from kitaisreal/space-saving-remove-last-element-from-map-fix 
SpaceSaving remove last element from map fix
 2020-12-13 04:09:51 +03:00
alexey-milovidov
04e222f6f3
Merge pull request #17986 from azat/fwd-decl 
More forward declaration for generic headers
 2020-12-13 01:12:05 +03:00
Maksim Kita
5ae1652d51 Fixed aggregate function avg 2020-12-13 00:47:17 +03:00
Maksim Kita
b810b28b08 Added comment 2020-12-13 00:40:34 +03:00
Maksim Kita
0dcbcec19a Added tests 2020-12-13 00:29:09 +03:00
Alexey Milovidov
532557ecfd encodeXMLComponent: rename files after #17659 2020-12-12 23:47:37 +03:00
Maksim Kita
18bde6ef02 Fixed compile issues 2020-12-12 23:47:23 +03:00
alexey-milovidov
2eabd41749
Merge pull request #17659 from nautaa/master 
add function to escape charaters for XML
 2020-12-12 23:43:41 +03:00
alexey-milovidov
987725f67b
Merge pull request #17935 from Jokser/disk-s3-remove-empty-metadata-files 
Forcibly removing empty or bad metadata files from FS for DiskS3
 2020-12-12 23:41:35 +03:00
Maksim Kita
3d261c82e9 Array aggregation functions 2020-12-12 22:50:28 +03:00
alexey-milovidov
6f50a86025
Update gtest_hash_table.cpp 2020-12-12 18:57:07 +03:00
Pavel Kovalenko
3f2f663bfa Add [[maybe_unused]] for msg parameter in handle_error_code. 2020-12-12 17:43:11 +03:00
Azat Khuzhin
77a1d00dee Add new remote context as interpreter context to the Pipe 2020-12-12 17:43:10 +03:00
Azat Khuzhin
5b3ab48861 More forward declaration for generic headers 
The following headers are pretty generic, so use forward declaration as
much as possible:
- Context.h
- Settings.h
- ConnectionTimeouts.h
(Also this shows that some missing some includes -- this has been fixed)

And split ConnectionTimeouts.h into ConnectionTimeoutsContext.h (since
module part cannot be added for it, due to recursive build dependencies
that will be introduced)

Also remove Settings from the RemoteBlockInputStream/RemoteQueryExecutor
and just pass the context, since settings was passed only in speicifc
places, that can allow making a copy of Context (i.e. Copier).

Approx results (How much units will be recompiled after changing file X?):

- ConnectionTimeouts.h
  - mainline: 100

- Context.h:
  - mainline: ~800
  - patched:  415

- Settings.h:
  - mainline: 900-1K
  - patched:  440 (most of them because of the Context.h)
 2020-12-12 17:43:10 +03:00
Pavel Kovalenko
25df6bae78 Add nested exception when handle Disk S3 metadata file read error. 2020-12-12 17:11:47 +03:00
Maksim Kita
07c8293043 Added tests 2020-12-12 15:08:46 +03:00
Amos Bird
8d0e949462
ddlworker max entry metric 2020-12-12 14:20:49 +08:00
alexey-milovidov
c74011851a
Update HashTable.h 2020-12-12 04:58:07 +03:00
alexey-milovidov
d94d9aa8d7
Update HashTable.h 2020-12-12 04:17:32 +03:00
alexey-milovidov
9e48b9b656
Update HashTable.h 2020-12-12 03:47:43 +03:00
alexey-milovidov
eba1299845
Update HashTable.h 2020-12-12 03:38:55 +03:00
alexey-milovidov
245dea6f2e
Update HashTable.h 2020-12-12 03:33:57 +03:00
alexey-milovidov
7e2bc1e7a6
Update HashTable.h 2020-12-12 03:30:12 +03:00
alexey-milovidov
6e7366f921
Update HashTable.h 2020-12-12 03:28:41 +03:00
alexey-milovidov
e00b99ffe9
Update encodeXML.cpp 2020-12-12 03:09:11 +03:00
alexey-milovidov
b96316f0c4
Update encodeXML.cpp 2020-12-12 03:06:09 +03:00
alexey-milovidov
93985e6645
Update encodeXML.cpp 2020-12-12 03:05:35 +03:00
alexey-milovidov
0d6fe7121d
Merge pull request #17887 from sundy-li/trivial_count-fix 
disable optimize_trivial_count in query with array join
 2020-12-12 02:44:07 +03:00
alexey-milovidov
adbe8e1ebb
Merge pull request #17903 from ClickHouse/attach_table_from_path 
Implement ATTACH TABLE name FROM 'path/to/data/'
 2020-12-12 02:42:53 +03:00
alexey-milovidov
932493f12e
Merge pull request #17982 from azat/build 
Tiny build changes
 2020-12-12 02:37:14 +03:00
alexey-milovidov
fb9d05e93b
Merge pull request #17988 from ClickHouse/aku/remove-includes 
Remove some redundant includes to speed up build
 2020-12-12 02:32:27 +03:00
alexey-milovidov
8d8496a653
Merge pull request #18005 from ClickHouse/filimonov-log-verbosity-client-go-away 
Decrease log verbosity of disconnecting clients
 2020-12-12 02:25:13 +03:00
Alexander Kuzmenkov
dcc4b5609f fixup 2020-12-11 21:16:26 +03:00
Alexander Kuzmenkov
a2886cdfa5 Merge remote-tracking branch 'origin/master' into HEAD 2020-12-11 18:57:47 +03:00
Alexander Kuzmenkov
d54d96701a fixup 2020-12-11 18:57:26 +03:00
Pavel Kovalenko
59a5e63417 Merge remote-tracking branch 'origin/master' into s3-adaptive-single-part-upload 
# Conflicts:
#	src/Disks/S3/DiskS3.cpp
#	src/Disks/S3/DiskS3.h
#	src/Disks/S3/registerDiskS3.cpp
#	src/IO/WriteBufferFromS3.cpp
#	src/IO/WriteBufferFromS3.h
 2020-12-11 18:28:41 +03:00
Pavel Kovalenko
72a55c192e Fix master branch merge artifact. 2020-12-11 18:23:59 +03:00
Pavel Kovalenko
75bdb813ea Merge remote-tracking branch 'origin/master' into disk-s3-remove-empty-metadata-files 
# Conflicts:
#	src/Disks/S3/DiskS3.cpp
 2020-12-11 18:22:31 +03:00
alesapin
a24a76828e Fix 2020-12-11 18:18:51 +03:00
alesapin
4b83707c63 Compileable code for some reason 2020-12-11 18:00:58 +03:00
Nikita Mikhaylov
f1a145a2b2
Merge pull request #17984 from nikitamikhaylov/fix-arcadia-second 
Fix arcadia
 2020-12-11 17:56:19 +03:00
Amos Bird
c6ac831d4e
Fix type 2020-12-11 22:44:22 +08:00
Kruglov Pavel
a8c1d17f83
Merge pull request #16935 from ucasFL/agg-func-setting-null-for-empty 
`aggregate_functions_null_for_empty` move OrNull ahead
 2020-12-11 17:11:39 +03:00
Kruglov Pavel
6300cd285f
Merge pull request #17909 from Jokser/disk-s3-send-metadata 
Ability to set metadata when put S3 object
 2020-12-11 17:01:14 +03:00
Maksim Kita
b70b98c415 Fix style issues 2020-12-11 16:54:08 +03:00
Maksim Kita
4ae5619714 Optimized erase in HashTable 2020-12-11 16:54:08 +03:00
Maksim Kita
bf5d75853c Added erase into HashTable 2020-12-11 16:54:08 +03:00
Maksim Kita
d8b78682e1 SpaceSaving remove last element from map fix 2020-12-11 16:54:08 +03:00
Vitaly Baranov
1b3893bcab User with allow_ddl=0 cannot do DDL but can grant DDL. 2020-12-11 16:38:49 +03:00
Vitaly Baranov
648be453a4 User with allow_introspection_functions=0 cannot call introspection functions but can grant INTROSPECTION. 2020-12-11 16:38:49 +03:00
Vitaly Baranov
710ba6f617 Simplify class ContextAccess. 2020-12-11 16:38:45 +03:00
alesapin
57c30c4164 Garbage 2020-12-11 16:20:19 +03:00
Alexander Tokmakov
58a31e4882 Merge branch 'master' into allow_atomic_database_inside_materialize_mysql 2020-12-11 16:14:03 +03:00
Alexander Tokmakov
f9f7da5f97 fix 2020-12-11 15:06:19 +03:00
Pavel Kovalenko
de4a7a8865 Correct handling S3 disk metadata file read exceptions. 2020-12-11 14:27:58 +03:00
Pavel Kovalenko
5bf388683c Correct handling S3 disk metadata file read exceptions. 2020-12-11 14:21:54 +03:00
filimonov
8d9ad60afa
Decrease verbosity of disconnecting clients 
Right now they go to error log.
 2020-12-11 11:51:48 +01:00
Alexander Kuzmenkov
fb1221148d
Merge pull request #17748 from azat/custom-TLD 
Add ability to use custom TLD list
 2020-12-11 12:42:19 +03:00
alesapin
7ffd76a605 Fix bug 2020-12-11 11:41:02 +03:00
nauta
00dc104025 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse 2020-12-11 16:15:40 +08:00
alesapin
cbba73672e Merge branch 'master' into try_rewrite_writer 2020-12-11 11:09:47 +03:00
Amos Bird
5b1e5679b4
Add -SimpleState combinator 2020-12-11 11:43:56 +08:00
feng lv
3ee6b6382b fix 
fix
 2020-12-11 02:00:18 +00:00
Alexander Kuzmenkov
d757f32300 Remove some redundant includes to speed up build 2020-12-11 02:58:11 +03:00
nikitamikhaylov
b6d69eb63b done 2020-12-11 02:16:21 +03:00
Azat Khuzhin
d5b62ab26d build: use -Wno-c++2a-compat over -Wno-c++20-compat (since -std=c++2a) 2020-12-11 01:32:38 +03:00
Azat Khuzhin
2a814afd85 build: re-enable jobs limits 2020-12-11 01:32:38 +03:00
alexey-milovidov
2fb7ce8340
Revert "Date vs DateTime64 comparison" 2020-12-11 01:09:01 +03:00
Nikita Mikhaylov
77df818c5f
Merge pull request #17963 from nikitamikhaylov/fix-arcadia 
Use ryu instead of dragonbox in Arcadia
 2020-12-11 00:15:02 +03:00
alexey-milovidov
f7d1441858
Update WriteHelpers.h 2020-12-11 00:09:52 +03:00
alexey-milovidov
7f4b5a0d1b
Merge pull request #17854 from weeds085490/dev/add_diag_info_when_circle_in_merge 
add diagnostic information when two merge tables try to read each oth…
 2020-12-10 22:56:34 +03:00
alexey-milovidov
c35c52be87
Merge pull request #17867 from ucasFL/mergetree-setting 
Add settings `min_compress_block_size` and `max_compress_block_size` to MergeTreeSettings
 2020-12-10 22:54:05 +03:00
alexey-milovidov
f1ee1ef16a
Update MergeTreeSettings.h 2020-12-10 22:50:54 +03:00
nikitamikhaylov
17310c6c50 fix-arcadia 2020-12-10 21:08:16 +03:00
Kruglov Pavel
9a785dbbf5
Merge branch 'master' into disk-s3-send-metadata 2020-12-10 20:17:41 +03:00
tavplubix
60aef3d529
Merge pull request #17944 from zhang2014/fix/ISSUES-15187 
ISSUES-15187 support convert MySQL prefix index for MaterializeMySQL
 2020-12-10 19:42:38 +03:00
alesapin
1cb06bd975 Split one method 2020-12-10 19:29:10 +03:00
tavplubix
5f78280aec
Merge pull request #17915 from zhang2014/better_exception_message 
Better exception message for MaterializeMySQL
 2020-12-10 19:26:20 +03:00
alesapin
90fa9a2073 Merge branch 'master' into try_rewrite_writer 2020-12-10 18:36:10 +03:00
nikitamikhaylov
955033d6a1 done 2020-12-10 16:18:37 +03:00
alesapin
f3d1dc360c Fix style 2020-12-10 12:24:52 +03:00
alesapin
0704b478ee Less constuctors 2020-12-10 12:22:43 +03:00
Vladimir Chebotarev
39d867e56d
Added proper authentication for S3 client (#16856) 2020-12-10 12:19:42 +03:00
alesapin
2787b615b0 Make interface as simple as possible 2020-12-10 11:57:52 +03:00
alesapin
dd9f4bfc8a
Merge pull request #16877 from ClickHouse/complete_zk_api 
Fake in-memory ZooKeeper server inside ClickHouse
 2020-12-10 10:47:54 +03:00
Nikita Mikhaylov
80d4af9a73
Merge pull request #17874 from nikitamikhaylov/calendar-date 
Merging #17750
 2020-12-10 00:19:04 +03:00
tavplubix
f13de96afc
Merge pull request #17366 from zhang2014/fix/ISSUES-16835 
ISSUES-16835 try fix miss match header with MySQL SHOW statement
 2020-12-09 23:12:47 +03:00
alesapin
fef65b0cbd
Merge pull request #17919 from ClickHouse/additional_size_check 
Add additional columns size check for MergeTree in debug mode
 2020-12-09 22:40:06 +03:00
zhang2014
88798f201b ISSUES-15187 support prefix index 2020-12-10 02:50:56 +08:00
alesapin
7979b3655c Better formating 2020-12-09 21:22:07 +03:00
alesapin
3b88c077ed Mechanical refactoring 2020-12-09 21:19:49 +03:00
alesapin
af73db93e6 Mechanical refactoring 2020-12-09 21:10:09 +03:00
Azat Khuzhin
840a21d073 Add top_level_domains_path for easier overriding 2020-12-09 21:08:31 +03:00
Azat Khuzhin
c987be632f Switch TLDList to StringHashSet (to avoid errors on collisions) 2020-12-09 21:08:30 +03:00
Azat Khuzhin
89cb2185a8 Fix StringHashTable move constructor 2020-12-09 21:08:30 +03:00
Azat Khuzhin
8a0487b1af Add StringHashSet 2020-12-09 21:08:30 +03:00
Azat Khuzhin
916cbd6610 Add ability to use custom TLD list 
v2: Add a note that top_level_domains_lists aren not applied w/o restart
v3: Remove ExtractFirstSignificantSubdomain{Default,Custom}Lookup.h headers
v4: TLDListsHolder: remove FIXME for dense_hash_map (this is not significant)
 2020-12-09 21:08:22 +03:00
Pavel Kovalenko
5802633f95 Fix parameter name in constructor of DiskS3 2020-12-09 18:38:02 +03:00
nikitamikhaylov
b13873356c also style 2020-12-09 18:30:44 +03:00
alesapin
850f903d40 Merge branch 'master' into complete_zk_api 2020-12-09 18:18:38 +03:00
Vasily Nemkov
a2f85a03f3 Enforcing all sorting keys to be present in DEDUPLICATE BY columns 
Updated test and minor cleanup
 2020-12-09 18:08:37 +03:00
Pavel Kruglov
c8c543ca94 Add throwing exceptions 2020-12-09 18:07:58 +03:00
Pavel Kovalenko
818cdd353a Remove empty or bad metadata files from FS for DiskS3. 2020-12-09 18:01:30 +03:00
Pavel Kovalenko
db7a87089b Adaptive choose of single/multi part upload in WriteBufferFromS3. 2020-12-09 17:09:04 +03:00
alesapin
4d1f528806
Merge pull request #17918 from ClickHouse/revert-17120-fix_granularity_on_block_borders 
Revert "Fix index granularity calculation on block borders"
 2020-12-09 14:46:56 +03:00
alesapin
b307e545a9 Fix check 2020-12-09 14:46:04 +03:00
alesapin
0f4056fd95 Add additional size check in debug mode 2020-12-09 14:23:37 +03:00
Nikolai Kochetov
6a9e1ce436
Merge pull request #17895 from Enmk/DateTime64_DateTime_comparison 
Date vs DateTime64 comparison
 2020-12-09 14:22:26 +03:00
alesapin
7783ddb3af
Revert "Fix index granularity calculation on block borders" 2020-12-09 14:05:48 +03:00
feng lv
91c3de9664 fix 
fix

fix
 2020-12-09 09:13:51 +00:00
nauta
15eb2addd1 fix encodeXML 2020-12-09 16:55:03 +08:00
zhang2014
bf30aa5ff1 Code style 2020-12-09 16:50:40 +08:00
zhang2014
ef15b1f1fb Better exception message for MaterializeMySQL 2020-12-09 16:46:54 +08:00
alesapin
758dcd1972 Separate factory for test keeper handlers 2020-12-09 11:45:36 +03:00
alesapin
7ff50fb352 Close requests without timeout 2020-12-09 11:19:52 +03:00
zhang2014
2f735aa61d ISSUES-16835 try fix review comment 2020-12-09 16:19:09 +08:00
nauta
12f1ebdc00 fix encodeXML 2020-12-09 15:08:12 +08:00
nauta
c05ca054c1 fix encodeXML 2020-12-09 12:40:11 +08:00
feng lv
e95e443246 fix 
fix
 2020-12-09 04:32:28 +00:00
feng lv
9b2bb1820a Merge branch 'master' of github.com:ClickHouse/ClickHouse into agg-func-setting-null-for-empty 2020-12-09 02:28:49 +00:00
alexey-milovidov
e127636a4b
Merge pull request #16787 from kitaisreal/fast-float-integration 
FastFloat library integration
 2020-12-08 21:34:34 +03:00
Pavel Kovalenko
dfbb31174e Ability to set metadata when put S3 object 2020-12-08 21:31:57 +03:00
nikitamikhaylov
95ce4bc54c style 2020-12-08 21:28:18 +03:00
Vitaly Baranov
f6f336ac78
Merge pull request #17888 from vitlibar/retrieve-logs-from-grpc 
Retrieve logs from grpc
 2020-12-08 20:54:02 +03:00
nikitamikhaylov
e3a9cae4c5 better 2020-12-08 20:43:43 +03:00
Vasily Nemkov
59fc301344 Fixed test to be less flaky 
Also logging expanded list of columns passed from `DEDUPLICATE BY` to actual deduplication routines.
 2020-12-08 19:44:34 +03:00
Kruglov Pavel
291959c1b3
Update comment 2020-12-08 19:19:51 +03:00
nikitamikhaylov
71e9a8d9d0 build 2020-12-08 18:40:32 +03:00
alesapin
3d0dbbe411 Fix build 2020-12-08 17:49:18 +03:00
alesapin
91e3162e09 More correct session close 2020-12-08 17:28:51 +03:00
Vasily Nemkov
0c2d73adcb Fixed comparing Date and DateTime64 2020-12-08 17:17:02 +03:00
Alexander Tokmakov
04ceaa66f2 implement ATTACH TABLE name FROM 'path/to/data/ 2020-12-08 17:15:23 +03:00
Ivan
0ba712a2d3
Merge branch 'master' into allow_atomic_database_inside_materialize_mysql 2020-12-08 16:45:51 +03:00
alesapin
f4231d552e Banch of fixes 2020-12-08 16:28:39 +03:00
nauta
ab5f397022 add encodeXMLComponent function 2020-12-08 21:02:09 +08:00
Kruglov Pavel
e19eb6f17a
Merge branch 'master' into optimize-data-on-insert 2020-12-08 15:57:46 +03:00
alexey-milovidov
d9b52f94f7
Merge pull request #17637 from amosbird/buildid 
reload symbols and fix build-id
 2020-12-08 14:55:35 +03:00
alexey-milovidov
ab10cb4bf9
Merge pull request #17707 from ClickHouse/quota-by-x-forwarded-for 
Allow quotas to be keyed by proxy-forwarded IP address; add support for PROXY protocol
 2020-12-08 14:48:05 +03:00
Vasily Nemkov
8c5daf0925 Fixed building tests with GCC-10 
Also a minor cleanup of the test code.
 2020-12-08 13:15:18 +03:00
Nikolai Kochetov
7d77a7ba24
Merge pull request #16952 from Enmk/DateTime64_fixes_comparison 
Fixed comparison of DateTime64 with different scales
 2020-12-08 12:40:41 +03:00
sundy-li
d9176263aa disable optimize_trivial_count in query with array join 2020-12-08 16:00:12 +08:00
Winter Zhang
972cb41fae
Merge branch 'master' into fix/ISSUES-16835 2020-12-08 15:32:58 +08:00
Alexey Milovidov
4ecfe8fef4 Remove unused headers 2020-12-08 02:10:22 +03:00
alexey-milovidov
a7324f8b4c
Update InterpreterSystemQuery.cpp 2020-12-08 00:12:09 +03:00
Vitaly Baranov
559afe028f Retrieve logs from grpc library and pass them to our logging system. 2020-12-07 23:39:55 +03:00
Amos Bird
08675028e5
fix build 2020-12-08 01:40:49 +08:00
Maksim Kita
a9a6517291 Fixed style 2020-12-07 19:26:38 +03:00
alesapin
b5d2559626
Merge pull request #17709 from kssenii/better-startup 
rabbitmq: fix startup with no connection
 2020-12-07 19:08:18 +03:00
nikitamikhaylov
a8616ea262 better 2020-12-07 18:47:57 +03:00
Alexey Milovidov
1ed329017b Merge branch 'master' into quota-by-x-forwarded-for 2020-12-07 18:22:19 +03:00
Vasily Nemkov
168155eeec Minor: cleanup 2020-12-07 18:07:40 +03:00
Vasily Nemkov
dbdc018ab8 Fixed and refined unite-test 
* no more undefined values for attributes in ReplicatedMergeTreeLogEntry
* validation of string serialization format
 2020-12-07 17:38:25 +03:00
Maksim Kita
b0afa8488d Updated parse float precise implementation 2020-12-07 17:23:02 +03:00
feng lv
50b64ba1f8 fix 2020-12-07 13:18:31 +00:00
feng lv
87bdf028fd fix conflict 2020-12-07 13:14:22 +00:00
PHO
3c90065158 Add functions toMJD and fromMJD 
These functions convert between Proleptic Gregorian calendar date and Modified Julian Day number.
 2020-12-07 16:00:32 +03:00
PHO
8ce936af2c Add a missing #include <memory> 
GCC fails to compile this due to std::unique_ptr not being declared.
 2020-12-07 16:00:32 +03:00
feng lv
d7b30f74d1 add min-max_compress_block_size to mergetree settings 2020-12-07 12:47:51 +00:00
Maksim Kita
c3864d2fbf Updated contrib CMakeLists 2020-12-07 14:08:19 +03:00
Vasily Nemkov
957bbfc7b0 Fixed parsing invalid cases: prohibit empty lists and APPLY/REPLACE column transformers 2020-12-07 13:18:54 +03:00
alesapin
57f40e4260
Merge pull request #17458 from ClickHouse/merge-expressions 
Merge expressions
 2020-12-07 12:34:19 +03:00
alesapin
0c43246216 Merge branch 'master' into complete_zk_api 2020-12-07 10:24:55 +03:00
root
e07374331a add diagnostic information when two merge tables try to read each other's data 2020-12-07 15:23:58 +08:00
Vasily Nemkov
70ea507dae OPTIMIZE DEDUPLICATE BY columns 
Extended OPTIMIZE ... DEDUPLICATE syntax to allow explicit (or implicit with asterisk/column transformers) list of columns to check for duplicates on.

Following syntax variants are now supported:

OPTIMIZE TABLE table DEDUPLICATE; -- the old one
OPTIMIZE TABLE table DEDUPLICATE BY *;
OPTIMIZE TABLE table DEDUPLICATE BY * EXCEPT colX;
OPTIMIZE TABLE table DEDUPLICATE BY * EXCEPT (colX, colY);
OPTIMIZE TABLE table DEDUPLICATE BY col1,col2,col3;
OPTIMIZE TABLE table DEDUPLICATE BY COLUMNS('column-matched-by-regex');
OPTIMIZE TABLE table DEDUPLICATE BY COLUMNS('column-matched-by-regex') EXCEPT colX;
OPTIMIZE TABLE table DEDUPLICATE BY COLUMNS('column-matched-by-regex') EXCEPT (colX, colY);

Note that * behaves just like in SELECT: MATERIALIZED, and ALIAS columns are not used for expansion.
Also, it is an error to specify empty list of columns, or write an expression that results in an empty list of columns, or deduplicate by an ALIAS column.
Column transformers other than EXCEPT are not supported.
 2020-12-07 09:44:07 +03:00
alexey-milovidov
4df1983d64
Merge pull request #17571 from vdimir/ip-dict-accept-alias 
IP dictionary works with aliased types `IPv4` and `IPv6` (close #6804)
 2020-12-07 02:19:32 +03:00
Alexey Milovidov
a63d4f0db3 Merge branch 'master' into amosbird-buildid 2020-12-07 02:17:29 +03:00
alexey-milovidov
f0800a070d
Merge pull request #17700 from ClickHouse/tavplubix-patch-3 
Fix sequential number in TestKeeper
 2020-12-07 02:13:04 +03:00
Azat Khuzhin
c3a4e5e7b7 Fix max_distributed_connections (one more time) 
With prefer_localhost_replica=1 max_distributed_connections uses
max_threads before this patch.

Fixes: #14936
Previous fix: #9673
 2020-12-07 01:19:53 +03:00
Maksim Kita
5b57c59a3b Updated fast_float integration 2020-12-06 23:37:55 +03:00
Maksim Kita
b6bfb1cf20 Use fast_float by default 2020-12-06 23:37:36 +03:00
Maksim Kita
5f410718ca Fix marker check 2020-12-06 23:37:35 +03:00
Maksim Kita
ccbfd52315 Fixed compile issues 2020-12-06 23:37:35 +03:00
Maksim Kita
095137b9f7 FastFloat conditional replace precise parsing 2020-12-06 23:37:35 +03:00
Maksim Kita
87c50602bc Fast float updated implementation 2020-12-06 23:37:35 +03:00
Maksim Kita
7d97f23db4 Fixed point 2020-12-06 23:37:35 +03:00
Maksim Kita
80d66b8868 FastFloat library integration 2020-12-06 23:37:35 +03:00
alexey-milovidov
7df72c79f1
Merge pull request #17606 from ClickHouse/boringssl-2 
Port ClickHouse code to BoringSSL
 2020-12-06 23:00:22 +03:00
alexey-milovidov
878864602c
Merge pull request #17831 from kitaisreal/dragonbox-integration 
DragonBox integration
 2020-12-06 22:58:56 +03:00
alexey-milovidov
a3bcf60298
Merge pull request #17833 from ucasFL/fix-maxs 
fix incorrect initialize MergeTreeWriterSettings
 2020-12-06 16:43:16 +03:00
alexey-milovidov
614420feb9
Merge pull request #17794 from excitoon-favorites/s3testiostream 
Attempt to use IOStream in AWS SDK
 2020-12-06 16:42:12 +03:00
nauta
8e615a1d8d Merge remote-tracking branch 'upstream/master' 2020-12-06 20:48:47 +08:00
Maksim Kita
977da3d052 Removed ryu 2020-12-06 15:39:39 +03:00
feng lv
a634e4ed80 fix incorrect initialize MergeTreeWriterSettings 2020-12-06 08:57:02 +00:00
kssenii
8f1ed36897 Fix races 2020-12-06 00:24:49 +00:00
Maksim Kita
64549702a2 DragonBox integration 2020-12-06 00:32:03 +03:00
Anton Popov
ce03a896a1 remove unused files 2020-12-05 22:51:16 +03:00
Anton Popov
7aaa2c052f
Merge branch 'master' into merging-map 2020-12-05 22:41:46 +03:00
Anton Popov
6b09669d66 data type map: several fixes 2020-12-05 22:36:09 +03:00
alesapin
27c3301083
Merge pull request #17800 from nvartolomei/nv/waitForAllReplicasToProcessLogEntry-foreign-shard 
Update StorageReplicatedMergeTree::waitForAllReplicasToProcessLogEntry to support waiting on foreign shards / tables
 2020-12-05 16:15:46 +03:00
alesapin
0eec52b1fd
Merge pull request #17737 from ClickHouse/fix_segfault_in_distributed_out_stream 
Fix segfault when 'not enough space'
 2020-12-05 16:14:30 +03:00
Anton Popov
d1ef6a897e
Merge pull request #17802 from detailyang/patch-1 
hotfix:check in_memory_parts_enable_wal
 2020-12-05 03:05:38 +03:00
Anton Popov
60b0cbb1c1
Merge pull request #15939 from Avogar/optimize_final_optimization 
Optimize final optimization
 2020-12-05 02:26:27 +03:00
Alexander Kuzmenkov
b54d50fa7f
Merge pull request #17459 from azat/countMatches-pull 
Add countMatches function
 2020-12-05 00:01:47 +03:00
Pavel Kruglov
5ae6c6dab9 Fix build error 2020-12-04 20:40:28 +03:00
Pavel Kruglov
4b58528b9e Rename getPos to getRow, change mergeBlock, pass setting instead of context 2020-12-04 19:25:30 +03:00
Pavel Kruglov
905ba78adc Merge branch 'master' of github.com:ClickHouse/ClickHouse into optimize-data-on-insert 2020-12-04 18:56:46 +03:00
detailyang
e7a151fd1e
hotfix:check in_memory_parts_enable_wal 2020-12-04 23:14:27 +08:00
kssenii
448463ebe0 Better 2020-12-04 14:50:42 +00:00
alesapin
42544a9833 Merge branch 'master' into fix_segfault_in_distributed_out_stream 2020-12-04 17:41:10 +03:00
Pavel Kruglov
9dbced0474 Pass setting instead of context 2020-12-04 17:01:59 +03:00
alesapin
278bbf6d51 Merge branch 'master' into complete_zk_api 2020-12-04 16:48:19 +03:00
alesapin
ac118feef0 Merge branch 'master' into boringssl-2 2020-12-04 16:24:20 +03:00
Nicolae Vartolomei
796aee032d Update StorageReplicatedMergeTree::waitForAllReplicasToProcessLogEntry to support waiting on foreign shards / tables 
This is not used anywhere yet but needed for an upcoming PR for part movement between shards.
 2020-12-04 13:01:12 +00:00
Ilya Yatsishin
2e9f10ab3e
Merge pull request #17767 from bharatnc/ncb/refact-zk-path 
Improve zookeeper path concatenation inside DDLWorker
 2020-12-04 14:34:05 +03:00
Vladimir Chebotarev
a5e3d89649 Attempt to use IOStream in AWS SDK. 2020-12-04 13:37:08 +03:00
alexey-milovidov
07f914769e
Merge pull request #17739 from spongedu/check_systemlog_table_engine_define 
add check for systemlog tables' engine definition
 2020-12-04 13:01:17 +03:00
philip.han
93ec2db45b Fix typo 2020-12-04 18:24:42 +09:00
Nikolai Kochetov
e57ad9cb7e
Update QueryPlan.cpp 2020-12-04 11:41:36 +03:00
Ivan
315ff4f0d9
ANTLR4 Grammar for ClickHouse and new parser (#11298) 2020-12-04 05:15:44 +03:00
Ivan
6a48d25b74
Fix arcadian build (#17781) 2020-12-04 02:32:17 +03:00
bharatnc
a8fea625ae simplify path concat 2020-12-03 10:29:32 -08:00
bharatnc
d05d7e8b06 fix missing import 2020-12-03 09:08:17 -08:00
bharatnc
0efe16f9ce concatenate paths using fs::path 2020-12-03 09:04:24 -08:00
Alexey Milovidov
a2eb7c96df Fix ugly bug 2020-12-03 19:51:27 +03:00
bharatnc
44e8e30bf1 removed unused imports 2020-12-03 08:43:22 -08:00
kssenii
f16d6a4128 Better 2020-12-03 14:11:35 +00:00
Anton Popov
cab9855dd1
Update StorageReplicatedMergeTree.cpp 2020-12-03 16:54:05 +03:00
Anton Popov
cd1917c7a6
Merge branch 'master' into optimize_final_optimization 2020-12-03 16:52:51 +03:00
alexey-milovidov
9d7667dada
Update ReadHelpers.h 2020-12-03 16:24:32 +03:00
Alexey Milovidov
50fe5f9211 Added note 2020-12-03 00:09:46 +03:00
Alexey Milovidov
3e2447391b Support for PROXY protocol 2020-12-03 00:05:51 +03:00
alexey-milovidov
85f4045160
Merge pull request #17144 from fibersel/issue-16791 
introduce zstd compression (for data import/export)
 2020-12-02 22:41:07 +03:00
Alexey Milovidov
2c7b03ab6e Fix error 2020-12-02 22:20:47 +03:00
kssenii
ebab21178e Fix, add test 2020-12-02 18:45:30 +00:00
Azat Khuzhin
5365718f01
Fix optimize_distributed_group_by_sharding_key for query with OFFSET only (#16996) 
* Fix optimize_distributed_group_by_sharding_key for query with OFFSET only

* Fix 01244_optimize_distributed_group_by_sharding_key flakiness
 2020-12-02 20:11:39 +03:00
spongedc
b13c381d7e add log for systemlog tables' engine definition check 2020-12-03 01:02:37 +08:00
spongedc
7f723eb780 add check for systemlog tables' engine definition 2020-12-03 00:45:17 +08:00
Alexander Tokmakov
a0ef3a113a Merge branch 'master' into allow_atomic_database_inside_materialize_mysql 2020-12-02 18:29:02 +03:00
Alexander Tokmakov
bfbf150c67 fix segfault when 'not enough space' 2020-12-02 17:49:43 +03:00
tavplubix
45b4b3648c
Merge pull request #17664 from ClickHouse/tavplubix-patch-2 
Fix renameat2 ENOSYS on WSL
 2020-12-02 13:55:50 +03:00
tavplubix
88bc73df3a fix seq number in TestKeeper 2020-12-02 12:38:55 +03:00
nautaa
4cc56c2501 rename function name 2020-12-02 17:00:27 +08:00
alesapin
93ea2f5b1f Merge branch 'master' into complete_zk_api 2020-12-02 11:30:09 +03:00
kssenii
8d3a538629 Better startup 2020-12-02 01:17:50 +00:00
Alexey Milovidov
c9aa412151 Allow quotas to be keyed by proxy-forwarded IP address 2020-12-02 00:09:16 +03:00
Azat Khuzhin
737357418f Fix and optimize countMatches()/countMatchesCaseInsensitive() 
- Update after IFunction interfaces changes
- move type checks into FunctionCountMatches::getReturnTypeImpl()
- Use StringRef over String
- Separate out logic for counting sub matches into separate helper
- Do not copy other regular expression matches, only the first
- Add some comments
- Set is_no_capture, to avoid check for number of subpatterns
- Add countMatchesCaseInsensitive()
- Reguster functions in case-sensitive manner, since this is not SQL
  standard
 2020-12-01 22:25:26 +03:00
alexey-milovidov
a43e739949
Merge pull request #17685 from georgthegreat/patch-3 
Use feature testing macro once more
 2020-12-01 22:04:05 +03:00
Azat Khuzhin
0004fd8ab9 Merge remote-tracking branch 'upstream/pr/16277' into countMatches-pull 2020-12-01 21:03:33 +03:00
alexey-milovidov
f25adea3b9
Merge pull request #17658 from azat/MemoryTracker-nested-blocking 
Make LockExceptionInThread/BlockerInThread nested
 2020-12-01 20:53:10 +03:00
tavplubix
a908b2d653
Merge pull request #17640 from ClickHouse/fix_ddl_worker_is_circular 
Fix race on DDLWorker::is_circular_replicated
 2020-12-01 17:43:21 +03:00
Yuriy Chernyshov
6c830e629e
Use feature testing macro once more 2020-12-01 17:06:41 +03:00
Alexander Kuzmenkov
5ad15e2018
Merge pull request #17109 from azat/perf-AggregatingMergeTree-INSERT 
Improve performance of AggregatingMergeTree w/ SimpleAggregateFunction(String) in PK
 2020-12-01 16:27:36 +03:00
Alexander Kuzmenkov
12d1fa6456
Merge pull request #17438 from spongedu/add_ttl_option_for_syslog 
Support configure System log table`s ttl in config.xml
 2020-12-01 16:03:06 +03:00
Anton Popov
12604ce0e6 Merge branch 'dev_map2' of git://github.com/hexiaoting/ClickHouse into merging-map 2020-12-01 14:52:30 +03:00
tavplubix
21bbc7bc19
Merge pull request #17615 from ClickHouse/fix-logging 
Fix logging in MergeTree
 2020-12-01 14:26:25 +03:00
Nikolai Kochetov
d9773942a2 Rewiev fixes. 2020-12-01 14:19:03 +03:00
tavplubix
88133860d7
Update renameat2.cpp 2020-12-01 13:22:29 +03:00
nautaa
eb0c442763 add function to escape charaters for HTML 2020-12-01 16:32:09 +08:00
Azat Khuzhin
0bf6ed2e94 Make LockExceptionInThread/BlockerInThread nested 2020-12-01 10:34:25 +03:00
alexey-milovidov
2644f446ab
Merge pull request #17453 from azat/memory-tracking-exception-locking 
Do not allow to throw MEMORY_LIMIT_EXCEEDED if there is uncaught exception
 2020-12-01 10:25:17 +03:00
Azat Khuzhin
9c801239cf
Better description of costly ArenaAllocChunks in AggregatingSortedAlgorithm 
Co-authored-by: Alexander Kuzmenkov <36882414+akuzm@users.noreply.github.com>
 2020-12-01 00:52:12 +03:00
Vasily Nemkov
87945fb68b Merge branch 'master' into HEAD 2020-11-30 23:25:57 +03:00
spongedc
9e995d9756 1.make ttl option more generic 2. add check if engine specified for system log 2020-12-01 00:29:36 +08:00
Alexander Tokmakov
fe7c3cb865 fix race on is_circular_replicated 2020-11-30 18:31:02 +03:00
Alexander Kuzmenkov
7b53637178
Merge pull request #17621 from ClickHouse/aku/ot-test-fix 
Fix the OpenTelemetry test
 2020-11-30 18:28:27 +03:00
spongedc
d96600678d Merge remote-tracking branch 'origin/master' into add_ttl_option_for_syslog 2020-11-30 22:53:52 +08:00
Amos Bird
310918b06a
reload symbols and fix build-id 2020-11-30 22:30:55 +08:00
Alexander Kuzmenkov
c5a81f6172
Merge pull request #17437 from vitlibar/add-new-constants-to-client-info-interface 
Add constants to ClientInfo::Interface for MySQL and PostgreSQL protocols
 2020-11-30 17:02:30 +03:00
tavplubix
db3918d88d
Merge pull request #16861 from Jokser/disk-s3-proxy-tunnel-mode 
Support HTTP proxy and HTTPS S3 endpoint configuration
 2020-11-30 16:05:12 +03:00
Anton Popov
115574163e
Merge pull request #16937 from satanson/master 
A very fast O(logn) repeat impl
 2020-11-30 15:14:51 +03:00
Alexander Kuzmenkov
d9dd9341ce Fix the OpenTelemetry test 2020-11-30 12:11:17 +03:00
Alexey Milovidov
6590fdfdd2 Fix logging 2020-11-30 11:44:01 +03:00
alesapin
6d2a007b79 Merge branch 'master' into complete_zk_api 2020-11-30 10:58:25 +03:00
alesapin
25f40db2fb
Merge pull request #17499 from ClickHouse/concurrent_mutation_and_random_kill 
Fix kill mutation on concurrent alter queries
 2020-11-30 10:51:50 +03:00
Alexey Milovidov
e42ff1ae02 Port ClickHouse code to BoringSSL 2020-11-30 10:01:55 +03:00
Alexey Milovidov
af5e2084ff Port ClickHouse code to BoringSSL 2020-11-30 09:59:35 +03:00
alexey-milovidov
df90cbd7d3
Merge pull request #17563 from ClickHouse/parser-alter-missing-code 
Allow query parameters in UPDATE statement.
 2020-11-30 09:38:14 +03:00
Azat Khuzhin
ccd794a676 Add remerge_sort_lowered_memory_bytes_ratio setting 
Sometimes default ratio is not good enough (2), since it depends on lots
of factors:
- size of LIMIT
- max_memory_usage
- ...

So add a separate setting for it.

But note that it make sense to set
remerge_sort_lowered_memory_bytes_ratio only in range (1, 2]

Since <= 1 will just use more CPU, and > 2 will use more RAM and will
unlikely be faster.
 2020-11-29 21:16:42 +03:00
alexey-milovidov
038a56d243
Merge pull request #16951 from CurtizJ/fix-groupby-optimization 
Fix optimization with 'optimize_aggregators_of_group_by_keys' and joins
 2020-11-29 20:47:16 +03:00
alexey-milovidov
49af4ff7c9
Merge pull request #16988 from CurtizJ/fix-perf-storage-merge 
Fix performance with Merge table over huge number of MergeTree tables
 2020-11-29 20:46:29 +03:00
alexey-milovidov
1c7844b91e
Merge pull request #16956 from CurtizJ/fix-order-by 
Fix order by optimization with monotonous functions
 2020-11-29 20:45:47 +03:00
alexey-milovidov
51f159201b
Merge pull request #17536 from azat/fix-toUnixTimestamp-Date-error 
Fix toUnixTimestamp(Date()) error (use type name not column type name)
 2020-11-29 18:19:55 +03:00
Alexey Milovidov
7d79a3cc35 Make insert_quorum_parallel by default 2020-11-29 18:13:57 +03:00
Alexey Milovidov
2e6bedce91 Relax "Too many parts" threshold, part 1 2020-11-29 18:08:02 +03:00
Alexey Milovidov
4a66db1bf4 Fix #10976 2020-11-29 16:43:24 +03:00
Alexey Milovidov
f9b1e77808 ParserAlterQuery: fix strange code 2020-11-29 16:30:16 +03:00
a.palagashvili
1e71725143 fix typo 2020-11-29 16:02:04 +03:00
a.palagashvili
08b8eb8fc2 resolved conflict, added new compression method in http 2020-11-29 15:59:56 +03:00
FawnD2
26488467f8 Merge branch 'master' into switch-upstream-for-arrow-submodule 2020-11-29 15:53:28 +03:00