Commit Graph

8055 Commits

Author SHA1 Message Date
Alexander Tokmakov
0c80fce7f0 Merge branch 'master' into allow_atomic_database_inside_materialize_mysql 2020-12-13 17:56:50 +03:00
Maksim Kita
5d6036e9c8 Fixed style issues 2020-12-13 14:38:56 +03:00
Maksim Kita
06b047235a Fixed style issues 2020-12-13 14:35:52 +03:00
Maksim Kita
547f452ba9 HashTable erase added tests 2020-12-13 13:30:25 +03:00
alexey-milovidov
bce02de691
Merge pull request #17539 from azat/remerge_sort_lowered_memory_bytes_ratio
Add remerge_sort_lowered_memory_bytes_ratio setting
2020-12-13 04:38:50 +03:00
alexey-milovidov
8df4789113
Merge pull request #17845 from kitaisreal/space-saving-remove-last-element-from-map-fix
SpaceSaving remove last element from map fix
2020-12-13 04:09:51 +03:00
alexey-milovidov
04e222f6f3
Merge pull request #17986 from azat/fwd-decl
More forward declaration for generic headers
2020-12-13 01:12:05 +03:00
Maksim Kita
5ae1652d51 Fixed aggregate function avg 2020-12-13 00:47:17 +03:00
Maksim Kita
b810b28b08 Added comment 2020-12-13 00:40:34 +03:00
Maksim Kita
0dcbcec19a Added tests 2020-12-13 00:29:09 +03:00
Alexey Milovidov
532557ecfd encodeXMLComponent: rename files after #17659 2020-12-12 23:47:37 +03:00
Maksim Kita
18bde6ef02 Fixed compile issues 2020-12-12 23:47:23 +03:00
alexey-milovidov
2eabd41749
Merge pull request #17659 from nautaa/master
add function to escape charaters for XML
2020-12-12 23:43:41 +03:00
alexey-milovidov
987725f67b
Merge pull request #17935 from Jokser/disk-s3-remove-empty-metadata-files
Forcibly removing empty or bad metadata files from FS for DiskS3
2020-12-12 23:41:35 +03:00
Maksim Kita
3d261c82e9 Array aggregation functions 2020-12-12 22:50:28 +03:00
alexey-milovidov
6f50a86025
Update gtest_hash_table.cpp 2020-12-12 18:57:07 +03:00
Pavel Kovalenko
3f2f663bfa Add [[maybe_unused]] for msg parameter in handle_error_code. 2020-12-12 17:43:11 +03:00
Azat Khuzhin
77a1d00dee Add new remote context as interpreter context to the Pipe 2020-12-12 17:43:10 +03:00
Azat Khuzhin
5b3ab48861 More forward declaration for generic headers
The following headers are pretty generic, so use forward declaration as
much as possible:
- Context.h
- Settings.h
- ConnectionTimeouts.h
(Also this shows that some missing some includes -- this has been fixed)

And split ConnectionTimeouts.h into ConnectionTimeoutsContext.h (since
module part cannot be added for it, due to recursive build dependencies
that will be introduced)

Also remove Settings from the RemoteBlockInputStream/RemoteQueryExecutor
and just pass the context, since settings was passed only in speicifc
places, that can allow making a copy of Context (i.e. Copier).

Approx results (How much units will be recompiled after changing file X?):

- ConnectionTimeouts.h
  - mainline: 100

- Context.h:
  - mainline: ~800
  - patched:  415

- Settings.h:
  - mainline: 900-1K
  - patched:  440 (most of them because of the Context.h)
2020-12-12 17:43:10 +03:00
Pavel Kovalenko
25df6bae78 Add nested exception when handle Disk S3 metadata file read error. 2020-12-12 17:11:47 +03:00
Maksim Kita
07c8293043 Added tests 2020-12-12 15:08:46 +03:00
Amos Bird
8d0e949462
ddlworker max entry metric 2020-12-12 14:20:49 +08:00
alexey-milovidov
c74011851a
Update HashTable.h 2020-12-12 04:58:07 +03:00
alexey-milovidov
d94d9aa8d7
Update HashTable.h 2020-12-12 04:17:32 +03:00
alexey-milovidov
9e48b9b656
Update HashTable.h 2020-12-12 03:47:43 +03:00
alexey-milovidov
eba1299845
Update HashTable.h 2020-12-12 03:38:55 +03:00
alexey-milovidov
245dea6f2e
Update HashTable.h 2020-12-12 03:33:57 +03:00
alexey-milovidov
7e2bc1e7a6
Update HashTable.h 2020-12-12 03:30:12 +03:00
alexey-milovidov
6e7366f921
Update HashTable.h 2020-12-12 03:28:41 +03:00
alexey-milovidov
e00b99ffe9
Update encodeXML.cpp 2020-12-12 03:09:11 +03:00
alexey-milovidov
b96316f0c4
Update encodeXML.cpp 2020-12-12 03:06:09 +03:00
alexey-milovidov
93985e6645
Update encodeXML.cpp 2020-12-12 03:05:35 +03:00
alexey-milovidov
0d6fe7121d
Merge pull request #17887 from sundy-li/trivial_count-fix
disable optimize_trivial_count in query with array join
2020-12-12 02:44:07 +03:00
alexey-milovidov
adbe8e1ebb
Merge pull request #17903 from ClickHouse/attach_table_from_path
Implement ATTACH TABLE name FROM 'path/to/data/'
2020-12-12 02:42:53 +03:00
alexey-milovidov
932493f12e
Merge pull request #17982 from azat/build
Tiny build changes
2020-12-12 02:37:14 +03:00
alexey-milovidov
fb9d05e93b
Merge pull request #17988 from ClickHouse/aku/remove-includes
Remove some redundant includes to speed up build
2020-12-12 02:32:27 +03:00
alexey-milovidov
8d8496a653
Merge pull request #18005 from ClickHouse/filimonov-log-verbosity-client-go-away
Decrease log verbosity of disconnecting clients
2020-12-12 02:25:13 +03:00
Alexander Kuzmenkov
dcc4b5609f fixup 2020-12-11 21:16:26 +03:00
Alexander Kuzmenkov
a2886cdfa5 Merge remote-tracking branch 'origin/master' into HEAD 2020-12-11 18:57:47 +03:00
Alexander Kuzmenkov
d54d96701a fixup 2020-12-11 18:57:26 +03:00
Pavel Kovalenko
59a5e63417 Merge remote-tracking branch 'origin/master' into s3-adaptive-single-part-upload
# Conflicts:
#	src/Disks/S3/DiskS3.cpp
#	src/Disks/S3/DiskS3.h
#	src/Disks/S3/registerDiskS3.cpp
#	src/IO/WriteBufferFromS3.cpp
#	src/IO/WriteBufferFromS3.h
2020-12-11 18:28:41 +03:00
Pavel Kovalenko
72a55c192e Fix master branch merge artifact. 2020-12-11 18:23:59 +03:00
Pavel Kovalenko
75bdb813ea Merge remote-tracking branch 'origin/master' into disk-s3-remove-empty-metadata-files
# Conflicts:
#	src/Disks/S3/DiskS3.cpp
2020-12-11 18:22:31 +03:00
Nikita Mikhaylov
f1a145a2b2
Merge pull request #17984 from nikitamikhaylov/fix-arcadia-second
Fix arcadia
2020-12-11 17:56:19 +03:00
Amos Bird
c6ac831d4e
Fix type 2020-12-11 22:44:22 +08:00
Kruglov Pavel
a8c1d17f83
Merge pull request #16935 from ucasFL/agg-func-setting-null-for-empty
`aggregate_functions_null_for_empty` move OrNull ahead
2020-12-11 17:11:39 +03:00
Kruglov Pavel
6300cd285f
Merge pull request #17909 from Jokser/disk-s3-send-metadata
Ability to set metadata when put S3 object
2020-12-11 17:01:14 +03:00
Maksim Kita
b70b98c415 Fix style issues 2020-12-11 16:54:08 +03:00
Maksim Kita
4ae5619714 Optimized erase in HashTable 2020-12-11 16:54:08 +03:00
Maksim Kita
bf5d75853c Added erase into HashTable 2020-12-11 16:54:08 +03:00
Maksim Kita
d8b78682e1 SpaceSaving remove last element from map fix 2020-12-11 16:54:08 +03:00
Vitaly Baranov
1b3893bcab User with allow_ddl=0 cannot do DDL but can grant DDL. 2020-12-11 16:38:49 +03:00
Vitaly Baranov
648be453a4 User with allow_introspection_functions=0 cannot call introspection functions but can grant INTROSPECTION. 2020-12-11 16:38:49 +03:00
Vitaly Baranov
710ba6f617 Simplify class ContextAccess. 2020-12-11 16:38:45 +03:00
Alexander Tokmakov
58a31e4882 Merge branch 'master' into allow_atomic_database_inside_materialize_mysql 2020-12-11 16:14:03 +03:00
Alexander Tokmakov
f9f7da5f97 fix 2020-12-11 15:06:19 +03:00
Pavel Kovalenko
de4a7a8865 Correct handling S3 disk metadata file read exceptions. 2020-12-11 14:27:58 +03:00
Pavel Kovalenko
5bf388683c Correct handling S3 disk metadata file read exceptions. 2020-12-11 14:21:54 +03:00
filimonov
8d9ad60afa
Decrease verbosity of disconnecting clients
Right now they go to error log.
2020-12-11 11:51:48 +01:00
Alexander Kuzmenkov
fb1221148d
Merge pull request #17748 from azat/custom-TLD
Add ability to use custom TLD list
2020-12-11 12:42:19 +03:00
nauta
00dc104025 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse 2020-12-11 16:15:40 +08:00
Amos Bird
5b1e5679b4
Add -SimpleState combinator 2020-12-11 11:43:56 +08:00
feng lv
3ee6b6382b fix
fix
2020-12-11 02:00:18 +00:00
Alexander Kuzmenkov
d757f32300 Remove some redundant includes to speed up build 2020-12-11 02:58:11 +03:00
nikitamikhaylov
b6d69eb63b done 2020-12-11 02:16:21 +03:00
Azat Khuzhin
d5b62ab26d build: use -Wno-c++2a-compat over -Wno-c++20-compat (since -std=c++2a) 2020-12-11 01:32:38 +03:00
Azat Khuzhin
2a814afd85 build: re-enable jobs limits 2020-12-11 01:32:38 +03:00
alexey-milovidov
2fb7ce8340
Revert "Date vs DateTime64 comparison" 2020-12-11 01:09:01 +03:00
Nikita Mikhaylov
77df818c5f
Merge pull request #17963 from nikitamikhaylov/fix-arcadia
Use ryu instead of dragonbox in Arcadia
2020-12-11 00:15:02 +03:00
alexey-milovidov
f7d1441858
Update WriteHelpers.h 2020-12-11 00:09:52 +03:00
alexey-milovidov
7f4b5a0d1b
Merge pull request #17854 from weeds085490/dev/add_diag_info_when_circle_in_merge
add diagnostic information when two merge tables try to read each oth…
2020-12-10 22:56:34 +03:00
alexey-milovidov
c35c52be87
Merge pull request #17867 from ucasFL/mergetree-setting
Add settings `min_compress_block_size` and `max_compress_block_size` to MergeTreeSettings
2020-12-10 22:54:05 +03:00
alexey-milovidov
f1ee1ef16a
Update MergeTreeSettings.h 2020-12-10 22:50:54 +03:00
nikitamikhaylov
17310c6c50 fix-arcadia 2020-12-10 21:08:16 +03:00
Kruglov Pavel
9a785dbbf5
Merge branch 'master' into disk-s3-send-metadata 2020-12-10 20:17:41 +03:00
tavplubix
60aef3d529
Merge pull request #17944 from zhang2014/fix/ISSUES-15187
ISSUES-15187 support convert MySQL prefix index for MaterializeMySQL
2020-12-10 19:42:38 +03:00
tavplubix
5f78280aec
Merge pull request #17915 from zhang2014/better_exception_message
Better exception message for MaterializeMySQL
2020-12-10 19:26:20 +03:00
nikitamikhaylov
955033d6a1 done 2020-12-10 16:18:37 +03:00
Vladimir Chebotarev
39d867e56d
Added proper authentication for S3 client (#16856) 2020-12-10 12:19:42 +03:00
alesapin
dd9f4bfc8a
Merge pull request #16877 from ClickHouse/complete_zk_api
Fake in-memory ZooKeeper server inside ClickHouse
2020-12-10 10:47:54 +03:00
Nikita Mikhaylov
80d4af9a73
Merge pull request #17874 from nikitamikhaylov/calendar-date
Merging #17750
2020-12-10 00:19:04 +03:00
tavplubix
f13de96afc
Merge pull request #17366 from zhang2014/fix/ISSUES-16835
ISSUES-16835 try fix miss match header with MySQL SHOW statement
2020-12-09 23:12:47 +03:00
alesapin
fef65b0cbd
Merge pull request #17919 from ClickHouse/additional_size_check
Add additional columns size check for MergeTree in debug mode
2020-12-09 22:40:06 +03:00
zhang2014
88798f201b ISSUES-15187 support prefix index 2020-12-10 02:50:56 +08:00
Azat Khuzhin
840a21d073 Add top_level_domains_path for easier overriding 2020-12-09 21:08:31 +03:00
Azat Khuzhin
c987be632f Switch TLDList to StringHashSet (to avoid errors on collisions) 2020-12-09 21:08:30 +03:00
Azat Khuzhin
89cb2185a8 Fix StringHashTable move constructor 2020-12-09 21:08:30 +03:00
Azat Khuzhin
8a0487b1af Add StringHashSet 2020-12-09 21:08:30 +03:00
Azat Khuzhin
916cbd6610 Add ability to use custom TLD list
v2: Add a note that top_level_domains_lists aren not applied w/o restart
v3: Remove ExtractFirstSignificantSubdomain{Default,Custom}Lookup.h headers
v4: TLDListsHolder: remove FIXME for dense_hash_map (this is not significant)
2020-12-09 21:08:22 +03:00
Pavel Kovalenko
5802633f95 Fix parameter name in constructor of DiskS3 2020-12-09 18:38:02 +03:00
nikitamikhaylov
b13873356c also style 2020-12-09 18:30:44 +03:00
alesapin
850f903d40 Merge branch 'master' into complete_zk_api 2020-12-09 18:18:38 +03:00
Pavel Kruglov
c8c543ca94 Add throwing exceptions 2020-12-09 18:07:58 +03:00
Pavel Kovalenko
818cdd353a Remove empty or bad metadata files from FS for DiskS3. 2020-12-09 18:01:30 +03:00
Pavel Kovalenko
db7a87089b Adaptive choose of single/multi part upload in WriteBufferFromS3. 2020-12-09 17:09:04 +03:00
alesapin
4d1f528806
Merge pull request #17918 from ClickHouse/revert-17120-fix_granularity_on_block_borders
Revert "Fix index granularity calculation on block borders"
2020-12-09 14:46:56 +03:00
alesapin
b307e545a9 Fix check 2020-12-09 14:46:04 +03:00
alesapin
0f4056fd95 Add additional size check in debug mode 2020-12-09 14:23:37 +03:00
Nikolai Kochetov
6a9e1ce436
Merge pull request #17895 from Enmk/DateTime64_DateTime_comparison
Date vs DateTime64 comparison
2020-12-09 14:22:26 +03:00
alesapin
7783ddb3af
Revert "Fix index granularity calculation on block borders" 2020-12-09 14:05:48 +03:00
feng lv
91c3de9664 fix
fix

fix
2020-12-09 09:13:51 +00:00
nauta
15eb2addd1 fix encodeXML 2020-12-09 16:55:03 +08:00
zhang2014
bf30aa5ff1 Code style 2020-12-09 16:50:40 +08:00
zhang2014
ef15b1f1fb Better exception message for MaterializeMySQL 2020-12-09 16:46:54 +08:00
alesapin
758dcd1972 Separate factory for test keeper handlers 2020-12-09 11:45:36 +03:00
alesapin
7ff50fb352 Close requests without timeout 2020-12-09 11:19:52 +03:00
zhang2014
2f735aa61d ISSUES-16835 try fix review comment 2020-12-09 16:19:09 +08:00
nauta
12f1ebdc00 fix encodeXML 2020-12-09 15:08:12 +08:00
nauta
c05ca054c1 fix encodeXML 2020-12-09 12:40:11 +08:00
feng lv
e95e443246 fix
fix
2020-12-09 04:32:28 +00:00
feng lv
9b2bb1820a Merge branch 'master' of github.com:ClickHouse/ClickHouse into agg-func-setting-null-for-empty 2020-12-09 02:28:49 +00:00
alexey-milovidov
e127636a4b
Merge pull request #16787 from kitaisreal/fast-float-integration
FastFloat library integration
2020-12-08 21:34:34 +03:00
Pavel Kovalenko
dfbb31174e Ability to set metadata when put S3 object 2020-12-08 21:31:57 +03:00
nikitamikhaylov
95ce4bc54c style 2020-12-08 21:28:18 +03:00
Vitaly Baranov
f6f336ac78
Merge pull request #17888 from vitlibar/retrieve-logs-from-grpc
Retrieve logs from grpc
2020-12-08 20:54:02 +03:00
nikitamikhaylov
e3a9cae4c5 better 2020-12-08 20:43:43 +03:00
Kruglov Pavel
291959c1b3
Update comment 2020-12-08 19:19:51 +03:00
nikitamikhaylov
71e9a8d9d0 build 2020-12-08 18:40:32 +03:00
alesapin
3d0dbbe411 Fix build 2020-12-08 17:49:18 +03:00
alesapin
91e3162e09 More correct session close 2020-12-08 17:28:51 +03:00
Vasily Nemkov
0c2d73adcb Fixed comparing Date and DateTime64 2020-12-08 17:17:02 +03:00
Alexander Tokmakov
04ceaa66f2 implement ATTACH TABLE name FROM 'path/to/data/ 2020-12-08 17:15:23 +03:00
Ivan
0ba712a2d3
Merge branch 'master' into allow_atomic_database_inside_materialize_mysql 2020-12-08 16:45:51 +03:00
alesapin
f4231d552e Banch of fixes 2020-12-08 16:28:39 +03:00
nauta
ab5f397022 add encodeXMLComponent function 2020-12-08 21:02:09 +08:00
Kruglov Pavel
e19eb6f17a
Merge branch 'master' into optimize-data-on-insert 2020-12-08 15:57:46 +03:00
alexey-milovidov
d9b52f94f7
Merge pull request #17637 from amosbird/buildid
reload symbols and fix build-id
2020-12-08 14:55:35 +03:00
alexey-milovidov
ab10cb4bf9
Merge pull request #17707 from ClickHouse/quota-by-x-forwarded-for
Allow quotas to be keyed by proxy-forwarded IP address; add support for PROXY protocol
2020-12-08 14:48:05 +03:00
Nikolai Kochetov
7d77a7ba24
Merge pull request #16952 from Enmk/DateTime64_fixes_comparison
Fixed comparison of DateTime64 with different scales
2020-12-08 12:40:41 +03:00
sundy-li
d9176263aa disable optimize_trivial_count in query with array join 2020-12-08 16:00:12 +08:00
Winter Zhang
972cb41fae
Merge branch 'master' into fix/ISSUES-16835 2020-12-08 15:32:58 +08:00
Alexey Milovidov
4ecfe8fef4 Remove unused headers 2020-12-08 02:10:22 +03:00
alexey-milovidov
a7324f8b4c
Update InterpreterSystemQuery.cpp 2020-12-08 00:12:09 +03:00
Vitaly Baranov
559afe028f Retrieve logs from grpc library and pass them to our logging system. 2020-12-07 23:39:55 +03:00
Amos Bird
08675028e5
fix build 2020-12-08 01:40:49 +08:00
Maksim Kita
a9a6517291 Fixed style 2020-12-07 19:26:38 +03:00
alesapin
b5d2559626
Merge pull request #17709 from kssenii/better-startup
rabbitmq: fix startup with no connection
2020-12-07 19:08:18 +03:00
nikitamikhaylov
a8616ea262 better 2020-12-07 18:47:57 +03:00
Alexey Milovidov
1ed329017b Merge branch 'master' into quota-by-x-forwarded-for 2020-12-07 18:22:19 +03:00
Maksim Kita
b0afa8488d Updated parse float precise implementation 2020-12-07 17:23:02 +03:00
feng lv
50b64ba1f8 fix 2020-12-07 13:18:31 +00:00
feng lv
87bdf028fd fix conflict 2020-12-07 13:14:22 +00:00
PHO
3c90065158 Add functions toMJD and fromMJD
These functions convert between Proleptic Gregorian calendar date and Modified Julian Day number.
2020-12-07 16:00:32 +03:00
PHO
8ce936af2c Add a missing #include <memory>
GCC fails to compile this due to std::unique_ptr not being declared.
2020-12-07 16:00:32 +03:00
feng lv
d7b30f74d1 add min-max_compress_block_size to mergetree settings 2020-12-07 12:47:51 +00:00
Maksim Kita
c3864d2fbf Updated contrib CMakeLists 2020-12-07 14:08:19 +03:00
alesapin
57f40e4260
Merge pull request #17458 from ClickHouse/merge-expressions
Merge expressions
2020-12-07 12:34:19 +03:00
alesapin
0c43246216 Merge branch 'master' into complete_zk_api 2020-12-07 10:24:55 +03:00
root
e07374331a add diagnostic information when two merge tables try to read each other's data 2020-12-07 15:23:58 +08:00
alexey-milovidov
4df1983d64
Merge pull request #17571 from vdimir/ip-dict-accept-alias
IP dictionary works with aliased types `IPv4` and `IPv6` (close #6804)
2020-12-07 02:19:32 +03:00