Commit Graph

8199 Commits

Author SHA1 Message Date
alesapin
b347fa322c Trying to fix races one more time 2020-12-16 15:58:00 +03:00
Pervakov Grigorii
4edbb42ba1 Use IDisk in Set and Join storages 2020-12-16 14:58:44 +03:00
nikitamikhaylov
bcd6fc1c88 better 2020-12-16 14:55:33 +03:00
nikitamikhaylov
18d52dbc63 better 2020-12-16 14:55:33 +03:00
nikitamikhaylov
20aaf48e38 pragmas 2020-12-16 14:55:33 +03:00
nikitamikhaylov
5c4e1d1db5 better 2020-12-16 14:55:33 +03:00
nikitamikhaylov
3288f1fd0c ya make 2020-12-16 14:55:33 +03:00
nikitamikhaylov
c3a6499f6d fix ya.make 2020-12-16 14:55:33 +03:00
nikitamikhaylov
4ccdb3ca20 done 2020-12-16 14:55:33 +03:00
Ilya Golshtein
09d1e89674 yandex/clickhouse-kerberized-hadoop + missed header 2020-12-16 14:48:33 +03:00
Ilya Golshtein
407565b47f fix - wrong error code 2020-12-16 14:48:33 +03:00
Ilya Golshtein
9701d6a2d5 style fix per code review, doc improvement, params consistency check 2020-12-16 14:48:33 +03:00
Ilya Golshtein
815856bc3d pass config, not context to createHDFSBuilder 2020-12-16 14:48:33 +03:00
Ilya Golshtein
7e97814859 cleanup, fixes, new submodules, ShellCommand, WriteBufferFromString 2020-12-16 14:48:33 +03:00
Ilya Golshtein
d1d657335b USE_INTERNAL_HDFS3_LIBRARY + bash lint 2020-12-16 14:48:33 +03:00
Ilya Golshtein
d9166a0645 HADOOP_SECURE_DN_USER way, kinit thread, docker capabilities 2020-12-16 14:48:33 +03:00
Ilya Golshtein
185ac744b1 kerberized hdfs compiled 2020-12-16 14:48:33 +03:00
Maksim Kita
7d23451e81 Replaced usages of 4096 constant with getPageSize 2020-12-16 13:46:28 +03:00
Maksim Kita
dbb2fbcdd5 Unified usages of getPageSize
1. Introduced getPageSize function.
2. Replaced usages of getpagesize with getPageSize function.
3. Replaced usages of sysconf(_SG_PAGESIZE) with getPageSize function.
2020-12-16 13:42:23 +03:00
Maksim Kita
058fbd5222 MMapReadBufferFromFileDescriptor use getpagesize 2020-12-16 13:42:23 +03:00
taiyang-li
cd7827f70c explain ast support nonselect queries 2020-12-16 18:11:38 +08:00
Nikolai Kochetov
44d2194326 Try fix integration tests. 2020-12-16 11:52:04 +03:00
alesapin
2a4a6b22b1 Fix remove TTL for column 2020-12-16 10:26:18 +03:00
Alexey Milovidov
37363ae89d Comment update 2020-12-16 09:43:16 +03:00
Alexey Milovidov
4bd5d3b662 Comment update 2020-12-16 06:36:43 +03:00
Alexey Milovidov
88c5031dfa Add a commit #16595 2020-12-16 06:27:28 +03:00
Alexey Milovidov
ca9ccf4850 Comment update 2020-12-16 06:03:43 +03:00
jianmei zhang
a7933ddf31 Merge and rebase with master 2020-12-16 09:38:38 +08:00
Anton Popov
b485b5bd1c minor fixes and comments added 2020-12-16 01:22:21 +03:00
alexey-milovidov
aec820362a
Update DecimalFunctions.h 2020-12-16 00:28:53 +03:00
Maksim Kita
4e3cc606e6 Fixed tests 2020-12-15 23:36:45 +03:00
Maksim Kita
51f53ce8e9 Added tryParseDecimal functions 2020-12-15 21:54:16 +03:00
Anton Popov
e51cf03f21 Merge remote-tracking branch 'upstream/master' into HEAD 2020-12-15 21:08:01 +03:00
Mikhail Filimonov
9df7ecb8e6
fixes 2020-12-15 18:06:23 +01:00
alesapin
1bd2f49fb5 Merge branch 'master' into try_rewrite_writer 2020-12-15 19:05:04 +03:00
alesapin
dff71850a8 Merge branch 'master' into fix_watch_race_testkeeper 2020-12-15 19:04:24 +03:00
alexey-milovidov
22aba554c0
Revert "Fix access rights required for the merge() table function." 2020-12-15 18:07:20 +03:00
Mikhail Filimonov
27ff3a5214
Rework using a separate flag file instead of renames 2020-12-15 15:46:13 +01:00
Nikita Mikhaylov
31bef163ba
Merge pull request #17848 from azat/max_distributed_connections-fix
Fix max_distributed_connections
2020-12-15 17:34:38 +03:00
Anton Popov
dd09e1d783 fix type map ser/de to json 2020-12-15 17:34:37 +03:00
Nikolai Kochetov
6defcbb662
Merge branch 'master' into optimize-data-on-insert 2020-12-15 16:50:42 +03:00
Vasily Nemkov
90041babe1 Fixed compilation 2020-12-15 14:35:11 +03:00
alesapin
9d17f01dc9 Merge branch 'master' into fix_watch_race_testkeeper 2020-12-15 13:41:04 +03:00
Vasily Nemkov
bf8c7cd685 Checking that columns from PARTITION BY are present in DEDUPLICATE BY 2020-12-15 13:41:00 +03:00
alesapin
8670836573 Add some comments 2020-12-15 13:34:28 +03:00
alesapin
74c2211510 More clear 2020-12-15 12:54:48 +03:00
Alexander Kazakov
def080c8ba
Fixed unsafe ast rewrite (#18064)
Fixed unsafe assignment to a reference in InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery()
2020-12-15 11:16:25 +03:00
alesapin
a50187c995 Slightly better 2020-12-15 11:04:37 +03:00
jianmei zhang
508b50d121 support SHOW CHANGED SETTINGS query and add test cases, also do code changes to compile SHOW SETTINGS PROFILES. 2020-12-15 14:46:56 +08:00
Vitaly Baranov
5a8c750b0b
Merge pull request #17983 from vitlibar/fix-access-rights-for-merge-table-function
Fix access rights required for the merge() table function.
2020-12-15 09:17:52 +03:00
Anton Popov
c78861e86e Merge remote-tracking branch 'upstream/master' into HEAD 2020-12-15 01:45:01 +03:00
Anton Popov
afc2d7099b add conversion from array to map 2020-12-15 01:16:04 +03:00
alexey-milovidov
91be7a6f27
Merge pull request #16809 from kitaisreal/read-float-8digits-unroll-performance-improvement
ReadFloat 8digits unroll performance improvement
2020-12-14 23:03:21 +03:00
alexey-milovidov
363ff79cca
Merge pull request #17934 from Jokser/s3-adaptive-single-part-upload
Adaptive choose of single/multi part upload in WriteBufferFromS3
2020-12-14 23:00:43 +03:00
alexey-milovidov
906415540a
Merge pull request #18060 from kitaisreal/create-query-create-as-select-with-columns-specification
CreateQuery create as select with columns specification
2020-12-14 22:57:02 +03:00
alexey-milovidov
7184746f45
Merge pull request #18059 from excitoon/patch-2
Fixed `std::out_of_range: basic_string` in S3 URL parsing
2020-12-14 22:56:39 +03:00
Maksim Kita
17b43ca721 Fixed tests 2020-12-14 22:12:15 +03:00
Maksim Kita
16a30eb4aa Updated non-finite floating conversion into int 2020-12-14 22:12:15 +03:00
alexey-milovidov
e945821e1f Update castColumn.h 2020-12-14 22:12:15 +03:00
alexey-milovidov
26e582272f Update castColumn.h 2020-12-14 22:12:15 +03:00
Maksim Kita
6873b13587 Fixed clang build issue 2020-12-14 22:12:15 +03:00
Maksim Kita
0b565b679e Fixed Set execute for columns that cannot be inside Nullable 2020-12-14 22:12:15 +03:00
Maksim Kita
18dc118298 Fixed compile issues 2020-12-14 22:12:15 +03:00
Maksim Kita
0464859cfe Updated usage of different types during IN query
1. Added accurateCast function.
2. Use accurateCast in Set during execute.
3. Added accurateCast tests.
4. Updated select_in_different_types tests.
2020-12-14 22:12:15 +03:00
Maksim Kita
6f4bc77dbc Added equality comparsion 2020-12-14 22:12:15 +03:00
Maksim Kita
f4b8e8ef99 Allow different types inside IN subquery 2020-12-14 22:12:15 +03:00
Maksim Kita
dff31e8de7 Fixed compile issues 2020-12-14 22:12:15 +03:00
Maksim Kita
0dac432942 Added const to arguments 2020-12-14 22:12:15 +03:00
Maksim Kita
dd072a20c9 Fixed compile issues 2020-12-14 22:12:15 +03:00
Maksim Kita
7b66dc374c Fixed clang compile issues 2020-12-14 22:12:15 +03:00
Maksim Kita
4435642e39 Fixed style issues 2020-12-14 22:12:15 +03:00
Maksim Kita
db5d0944ed Added Decimal support 2020-12-14 22:12:15 +03:00
Maksim Kita
baad78d2f2 Fixed setting null value in vector. Updated tests. 2020-12-14 22:12:15 +03:00
Maksim Kita
4cd5025e83 Added numeric limits for UInt128 2020-12-14 22:12:15 +03:00
Maksim Kita
d636e1618b Added function accurate cast or null 2020-12-14 22:12:15 +03:00
alesapin
73780838a1 Remove dead list watches 2020-12-14 19:01:29 +03:00
Mikhail Filimonov
24abcc970b
Tests and fixes 2020-12-14 15:31:13 +01:00
Mikhail Filimonov
87ea1528cb
support for Lazy database 2020-12-14 15:31:13 +01:00
Mikhail Filimonov
4ba80996b0
Detach permanently for DatabaseConnectionMySQL 2020-12-14 15:31:12 +01:00
Mikhail Filimonov
799141362d
Prevent attempts to recreate the table which was detached permanently 2020-12-14 15:31:11 +01:00
Mikhail Filimonov
ad9cb580a9
Fix 2020-12-14 15:31:11 +01:00
Mikhail Filimonov
2aeb72c09a
Fix for tiny issue #13850 2020-12-14 15:31:10 +01:00
Mikhail Filimonov
3f5e5eb15a
Handle not implemented cases properly 2020-12-14 15:31:05 +01:00
Mikhail Filimonov
f6097cf818
Adding DETACH TABLE PERMANENTLY 2020-12-14 15:28:59 +01:00
alesapin
34d1ad1aca Fix writer compact 2020-12-14 17:27:39 +03:00
tavplubix
dd2ae6926d
Merge pull request #14849 from ClickHouse/allow_atomic_database_inside_materialize_mysql
Allow Atomic database inside MaterializeMySQL
2020-12-14 16:27:13 +03:00
alesapin
35d2a689dd One more time 2020-12-14 16:06:11 +03:00
alesapin
2a2b02d395 One more time 2020-12-14 16:05:48 +03:00
alesapin
9e98cdad5a Accident changes 2020-12-14 16:05:07 +03:00
alesapin
47e3f619e5 Remove redundant code 2020-12-14 16:01:01 +03:00
alesapin
a87fb3fae0 Fix style 2020-12-14 15:52:15 +03:00
alesapin
303c12d2e4 Slightly better 2020-12-14 15:51:14 +03:00
Maksim Kita
55f991adde Updated test 2020-12-14 15:23:53 +03:00
alesapin
6fb23da851 Refactoring 2020-12-14 15:03:49 +03:00
alesapin
70be03aa7d Working compact parts 2020-12-14 14:36:15 +03:00
alexey-milovidov
ab17927c85
Merge pull request #18032 from kitaisreal/array-aggregation-functions
Array aggregation functions
2020-12-14 14:11:09 +03:00
alesapin
fbcf85cb42 Something working for wide parts 2020-12-14 14:06:02 +03:00
alexey-milovidov
8a20d449d9
Update arrayAggregation.cpp 2020-12-14 14:01:31 +03:00
alexey-milovidov
d55c5bec94
Merge pull request #18053 from azat/librdkafka-snappy-UB-fix
Fix possible corruption in librdkafka snappy decompression
2020-12-14 13:59:11 +03:00
alexey-milovidov
493ee6732b
Merge pull request #18052 from kitaisreal/memory-storage-read-optimization
MemoryStorage read optimization
2020-12-14 13:58:45 +03:00
alexey-milovidov
aac8b85b34
Merge pull request #18054 from ClickHouse/remove-obsolete-settings
Remove obsolete settings
2020-12-14 13:58:15 +03:00
alexey-milovidov
60efab623d
Update S3Common.cpp 2020-12-14 13:53:40 +03:00
Maksim Kita
5f7c867da3 Added parse error if no select after as keyword 2020-12-14 12:33:16 +03:00
Maksim Kita
d8534ae1af CreateQuery create as select with columns specification 2020-12-14 12:30:08 +03:00
Vitaly Baranov
a98e2311f8
Merge pull request #17908 from vitlibar/fix-checking-introspection-grants
Fix checking introspection grants
2020-12-14 12:10:17 +03:00
Vladimir Chebotarev
418c974eaf
Fixed std::out_of_range: basic_string in S3 URL parsing. 2020-12-14 11:17:29 +03:00
Pavel Kovalenko
346c241c20 Merge remote-tracking branch 'origin/master' into s3-adaptive-single-part-upload
# Conflicts:
#	src/Disks/S3/DiskS3.cpp
2020-12-14 11:00:30 +03:00
alesapin
12b6a54a24 Merge branch 'master' into try_rewrite_writer 2020-12-14 10:30:01 +03:00
alesapin
fd695c9ff4 Dive into debug 2020-12-14 10:28:42 +03:00
jianmei zhang
f829fbb928 Merge remote-tracking branch 'upstream/master' 2020-12-14 11:21:42 +08:00
jianmei zhang
2169e8f7f4 Fix issue #17160 by adding show settings like '...' 2020-12-14 10:33:51 +08:00
alexey-milovidov
5da9315ceb
Update readFloatText.h 2020-12-14 05:22:17 +03:00
alexey-milovidov
66b2424e33
Update readFloatText.h 2020-12-14 05:20:00 +03:00
Alexey Milovidov
6341521b10 Remove obsolete settings 2020-12-14 02:40:11 +03:00
Maksim Kita
1bccd6dff6 Fixed style issues 2020-12-14 00:50:55 +03:00
Azat Khuzhin
2bf226decc Fix typo in KafkaSettings comments 2020-12-14 00:38:10 +03:00
Maksim Kita
69127ca0ed Changed BlocksList to Blocks 2020-12-14 00:21:25 +03:00
Vitaly Baranov
9310437920 Fix access rights required for the merge() table function. 2020-12-13 23:34:53 +03:00
Maksim Kita
3c6df61e5c MemoryStorage read optimization 2020-12-13 22:24:15 +03:00
alexey-milovidov
8702809c9f
Merge pull request #17464 from amosbird/ddlworkermetric
ddlworker max entry metric
2020-12-13 21:28:03 +03:00
Maksim Kita
0be51cbabd Updated tests 2020-12-13 21:27:48 +03:00
alexey-milovidov
d8484d9c31
Merge pull request #18033 from ClickHouse/encode-xml-rename-files
encodeXMLComponent: rename files after #17659
2020-12-13 18:28:52 +03:00
alexey-milovidov
cd5f827265
Merge pull request #18047 from kitaisreal/space-saving-remove-last-element-from-map-fix
HashTable erase added tests
2020-12-13 18:27:01 +03:00
Alexander Tokmakov
0c80fce7f0 Merge branch 'master' into allow_atomic_database_inside_materialize_mysql 2020-12-13 17:56:50 +03:00
Maksim Kita
5d6036e9c8 Fixed style issues 2020-12-13 14:38:56 +03:00
Maksim Kita
06b047235a Fixed style issues 2020-12-13 14:35:52 +03:00
Maksim Kita
547f452ba9 HashTable erase added tests 2020-12-13 13:30:25 +03:00
alexey-milovidov
bce02de691
Merge pull request #17539 from azat/remerge_sort_lowered_memory_bytes_ratio
Add remerge_sort_lowered_memory_bytes_ratio setting
2020-12-13 04:38:50 +03:00
alexey-milovidov
8df4789113
Merge pull request #17845 from kitaisreal/space-saving-remove-last-element-from-map-fix
SpaceSaving remove last element from map fix
2020-12-13 04:09:51 +03:00
alexey-milovidov
04e222f6f3
Merge pull request #17986 from azat/fwd-decl
More forward declaration for generic headers
2020-12-13 01:12:05 +03:00
Maksim Kita
5ae1652d51 Fixed aggregate function avg 2020-12-13 00:47:17 +03:00
Maksim Kita
b810b28b08 Added comment 2020-12-13 00:40:34 +03:00
Maksim Kita
0dcbcec19a Added tests 2020-12-13 00:29:09 +03:00
Alexey Milovidov
532557ecfd encodeXMLComponent: rename files after #17659 2020-12-12 23:47:37 +03:00
Maksim Kita
18bde6ef02 Fixed compile issues 2020-12-12 23:47:23 +03:00
alexey-milovidov
2eabd41749
Merge pull request #17659 from nautaa/master
add function to escape charaters for XML
2020-12-12 23:43:41 +03:00
alexey-milovidov
987725f67b
Merge pull request #17935 from Jokser/disk-s3-remove-empty-metadata-files
Forcibly removing empty or bad metadata files from FS for DiskS3
2020-12-12 23:41:35 +03:00
Maksim Kita
3d261c82e9 Array aggregation functions 2020-12-12 22:50:28 +03:00
alexey-milovidov
6f50a86025
Update gtest_hash_table.cpp 2020-12-12 18:57:07 +03:00
Pavel Kovalenko
3f2f663bfa Add [[maybe_unused]] for msg parameter in handle_error_code. 2020-12-12 17:43:11 +03:00
Azat Khuzhin
77a1d00dee Add new remote context as interpreter context to the Pipe 2020-12-12 17:43:10 +03:00
Azat Khuzhin
5b3ab48861 More forward declaration for generic headers
The following headers are pretty generic, so use forward declaration as
much as possible:
- Context.h
- Settings.h
- ConnectionTimeouts.h
(Also this shows that some missing some includes -- this has been fixed)

And split ConnectionTimeouts.h into ConnectionTimeoutsContext.h (since
module part cannot be added for it, due to recursive build dependencies
that will be introduced)

Also remove Settings from the RemoteBlockInputStream/RemoteQueryExecutor
and just pass the context, since settings was passed only in speicifc
places, that can allow making a copy of Context (i.e. Copier).

Approx results (How much units will be recompiled after changing file X?):

- ConnectionTimeouts.h
  - mainline: 100

- Context.h:
  - mainline: ~800
  - patched:  415

- Settings.h:
  - mainline: 900-1K
  - patched:  440 (most of them because of the Context.h)
2020-12-12 17:43:10 +03:00
Pavel Kovalenko
25df6bae78 Add nested exception when handle Disk S3 metadata file read error. 2020-12-12 17:11:47 +03:00
Maksim Kita
07c8293043 Added tests 2020-12-12 15:08:46 +03:00
Amos Bird
8d0e949462
ddlworker max entry metric 2020-12-12 14:20:49 +08:00
alexey-milovidov
c74011851a
Update HashTable.h 2020-12-12 04:58:07 +03:00
alexey-milovidov
d94d9aa8d7
Update HashTable.h 2020-12-12 04:17:32 +03:00
alexey-milovidov
9e48b9b656
Update HashTable.h 2020-12-12 03:47:43 +03:00
alexey-milovidov
eba1299845
Update HashTable.h 2020-12-12 03:38:55 +03:00
alexey-milovidov
245dea6f2e
Update HashTable.h 2020-12-12 03:33:57 +03:00