Commit Graph

19975 Commits

Author SHA1 Message Date
Alexey Milovidov
81602fd249 Added __restrict in FunctionsComparison 2020-02-24 03:12:47 +03:00
alexey-milovidov
1803656b9f
Merge pull request #9322 from ClickHouse/processors-inconsistent-whitespaces
Fixed inconsistent whitespaces in log messages of Processors
2020-02-24 03:09:03 +03:00
Alexey Milovidov
e30064dbfa Added suggestion from Amos Bird 2020-02-24 02:48:38 +03:00
Alexey Milovidov
07d272764d __restrict in arithmetic functions 2020-02-24 02:14:27 +03:00
Alexey Milovidov
7ff3dc0337 Remove garbage from FunctionsComparison; better build time and less template instantiations 2020-02-24 01:46:52 +03:00
Alexey Milovidov
2001bcbf6a Whitespaces 2020-02-24 00:53:16 +03:00
Alexey Milovidov
dbfbc38fe8 Whitespaces 2020-02-24 00:45:31 +03:00
Alexey Milovidov
40ae72b543 Fixed inconsistent whitespaces in log message of Processors 2020-02-24 00:40:57 +03:00
CurtizJ
e5fad6d753 Merge remote-tracking branch 'upstream/master' into alter-ttl 2020-02-23 18:40:42 +03:00
Andrew Onyshchuk
d15ff3e8d5 Parquet improvements
- Read only required columns
- Avoid reading the entire file to RAM when possible
- Allow using internal parquet on darwin
2020-02-23 00:04:58 -06:00
alexey-milovidov
afc306091b
Merge pull request #9262 from ClickHouse/fix_expressions_in_metadata
Fix expressions in metadata
2020-02-23 04:32:55 +03:00
alexey-milovidov
cb89bcae25
Update PushingToViewsBlockOutputStream.cpp 2020-02-23 04:30:53 +03:00
alexey-milovidov
4a0873a93f
Update Settings.h 2020-02-23 04:30:22 +03:00
alexey-milovidov
c9cf1656b9
Merge branch 'master' into fix/ISSUES-8971 2020-02-23 04:16:23 +03:00
Alexey Milovidov
c902b27e25 Whitespaces 2020-02-23 04:04:59 +03:00
alexey-milovidov
d0fea62079
Merge pull request #8290 from CurtizJ/polymorphic-parts
Polymorphic parts (compact format).
2020-02-23 04:01:07 +03:00
Alexey Milovidov
55787391c6 Merge branch 'master' of github.com:yandex/ClickHouse into amosbird-char8_t 2020-02-23 00:30:19 +03:00
Alexey Milovidov
6325d7514c Fixed warning 2020-02-22 23:07:22 +03:00
Alexey Milovidov
1ba67b1bb4 Fixed bad code 2020-02-22 22:44:31 +03:00
Alexey Milovidov
4c504ffda3 Fixed errors 2020-02-22 22:35:39 +03:00
Anton Popov
b736029828
Update ErrorCodes.cpp 2020-02-22 22:11:44 +03:00
alexey-milovidov
1950923433
Merge branch 'master' into polymorphic-parts 2020-02-22 20:56:27 +03:00
Alexey Milovidov
9e9cba6eb7 Merge remote-tracking branch 'origin/master' into amosbird-char8_t 2020-02-22 20:49:25 +03:00
alexey-milovidov
5d2bf946ee
Update Types.h 2020-02-22 20:42:00 +03:00
Vitaly Baranov
e026258f42
Update InterpreterSetRoleQuery.h 2020-02-22 19:32:15 +03:00
Alexander Tokmakov
ac0e2c2256 Merge branch 'master' into fix_expressions_in_metadata 2020-02-22 16:42:45 +03:00
Amos Bird
693cf211fa
Build fix 2020-02-22 16:44:23 +08:00
Vxider
ecd72b8478 build fix 2020-02-22 16:11:20 +08:00
Amos Bird
f5d6043a5d
Strict aliasing in c++20 2020-02-22 13:46:35 +08:00
Alexey Milovidov
c3e80485da
More strict aliasing 2020-02-22 10:19:39 +08:00
Alexey Milovidov
52153d15cc
More strict aliasing 2020-02-22 10:19:17 +08:00
Alexey Milovidov
cce1e46b45
More strict aliasing 2020-02-22 10:19:17 +08:00
Alexey Milovidov
ac83a28285
More strict aliasing 2020-02-22 10:17:52 +08:00
Alexey Milovidov
5cf3414b8a
More strict aliasing 2020-02-22 10:17:52 +08:00
Alexey Milovidov
3bf1e6f6c1
More strict aliasing 2020-02-22 10:17:25 +08:00
Alexey Milovidov
d3867ac5fa
More strict aliasing 2020-02-22 10:17:25 +08:00
Alexey Milovidov
e1b3c58746
More strict aliasing 2020-02-22 10:17:24 +08:00
Vitaly Baranov
c1e870d493
Merge pull request #9182 from vitlibar/RBAC-5.2
RBAC-5.2
2020-02-22 03:55:17 +03:00
Alexander Tokmakov
d6205fa4fa Merge branch 'master' into fix_expressions_in_metadata 2020-02-22 03:17:15 +03:00
alexey-milovidov
66e7965381
Merge pull request #9294 from ClickHouse/colors-in-logs-sent-to-client
Colors in logs sent to client
2020-02-22 02:24:08 +03:00
alexey-milovidov
5cc112e3d3
Merge pull request #9293 from ClickHouse/akz/column_vector_replicate_faster
Made ColumnVector::replicate() implementation 3x faster
2020-02-22 02:23:49 +03:00
alexey-milovidov
55520b9629
Merge pull request #9289 from ClickHouse/fix-9134
Fix 9134
2020-02-22 02:23:00 +03:00
robot-clickhouse
473e1eac6f Auto version update to [20.3.1.1] [54433] 2020-02-22 00:35:33 +03:00
alexey-milovidov
67cb5c8fab
Merge pull request #9287 from ClickHouse/reading-the-code-of-alter-move-partition
Reading the code of ALTER MOVE PARTITION
2020-02-22 00:28:43 +03:00
alexey-milovidov
49b46fd897
Merge pull request #9257 from millb/disk_scheme_4
Space check from path/data/ for default disk
2020-02-22 00:27:49 +03:00
alexey-milovidov
716a7e907f
Merge pull request #9275 from 4ertus2/joins
Negative test for partial_merge_join variants
2020-02-22 00:26:05 +03:00
Alexey Milovidov
5f9a56a38a Colorize logs that are send to client with "send_logs_level" setting 2020-02-21 23:01:38 +03:00
Alexander Kazakov
1c86a31431 Faster ColumnVector::replicate() 2020-02-21 22:47:20 +03:00
Alexander Kazakov
2e8dd9d9fc A unit test for ColumnVector::replicate() 2020-02-21 22:46:08 +03:00
Nikolai Kochetov
fddb021951 Added comment. 2020-02-21 22:17:09 +03:00
Alexey Milovidov
0dbd885679 Reading the code of ALTER MOVE PARTITION 2020-02-21 19:57:40 +03:00
Nikolai Kochetov
350881a3da Copy block info in ConvertingBlockInputStream. 2020-02-21 19:57:22 +03:00
CurtizJ
14daa51cec add comments 2020-02-21 19:53:33 +03:00
Alexey Milovidov
396e9c57d0 Fixed OptimizedRegularExpression in case of empty regexp 2020-02-21 18:55:36 +03:00
Alexander Tokmakov
db669cef63 Merge branch 'master' into fix_expressions_in_metadata 2020-02-21 18:22:52 +03:00
alexey-milovidov
ee710dd1f7
Merge pull request #9235 from zhang2014/fix/ISSUES-9230
ISSUES-9230 pushed SelectQueryOption into join expression
2020-02-21 17:55:57 +03:00
alexey-milovidov
1e8389eceb
Merge pull request #8929 from ClickHouse/more-processors-for-storages
More processors for storage::read
2020-02-21 17:39:12 +03:00
alexey-milovidov
abe8315861
Merge pull request #9258 from Jokser/disk-s3-read-write-buffers-refactoring
Disk->writeFile() returns WriteBufferFromFileBase.
2020-02-21 17:28:49 +03:00
alexey-milovidov
bc910d3489
Trigger CI 2020-02-21 17:05:57 +03:00
Alexander Tokmakov
e117e5838e fixes 2020-02-21 16:44:44 +03:00
chertus
759d137162 add negative test for partial_merge_join variants 2020-02-21 16:16:59 +03:00
Nikolai Kochetov
30d41b34ba Merged with master 2020-02-21 11:47:56 +03:00
Vitaly Baranov
e017bacc48 Implement SQL queries for creating and controlling roles. 2020-02-21 06:03:09 +03:00
Vitaly Baranov
6671ca67eb Add access type ROLE_ADMIN. 2020-02-21 06:03:09 +03:00
Vitaly Baranov
ae18d443c8 Introduce roles. 2020-02-21 06:03:03 +03:00
Vitaly Baranov
fc8aa5efe7 Separate access-controlling access types. 2020-02-21 03:27:29 +03:00
Vitaly Baranov
543587fc46 Remove ATTACH and DETACH access types, check CREATE and DROP access types instead of them. 2020-02-21 03:27:29 +03:00
Vitaly Baranov
4f85c148b5 Move event handling away from Context. 2020-02-21 03:27:23 +03:00
alexey-milovidov
0f72781b1e
Trigger CI 2020-02-21 02:02:52 +03:00
alexey-milovidov
d1e26f5b35
Merge pull request #9163 from ClickHouse/match-zero-byte-fix
Fixed `match` and `extract` when haystack has zero bytes.
2020-02-21 02:01:50 +03:00
alexey-milovidov
219f94ca97
Merge pull request #9082 from 4ertus2/joins
Switch JOIN algo on the fly
2020-02-21 02:01:23 +03:00
Vitaly Baranov
6cac4a919b Improve behaviour of row policies, now it applies for a table always when defined for that table (even for another user). 2020-02-21 00:57:42 +03:00
Vitaly Baranov
5849dd2236 Slightly better solution for checking row policy for distributed tables,
now it checks both current user's and initial user's filters.
2020-02-21 00:57:42 +03:00
Vitaly Baranov
244c9d5325 Add class GenericRoleSet to represent a set of IDs of users and roles. 2020-02-21 00:57:42 +03:00
Vitaly Baranov
ed2061db8a Better pointers: std::shared_ptr<const QuotaContext> instead of std::shared_ptr<QuotaContext>, boost::atomic_shared_ptr instead of std::atomic_load/store. 2020-02-21 00:57:42 +03:00
Vitaly Baranov
9edea08b6d Improve parsers of access managing SQL. 2020-02-21 00:57:42 +03:00
Alexander Tokmakov
e1f5a620b5 more complex test and some fixes 2020-02-20 23:24:04 +03:00
Alexey Milovidov
2c8a6a2885 Fixed bad code 2020-02-20 22:38:18 +03:00
alesapin
f06bcee7bc Merge with master 2020-02-20 22:36:36 +03:00
chertus
aeefb78157 add comments to JoinSwitcher 2020-02-20 22:13:12 +03:00
Alexey Milovidov
d87e25aeab Merge branch 'master' of github.com:yandex/ClickHouse into match-zero-byte-fix 2020-02-20 21:52:50 +03:00
alexey-milovidov
d4381d7976
Merge pull request #9217 from ClickHouse/fix_mutations_finalization_one_more_time
Fix remove parts from mutations
2020-02-20 21:47:27 +03:00
alexey-milovidov
4433947670
Merge pull request #9227 from ClickHouse/simplier_alter_prepare
Simplier alter prepare
2020-02-20 21:45:27 +03:00
alexey-milovidov
5c097f842f
Merge pull request #9247 from ClickHouse/aku/logical-error-message
Log error message before aborting on LOGICAL_ERROR.
2020-02-20 21:45:01 +03:00
Alexey Milovidov
5894a750d5 Merge branch 'master' into session-cleaner-better-build-time 2020-02-20 21:43:40 +03:00
alexey-milovidov
f4124d3522
Merge pull request #9251 from 4ertus2/ast
Fix bug with comma JOIN and IN
2020-02-20 21:41:08 +03:00
alexey-milovidov
81f52614fd
Merge pull request #9255 from abyss7/log-alias
Don't use refs on vanishing objects
2020-02-20 21:16:32 +03:00
alexey-milovidov
79d194119b
Merge pull request #9254 from ClickHouse/fix-ndebuf-in-pipeline-executor
Fix NDEBUG in PipelineExecutor.
2020-02-20 21:16:11 +03:00
chertus
f683437a8c remove dangerous optimisation 2020-02-20 20:19:16 +03:00
Pavel Kovalenko
e593003be7 Formatting issues. 2020-02-20 19:48:52 +03:00
Pavel Kovalenko
e5b81aefe3 WriteBufferFromFileBase interface refactoring.
Disk->writeFile() returns WriteBufferFromFileBase.
DiskMemory read/write buffers refactoring.
2020-02-20 19:39:32 +03:00
millb
cf53160221 fixed bug 2020-02-20 19:21:28 +03:00
alexey-milovidov
a1193cbbf8
Merge pull request #9128 from Jokser/storage-stripe-log-s3
Storage Stripe Log S3 support.
2020-02-20 19:01:36 +03:00
Ivan Lezhankin
d211b1a482 Don't use refs on vanishing objects 2020-02-20 18:40:23 +03:00
Clément Rodriguez
1f275c965f Rebase with upstream/master 2020-02-20 16:32:05 +01:00
Nikolai Kochetov
9191e5f17f Fix NDEBUG in PipelineExecutor. 2020-02-20 18:26:20 +03:00
Nikolai Kochetov
cca4d4e296 More comments and remove spaces. 2020-02-20 17:40:58 +03:00
Alexander Tokmakov
c492ee93d9 fold constant expressions in storage engine arguments 2020-02-20 17:13:43 +03:00
chertus
9748f8dcf6 fix bug with comma join and in 2020-02-20 16:33:14 +03:00
Alexey Milovidov
f888c6ac88 Fixed build 2020-02-20 16:21:58 +03:00
alexey-milovidov
5d4a85488e
Merge pull request #9231 from abyss7/log-alias
Get marks from first non-alias column in Log storage
2020-02-20 16:20:21 +03:00
Clément Rodriguez
dd4353311f Merge remote-tracking branch 'upstream/master' 2020-02-20 14:07:37 +01:00
Ivan Lezhankin
ee2cb00aa1 Use getAllPhysical() 2020-02-20 15:46:27 +03:00
CurtizJ
3f7f13ce05 Merge remote-tracking branch 'upstream/master' into polymorphic-parts 2020-02-20 15:36:55 +03:00
Alexander Kuzmenkov
642e21e8e1 Log error message before aborting on LOGICAL_ERROR. 2020-02-20 15:29:53 +03:00
Nikolai Kochetov
84af9677be Try fix external tables for RemoteBlockInputStream 2020-02-20 14:29:12 +03:00
chertus
56fa3cc1eb correct fallback for PREFER_PARTIAL_MERGE: HashJoin -> MergeJoin instead of HashJoin -> JoinSwitcher 2020-02-20 14:26:00 +03:00
alesapin
a576811c45 Better error codes and exception messages, remove duplicated headers 2020-02-20 13:48:48 +03:00
Yury Stankevich
1d391e2841 add option to force deduplicate children 2020-02-20 13:06:56 +03:00
alesapin
cbd8b697c4 Better error codes and exception messages, remove duplicated headers 2020-02-20 13:04:15 +03:00
alexey-milovidov
64fe250eff
Merge pull request #9211 from ClickHouse/remove-useless-code-in-compression
Remove useless code
2020-02-20 13:02:20 +03:00
alexey-milovidov
eceabbfc3f
Merge pull request #9221 from nvartolomei/nv/advertise-a-stack-trace-will-follow
Improve stack trace formatting for Poco and std exceptions
2020-02-20 12:59:58 +03:00
alexey-milovidov
63aa168a8c
Merge pull request #9229 from 4ertus2/ast
Fix CROSS to INNER JOIN rewrite with [NOT] LIKE
2020-02-20 12:54:57 +03:00
Alexander Kazakov
5a67c02a5d
In KeyCondition: Fixed execution of inversed predicates for non-strictly monotinic functional index (#9223)
* Tests for functional index

* Fixed execution of inversed predicates in functional index

When non-strictly monotonic functional index is used inverted predicated
may be executed incorrectly, which leads to multiple problems: #8821,
#9034
2020-02-20 12:53:02 +03:00
alesapin
0034674330 Fix tests and small bug 2020-02-20 12:22:42 +03:00
alesapin
5282f8b59c Fix tests and small bug 2020-02-20 12:22:17 +03:00
zhang2014
130e76d5c0 ISSUES-9230 pushed SelectQueryOption into join expression 2020-02-20 11:15:59 +08:00
CurtizJ
2f30a1350b pass proper time for TTL 2020-02-20 03:24:05 +03:00
alexey-milovidov
1f42d03bf8
Update SeekableReadBuffer.h 2020-02-19 22:26:33 +03:00
chertus
3d7959d2e8 fix join_algorithm and partial_merge_join settings check 2020-02-19 22:11:23 +03:00
Alexey Milovidov
a739e42740 Better build time 2020-02-19 21:41:22 +03:00
Ivan Lezhankin
894c451cf0 Get marks from first non-alias column in Log storage 2020-02-19 21:06:18 +03:00
chertus
fa8f07374b fix CROSS to INNER JOIN rewrite with [NOT] LIKE 2020-02-19 20:22:16 +03:00
CurtizJ
803d9da496 add test for mutations with TTL 2020-02-19 20:18:12 +03:00
Nikolai Kochetov
39916dd01a Remove readWithProcessors from IStorage. 2020-02-19 19:09:31 +03:00
Nikolai Kochetov
a3c4b2e922 Remove readWithProcessors from IStorage. 2020-02-19 19:07:28 +03:00
Nikolai Kochetov
e0c30259fb Remove readWithProcessors from IStorage. 2020-02-19 19:02:37 +03:00
alesapin
60118b65d5 Better 2020-02-19 18:12:32 +03:00
Nikolai Kochetov
bf18eeda95 Use processors for sending external tables. 2020-02-19 18:09:32 +03:00
alesapin
c4972b3799 Better 2020-02-19 18:07:02 +03:00
alesapin
1914b1dab7 Add missed headers 2020-02-19 17:58:06 +03:00
Pavel Kovalenko
d4fa60f52d Rename disk_name -> disk. 2020-02-19 17:50:39 +03:00
alesapin
6020f2fd4a Remove redundant function 2020-02-19 17:50:11 +03:00
alesapin
d5b4ddf6d8 Simplier alter modify logic 2020-02-19 17:49:59 +03:00
alesapin
28b2a03b08 First version 2020-02-19 17:49:45 +03:00
alesapin
7a9b96a8f9 Remove redundant function 2020-02-19 17:43:34 +03:00
alesapin
3f29ea0756 Simplier alter modify logic 2020-02-19 17:39:01 +03:00
chertus
9f43fa87c3 make switched flag atomic 2020-02-19 17:23:21 +03:00
Clément Rodriguez
cdd99d7f23 Merge 2020-02-19 15:23:17 +01:00
CurtizJ
23592991e6 comments and refactoring 2020-02-19 17:07:36 +03:00
Nikolai Kochetov
3bfbd26901 Use processors for sending external tables. 2020-02-19 17:00:49 +03:00
Nicolae Vartolomei
811197558c Improve stack trace formatting for Poco and std exceptions
Before:

```
<Error> Application: Caught exception while loading metadata: Poco::Exception. Code: 1000, e.code() = 0, e.displayText() = Access to file denied: boo0. /home/nv/clickhouse-master-clion/contrib/poco/Foundation/src/Exception.cpp:27: Poco::FileAccessDeniedException::FileAccessDeniedException(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&, int) @ 0xbb598cc in /state/home/nv/clickhouse-builds/clickhouse-master-clion-gcc/dbms/programs/clickhous
```

After:

```
<Error> Application: Caught exception while loading metadata: Poco::Exception. Code: 1000, e.code() = 0, e.displayText() = Access to file denied: boo, Stack trace (when copying this message, always include the lines below):

0. /home/nv/clickhouse-master-clion/contrib/poco/Foundation/src/Exception.cpp:27: Poco::FileAccessDeniedException::FileAccessDeniedException(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&, int) @ 0xbb5987c in /state/home/nv/clickhouse-builds/clickhouse-master-clion-gcc/dbms/programs/clickhous
```
2020-02-19 13:33:31 +00:00
alesapin
3b4c27b0de Fix remove parts from mutations 2020-02-19 15:55:23 +03:00
alesapin
6f266c94ed Trying to simplify alter commands logic 2020-02-19 15:52:27 +03:00
alesapin
ad51369982 Fix remove of actual_part from mutations 2020-02-19 15:50:11 +03:00
chertus
3348697128 fix storage join 2020-02-19 15:37:56 +03:00
Nikolai Kochetov
75af5414d9 Try fix test_delayed_replica_failover 2020-02-19 15:30:56 +03:00
alesapin
6eda5547a2 Revert redundant change 2020-02-19 15:00:45 +03:00
chertus
48ac7d35ae Merge branch 'master' into joins 2020-02-19 14:21:40 +03:00
chertus
f748427ffd minor fix (remove logic dependent on partial_merge_join setting) 2020-02-19 14:20:35 +03:00
Pavel Kovalenko
d662c1e006 Merge branch 'master' into storage-stripe-log-s3 2020-02-19 13:24:23 +03:00
Nikolai Kochetov
4fa6c86114 Fix StorageHDFS. 2020-02-19 13:22:44 +03:00
Nikolai Kochetov
70a7ddc172 Fix StorageURL 2020-02-19 13:17:49 +03:00
alexey-milovidov
b063dbeaf2
Merge pull request #8598 from excitoon-favorites/passttlsoverhttp
Pass TTL rule info with block to other replicas
2020-02-19 12:09:25 +03:00
alexey-milovidov
c5d5c9c11e
Merge pull request #9192 from nvartolomei/nv/format-version-file-typo
Fix typo in file name when reporting version file duplicates
2020-02-19 11:59:22 +03:00
alexey-milovidov
1c66c2f383
Merge pull request #9201 from CurtizJ/fix-range-reader
Fix mistake introduced in #9050.
2020-02-19 11:58:21 +03:00
alexey-milovidov
77f9a358ff
Update ProfileEvents.cpp 2020-02-19 11:55:29 +03:00
alexey-milovidov
e90124dc24
Update ProfileEvents.cpp 2020-02-19 11:54:23 +03:00
Mikhail f. Shiryaev
fdc00e3562
Add description for some profiling events 2020-02-19 09:50:58 +01:00
Alexey Milovidov
b2a52a2d69 Remove useless code #9210 2020-02-19 11:49:26 +03:00
alesapin
c2d53438e1 Less flappy test and more comments 2020-02-19 11:45:09 +03:00
CurtizJ
dea444b69c fix mistake in MergeTreeDataSelectExecutor 2020-02-19 00:00:51 +03:00
alesapin
f4b2be7b32 Remove parts from mutations on replica start 2020-02-18 22:57:48 +03:00
Pavel Kovalenko
ff50a51757 Formatting issues. 2020-02-18 22:13:37 +03:00
CurtizJ
b0f7905567 better TTL calculations with mutations 2020-02-18 22:03:40 +03:00
alesapin
1f4b42a99f Fix bug in initialization 2020-02-18 20:31:49 +03:00
chertus
74a5227ac4 add join_algorithm setting 2020-02-18 20:31:22 +03:00
Nikolai Kochetov
69a38958b4 fix PVS warning. 2020-02-18 19:23:29 +03:00
Pavel Kovalenko
05ceef4ef8 Log family storages disk support via 'SETTINGS' clause. 2020-02-18 17:41:30 +03:00
Nikolai Kochetov
3f55e6a499 Processors support for StorageFromMergeTreeDataPart reading. 2020-02-18 17:24:33 +03:00
chertus
fbecd0c155 use default_max_bytes_in_join in JoinSwitcher if no join limits 2020-02-18 17:19:13 +03:00
Nikolai Kochetov
5d0d2b25e1 Update MergingSortedTransform 2020-02-18 17:15:50 +03:00
Nikolai Kochetov
41851b62e9 Fix TreeExecutorBlockInputStream 2020-02-18 16:29:40 +03:00
Nikolai Kochetov
49926098d3 Update BlockStreamProfileInfo 2020-02-18 16:16:30 +03:00
chertus
f1673e1344 fix JoinSwitcher logic 2020-02-18 15:41:23 +03:00
Pavel Kovalenko
0040ad3289 Fixed includes. 2020-02-18 15:24:20 +03:00
Nicolae Vartolomei
b612cbf7d8 Fix typo in file name when reporting version file duplicates 2020-02-18 11:44:16 +00:00
alesapin
b3fe0b51a1 Merge branch 'master' into alter_on_top_of_mutations 2020-02-18 14:32:12 +03:00
alesapin
db3ea6cca8 Better comments 2020-02-18 14:31:24 +03:00
Nikolai Kochetov
145cb6e12f Update TreeExecutorBlockInputStream. 2020-02-18 13:39:08 +03:00
Nikolai Kochetov
b6b4a87206 Update TreeExecutorBlockInputStream. 2020-02-18 13:37:57 +03:00
Pavel Kovalenko
a8cffd55aa Formatting issues. 2020-02-18 12:51:22 +03:00
alexey-milovidov
b688fc5895
Merge pull request #9174 from azat/O_CLOEXEC
[RFC] Set O_CLOEXEC
2020-02-18 12:50:19 +03:00
Nikolai Kochetov
9b8fa9f306 Update TreeExecutor. 2020-02-18 12:05:49 +03:00
Nikolai Kochetov
426a8fd6a2 Update TreeExecutor. 2020-02-18 12:03:17 +03:00
CurtizJ
49c80c88ef Merge remote-tracking branch 'upstream/master' into alter-ttl 2020-02-18 10:58:07 +03:00
Nikolai Kochetov
e6a30feed0 Fix build. 2020-02-18 10:53:16 +03:00
Pavel Kovalenko
33443c4bea Merge branch 'master' into storage-stripe-log-s3
# Conflicts:
#	dbms/src/Compression/CompressedReadBufferFromFile.h
#	dbms/src/IO/ReadBufferFromFileBase.h
2020-02-18 00:29:09 +03:00
Azat Khuzhin
aa252e48b8 Set O_CLOEXEC
Since clickhouse allows to execute user-specified command (i.e.
for dictionary loading), it is better not to expose them.

But there is something left for now:
- 10 -> socket:[14422712]
- 11 -> socket:[14422714]
- 12 -> anon_inode:[eventpoll]
- 13 -> anon_inode:[eventpoll]
- 14 -> anon_inode:[eventpoll]
- 15 -> socket:[14426310]
- 16 -> anon_inode:[eventpoll]
- 3 -> /proc/2739071/fd
- 6 -> socket:[14422708]
- 9 -> socket:[14422710]

And most of these (eventpoll) went from poco, for which O_CLOEXEC cannot
be passed.
2020-02-18 00:28:11 +03:00
CurtizJ
7022376a2a remove debug prints 2020-02-17 23:45:16 +03:00
CurtizJ
2ff030be35 recalculate TTL expressions during mutations 2020-02-17 23:39:24 +03:00
Pavel Kovalenko
e849654628 Reworked ReadIndirectBuffer for DiskMemory. 2020-02-17 23:08:35 +03:00
alexey-milovidov
146109fe27
Merge pull request #9161 from abyss7/arcadia
Reorganize layout of repository (part 1)
2020-02-17 21:58:20 +03:00
Alexey Milovidov
a1ccd14032 Fixed error with zero bytes in haystack for constant case #9160 2020-02-17 21:53:59 +03:00
alesapin
a084ee8edd Fix style 2020-02-17 21:09:04 +03:00
alesapin
38450ccb6e Slightly better code 2020-02-17 21:07:22 +03:00
chertus
a9e743d8bd minor JoinSwitcher optimisation 2020-02-17 20:41:38 +03:00
chertus
5717d48333 better includes 2020-02-17 20:21:03 +03:00
alexey-milovidov
35f1a8ed51
Fixed awful translation 2020-02-17 20:12:22 +03:00
chertus
4a658f4325 swtich HashJoin to MergeJoin if JOIN limit exceeded 2020-02-17 20:08:31 +03:00
Nikolai Kochetov
bdaeafffc1 Processors support for StorageLiveView reading. 2020-02-17 19:37:18 +03:00
Nikolai Kochetov
fbfaac6391 Processors support for StorageLiveView reading. 2020-02-17 19:35:23 +03:00
alesapin
382f6ab720 More comments and slightly better code 2020-02-17 19:33:05 +03:00
Nikolai Kochetov
34d7873524 Processors support for StorageKafka reading. 2020-02-17 19:08:22 +03:00
alesapin
6a02b99faf Slightly refactor merger mutator 2020-02-17 18:44:13 +03:00
Nikolai Kochetov
98b6ad4eff Processors support for StorageXDBC reading. 2020-02-17 18:33:16 +03:00
Nikolai Kochetov
dda0bcb9ba Processors support for StorageXDBC reading. 2020-02-17 18:32:27 +03:00
Nikolai Kochetov
728ece09f1 Processors support for StorageView reading. 2020-02-17 18:27:51 +03:00
Nikolai Kochetov
4cc3eaa9ce Processors support for StorageValues reading. 2020-02-17 18:07:42 +03:00
Nikolai Kochetov
5372942aef Processors support for StorageURL reading. 2020-02-17 18:01:03 +03:00
Pavel Kovalenko
cf474e1f09 Fixed DiskMemory->readFile() test. 2020-02-17 18:00:39 +03:00
Nikolai Kochetov
df76f1fe56 Processors support for StorageTinyLog reading. 2020-02-17 17:45:10 +03:00
Ivan Lezhankin
102dad0ca0 Merge branch 'master' into arcadia 2020-02-17 17:37:10 +03:00
Nikolai Kochetov
9eda64fcf7 Update SelectStreamFactory. 2020-02-17 17:28:44 +03:00
Ivan Lezhankin
39ea079034 More clean-up 2020-02-17 17:27:09 +03:00
alesapin
b59fd72f34 Remove comment 2020-02-17 16:48:59 +03:00
alesapin
55192a652f Less changes 2020-02-17 16:41:53 +03:00
alesapin
7d7fdb389d Remove redundant error code 2020-02-17 16:37:16 +03:00
alesapin
72ed29f1e8 Remove some garbage from code 2020-02-17 16:35:17 +03:00
alesapin
e531e0a0ab Add test with bad alter 2020-02-17 16:20:09 +03:00
alesapin
47c649f6c3 Fix all style warnings 2020-02-17 15:47:34 +03:00
Alexey Milovidov
809b409426 Read the code 2020-02-17 15:44:58 +03:00
alesapin
777dfc774d One more test 2020-02-17 15:42:53 +03:00
Nikolai Kochetov
34e32db810 Fix build. 2020-02-17 14:55:32 +03:00
Nikolai Kochetov
bbdac39d2d Fix build. 2020-02-17 14:50:53 +03:00
alesapin
0a5403185c Add test for parallel detach and fix some bugs. 2020-02-17 14:31:42 +03:00
Nikolai Kochetov
f4d5175a12 Fix build. 2020-02-17 14:26:09 +03:00
Pavel Kovalenko
f3bec50d22 Fixed getPositionInFile() method usages. 2020-02-17 13:49:36 +03:00
Pavel Kovalenko
f9965a7d29 Merge branch 'master' into storage-stripe-log-s3
# Conflicts:
#	dbms/tests/config/disks.xml
2020-02-17 13:46:06 +03:00
Nikolai Kochetov
4599fbd798 Added force_tree_shaped_pipeline flag to SelectQueryInfo. 2020-02-17 13:42:14 +03:00
chertus
c2d6167f2a Merge branch 'master' into joins 2020-02-17 13:19:15 +03:00
Nikolai Kochetov
9b2d03f58c Fix StorageMerge. 2020-02-17 12:26:15 +03:00
alesapin
659fba4b97 Fix constraints 2020-02-17 11:57:59 +03:00
Alexey Milovidov
09e18f05ce Fixed error, added a test #9143 2020-02-17 09:54:24 +03:00
Alexey Milovidov
35e7197c8f Merge branch 'master' into bit-test-many-fuzz 2020-02-17 08:43:44 +03:00
Alexey Milovidov
b88238dffc Added 9th reason why parts can appear to be non byte-identical after download 2020-02-17 08:16:48 +03:00
alexey-milovidov
ca00c9c4cd
Merge pull request #9150 from ClickHouse/fix-bug-demangle
Fix bug in "demangle" function
2020-02-17 07:22:11 +03:00
alexey-milovidov
e0b6019878
Merge pull request #9014 from amosbird/joingetfix2
Fix joinGet with nullable return types.
2020-02-17 06:59:40 +03:00
alexey-milovidov
930cb5c3c3
Merge pull request #9152 from azat/poco-1.7.6-fix
Drop unused ALL_ADDRESSES const (fixes poco 1.7.6+dfsg1-5+deb9u1)
2020-02-17 06:58:35 +03:00
Amos Bird
0dee987831
Fix joinGet with nullable return types. 2020-02-17 07:32:32 +08:00
Azat Khuzhin
c2d7922413 Drop unused ALL_ADDRESSES const (fixes poco 1.7.6+dfsg1-5+deb9u1)
With poco 1.7.6+dfsg1-5+deb9u1:
  5  0x00007f9921e48085 in __cxa_throw ()
  6  0x00007f9918dfca88 in Poco::Net::IPAddress::IPAddress(void const*, unsigned int, unsigned int) () from /usr/lib/libPocoNet.so.46
  7  0x00007f9918dfcf91 in Poco::Net::IPAddress::operator&(Poco::Net::IPAddress const&) const () from /usr/lib/libPocoNet.so.46
  8  0x00007f991737a623 in DB::AllowedClientHosts::IPSubnet::set (this=0x7f991742afa0 <DB::(anonymous namespace)::ALL_ADDRESSES>, prefix_=..., mask_=...) at AllowedClientHosts.h:146
  9  0x00007f991737a2da in DB::AllowedClientHosts::IPSubnet::IPSubnet (this=0x7f991742afa0 <DB::(anonymous namespace)::ALL_ADDRESSES>, prefix_=..., mask_=...) at AllowedClientHosts.h:24
  10 0x00007f991737a0a2 in __static_initialization_and_destruction_0 (__initialize_p=1, __priority=65535) at AllowedClientHosts.cpp:25

Fixes: 2e4174a54c
2020-02-16 21:24:38 +03:00
Alexey Milovidov
01d4805989 Merge branch 'master' into bit-test-many-fuzz 2020-02-16 15:05:20 +03:00
Alexey Milovidov
9cd79c8a38 Fixed bug in "demangle" #8985 2020-02-16 14:55:45 +03:00
Alexey Milovidov
2e8d42a188 Additions to prev. revision 2020-02-16 13:44:24 +03:00
alexey-milovidov
355ff00c2e
Revert "Build fixes" 2020-02-16 11:48:01 +03:00
Ivan Lezhankin
4cedd4619d Code clean-up 2020-02-16 11:04:03 +03:00
Alexey Milovidov
724be6d08f Fixed fuzz test and incorrect behaviour of bitTestAll/Any functions 2020-02-16 09:46:29 +03:00
alexey-milovidov
41c883ace3
Merge pull request #8911 from millb/secure_password
Changed format for path in replicas
2020-02-16 07:17:12 +03:00
alexey-milovidov
4ebb240be6
Update Cluster.h 2020-02-16 07:13:54 +03:00
alexey-milovidov
5ebabe519f
Update Cluster.cpp 2020-02-16 07:12:48 +03:00
alexey-milovidov
480881563a
Slightly more readable. 2020-02-16 07:11:19 +03:00
alexey-milovidov
6f51f089ec
Merge pull request #9138 from ClickHouse/system-replicas-add-zookeeper-exception-column
Add zookeeper_exception column to system.replicas table.
2020-02-16 06:14:22 +03:00
alexey-milovidov
76f09ec883
Merge pull request #9052 from oandrew/reinterpret-fixedstring-bugfix
Use correct implementation for reinterpretAsFixedString
2020-02-16 06:11:13 +03:00
Alexey Milovidov
4ae404f794 Implement #9137 2020-02-15 03:13:00 +03:00
Alexey Milovidov
07479236d7 Implement #9137 2020-02-15 03:11:09 +03:00
alexey-milovidov
38c4f3ed84
Merge pull request #9131 from ClickHouse/better_temporary_live_view_syntax
Better CREATE syntax for temporary LIVE VIEW
2020-02-15 02:55:37 +03:00
alexey-milovidov
f836987f31
Merge pull request #9041 from proller/fix27
Build fixes
2020-02-15 02:51:18 +03:00
alexey-milovidov
4d0d32da23
Merge pull request #9091 from PerformanceVision/bit_on_bitset
Implement bit operations for FixedString datatype for doing bits operation on a bitset
2020-02-15 02:43:29 +03:00
alexey-milovidov
db1c67e3e3
Merge pull request #9100 from ClickHouse/issue-9094
Prevent abort on shutdown if the fs is readonly
2020-02-15 02:38:37 +03:00
CurtizJ
cb9936cbc4 better checking if we can use polymorphic parts 2020-02-15 00:33:02 +03:00
alesapin
88f46ac636 Add alters only for new mutations 2020-02-14 23:13:57 +03:00
Alexander Kuzmenkov
51815044c5
Merge pull request #8943 from ClickHouse/aku/flush-perf
[wip] Improve flush performance in SystemLog
2020-02-14 22:41:44 +03:00
proller
cf39e9d64a Merge remote-tracking branch 'upstream/master' into fix27 2020-02-14 21:28:09 +03:00
Alexander Tokmakov
6889951396 better syntax for temporary LIVE VIEW 2020-02-14 21:20:20 +03:00
Nikolai Kochetov
1685c4d689 Fix build. 2020-02-14 20:50:27 +03:00
Nikolai Kochetov
52a63275ea Merge with master. 2020-02-14 20:47:39 +03:00
Nikolai Kochetov
97f0e1ffdc Fix SelectStreamFactory. 2020-02-14 20:03:23 +03:00
Pavel Kovalenko
06e203d004 StorageStripeLog S3 support. 2020-02-14 17:28:33 +03:00
Nikolai Kochetov
ce6bcb77a2 Fix TreeExecutor. 2020-02-14 17:05:31 +03:00
Nikolai Kochetov
da6d43ea8a Fix TreeExecutor. 2020-02-14 17:00:39 +03:00
alesapin
42d0e27bfa Fix tests and bugs 2020-02-14 16:17:50 +03:00
Alexander Kuzmenkov
6b09956277 review fixes 2020-02-14 16:09:51 +03:00
alesapin
39e79bb1a2 Remove header 2020-02-14 14:16:45 +03:00
alesapin
11f30dcc61 Remove more comments 2020-02-14 14:15:05 +03:00
Nikolai Kochetov
96b5ef8459 Processors support for StorageStripeLog reading. 2020-02-14 13:57:09 +03:00
alesapin
389292f579 Removed alter thread 2020-02-14 13:35:39 +03:00
alesapin
958e217499 Additional metadata 2020-02-14 13:34:54 +03:00
Nikolai Kochetov
0766e46bcd Fix StorageFile. 2020-02-14 13:22:05 +03:00
alesapin
527325ef46 Correct startup logic 2020-02-14 13:17:04 +03:00
CurtizJ
ddb3a55f67 Merge remote-tracking branch 'upstream/master' into polymorphic-parts 2020-02-14 13:15:16 +03:00
Nikolai Kochetov
4cf65451de Update SelectStreamFactory. 2020-02-14 12:36:00 +03:00
Nikolai Kochetov
bb6d6a37b3 Fix build. 2020-02-14 12:28:13 +03:00
alesapin
d9ebec472b More simple 2020-02-14 12:24:00 +03:00
Guillaume Tassery
59ed5f65b5 Add bitNot function 2020-02-14 09:17:32 +01:00
Guillaume Tassery
ecbeba0f9e Set allow_fixed_string on operation instead of function generation 2020-02-14 08:11:37 +01:00
Guillaume Tassery
bad9848f2a use maybe_unused instead 2020-02-14 04:49:02 +01:00
CurtizJ
7041e28077 fix segfault in MergeTreeRangeReader 2020-02-14 00:20:35 +03:00
alesapin
199c22c363 Better naming 2020-02-13 23:09:48 +03:00
alexey-milovidov
7aeb900922
Merge pull request #8436 from achulkov2/polygon-dict-basic-interface-improvements
[WIP] Basic interface for polygon dictionaries
2020-02-13 21:05:42 +03:00
alesapin
78d42142cf Better 2020-02-13 19:16:09 +03:00
alesapin
8c160c7905 Better 2020-02-13 17:48:38 +03:00
CurtizJ
6e1734f2d7 remove rarely used createPart overload 2020-02-13 17:42:48 +03:00
alexey-milovidov
dcc6fbb7a6
Fixed idiotic translation. 2020-02-13 17:25:17 +03:00
CurtizJ
64e1883c06 better replication with compact parts 2020-02-13 17:19:43 +03:00
alexey-milovidov
296621f757
Merge pull request #9076 from sundy-li/mysql-show-tables
Show Queries more like MySQL did
2020-02-13 16:50:12 +03:00
alexey-milovidov
3cfcdcd79f
Update InterpreterShowTablesQuery.cpp 2020-02-13 16:46:35 +03:00
Alexey Milovidov
b5c79201c3 Prevent abort on shutdown if the fs is readonly 2020-02-13 16:15:54 +03:00
alesapin
e1bc499ea8 Remove comments 2020-02-13 16:13:23 +03:00
Guillaume Tassery
1642c7bb97 Merge branch 'master' of github.com:ClickHouse/ClickHouse into bit_on_bitset 2020-02-13 13:24:00 +01:00
Guillaume Tassery
d5b6b580c3 make happy gcc-9 2020-02-13 13:23:31 +01:00
alesapin
a6938cf5d9 Less verbose logging 2020-02-13 15:03:30 +03:00
alesapin
45ebf08925 Better 2020-02-13 14:38:04 +03:00
alesapin
e39b6dff54 Finally working code 2020-02-13 12:56:07 +03:00
Mikhail Korotov
5d1396ca33
Update Cluster.h 2020-02-12 17:32:18 +03:00
Ivan
bef233f450
Add simple memory profiler (#8765)
* Add new trace type to system.trace_log table

* [WIP]

* Add settings for soft limit raising.

* Remove unused diff

* Remove unused diff

* Some renames

* Fix client hanging on quit

* Remove obsolete pointer for trace collector in context.

* Use memory tracker on query level.

* Fix TSan tests

* Try to simplify TraceCollector initialization.

It allows to workaround first call inside signal handler

* Initialize TraceCollector before setting signal handlers

* Attempt to fix

* Fix Int64 → UInt64 for |size|

* Explicitly reset global TraceCollector instance.
2020-02-12 15:37:40 +03:00
Guillaume Tassery
4ea8cfb1e1 cosmetic 2020-02-12 12:45:31 +01:00
proller
4c3b8649e3 Merge remote-tracking branch 'upstream/master' into fix27 2020-02-12 13:59:14 +03:00
Guillaume Tassery
b9954f6785 Merge branch 'master' of github.com:ClickHouse/ClickHouse into bit_on_bitset 2020-02-12 11:35:07 +01:00
Guillaume Tassery
e5b048ab51 Can use bit(And|Or|Xor) using a bitset set as a FixedString 2020-02-12 11:33:43 +01:00
Mikhail Korotov
43d4838849 Merge branch 'secure_password' of https://github.com/millb/ClickHouse into secure_password 2020-02-12 13:13:50 +03:00
millb
6abeabc1f2 fixed bugs 2020-02-12 13:13:11 +03:00
Mikhail Korotov
5bd74b464d Merge branch 'secure_password' of https://github.com/millb/ClickHouse into secure_password 2020-02-12 13:08:10 +03:00
millb
92fc1a9b2b fixed bugs 2020-02-12 13:06:09 +03:00
alesapin
526428ffe0 Better 2020-02-12 13:00:24 +03:00
Mikhail Korotov
01b03f9b1f Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into secure_password 2020-02-12 11:43:52 +03:00
CurtizJ
59c4f53fec fix polymorphic parts fetching 2020-02-12 02:29:34 +03:00
Yatsishin Ilya
fbddec5c58 Merge remote-tracking branch 'origin' into qoega/random-table-function-small 2020-02-11 23:33:25 +03:00
Yatsishin Ilya
647994fea2 pcg64_oneseq -> pcg32 2020-02-11 23:32:45 +03:00
chertus
cbf99fa8b2 Merge branch 'master' into joins 2020-02-11 22:27:47 +03:00
Alexander Kuzmenkov
413cb601dd
Merge pull request #8969 from filimonov/kafka_producer_with_key_and_timestamp
key and timestamp in Kafka producer
2020-02-11 22:03:37 +03:00
chertus
d2d4118730 add JoinSwitcher 2020-02-11 21:28:37 +03:00
Ilya Yatsishin
5b4b04e13b
Merge pull request #9050 from CurtizJ/fix-range-reader
Fix order of ranges in MergeTreeDataSelectExecutor
2020-02-11 18:31:34 +03:00
Ivan Lezhankin
5644fa8c41 Explicitly reset global TraceCollector instance. 2020-02-11 18:16:53 +03:00
alesapin
9e0d4b0bd4 Seems to work 2020-02-11 17:54:46 +03:00
Yatsishin Ilya
a7ec7a6c4d pcg64 -> pcg64_oneseq 2020-02-11 17:05:51 +03:00
Yuriy
68eea2ba18 send string columns to mysql client as utf8 2020-02-11 16:58:49 +03:00
CurtizJ
b26a8b5622 choose part type while selecting parts to merge 2020-02-11 16:41:26 +03:00
sundy
250475557d Show Queries more like MySQL 2020-02-11 19:36:12 +08:00
Mikhail Korotov
f8db74fca6 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into secure_password 2020-02-11 13:51:37 +03:00
Artem Zuikov
840d4c5f4a
Merge pull request #9067 from 4ertus2/some
Refactoring: actualize ExpressionAnalyzer public interface
2020-02-11 13:48:56 +03:00
Yatsishin Ilya
9e609cc374 Merge branch 'master' of https://github.com/clickhouse/clickhouse into qoega/random-table-function-small 2020-02-11 13:13:10 +03:00
Yatsishin Ilya
db6764d0d6 Merge branch 'qoega/random-table-function-small' of github.com:qoega/clickhouse into qoega/random-table-function-small 2020-02-11 12:55:37 +03:00
Yatsishin Ilya
e2688e030d fix indufficient arguments parsing 2020-02-11 12:53:54 +03:00
Nikolai Kochetov
42692ad07b Fix typeo in ExternalModelsLoader. 2020-02-11 08:32:27 +03:00
CurtizJ
c72c38aea9 require strict part type in MergeTreeReaders 2020-02-10 23:30:49 +03:00
chertus
b4ea4ca654 actualize ExpressionAnalyzer public interface 2020-02-10 22:55:13 +03:00
Yatsishin Ilya
af34a659fa Merge remote-tracking branch 'origin' into qoega/random-table-function-small 2020-02-10 22:14:30 +03:00
alesapin
260a4687f0 Something working 2020-02-10 19:55:09 +03:00
CurtizJ
90a121cc1e remove useless line 2020-02-10 19:34:47 +03:00
CurtizJ
852772364e replace std::vector to std::deque for MarkRanges 2020-02-10 19:04:24 +03:00
Artem Zuikov
bd6d9a427b
Some InterpreterSelectQuery refactoring (#9035)
move ExpressionActionsChain logic out of InterpreterSelectQuery
2020-02-10 18:50:12 +03:00
Ivan Lezhankin
cc63739837 Fix Int64 → UInt64 for |size| 2020-02-10 18:24:26 +03:00
alesapin
2a866043aa some trash 2020-02-10 16:32:59 +03:00
tavplubix
4543177931 Merge pull request #9048 from ClickHouse/fix_mutation_order
Fix primary.idx corruption after delete mutation
2020-02-09 19:21:23 +03:00
Alexander Kuzmenkov
2b683f6fc9 boop 2020-02-09 17:15:29 +03:00
Alexander Kuzmenkov
dae3811e25
Merge pull request #9015 from Slach/master
Track the number of MySQL connections
2020-02-09 17:01:01 +03:00
alesapin
19de74d5bd Remove redundant lock 2020-02-09 11:52:42 +03:00
alesapin
2dca542d2e Correctly accuire lock 2020-02-09 11:42:15 +03:00
Andrew Onyshchuk
9d35b8b6ea Use correct implementation for reinterpretAsFixedString 2020-02-08 19:23:09 -06:00
alesapin
5a96eaf0e8 Add missed locks for ReplicatedMergeTree alter 2020-02-08 16:39:44 +03:00