Commit Graph

26123 Commits

Author SHA1 Message Date
CurtizJ
e5fad6d753 Merge remote-tracking branch 'upstream/master' into alter-ttl 2020-02-23 18:40:42 +03:00
Andrew Onyshchuk
d15ff3e8d5 Parquet improvements
- Read only required columns
- Avoid reading the entire file to RAM when possible
- Allow using internal parquet on darwin
2020-02-23 00:04:58 -06:00
alexey-milovidov
afc306091b
Merge pull request #9262 from ClickHouse/fix_expressions_in_metadata
Fix expressions in metadata
2020-02-23 04:32:55 +03:00
alexey-milovidov
b5e9e922fb
Update test.py 2020-02-23 04:31:12 +03:00
alexey-milovidov
cb89bcae25
Update PushingToViewsBlockOutputStream.cpp 2020-02-23 04:30:53 +03:00
alexey-milovidov
4a0873a93f
Update Settings.h 2020-02-23 04:30:22 +03:00
alexey-milovidov
c9cf1656b9
Merge branch 'master' into fix/ISSUES-8971 2020-02-23 04:16:23 +03:00
Alexey Milovidov
c902b27e25 Whitespaces 2020-02-23 04:04:59 +03:00
alexey-milovidov
d0fea62079
Merge pull request #8290 from CurtizJ/polymorphic-parts
Polymorphic parts (compact format).
2020-02-23 04:01:07 +03:00
Alexey Milovidov
55787391c6 Merge branch 'master' of github.com:yandex/ClickHouse into amosbird-char8_t 2020-02-23 00:30:19 +03:00
Alexey Milovidov
21647ed842 Fixed warning 2020-02-22 23:22:38 +03:00
Alexey Milovidov
6325d7514c Fixed warning 2020-02-22 23:07:22 +03:00
Alexey Milovidov
1ba67b1bb4 Fixed bad code 2020-02-22 22:44:31 +03:00
Alexey Milovidov
4c504ffda3 Fixed errors 2020-02-22 22:35:39 +03:00
Anton Popov
b736029828
Update ErrorCodes.cpp 2020-02-22 22:11:44 +03:00
alexey-milovidov
1950923433
Merge branch 'master' into polymorphic-parts 2020-02-22 20:56:27 +03:00
Alexey Milovidov
9e9cba6eb7 Merge remote-tracking branch 'origin/master' into amosbird-char8_t 2020-02-22 20:49:25 +03:00
alexey-milovidov
5d2bf946ee
Update Types.h 2020-02-22 20:42:00 +03:00
Vitaly Baranov
e026258f42
Update InterpreterSetRoleQuery.h 2020-02-22 19:32:15 +03:00
Alexander Tokmakov
852043c8d9 better configs 2020-02-22 17:26:39 +03:00
Alexander Tokmakov
ac0e2c2256 Merge branch 'master' into fix_expressions_in_metadata 2020-02-22 16:42:45 +03:00
alexey-milovidov
af3e296df5
Merge pull request #9306 from Vxider/build-fix
build fix on GCC 9.2.0
2020-02-22 14:41:34 +03:00
tavplubix
8358c952c3
Merge pull request #9302 from ClickHouse/fix_tests_with_secure_sockets
Try fix tests with secure sockets
2020-02-22 13:32:12 +03:00
Amos Bird
693cf211fa
Build fix 2020-02-22 16:44:23 +08:00
Vxider
ecd72b8478 build fix 2020-02-22 16:11:20 +08:00
Amos Bird
f5d6043a5d
Strict aliasing in c++20 2020-02-22 13:46:35 +08:00
Alexey Milovidov
c3e80485da
More strict aliasing 2020-02-22 10:19:39 +08:00
Alexey Milovidov
52153d15cc
More strict aliasing 2020-02-22 10:19:17 +08:00
Alexey Milovidov
cce1e46b45
More strict aliasing 2020-02-22 10:19:17 +08:00
Alexey Milovidov
ac83a28285
More strict aliasing 2020-02-22 10:17:52 +08:00
Alexey Milovidov
5cf3414b8a
More strict aliasing 2020-02-22 10:17:52 +08:00
Alexey Milovidov
3bf1e6f6c1
More strict aliasing 2020-02-22 10:17:25 +08:00
Alexey Milovidov
d3867ac5fa
More strict aliasing 2020-02-22 10:17:25 +08:00
Alexey Milovidov
e1b3c58746
More strict aliasing 2020-02-22 10:17:24 +08:00
Alexander Tokmakov
21e0eb5f11 try fix tests with secure sockets 2020-02-22 04:37:03 +03:00
Alexander Tokmakov
a13495485f try fix tests with secure sockets 2020-02-22 04:35:28 +03:00
Vitaly Baranov
c1e870d493
Merge pull request #9182 from vitlibar/RBAC-5.2
RBAC-5.2
2020-02-22 03:55:17 +03:00
Alexander Tokmakov
62e14bece0 revert changes in config 2020-02-22 03:45:53 +03:00
Alexander Tokmakov
d6205fa4fa Merge branch 'master' into fix_expressions_in_metadata 2020-02-22 03:17:15 +03:00
alexey-milovidov
66e7965381
Merge pull request #9294 from ClickHouse/colors-in-logs-sent-to-client
Colors in logs sent to client
2020-02-22 02:24:08 +03:00
alexey-milovidov
5cc112e3d3
Merge pull request #9293 from ClickHouse/akz/column_vector_replicate_faster
Made ColumnVector::replicate() implementation 3x faster
2020-02-22 02:23:49 +03:00
alexey-milovidov
55520b9629
Merge pull request #9289 from ClickHouse/fix-9134
Fix 9134
2020-02-22 02:23:00 +03:00
tavplubix
d720db86e5
Merge pull request #9288 from ClickHouse/enable_ssl_in_functional_tests
Enable secure sockets in stateless tests
2020-02-22 00:46:38 +03:00
robot-clickhouse
473e1eac6f Auto version update to [20.3.1.1] [54433] 2020-02-22 00:35:33 +03:00
robot-clickhouse
8646aaa261 Auto version update to [20.2.1.2443] [54432] 2020-02-22 00:35:00 +03:00
alexey-milovidov
67cb5c8fab
Merge pull request #9287 from ClickHouse/reading-the-code-of-alter-move-partition
Reading the code of ALTER MOVE PARTITION
2020-02-22 00:28:43 +03:00
alexey-milovidov
49b46fd897
Merge pull request #9257 from millb/disk_scheme_4
Space check from path/data/ for default disk
2020-02-22 00:27:49 +03:00
alexey-milovidov
716a7e907f
Merge pull request #9275 from 4ertus2/joins
Negative test for partial_merge_join variants
2020-02-22 00:26:05 +03:00
Alexey Milovidov
5f9a56a38a Colorize logs that are send to client with "send_logs_level" setting 2020-02-21 23:01:38 +03:00
alexey-milovidov
baf90fcfa2
Revert "Make SPLIT_SHARED_LIBRARIES=OFF more robust" 2020-02-21 22:52:18 +03:00
Alexander Kazakov
1c86a31431 Faster ColumnVector::replicate() 2020-02-21 22:47:20 +03:00
Alexander Kazakov
2e8dd9d9fc A unit test for ColumnVector::replicate() 2020-02-21 22:46:08 +03:00
Nikolai Kochetov
fddb021951 Added comment. 2020-02-21 22:17:09 +03:00
Nikolai Kochetov
23c5c6f874 Make more deterministic test. 2020-02-21 22:03:45 +03:00
Nikolai Kochetov
82489a4ba2 Added integration test from #9134 2020-02-21 22:01:43 +03:00
Alexander Tokmakov
9415ed821c enable secure sockets in stateless tests 2020-02-21 22:00:32 +03:00
Nikolai Kochetov
e7d2ff6d7a Added test from #9134. 2020-02-21 20:48:37 +03:00
Alexey Milovidov
0dbd885679 Reading the code of ALTER MOVE PARTITION 2020-02-21 19:57:40 +03:00
Nikolai Kochetov
350881a3da Copy block info in ConvertingBlockInputStream. 2020-02-21 19:57:22 +03:00
CurtizJ
14daa51cec add comments 2020-02-21 19:53:33 +03:00
Alexander Tokmakov
0201b485a7 enable secure ports for tests 2020-02-21 19:07:18 +03:00
Alexey Milovidov
396e9c57d0 Fixed OptimizedRegularExpression in case of empty regexp 2020-02-21 18:55:36 +03:00
Alexander Tokmakov
db669cef63 Merge branch 'master' into fix_expressions_in_metadata 2020-02-21 18:22:52 +03:00
alexey-milovidov
ee710dd1f7
Merge pull request #9235 from zhang2014/fix/ISSUES-9230
ISSUES-9230 pushed SelectQueryOption into join expression
2020-02-21 17:55:57 +03:00
alexey-milovidov
1e8389eceb
Merge pull request #8929 from ClickHouse/more-processors-for-storages
More processors for storage::read
2020-02-21 17:39:12 +03:00
alexey-milovidov
abe8315861
Merge pull request #9258 from Jokser/disk-s3-read-write-buffers-refactoring
Disk->writeFile() returns WriteBufferFromFileBase.
2020-02-21 17:28:49 +03:00
alexey-milovidov
bc910d3489
Trigger CI 2020-02-21 17:05:57 +03:00
Alexander Tokmakov
e117e5838e fixes 2020-02-21 16:44:44 +03:00
chertus
759d137162 add negative test for partial_merge_join variants 2020-02-21 16:16:59 +03:00
alesapin
2f6e22b4fd Fix failed integration tests 2020-02-21 11:53:29 +03:00
alesapin
582a9d99c1 Fix failed integration tests 2020-02-21 11:52:59 +03:00
Nikolai Kochetov
30d41b34ba Merged with master 2020-02-21 11:47:56 +03:00
Vitaly Baranov
cf25d225c6 Add tests for roles. 2020-02-21 06:03:09 +03:00
Vitaly Baranov
e017bacc48 Implement SQL queries for creating and controlling roles. 2020-02-21 06:03:09 +03:00
Vitaly Baranov
6671ca67eb Add access type ROLE_ADMIN. 2020-02-21 06:03:09 +03:00
Vitaly Baranov
ae18d443c8 Introduce roles. 2020-02-21 06:03:03 +03:00
Vitaly Baranov
fc8aa5efe7 Separate access-controlling access types. 2020-02-21 03:27:29 +03:00
Vitaly Baranov
543587fc46 Remove ATTACH and DETACH access types, check CREATE and DROP access types instead of them. 2020-02-21 03:27:29 +03:00
Vitaly Baranov
4f85c148b5 Move event handling away from Context. 2020-02-21 03:27:23 +03:00
alexey-milovidov
0f72781b1e
Trigger CI 2020-02-21 02:02:52 +03:00
alexey-milovidov
d1e26f5b35
Merge pull request #9163 from ClickHouse/match-zero-byte-fix
Fixed `match` and `extract` when haystack has zero bytes.
2020-02-21 02:01:50 +03:00
alexey-milovidov
219f94ca97
Merge pull request #9082 from 4ertus2/joins
Switch JOIN algo on the fly
2020-02-21 02:01:23 +03:00
Vitaly Baranov
6cac4a919b Improve behaviour of row policies, now it applies for a table always when defined for that table (even for another user). 2020-02-21 00:57:42 +03:00
Vitaly Baranov
5849dd2236 Slightly better solution for checking row policy for distributed tables,
now it checks both current user's and initial user's filters.
2020-02-21 00:57:42 +03:00
Vitaly Baranov
244c9d5325 Add class GenericRoleSet to represent a set of IDs of users and roles. 2020-02-21 00:57:42 +03:00
Vitaly Baranov
ed2061db8a Better pointers: std::shared_ptr<const QuotaContext> instead of std::shared_ptr<QuotaContext>, boost::atomic_shared_ptr instead of std::atomic_load/store. 2020-02-21 00:57:42 +03:00
Vitaly Baranov
9edea08b6d Improve parsers of access managing SQL. 2020-02-21 00:57:42 +03:00
Alexander Tokmakov
e1f5a620b5 more complex test and some fixes 2020-02-20 23:24:04 +03:00
Alexey Milovidov
2c8a6a2885 Fixed bad code 2020-02-20 22:38:18 +03:00
alesapin
f06bcee7bc Merge with master 2020-02-20 22:36:36 +03:00
chertus
aeefb78157 add comments to JoinSwitcher 2020-02-20 22:13:12 +03:00
Alexey Milovidov
d87e25aeab Merge branch 'master' of github.com:yandex/ClickHouse into match-zero-byte-fix 2020-02-20 21:52:50 +03:00
alexey-milovidov
d4381d7976
Merge pull request #9217 from ClickHouse/fix_mutations_finalization_one_more_time
Fix remove parts from mutations
2020-02-20 21:47:27 +03:00
alexey-milovidov
4433947670
Merge pull request #9227 from ClickHouse/simplier_alter_prepare
Simplier alter prepare
2020-02-20 21:45:27 +03:00
alexey-milovidov
5c097f842f
Merge pull request #9247 from ClickHouse/aku/logical-error-message
Log error message before aborting on LOGICAL_ERROR.
2020-02-20 21:45:01 +03:00
alexey-milovidov
f4124d3522
Merge pull request #9251 from 4ertus2/ast
Fix bug with comma JOIN and IN
2020-02-20 21:41:08 +03:00
alexey-milovidov
81f52614fd
Merge pull request #9255 from abyss7/log-alias
Don't use refs on vanishing objects
2020-02-20 21:16:32 +03:00
alexey-milovidov
79d194119b
Merge pull request #9254 from ClickHouse/fix-ndebuf-in-pipeline-executor
Fix NDEBUG in PipelineExecutor.
2020-02-20 21:16:11 +03:00
chertus
f683437a8c remove dangerous optimisation 2020-02-20 20:19:16 +03:00
Pavel Kovalenko
e593003be7 Formatting issues. 2020-02-20 19:48:52 +03:00
Pavel Kovalenko
e5b81aefe3 WriteBufferFromFileBase interface refactoring.
Disk->writeFile() returns WriteBufferFromFileBase.
DiskMemory read/write buffers refactoring.
2020-02-20 19:39:32 +03:00
millb
cf53160221 fixed bug 2020-02-20 19:21:28 +03:00
alexey-milovidov
a1193cbbf8
Merge pull request #9128 from Jokser/storage-stripe-log-s3
Storage Stripe Log S3 support.
2020-02-20 19:01:36 +03:00
Ivan Lezhankin
d211b1a482 Don't use refs on vanishing objects 2020-02-20 18:40:23 +03:00
Clément Rodriguez
1f275c965f Rebase with upstream/master 2020-02-20 16:32:05 +01:00
Nikolai Kochetov
9191e5f17f Fix NDEBUG in PipelineExecutor. 2020-02-20 18:26:20 +03:00
Nikolai Kochetov
b4cda92e64 Added test from #9151. 2020-02-20 17:57:50 +03:00
Nikolai Kochetov
cca4d4e296 More comments and remove spaces. 2020-02-20 17:40:58 +03:00
Alexander Tokmakov
c492ee93d9 fold constant expressions in storage engine arguments 2020-02-20 17:13:43 +03:00
chertus
9748f8dcf6 fix bug with comma join and in 2020-02-20 16:33:14 +03:00
alexey-milovidov
5d4a85488e
Merge pull request #9231 from abyss7/log-alias
Get marks from first non-alias column in Log storage
2020-02-20 16:20:21 +03:00
Clément Rodriguez
dd4353311f Merge remote-tracking branch 'upstream/master' 2020-02-20 14:07:37 +01:00
alesapin
0903faf5ca Fix one more test 2020-02-20 16:04:22 +03:00
alesapin
737a650824 Fix one more test 2020-02-20 16:02:58 +03:00
Ivan Lezhankin
ee2cb00aa1 Use getAllPhysical() 2020-02-20 15:46:27 +03:00
CurtizJ
3f7f13ce05 Merge remote-tracking branch 'upstream/master' into polymorphic-parts 2020-02-20 15:36:55 +03:00
Alexander Kuzmenkov
642e21e8e1 Log error message before aborting on LOGICAL_ERROR. 2020-02-20 15:29:53 +03:00
Nikolai Kochetov
84af9677be Try fix external tables for RemoteBlockInputStream 2020-02-20 14:29:12 +03:00
chertus
56fa3cc1eb correct fallback for PREFER_PARTIAL_MERGE: HashJoin -> MergeJoin instead of HashJoin -> JoinSwitcher 2020-02-20 14:26:00 +03:00
Nikita Mikhaylov
39f2e6b835
Merge pull request #9198 from nikitamikhaylov/copier-refactoring
clustercopier.cpp file splitting
2020-02-20 13:55:31 +03:00
alesapin
a576811c45 Better error codes and exception messages, remove duplicated headers 2020-02-20 13:48:48 +03:00
Yury Stankevich
c998e5f149 force deduplicate children test 2020-02-20 13:07:30 +03:00
Yury Stankevich
1d391e2841 add option to force deduplicate children 2020-02-20 13:06:56 +03:00
alesapin
cbd8b697c4 Better error codes and exception messages, remove duplicated headers 2020-02-20 13:04:15 +03:00
alexey-milovidov
64fe250eff
Merge pull request #9211 from ClickHouse/remove-useless-code-in-compression
Remove useless code
2020-02-20 13:02:20 +03:00
alexey-milovidov
eceabbfc3f
Merge pull request #9221 from nvartolomei/nv/advertise-a-stack-trace-will-follow
Improve stack trace formatting for Poco and std exceptions
2020-02-20 12:59:58 +03:00
alexey-milovidov
63aa168a8c
Merge pull request #9229 from 4ertus2/ast
Fix CROSS to INNER JOIN rewrite with [NOT] LIKE
2020-02-20 12:54:57 +03:00
Alexander Kazakov
5a67c02a5d
In KeyCondition: Fixed execution of inversed predicates for non-strictly monotinic functional index (#9223)
* Tests for functional index

* Fixed execution of inversed predicates in functional index

When non-strictly monotonic functional index is used inverted predicated
may be executed incorrectly, which leads to multiple problems: #8821,
#9034
2020-02-20 12:53:02 +03:00
alesapin
0034674330 Fix tests and small bug 2020-02-20 12:22:42 +03:00
alesapin
5282f8b59c Fix tests and small bug 2020-02-20 12:22:17 +03:00
Nikita Mikhaylov
23ceddebbc codestyle final 2 2020-02-20 12:06:00 +03:00
alesapin
91ac73a007 Add settings to storage in test 2020-02-20 11:50:26 +03:00
alesapin
2561e27ead Add settings to storage in test 2020-02-20 11:50:00 +03:00
zhang2014
130e76d5c0 ISSUES-9230 pushed SelectQueryOption into join expression 2020-02-20 11:15:59 +08:00
CurtizJ
2f30a1350b pass proper time for TTL 2020-02-20 03:24:05 +03:00
nikitamikhaylov
3c1f2b6124 style check final 2020-02-19 23:50:27 +03:00
alesapin
5be878fd02 Fix test 2020-02-19 23:45:50 +03:00
alesapin
e69fd2ac0d Fix test 2020-02-19 23:44:36 +03:00
nikitamikhaylov
6ca0776a61 Merge branch 'master' of github.com:ClickHouse/ClickHouse into copier-refactoring 2020-02-19 23:41:35 +03:00
alexey-milovidov
1f42d03bf8
Update SeekableReadBuffer.h 2020-02-19 22:26:33 +03:00
chertus
3d7959d2e8 fix join_algorithm and partial_merge_join settings check 2020-02-19 22:11:23 +03:00
Ivan Lezhankin
894c451cf0 Get marks from first non-alias column in Log storage 2020-02-19 21:06:18 +03:00
chertus
732c50408a disable crazy push down for test 2020-02-19 20:29:57 +03:00
chertus
fa8f07374b fix CROSS to INNER JOIN rewrite with [NOT] LIKE 2020-02-19 20:22:16 +03:00
CurtizJ
803d9da496 add test for mutations with TTL 2020-02-19 20:18:12 +03:00
Nikolai Kochetov
39916dd01a Remove readWithProcessors from IStorage. 2020-02-19 19:09:31 +03:00
Nikolai Kochetov
a3c4b2e922 Remove readWithProcessors from IStorage. 2020-02-19 19:07:28 +03:00
Nikolai Kochetov
e0c30259fb Remove readWithProcessors from IStorage. 2020-02-19 19:02:37 +03:00
Nikita Mikhaylov
caa4810c5c more codestyle 2020-02-19 18:59:47 +03:00
Nikita Mikhaylov
819a4ad6da codestyle 2020-02-19 18:45:49 +03:00
alesapin
60118b65d5 Better 2020-02-19 18:12:32 +03:00
Nikolai Kochetov
76a21b3364 Use processors for sending external tables. 2020-02-19 18:12:21 +03:00
Nikolai Kochetov
bf18eeda95 Use processors for sending external tables. 2020-02-19 18:09:32 +03:00
alesapin
c4972b3799 Better 2020-02-19 18:07:02 +03:00
Nikita Mikhaylov
24cbd0d6d1 squashed commits 2020-02-19 18:01:08 +03:00
alesapin
1914b1dab7 Add missed headers 2020-02-19 17:58:06 +03:00
CurtizJ
6bc5d988d5 tests for compact parts 2020-02-19 17:55:03 +03:00
Pavel Kovalenko
d4fa60f52d Rename disk_name -> disk. 2020-02-19 17:50:39 +03:00
alesapin
6020f2fd4a Remove redundant function 2020-02-19 17:50:11 +03:00
alesapin
d5b4ddf6d8 Simplier alter modify logic 2020-02-19 17:49:59 +03:00
alesapin
28b2a03b08 First version 2020-02-19 17:49:45 +03:00
alesapin
7a9b96a8f9 Remove redundant function 2020-02-19 17:43:34 +03:00
alesapin
3f29ea0756 Simplier alter modify logic 2020-02-19 17:39:01 +03:00
chertus
9f43fa87c3 make switched flag atomic 2020-02-19 17:23:21 +03:00
Clément Rodriguez
cdd99d7f23 Merge 2020-02-19 15:23:17 +01:00
CurtizJ
23592991e6 comments and refactoring 2020-02-19 17:07:36 +03:00
Nikolai Kochetov
3bfbd26901 Use processors for sending external tables. 2020-02-19 17:00:49 +03:00
Alexey Milovidov
add281dfe3 Enable metric_log by default 2020-02-19 16:39:20 +03:00
Nicolae Vartolomei
811197558c Improve stack trace formatting for Poco and std exceptions
Before:

```
<Error> Application: Caught exception while loading metadata: Poco::Exception. Code: 1000, e.code() = 0, e.displayText() = Access to file denied: boo0. /home/nv/clickhouse-master-clion/contrib/poco/Foundation/src/Exception.cpp:27: Poco::FileAccessDeniedException::FileAccessDeniedException(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&, int) @ 0xbb598cc in /state/home/nv/clickhouse-builds/clickhouse-master-clion-gcc/dbms/programs/clickhous
```

After:

```
<Error> Application: Caught exception while loading metadata: Poco::Exception. Code: 1000, e.code() = 0, e.displayText() = Access to file denied: boo, Stack trace (when copying this message, always include the lines below):

0. /home/nv/clickhouse-master-clion/contrib/poco/Foundation/src/Exception.cpp:27: Poco::FileAccessDeniedException::FileAccessDeniedException(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&, int) @ 0xbb5987c in /state/home/nv/clickhouse-builds/clickhouse-master-clion-gcc/dbms/programs/clickhous
```
2020-02-19 13:33:31 +00:00
chertus
1c297412d4 fix test 2020-02-19 16:10:03 +03:00
alesapin
3b4c27b0de Fix remove parts from mutations 2020-02-19 15:55:23 +03:00
alesapin
6f266c94ed Trying to simplify alter commands logic 2020-02-19 15:52:27 +03:00
alesapin
f85efc5522 SLightly more stable test 2020-02-19 15:50:46 +03:00
alesapin
ad51369982 Fix remove of actual_part from mutations 2020-02-19 15:50:11 +03:00
chertus
3348697128 fix storage join 2020-02-19 15:37:56 +03:00
Nikolai Kochetov
75af5414d9 Try fix test_delayed_replica_failover 2020-02-19 15:30:56 +03:00
alesapin
6eda5547a2 Revert redundant change 2020-02-19 15:00:45 +03:00
chertus
48ac7d35ae Merge branch 'master' into joins 2020-02-19 14:21:40 +03:00
chertus
f748427ffd minor fix (remove logic dependent on partial_merge_join setting) 2020-02-19 14:20:35 +03:00
Pavel Kovalenko
d662c1e006 Merge branch 'master' into storage-stripe-log-s3 2020-02-19 13:24:23 +03:00
Nikolai Kochetov
4fa6c86114 Fix StorageHDFS. 2020-02-19 13:22:44 +03:00
Nikolai Kochetov
70a7ddc172 Fix StorageURL 2020-02-19 13:17:49 +03:00
alexey-milovidov
b063dbeaf2
Merge pull request #8598 from excitoon-favorites/passttlsoverhttp
Pass TTL rule info with block to other replicas
2020-02-19 12:09:25 +03:00
alexey-milovidov
c5d5c9c11e
Merge pull request #9192 from nvartolomei/nv/format-version-file-typo
Fix typo in file name when reporting version file duplicates
2020-02-19 11:59:22 +03:00
alexey-milovidov
1c66c2f383
Merge pull request #9201 from CurtizJ/fix-range-reader
Fix mistake introduced in #9050.
2020-02-19 11:58:21 +03:00
alexey-milovidov
ebf4f98a0c
Merge pull request #9210 from Felixoid/profiling_docs
Add description for some profiling events
2020-02-19 11:55:52 +03:00
alexey-milovidov
77f9a358ff
Update ProfileEvents.cpp 2020-02-19 11:55:29 +03:00
alexey-milovidov
e90124dc24
Update ProfileEvents.cpp 2020-02-19 11:54:23 +03:00
Mikhail f. Shiryaev
fdc00e3562
Add description for some profiling events 2020-02-19 09:50:58 +01:00
Alexey Milovidov
b2a52a2d69 Remove useless code #9210 2020-02-19 11:49:26 +03:00
alesapin
c2d53438e1 Less flappy test and more comments 2020-02-19 11:45:09 +03:00
alexey-milovidov
9037a5d29a
Suggestion from Azat 2020-02-19 11:27:57 +03:00
CurtizJ
dea444b69c fix mistake in MergeTreeDataSelectExecutor 2020-02-19 00:00:51 +03:00
alesapin
f4b2be7b32 Remove parts from mutations on replica start 2020-02-18 22:57:48 +03:00
Pavel Kovalenko
ff50a51757 Formatting issues. 2020-02-18 22:13:37 +03:00
CurtizJ
b0f7905567 better TTL calculations with mutations 2020-02-18 22:03:40 +03:00
alesapin
1f4b42a99f Fix bug in initialization 2020-02-18 20:31:49 +03:00
chertus
74a5227ac4 add join_algorithm setting 2020-02-18 20:31:22 +03:00
Nikolai Kochetov
69a38958b4 fix PVS warning. 2020-02-18 19:23:29 +03:00
alesapin
d6f33cf161 More stable add drop test 2020-02-18 17:52:23 +03:00
Pavel Kovalenko
05ceef4ef8 Log family storages disk support via 'SETTINGS' clause. 2020-02-18 17:41:30 +03:00
Nikolai Kochetov
3f55e6a499 Processors support for StorageFromMergeTreeDataPart reading. 2020-02-18 17:24:33 +03:00
chertus
fbecd0c155 use default_max_bytes_in_join in JoinSwitcher if no join limits 2020-02-18 17:19:13 +03:00
Nikolai Kochetov
5d0d2b25e1 Update MergingSortedTransform 2020-02-18 17:15:50 +03:00
Nikolai Kochetov
41851b62e9 Fix TreeExecutorBlockInputStream 2020-02-18 16:29:40 +03:00
Nikolai Kochetov
49926098d3 Update BlockStreamProfileInfo 2020-02-18 16:16:30 +03:00
chertus
f1673e1344 fix JoinSwitcher logic 2020-02-18 15:41:23 +03:00
Pavel Kovalenko
0040ad3289 Fixed includes. 2020-02-18 15:24:20 +03:00
Nicolae Vartolomei
b612cbf7d8 Fix typo in file name when reporting version file duplicates 2020-02-18 11:44:16 +00:00
alesapin
b3fe0b51a1 Merge branch 'master' into alter_on_top_of_mutations 2020-02-18 14:32:12 +03:00
alesapin
db3ea6cca8 Better comments 2020-02-18 14:31:24 +03:00
Nikolai Kochetov
145cb6e12f Update TreeExecutorBlockInputStream. 2020-02-18 13:39:08 +03:00
Nikolai Kochetov
b6b4a87206 Update TreeExecutorBlockInputStream. 2020-02-18 13:37:57 +03:00
alexey-milovidov
9e4b29fe6c
Merge pull request #9156 from azat/SPLIT_SHARED_LIBRARIES-OFF_robust-build
Make SPLIT_SHARED_LIBRARIES=OFF more robust
2020-02-18 12:51:32 +03:00
Pavel Kovalenko
a8cffd55aa Formatting issues. 2020-02-18 12:51:22 +03:00
alexey-milovidov
b688fc5895
Merge pull request #9174 from azat/O_CLOEXEC
[RFC] Set O_CLOEXEC
2020-02-18 12:50:19 +03:00
alesapin
5507610e67 Less flapping test 2020-02-18 12:30:20 +03:00
Nikolai Kochetov
9b8fa9f306 Update TreeExecutor. 2020-02-18 12:05:49 +03:00
Nikolai Kochetov
426a8fd6a2 Update TreeExecutor. 2020-02-18 12:03:17 +03:00
alesapin
62791b8a4b More stable and more verbose tests 2020-02-18 12:02:40 +03:00
CurtizJ
49c80c88ef Merge remote-tracking branch 'upstream/master' into alter-ttl 2020-02-18 10:58:07 +03:00
Nikolai Kochetov
e6a30feed0 Fix build. 2020-02-18 10:53:16 +03:00
Azat Khuzhin
3bccd81752 Use -undefined,dynamic_lookup over --unresolved-symbols=ignore-all on OSX
Since OSX does not have later [1]:

    ld: unknown option: --unresolved-symbols=ignore-all
    clang: error: linker command failed with exit code 1 (use -v to see invocation)

  [1]: https://clickhouse-builds.s3.yandex.net/9156/eb89764d9dd631a9227ad9c36ad7d6f3ac8d0a4e/build_log_611498641_1581938330.txt
2020-02-18 07:09:24 +03:00
Azat Khuzhin
1313ec7d1b Make SPLIT_SHARED_LIBRARIES=OFF more robust
Refs: #6915
Closes: #9006
Fixes: #9005
2020-02-18 07:09:03 +03:00
Pavel Kovalenko
33443c4bea Merge branch 'master' into storage-stripe-log-s3
# Conflicts:
#	dbms/src/Compression/CompressedReadBufferFromFile.h
#	dbms/src/IO/ReadBufferFromFileBase.h
2020-02-18 00:29:09 +03:00
Azat Khuzhin
aa252e48b8 Set O_CLOEXEC
Since clickhouse allows to execute user-specified command (i.e.
for dictionary loading), it is better not to expose them.

But there is something left for now:
- 10 -> socket:[14422712]
- 11 -> socket:[14422714]
- 12 -> anon_inode:[eventpoll]
- 13 -> anon_inode:[eventpoll]
- 14 -> anon_inode:[eventpoll]
- 15 -> socket:[14426310]
- 16 -> anon_inode:[eventpoll]
- 3 -> /proc/2739071/fd
- 6 -> socket:[14422708]
- 9 -> socket:[14422710]

And most of these (eventpoll) went from poco, for which O_CLOEXEC cannot
be passed.
2020-02-18 00:28:11 +03:00
alexey-milovidov
3fcf2d4e78
Merge pull request #9155 from ClickHouse/obfuscator-overgenerate-data
clickhouse-obfuscator: allow to generate more data than was in source
2020-02-17 23:51:57 +03:00
CurtizJ
7022376a2a remove debug prints 2020-02-17 23:45:16 +03:00
CurtizJ
2ff030be35 recalculate TTL expressions during mutations 2020-02-17 23:39:24 +03:00
Pavel Kovalenko
e849654628 Reworked ReadIndirectBuffer for DiskMemory. 2020-02-17 23:08:35 +03:00
alexey-milovidov
146109fe27
Merge pull request #9161 from abyss7/arcadia
Reorganize layout of repository (part 1)
2020-02-17 21:58:20 +03:00
Alexey Milovidov
a1ccd14032 Fixed error with zero bytes in haystack for constant case #9160 2020-02-17 21:53:59 +03:00
Alexey Milovidov
808e27bf30 Added a test #9160 2020-02-17 21:52:10 +03:00
alesapin
a084ee8edd Fix style 2020-02-17 21:09:04 +03:00
alesapin
38450ccb6e Slightly better code 2020-02-17 21:07:22 +03:00
chertus
a9e743d8bd minor JoinSwitcher optimisation 2020-02-17 20:41:38 +03:00
chertus
5717d48333 better includes 2020-02-17 20:21:03 +03:00
alexey-milovidov
35f1a8ed51
Fixed awful translation 2020-02-17 20:12:22 +03:00
chertus
4a658f4325 swtich HashJoin to MergeJoin if JOIN limit exceeded 2020-02-17 20:08:31 +03:00
Nikolai Kochetov
bdaeafffc1 Processors support for StorageLiveView reading. 2020-02-17 19:37:18 +03:00
Nikolai Kochetov
fbfaac6391 Processors support for StorageLiveView reading. 2020-02-17 19:35:23 +03:00
alesapin
382f6ab720 More comments and slightly better code 2020-02-17 19:33:05 +03:00
Nikolai Kochetov
34d7873524 Processors support for StorageKafka reading. 2020-02-17 19:08:22 +03:00
alesapin
6a02b99faf Slightly refactor merger mutator 2020-02-17 18:44:13 +03:00
Nikolai Kochetov
98b6ad4eff Processors support for StorageXDBC reading. 2020-02-17 18:33:16 +03:00
Nikolai Kochetov
dda0bcb9ba Processors support for StorageXDBC reading. 2020-02-17 18:32:27 +03:00
Nikolai Kochetov
728ece09f1 Processors support for StorageView reading. 2020-02-17 18:27:51 +03:00
Nikolai Kochetov
4cc3eaa9ce Processors support for StorageValues reading. 2020-02-17 18:07:42 +03:00
Nikolai Kochetov
5372942aef Processors support for StorageURL reading. 2020-02-17 18:01:03 +03:00
Pavel Kovalenko
cf474e1f09 Fixed DiskMemory->readFile() test. 2020-02-17 18:00:39 +03:00
Nikolai Kochetov
df76f1fe56 Processors support for StorageTinyLog reading. 2020-02-17 17:45:10 +03:00
Ivan Lezhankin
102dad0ca0 Merge branch 'master' into arcadia 2020-02-17 17:37:10 +03:00
Nikolai Kochetov
9eda64fcf7 Update SelectStreamFactory. 2020-02-17 17:28:44 +03:00
Ivan Lezhankin
39ea079034 More clean-up 2020-02-17 17:27:09 +03:00
alesapin
b59fd72f34 Remove comment 2020-02-17 16:48:59 +03:00
alesapin
55192a652f Less changes 2020-02-17 16:41:53 +03:00
alesapin
7d7fdb389d Remove redundant error code 2020-02-17 16:37:16 +03:00
alesapin
72ed29f1e8 Remove some garbage from code 2020-02-17 16:35:17 +03:00
alesapin
e531e0a0ab Add test with bad alter 2020-02-17 16:20:09 +03:00
alesapin
f1a60b6843 Better names for replicas 2020-02-17 15:51:16 +03:00
alesapin
47c649f6c3 Fix all style warnings 2020-02-17 15:47:34 +03:00
Alexey Milovidov
809b409426 Read the code 2020-02-17 15:44:58 +03:00
alesapin
777dfc774d One more test 2020-02-17 15:42:53 +03:00
Nikolai Kochetov
34e32db810 Fix build. 2020-02-17 14:55:32 +03:00
Nikolai Kochetov
bbdac39d2d Fix build. 2020-02-17 14:50:53 +03:00
alesapin
0a5403185c Add test for parallel detach and fix some bugs. 2020-02-17 14:31:42 +03:00
Nikolai Kochetov
f4d5175a12 Fix build. 2020-02-17 14:26:09 +03:00
Pavel Kovalenko
cceaf69264 Change log_family_disk_memory test number. 2020-02-17 13:51:16 +03:00
Pavel Kovalenko
f3bec50d22 Fixed getPositionInFile() method usages. 2020-02-17 13:49:36 +03:00
Pavel Kovalenko
f9965a7d29 Merge branch 'master' into storage-stripe-log-s3
# Conflicts:
#	dbms/tests/config/disks.xml
2020-02-17 13:46:06 +03:00
Nikolai Kochetov
4599fbd798 Added force_tree_shaped_pipeline flag to SelectQueryInfo. 2020-02-17 13:42:14 +03:00
chertus
c2d6167f2a Merge branch 'master' into joins 2020-02-17 13:19:15 +03:00
Nikolai Kochetov
9b2d03f58c Fix StorageMerge. 2020-02-17 12:26:15 +03:00
CurtizJ
1612fefd66 better test 2020-02-17 12:21:57 +03:00
alesapin
4300cc523d Fix test 2020-02-17 12:12:01 +03:00
alesapin
659fba4b97 Fix constraints 2020-02-17 11:57:59 +03:00
Alexey Milovidov
d66d1c7930 Added a test for obfuscator 2020-02-17 11:05:48 +03:00
Alexey Milovidov
76153ed8ac clickhouse-obfuscator: allow to generate more data than was in source 2020-02-17 10:52:13 +03:00
Alexey Milovidov
09e18f05ce Fixed error, added a test #9143 2020-02-17 09:54:24 +03:00
Alexey Milovidov
35e7197c8f Merge branch 'master' into bit-test-many-fuzz 2020-02-17 08:43:44 +03:00
Alexey Milovidov
b88238dffc Added 9th reason why parts can appear to be non byte-identical after download 2020-02-17 08:16:48 +03:00
alexey-milovidov
ca00c9c4cd
Merge pull request #9150 from ClickHouse/fix-bug-demangle
Fix bug in "demangle" function
2020-02-17 07:22:11 +03:00
alexey-milovidov
e0b6019878
Merge pull request #9014 from amosbird/joingetfix2
Fix joinGet with nullable return types.
2020-02-17 06:59:40 +03:00
alexey-milovidov
930cb5c3c3
Merge pull request #9152 from azat/poco-1.7.6-fix
Drop unused ALL_ADDRESSES const (fixes poco 1.7.6+dfsg1-5+deb9u1)
2020-02-17 06:58:35 +03:00
Amos Bird
0dee987831
Fix joinGet with nullable return types. 2020-02-17 07:32:32 +08:00
Azat Khuzhin
c2d7922413 Drop unused ALL_ADDRESSES const (fixes poco 1.7.6+dfsg1-5+deb9u1)
With poco 1.7.6+dfsg1-5+deb9u1:
  5  0x00007f9921e48085 in __cxa_throw ()
  6  0x00007f9918dfca88 in Poco::Net::IPAddress::IPAddress(void const*, unsigned int, unsigned int) () from /usr/lib/libPocoNet.so.46
  7  0x00007f9918dfcf91 in Poco::Net::IPAddress::operator&(Poco::Net::IPAddress const&) const () from /usr/lib/libPocoNet.so.46
  8  0x00007f991737a623 in DB::AllowedClientHosts::IPSubnet::set (this=0x7f991742afa0 <DB::(anonymous namespace)::ALL_ADDRESSES>, prefix_=..., mask_=...) at AllowedClientHosts.h:146
  9  0x00007f991737a2da in DB::AllowedClientHosts::IPSubnet::IPSubnet (this=0x7f991742afa0 <DB::(anonymous namespace)::ALL_ADDRESSES>, prefix_=..., mask_=...) at AllowedClientHosts.h:24
  10 0x00007f991737a0a2 in __static_initialization_and_destruction_0 (__initialize_p=1, __priority=65535) at AllowedClientHosts.cpp:25

Fixes: 2e4174a54c
2020-02-16 21:24:38 +03:00
Alexey Milovidov
01d4805989 Merge branch 'master' into bit-test-many-fuzz 2020-02-16 15:05:20 +03:00
Alexey Milovidov
405630d38e Added test #8985 2020-02-16 14:58:54 +03:00
Alexey Milovidov
9cd79c8a38 Fixed bug in "demangle" #8985 2020-02-16 14:55:45 +03:00
alexey-milovidov
4db0eac979
Merge pull request #9149 from ClickHouse/fix-bad-join-test
Fixed non-deterministic test
2020-02-16 13:53:11 +03:00
Alexey Milovidov
2e8d42a188 Additions to prev. revision 2020-02-16 13:44:24 +03:00
alexey-milovidov
a3eac2688b
Merge pull request #9144 from ClickHouse/describe-query-profiler-when-unavailable
Describe reasons when query profiler cannot work
2020-02-16 11:57:59 +03:00
Alexey Milovidov
ecbc3c5f33 Fixed non-deterministic test 2020-02-16 11:54:41 +03:00
alexey-milovidov
355ff00c2e
Revert "Build fixes" 2020-02-16 11:48:01 +03:00
Ivan Lezhankin
4cedd4619d Code clean-up 2020-02-16 11:04:03 +03:00
Alexey Milovidov
3772ffdc9d Describe reasons when query profiler cannot work 2020-02-16 09:51:52 +03:00
Alexey Milovidov
63b7d6e5ac Describe reasons when query profiler cannot work 2020-02-16 09:49:24 +03:00
Alexey Milovidov
724be6d08f Fixed fuzz test and incorrect behaviour of bitTestAll/Any functions 2020-02-16 09:46:29 +03:00
alexey-milovidov
41c883ace3
Merge pull request #8911 from millb/secure_password
Changed format for path in replicas
2020-02-16 07:17:12 +03:00
alexey-milovidov
4ebb240be6
Update Cluster.h 2020-02-16 07:13:54 +03:00
alexey-milovidov
5ebabe519f
Update Cluster.cpp 2020-02-16 07:12:48 +03:00
alexey-milovidov
480881563a
Slightly more readable. 2020-02-16 07:11:19 +03:00
alexey-milovidov
6f51f089ec
Merge pull request #9138 from ClickHouse/system-replicas-add-zookeeper-exception-column
Add zookeeper_exception column to system.replicas table.
2020-02-16 06:14:22 +03:00
alexey-milovidov
76f09ec883
Merge pull request #9052 from oandrew/reinterpret-fixedstring-bugfix
Use correct implementation for reinterpretAsFixedString
2020-02-16 06:11:13 +03:00
Andrew Onyshchuk
55b9af60ca Add test for reinterpretAsFixedString 2020-02-15 17:49:32 -06:00
alesapin
0ff2b5170c Sleep some time after attach 2020-02-15 10:58:15 +03:00
Alexey Milovidov
4ae404f794 Implement #9137 2020-02-15 03:13:00 +03:00
Alexey Milovidov
07479236d7 Implement #9137 2020-02-15 03:11:09 +03:00
alexey-milovidov
e9af153819
Merge pull request #9126 from Melancholic/change_http_status
Fixed #5104. Return 503 status in /replicas_status if not ok
2020-02-15 02:59:18 +03:00
alexey-milovidov
7f581fb555
Merge pull request #9135 from den-crane/test-for-6143
tests for #6143 and #2314
2020-02-15 02:57:20 +03:00
alexey-milovidov
38c4f3ed84
Merge pull request #9131 from ClickHouse/better_temporary_live_view_syntax
Better CREATE syntax for temporary LIVE VIEW
2020-02-15 02:55:37 +03:00
alexey-milovidov
ab702acf12
Merge pull request #9105 from ClickHouse/aku/flap-faster
Make some performance tests faster.
2020-02-15 02:54:16 +03:00
alexey-milovidov
a264f4a4dc
Merge pull request #9061 from ClickHouse/aku/flappy-perf
Less flappy performance test queries
2020-02-15 02:53:10 +03:00
alexey-milovidov
f836987f31
Merge pull request #9041 from proller/fix27
Build fixes
2020-02-15 02:51:18 +03:00
alexey-milovidov
71c6430f10
Merge pull request #9129 from Jokser/disks-section-for-functional-tests
Added disks section for stateless functional testing.
2020-02-15 02:48:19 +03:00
alexey-milovidov
ec1191e4e8
Update disks.xml 2020-02-15 02:47:24 +03:00
alexey-milovidov
4d0d32da23
Merge pull request #9091 from PerformanceVision/bit_on_bitset
Implement bit operations for FixedString datatype for doing bits operation on a bitset
2020-02-15 02:43:29 +03:00
alexey-milovidov
db1c67e3e3
Merge pull request #9100 from ClickHouse/issue-9094
Prevent abort on shutdown if the fs is readonly
2020-02-15 02:38:37 +03:00
CurtizJ
cb9936cbc4 better checking if we can use polymorphic parts 2020-02-15 00:33:02 +03:00
Denis Zhuravlev
bef505a804 Merge branch 'test-for-6143' of github.com:den-crane/ClickHouse into test-for-6143 2020-02-14 16:43:41 -04:00
Denis Zhuravlev
cce9645848 test for #2314 2020-02-14 16:43:28 -04:00
Denis Zhuravlev
dada5cf6ca
Update 01080_engine_merge_prewhere_tupleelement_error.sql
optimize_move_to_prewhere=0
2020-02-14 16:17:29 -04:00
alesapin
88f46ac636 Add alters only for new mutations 2020-02-14 23:13:57 +03:00
Denis Zhuravlev
eec35ce32d test for #6143 2020-02-14 16:11:38 -04:00
Alexander Kuzmenkov
4c4448c04b
Update ngram_distance.xml 2020-02-14 22:49:54 +03:00
Alexander Kuzmenkov
e3abc3b60d
Update general_purpose_hashes_on_UUID.xml 2020-02-14 22:46:27 +03:00
Alexander Kuzmenkov
db0f2a5dba
Update codecs_int_insert.xml 2020-02-14 22:44:59 +03:00
Alexander Kuzmenkov
51815044c5
Merge pull request #8943 from ClickHouse/aku/flush-perf
[wip] Improve flush performance in SystemLog
2020-02-14 22:41:44 +03:00
alesapin
86b4ce2f24 Remove accident changes 2020-02-14 22:16:27 +03:00
CurtizJ
73b1ac0eac add integration tests for polymorphic parts 2020-02-14 22:11:51 +03:00
proller
cf39e9d64a Merge remote-tracking branch 'upstream/master' into fix27 2020-02-14 21:28:09 +03:00
Alexander Tokmakov
6889951396 better syntax for temporary LIVE VIEW 2020-02-14 21:20:20 +03:00
Nikolai Kochetov
1685c4d689 Fix build. 2020-02-14 20:50:27 +03:00
Nikolai Kochetov
52a63275ea Merge with master. 2020-02-14 20:47:39 +03:00
Nikolai Kochetov
97f0e1ffdc Fix SelectStreamFactory. 2020-02-14 20:03:23 +03:00
Pavel Kovalenko
7c585291b5 Added disks section for stateless functional testing. 2020-02-14 18:37:51 +03:00
Anton Popov
1162c22063
Merge pull request #9106 from CurtizJ/fix-range-reader
Fix segfault in MergeTreeRangeReader
2020-02-14 17:59:43 +03:00
Pavel Kovalenko
06e203d004 StorageStripeLog S3 support. 2020-02-14 17:28:33 +03:00
nagorny
15d3176d40 Ticket #5104. Return 503 status from /replicas_status if not ok 2020-02-14 17:20:27 +03:00
Nikolai Kochetov
ce6bcb77a2 Fix TreeExecutor. 2020-02-14 17:05:31 +03:00
Nikolai Kochetov
da6d43ea8a Fix TreeExecutor. 2020-02-14 17:00:39 +03:00
alesapin
42d0e27bfa Fix tests and bugs 2020-02-14 16:17:50 +03:00
Alexander Kuzmenkov
6b09956277 review fixes 2020-02-14 16:09:51 +03:00
alesapin
39e79bb1a2 Remove header 2020-02-14 14:16:45 +03:00
Alexander Kuzmenkov
191759ba17
Update set_hits.xml 2020-02-14 14:15:26 +03:00
alesapin
11f30dcc61 Remove more comments 2020-02-14 14:15:05 +03:00
Alexander Kuzmenkov
76e2065162
Update codecs_int_insert.xml 2020-02-14 14:12:44 +03:00
Alexander Kuzmenkov
e0b7755fa7
Update general_purpose_hashes_on_UUID.xml 2020-02-14 14:03:44 +03:00
Nikolai Kochetov
96b5ef8459 Processors support for StorageStripeLog reading. 2020-02-14 13:57:09 +03:00
alesapin
027744df66 Less seconds in test 2020-02-14 13:43:10 +03:00