Commit Graph

1974 Commits

Author SHA1 Message Date
alexey-milovidov
97d9f218af
Merge pull request #11296 from ClickHouse/fix-false-too-slow
Fix bug with Throttler and query speed estimation
2020-05-31 14:18:29 +03:00
Ewout
70eaae38f2 Fix visitParamExtractRaw for strings with unbalanced { or [.
Closes #11254 .
2020-05-31 00:58:30 +02:00
Alexey Milovidov
25f941020b Remove namespace pollution 2020-05-31 00:57:37 +03:00
Alexey Milovidov
5aff138956 Preparation for structured logging 2020-05-31 00:35:52 +03:00
Dmitry
4b0d32f026 Merge branch 'master' of github.com:yandex/ClickHouse into group_by_in_order_optimization 2020-05-31 00:21:02 +03:00
alexey-milovidov
383962e47c
Update trap.cpp 2020-05-30 23:45:30 +03:00
Alexey Ilyukhov
1b0c9fae6c Fix style 2020-05-30 23:15:35 +03:00
Alexey Milovidov
b95b6ec0ee Tested with "trap" function 2020-05-30 23:02:44 +03:00
Alexey Milovidov
9a41eb14a6 Fix build 2020-05-30 22:40:23 +03:00
Alexey Milovidov
09d2f19287 Better exception in case when there is shortage of memory mappings 2020-05-30 22:38:25 +03:00
Alexey Milovidov
43c2a46672 Fix very rare race condition in ThreadPool 2020-05-30 21:57:02 +03:00
Alexey Ilyukhov
853872b404 Fix style 2020-05-30 21:37:32 +03:00
alexey-milovidov
3eea042d16
Merge pull request #11243 from ClickHouse/remove-experimental-use-processors-flag-4
Remove some code.
2020-05-30 21:05:14 +03:00
alexey-milovidov
a5770fe041
Update PullingPipelineExecutor.cpp 2020-05-30 21:05:05 +03:00
Alexey Milovidov
421a62e978 Merge branch 'master' into fix-false-too-slow 2020-05-30 19:36:55 +03:00
Alexey Milovidov
41bfa8a275 Addition to prev. revision 2020-05-30 19:35:59 +03:00
Alexey Milovidov
326d2f9af8 Fix uninitialized memory in conversion 2020-05-30 19:21:14 +03:00
Alexey Milovidov
6468d7af8c Regenerate ya.make 2020-05-30 19:20:19 +03:00
Alexey Ilyukhov
3b78b010e5 Add empty line 2020-05-30 18:30:09 +03:00
Alexey Ilyukhov
b84c8fcbd8 Add allow_experimental_geo_types; add test 2020-05-30 18:26:19 +03:00
alexey-milovidov
1dbaf80a5d
Merge pull request #11303 from ClickHouse/fix-index-analysis-empty-array
Fix issue #11286; add a test
2020-05-30 17:28:00 +03:00
Alexey Milovidov
496fed5ed3 Remove "system_tables_lazy_load" option 2020-05-30 17:24:09 +03:00
Nikolai Kochetov
22cba267e3
Merge pull request #11295 from ClickHouse/abb-back-experimental_use_processors-setting
Revert setting.
2020-05-30 10:04:07 +03:00
Alexey Milovidov
ffdec23d08 Remove wrong code #8441 2020-05-30 01:43:25 +03:00
Alexey Milovidov
b78c48310b Whitespaces 2020-05-30 01:37:44 +03:00
Alexey Milovidov
8c8821475c Fix issue #11286; add a test 2020-05-30 00:32:35 +03:00
Alexey Milovidov
e4a329a47f Checking max execution speed on all nodes #5732 2020-05-29 23:37:37 +03:00
Alexey Milovidov
9768743d09 Whitespace 2020-05-29 23:17:38 +03:00
Ilya Yatsishin
393db8ff6c
Merge pull request #11261 from filimonov/kafka_log_with_prefix_and_facility
Add prefix & facility to librdkafka logs
2020-05-29 23:02:42 +03:00
Alexey Milovidov
fb5e1a8e8d Whitespaces 2020-05-29 22:54:59 +03:00
Alexey Milovidov
0eb2f4dee9 Change default value of "timeout_before_checking_execution_speed" to make it reasonable 2020-05-29 21:51:51 +03:00
Alexey Milovidov
9d39fc6dcb Fix bug with Throttler and query speed estimation 2020-05-29 21:23:45 +03:00
Nikolai Kochetov
36b1a37927 Revert setting. 2020-05-29 21:23:11 +03:00
tavplubix
a4e40fb5f2
Merge pull request #11269 from ClickHouse/add_context_to_idatabase_methods
Add context to IDatabase methods
2020-05-29 21:15:35 +03:00
alexey-milovidov
1abaca5174
Merge pull request #11276 from ClickHouse/fix-constraints-and-insert-performance
Fix constraints for DEFAULT fields; fix constraints for temporary tables; improve performance of INSERT for small blocks.
2020-05-29 20:04:59 +03:00
Anton Popov
e6a9a33010
Merge pull request #11183 from ClickHouse/consistent_metadata2
Refactor TTLs metadata (move them to IStorage).
2020-05-29 20:00:11 +03:00
Nikolai Kochetov
f7e0e87c7d Try fix tests. 2020-05-29 19:35:09 +03:00
alexey-milovidov
58c1d96582
Merge pull request #11208 from ClickHouse/escape-sequences-php-mysql-style
Experiment on parsing backslash escapes in a more convenient way #10922
2020-05-29 17:19:00 +03:00
alesapin
a429760641 Fix debug build 2020-05-29 17:10:09 +03:00
alexey-milovidov
304c6a1ee3
Merge pull request #11278 from vitlibar/fix-crash-set-default-role-with-wrong-args
Fix crash when SET DEFAULT ROLE is called with wrong arguments.
2020-05-29 16:24:42 +03:00
alexey-milovidov
9a4fd5cf56
Merge pull request #11272 from ClickHouse/fix-usage-of-fmtlib
Fix potential incorrect usage of fmtlib
2020-05-29 16:22:52 +03:00
Alexander Kuzmenkov
6e3bbf83e3 thread-local perf events 2020-05-29 16:04:32 +03:00
Nikolai Kochetov
bd814d83de Try fix tests. 2020-05-29 16:04:03 +03:00
Nikita Mikhaylov
9233997b24
Merge pull request #11233 from nikitamikhaylov/cache-getstring-bugfix
Cache-dictionary getString() bugfix
2020-05-29 16:32:35 +04:00
alesapin
748e8fbfc3 Merge with master 2020-05-29 14:03:11 +03:00
alesapin
2ff7bbb511 Better names 2020-05-29 13:56:04 +03:00
Dmitry
adcb88a1d5 turn OFF by default 2020-05-29 13:54:13 +03:00
alesapin
0170250c5e Merge branch 'master' into consistent_metadata2 2020-05-29 13:48:09 +03:00
Nikolai Kochetov
cf08299e43
Merge pull request #11249 from ClickHouse/fix-memory-tracked-description-race
Fix race for description in MemoryTracker.
2020-05-29 13:42:07 +03:00
Nikolai Kochetov
bbb57b7789 Try fix tests. 2020-05-29 13:31:19 +03:00
Alexander Kazakov
3f53b5b335
Fixed improper logging of failures in destructors of certain metrics (#11264) 2020-05-29 12:45:55 +03:00
Mikhail Filimonov
b885337454 Virtual columns for accessing kafka message headers 2020-05-29 10:44:10 +02:00
alesapin
9a34310ead
Merge pull request #11262 from ClickHouse/fix_unit_broken_tests
Fix unit broken tests
2020-05-29 11:18:46 +03:00
Vitaly Baranov
2d12b4d3ac Fix crash when SET DEFAULT ROLE is called with wrong arguments. 2020-05-29 09:54:27 +03:00
Alexey Milovidov
9120495c48 Increase chunk size for parallel parsing just in case 2020-05-29 05:31:45 +03:00
Alexey Milovidov
23d7947549 Fix constraints for DEFAULT fields; fix constraints for temporary tables; improve performance of INSERT for small blocks 2020-05-29 05:08:48 +03:00
Andrei Nekrashevich
af469c0da5 fix issues 2020-05-29 05:06:21 +03:00
alexey-milovidov
04bdffd9d7
Merge pull request #11255 from zlobober/proper_versions_in_arcadia
Use proper versions in Arcadia build.
2020-05-29 03:58:49 +03:00
Alexey Milovidov
e8f52337aa Fix incorrect usage of fmtlib 2020-05-29 03:09:12 +03:00
Alexander Tokmakov
c071e0a473 add context to DatabaseCatalog methods 2020-05-29 02:01:18 +03:00
alexey-milovidov
fb4d272f5b
Merge pull request #11258 from vitlibar/protobuf-fix-handling-bad-data
Fix handling bad data while reading in Protobuf format.
2020-05-28 23:26:20 +03:00
Alexander Tokmakov
3cff070f89 add context to IDatabase methods 2020-05-28 23:10:45 +03:00
Nikolai Kochetov
a9c6fa1ca7 Try fix tests. 2020-05-28 23:05:07 +03:00
alesapin
db72f39594 Remove error code 2020-05-28 22:07:20 +03:00
alesapin
026244b07f Better 2020-05-28 21:57:09 +03:00
alesapin
e9c1e1a7e4 Remove redundant header 2020-05-28 21:54:42 +03:00
alesapin
93801a1a9d Fix unit tests 2020-05-28 21:52:08 +03:00
Mikhail Filimonov
7211af9404 Fixing style 2020-05-28 20:19:10 +02:00
Mikhail Filimonov
b97ff8136b Make function static 2020-05-28 20:10:54 +02:00
alesapin
a95469020a Better error codes 2020-05-28 21:02:41 +03:00
Nikolai Kochetov
87b0ea26d3 Try fix tests. 2020-05-28 20:59:09 +03:00
Mikhail Filimonov
16de65a6f0 Add prefix & facility to librdkafka logs 2020-05-28 19:52:59 +02:00
Mikhail Filimonov
e39c4cdf71 Add _timestamp_ms virtual columns to Kafka engine 2020-05-28 19:41:57 +02:00
alesapin
eb5a8dccfa Fix ya.make 2020-05-28 20:32:22 +03:00
Dmitry
871539e4cc test and ya.make 2020-05-28 20:30:21 +03:00
Vitaly Baranov
d7cc703233
Merge pull request #11080 from vitlibar/add-authentication-type-to-system-users
Show authentication type in system.users table
2020-05-28 20:20:41 +03:00
alesapin
66ccb30299 Fix style check 2020-05-28 20:17:05 +03:00
alesapin
860dc2c814 Merge with consistent_metadata2 2020-05-28 19:45:51 +03:00
alesapin
c5fe87e123 Less includes 2020-05-28 19:32:35 +03:00
alesapin
acc3e6b15a Better structure 2020-05-28 19:31:27 +03:00
Pavel Kovalenko
51be859b16 S3 Poco HTTP Client WIP (timeouts + proxy support). 2020-05-28 19:11:27 +03:00
Nikolai Kochetov
534e55f5b5 try fix tests. 2020-05-28 19:01:12 +03:00
Vitaly Baranov
a452d037ef Fix handling bad data while reading in Protobuf format. 2020-05-28 18:41:20 +03:00
alesapin
c6f82590ad Add missed files 2020-05-28 18:34:33 +03:00
alesapin
61aff798d3 Compileable code 2020-05-28 18:33:44 +03:00
Nikolai Kochetov
ea3f638b30 Try fix tests. 2020-05-28 17:11:36 +03:00
Nikolai Kochetov
28cc6d9c6b Try fix tests. 2020-05-28 17:03:32 +03:00
alesapin
099bfc4657 Fix bug with empty column 2020-05-28 17:03:21 +03:00
Alexey Milovidov
71b7bb9c3a Merge branch 'master' into escape-sequences-php-mysql-style 2020-05-28 16:58:23 +03:00
Nikolai Kochetov
030aa6eac4 Fix build. 2020-05-28 16:57:01 +03:00
Mikhail Filimonov
4de1d6d421 Fixing style 2020-05-28 15:53:27 +02:00
Maxim Akhmedov
f5b1ab8e4a Use proper versions in Arcadia build. 2020-05-28 16:46:56 +03:00
alesapin
5f8b69547b More readable code 2020-05-28 16:45:08 +03:00
Mikhail Filimonov
6b694d54b4 Better kafka client.id 2020-05-28 15:39:55 +02:00
alesapin
f5e5290c0a Better naming 2020-05-28 16:09:03 +03:00
alesapin
5b5f749592 Split files 2020-05-28 16:03:18 +03:00
alesapin
26a9829e04 Indices description as vector 2020-05-28 15:47:17 +03:00
alesapin
52ca6b2051 I'm able to build it 2020-05-28 15:37:05 +03:00
Nikolai Kochetov
b71d520a3f Fix race for description in MemoryTracker. 2020-05-28 15:30:42 +03:00
alexey-milovidov
545c9e5bac
Merge pull request #11236 from abyss7/CLICKHOUSE-4856
Build universal ClickHouse binary with ya.make
2020-05-28 15:28:49 +03:00
Nikolai Kochetov
235fdc831b Merged with master. 2020-05-28 15:23:23 +03:00
Nikolai Kochetov
557e531ff3 Fix tests. 2020-05-28 15:06:31 +03:00
tavplubix
801c1c1240
Merge pull request #11205 from ClickHouse/fix-view-totals
Fix totals and extremes header for view.
2020-05-28 15:05:34 +03:00
Alexander Kuzmenkov
40b704fb61 remove some C 2020-05-28 15:03:22 +03:00
Nikolai Kochetov
2a9bcfbcd1 Fix build. 2020-05-28 14:00:12 +03:00
Nikolai Kochetov
da0052858d Fix build. 2020-05-28 13:57:04 +03:00
Alexander Kuzmenkov
3c18344b06 account for counter multiplexing 2020-05-28 13:48:34 +03:00
Nikolai Kochetov
6efa4d1d4f Fix style. 2020-05-28 13:41:59 +03:00
Pavel Kovalenko
29a5804342 S3 Poco HTTP Client WIP (rewind buffer). 2020-05-28 12:46:31 +03:00
Nikolai Kochetov
2a217e64e0
Merge pull request #11171 from Provet/master
Optimized partial sort transformer
2020-05-28 12:28:50 +03:00
Nikolai Kochetov
5572f6c276 Fix style. 2020-05-28 12:07:40 +03:00
Nikolai Kochetov
1fa795988f Remove some code. 2020-05-28 11:24:59 +03:00
Alexander Kuzmenkov
a697560738
Merge pull request #11224 from ClickHouse/aku/merge-arrow-stream
Merge ArrowStream format #11088
2020-05-28 09:37:40 +03:00
madianjun
e3c7ab2ca7 Add Kafka client.id 2020-05-28 08:32:51 +02:00
Vitaly Baranov
98172deffc Show authentication type in table system.users and while executing SHOW CREATE USER query. 2020-05-28 08:34:10 +03:00
Nikolai Kochetov
242ba74872
Merge pull request #11148 from ClickHouse/remove-experimental-use-processors-flag-3
Insert select with QueryPipeline
2020-05-28 07:47:59 +03:00
Andrei Nekrashevich
3c68ecacfe Added function fuzzBits 2020-05-28 05:51:37 +03:00
alexey-milovidov
69d5fd0edb
Merge pull request #11220 from ClickHouse/keep-metric-distributed-queue-on-exception
Keep the value of DistributedFilesToInsert metric on exceptions
2020-05-28 01:23:11 +03:00
Ivan Lezhankin
2432ea2c4b Build universal binary using ya make 2020-05-28 00:58:46 +03:00
Nikita Mikhaylov
ec479839d9 fixed 2020-05-27 22:44:22 +03:00
Pavel Kovalenko
677cb56a06 S3 Poco HTTP Client WIP. 2020-05-27 22:41:49 +03:00
alesapin
380c60a33f Intermediate stage (doesn't compile) 2020-05-27 21:38:34 +03:00
alexey-milovidov
dffeec8637
Merge pull request #10537 from expl0si0nn/ttl_expr_data_rollup
Support of WHERE and GROUP BY in TTL expressions
2020-05-27 21:35:55 +03:00
Nikolai Kochetov
2dcee3db5c Merge branch 'master' into remove-experimental-use-processors-flag-3 2020-05-27 21:25:34 +03:00
Nikolai Kochetov
e93882c977 Insert select using PipelineExecutor. 2020-05-27 21:20:26 +03:00
Alexander Kuzmenkov
640df68e05
Merge pull request #11184 from ClickHouse/enable-log-queries
Enable log_queries by default
2020-05-27 20:55:31 +03:00
Ivan
5b858de374
Split programs/server into actual program and library (#11186)
* Split programs/server into actual program and library
2020-05-27 20:52:52 +03:00
Pavel Kovalenko
a2dccc778c S3 Poco HTTP Client WIP (redirect support). 2020-05-27 19:56:17 +03:00
Albert Kidrachev
4c5324600b fix tests 2020-05-27 18:38:29 +03:00
Alexander Kuzmenkov
1658705f7c
Add URL/port.cpp to ya.make (a follow-up for #11120) 2020-05-27 18:29:22 +03:00
Pavel Kovalenko
2b07f69e57 S3 Poco HTTP Client WIP. 2020-05-27 18:02:25 +03:00
Alexander Kuzmenkov
4e566c3570 support new logging functions 2020-05-27 17:16:34 +03:00
alesapin
18656841a3 Implement methods for index struct 2020-05-27 16:34:23 +03:00
Alexander Kuzmenkov
db84f0e892 Merge remote-tracking branch 'origin/master' into HEAD 2020-05-27 16:30:13 +03:00
Albert Kidrachev
a727e1fb1b more relaxation 2020-05-27 15:57:14 +03:00
Alexander Kuzmenkov
ac263f921e Merge remote-tracking branch 'origin/master' into HEAD 2020-05-27 15:51:03 +03:00
Alexander Kuzmenkov
ad93644254 make single if 2020-05-27 15:50:12 +03:00
Alexander Kuzmenkov
c1cfc68cd6 revert accidental changes 2020-05-27 15:46:49 +03:00
Alexander Kuzmenkov
f54c892b49
Update src/Processors/Formats/Impl/ArrowBlockInputFormat.h 2020-05-27 15:41:59 +03:00
Alexander Kuzmenkov
61f833efc1
Update src/Processors/Formats/Impl/ArrowBlockInputFormat.h 2020-05-27 15:41:52 +03:00
Alexander Kuzmenkov
81a5af1938
Update src/Processors/Formats/Impl/ArrowBlockInputFormat.h 2020-05-27 15:41:45 +03:00
Alexander Kuzmenkov
0fc1268432
Merge pull request #11120 from azat/function-port
Add port() function
2020-05-27 15:27:06 +03:00
Albert Kidrachev
a0f99fde70 fix 2020-05-27 14:56:01 +03:00
Albert Kidrachev
d24286d5da fix 2020-05-27 14:52:45 +03:00
alesapin
c4b2f72fe6 Add common struct for skip indices 2020-05-27 14:25:02 +03:00
Nikolai Sorokin
57555dbabf Fix after rebase 2020-05-27 14:00:17 +03:00
alexey-milovidov
992f0dfec5
Merge pull request #11149 from filimonov/kafka_reschedule
Fixed reschedule issue in Kafka
2020-05-27 13:26:55 +03:00
Alexey Milovidov
146370934a Keep the value of DistributedFilesToInsert metric on exceptions 2020-05-27 13:07:38 +03:00
Anton Popov
f62adfd588 Fix Arcadia build 2020-05-27 12:53:15 +03:00
Nikolai Sorokin
e182d4df2e Fix context usage 2020-05-27 12:53:15 +03:00
Nikolai Sorokin
141ed88751 Allow functions in group by keys; Add default aggregate function; Add more tests 2020-05-27 12:53:15 +03:00
Nikolai Sorokin
7d937b43c7 Init with correct value 2020-05-27 12:53:15 +03:00
Nikolai Sorokin
6585571ee2 Fix bug 2020-05-27 12:53:15 +03:00
Nikolai Sorokin
c6541b1dad Up test id; Fix clang build 2020-05-27 12:53:15 +03:00
Nikolai Sorokin
1f02ba9692 Add eof 2020-05-27 12:53:15 +03:00
Nikolai Sorokin
66496dc7e3 Fix trailing spaces 2020-05-27 12:53:15 +03:00
Nikolai Sorokin
eeaf608aa9 Refactor code; support prefix of PK as GROUP BY key 2020-05-27 12:53:15 +03:00
Nikolai Sorokin
61974e0047 TTL Expressions WHERE and GROUP BY draft 2020-05-27 12:53:15 +03:00
alesapin
c7cda399c7 Merge branch 'master' into consistent_metadata2 2020-05-27 12:51:56 +03:00
alesapin
3399e573d1
Merge pull request #11199 from ClickHouse/fix_primary_key_method_call
Fix primary key check
2020-05-27 11:55:12 +03:00
Alexander Kuzmenkov
0db71f52a3
Merge pull request #10947 from ClickHouse/aku/inline-memory
Assert that allocator & container are consistent wrt. inline memory
2020-05-27 10:58:59 +03:00
Mikhail Filimonov
efc0b97707 Fix Kafka performance issue related to reschedules based on limits, which were always applied. 2020-05-27 07:39:06 +02:00
Dmitry
41d1cd1c9b fix bad merge 2020-05-27 01:17:32 +03:00
alexey-milovidov
4a48003905
Merge pull request #11207 from zlobober/adding_nested_storages
Make possible adding nested storages to MultipleAccessStorage in run-time
2020-05-27 01:02:50 +03:00
Alexey Milovidov
fb4089ab8e Fix error 2020-05-27 00:48:29 +03:00
Dmitry
112e86b134 small fix 2020-05-26 22:20:02 +03:00
Nikolai Kochetov
361b92f083
Merge pull request #11200 from ClickHouse/fix-strict-resize-finishing
Fix StrictResize
2020-05-26 21:31:44 +03:00
Dmitry
38c585f867 Merge branch 'master' of github.com:yandex/ClickHouse into group_by_in_order_optimization 2020-05-26 21:27:50 +03:00
Alexander Kuzmenkov
83aaea7b0f Merge remote-tracking branch 'origin/master' into HEAD 2020-05-26 18:29:42 +03:00
Alexey Milovidov
b2057159c1 Experiment on parsing backslash escapes in a more convenient way #10922 2020-05-26 17:24:20 +03:00
alesapin
9d0c28d96c Add missing methods 2020-05-26 17:14:08 +03:00
Maxim Akhmedov
e09bcb4290 Make possible adding nested storages to MultipleAccessStorage in run-time. 2020-05-26 17:05:06 +03:00
alesapin
8614487a5a Fix primary key check 2020-05-26 16:46:19 +03:00
Vasily Nemkov
28a2cc0a82 Functions {to,from}UnixTimestamp64{Milli,Micro,Nano}
* Family of functions to convert DateTime64 to Int64 and back, usefull for
   imporintg/exporting raw timestamp values of certain precision.
 * Docs
 * Tests
 * Fixed ya.make
2020-05-26 16:42:22 +03:00
Nikolai Kochetov
12384551da Fix totals and extremes header for views. 2020-05-26 16:19:24 +03:00
Nikolai Kochetov
e9d348ebf9
Merge pull request #11198 from ClickHouse/fix-step-by-step-pipeline-execution
Fix PipelineExecutor::executeStepImpl
2020-05-26 15:27:56 +03:00
alesapin
6626ef08e8 Fix PVS studio errors 2020-05-26 15:14:50 +03:00
Vitaly Baranov
2c8a355f19
Merge pull request #11081 from vitlibar/fix-no-password-mode
Fix settings NO_PASSWORD authentication mode in users.xml.
2020-05-26 14:20:34 +03:00
Vitaly Baranov
e27ded8798
Merge pull request #11172 from vitlibar/grpc-improve-build-scripts
Improve build scripts for protobuf & gRPC
2020-05-26 13:27:54 +03:00
Nikolai Kochetov
709f705886 Fix PipelineExecutor::executeStepImpl 2020-05-26 13:26:38 +03:00
Nikolai Kochetov
54f50745ec Fix StrictResizeProcessor. 2020-05-26 13:19:56 +03:00
alesapin
5780240e88 Fix primry key check 2020-05-26 12:46:04 +03:00
alesapin
7bbb064b34 Fix metadata update 2020-05-26 11:58:32 +03:00
Nikolai Kochetov
1f9e4996c7 Fix PipelineExecutor::executeStepImpl 2020-05-26 10:51:53 +03:00
Ilya Yatsishin
2b155ac989
Merge pull request #11185 from ClickHouse/fix-lambda-lc-args
Fix lambda lc args
2020-05-26 10:27:35 +03:00
Alexander Kuzmenkov
4b1bb43543
Merge pull request #11076 from ClickHouse/aku/join-error-messages
Better error messages about joins
2020-05-26 09:09:59 +03:00
Alexander Kuzmenkov
9d25ae22b5 Merge remote-tracking branch 'origin/master' into HEAD 2020-05-26 09:07:01 +03:00
Alexander Kuzmenkov
bf941755f2 fixup 2020-05-26 09:00:51 +03:00
Alexander Kuzmenkov
7142e68d7a fixup 2020-05-26 08:54:04 +03:00
Alexey Milovidov
c858f4d89c Clarifications 2020-05-26 02:47:21 +03:00
alexey-milovidov
d4acd1af3a
Merge pull request #11179 from excitoon-favorites/s3globfix
Fixed S3 globbing which could fail in case of more than 1000 keys and some backends
2020-05-26 02:45:42 +03:00
Alexey Milovidov
55a02c391d Style 2020-05-26 01:06:02 +03:00
Alexey Milovidov
4bb3381bc9 Fix build after merge 2020-05-26 00:53:29 +03:00
Nikita Mikhaylov
507d98b24b
Merge pull request #11006 from nikitamikhaylov/MorozovVasily-UpdatePermutation
Merging IColumn::updatePermutation
2020-05-26 01:42:41 +04:00
filimonov
73a0ef6c0e
Fix for the hang during deletion of engine=Kafka (one more time) (#11145)
* Added flag for safer rdkafka destruction, but more testing detected another hang case, which has no straigt solutions and can be workarounded currenly only by draining the consumer queue, so destructor is back

* After review fixes

* After review fixes2

* After review fixes3
2020-05-26 00:13:10 +03:00
Nikolai Kochetov
a01b6496b6 Fix types for function Capture. 2020-05-25 22:21:42 +03:00
alesapin
355fbadb31 Fix style 2020-05-25 22:18:01 +03:00
Ivan Blinkov
548fc7141a
Enable log_queries by default 2020-05-25 21:12:03 +03:00
alesapin
211d7e229f Better using 2020-05-25 21:03:04 +03:00
alesapin
adc7439a4c Comments and refactoring 2020-05-25 20:57:08 +03:00
alesapin
62e9f67639 Better 2020-05-25 20:25:18 +03:00
alesapin
d7c59bb4aa Merge branch 'master' into consistent_metadata2 2020-05-25 20:23:52 +03:00
alesapin
c3a6571036 Compilable code 2020-05-25 20:22:20 +03:00
alesapin
9b3cc9e525 Almost working ttl in IStorage 2020-05-25 20:07:14 +03:00
Vitaly Baranov
58a2172154 Improve build scripts related to protobuf and gRPC. 2020-05-25 18:46:57 +03:00
Nikita Mikhaylov
b48deb91ac comments and styles 2020-05-25 17:33:31 +03:00
Nikita Mikhaylov
b7adfc7c07 Merge branch 'master' of github.com:ClickHouse/ClickHouse into MorozovVasily-UpdatePermutation 2020-05-25 17:26:30 +03:00
Vladimir Chebotarev
7f9a257c31 Fixed S3 globbing which could fail in case of more than 1000 keys and some backends. 2020-05-25 15:57:32 +03:00
Artem Zuikov
04322b7b87 remove stale unit-test 2020-05-25 15:06:14 +03:00
Nikolai Kochetov
c83014bc76
Merge pull request #11114 from azat/max_threads-simple-query-optimization-fix
Do not reserve extra threads after max threads optimization for simple queries
2020-05-25 14:05:46 +03:00
alesapin
6281dd6893
Merge pull request #11115 from ClickHouse/consistent_metadata
Refactoring in storage metadata (more consistent keys)
2020-05-25 13:09:56 +03:00
Vitaly Baranov
eeb4cbc433 Fix settings NO_PASSWORD authentication mode in users.xml. 2020-05-25 11:35:26 +03:00
Alexander Kuzmenkov
8d5bbed2de Merge remote-tracking branch 'origin/master' into HEAD 2020-05-25 06:44:11 +03:00
Alexander Kuzmenkov
f1fb7245e5 Merge remote-tracking branch 'origin/master' into HEAD 2020-05-25 06:21:27 +03:00
Alexander Kuzmenkov
09129a6d21 Function for printing array of Asts 2020-05-25 06:19:46 +03:00
hcz
f2e3bcdd15 Improve code style in src and test files of Arrow formats 2020-05-25 10:50:55 +08:00
Alexander Kuzmenkov
3b888e4e33 Add rand32 alias 2020-05-25 04:03:46 +03:00
Albert Kidrachev
3abf7b7dcd fix 2020-05-25 03:32:08 +03:00
Albert Kidrachev
96260cf33a init 2020-05-25 02:56:24 +03:00
alexey-milovidov
bee5849c6a
Merge pull request #11137 from ClickHouse/logger-fmt
fmt-style logging, part 1
2020-05-25 01:38:14 +03:00
alexey-milovidov
16760936a3
Merge pull request #11168 from ClickHouse/radix-sort-experiments
Fix bugs in MSB Radix Sort
2020-05-24 23:31:42 +03:00
alexey-milovidov
9b09cfc611
Merge pull request #11165 from ClickHouse/fix-test-s3
Merging #11036
2020-05-24 22:18:35 +03:00
Alexey Milovidov
4ebf63fb23 Fixed error 2020-05-24 22:17:15 +03:00
Alexey Milovidov
9082a70ee6 Fix clang-tidy 2020-05-24 21:25:58 +03:00
Alexey Milovidov
01be2dadb3 Various comments 2020-05-24 21:05:06 +03:00
Alexey Milovidov
d0c0a0aed6 Unrolled histogram calculation 8 times 2020-05-24 18:51:23 +03:00
Alexey Milovidov
e99ed19586 Unrolled histogram calculation 2020-05-24 18:48:11 +03:00
Alexey Milovidov
04022f71b4 Added comment 2020-05-24 18:35:48 +03:00
Alexey Milovidov
4748de9c85 Fix partial radix sort: it was not working at all 2020-05-24 18:26:07 +03:00
Alexey Milovidov
5e7ea6500c Fix error 2020-05-24 17:48:53 +03:00
Alexey Milovidov
32158d9aee Trying to understand and fix the code of RadixSortMSD 2020-05-24 17:42:20 +03:00
Azat Khuzhin
c36708caf9 Split data skipping indexes from the order by to evaluate order by before merge 2020-05-24 16:12:08 +03:00
Azat Khuzhin
71731b2e99 Fix data skipping indexes for columns with additional actions during merge
For example for AggregatingMergeTree if the column in the data skipping
index is under some aggregate function, then data skipping index will be
incorrect.

Fix this by calculating data skipping indexes after aggregation has been
done.
2020-05-24 16:12:08 +03:00
Alexey Milovidov
a8e8bc4298 Added a comment 2020-05-24 13:49:43 +03:00
Alexey Milovidov
7fca4ce4d0 Added missing test @excitoon #11036 2020-05-24 13:44:03 +03:00
Alexey Milovidov
e3cd085230 Fix test (looks like it was incorrect) 2020-05-24 13:42:13 +03:00
alexey-milovidov
aa8f385085
Merge pull request #11159 from ClickHouse/fix-radix-sort
Fix radix sort after #10981
2020-05-24 02:31:45 +03:00
Alexey Milovidov
bff624e2ef Fix style 2020-05-24 01:30:43 +03:00
Alexey Milovidov
7e1813825b Return old names of macros 2020-05-24 01:24:01 +03:00
Alexey Milovidov
61cc605ee7 Remove old method 2020-05-24 01:21:29 +03:00
Alexey Milovidov
af2a59e49b Progress on task 2020-05-24 00:50:34 +03:00
Alexey Milovidov
d853bc39c5 Apply all transformations again 2020-05-24 00:41:48 +03:00
Alexey Milovidov
c87fb91532 Progress on task 2020-05-24 00:41:35 +03:00
Alexey Milovidov
93626701b8 Apply all transformations again 2020-05-24 00:27:27 +03:00
Alexey Milovidov
ce0619dabf Progress on task 2020-05-24 00:26:45 +03:00
Alexey Milovidov
2d7d5a1547 Apply all transformations again 2020-05-24 00:16:27 +03:00
Alexey Milovidov
bab24879e9 Progress on task 2020-05-24 00:16:05 +03:00
Alexey Milovidov
7c0c328a35 Progress on task 2020-05-24 00:05:47 +03:00
Alexey Milovidov
d2621fee30 Progress on task 2020-05-23 23:57:48 +03:00
Alexey Milovidov
e1695feb7f Apply all transformations again 2020-05-23 23:40:32 +03:00
Alexey Milovidov
38e3e273cd Progress on task 2020-05-23 23:39:59 +03:00
Alexey Milovidov
85f84550ba Progress on task 2020-05-23 23:37:37 +03:00
Azat Khuzhin
9de1a231c9 Add optional default_port argument for the port() function 2020-05-23 23:36:01 +03:00
Alexey Milovidov
f75587e562 Progress on task 2020-05-23 23:13:34 +03:00
Alexey Milovidov
18febd7b97 find {base,src,programs} -name '*.h' -or -name '*.cpp' | xargs grep -l -P 'LOG_[^\_(]+\([^,]+, "[^"]+" << [^<]+ << "[^"]+" << [^<]+ << "[^"]+" << [^<]+ << "[^"]+" << [^<]+ << "[^"]+"\);' | while read file; do perl -pne 's/(LOG_[^\_(]+)\(([^,]+), "([^"]+)" << ([^<]+) << "([^"]+)" << ([^<]+) << "([^"]+)" << ([^<]+) << "([^"]+)" << ([^<]+) << "([^"]+)"\);/${1}_FORMATTED(${2}, "${3}{}${5}{}${7}{}${9}{}${11}", ${4}, ${6}, ${8}, ${10});/' $file > ${file}.tmp; mv ${file}.tmp $file; done 2020-05-23 22:56:05 +03:00
Alexey Milovidov
cd6d3c7509 Progress on task 2020-05-23 22:55:06 +03:00
Alexey Milovidov
d5b7883451 find {base,src,programs} -name '*.h' -or -name '*.cpp' | xargs grep -l -P 'LOG_[^\_(]+\([^,]+, "[^"]+" << [^<]+ << "[^"]+" << [^<]+ << "[^"]+" << [^<]+ << "[^"]+"\);' | xargs sed -i -r -e 's/(LOG_[^\_(]+)\(([^,]+), "([^"]+)" << ([^<]+) << "([^"]+)" << ([^<]+) << "([^"]+)" << ([^<]+) << "([^"]+)"\);/\1_FORMATTED(\2, "\3{}\5{}\7{}\9", \4, \6, \8);/' 2020-05-23 22:41:08 +03:00
Alexey Milovidov
7e2fb9ad65 Apply all transformations again 2020-05-23 22:38:30 +03:00
Alexey Milovidov
eacff92d0e Progress on task 2020-05-23 22:35:08 +03:00
Alexey Milovidov
0ab3ca8534 Apply all transformations again 2020-05-23 22:32:44 +03:00
Alexey Milovidov
29762240de Remove duplicate whitespaces (preparation) 2020-05-23 22:31:54 +03:00
Alexey Milovidov
7fed65cbe2 Remove duplicate whitespaces (preparation) 2020-05-23 22:14:58 +03:00
Alexey Milovidov
86b4d5a86f Remove duplicate whitespaces (preparation) 2020-05-23 22:09:06 +03:00
Alexey Milovidov
ab0562a574 Make all LOG in single line (preparation) 2020-05-23 22:05:41 +03:00
Alexey Milovidov
9d2a0d2dd7 Apply all transformations again 2020-05-23 21:59:49 +03:00
Alexey Milovidov
a2ad11897f Remove duplicate whitespaces (preparation) 2020-05-23 21:53:58 +03:00
Alexey Milovidov
1f13515a65 Make all LOG in single line (preparation) 2020-05-23 21:31:37 +03:00
Alexey Milovidov
45b6abdfee Progress on task 2020-05-23 21:22:40 +03:00
Alexey Milovidov
3384f3b77e Progress on task 2020-05-23 21:07:38 +03:00
Alexey Milovidov
fc412f2d9d Progress on task 2020-05-23 20:59:03 +03:00
Alexey Milovidov
9d24908e53 Progress on task 2020-05-23 20:52:11 +03:00
Azat Khuzhin
409cff11df Add port() function
It uses domain() (getURLHost()) internally so it has the same
limitations:
- no ipv6 support
- no host-without-dots support (i.e. "foobar")
2020-05-23 20:45:56 +03:00
Alexey Milovidov
3a09f9ca1c find {base,src,programs} -name '*.h' -or -name '*.cpp' | xargs grep -l -P 'LOG_[^\W_]+\([^,]+, [^<+)"]+\);' | xargs sed -i -r -e 's/(LOG_[^\W_]+)\(([^,]+), ([^<+)"]+)\);/\1_FORMATTED(\2, \3);/' 2020-05-23 20:29:56 +03:00
Azat Khuzhin
aa656f95dd Fix compilation on osx (where UInt64 and size_t is different) 2020-05-23 20:28:40 +03:00
Alexey Milovidov
b3f4fe12dd Progress on task 2020-05-23 20:25:19 +03:00
Alexey Milovidov
d6bc4d2bd0 find {base,src,programs} -name '*.h' -or -name '*.cpp' | xargs grep -l -P 'LOG_\w+\([^,]+, [^<]+ << "[^"]+" << [^<]+\);' | xargs sed -i -r -e 's/(LOG_\w+)\(([^,]+), ([^<]+) << "([^"]+)" << ([^<]+)\);/\1_FORMATTED(\2, "{}\4{}", \3, \5);/' 2020-05-23 20:14:57 +03:00
Alexey Milovidov
57f6dc66d3 find {base,src,programs} -name '*.h' -or -name '*.cpp' | xargs grep -l -P 'LOG_\w+\([^,]+, "[^"]+" \+ [^+]+ \+ "[^"]+" \+ [^+]+ \+ "[^"]+" \+ [^+]+\);' | xargs sed -i -r -e 's/(LOG_\w+)\(([^,]+), "([^"]+)" \+ ([^+]+) \+ "([^"]+)" \+ ([^+]+) \+ "([^"]+)" \+ ([^+]+)\);/\1_FORMATTED(\2, "\3{}\5{}\7{}", \4, \6, \8);/' 2020-05-23 20:11:09 +03:00
Alexey Milovidov
7bc2b6bbbc find {base,src,programs} -name '*.h' -or -name '*.cpp' | xargs grep -l -P 'LOG_\w+\([^,]+, "[^"]+" \+ [^+]+ \+ "[^"]+" \+ [^+]+\);' | xargs sed -i -r -e 's/(LOG_\w+)\(([^,]+), "([^"]+)" \+ ([^+]+) \+ "([^"]+)" \+ ([^+]+)\);/\1_FORMATTED(\2, "\3{}\5{}", \4, \6);/' 2020-05-23 20:10:45 +03:00
Alexey Milovidov
241f8c5431 find {base,src,programs} -name '*.h' -or -name '*.cpp' | xargs grep -l -P 'LOG_\w+\([^,]+, "[^"]+" \+ [^+]+ \+ "[^"]+"\);' | xargs sed -i -r -e 's/(LOG_\w+)\(([^,]+), "([^"]+)" \+ ([^+]+) \+ "([^"]+)"\);/\1_FORMATTED(\2, "\3{}\5", \4);/' 2020-05-23 20:10:21 +03:00
Alexey Milovidov
f69cbdcbfc find {base,src,programs} -name '*.h' -or -name '*.cpp' | xargs grep -l -P 'LOG_\w+\([^,]+, "[^"]+" \+ [^+]+\);' | xargs sed -i -r -e 's/(LOG_\w+)\(([^,]+), "([^"]+)" \+ ([^+]+)\);/\1_FORMATTED(\2, "\3{}", \4);/' 2020-05-23 20:09:37 +03:00
Alexey Milovidov
f68d1ceb4f find {base,src,programs} -name '*.h' -or -name '*.cpp' | xargs grep -l -P 'LOG_\w+\([^,]+, "[^"]+" << [^<]+ << "[^"]+" << [^<]+ << "[^"]+" << [^<]+\);' | xargs sed -i -r -e 's/(LOG_\w+)\(([^,]+), "([^"]+)" << ([^<]+) << "([^"]+)" << ([^<]+) << "([^"]+)" << ([^<]+)\);/\1_FORMATTED(\2, "\3{}\5{}\7{}", \4, \6, \8);/' 2020-05-23 20:02:09 +03:00
Alexey Milovidov
533f86278a find {base,src,programs} -name '*.h' -or -name '*.cpp' | xargs grep -l -P 'LOG_\w+\([^,]+, "[^"]+" << [^<]+ << "[^"]+" << [^<]+ << "[^"]+"\);' | xargs sed -i -r -e 's/(LOG_\w+)\(([^,]+), "([^"]+)" << ([^<]+) << "([^"]+)" << ([^<]+) << "([^"]+)"\);/\1_FORMATTED(\2, "\3{}\5{}\7", \4, \6);/' 2020-05-23 20:00:41 +03:00
Alexey Milovidov
8042e5febe find {base,src,programs} -name '*.h' -or -name '*.cpp' | xargs grep -l -P 'LOG_\w+\([^,]+, "[^"]+" << [^<]+ << "[^"]+" << [^<]+\);' | xargs sed -i -r -e 's/(LOG_\w+)\(([^,]+), "([^"]+)" << ([^<]+) << "([^"]+)" << ([^<]+)\);/\1_FORMATTED(\2, "\3{}\5{}", \4, \6);/' 2020-05-23 19:58:15 +03:00
Alexey Milovidov
e391b77d81 find {base,src,programs} -name '*.h' -or -name '*.cpp' | xargs grep -l -P 'LOG_\w+\([^,]+, "[^"]+" << [^<]+ << "[^"]+"\);' | xargs sed -i -r -e 's/(LOG_\w+)\(([^,]+), "([^"]+)" << ([^<]+) << "([^"]+)"\);/\1_FORMATTED(\2, "\3{}\5", \4);/' 2020-05-23 19:56:05 +03:00
Alexey Milovidov
ee4ffbc332 find {base,src,programs} -name '*.h' -or -name '*.cpp' | xargs grep -l -P 'LOG_\w+\([^,]+, "[^"]+" << [^<]+\);' | xargs sed -i -r -e 's/(LOG_\w+)\(([^,]+), "([^"]+)" << ([^<]+)\);/\1_FORMATTED(\2, "\3{}", \4);/' 2020-05-23 19:47:56 +03:00
Alexey Milovidov
8d2e80a5e2 find {base,src,programs} -name '*.h' -or -name '*.cpp' | xargs grep -l -P 'LOG_\w+\([^,]+, "[^"]+"\)' | xargs sed -i -r -e 's/(LOG_\w+)\(([^,]+, "[^"]+")\)/\1_FORMATTED(\2)/' 2020-05-23 19:42:39 +03:00
Alexey Milovidov
e884800662 Remove commented code 2020-05-23 19:38:59 +03:00
Alexey Milovidov
35d79e1252 fmt-style logging, part 1 2020-05-23 19:33:07 +03:00
alexey-milovidov
08c7277d2b
Merge pull request #11144 from ClickHouse/dont-validate-polygons-in-non-constant-case
Fix performance issue with pointInPolygon
2020-05-23 18:54:50 +03:00
tavplubix
6ece9649f1
Merge pull request #11151 from naorlov/CLICKHOUSE-7224
Add `FailedQuery`, `FailedSelectQuery` and `FailedInsertQuery`
2020-05-23 18:47:44 +03:00
Alexey Milovidov
9c15e3ad92 Make it right 2020-05-23 18:29:43 +03:00
Alexey Milovidov
82f03fa8ce Fix loop unrolling 2020-05-23 18:22:04 +03:00
Alexey Milovidov
73a3394b3d Clarifications #10981 2020-05-23 17:28:22 +03:00
alexey-milovidov
ac6deaf8ec
Merge pull request #11036 from excitoon-favorites/s3fixes
Fixed parsing of S3 URL
2020-05-23 17:06:59 +03:00
alexey-milovidov
1d0043892b
Merge pull request #11155 from azat/dist-logging
Add table name into logs for StorageDistributed
2020-05-23 16:53:41 +03:00
alexey-milovidov
34eb533842
Merge pull request #10981 from g-arslan/master
Try to remove redundant data move in radix sort
2020-05-23 15:55:35 +03:00
Azat Khuzhin
0e12edb895 Fix max_threads simple query optimization for SELECT with subqueries
Fixes: 01245_limit_infinite_sources
2020-05-23 15:14:27 +03:00
Alexey Milovidov
2df7813177 Whitespaces 2020-05-23 14:52:45 +03:00
Alexey Milovidov
3e87b5fe72 Remove old TODO 2020-05-23 14:50:21 +03:00
Alexey Milovidov
8c63886ba6 Added a comment 2020-05-23 14:26:40 +03:00