Commit Graph

14995 Commits

Author SHA1 Message Date
Alexey Milovidov
72c0892246 Merge branch 'simdjson-update' of github.com:yandex/ClickHouse into simdjson-update 2019-08-03 23:12:52 +03:00
Alexey Milovidov
63f508ae04 Merge branch 'master' into simdjson-update 2019-08-03 23:12:24 +03:00
alexey-milovidov
72e3f35924
Merge pull request #6309 from yandex/compiler-no-defaultlibs
Avoid extra dependency in Compiler (used with compile = 1 setting)
2019-08-03 18:46:03 +03:00
Zhichang Yu
4f146eaa7e added bitmapRange function 2019-08-03 23:07:46 +08:00
Nikolai Kochetov
f2be163fb0 Do not check empty columns in header. 2019-08-03 16:51:56 +03:00
Nikita Vasilev
5ce205941a fix 2019-08-03 09:46:25 +03:00
alexey-milovidov
e9c2077c71
Merge pull request #6208 from vitlibar/write-buffer-call-next-impl-even-if-zero-offset
Fix formula for new_size in WriteBufferFromVector(AppendModeTag).
2019-08-03 06:27:31 +03:00
Alexey Milovidov
b9d39f4882 Merge branch 'master' into fastops 2019-08-03 06:24:33 +03:00
alexey-milovidov
349ad17436
Merge pull request #6298 from yandex/aku/uint816-nocache
Disable consecutive key optimization for UInt8/16.
2019-08-03 06:23:03 +03:00
alexey-milovidov
b1486015f4
Merge pull request #6301 from yandex/fix-thread-pool-hang-if-full
Fixed the possibility of hanging queries when server is overloaded
2019-08-03 06:21:08 +03:00
alexey-milovidov
309f14d924
Use SIMDJSON only on AVX2 machines as before. 2019-08-03 06:18:09 +03:00
Alexey Milovidov
ea98bd4ae2 Avoid extra dependency in Compiler (used with compile = 1 setting) 2019-08-03 06:01:13 +03:00
alexey-milovidov
2b6a28f617
Merge pull request #6279 from yandex/remove-cat-boost-pool
Removed table function "catBoostPool" and storage "CatBoostPool"
2019-08-03 04:59:55 +03:00
Alexey Milovidov
9f6e26f14d Fixed tests 2019-08-03 04:10:13 +03:00
alexey-milovidov
5537b151d9
Merge pull request #6305 from yandex/fix-fpe-in-yandex-consistent-hash
Fix FPE in yandexConsistentHash function
2019-08-03 04:05:38 +03:00
Alexey Milovidov
4f8d1872d2 Merge branch 'master' of github.com:yandex/ClickHouse into fix-thread-pool-hang-if-full 2019-08-03 02:51:46 +03:00
alexey-milovidov
0ee60229ea
Merge pull request #6303 from yandex/part-name-more-checks
More validation of part_name
2019-08-03 02:27:06 +03:00
Alexey Milovidov
11762f6eec Updated SIMDJSON 2019-08-03 02:24:50 +03:00
Alexey Milovidov
67f167605b Merge branch 'master' of github.com:yandex/ClickHouse into fastops 2019-08-03 01:58:53 +03:00
Alexey Milovidov
a5a6aaf8b1 Merge branch 'master' into fastops 2019-08-03 01:58:38 +03:00
alexey-milovidov
9af4542230
Merge pull request #6278 from yandex/fix_bool_settings_parsing
Fix bool settings parsing
2019-08-03 01:55:42 +03:00
alexey-milovidov
149ed67462
Merge pull request #6281 from yandex/fix-low-cardinality-aggregate-arguments
Fix LowCardinality arguments conversion in AggregateFunctionFactory
2019-08-03 01:50:21 +03:00
Alexey Milovidov
7394d3e73a Fixed exception message 2019-08-03 01:42:21 +03:00
Alexey Milovidov
62053314bb Fixed FPE in yandexConsistentHash 2019-08-03 01:40:28 +03:00
Alexey Milovidov
21cb7de777 More validation of part_name 2019-08-02 23:21:31 +03:00
alexey-milovidov
f149e3b436
Merge pull request #6277 from yandex/aku/pairnoinit
Make PairNoInit a simple struct.
2019-08-02 22:56:12 +03:00
alexey-milovidov
f8980e691e
Merge pull request #6274 from CurtizJ/ttl-old-parts
TTL improvements.
2019-08-02 22:51:28 +03:00
alexey-milovidov
12a8bf20eb
Merge pull request #6297 from 4ertus2/bugs
Fix crash on CAST exotic types to Decimal
2019-08-02 22:47:27 +03:00
Nikita Vasilev
bfa9a2c86f fixed index condition 2019-08-02 22:21:55 +03:00
alexey-milovidov
3e0ce7df58
Merge pull request #6249 from 4ertus2/joins
Fix join_use_nulls. Nulls in JOIN keys issue
2019-08-02 22:07:03 +03:00
Alexey Milovidov
e3927cf176 Merge branch 'master' into fastops 2019-08-02 22:04:38 +03:00
Alexey Milovidov
35a71506a5 Fixed error 2019-08-02 21:59:19 +03:00
Alexey Milovidov
a5105f85cf Removed table function "catBoostPool" and storage "CatBoostPool" 2019-08-02 21:52:43 +03:00
Alexey Milovidov
994ef14393 Fixed "unbundled" build 2019-08-02 21:51:39 +03:00
Nikolai Kochetov
a92f086600 Remove XMLRowOutputStream. 2019-08-02 20:39:24 +03:00
Nikolai Kochetov
6e3274ef98 Remove VerticalRowOutputStream. 2019-08-02 20:37:24 +03:00
Nikolai Kochetov
6234cb865a Remove ValuesRowOutputStream. 2019-08-02 20:19:10 +03:00
Nikolai Kochetov
1f6a16b03a Remove ValuesRowInputStream. 2019-08-02 20:16:58 +03:00
Alexey Milovidov
67d91c4b88 Fixed the possibility of hanging queries when server is overloaded 2019-08-02 20:14:04 +03:00
Nikolai Kochetov
e6b3f3f03a Remove TSKVRowInputStream. 2019-08-02 20:00:38 +03:00
Nikolai Kochetov
f820fff794 Remove TSKVRowInputStream. 2019-08-02 19:59:50 +03:00
Nikolai Kochetov
c336c514fb Remove TSKVRowInputStream. 2019-08-02 19:58:52 +03:00
Nikolai Kochetov
422b593570 Remove TSKVRowInputStream. 2019-08-02 19:56:52 +03:00
Nikolai Kochetov
ab914010e1 Remove TSKVRowInputStream. 2019-08-02 19:56:16 +03:00
Nikolai Kochetov
6ab2e19410 Remove TSKVRowInputStream. 2019-08-02 19:51:33 +03:00
Nikolai Kochetov
f809de0949 Remove TabSeparatedRowOutputStream and TSKVRowOutputStream. 2019-08-02 19:48:50 +03:00
Nikolai Kochetov
afb3c20778 Remove CSVRowOutputStream. 2019-08-02 19:37:33 +03:00
Nikolai Kochetov
e5d67cbe61 Remove ProtobufRowOutputStream. 2019-08-02 19:34:20 +03:00
Nikolai Kochetov
5fb548c994 Remove ProtobufRowOutputStream. 2019-08-02 19:31:17 +03:00
Nikolai Kochetov
8c66d106e4 Remove ProtobufRowInputStream. 2019-08-02 19:23:44 +03:00
Nikolai Kochetov
bd4f0182e4 Remove PrettyBlockOutputStreams. 2019-08-02 19:20:25 +03:00
Nikolai Kochetov
529e06e5cb Remove ParquetBlockOutputStream. 2019-08-02 19:09:52 +03:00
Nikolai Kochetov
fcecbbda73 Remove OParquetBlockInputStream 2019-08-02 19:00:24 +03:00
Nikolai Kochetov
978bdc4bfc Remove ODBCDriverBlockOutputStream. 2019-08-02 18:51:43 +03:00
Nikolai Kochetov
51bd715781 Remove ODBCDriver2BlockOutputStream. 2019-08-02 18:49:46 +03:00
Nikolai Kochetov
d57d8a609f Remove MySQLWireBlockOutputStream. 2019-08-02 18:45:21 +03:00
Nikolai Kochetov
4019f5e102 Remove JSONRowOutputStream. 2019-08-02 18:42:52 +03:00
Nikolai Kochetov
ce712d881a Remove JSONEachRowRowOutputStream. 2019-08-02 18:39:12 +03:00
Alexander Kuzmenkov
d808fafa8f Disable consecutive key optimization for UInt8/16.
These types use a FixedHashMap for aggregation, which makes lookup
almost free, so we don't have to cache the last lookup result.

This is a part of StringHashMap PR #5417 by Amos Bird.
2019-08-02 18:37:32 +03:00
Nikolai Kochetov
ae50ab6907 Remove JSONEachRowRowInputStream. 2019-08-02 18:36:36 +03:00
Nikolai Kochetov
cd299bb162 Remove JSONCompactRowOutputStream. 2019-08-02 18:32:07 +03:00
Nikolai Kochetov
2833ca6d2f Remove CapnProtoRowInputStream. 2019-08-02 18:28:13 +03:00
Nikolai Kochetov
342f044241 Remove BinaryRowOutputStream. 2019-08-02 18:25:32 +03:00
Nikolai Kochetov
03ece9dc99 Remove BinaryRowInputStream. 2019-08-02 18:21:48 +03:00
Nikolai Kochetov
dd90932222 Update FormatFactory. 2019-08-02 18:06:31 +03:00
Nikolai Kochetov
49632a74b7 Update FormatFactory. 2019-08-02 17:41:19 +03:00
chertus
fcc6a2c2be fix crash on CAST exotic types to decimal 2019-08-02 17:31:55 +03:00
Nikolai Kochetov
48818aef7f Update MySQLOutputFormat. 2019-08-02 15:41:21 +03:00
Nikolai Kochetov
0201cdf61a Merge branch 'master' into processors-and-output-formats 2019-08-02 15:29:19 +03:00
Nikolai Kochetov
77ca4acf67 Remove LowCardinality in AggregatingSortedBlockInputStream. 2019-08-02 13:54:40 +03:00
Nikolai Kochetov
5a9a4b23c3 Remove LowCardinality in AggregatingSortedBlockInputStream. 2019-08-02 13:50:42 +03:00
Nikolai Kochetov
f71ce27a70 Remove LowCardinality in AggregatingSortedBlockInputStream. 2019-08-02 13:49:52 +03:00
alesapin
46a6a78e7b Merge branch 'master' into fix_bool_settings_parsing 2019-08-02 10:51:42 +03:00
Alexey Milovidov
07273c7914 Instrumented ThreadPool 2019-08-01 23:09:38 +03:00
chertus
c5a661a05c undo wrong changes 2019-08-01 22:56:29 +03:00
chertus
94813b21ba restore names deduplication 2019-08-01 22:48:21 +03:00
Alexey Milovidov
c1de1d445c Enabled query profiler by default 2019-08-01 22:47:04 +03:00
chertus
479a0a9c8e fix case with several same keys in join 2019-08-01 22:39:39 +03:00
alesapin
af5cabd740 Fix changed logic 2019-08-01 22:30:00 +03:00
alexey-milovidov
5cf2f5f301
Merge pull request #6265 from nikitamikhaylov/query_log_enum
system.query_log: change data type of `type` column to Enum.
2019-08-01 22:21:43 +03:00
Nikita Vasilev
7aacbbdc5a fix bug 2019-08-01 22:18:36 +03:00
Alexey Milovidov
5c361c327b Enabled "precise" mode; updated tests 2019-08-01 22:17:49 +03:00
CurtizJ
d169f42b36 fix build 2019-08-01 22:07:31 +03:00
Nikolai Kochetov
a8378e8ef0 Fix LowCardinality arguments conversion for AggregateFunctionFactory. 2019-08-01 21:22:38 +03:00
alesapin
ca3796f0a3 Less branches 2019-08-01 20:46:37 +03:00
alesapin
7c37450c3d Better code and tests 2019-08-01 20:43:10 +03:00
chertus
4072214b5d fix UB in join keys order 2019-08-01 20:27:51 +03:00
alesapin
5b4b875497 Fix bool settings parsing in config 2019-08-01 20:03:34 +03:00
Alexander Kuzmenkov
011150fa8a Make PairNoInit a simple struct. 2019-08-01 19:54:33 +03:00
Nikita Mikhaylov
241751542e CamelCase 2019-08-01 19:37:50 +03:00
CurtizJ
82f304f81e add query 'SYSTEM STOP TTL MERGES' 2019-08-01 18:36:12 +03:00
Nikolai Kochetov
c228f18130 Update IRowInputFormat and FormatFactory. 2019-08-01 17:25:41 +03:00
Nikita Mikhaylov
9dbb758133 better style 2019-08-01 15:40:12 +03:00
Vitaly Baranov
d7891ec9cf Fix formula for new_size in WriteBufferFromVector(AppendModeTag). 2019-08-01 15:27:32 +03:00
tavplubix
6625536236
Merge pull request #6055 from yandex/csv_unquoted_nulls_and_default_values
CSV unquoted nulls and default values
2019-08-01 15:11:06 +03:00
CurtizJ
c30bdecf6d add missing comments 2019-08-01 15:00:35 +03:00
alexey-milovidov
e034dab1be
Merge pull request #6255 from yandex/storage-values-simplification
Simplified code with parsing table declaration for table functions.
2019-08-01 14:58:28 +03:00
Nikita Mikhaylov
406f7a2bfe done 2019-08-01 14:11:08 +03:00
CurtizJ
f224269d41 filter by ttl parts created before 'alter ... modify ttl' query with 'optimize ... final' query 2019-08-01 14:10:42 +03:00
Nikita Mikhaylov
a9fea0314e better style 2019-08-01 13:31:29 +03:00
Nikolai Kochetov
a5bb2e2b3f Update Schema name in Protobuf and CapnProto formats. 2019-08-01 12:56:30 +03:00
Nikolai Kochetov
9811fdcdc7 Update CapnProtoRowInputFormat. 2019-08-01 11:31:08 +03:00
alexey-milovidov
eeeab85bbe
Merge pull request #6247 from yandex/fix-malicious-replica
Fixed the case when malicious ClickHouse replica can force clickhouse-server to write to arbitrary path.
2019-08-01 07:22:58 +03:00
Alexey Milovidov
591af05e57 Fixed error with searching debug info 2019-08-01 06:45:33 +03:00
Alexey Milovidov
c3f54f85c1 Fixed error with "unbundled" build 2019-08-01 06:06:15 +03:00
Alexey Milovidov
a25890c038 Merge branch 'master' into fastops 2019-08-01 06:05:53 +03:00
Alexey Milovidov
12f6b75284 Fixed error 2019-08-01 05:34:58 +03:00
Alexey Milovidov
49b6749280 Merge branch 'master' into fix-malicious-replica 2019-08-01 05:11:45 +03:00
Alexey Milovidov
26bb14da4e Simplified table function "values" 2019-08-01 05:03:15 +03:00
alexey-milovidov
a8793fbef3
Merge pull request #6209 from dimarub2000/values_list
VALUES list
2019-08-01 04:36:04 +03:00
alexey-milovidov
10d02cd2b9
Merge pull request #6250 from yandex/better-stack-traces
QueryProfiler: better stack traces: start outside of signal handler
2019-08-01 04:34:32 +03:00
alexey-milovidov
e8cac8ab6e
Merge pull request #6253 from yandex/std-filesystem-2
Changed boost::filesystem to std::filesystem
2019-08-01 04:32:40 +03:00
Alexey Milovidov
ec2fd3e29d Added missing files 2019-08-01 04:17:44 +03:00
Alexey Milovidov
b1c9fc0233 Using FastOps library 2019-08-01 03:29:32 +03:00
Alexey Milovidov
fb3824f98b Merge branch 'master' into fastops 2019-08-01 01:59:59 +03:00
alexey-milovidov
a94fe354c5
Merge pull request #6233 from yandex/fix-overflow-in-int-div
Fixed overflow in intDiv functions
2019-08-01 01:39:37 +03:00
Alexey Milovidov
f3921ce3e0 Changed boost::filesystem to std::filesystem 2019-08-01 01:37:41 +03:00
Alexey Milovidov
e3c342d893 Better stack traces: start outside of signal handler 2019-08-01 00:40:29 +03:00
alesapin
cfbae59701
Merge pull request #6236 from yandex/fix_prewhere_remote
Fix bug in prewhere + distributed
2019-07-31 23:22:29 +03:00
chertus
10edd76fe4 fix join_use_nulls results for key columns 2019-07-31 23:19:52 +03:00
Alexey Milovidov
bc9d620155 Fixed the case when malicious ClickHouse replica can force clickhouse-server to write to arbitrary path 2019-07-31 22:31:04 +03:00
Alexey Milovidov
5cedc24e51 Fixed error 2019-07-31 21:04:24 +03:00
Dmitry Rubashkin
fab6e89a9d Minor style fixes 2019-07-31 18:58:28 +03:00
Dmitry Rubashkin
fbe7e56e93 Changed name and added comments 2019-07-31 18:43:01 +03:00
Dmitry Rubashkin
1ec249755e Parser is now used for ITableFunctionFileLike 2019-07-31 18:36:10 +03:00
Nikolai Kochetov
9c4aefe2ae Update ODBCDriver2BlockOutputFormat. 2019-07-31 18:10:51 +03:00
alesapin
f70b0ed910 Slightly better 2019-07-31 18:05:21 +03:00
Nikolai Kochetov
1347cf1359 Update ODBCDriver2BlockOutputFormat. 2019-07-31 17:58:56 +03:00
alesapin
aed4e5d1c4 Get type from source column 2019-07-31 17:57:14 +03:00
alesapin
4481bf429f Remove nulltype from assignment 2019-07-31 17:54:58 +03:00
Nikolai Kochetov
3a8fefdda8 Update CSVRowInputStream. 2019-07-31 17:43:08 +03:00
alexey-milovidov
ac5d2a225d
Merge pull request #6226 from yandex/aku/lock-tinylog
Lock the TinyLog storage when reading.
2019-07-31 17:40:55 +03:00
Nikita Mikhaylov
cac7972837 better 2019-07-31 17:18:59 +03:00
Nikolai Kochetov
f0bf083efc Update CSVRowInputStream. 2019-07-31 17:16:28 +03:00
Dmitry Rubashkin
a449a00e58 Comments are now in right places 2019-07-31 17:12:05 +03:00
Dmitry Rubashkin
f91c64bd28 parser changed, test modified, comments added 2019-07-31 17:06:22 +03:00
Nikita Mikhaylov
ad4459c4a2 fixed flush_logs + added pretty function 2019-07-31 17:03:23 +03:00
Nikolai Kochetov
4e38a45922 Update FormatFactory. 2019-07-31 16:26:08 +03:00
alesapin
2254e6fd32 Fix comment 2019-07-31 15:35:23 +03:00
alesapin
46c1e9d1a2 Use COPY_COLUMN instead of PROJECT 2019-07-31 15:33:58 +03:00
Nikolai Kochetov
2c638d577d Update VerticalRowOutputFormat. 2019-07-31 14:51:00 +03:00
chertus
f402ae5092 Merge branch 'master' into joins 2019-07-31 14:40:19 +03:00
Alexander Kuzmenkov
3ff143c60f Lock the TinyLog storage when reading.
Unlike StripeLog, we only have one set of files per column, so we can't
read concurrently with writing. We didn't use any locking before, and
that lead to user-visible error messages and tsan failures.
2019-07-31 13:59:12 +03:00
Nikolai Kochetov
77d81687b3 Update FormatFactory. 2019-07-31 13:54:50 +03:00
Nikolai Kochetov
2d5b282a31 Update FormatFactory. 2019-07-31 13:37:28 +03:00
Nikolai Kochetov
0e61ca79d0 Update FormatFactory. 2019-07-31 13:34:31 +03:00
Nikolai Kochetov
cc74c5ec78 Update FormatFactory. 2019-07-31 13:31:14 +03:00
Nikolai Kochetov
4bea8541d1 Update FormatFactory. 2019-07-31 13:28:54 +03:00
alesapin
e6052ec117 Fix bug in prewhere + distributed 2019-07-31 13:22:56 +03:00
Nikolai Kochetov
8bfd909f5b Update JSONEachRowRowOutputFormat. 2019-07-31 13:06:46 +03:00