Commit Graph

18203 Commits

Author SHA1 Message Date
Andrei Bodrov
5ae834d153 fix conflict 2019-12-18 13:02:04 +03:00
alesapin
8116351f09 Fix setting description 2019-12-18 12:20:33 +03:00
alesapin
f110b70ad8 Merge branch 'master' into synchronous_mutations 2019-12-18 12:00:14 +03:00
Alexey Milovidov
b90b090040 Addition to prev. revision 2019-12-18 08:26:17 +03:00
Alexey Milovidov
f804ff5d1a Make the setting obsolete 2019-12-18 08:19:56 +03:00
Alexey Milovidov
4ec492a50c Merge branch 'master' into update-llvm-bisect 2019-12-18 08:12:18 +03:00
Alexey Milovidov
6d58d85579 Fixed warnings 2019-12-18 08:12:03 +03:00
Alexey Milovidov
12f21dd584 Removed useless memset 2019-12-18 08:11:26 +03:00
Alexey Milovidov
0bc4a64b89 Attempt to make it working 2019-12-18 07:21:06 +03:00
alexey-milovidov
fcbd76815c
Merge branch 'master' into update-llvm-bisect 2019-12-18 04:22:10 +03:00
Alexey Milovidov
55dd76cdbf Fixed build 2019-12-18 03:38:20 +03:00
Alexey Milovidov
ffb506b073 Fixed build 2019-12-18 03:37:35 +03:00
Alexey Milovidov
8f67b0bf3d Returned normal LLVM headers in ExpressionJIT 2019-12-18 03:35:54 +03:00
Alexey Milovidov
5e9d7c1b9d Update to llvm-9.0.0 2019-12-18 02:29:48 +03:00
alexey-milovidov
a7384b4d07
Merge branch 'master' into MoreGCCWarnings 2019-12-18 02:01:39 +03:00
alexey-milovidov
06d124c073
Merge pull request #8229 from hczhcz/patch-2
Optimize rounding functions
2019-12-18 02:00:14 +03:00
alexey-milovidov
b2fcaff0dc
Merge pull request #8252 from 4ertus2/bugs
Fix crash in FULL JOIN with LowCard in key (attempt 2)
2019-12-18 01:58:56 +03:00
alexey-milovidov
c9887ccadc
Merge pull request #8250 from ClickHouse/no_mutation_number_by_default
No mutation number by default
2019-12-18 01:58:21 +03:00
Alexey Milovidov
eff1a95016 Update to 4637e15844661778c871b5f9642228e79a87e6e9 2019-12-18 01:09:29 +03:00
Alexey Milovidov
5378b2ade4 Update to 079df9ab2cd137141d5444f994ecc9721a6e2b68 2019-12-18 00:58:32 +03:00
Alexey Milovidov
5945644207 Update to 6cadc7c06ba 2019-12-18 00:51:47 +03:00
Alexey Milovidov
bc827c1649 Removed support for old LLVM 2019-12-18 00:00:01 +03:00
Alexander Kuzmenkov
89a2ec3944
Check Field type in get(). (#7386)
Allow silent conversion only between Int64 and UInt64.
2019-12-17 23:48:33 +03:00
alexey-milovidov
abd7e52272
Update S3Common.cpp 2019-12-17 18:38:50 +03:00
chertus
d7a2f45299 Fix crash in FULL JOIN with LowCard in key (attempt 2) 2019-12-17 18:02:42 +03:00
Pervakov Grigory
bdb9156843 Attach AWS SDK logging to CH logging system 2019-12-17 17:25:18 +03:00
Andrei Bodrov
3a7384b585 AvgData 2019-12-17 17:00:40 +03:00
alesapin
9a005d27ea Merge branch 'master' into synchronous_mutations 2019-12-17 15:27:36 +03:00
alesapin
b2979546c3 Fix mutation number by default 2019-12-17 15:23:17 +03:00
Vitaly Baranov
d0d5c72e4d Reloading of a dictionary now waits for results and shows errors.
Clearer names for load and reload functions in ExternalLoader.
2019-12-17 13:45:47 +03:00
Alexander Kuzmenkov
94b98e7f29
Set: initialize filter for Null values as well. (#8235)
Found with MemorySanitizer.
2019-12-17 13:20:04 +03:00
Alexander Kuzmenkov
8b1dae3f3d
Fix some implicit Field casts (#8209) 2019-12-17 13:19:21 +03:00
alesapin
3ad6b482ab
Merge pull request #8127 from ClickHouse/restrictions_for_external_dictionaries_from_ddl
Add restrictions for several sources of external dictionaries
2019-12-17 12:18:39 +03:00
Olga Khvostikova
b47863a0c6
Fix segfault in table function file while inserting into it (#8177)
* Fix segfault in table function file while inserting into it
2019-12-17 11:06:39 +03:00
alexey-milovidov
7092520617
Update BloomFilterHash.h 2019-12-17 08:46:46 +03:00
hcz
dabaef2836 Fix correctness 2019-12-17 10:57:11 +08:00
kreuzerkrieg
9612bb0e79 More GCC warnings 2019-12-16 23:19:50 +02:00
alesapin
a2180b0bb3 Merge branch 'master' into restrictions_for_external_dictionaries_from_ddl 2019-12-16 23:07:16 +03:00
alexey-milovidov
fcca420e91
Merge pull request #8231 from ClickHouse/enabling_values_optimization_by_default
Enable Values optimization by default
2019-12-16 22:13:50 +03:00
Alexey Milovidov
0bc1c6d91d Changes after review of #8034 2019-12-16 21:51:42 +03:00
Alexey Milovidov
0042c8271e Changes after review of #8034 2019-12-16 21:41:51 +03:00
alexey-milovidov
12b3dcdcb8
Merge pull request #8034 from hombit/h3support
h3 functions required for circle search
2019-12-16 21:35:19 +03:00
alexey-milovidov
ed942ce29c
Update h3kRing.cpp 2019-12-16 21:34:51 +03:00
Konstantin Malanchev
f0b6a540ec Fix style of registerFunctionsGeo.cpp 2019-12-16 20:46:39 +03:00
Konstantin Malanchev
590627a658 Add h3EdgeAngle function 2019-12-16 20:46:39 +03:00
Konstantin Malanchev
1c1794d3d8 Add h3EdgeLengthM function 2019-12-16 20:46:38 +03:00
Konstantin Malanchev
9937fc7ff9 Add h3kRing function 2019-12-16 20:46:38 +03:00
alesapin
2695aa13c4 Add ability to execute mutations asynchronously 2019-12-16 18:51:15 +03:00
Alexander Tokmakov
9e566d997e fix insert select from mysql(...) 2019-12-16 17:28:44 +03:00
hcz
a563ad0b21 Optimize rounding functions 2019-12-16 18:39:35 +08:00
Alexander Tokmakov
cab852dd0e enable values optimization by default 2019-12-16 12:25:31 +03:00
alexey-milovidov
bf1414cc76
Merge pull request #8225 from ClickHouse/tcmalloc-deprecate
Deprecate tcmalloc
2019-12-16 03:20:56 +03:00
Alexey Milovidov
952351a033 Fixed build after merge 2019-12-16 02:54:56 +03:00
alexey-milovidov
575984b4a0
Merge pull request #8189 from ClickHouse/regions-more-languages
More languages for regions
2019-12-16 02:47:20 +03:00
alexey-milovidov
d0ef4b6b96
Merge branch 'master' into more-accurate-using-load-reload 2019-12-16 02:42:45 +03:00
alexey-milovidov
38353d1253
Merge pull request #8197 from filimonov/fix_kafka_mv_subqueries
Init query context for Kafka to make subqueries work
2019-12-16 02:40:00 +03:00
Alexey Milovidov
ebf16a8a17 Deprecated tcmalloc 2019-12-16 01:37:27 +03:00
alexey-milovidov
3399f9a73c
Merge pull request #8112 from hczhcz/patch-1210
Add function bankerRound
2019-12-15 23:57:13 +03:00
Andrei Bodrov
cae40d3d94 fix name, add exception, add tests 2019-12-15 16:36:44 +03:00
hcz
3ff7c1e4dc Improve roundBankers implementation 2019-12-15 16:30:54 +08:00
Alexey Milovidov
6a34958fd2 Minor modifications 2019-12-15 02:00:18 +03:00
alexey-milovidov
3a265cd9f3
Merge pull request #8213 from ClickHouse/fix-exists-query
Fixed segfault in EXISTS query
2019-12-14 23:02:08 +03:00
Vitaliy Zakaznikov
cf22cde702 Merge branch 'master' of https://github.com/vzakaznikov/ClickHouse into live_view_support_for_subquery 2019-12-14 19:21:44 +01:00
Vitaliy Zakaznikov
0f9450433f * Reverting back to the old logic.
* Removing redundant catch clauses.
* Updating createStorage function signature in StorageBlocks.h.
2019-12-14 18:29:34 +01:00
alexey-milovidov
cd556a35e6
Merge pull request #8210 from 4ertus2/bugs
Fix `There's no column` error for materialized and alias columns
2019-12-14 19:45:07 +03:00
alexey-milovidov
39a8f1e9c7
Merge pull request #8202 from zhang2014/feature/support_drop_mysql_database
ISSUES-6063 support drop mysql database engine
2019-12-14 19:44:17 +03:00
alexey-milovidov
e009584086
Merge pull request #8164 from nicelulu/master
Fix trivial count query with ConvertingBlockInputStream.
2019-12-14 19:39:49 +03:00
Alexey Milovidov
0998dcbda6 Fixed segfault in EXISTS query 2019-12-13 23:24:03 +03:00
Winter Zhang
690502a435
update _remove.flag suffix to .remove_flag suffix 2019-12-14 04:15:40 +08:00
chertus
8c9ca6891f fix 'There's no column' error for materialized and alias columns 2019-12-13 21:46:55 +03:00
alexey-milovidov
8727f30ef8
Merge pull request #7790 from bgranvea/simple-aggregate-function-fix
Fix "Sizes of columns doesn't match" error with SimpleAggregateFunction
2019-12-13 20:56:03 +03:00
alexey-milovidov
d0408e8265
Merge pull request #8204 from ClickHouse/nullable-rand
rand and nullable argument
2019-12-13 20:50:07 +03:00
Nikolai Kochetov
28fcc6902f Try to simplify code in StorageLiveView 2019-12-13 20:08:21 +03:00
hcz
6171e8b70c Rename roundBankers 2019-12-13 22:50:14 +08:00
Nikolai Kochetov
1de6b244aa Fix randConstant. 2019-12-13 16:47:28 +03:00
Vasily Nemkov
d8473c17a3 Improved performance of max(), min(), argMin(), argMax() for DateTime64 2019-12-13 16:40:09 +03:00
Nikolai Kochetov
bd2517343d Fi rand and randConstant for nullable types. 2019-12-13 16:10:02 +03:00
zhang2014
713923e451 Support detach and drop table for mysql database engine 2019-12-13 19:48:38 +08:00
vxider
142932ebdf fix gcc 8.2.1 build (#8162) 2019-12-13 14:18:09 +03:00
philip.han
fe7ae014d8 Fixed bloom_filter bug that counting error for Array(Nullable(String)). 2019-12-13 18:38:03 +09:00
Konstantin Malanchev
4eae32d438 Add h3IsValid function 2019-12-13 11:39:50 +03:00
Konstantin Malanchev
947fb39d5e Add h3getResolution function 2019-12-13 11:39:50 +03:00
root
63aaf64e93 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into lulu-master1 2019-12-13 16:12:43 +08:00
Mikhail Filimonov
f3fa71c707 Init query context for Kafka to make subqueries work 2019-12-13 02:21:40 +01:00
alexey-milovidov
399995d60b
Merge pull request #7812 from infinivision/fix_part_mutation
fix part mutation
2019-12-13 03:45:59 +03:00
alexey-milovidov
ad76a1bafb
Merge pull request #8185 from vitlibar/fix-drop-dictionary-if-exists
Fix DROP DICTIONARY IF EXISTS
2019-12-13 02:47:06 +03:00
alexey-milovidov
31e4d40501
Merge pull request #8106 from ClickHouse/function-refactoring
Function refactoring
2019-12-13 02:30:55 +03:00
alexey-milovidov
d0cf282204
Merge pull request #8179 from ClickHouse/parts_to_do_names
Add parts_to_do_names column to system.mutations.
2019-12-13 02:30:03 +03:00
alexey-milovidov
efb916c556
Merge pull request #8176 from ClickHouse/fix_tmp_drop_relative_path
Fix loading of partially dropped table
2019-12-13 02:28:13 +03:00
alexey-milovidov
69535078fd
Merge pull request #8192 from excitoon-favorites/better-logging-disks
Better logging in background move task.
2019-12-13 02:27:38 +03:00
alexey-milovidov
32f42c4e92
Merge pull request #8194 from excitoon-favorites/fixed-move-pool
Fixed metrics in `BackgroundProcessingPool`
2019-12-13 02:26:52 +03:00
Vladimir Chebotarev
8a423a94b6 Fixed a typo. 2019-12-13 01:18:25 +03:00
Artem Zuikov
5783142f39
Merge pull request #8178 from 4ertus2/some
Refactoring: extract getTableExpressions() variants into own file
2019-12-13 01:09:47 +03:00
Vladimir Chebotarev
e413cd6e6c Fixed metrics in BackgroundProcessingPool. 2019-12-13 01:08:54 +03:00
Vladimir Chebotarev
9882c7c5ad Minor fix in logging. 2019-12-13 00:38:05 +03:00
Vladimir Chebotarev
9393bb0f12 Better logging in background move task. 2019-12-13 00:34:57 +03:00
Alexey Milovidov
df5f1f7433 More languages for regions 2019-12-12 22:34:58 +03:00
Alexey Milovidov
f88c94ed56 Changes after review of #8149 2019-12-12 22:12:18 +03:00
alexey-milovidov
0dc62d20e1
Merge pull request #8149 from zhang2014/feature/array_zip
Add arrayZip function
2019-12-12 22:00:39 +03:00
Alexey Milovidov
8580f8b56c Proper fix for #8147 2019-12-12 21:53:48 +03:00
Vitaly Baranov
4c157007f5 Refactoring of using ExternalLoader in dictionary DDL:
Instead of using ExternalLoader::reload() now it's used reloadConfig() which reloads only what necessary.
Functions attachDictionary() and detachDictionary() are simplified and have lesser number of parameters.
Instead of injecting into LoadablesConfigReader's internals for creating dictionary a temp repository is used.
2019-12-12 21:45:58 +03:00
Alexey Milovidov
575da23573 Fixed build 2019-12-12 21:40:46 +03:00
Vitaly Baranov
f81d9b4e73 Fix DROP DICTIONARY IF EXISTS db.dict - now it doesn't throw exceptions
even if db doesn't exist.
2019-12-12 21:37:44 +03:00
alexey-milovidov
51ed10ed78
Merge pull request #8011 from Jokser/aws-s3-sdk-integration
AWS SDK S3 integration
2019-12-12 20:43:16 +03:00
Nikolai Kochetov
d29561984a Fix build. 2019-12-12 19:59:17 +03:00
chertus
77ab1dbccb move one more function 2019-12-12 19:54:04 +03:00
alesapin
b7622c8fd9 Add parts_to_do_names column to system.mutations 2019-12-12 19:24:03 +03:00
chertus
68a33863ab extract getTableExpressions variants into own file 2019-12-12 19:06:18 +03:00
alexey-milovidov
c47acef529
Merge pull request #8163 from ClickHouse/dictionaries_ddl_on_cluster
Dictionaries ddl on cluster
2019-12-12 18:20:15 +03:00
alexey-milovidov
29b2e26074
Merge pull request #8144 from 4ertus2/decimal
Decimal specializations for min/max
2019-12-12 18:18:14 +03:00
alesapin
8fb9541958
Merge pull request #7946 from Alex-Burmak/filesystem_abstraction
Filesystem abstraction layer
2019-12-12 18:12:35 +03:00
Nikolai Kochetov
7082f8028b Merged with master. 2019-12-12 18:04:30 +03:00
Nikolai Kochetov
06f2fa8433 Add more comments, rename classes, move functions adaptors to separate file. 2019-12-12 17:56:03 +03:00
Nikolai Kochetov
168a55b617 Fix build. 2019-12-12 17:55:55 +03:00
Nikolai Kochetov
7dba6849c8 Fix concat and reverse for arrays. 2019-12-12 17:55:35 +03:00
Nikolai Kochetov
17af1ed25f Fix FunctionExpression. 2019-12-12 17:55:35 +03:00
Nikolai Kochetov
9c4d123f87 Style fixes. 2019-12-12 17:55:35 +03:00
Nikolai Kochetov
187cc83702 update tuple comparison. 2019-12-12 17:55:35 +03:00
Nikolai Kochetov
5289b67b70 update LLVMFunction. 2019-12-12 17:55:35 +03:00
Nikolai Kochetov
63a8dcd2e8 update yestarday. 2019-12-12 17:55:35 +03:00
Nikolai Kochetov
7336f3fa7f update transform. 2019-12-12 17:55:35 +03:00
Nikolai Kochetov
a18f0c5aa6 update FunctionArrayMapped. 2019-12-12 17:55:35 +03:00
Nikolai Kochetov
db08cc1b5a update toTypeName. 2019-12-12 17:55:35 +03:00
Nikolai Kochetov
b401dc521a update reverse. 2019-12-12 17:55:35 +03:00
Nikolai Kochetov
d7b08b166b update now and today. 2019-12-12 17:55:35 +03:00
Nikolai Kochetov
a9f1a2e382 Fix compile errors. 2019-12-12 17:55:36 +03:00
Alexander Tokmakov
1a6c973055 use absolute path and try to load table 2019-12-12 17:47:31 +03:00
hcz
c0028c3942 Add aggregate function categoricalInformationValue (#8117)
* Add categorical iv aggregate function with tests
2019-12-12 16:28:28 +03:00
chertus
16844012e4 Merge branch 'master' into decimal 2019-12-12 15:35:30 +03:00
Alexander Burmak
1f69a7a015 Fixed merge issues 2019-12-12 14:10:18 +03:00
alesapin
e7f5b92b19 Add ability to create external dictionaries ON CLUSTER 2019-12-12 13:27:02 +03:00
zhangxiao018
c03f126057 fix trivial count query with ConvertingBlockInputStream. 2019-12-12 18:21:08 +08:00
Nikolai Kochetov
7ad2a6dd0b
Merge pull request #7170 from Enmk/DateTime64
DateTime64 data type
2019-12-12 12:20:22 +03:00
Alexander Burmak
c514ec3278 Minor code cleanup 2019-12-12 12:18:46 +03:00
Alexander Burmak
2ce6136de5 Merge remote-tracking branch 'refs/remotes/upstream/master' into vfs 2019-12-12 12:10:50 +03:00
CurtizJ
890bfeb4eb fix order description analyzing 2019-12-11 21:52:59 +03:00
Nikolai Kochetov
1d90c4c555 Fix build. 2019-12-11 20:09:42 +03:00
zhang2014
194ab5526d add arrayZip function 2019-12-12 00:22:14 +08:00
Nikolai Kochetov
ea05ab293d Fix PVS check. 2019-12-11 19:09:43 +03:00
Vasily Nemkov
f8fec0402b Merge commit 'e7540dcf686936a490f89d0735f74c2f5f009821' into DateTime64 2019-12-11 17:38:32 +03:00
Pavel Kovalenko
daf064d13b Merge remote-tracking branch 'jokser/aws-s3-sdk-integration' into aws-s3-sdk-integration 2019-12-11 17:32:33 +03:00
Vasily Nemkov
514847609d PR fixes:
* Fixed precision calculation in DataTypeDecimalBase c-tor
* Fixed max precision calculation in getLeastSupertype
* Fixed reading past end of vector in FunctionsConversion with extractToDecimalScale
* More verbose comments on FunctionArgumentTypeValidator and validateFunctionArgumentTypes
* style and other minor fixes.
2019-12-11 17:24:59 +03:00
Pavel Kovalenko
c7f016fc4e AWS SDK integration - code cleanup. 2019-12-11 17:21:48 +03:00
chertus
4907ca734c Decimal specializations for min/max 2019-12-11 17:16:59 +03:00
CurtizJ
6834fbf03d implement ORDER BY optimization for some other meta-storages 2019-12-11 16:09:46 +03:00
alesapin
3229261c91 Fix dictionary_source check 2019-12-11 14:09:21 +03:00
alesapin
2940aeff23 Fix style 2019-12-11 13:24:20 +03:00
alesapin
fd9483efbe Just trigger CI 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
0ff0a52249 Missed review fixes. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
f2aee64072 Minor style fix. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
e41deb5848 Added comment to MergeTreePartsMover::selectPartsForMove(). 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
7fd1668fde Review fixes. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
e3ed311273 Fixed Clang build. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
67aa268bbb Finally fixed tests and logic for extended TTL syntax. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
f83b28a1c1 Fixed a typo in MergeTreeData::selectMoveDestination(). 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
618a39cc8c Don't move anything if part already belongs their destination. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
f72da4ab0c Removing expired rows shall not be triggered on move TTL expiration. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
8ed37801ca Finally fixed selection of destination of move TTL. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
15fb64f54b Fixed move TTL expiration logic. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
df002f20b1 Fixed move TTL metadata. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
14cf530542 Added move TTL rules to metadata of ReplicatedMergeTree. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
7407f7c39d Placed move TTL rules to a vector. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
108e2b33eb Fixed a bug with erasing columns with same name. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
0da7234d99 Added few FIXMEs to not forget. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
ce851fc782 Fixed MergeTreeData::hasTableTTL() method according to extended TTLs. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
cb777f6c50 Removed redundant template from updateTTL() method. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
62016feab0 Renamed TTLDestinationType to PartDestinationType. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
cc0c21604f Fixed Clang build one more time. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
ce066d3bb0 Style fixes. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
88c7220256 Fixed Clang build. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
07c4fa3cc0 Correct merge of background move pool. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
3e3e9ac56f Moved settings for BackgroundProcessingPool to configuration. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
e519c04bbe Minor fix of JSON handling in MergeTreeDataPartTTLInfo. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
342ea5c30a Removed TODO comments. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
773bf7b35c Removed 'DELETE' keyword from default TTL syntax description. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
58e824b6a1 Refactored, added move enforcement on merges, fixed a bug with wrong disk selection in ReplicatedMergeTree. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
dfe0edc03f Style fix. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
76c4ac9f60 Fixed ttl move logic in background move task and added ttl enforcement on inserts. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
575de5ada6 Attempt to add background moves by TTL expressions. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
893e0de37a Minor fix. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
33ded274a3 First attempt to store min/max for move ttl expressions. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
3e984609fb Fixed ClickHouse after changing syntax. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
7a37c4f6a9 Parser for extended TTL expressions. 2019-12-11 13:24:20 +03:00
alesapin
4385aab4a1 Merge branch 'master' into restrictions_for_external_dictionaries_from_ddl 2019-12-11 12:29:55 +03:00
Vasily Nemkov
c781908e6d Post-PR fixes
* More precise overflow check in readIntTextImpl
* writeDateTimeText now always writes sub-second part for DateTime64
* comment for validateFunctionArgumentTypes
* DateTime64-related fixes for FunctionConvertFromString
* other minoe fixes: comments, removed commented out code, variable
  renamings, etc.
2019-12-11 12:20:05 +03:00
Vasily Nemkov
f56b2b64f2 Post-review refactoring and tests for DateTime64 and Decimal.
* put functions in DecimalFunctions into DecimalUtils namespace
* fixed possible buffer overflow in parseDateTimeBestEffortImpl
* fixed readDateTimeTextImpl not to require fractional part separator
  (if fractional part is missing)
* Tests for code from DecimalFunctions.h
* Fixed serializing DateTime64 to string with writeDateTimeText(), fixed tests
2019-12-11 06:58:49 +03:00
Alexey Milovidov
4f9cd8a3c8 Update contributors 2019-12-11 06:13:33 +03:00
hcz
2f276c2bb7 Rename bankerRound as bankersRound 2019-12-11 10:43:47 +08:00
CurtizJ
fd5b23730e implement order by optimization for storage Merge 2019-12-11 04:35:47 +03:00
CurtizJ
45a9751c31 refactoring of order by optimization 2019-12-11 04:34:39 +03:00
Zhichang Yu
ff1b8d46e2 fixed part mutation, added test_backup_restore integration test case 2019-12-11 09:31:37 +08:00
alexey-milovidov
aecd5a5493
Merge pull request #8123 from ClickHouse/aku/field-prepare
Prepare for stricter type checking in Field.
2019-12-11 02:21:34 +03:00
CurtizJ
9e75892516 refactoring of order by optimization 2019-12-11 02:18:24 +03:00
alexey-milovidov
309653f60d
Merge pull request #7182 from ClickHouse/aku/zlib-msan
Update zlib-ng to fix MemorySanitizer problems.
2019-12-11 02:15:16 +03:00
alexey-milovidov
85d668ebf4
Update S3Common.cpp 2019-12-11 02:03:45 +03:00
alesapin
6842ff02c9 Fix shared build 2019-12-10 23:39:36 +03:00
alesapin
ea8994b9e4 Add restrections for several sources of external dictionaries 2019-12-10 20:27:29 +03:00
alesapin
67f1ff1c8b
Merge pull request #8104 from excitoon-favorites/test_move_after_merge
FIxed behavior with ALTER MOVE ran immediately after merge finish moves superpart of specified
2019-12-10 17:15:08 +03:00
Alexander Kuzmenkov
50a8a7197f Prepare for stricter type checking in Field. 2019-12-10 16:40:45 +03:00
Alexander Kuzmenkov
3df94283b3 Remove a workaround for zlib-ng MemorySanitizer problems. 2019-12-10 13:15:18 +03:00
alesapin
397a3fc2e7
Merge pull request #8098 from ClickHouse/fix_dictionary_properties
Fix dictionary properties
2019-12-10 12:55:29 +03:00
Vladimir Chebotarev
269a0246aa Added explicit check for existence of part and pair of log messages. 2019-12-10 12:47:23 +03:00
hcz
8ed416ed41 Add bankerRound 2019-12-10 14:13:05 +08:00
Vladimir Chebotarev
6afd8d7805 Added test_multiple_disk::test_kill_while_insert, reworked log message and fixed logic of treating stale copies. 2019-12-09 23:29:44 +03:00
Vladimir Chebotarev
a2f238d8da Added more logging and switched to detaching stale part instead of removing. 2019-12-09 23:29:44 +03:00
Vladimir Chebotarev
9cf7ef03af Fixed handling of MergeTreeData::DataPartPtr's in MergeTreeData::swapActivePart(). 2019-12-09 23:29:44 +03:00
Vladimir Chebotarev
374e0f7bb5 Finally fixed tests. 2019-12-09 23:29:44 +03:00
Vladimir Chebotarev
c283776e84 Really fixed tests. 2019-12-09 23:29:44 +03:00
Vladimir Chebotarev
89659a9129 Fixed a typo. 2019-12-09 23:29:44 +03:00
Vladimir Chebotarev
fe3e89fb38 Fixed tests. 2019-12-09 23:29:44 +03:00
filimonov
f545da40e6 style 2019-12-09 23:29:44 +03:00
filimonov
0ab67c7b1f Log when part is removed after move 2019-12-09 23:29:44 +03:00
Vladimir Chebotarev
efa73608b8 Separated constant path to DeleteOnDestroy marker. 2019-12-09 23:29:44 +03:00
Vladimir Chebotarev
13c5c621c1 Attempt to ignore redundant copies of parts after move and restart. 2019-12-09 23:29:44 +03:00
alexey-milovidov
cce78ef018
Merge pull request #8036 from yurriy/mysql
Compatibility with MySQL clients which don't support sha2_password auth plugin
2019-12-09 23:11:31 +03:00
Alexey Milovidov
da72203ceb Added a comment 2019-12-09 22:53:40 +03:00
Alexey Milovidov
2fe7472a63 Added function "greatCircleAngle"; changed earth radius 2019-12-09 22:35:25 +03:00
Alexey Milovidov
1e3b9af66f Added clarifications 2019-12-09 20:25:16 +03:00
Alexey Milovidov
2db25df706 Merge branch 'master' into geodist-less-wrong 2019-12-09 18:42:37 +03:00
Nikolai Kochetov
fd62c09a8b Update FunctionCapture and FunctionExpression. 2019-12-09 17:36:47 +03:00
Alexander Burmak
5a93441445 Merge remote-tracking branch 'refs/remotes/upstream/master' into vfs 2019-12-09 17:18:47 +03:00
alesapin
85aac386aa Missed commit 2019-12-09 17:06:28 +03:00
alesapin
642ce2d751 Fix escaping and add string expressions support 2019-12-09 17:05:58 +03:00
Nikolai Kochetov
18bfa684a2 Rename IFunction.h to IFunctionImpl.h in functions implementations. 2019-12-09 16:12:54 +03:00
Pavel Kovalenko
ba59991912 AWS SDK integration - added new lines at the end of files. 2019-12-09 15:36:06 +03:00
Pavel Kovalenko
94e9638006 AWS SDK integration added url checking. 2019-12-09 13:58:57 +03:00
Alexander Burmak
f27d462986 Minor amendments 2019-12-09 08:47:12 +03:00
alexey-milovidov
d051a03794
Merge pull request #8042 from excitoon-favorites/gmtime
Removed `localtime` from `HTTPDictionarySource::getUpdateFieldAndDate…
2019-12-09 04:57:18 +03:00
alexey-milovidov
624be3679b
Merge branch 'master' into mysql 2019-12-09 04:53:30 +03:00
alexey-milovidov
0d278b414c
Merge pull request #8046 from amosbird/interpose
Interpose malloc symbols entirely.
2019-12-09 04:33:49 +03:00
alexey-milovidov
abb823af7f
Merge pull request #8079 from yurriy/mysql-types-test
Fixed Float64 conversion in MySQL protocol
2019-12-09 04:32:22 +03:00
Alexey Milovidov
b5e05d761b Whitespace 2019-12-09 04:15:42 +03:00
Alexey Milovidov
9399b39070 Fixes 2019-12-09 04:09:03 +03:00
Alexey Milovidov
41a6eedadc Added comment 2019-12-09 04:02:09 +03:00
Alexey Milovidov
fb908eae0a Fixed comments 2019-12-09 03:02:50 +03:00
Alexey Milovidov
b977aa3cdf Fixed error 2019-12-09 02:59:25 +03:00
Alexey Milovidov
c738d92411 Maybe better memory layout 2019-12-09 02:55:56 +03:00
Alexey Milovidov
171bb14614 Addition to prev. revision 2019-12-09 02:41:34 +03:00
Alexey Milovidov
1835087291 Added function geoDistance and returned the old behaviour of greatCircleDistance 2019-12-09 02:40:53 +03:00
Alexey Milovidov
109542c445 Small improvements 2019-12-09 02:09:05 +03:00
Alexey Milovidov
09df6a0c00 Small improvements 2019-12-09 02:02:44 +03:00
Alexey Milovidov
f7320e50b7 Renamed variables 2019-12-09 02:00:34 +03:00
Alexey Milovidov
a04ed4883d Added comments 2019-12-09 01:44:17 +03:00
Alexey Milovidov
19f05c4594 Removed too strict type check 2019-12-09 01:09:32 +03:00
Alexey Milovidov
3d71cb0596 Make the code of greatCircleDistance less wrong 2019-12-09 00:59:41 +03:00
Nikolai Kochetov
a73eb4292b Functions refactor part 1. 2019-12-09 00:06:37 +03:00
alexey-milovidov
7e8b177a3b
Merge pull request #8077 from nvartolomei/nv/system-query-parser
Fix SYSTEM query parser suggestions
2019-12-09 00:04:14 +03:00
alexey-milovidov
cf194edfaf
Merge pull request #8016 from filimonov/kafka_fixes
Kafka fixes
2019-12-09 00:03:36 +03:00
alexey-milovidov
ee7d675f86
Update KafkaBlockInputStream.cpp 2019-12-09 00:03:09 +03:00
alexey-milovidov
a7f5ac7099
Merge pull request #8081 from errx/master
Added new function JSONExtractArrayRaw
2019-12-08 23:52:56 +03:00
alexey-milovidov
21a7a53491
Update FunctionsJSON.h 2019-12-08 23:48:34 +03:00
alexey-milovidov
16754bfff5
Merge pull request #8043 from excitoon-favorites/systemmergespaths
Added information about paths to `system.merges`.
2019-12-08 23:30:39 +03:00
Alexander Burmak
edd11abad1 Addressed code review comments 2019-12-08 19:47:51 +03:00
tyrionhuang
6cf7ac045b fix BitmapAnd error, like issue #5479: bitmapHasAny in scalar subquery causes segment fault 2019-12-08 23:10:37 +08:00
Oleg Matrokhin
8ea7cab7e4 simplify expression 2019-12-08 18:07:06 +03:00
tyrionhuang
213e2dd700 fix BitmapAnd error, like issue #5479: bitmapHasAny in scalar subquery causes segment fault 2019-12-08 22:44:17 +08:00
Oleg Matrokhin
2cab90b9f4 fmt 2019-12-08 17:36:31 +03:00
Alexander Burmak
8104395dd2 Merge remote-tracking branch 'refs/remotes/upstream/master' into vfs 2019-12-08 11:45:18 +03:00
alesapin
af7b8f9274
Merge pull request #8051 from ClickHouse/fix_collations_behaviour
Fix several bugs with collations.
2019-12-08 11:10:23 +03:00
Sergei Shtykov
b4839c52db The most working of all the previous versions. 2019-12-08 10:56:07 +03:00
Yuriy
e0796261aa mysql protocol: fixed Float32 conversion and added types test 2019-12-08 08:40:08 +03:00
Oleg Matrokhin
10cf9e5b9f implement new function 2019-12-08 03:18:24 +03:00
Nicolae Vartolomei
f5e764eba1 Fix SYSTEM query parser suggestions 2019-12-07 23:05:57 +00:00
Vladimir Chebotarev
984e81876a Fixed Clang build. 2019-12-07 22:30:37 +03:00
alesapin
2fffe2802f Review fixes 2019-12-07 16:13:14 +03:00
Vladimir Chebotarev
1fbfb50fba Fixed updating result_part_path while merging and mutating. 2019-12-07 12:54:05 +03:00
alesapin
b9591a8bb4 Fix variable scope 2019-12-07 11:17:01 +03:00
Vladimir Chebotarev
05a05b5fb6 Fixed result_part_part of a mutation. 2019-12-07 11:10:08 +03:00
alesapin
3881a85c39 Review fixes 2019-12-07 01:22:12 +03:00
alexey-milovidov
56b2ec8b4a
Merge pull request #7693 from millb/hashes_from_values_of_UUID_type
Created cityHash for decimal and UUID types.
2019-12-07 00:30:28 +03:00
alexey-milovidov
113ddb2588
Update FunctionsHashing.h 2019-12-06 22:21:22 +03:00
alexey-milovidov
1c1351d644
Update FunctionsHashing.h 2019-12-06 22:19:19 +03:00
alexey-milovidov
e0aa12717b
Update FunctionsHashing.h 2019-12-06 22:18:47 +03:00
alexey-milovidov
bef3a0d2d2
Merge pull request #8071 from azat/Connection-sendCancel-SIGSEGV
Avoid null dereference after "Unknown packet X from server"
2019-12-06 22:15:18 +03:00
alexey-milovidov
36203721de
Update Connection.cpp 2019-12-06 22:14:27 +03:00
millb
b13cd85613 Applied the required changes 2019-12-06 22:08:21 +03:00
Azat Khuzhin
e4209d6a3f Avoid null dereference after "Unknown packet X from server"
stracktrace:
  ...
  2  DB::WriteBuffer::nextIfAtEnd (this=0x0) at ../dbms/src/IO/WriteBuffer.h:66
  3  DB::writeVarUInt (ostr=..., x=3) at ../dbms/src/IO/VarInt.h:191
  4  DB::Connection::sendCancel (this=0x7f0b7f5e5610) at ../dbms/src/Client/Connection.cpp:444
  5  0x0000561738d0b565 in DB::MultiplexedConnections::sendCancel (this=0x7f0c9b0173e0) at ../dbms/src/Client/MultiplexedConnections.cpp:174
  6  0x00005617387d22df in DB::RemoteBlockInputStream::tryCancel (this=0x7f0cc45f9810, reason=<optimized out>) at /usr/include/c++/9/bits/unique_ptr.h:352
  7  0x00005617387d2a37 in DB::RemoteBlockInputStream::cancel (this=<optimized out>, kill=false) at ../dbms/src/DataStreams/RemoteBlockInputStream.cpp:121
  8  0x000056173891f10c in DB::ParallelInputsProcessor<DB::UnionBlockInputStream::Handler>::cancel (this=0x7f0c370ec168, kill=kill@entry=false)
  9  0x000056173892cfce in DB::UnionBlockInputStream::cancel (kill=false, this=<optimized out>) at ../dbms/src/DataStreams/UnionBlockInputStream.h:99
  10 DB::UnionBlockInputStream::Handler::onException (this=0x7f0c370ec160, exception=...) at ../dbms/src/DataStreams/UnionBlockInputStream.h:240
  11 DB::ParallelInputsProcessor<DB::UnionBlockInputStream::Handler>::thread (this=0x7f0c370ec168, thread_group=..., thread_num=<optimized out>)
      at ../dbms/src/DataStreams/ParallelInputsProcessor.h:217

And in onException frame there is:
  (gdb) p ((DB::Exception *)exception._M_exception_object)._msg._M_dataplus._M_p
  $6 = (...) 0x7f0c9b1e7a40 "Unknown packet 9 from server HOSTNAME:PORT"

And on "Unknown packet" there is disconnect() before, see default in
switch statement at Connection::receivePacket().
2019-12-06 21:55:17 +03:00
Mikhail Korotov
3528555174
Update FunctionsHashing.h 2019-12-06 19:33:37 +03:00
Amos Bird
971770a040
Interpose malloc symbols entirely. 2019-12-07 00:32:00 +08:00
Mikhail Korotov
5a1ad17736
Update FunctionsHashing.h 2019-12-06 19:30:46 +03:00
millb
c801845185 Applied the required changes 2019-12-06 19:27:45 +03:00
millb
e3426e39e8 Fixed bugs 2019-12-06 18:43:50 +03:00
Pavel Kovalenko
6b8d599956 AWS SDK integration formatting issues. 2019-12-06 18:42:55 +03:00
Vxider
47f8d9713a build fix 2019-12-06 23:35:23 +08:00
millb
41008c9cca Merge branch 'master' into hashes_from_values_of_UUID_type 2019-12-06 18:22:06 +03:00
millb
56c7e53bdc Changes applied 2019-12-06 18:21:58 +03:00
Pavel Kovalenko
621d3dd2d1 AWS SDK integration formatting issues. 2019-12-06 18:14:39 +03:00
Pavel Kovalenko
81b4b1a538 AWS SDK added doc. 2019-12-06 17:54:20 +03:00
Pavel Kovalenko
c840fdefc0 Merge branch 'master' into aws-s3-sdk-integration
# Conflicts:
#	dbms/src/Common/ErrorCodes.cpp
#	dbms/src/IO/ReadBufferFromS3.cpp
#	dbms/src/IO/ReadBufferFromS3.h
#	dbms/src/IO/WriteBufferFromS3.cpp
#	dbms/src/IO/WriteBufferFromS3.h
#	dbms/src/Storages/StorageS3.cpp
2019-12-06 17:52:29 +03:00
Pavel Kovalenko
52b26b1376 AWS SDK formatting issues. 2019-12-06 17:48:56 +03:00
alexey-milovidov
3d279499d0
Merge pull request #7632 from hczhcz/patch-2
Allow relative user_files_path
2019-12-06 17:44:18 +03:00
Pavel Kovalenko
a9dfefd37f AWS SDK integration rework. 2019-12-06 17:37:21 +03:00
robot-clickhouse
6d56509109 Auto version update to [19.19.1.1] [54430] 2019-12-06 17:22:00 +03:00
Vitaly Baranov
8bd9709d1d
Merge pull request #8044 from vitlibar/simplify-format-of-header-of-distributed-send
Simplify format of the header of data sent to a shard in a distributed query.
2019-12-06 15:46:00 +03:00
Vitaliy Zakaznikov
435ce84939 Setting table alias when replacing subquery with a table.
Adding extra tests that use table aliases.
2019-12-06 13:31:08 +01:00
Mikhail Filimonov
4e4957e052 returning allowNext() to the proper position 2019-12-06 12:22:36 +01:00
Nikita Mikhaylov
6fc5248a27
Merge branch 'master' into limit_with_ties 2019-12-06 13:16:54 +03:00
alesapin
de6cd490ef
Merge pull request #8037 from vitlibar/system-reload-dictionary-causes-complete-reloading
SYSTEM RELOAD DICTIONARY reloads a dictionary completely
2019-12-06 12:55:41 +03:00
Yuriy
6c8e2d8b85 fixed getting double SHA1 in mysql_native_password auth plugin 2019-12-06 04:35:49 +03:00
Vitaly Baranov
2133492598
Merge pull request #7257 from vitlibar/RBAC-2
RBAC-2
2019-12-06 03:19:39 +03:00
Vitaliy Zakaznikov
ae3749d764 Fixing clang error in dbms/src/Storages/LiveView/StorageBlocks.h 2019-12-05 19:08:40 -05:00
Vitaliy Zakaznikov
2d6645cc1b Fixing clang error. 2019-12-05 17:04:55 -05:00
Vitaliy Zakaznikov
613c343c09 Fixing styling issues. 2019-12-05 16:48:25 -05:00
Vitaliy Zakaznikov
32fe9ea9d5 Fixing issue with support for nested subqueries.
Adding additional live view with subquery tests.
2019-12-05 22:42:00 +01:00
Mikhail Filimonov
7d760a964d Fix for timestamp & style 2019-12-05 22:21:15 +01:00
Nikita Mikhaylov
46478db2f8 Merge branch 'master' of github.com:ClickHouse/ClickHouse 2019-12-05 22:09:15 +03:00
Nikita Mikhaylov
4946409a78
Merge branch 'master' into limit_with_ties 2019-12-05 21:58:47 +03:00
Nikita Mikhaylov
de2d996063
Merge pull request #7786 from nikitamikhaylov/incorrect_count
Incorrect count() with condition query result for SummingMergeTree.
2019-12-05 21:56:54 +03:00
alesapin
6afafef86c
Merge pull request #8047 from ClickHouse/fix_check_query_again
Fix bug in checkDataPart
2019-12-05 21:31:36 +03:00
Vitaly Baranov
6306e2ab91 Add DCL to manage quotas. 2019-12-05 21:03:57 +03:00
Vitaly Baranov
8035af3a79 Make Field::getScaleMultiplier() inline to allow using FieldVisitorConvertToNumber
in the "clickhouse_parsers" library.
2019-12-05 21:03:57 +03:00
Vitaly Baranov
3e6619c076 Move IntervalKind-related functions to a separate file. 2019-12-05 21:03:57 +03:00
Vitaly Baranov
38fa1af5ca Disable quota consumptions for the system queries and for selecting
from the `system.quota` and `system.quotas` tables.
2019-12-05 21:03:57 +03:00
Vitaly Baranov
d9b1a733fc Add table system.quotas. 2019-12-05 21:03:57 +03:00
Vitaly Baranov
55a05e5643 Add functions currentQuota() and currentQuotaKey(). 2019-12-05 21:03:57 +03:00
Vitaly Baranov
0e21673271 Rework Quota based on IAccessEntity. 2019-12-05 21:03:57 +03:00
Vitaly Baranov
c733e5b50b Add functions for writing std::chrono to string. 2019-12-05 21:03:57 +03:00
Vitaly Baranov
7db6c60bb1 Add AccessControlManager and an interface for the storage. 2019-12-05 21:03:57 +03:00
Vitaly Baranov
44f3ab5f96 Extend typeid_cast() for shared_ptr. 2019-12-05 21:03:57 +03:00
Vitaly Baranov
9b44848179 SYSTEM RELOAD DICTIONARY now reloads a dictionary with update_field completely. 2019-12-05 19:45:05 +03:00
alesapin
772bb0b70b Fix collation locales 2019-12-05 18:35:09 +03:00
Nikita Mikhaylov
4f74974492 fixed warning unique_lock 2019-12-05 17:34:35 +03:00
Vitaliy Zakaznikov
28db10fd7d Fixing styling errors. 2019-12-05 14:26:47 +01:00
alesapin
ee46a73d25 Fix bug in checkDataPart when last granule has same number of rows as in .mrk file 2019-12-05 15:01:36 +03:00
chertus
852e891499 better comment 2019-12-05 15:01:34 +03:00
Vitaliy Zakaznikov
e20793b2dc Merge remote-tracking branch 'origin/master' into live_view_support_for_subquery 2019-12-05 06:54:04 -05:00
Vitaliy Zakaznikov
1e0e00b7e4 Small fixes to empty lines and style. 2019-12-05 06:53:36 -05:00
Nikolai Kochetov
26e415736a
Merge pull request #7665 from 4ertus2/joins
New ANY, SEMI, ANTI JOIN (HashJoin only)
2019-12-05 14:38:20 +03:00
Nikolai Kochetov
86ff01d3aa
Merge pull request #7988 from ClickHouse/processors-4.4
Better updated ports check in processors
2019-12-05 13:54:40 +03:00
Vitaly Baranov
133675a86a Simplify format of the header of data sending to a shard in a distributed query. 2019-12-05 13:34:25 +03:00
Mikhail Korotov
88e37020e0 JSONCompactEachRow and JSONCompactEachRowWithNamesAndTypes (#7841)
* Research commit

* Created Output EachRow Format

* Fixed bugs

* Created output format JSONCompactEachRowWithNamesAndTypes without totals

* Fixed bugs

* Fixed bugs

* Totals for JSONCompactEachRowWithNamesAndTypes

* Deleted needless debug

* Working commit

* Working commit

* Working commit

* Working commit

* Working commit

* Working commit

* Working commit

* Working commit

* Working commit

* Working commit

* Working commit

* Working commit

* Tests added

* Input Format for JSONCompactEachRow

* Fixed bugs for JSONCompactEachRow Input format

* Fixed bugs for JSONCompactEachRowRowInputFormat.cpp

* JSONCompactEachRow and JSONCompactEachRowWithNamesAndTypes united

* Created input format for both formats

* fixed bugs

* fixed bugs

* Working commit

* Working commit

* Working commit

* Working commit

* tests

* Working commit

* Final tests

* Performance tests added
2019-12-05 13:13:40 +03:00
Nikita Mikhaylov
b6413d4a04 better 2019-12-05 12:52:49 +03:00
Nikita Mikhaylov
9d005d1565 true changes 2019-12-05 12:50:42 +03:00
Vladimir Chebotarev
7c7562987d Removed is_move from system.merges. 2019-12-05 12:31:45 +03:00
Vladimir Chebotarev
3c35b3db60 Removed localtime from HTTPDictionarySource::getUpdateFieldAndDate(). 2019-12-05 12:18:51 +03:00
Vitaly Baranov
2cc78413ed
Merge pull request #7914 from azat/dist-send-extra-checksum
Add checksum for extra info/query in distributed sends
2019-12-05 11:43:08 +03:00
alesapin
a524e82a7f
Merge pull request #8029 from ClickHouse/fix_dict_partially_update_failover
Fix external dictionaries failover, when they have invalidate_query.
2019-12-05 11:12:17 +03:00
Yuriy Baranov
67d72f35b9
Update Authentication.cpp 2019-12-05 03:35:52 +03:00
Yuriy
9a222c6a2a compare with proper variable 2019-12-05 03:23:12 +03:00
Yuriy
4b170ae769 fixed compilation error 2019-12-05 03:19:36 +03:00
Yuriy
564b58d2f6 using mysql_native_password for passwordless users 2019-12-05 02:37:11 +03:00
Yuriy
9d0a0d0db0 fixed type 2019-12-05 02:32:17 +03:00
Yuriy
dbe7dc1185 using SHA1 MySQL auth plugin for plaintext passwords 2019-12-05 02:30:06 +03:00
Vitaliy Zakaznikov
7f92e6a21f Draft of proper support for subquries in live view tables. 2019-12-05 00:29:37 +01:00
chertus
d3d2e39955 fix SEMI RIGHT JOIN 2019-12-04 23:23:07 +03:00
Azat Khuzhin
3a72e1c12a Add checksum for extra info/query in distributed sends
This extras includes:
- server revision
- query settings
- query

Otherwise the code can try to interpret data, and got for instance
std::length_error exception, which is not catched (to mark the part as
broken). Also this will protect from the corruptions on disk.

And add a simple test, since dbms/tests/integration/test_insert_into_distributed too complex.

Also simplify the code by using readStringBinary() over
readVarUInt()+b.readStrict() (this also gains additional checks that
string is not bigger then 1GB).

Refs: #4852 (8ef7f3589a)
v2: avoid ABI breakage (suggested by @vitlibar)
v3: minor code fixes (suggested by @vitlibar) and as a consequence clang-8 build fix
v4: drop DBMS_MIN_REVISION_WITH_EXTRAS_CHECKSUM_IN_DIST_BATCH and also
    revert some renames to make the patch cleaner
2019-12-04 22:54:38 +03:00
Nikolai Kochetov
715d7a6455 Disable processors by default. 2019-12-04 20:24:53 +03:00
alesapin
7b8443710d Better code 2019-12-04 19:20:24 +03:00
alesapin
40c6966223 Don't check dictionary modification if it's already have an exception. 2019-12-04 18:23:18 +03:00
alesapin
3128b62f0e Create dictionary if not exists 2019-12-04 18:11:36 +03:00
alesapin
a41764cccc Reload dictionary with invalidate query if it has exception 2019-12-04 17:45:56 +03:00
Nikolai Kochetov
3ac103f21c Fix the number of rows in MergingSortedTransform. 2019-12-04 16:45:42 +03:00
Nikolai Kochetov
901a6b4627 Style fix. 2019-12-04 12:56:08 +03:00
Nikolai Kochetov
efe1616fda Fix optimization for 'WHERE column in (empty set)' case. 2019-12-04 12:55:01 +03:00
Nikolai Kochetov
81b5b17828 Fix pvs studio varning. 2019-12-04 12:55:01 +03:00
Nikolai Kochetov
fa98587c19 Init update_info in port. 2019-12-04 12:55:01 +03:00
Nikolai Kochetov
4337fc20b5 Enable processors by default. 2019-12-04 12:55:01 +03:00
Nikolai Kochetov
8524a75580 Check once if filter column can be always false in filter transform. 2019-12-04 12:55:01 +03:00
Nikolai Kochetov
9465183408 Add info about affected ports after prepare. 2019-12-04 12:55:01 +03:00
Nikolai Kochetov
4f2f474fde Add info about affected ports to IProcessor::prepare 2019-12-04 12:55:01 +03:00
alesapin
eb17d51dd4 Remove unused function 2019-12-04 12:49:54 +03:00
alesapin
d1d3bac744 Better 2019-12-04 12:48:08 +03:00
alesapin
9e5f13e7af Merge branch 'fix_metric_suffix_in_settings_value' of https://github.com/millb/ClickHouse into millb-fix_metric_suffix_in_settings_value 2019-12-04 12:22:29 +03:00
alesapin
8877129d60
Merge pull request #8012 from ClickHouse/millb-url_engine_problem
Merging [#7154]
2019-12-04 12:13:15 +03:00
Mikhail Filimonov
34275626de Fix for https://github.com/ClickHouse/ClickHouse/issues/8003 : old producers do not write timestamp, but column still should have enough rows 2019-12-03 23:03:43 +01:00
Mikhail Filimonov
3de3ba336a Fix Native format in Kafka 2019-12-03 22:12:47 +01:00
Mikhail Filimonov
6e426592a7 Make the formats like RowBinaryWithNamesAndTypes work in Kafka & do not try to parse buffer when it at eof 2019-12-03 22:03:22 +01:00
alesapin
fa4728d44f Fix style 2019-12-03 20:57:00 +03:00
Nikolai Kochetov
7b3c56990d
Merge pull request #8005 from ClickHouse/add-more-checks-to-chunk
Add forgotten rows number check to chunk constructor.
2019-12-03 20:26:19 +03:00
alesapin
2a43daec5c Buildable code 2019-12-03 20:15:16 +03:00
alesapin
20e4e92c49 Fix some conflicts 2019-12-03 19:32:41 +03:00
Pavel Kovalenko
a9e2327ec0 AWS S3 SDK integration. 2019-12-03 19:23:24 +03:00
Alexander Burmak
21623c3308 Merge remote-tracking branch 'refs/remotes/upstream/master' into vfs 2019-12-03 18:16:19 +03:00
chertus
3829df0e7b fix comment 2019-12-03 17:38:13 +03:00
chertus
e160d35e54 more Join.addJoinedBlock() refactoring 2019-12-03 17:30:51 +03:00
Nikolai Kochetov
31d5c66867 Fix num rows in IRowInputFormat 2019-12-03 16:43:40 +03:00
Alexander Burmak
108c792fd9 Fixed typos in ExternalLoader.h and CrossToInnerJoinVisitor.cpp 2019-12-03 16:39:42 +03:00
chertus
46b27e4dd1 perf: move heavy addJoinedBlock() operations out of lock 2019-12-03 16:31:52 +03:00
chertus
3dc6ef421e perf: do not make row filter if not needed 2019-12-03 15:55:20 +03:00
alexey-milovidov
1b2297bcee
Merge pull request #7999 from litao91/typo_fix
Fix a minor typo on formatting UNION ALL AST
2019-12-03 15:29:49 +03:00
alexey-milovidov
aadf7c689c
Merge pull request #7993 from ClickHouse/merge-great-circle-distance
Merging #7307
2019-12-03 15:23:38 +03:00
alexey-milovidov
f09c29a2b6
Merge pull request #7992 from ClickHouse/excitoon-favorites-s3auth
Merging #7623
2019-12-03 15:21:12 +03:00
Vasily Nemkov
37832c9497 Removed code duplication and cleaned up headers mess a bit 2019-12-03 15:14:07 +03:00
Nikolai Kochetov
448d755a3b Add forgotten rows number check to chunk constructor. 2019-12-03 14:56:51 +03:00
litao91
d9607c50fe
Fix a minor typo on formatting UNION ALL AST 2019-12-03 16:58:00 +08:00
Alexey Milovidov
40b0f12755 Removed tons of garbage from "greatCircleDistance" function. But algorithm is still unclear. 2019-12-03 05:25:23 +03:00
alexey-milovidov
0c904f1484
Merge pull request #7721 from 4ertus2/decimal
Basic GatherUtils support for Decimals
2019-12-03 05:15:38 +03:00
alexey-milovidov
0734d4695b
Merge pull request #7724 from 4ertus2/some
Missing array functions for Decimals
2019-12-03 05:14:33 +03:00
alexey-milovidov
812df3aef3
Merge pull request #7755 from nikitamikhaylov/storage_set
Using the Set engine happen Exception: Method read is not supported by storage Set
2019-12-03 05:09:47 +03:00
alexey-milovidov
ef66c453c4
Update ExpressionAnalyzer.h 2019-12-03 05:09:05 +03:00
alexey-milovidov
cdaa913d1f
Update ExpressionAnalyzer.h 2019-12-03 05:08:41 +03:00
Alexey Milovidov
2474cdfa09 Removed tons of garbage from "greatCircleDistance" function. But algorithm is still unclear. 2019-12-03 04:55:46 +03:00
Alexey Milovidov
0da80b3c7b Merge branch 'master' of github.com:yandex/ClickHouse into enable-experimental-indices-and-make-settings-obsolete 2019-12-03 04:35:42 +03:00
alexey-milovidov
f5e88f8cd5
Merge pull request #7307 from ClickHouse/new-branch-for-new-geodist
Speed up greatCircleDistance function with test
2019-12-03 04:34:35 +03:00
alexey-milovidov
dbc95e27be
Update greatCircleDistance.cpp 2019-12-03 04:33:36 +03:00
Alexey Milovidov
eef44d3fc5 Merge branch 'master' into enable-experimental-indices-and-make-settings-obsolete 2019-12-03 04:31:08 +03:00
Alexey Milovidov
49d25e06a8 Added a test 2019-12-03 04:29:19 +03:00
Alexey Milovidov
93ef18501f Added a test 2019-12-03 04:27:48 +03:00
Alexey Milovidov
199a209c82 Added a test 2019-12-03 04:23:17 +03:00
Alexey Milovidov
8fa05a212b Fixed bug in #7623 2019-12-03 04:22:25 +03:00