thevar1able/ClickHouse
1
0
Fork 0
mirror of https://github.com/ClickHouse/ClickHouse.git synced 2024-11-19 06:01:57 +00:00
Code Issues Packages Projects Releases Wiki Activity
33,259 Commits 9,136 Branches 1,778 Tags 2 GiB
a33ade77fd
Commit Graph

23914 Commits

Author SHA1 Message Date
Nicolae Vartolomei
d1de5bb8d5 Improve settings constraints tests coverage 2019-12-17 17:20:15 +00:00
alexey-milovidov
abd7e52272
Update S3Common.cpp 2019-12-17 18:38:50 +03:00
chertus
d7a2f45299 Fix crash in FULL JOIN with LowCard in key (attempt 2) 2019-12-17 18:02:42 +03:00
Pervakov Grigory
bdb9156843 Attach AWS SDK logging to CH logging system 2019-12-17 17:25:18 +03:00
Andrei Bodrov
3a7384b585 AvgData 2019-12-17 17:00:40 +03:00
alesapin
1c09a8b8aa Revert tests 2019-12-17 16:03:23 +03:00
alesapin
3c4f12cb7f Fix config subst test 2019-12-17 15:41:22 +03:00
alesapin
937eee15fe Fix check_table test 2019-12-17 15:40:18 +03:00
alesapin
9a005d27ea Merge branch 'master' into synchronous_mutations 2019-12-17 15:27:36 +03:00
alesapin
b2979546c3 Fix mutation number by default 2019-12-17 15:23:17 +03:00
alesapin
97e388db8e Add missed test for system.mutations 2019-12-17 15:22:28 +03:00
Vitaly Baranov
d0d5c72e4d Reloading of a dictionary now waits for results and shows errors. 
Clearer names for load and reload functions in ExternalLoader.
 2019-12-17 13:45:47 +03:00
Alexander Kuzmenkov
94b98e7f29
Set: initialize filter for Null values as well. (#8235) 
Found with MemorySanitizer.
 2019-12-17 13:20:04 +03:00
Alexander Kuzmenkov
8b1dae3f3d
Fix some implicit Field casts (#8209) 2019-12-17 13:19:21 +03:00
alesapin
3ad6b482ab
Merge pull request #8127 from ClickHouse/restrictions_for_external_dictionaries_from_ddl 
Add restrictions for several sources of external dictionaries
 2019-12-17 12:18:39 +03:00
philip.han
d5d8b2cefa Added a performance test for insertion of bloom_filter. 2019-12-17 17:59:02 +09:00
Olga Khvostikova
b47863a0c6
Fix segfault in table function file while inserting into it (#8177) 
* Fix segfault in table function file while inserting into it
 2019-12-17 11:06:39 +03:00
alexey-milovidov
7092520617
Update BloomFilterHash.h 2019-12-17 08:46:46 +03:00
hcz
dabaef2836 Fix correctness 2019-12-17 10:57:11 +08:00
kreuzerkrieg
9612bb0e79 More GCC warnings 2019-12-16 23:19:50 +02:00
alesapin
a2180b0bb3 Merge branch 'master' into restrictions_for_external_dictionaries_from_ddl 2019-12-16 23:07:16 +03:00
alesapin
9e7033cc68 Simplify test and sligtly increase timeouts 2019-12-16 22:56:17 +03:00
alexey-milovidov
fcca420e91
Merge pull request #8231 from ClickHouse/enabling_values_optimization_by_default 
Enable Values optimization by default
 2019-12-16 22:13:50 +03:00
Alexey Milovidov
4cf540b621 Applied a patch from Nicolae Vartolomei 2019-12-16 22:03:03 +03:00
Alexey Milovidov
0bc1c6d91d Changes after review of #8034 2019-12-16 21:51:42 +03:00
Alexey Milovidov
0042c8271e Changes after review of #8034 2019-12-16 21:41:51 +03:00
alexey-milovidov
12b3dcdcb8
Merge pull request #8034 from hombit/h3support 
h3 functions required for circle search
 2019-12-16 21:35:19 +03:00
alexey-milovidov
ed942ce29c
Update h3kRing.cpp 2019-12-16 21:34:51 +03:00
Konstantin Malanchev
f0b6a540ec Fix style of registerFunctionsGeo.cpp 2019-12-16 20:46:39 +03:00
Konstantin Malanchev
590627a658 Add h3EdgeAngle function 2019-12-16 20:46:39 +03:00
Konstantin Malanchev
1c1794d3d8 Add h3EdgeLengthM function 2019-12-16 20:46:38 +03:00
Konstantin Malanchev
9937fc7ff9 Add h3kRing function 2019-12-16 20:46:38 +03:00
alexey-milovidov
dd58ddbc9a
Merge pull request #8234 from ClickHouse/fix_insert_select_mysql 
Fix insert select from mysql(...)
 2019-12-16 20:42:02 +03:00
alesapin
2695aa13c4 Add ability to execute mutations asynchronously 2019-12-16 18:51:15 +03:00
alesapin
a67540e658
Merge pull request #8230 from Melancholic/master 
Fixed #5335. clickhouse-local. Print help if no arguments are passed
 2019-12-16 17:47:00 +03:00
Alexander Tokmakov
9e566d997e fix insert select from mysql(...) 2019-12-16 17:28:44 +03:00
hcz
a563ad0b21 Optimize rounding functions 2019-12-16 18:39:35 +08:00
Alexander Tokmakov
2980c1101e update tests 2019-12-16 13:24:02 +03:00
Alexander Tokmakov
cab852dd0e enable values optimization by default 2019-12-16 12:25:31 +03:00
nagorny
03f0909552 Fixed #5335. clickhouse-local. Print help if no arguments are passed 2019-12-16 12:05:26 +03:00
alexey-milovidov
bf1414cc76
Merge pull request #8225 from ClickHouse/tcmalloc-deprecate 
Deprecate tcmalloc
 2019-12-16 03:20:56 +03:00
Alexey Milovidov
952351a033 Fixed build after merge 2019-12-16 02:54:56 +03:00
alexey-milovidov
575984b4a0
Merge pull request #8189 from ClickHouse/regions-more-languages 
More languages for regions
 2019-12-16 02:47:20 +03:00
alexey-milovidov
d0ef4b6b96
Merge branch 'master' into more-accurate-using-load-reload 2019-12-16 02:42:45 +03:00
alexey-milovidov
38353d1253
Merge pull request #8197 from filimonov/fix_kafka_mv_subqueries 
Init query context for Kafka to make subqueries work
 2019-12-16 02:40:00 +03:00
Alexey Milovidov
d5d2959a5f Minor changes after merge #7900 2019-12-16 01:53:52 +03:00
Alexey Milovidov
ebf16a8a17 Deprecated tcmalloc 2019-12-16 01:37:27 +03:00
alexey-milovidov
d498e14ff8
Merge pull request #7900 from Vdimir/prometheus-metrics-7369 
Prometheus endpoint
 2019-12-16 01:16:52 +03:00
alexey-milovidov
3399f9a73c
Merge pull request #8112 from hczhcz/patch-1210 
Add function bankerRound
 2019-12-15 23:57:13 +03:00
Andrei Bodrov
e2f347a5ad fix test 2019-12-15 16:41:50 +03:00
Andrei Bodrov
cae40d3d94 fix name, add exception, add tests 2019-12-15 16:36:44 +03:00
hcz
3ff7c1e4dc Improve roundBankers implementation 2019-12-15 16:30:54 +08:00
Alexey Milovidov
6a34958fd2 Minor modifications 2019-12-15 02:00:18 +03:00
alexey-milovidov
3a265cd9f3
Merge pull request #8213 from ClickHouse/fix-exists-query 
Fixed segfault in EXISTS query
 2019-12-14 23:02:08 +03:00
Alexey Milovidov
22301e534b Don't use https in test to postpone fix of UBSan report in libressl 2019-12-14 19:48:19 +03:00
alexey-milovidov
cd556a35e6
Merge pull request #8210 from 4ertus2/bugs 
Fix `There's no column` error for materialized and alias columns
 2019-12-14 19:45:07 +03:00
alexey-milovidov
39a8f1e9c7
Merge pull request #8202 from zhang2014/feature/support_drop_mysql_database 
ISSUES-6063 support drop mysql database engine
 2019-12-14 19:44:17 +03:00
VDimir
d413c4a7d5 Add test_prometheus_endpoint 2019-12-14 19:40:50 +03:00
alexey-milovidov
e009584086
Merge pull request #8164 from nicelulu/master 
Fix trivial count query with ConvertingBlockInputStream.
 2019-12-14 19:39:49 +03:00
root
22bc508dc4 use currentDatabase(). 2019-12-14 13:28:16 +08:00
Nikita Mikhaylov
f055239cde
Merge pull request #8207 from nikitamikhaylov/fix-parallel-cancel-test 
Light fix of parallel cancel test
 2019-12-14 01:59:32 +03:00
Nikita Mikhaylov
69f32e007c
remove comment 2019-12-14 01:59:17 +03:00
Alexey Milovidov
0998dcbda6 Fixed segfault in EXISTS query 2019-12-13 23:24:03 +03:00
Winter Zhang
690502a435
update _remove.flag suffix to .remove_flag suffix 2019-12-14 04:15:40 +08:00
chertus
8c9ca6891f fix 'There's no column' error for materialized and alias columns 2019-12-13 21:46:55 +03:00
alexey-milovidov
8727f30ef8
Merge pull request #7790 from bgranvea/simple-aggregate-function-fix 
Fix "Sizes of columns doesn't match" error with SimpleAggregateFunction
 2019-12-13 20:56:03 +03:00
alexey-milovidov
d0408e8265
Merge pull request #8204 from ClickHouse/nullable-rand 
rand and nullable argument
 2019-12-13 20:50:07 +03:00
alexey-milovidov
86e1cbf80b
Merge pull request #8199 from Enmk/DateTime64_performance 
Improved performance of max(), min(), argMin(), argMax() for DateTime64
 2019-12-13 20:49:43 +03:00
Nikita Mikhaylov
9936fd2bc4 fix added 2019-12-13 19:44:33 +03:00
hcz
6171e8b70c Rename roundBankers 2019-12-13 22:50:14 +08:00
Alexander Kuzmenkov
5b67c55ec6 Update containers for #6892. 2019-12-13 16:57:10 +03:00
Nikolai Kochetov
1de6b244aa Fix randConstant. 2019-12-13 16:47:28 +03:00
Vasily Nemkov
d8473c17a3 Improved performance of max(), min(), argMin(), argMax() for DateTime64 2019-12-13 16:40:09 +03:00
Boris Granveaud
3502e3858a provide test case 2019-12-13 14:10:49 +01:00
Nikolai Kochetov
bd2517343d Fi rand and randConstant for nullable types. 2019-12-13 16:10:02 +03:00
zhang2014
713923e451 Support detach and drop table for mysql database engine 2019-12-13 19:48:38 +08:00
vxider
142932ebdf fix gcc 8.2.1 build (#8162) 2019-12-13 14:18:09 +03:00
philip.han
fe7ae014d8 Fixed bloom_filter bug that counting error for Array(Nullable(String)). 2019-12-13 18:38:03 +09:00
Konstantin Malanchev
4eae32d438 Add h3IsValid function 2019-12-13 11:39:50 +03:00
Konstantin Malanchev
947fb39d5e Add h3getResolution function 2019-12-13 11:39:50 +03:00
root
63aaf64e93 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into lulu-master1 2019-12-13 16:12:43 +08:00
alesapin
d894d1df3d
Merge pull request #8135 from excitoon/patch-4 
Fixed `test_multiple_disks::test_kill_while_insert` a little
 2019-12-13 11:06:34 +03:00
zhangxiao018
9e0b1c9f65 add test. 2019-12-13 12:01:23 +08:00
zhangxiao018
8a2b8647e4 add test. 2019-12-13 11:59:51 +08:00
Mikhail Filimonov
f3fa71c707 Init query context for Kafka to make subqueries work 2019-12-13 02:21:40 +01:00
alexey-milovidov
399995d60b
Merge pull request #7812 from infinivision/fix_part_mutation 
fix part mutation
 2019-12-13 03:45:59 +03:00
alexey-milovidov
ad76a1bafb
Merge pull request #8185 from vitlibar/fix-drop-dictionary-if-exists 
Fix DROP DICTIONARY IF EXISTS
 2019-12-13 02:47:06 +03:00
alexey-milovidov
575208c6e2
Merge pull request #8182 from ClickHouse/aku/msan-exception 
Suppress an msan false positive in exception handling.
 2019-12-13 02:41:28 +03:00
alexey-milovidov
31e4d40501
Merge pull request #8106 from ClickHouse/function-refactoring 
Function refactoring
 2019-12-13 02:30:55 +03:00
alexey-milovidov
d0cf282204
Merge pull request #8179 from ClickHouse/parts_to_do_names 
Add parts_to_do_names column to system.mutations.
 2019-12-13 02:30:03 +03:00
alexey-milovidov
efb916c556
Merge pull request #8176 from ClickHouse/fix_tmp_drop_relative_path 
Fix loading of partially dropped table
 2019-12-13 02:28:13 +03:00
alexey-milovidov
be08e4cdf1
Merge pull request #8190 from filimonov/issue5142test 
Test for issue #5142
 2019-12-13 02:27:53 +03:00
alexey-milovidov
69535078fd
Merge pull request #8192 from excitoon-favorites/better-logging-disks 
Better logging in background move task.
 2019-12-13 02:27:38 +03:00
alexey-milovidov
32f42c4e92
Merge pull request #8194 from excitoon-favorites/fixed-move-pool 
Fixed metrics in `BackgroundProcessingPool`
 2019-12-13 02:26:52 +03:00
alexey-milovidov
d354628010
Merge pull request #8088 from dingxiangfei2009/ClusterCopier/refine-zxid-def 
ClusterCopier: refine zxid definition
 2019-12-13 02:25:41 +03:00
alexey-milovidov
d2c7a10340
Update ClusterCopier.cpp 2019-12-13 02:25:12 +03:00
Vladimir Chebotarev
8a423a94b6 Fixed a typo. 2019-12-13 01:18:25 +03:00
Artem Zuikov
5783142f39
Merge pull request #8178 from 4ertus2/some 
Refactoring: extract getTableExpressions() variants into own file
 2019-12-13 01:09:47 +03:00
Vladimir Chebotarev
e413cd6e6c Fixed metrics in BackgroundProcessingPool. 2019-12-13 01:08:54 +03:00
Vladimir Chebotarev
9882c7c5ad Minor fix in logging. 2019-12-13 00:38:05 +03:00
Vladimir Chebotarev
9393bb0f12 Better logging in background move task. 2019-12-13 00:34:57 +03:00
alexey-milovidov
989671cffe
Update 01046_materialized_view_with_join_over_distributed.sql 2019-12-13 00:01:33 +03:00
Mikhail Filimonov
32cd2912b7 Test for https://github.com/ClickHouse/ClickHouse/issues/5142 2019-12-12 21:49:45 +01:00
Alexey Milovidov
df5f1f7433 More languages for regions 2019-12-12 22:34:58 +03:00
Alexey Milovidov
f88c94ed56 Changes after review of #8149 2019-12-12 22:12:18 +03:00
alexey-milovidov
0dc62d20e1
Merge pull request #8149 from zhang2014/feature/array_zip 
Add arrayZip function
 2019-12-12 22:00:39 +03:00
alexey-milovidov
e917b8563e
Merge pull request #8186 from ClickHouse/proper-fix-for-variant-conversion 
Proper fix for #8147
 2019-12-12 21:55:47 +03:00
alexey-milovidov
b67c1ecffa
Revert "fix compilation (std::variant with narrowing) with system libcxx" 2019-12-12 21:55:12 +03:00
Alexey Milovidov
8580f8b56c Proper fix for #8147 2019-12-12 21:53:48 +03:00
Vitaly Baranov
4c157007f5 Refactoring of using ExternalLoader in dictionary DDL: 
Instead of using ExternalLoader::reload() now it's used reloadConfig() which reloads only what necessary.
Functions attachDictionary() and detachDictionary() are simplified and have lesser number of parameters.
Instead of injecting into LoadablesConfigReader's internals for creating dictionary a temp repository is used.
 2019-12-12 21:45:58 +03:00
Alexey Milovidov
575da23573 Fixed build 2019-12-12 21:40:46 +03:00
Vitaly Baranov
f81d9b4e73 Fix DROP DICTIONARY IF EXISTS db.dict - now it doesn't throw exceptions 
even if db doesn't exist.
 2019-12-12 21:37:44 +03:00
Alexander Kuzmenkov
f0ed2bd233 Suppress an msan false positive in exception handling. 
See https://github.com/google/sanitizers/issues/1155
 2019-12-12 21:28:58 +03:00
alexey-milovidov
51ed10ed78
Merge pull request #8011 from Jokser/aws-s3-sdk-integration 
AWS SDK S3 integration
 2019-12-12 20:43:16 +03:00
Nikolai Kochetov
d29561984a Fix build. 2019-12-12 19:59:17 +03:00
chertus
77ab1dbccb move one more function 2019-12-12 19:54:04 +03:00
alesapin
b7622c8fd9 Add parts_to_do_names column to system.mutations 2019-12-12 19:24:03 +03:00
chertus
68a33863ab extract getTableExpressions variants into own file 2019-12-12 19:06:18 +03:00
alexey-milovidov
5774078854
Merge pull request #8173 from excitoon/patch-5 
Fixed flapping `test_ttl_move::test_moves_after_merges_work`
 2019-12-12 18:22:34 +03:00
alexey-milovidov
c47acef529
Merge pull request #8163 from ClickHouse/dictionaries_ddl_on_cluster 
Dictionaries ddl on cluster
 2019-12-12 18:20:15 +03:00
alexey-milovidov
1bb14bb67e
Merge pull request #8147 from podshumok/patch-3 
fix compilation (std::variant with narrowing) with system libcxx
 2019-12-12 18:19:22 +03:00
alexey-milovidov
29b2e26074
Merge pull request #8144 from 4ertus2/decimal 
Decimal specializations for min/max
 2019-12-12 18:18:14 +03:00
alesapin
8fb9541958
Merge pull request #7946 from Alex-Burmak/filesystem_abstraction 
Filesystem abstraction layer
 2019-12-12 18:12:35 +03:00
Nikolai Kochetov
7082f8028b Merged with master. 2019-12-12 18:04:30 +03:00
Nikolai Kochetov
06f2fa8433 Add more comments, rename classes, move functions adaptors to separate file. 2019-12-12 17:56:03 +03:00
Nikolai Kochetov
168a55b617 Fix build. 2019-12-12 17:55:55 +03:00
Nikolai Kochetov
7dba6849c8 Fix concat and reverse for arrays. 2019-12-12 17:55:35 +03:00
Nikolai Kochetov
17af1ed25f Fix FunctionExpression. 2019-12-12 17:55:35 +03:00
Nikolai Kochetov
9c4d123f87 Style fixes. 2019-12-12 17:55:35 +03:00
Nikolai Kochetov
187cc83702 update tuple comparison. 2019-12-12 17:55:35 +03:00
Nikolai Kochetov
5289b67b70 update LLVMFunction. 2019-12-12 17:55:35 +03:00
Nikolai Kochetov
63a8dcd2e8 update yestarday. 2019-12-12 17:55:35 +03:00
Nikolai Kochetov
7336f3fa7f update transform. 2019-12-12 17:55:35 +03:00
Nikolai Kochetov
a18f0c5aa6 update FunctionArrayMapped. 2019-12-12 17:55:35 +03:00
Nikolai Kochetov
db08cc1b5a update toTypeName. 2019-12-12 17:55:35 +03:00
Nikolai Kochetov
b401dc521a update reverse. 2019-12-12 17:55:35 +03:00
Nikolai Kochetov
d7b08b166b update now and today. 2019-12-12 17:55:35 +03:00
Nikolai Kochetov
a9f1a2e382 Fix compile errors. 2019-12-12 17:55:36 +03:00
Alexander Tokmakov
1a6c973055 use absolute path and try to load table 2019-12-12 17:47:31 +03:00
Vladimir Chebotarev
3630b06cf9 Fixed flapping test_ttl_move::test_moves_after_merges_work 2019-12-12 16:42:03 +03:00
hcz
c0028c3942 Add aggregate function categoricalInformationValue (#8117) 
* Add categorical iv aggregate function with tests
 2019-12-12 16:28:28 +03:00
chertus
c63a0e88ed add perf test for decimal aggregates 2019-12-12 16:11:07 +03:00
chertus
16844012e4 Merge branch 'master' into decimal 2019-12-12 15:35:30 +03:00
alexey-milovidov
604a31bb66
Merge pull request #8143 from Akazz/race_condition/process_ordinary_query 
Resolved data race in DB::BlockStreamProfileInfo::calculateRowsBeforeLimit()
 2019-12-12 15:32:47 +03:00
Alexander Burmak
1f69a7a015 Fixed merge issues 2019-12-12 14:10:18 +03:00
alesapin
e7f5b92b19 Add ability to create external dictionaries ON CLUSTER 2019-12-12 13:27:02 +03:00
zhangxiao018
c03f126057 fix trivial count query with ConvertingBlockInputStream. 2019-12-12 18:21:08 +08:00
Ding Xiang Fei
21c571c5b5
Add reference to Zookeeper Internals manual 2019-12-12 18:16:14 +08:00
Nikolai Kochetov
7ad2a6dd0b
Merge pull request #7170 from Enmk/DateTime64 
DateTime64 data type
 2019-12-12 12:20:22 +03:00
Alexander Burmak
c514ec3278 Minor code cleanup 2019-12-12 12:18:46 +03:00
Alexander Burmak
2ce6136de5 Merge remote-tracking branch 'refs/remotes/upstream/master' into vfs 2019-12-12 12:10:50 +03:00
Alexander Kazakov
954d5072e9 Returned the terminating sendProgress() in processOrdinaryQuery 2019-12-12 07:46:39 +03:00
CurtizJ
d17f785260 fix tests 2019-12-12 00:51:06 +03:00
CurtizJ
d6058322e5 add test for special engines with order by 2019-12-11 23:07:41 +03:00
CurtizJ
890bfeb4eb fix order description analyzing 2019-12-11 21:52:59 +03:00
Nikolai Kochetov
1d90c4c555 Fix build. 2019-12-11 20:09:42 +03:00
zhang2014
194ab5526d add arrayZip function 2019-12-12 00:22:14 +08:00
Nikolai Kochetov
ea05ab293d Fix PVS check. 2019-12-11 19:09:43 +03:00
Konstantin Podshumok
7635cf93bd
fix compilation (std::variant with narrowing) with system libcxx 2019-12-11 18:33:14 +03:00
Alexander Kazakov
eb5040771b Minor correction 2019-12-11 17:54:19 +03:00
Vasily Nemkov
f8fec0402b Merge commit 'e7540dcf686936a490f89d0735f74c2f5f009821' into DateTime64 2019-12-11 17:38:32 +03:00
Pavel Kovalenko
daf064d13b Merge remote-tracking branch 'jokser/aws-s3-sdk-integration' into aws-s3-sdk-integration 2019-12-11 17:32:33 +03:00
Vasily Nemkov
61197370bb Merge branch 'DateTime64' of github.com:Enmk/ClickHouse into DateTime64 2019-12-11 17:25:34 +03:00
Vasily Nemkov
514847609d PR fixes: 
* Fixed precision calculation in DataTypeDecimalBase c-tor
* Fixed max precision calculation in getLeastSupertype
* Fixed reading past end of vector in FunctionsConversion with extractToDecimalScale
* More verbose comments on FunctionArgumentTypeValidator and validateFunctionArgumentTypes
* style and other minor fixes.
 2019-12-11 17:24:59 +03:00
Pavel Kovalenko
c7f016fc4e AWS SDK integration - code cleanup. 2019-12-11 17:21:48 +03:00
chertus
4907ca734c Decimal specializations for min/max 2019-12-11 17:16:59 +03:00
Alexander Kazakov
292e3a0d24 Reworked TCPHandler::processOrdinaryQuery() to resolve race condition 2019-12-11 16:30:27 +03:00
Nikolai Kochetov
20026d7931 Added perftest. 2019-12-11 16:17:30 +03:00
CurtizJ
6834fbf03d implement ORDER BY optimization for some other meta-storages 2019-12-11 16:09:46 +03:00
alesapin
3229261c91 Fix dictionary_source check 2019-12-11 14:09:21 +03:00
alesapin
2940aeff23 Fix style 2019-12-11 13:24:20 +03:00
alesapin
fd9483efbe Just trigger CI 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
0ff0a52249 Missed review fixes. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
f2aee64072 Minor style fix. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
e41deb5848 Added comment to MergeTreePartsMover::selectPartsForMove(). 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
7fd1668fde Review fixes. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
065b681a8c Boosted test_ttl_move::test_moves_to_volume_work a little. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
e3ed311273 Fixed Clang build. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
67aa268bbb Finally fixed tests and logic for extended TTL syntax. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
f83b28a1c1 Fixed a typo in MergeTreeData::selectMoveDestination(). 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
618a39cc8c Don't move anything if part already belongs their destination. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
f72da4ab0c Removing expired rows shall not be triggered on move TTL expiration. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
8ed37801ca Finally fixed selection of destination of move TTL. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
15fb64f54b Fixed move TTL expiration logic. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
164360e7ad Fixed test_ttl_move again. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
2e853e3211 Fixed more typos in test_ttl_move. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
df002f20b1 Fixed move TTL metadata. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
14cf530542 Added move TTL rules to metadata of ReplicatedMergeTree. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
7407f7c39d Placed move TTL rules to a vector. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
ae4b2b4ace Fixed some typos in test_ttl_move test. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
3250955b07 Refactored tests a little bit. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
b3427af0c1 Fixed typos in a test. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
108e2b33eb Fixed a bug with erasing columns with same name. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
0da7234d99 Added few FIXMEs to not forget. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
b3e261800d Fixes of tests for extended TTL syntax. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
ce851fc782 Fixed MergeTreeData::hasTableTTL() method according to extended TTLs. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
e163ebb7f0 Fixed more typos in test_ttl_move test. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
cc70f717ed Fixed typos in test_ttl_move test. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
617bf4214f Added first version of tests for extended TTL expressions (still need refactoring). 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
cb777f6c50 Removed redundant template from updateTTL() method. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
62016feab0 Renamed TTLDestinationType to PartDestinationType. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
cc0c21604f Fixed Clang build one more time. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
ce066d3bb0 Style fixes. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
88c7220256 Fixed Clang build. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
07c4fa3cc0 Correct merge of background move pool. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
3e3e9ac56f Moved settings for BackgroundProcessingPool to configuration. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
e519c04bbe Minor fix of JSON handling in MergeTreeDataPartTTLInfo. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
342ea5c30a Removed TODO comments. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
773bf7b35c Removed 'DELETE' keyword from default TTL syntax description. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
58e824b6a1 Refactored, added move enforcement on merges, fixed a bug with wrong disk selection in ReplicatedMergeTree. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
dfe0edc03f Style fix. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
76c4ac9f60 Fixed ttl move logic in background move task and added ttl enforcement on inserts. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
4cd75f926b Fixed 00933 ttl tests. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
575de5ada6 Attempt to add background moves by TTL expressions. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
893e0de37a Minor fix. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
33ded274a3 First attempt to store min/max for move ttl expressions. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
5a12986159 Updated ttl test according to new TTL syntax. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
3e984609fb Fixed ClickHouse after changing syntax. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
7a37c4f6a9 Parser for extended TTL expressions. 2019-12-11 13:24:20 +03:00
alesapin
4385aab4a1 Merge branch 'master' into restrictions_for_external_dictionaries_from_ddl 2019-12-11 12:29:55 +03:00
Vasily Nemkov
c781908e6d Post-PR fixes 
* More precise overflow check in readIntTextImpl
* writeDateTimeText now always writes sub-second part for DateTime64
* comment for validateFunctionArgumentTypes
* DateTime64-related fixes for FunctionConvertFromString
* other minoe fixes: comments, removed commented out code, variable
  renamings, etc.
 2019-12-11 12:20:05 +03:00
Vladimir Chebotarev
1ca9cefa1d
Fixed typo. 2019-12-11 11:58:53 +03:00
Vladimir Chebotarev
f5d162c5ed
Fixed test_multiple_disks::test_kill_while_insert a little. 2019-12-11 07:59:37 +03:00
Vasily Nemkov
f56b2b64f2 Post-review refactoring and tests for DateTime64 and Decimal. 
* put functions in DecimalFunctions into DecimalUtils namespace
* fixed possible buffer overflow in parseDateTimeBestEffortImpl
* fixed readDateTimeTextImpl not to require fractional part separator
  (if fractional part is missing)
* Tests for code from DecimalFunctions.h
* Fixed serializing DateTime64 to string with writeDateTimeText(), fixed tests
 2019-12-11 06:58:49 +03:00
Alexey Milovidov
4f9cd8a3c8 Update contributors 2019-12-11 06:13:33 +03:00
hcz
3a18d6b494 Add performance tests 2019-12-11 10:44:04 +08:00
hcz
2f276c2bb7 Rename bankerRound as bankersRound 2019-12-11 10:43:47 +08:00
alexey-milovidov
3540dd5c53
Update ClusterCopier.cpp 2019-12-11 04:53:29 +03:00
CurtizJ
fd5b23730e implement order by optimization for storage Merge 2019-12-11 04:35:47 +03:00
CurtizJ
45a9751c31 refactoring of order by optimization 2019-12-11 04:34:39 +03:00
Zhichang Yu
ff1b8d46e2 fixed part mutation, added test_backup_restore integration test case 2019-12-11 09:31:37 +08:00
alexey-milovidov
e73e19dc97
Merge pull request #8111 from azat/dictionary-reload-test-hotfix 
Fix async nature of reload in 01036_no_superfluous_dict_reload_on_create_database*
 2019-12-11 04:20:17 +03:00
alexey-milovidov
aecd5a5493
Merge pull request #8123 from ClickHouse/aku/field-prepare 
Prepare for stricter type checking in Field.
 2019-12-11 02:21:34 +03:00
CurtizJ
9e75892516 refactoring of order by optimization 2019-12-11 02:18:24 +03:00
alexey-milovidov
309653f60d
Merge pull request #7182 from ClickHouse/aku/zlib-msan 
Update zlib-ng to fix MemorySanitizer problems.
 2019-12-11 02:15:16 +03:00
alexey-milovidov
85d668ebf4
Update S3Common.cpp 2019-12-11 02:03:45 +03:00
alesapin
6842ff02c9 Fix shared build 2019-12-10 23:39:36 +03:00
alesapin
ea8994b9e4 Add restrections for several sources of external dictionaries 2019-12-10 20:27:29 +03:00
Pavel Kovalenko
c4b3cce847 AWS SDK integration - move s3 storage syntax tests to integration. 2019-12-10 19:11:13 +03:00
alesapin
67f1ff1c8b
Merge pull request #8104 from excitoon-favorites/test_move_after_merge 
FIxed behavior with ALTER MOVE ran immediately after merge finish moves superpart of specified
 2019-12-10 17:15:08 +03:00
Alexander Kuzmenkov
50a8a7197f Prepare for stricter type checking in Field. 2019-12-10 16:40:45 +03:00
Alexander Kuzmenkov
3df94283b3 Remove a workaround for zlib-ng MemorySanitizer problems. 2019-12-10 13:15:18 +03:00
alesapin
397a3fc2e7
Merge pull request #8098 from ClickHouse/fix_dictionary_properties 
Fix dictionary properties
 2019-12-10 12:55:29 +03:00
Vladimir Chebotarev
269a0246aa Added explicit check for existence of part and pair of log messages. 2019-12-10 12:47:23 +03:00
Vladimir Chebotarev
ed719f38b2 Added test_multiple_disks::test_move_after_merge. 2019-12-10 12:47:23 +03:00
VDimir
b6aadf468a Prometheus metric prefixes in CamelCase 2019-12-10 08:31:59 +00:00
hcz
8ed416ed41 Add bankerRound 2019-12-10 14:13:05 +08:00
Azat Khuzhin
65572a23fe Fix async nature of reload in 01036_no_superfluous_dict_reload_on_create_database* 
Due to the async nature of SYSTEM RELOAD DICTIONARY/DICTIONARIES the
test can fail, if the reload will happen after the dictGet*():

    .862801 [ 36 ] {61df55ee-4a17-4bf3-8cfb-9478490393c3} <Debug> executeQuery: (from [::1]:37422) SYSTEM RELOAD DICTIONARY `foo 1234.dict`
    .863681 [ 36 ] {cd55d9f9-d176-4b19-bc97-d25575da2d15} <Debug> executeQuery: (from [::1]:37422) SELECT query_count FROM system.dictionaries WHERE (database = 'foo 1234') AND ...
    .863678 [ 54 ] {} <Debug> executeQuery: (internal) SELECT `key`, `val` FROM `foo 1234`.`dict_data`;

This is just a hotfix, long-term solution will be to make SYSTEM RELOAD
DICTIONARY syncronous (by adding another command or making already
existing).

Refs: #7916
 2019-12-10 08:31:51 +03:00
Ding Xiang Fei
0f22f90ee5
refine zxid definition: it has two warping uint32 counters 2019-12-10 09:44:06 +08:00
Vladimir Chebotarev
ea44510b44 Minor fix of test. 2019-12-09 23:29:44 +03:00
Vladimir Chebotarev
6afd8d7805 Added test_multiple_disk::test_kill_while_insert, reworked log message and fixed logic of treating stale copies. 2019-12-09 23:29:44 +03:00
Vladimir Chebotarev
a2f238d8da Added more logging and switched to detaching stale part instead of removing. 2019-12-09 23:29:44 +03:00
Vladimir Chebotarev
9cf7ef03af Fixed handling of MergeTreeData::DataPartPtr's in MergeTreeData::swapActivePart(). 2019-12-09 23:29:44 +03:00
Vladimir Chebotarev
374e0f7bb5 Finally fixed tests. 2019-12-09 23:29:44 +03:00
Vladimir Chebotarev
c283776e84 Really fixed tests. 2019-12-09 23:29:44 +03:00
Vladimir Chebotarev
89659a9129 Fixed a typo. 2019-12-09 23:29:44 +03:00
Vladimir Chebotarev
fe3e89fb38 Fixed tests. 2019-12-09 23:29:44 +03:00
filimonov
f545da40e6 style 2019-12-09 23:29:44 +03:00
filimonov
0ab67c7b1f Log when part is removed after move 2019-12-09 23:29:44 +03:00
Vladimir Chebotarev
efa73608b8 Separated constant path to DeleteOnDestroy marker. 2019-12-09 23:29:44 +03:00
Vladimir Chebotarev
13c5c621c1 Attempt to ignore redundant copies of parts after move and restart. 2019-12-09 23:29:44 +03:00
alexey-milovidov
cce78ef018
Merge pull request #8036 from yurriy/mysql 
Compatibility with MySQL clients which don't support sha2_password auth plugin
 2019-12-09 23:11:31 +03:00
Alexey Milovidov
285139585c Updated test 2019-12-09 23:08:19 +03:00
Alexey Milovidov
da72203ceb Added a comment 2019-12-09 22:53:40 +03:00
Alexey Milovidov
2fe7472a63 Added function "greatCircleAngle"; changed earth radius 2019-12-09 22:35:25 +03:00
Alexey Milovidov
67fd108848 Added a test for "greatCircleAngle" 2019-12-09 22:34:00 +03:00
Alexey Milovidov
1e3b9af66f Added clarifications 2019-12-09 20:25:16 +03:00
Alexey Milovidov
2db25df706 Merge branch 'master' into geodist-less-wrong 2019-12-09 18:42:37 +03:00
Nikolai Kochetov
fd62c09a8b Update FunctionCapture and FunctionExpression. 2019-12-09 17:36:47 +03:00
Alexander Burmak
5a93441445 Merge remote-tracking branch 'refs/remotes/upstream/master' into vfs 2019-12-09 17:18:47 +03:00
alesapin
85aac386aa Missed commit 2019-12-09 17:06:28 +03:00
alesapin
642ce2d751 Fix escaping and add string expressions support 2019-12-09 17:05:58 +03:00
Nikolai Kochetov
18bfa684a2 Rename IFunction.h to IFunctionImpl.h in functions implementations. 2019-12-09 16:12:54 +03:00
Pavel Kovalenko
ba59991912 AWS SDK integration - added new lines at the end of files. 2019-12-09 15:36:06 +03:00
Pavel Kovalenko
971c48e1cf AWS SDK integration - fixed test with remote host filter. 2019-12-09 15:05:16 +03:00
Pavel Kovalenko
94e9638006 AWS SDK integration added url checking. 2019-12-09 13:58:57 +03:00
alexey-milovidov
9106b2854a
Merge pull request #8084 from azat/read-temporary-tables-on-failure 
Read temporary tables on failure to avoid interpreting that bits as query
 2019-12-09 13:49:09 +03:00
Alexander Burmak
f27d462986 Minor amendments 2019-12-09 08:47:12 +03:00
alexey-milovidov
d051a03794
Merge pull request #8042 from excitoon-favorites/gmtime 
Removed `localtime` from `HTTPDictionarySource::getUpdateFieldAndDate…
 2019-12-09 04:57:18 +03:00
alexey-milovidov
79215bd029
Merge pull request #8025 from excitoon/patch-2 
Added `-D LINKER_NAME=lld` to instruction to sanitizers.
 2019-12-09 04:56:17 +03:00
alexey-milovidov
4aa6b61859
Update sanitizers.md 2019-12-09 04:55:58 +03:00
alexey-milovidov
624be3679b
Merge branch 'master' into mysql 2019-12-09 04:53:30 +03:00
alexey-milovidov
0d278b414c
Merge pull request #8046 from amosbird/interpose 
Interpose malloc symbols entirely.
 2019-12-09 04:33:49 +03:00
alexey-milovidov
abb823af7f
Merge pull request #8079 from yurriy/mysql-types-test 
Fixed Float64 conversion in MySQL protocol
 2019-12-09 04:32:22 +03:00
alexey-milovidov
a3c6402e8b
Added perf test for collations (#8087) 2019-12-09 04:23:58 +03:00
Alexey Milovidov
b5e05d761b Whitespace 2019-12-09 04:15:42 +03:00
Alexey Milovidov
9399b39070 Fixes 2019-12-09 04:09:03 +03:00
Alexey Milovidov
41a6eedadc Added comment 2019-12-09 04:02:09 +03:00
Alexey Milovidov
c6cc5770cc Merge branch 'geodist-less-wrong' of github.com:yandex/ClickHouse into geodist-less-wrong 2019-12-09 03:20:45 +03:00
Alexey Milovidov
2afdb4f6a8 Added a test 2019-12-09 03:20:34 +03:00
Alexey Milovidov
fb908eae0a Fixed comments 2019-12-09 03:02:50 +03:00
Alexey Milovidov
b977aa3cdf Fixed error 2019-12-09 02:59:25 +03:00
Alexey Milovidov
c738d92411 Maybe better memory layout 2019-12-09 02:55:56 +03:00
Alexey Milovidov
171bb14614 Addition to prev. revision 2019-12-09 02:41:34 +03:00
Alexey Milovidov
1835087291 Added function geoDistance and returned the old behaviour of greatCircleDistance 2019-12-09 02:40:53 +03:00
Alexey Milovidov
109542c445 Small improvements 2019-12-09 02:09:05 +03:00
Alexey Milovidov
09df6a0c00 Small improvements 2019-12-09 02:02:44 +03:00
Alexey Milovidov
f7320e50b7 Renamed variables 2019-12-09 02:00:34 +03:00
Alexey Milovidov
a04ed4883d Added comments 2019-12-09 01:44:17 +03:00
Alexey Milovidov
4f3e7427e8 Fixed error in perf test 2019-12-09 01:41:45 +03:00
Alexey Milovidov
19f05c4594 Removed too strict type check 2019-12-09 01:09:32 +03:00
Alexey Milovidov
3d71cb0596 Make the code of greatCircleDistance less wrong 2019-12-09 00:59:41 +03:00
Alexey Milovidov
eca601239f Removed a test with typo in its name 2019-12-09 00:37:04 +03:00
Nikolai Kochetov
a73eb4292b Functions refactor part 1. 2019-12-09 00:06:37 +03:00
alexey-milovidov
7e8b177a3b
Merge pull request #8077 from nvartolomei/nv/system-query-parser 
Fix SYSTEM query parser suggestions
 2019-12-09 00:04:14 +03:00
alexey-milovidov
cf194edfaf
Merge pull request #8016 from filimonov/kafka_fixes 
Kafka fixes
 2019-12-09 00:03:36 +03:00
alexey-milovidov
ee7d675f86
Update KafkaBlockInputStream.cpp 2019-12-09 00:03:09 +03:00
alexey-milovidov
a7f5ac7099
Merge pull request #8081 from errx/master 
Added new function JSONExtractArrayRaw
 2019-12-08 23:52:56 +03:00
alexey-milovidov
21a7a53491
Update FunctionsJSON.h 2019-12-08 23:48:34 +03:00
alexey-milovidov
16754bfff5
Merge pull request #8043 from excitoon-favorites/systemmergespaths 
Added information about paths to `system.merges`.
 2019-12-08 23:30:39 +03:00
Azat Khuzhin
7b4fcc5fc5 Read temporary tables on failure to avoid interpreting that bits as query 
Before this patch if the query failes (due to "Too many simultaneous
queries" for example) it will not read external tables info, and the
next request will interpret them as the query beginning at got:

  DB::Exception: Unknown packet 11861 from client

v2: reordering in the executeQuery() is not enough, since the query
    can fail in other places, before, i.e. quotas
v3: I cannot make non-intergration test (since there is no ability to
    receive "Unknown packet" via client, only from the server log),
    hence added one
 2019-12-08 23:26:43 +03:00
Alexander Burmak
edd11abad1 Addressed code review comments 2019-12-08 19:47:51 +03:00
tyrionhuang
6cf7ac045b fix BitmapAnd error, like issue #5479: bitmapHasAny in scalar subquery causes segment fault 2019-12-08 23:10:37 +08:00
Oleg Matrokhin
8ea7cab7e4 simplify expression 2019-12-08 18:07:06 +03:00
tyrionhuang
213e2dd700 fix BitmapAnd error, like issue #5479: bitmapHasAny in scalar subquery causes segment fault 2019-12-08 22:44:17 +08:00
Oleg Matrokhin
2cab90b9f4 fmt 2019-12-08 17:36:31 +03:00
Oleg Matrokhin
36303a82f7 add tests 2019-12-08 17:24:37 +03:00
Alexander Burmak
8104395dd2 Merge remote-tracking branch 'refs/remotes/upstream/master' into vfs 2019-12-08 11:45:18 +03:00
alesapin
af7b8f9274
Merge pull request #8051 from ClickHouse/fix_collations_behaviour 
Fix several bugs with collations.
 2019-12-08 11:10:23 +03:00
Sergei Shtykov
b4839c52db The most working of all the previous versions. 2019-12-08 10:56:07 +03:00
Yuriy
e0796261aa mysql protocol: fixed Float32 conversion and added types test 2019-12-08 08:40:08 +03:00
Oleg Matrokhin
10cf9e5b9f implement new function 2019-12-08 03:18:24 +03:00
Nicolae Vartolomei
f5e764eba1 Fix SYSTEM query parser suggestions 2019-12-07 23:05:57 +00:00
Vladimir Chebotarev
984e81876a Fixed Clang build. 2019-12-07 22:30:37 +03:00
Vladimir Chebotarev
bb0de2509a Fixed test_system_merges/test.py::test_mutation_simple[replicated] test. 2019-12-07 22:23:25 +03:00
Vladimir Chebotarev
c60493fe72 Fixed test_system_merges/test.py::test_merge_simple[replicated] test. 2019-12-07 22:02:01 +03:00
alesapin
2fffe2802f Review fixes 2019-12-07 16:13:14 +03:00
Vladimir Chebotarev
ed2ec2d15d Fixed test_system_merges to correctly check replicated node set. 2019-12-07 13:35:13 +03:00
Vladimir Chebotarev
1513e5a854 Added replicated tests for system.merges. 2019-12-07 13:15:01 +03:00
Vladimir Chebotarev
1fbfb50fba Fixed updating result_part_path while merging and mutating. 2019-12-07 12:54:05 +03:00
Vladimir Chebotarev
b64b2cff09 Added simple non-replicated tests for system.merges. 2019-12-07 11:40:49 +03:00
alesapin
b9591a8bb4 Fix variable scope 2019-12-07 11:17:01 +03:00
Vladimir Chebotarev
05a05b5fb6 Fixed result_part_part of a mutation. 2019-12-07 11:10:08 +03:00
alesapin
5b828a6cbf Better test 2019-12-07 01:25:14 +03:00
alesapin
3881a85c39 Review fixes 2019-12-07 01:22:12 +03:00
alexey-milovidov
56b2ec8b4a
Merge pull request #7693 from millb/hashes_from_values_of_UUID_type 
Created cityHash for decimal and UUID types.
 2019-12-07 00:30:28 +03:00
alexey-milovidov
113ddb2588
Update FunctionsHashing.h 2019-12-06 22:21:22 +03:00
alexey-milovidov
1c1351d644
Update FunctionsHashing.h 2019-12-06 22:19:19 +03:00
alexey-milovidov
e0aa12717b
Update FunctionsHashing.h 2019-12-06 22:18:47 +03:00
alexey-milovidov
bef3a0d2d2
Merge pull request #8071 from azat/Connection-sendCancel-SIGSEGV 
Avoid null dereference after "Unknown packet X from server"
 2019-12-06 22:15:18 +03:00
alexey-milovidov
36203721de
Update Connection.cpp 2019-12-06 22:14:27 +03:00
millb
6799feaba6 Merge branch 'hashes_from_values_of_UUID_type' of github.com:millb/ClickHouse into hashes_from_values_of_UUID_type 2019-12-06 22:08:40 +03:00
millb
b13cd85613 Applied the required changes 2019-12-06 22:08:21 +03:00
Azat Khuzhin
e4209d6a3f Avoid null dereference after "Unknown packet X from server" 
stracktrace:
  ...
  2  DB::WriteBuffer::nextIfAtEnd (this=0x0) at ../dbms/src/IO/WriteBuffer.h:66
  3  DB::writeVarUInt (ostr=..., x=3) at ../dbms/src/IO/VarInt.h:191
  4  DB::Connection::sendCancel (this=0x7f0b7f5e5610) at ../dbms/src/Client/Connection.cpp:444
  5  0x0000561738d0b565 in DB::MultiplexedConnections::sendCancel (this=0x7f0c9b0173e0) at ../dbms/src/Client/MultiplexedConnections.cpp:174
  6  0x00005617387d22df in DB::RemoteBlockInputStream::tryCancel (this=0x7f0cc45f9810, reason=<optimized out>) at /usr/include/c++/9/bits/unique_ptr.h:352
  7  0x00005617387d2a37 in DB::RemoteBlockInputStream::cancel (this=<optimized out>, kill=false) at ../dbms/src/DataStreams/RemoteBlockInputStream.cpp:121
  8  0x000056173891f10c in DB::ParallelInputsProcessor<DB::UnionBlockInputStream::Handler>::cancel (this=0x7f0c370ec168, kill=kill@entry=false)
  9  0x000056173892cfce in DB::UnionBlockInputStream::cancel (kill=false, this=<optimized out>) at ../dbms/src/DataStreams/UnionBlockInputStream.h:99
  10 DB::UnionBlockInputStream::Handler::onException (this=0x7f0c370ec160, exception=...) at ../dbms/src/DataStreams/UnionBlockInputStream.h:240
  11 DB::ParallelInputsProcessor<DB::UnionBlockInputStream::Handler>::thread (this=0x7f0c370ec168, thread_group=..., thread_num=<optimized out>)
      at ../dbms/src/DataStreams/ParallelInputsProcessor.h:217

And in onException frame there is:
  (gdb) p ((DB::Exception *)exception._M_exception_object)._msg._M_dataplus._M_p
  $6 = (...) 0x7f0c9b1e7a40 "Unknown packet 9 from server HOSTNAME:PORT"

And on "Unknown packet" there is disconnect() before, see default in
switch statement at Connection::receivePacket().
 2019-12-06 21:55:17 +03:00
Mikhail Korotov
688ca7bfde performance test added 2019-12-06 21:10:03 +03:00
Mikhail Korotov
f63fe65e53 Simple tests added 2019-12-06 20:23:41 +03:00
Mikhail Korotov
3528555174
Update FunctionsHashing.h 2019-12-06 19:33:37 +03:00
Amos Bird
971770a040
Interpose malloc symbols entirely. 2019-12-07 00:32:00 +08:00
Mikhail Korotov
5a1ad17736
Update FunctionsHashing.h 2019-12-06 19:30:46 +03:00
millb
c801845185 Applied the required changes 2019-12-06 19:27:45 +03:00
millb
e3426e39e8 Fixed bugs 2019-12-06 18:43:50 +03:00
Pavel Kovalenko
6b8d599956 AWS SDK integration formatting issues. 2019-12-06 18:42:55 +03:00
Vxider
47f8d9713a build fix 2019-12-06 23:35:23 +08:00
millb
41008c9cca Merge branch 'master' into hashes_from_values_of_UUID_type 2019-12-06 18:22:06 +03:00
millb
56c7e53bdc Changes applied 2019-12-06 18:21:58 +03:00
Pavel Kovalenko
621d3dd2d1 AWS SDK integration formatting issues. 2019-12-06 18:14:39 +03:00
Pavel Kovalenko
dbcc06cc80 Removed CH docker image building in tests. 2019-12-06 17:57:43 +03:00
Pavel Kovalenko
81b4b1a538 AWS SDK added doc. 2019-12-06 17:54:20 +03:00
Pavel Kovalenko
c840fdefc0 Merge branch 'master' into aws-s3-sdk-integration 
# Conflicts:
#	dbms/src/Common/ErrorCodes.cpp
#	dbms/src/IO/ReadBufferFromS3.cpp
#	dbms/src/IO/ReadBufferFromS3.h
#	dbms/src/IO/WriteBufferFromS3.cpp
#	dbms/src/IO/WriteBufferFromS3.h
#	dbms/src/Storages/StorageS3.cpp
 2019-12-06 17:52:29 +03:00
Pavel Kovalenko
52b26b1376 AWS SDK formatting issues. 2019-12-06 17:48:56 +03:00
alexey-milovidov
3d279499d0
Merge pull request #7632 from hczhcz/patch-2 
Allow relative user_files_path
 2019-12-06 17:44:18 +03:00
Pavel Kovalenko
a9dfefd37f AWS SDK integration rework. 2019-12-06 17:37:21 +03:00
robot-clickhouse
6d56509109 Auto version update to [19.19.1.1] [54430] 2019-12-06 17:22:00 +03:00
robot-clickhouse
114db61c84 Auto version update to [19.18.1.1805] [54429] 2019-12-06 17:21:25 +03:00
Nikolai Kochetov
a73975d6a3
Merge pull request #8063 from Akazz/tests/better_server_pid_detection 
Improved getting ClickHouse server pid in clickhouse-test
 2019-12-06 16:26:47 +03:00
Vitaly Baranov
8bd9709d1d
Merge pull request #8044 from vitlibar/simplify-format-of-header-of-distributed-send 
Simplify format of the header of data sent to a shard in a distributed query.
 2019-12-06 15:46:00 +03:00
Mikhail Filimonov
4e4957e052 returning allowNext() to the proper position 2019-12-06 12:22:36 +01:00
Alexander Kazakov
faedac0b95 Rewrite command line for getting server pid 2019-12-06 13:58:46 +03:00
Nikita Mikhaylov
34d20a0ef4
updating test after resolving conflicts 2019-12-06 13:17:51 +03:00
Nikita Mikhaylov
6fc5248a27
Merge branch 'master' into limit_with_ties 2019-12-06 13:16:54 +03:00
alesapin
de6cd490ef
Merge pull request #8037 from vitlibar/system-reload-dictionary-causes-complete-reloading 
SYSTEM RELOAD DICTIONARY reloads a dictionary completely
 2019-12-06 12:55:41 +03:00
Yuriy
5237e3c059 better exception text 2019-12-06 04:42:12 +03:00
Yuriy
6c8e2d8b85 fixed getting double SHA1 in mysql_native_password auth plugin 2019-12-06 04:35:49 +03:00
Yuriy
e91d4722a4 fixed occasional federated server test failures 2019-12-06 04:35:49 +03:00
Vitaly Baranov
2133492598
Merge pull request #7257 from vitlibar/RBAC-2 
RBAC-2
 2019-12-06 03:19:39 +03:00
Mikhail Filimonov
7d760a964d Fix for timestamp & style 2019-12-05 22:21:15 +01:00
Nikita Mikhaylov
46478db2f8 Merge branch 'master' of github.com:ClickHouse/ClickHouse 2019-12-05 22:09:15 +03:00
Nikita Mikhaylov
88027947a1
update test after resolving conflicts 2019-12-05 21:59:30 +03:00
Nikita Mikhaylov
4946409a78
Merge branch 'master' into limit_with_ties 2019-12-05 21:58:47 +03:00
Nikita Mikhaylov
de2d996063
Merge pull request #7786 from nikitamikhaylov/incorrect_count 
Incorrect count() with condition query result for SummingMergeTree.
 2019-12-05 21:56:54 +03:00
Nikita Mikhaylov
5e60e0661f
delete useless reference 2019-12-05 21:54:18 +03:00
Nikita Mikhaylov
826a675974
delete useless reference 2019-12-05 21:53:44 +03:00
Nikita Mikhaylov
7783475aaa
delete useless test 2019-12-05 21:53:26 +03:00
alesapin
6afafef86c
Merge pull request #8047 from ClickHouse/fix_check_query_again 
Fix bug in checkDataPart
 2019-12-05 21:31:36 +03:00
Vitaly Baranov
6306e2ab91 Add DCL to manage quotas. 2019-12-05 21:03:57 +03:00
Vitaly Baranov
8035af3a79 Make Field::getScaleMultiplier() inline to allow using FieldVisitorConvertToNumber 
in the "clickhouse_parsers" library.
 2019-12-05 21:03:57 +03:00
Vitaly Baranov
3e6619c076 Move IntervalKind-related functions to a separate file. 2019-12-05 21:03:57 +03:00
Vitaly Baranov
ae29628779 Add an integration test for quotas. 2019-12-05 21:03:57 +03:00
Vitaly Baranov
38fa1af5ca Disable quota consumptions for the system queries and for selecting 
from the `system.quota` and `system.quotas` tables.
 2019-12-05 21:03:57 +03:00
Vitaly Baranov
d9b1a733fc Add table system.quotas. 2019-12-05 21:03:57 +03:00
Vitaly Baranov
55a05e5643 Add functions currentQuota() and currentQuotaKey(). 2019-12-05 21:03:57 +03:00
Vitaly Baranov
0e21673271 Rework Quota based on IAccessEntity. 2019-12-05 21:03:57 +03:00
Vitaly Baranov
c733e5b50b Add functions for writing std::chrono to string. 2019-12-05 21:03:57 +03:00
Vitaly Baranov
7db6c60bb1 Add AccessControlManager and an interface for the storage. 2019-12-05 21:03:57 +03:00
Vitaly Baranov
44f3ab5f96 Extend typeid_cast() for shared_ptr. 2019-12-05 21:03:57 +03:00
Vitaly Baranov
4d784d6f44 Add test. 2019-12-05 20:07:33 +03:00
Vitaly Baranov
9b44848179 SYSTEM RELOAD DICTIONARY now reloads a dictionary with update_field completely. 2019-12-05 19:45:05 +03:00
alesapin
772bb0b70b Fix collation locales 2019-12-05 18:35:09 +03:00
Nikita Mikhaylov
4f74974492 fixed warning unique_lock 2019-12-05 17:34:35 +03:00
alesapin
227d0ba9d6 Add one more test 2019-12-05 15:39:02 +03:00
alesapin
cd43debd79 Test with non adaptive parts 2019-12-05 15:18:18 +03:00
alesapin
ee46a73d25 Fix bug in checkDataPart when last granule has same number of rows as in .mrk file 2019-12-05 15:01:36 +03:00
chertus
852e891499 better comment 2019-12-05 15:01:34 +03:00
Nikolai Kochetov
26e415736a
Merge pull request #7665 from 4ertus2/joins 
New ANY, SEMI, ANTI JOIN (HashJoin only)
 2019-12-05 14:38:20 +03:00
Nikolai Kochetov
86ff01d3aa
Merge pull request #7988 from ClickHouse/processors-4.4 
Better updated ports check in processors
 2019-12-05 13:54:40 +03:00
Vitaly Baranov
133675a86a Simplify format of the header of data sending to a shard in a distributed query. 2019-12-05 13:34:25 +03:00
Mikhail Korotov
88e37020e0 JSONCompactEachRow and JSONCompactEachRowWithNamesAndTypes (#7841) 
* Research commit

* Created Output EachRow Format

* Fixed bugs

* Created output format JSONCompactEachRowWithNamesAndTypes without totals

* Fixed bugs

* Fixed bugs

* Totals for JSONCompactEachRowWithNamesAndTypes

* Deleted needless debug

* Working commit

* Working commit

* Working commit

* Working commit

* Working commit

* Working commit

* Working commit

* Working commit

* Working commit

* Working commit

* Working commit

* Working commit

* Tests added

* Input Format for JSONCompactEachRow

* Fixed bugs for JSONCompactEachRow Input format

* Fixed bugs for JSONCompactEachRowRowInputFormat.cpp

* JSONCompactEachRow and JSONCompactEachRowWithNamesAndTypes united

* Created input format for both formats

* fixed bugs

* fixed bugs

* Working commit

* Working commit

* Working commit

* Working commit

* tests

* Working commit

* Final tests

* Performance tests added
 2019-12-05 13:13:40 +03:00
Vladimir Chebotarev
73b0315b2f Added information about lld to instruction to sanitizers. 2019-12-05 13:08:34 +03:00
Vladimir Chebotarev
b9db05e1fd Revert "Added -D LINKER_NAME=lld to instruction to sanitizers." 
This reverts commit c5a30d39a0.
 2019-12-05 13:04:53 +03:00
Vladimir Chebotarev
60077e2311 Revert "Minor typo was fixed." 
This reverts commit e436bf140c.
 2019-12-05 13:04:47 +03:00
Nikita Mikhaylov
a3f3a333e2 better test 2019-12-05 12:55:06 +03:00
Nikita Mikhaylov
b6413d4a04 better 2019-12-05 12:52:49 +03:00
Nikita Mikhaylov
9d005d1565 true changes 2019-12-05 12:50:42 +03:00
Vladimir Chebotarev
7c7562987d Removed is_move from system.merges. 2019-12-05 12:31:45 +03:00
hcz
8a464995e7 Fix 2019-12-05 17:22:00 +08:00
Vladimir Chebotarev
3c35b3db60 Removed localtime from HTTPDictionarySource::getUpdateFieldAndDate(). 2019-12-05 12:18:51 +03:00
Vitaly Baranov
2cc78413ed
Merge pull request #7914 from azat/dist-send-extra-checksum 
Add checksum for extra info/query in distributed sends
 2019-12-05 11:43:08 +03:00
alesapin
a524e82a7f
Merge pull request #8029 from ClickHouse/fix_dict_partially_update_failover 
Fix external dictionaries failover, when they have invalidate_query.
 2019-12-05 11:12:17 +03:00
Yuriy Baranov
1df4250b2f
Update MySQLHandler.cpp 2019-12-05 04:52:48 +03:00
Yuriy Baranov
67d72f35b9
Update Authentication.cpp 2019-12-05 03:35:52 +03:00
Yuriy
9a222c6a2a compare with proper variable 2019-12-05 03:23:12 +03:00
Yuriy
4b170ae769 fixed compilation error 2019-12-05 03:19:36 +03:00
Yuriy
564b58d2f6 using mysql_native_password for passwordless users 2019-12-05 02:37:11 +03:00
Yuriy
9d0a0d0db0 fixed type 2019-12-05 02:32:17 +03:00
Yuriy
dbe7dc1185 using SHA1 MySQL auth plugin for plaintext passwords 2019-12-05 02:30:06 +03:00
chertus
d3d2e39955 fix SEMI RIGHT JOIN 2019-12-04 23:23:07 +03:00
Azat Khuzhin
3a72e1c12a Add checksum for extra info/query in distributed sends 
This extras includes:
- server revision
- query settings
- query

Otherwise the code can try to interpret data, and got for instance
std::length_error exception, which is not catched (to mark the part as
broken). Also this will protect from the corruptions on disk.

And add a simple test, since dbms/tests/integration/test_insert_into_distributed too complex.

Also simplify the code by using readStringBinary() over
readVarUInt()+b.readStrict() (this also gains additional checks that
string is not bigger then 1GB).

Refs: #4852 (8ef7f3589a)
v2: avoid ABI breakage (suggested by @vitlibar)
v3: minor code fixes (suggested by @vitlibar) and as a consequence clang-8 build fix
v4: drop DBMS_MIN_REVISION_WITH_EXTRAS_CHECKSUM_IN_DIST_BATCH and also
    revert some renames to make the patch cleaner
 2019-12-04 22:54:38 +03:00
alesapin
172bbb1a2f Fix flappy test, because dictionaries are loaded lazily 2019-12-04 21:30:47 +03:00
alesapin
cfa1b37fd6
Merge pull request #8032 from ClickHouse/ddl_dictionaries_if_not_exists 
Create dictionary if not exists
 2019-12-04 21:28:05 +03:00
Nikolai Kochetov
715d7a6455 Disable processors by default. 2019-12-04 20:24:53 +03:00
alesapin
7b8443710d Better code 2019-12-04 19:20:24 +03:00
alesapin
40c6966223 Don't check dictionary modification if it's already have an exception. 2019-12-04 18:23:18 +03:00
alesapin
2592e44eef
Merge pull request #8028 from ClickHouse/fix_libc_compatibility_of_odbc_bridge 
Fix unintendent dependency from GLIBC 2.16 in clickhouse-odbc-bridge
 2019-12-04 18:15:26 +03:00
alesapin
3128b62f0e Create dictionary if not exists 2019-12-04 18:11:36 +03:00
alesapin
a41764cccc Reload dictionary with invalidate query if it has exception 2019-12-04 17:45:56 +03:00
alesapin
ce05cea192 Add sleep for test 2019-12-04 17:22:49 +03:00
alesapin
711fb5e667 Added tests for external dictionary invalidate query failover 2019-12-04 16:53:05 +03:00
Nikolai Kochetov
3ac103f21c Fix the number of rows in MergingSortedTransform. 2019-12-04 16:45:42 +03:00
alesapin
516876becb Fix unintendent dependency from GLIBC 2.16 in clickhouse-odbc-bridge 2019-12-04 15:39:09 +03:00
Nikolai Kochetov
901a6b4627 Style fix. 2019-12-04 12:56:08 +03:00
Nikolai Kochetov
efe1616fda Fix optimization for 'WHERE column in (empty set)' case. 2019-12-04 12:55:01 +03:00
Nikolai Kochetov
81b5b17828 Fix pvs studio varning. 2019-12-04 12:55:01 +03:00
Nikolai Kochetov
fa98587c19 Init update_info in port. 2019-12-04 12:55:01 +03:00
Nikolai Kochetov
4337fc20b5 Enable processors by default. 2019-12-04 12:55:01 +03:00
Nikolai Kochetov
8524a75580 Check once if filter column can be always false in filter transform. 2019-12-04 12:55:01 +03:00
Nikolai Kochetov
9465183408 Add info about affected ports after prepare. 2019-12-04 12:55:01 +03:00
Nikolai Kochetov
4f2f474fde Add info about affected ports to IProcessor::prepare 2019-12-04 12:55:01 +03:00
alesapin
eb17d51dd4 Remove unused function 2019-12-04 12:49:54 +03:00
alesapin
d1d3bac744 Better 2019-12-04 12:48:08 +03:00
Vladimir Chebotarev
e436bf140c
Minor typo was fixed. 2019-12-04 12:47:51 +03:00