Commit Graph

23459 Commits

Author SHA1 Message Date
alexey-milovidov
1bb14bb67e
Merge pull request #8147 from podshumok/patch-3
fix compilation (std::variant with narrowing) with system libcxx
2019-12-12 18:19:22 +03:00
alexey-milovidov
29b2e26074
Merge pull request #8144 from 4ertus2/decimal
Decimal specializations for min/max
2019-12-12 18:18:14 +03:00
alesapin
8fb9541958
Merge pull request #7946 from Alex-Burmak/filesystem_abstraction
Filesystem abstraction layer
2019-12-12 18:12:35 +03:00
Nikolai Kochetov
7082f8028b Merged with master. 2019-12-12 18:04:30 +03:00
Nikolai Kochetov
06f2fa8433 Add more comments, rename classes, move functions adaptors to separate file. 2019-12-12 17:56:03 +03:00
Nikolai Kochetov
168a55b617 Fix build. 2019-12-12 17:55:55 +03:00
Nikolai Kochetov
7dba6849c8 Fix concat and reverse for arrays. 2019-12-12 17:55:35 +03:00
Nikolai Kochetov
17af1ed25f Fix FunctionExpression. 2019-12-12 17:55:35 +03:00
Nikolai Kochetov
9c4d123f87 Style fixes. 2019-12-12 17:55:35 +03:00
Nikolai Kochetov
187cc83702 update tuple comparison. 2019-12-12 17:55:35 +03:00
Nikolai Kochetov
5289b67b70 update LLVMFunction. 2019-12-12 17:55:35 +03:00
Nikolai Kochetov
63a8dcd2e8 update yestarday. 2019-12-12 17:55:35 +03:00
Nikolai Kochetov
7336f3fa7f update transform. 2019-12-12 17:55:35 +03:00
Nikolai Kochetov
a18f0c5aa6 update FunctionArrayMapped. 2019-12-12 17:55:35 +03:00
Nikolai Kochetov
db08cc1b5a update toTypeName. 2019-12-12 17:55:35 +03:00
Nikolai Kochetov
b401dc521a update reverse. 2019-12-12 17:55:35 +03:00
Nikolai Kochetov
d7b08b166b update now and today. 2019-12-12 17:55:35 +03:00
Nikolai Kochetov
a9f1a2e382 Fix compile errors. 2019-12-12 17:55:36 +03:00
Alexander Tokmakov
1a6c973055 use absolute path and try to load table 2019-12-12 17:47:31 +03:00
Vladimir Chebotarev
3630b06cf9 Fixed flapping test_ttl_move::test_moves_after_merges_work 2019-12-12 16:42:03 +03:00
hcz
c0028c3942 Add aggregate function categoricalInformationValue (#8117)
* Add categorical iv aggregate function with tests
2019-12-12 16:28:28 +03:00
chertus
c63a0e88ed add perf test for decimal aggregates 2019-12-12 16:11:07 +03:00
chertus
16844012e4 Merge branch 'master' into decimal 2019-12-12 15:35:30 +03:00
alexey-milovidov
604a31bb66
Merge pull request #8143 from Akazz/race_condition/process_ordinary_query
Resolved data race in DB::BlockStreamProfileInfo::calculateRowsBeforeLimit()
2019-12-12 15:32:47 +03:00
Alexander Burmak
1f69a7a015 Fixed merge issues 2019-12-12 14:10:18 +03:00
alesapin
e7f5b92b19 Add ability to create external dictionaries ON CLUSTER 2019-12-12 13:27:02 +03:00
zhangxiao018
c03f126057 fix trivial count query with ConvertingBlockInputStream. 2019-12-12 18:21:08 +08:00
Ding Xiang Fei
21c571c5b5
Add reference to Zookeeper Internals manual 2019-12-12 18:16:14 +08:00
Nikolai Kochetov
7ad2a6dd0b
Merge pull request #7170 from Enmk/DateTime64
DateTime64 data type
2019-12-12 12:20:22 +03:00
Alexander Burmak
c514ec3278 Minor code cleanup 2019-12-12 12:18:46 +03:00
Alexander Burmak
2ce6136de5 Merge remote-tracking branch 'refs/remotes/upstream/master' into vfs 2019-12-12 12:10:50 +03:00
Alexander Kazakov
954d5072e9 Returned the terminating sendProgress() in processOrdinaryQuery 2019-12-12 07:46:39 +03:00
Nikolai Kochetov
1d90c4c555 Fix build. 2019-12-11 20:09:42 +03:00
zhang2014
194ab5526d add arrayZip function 2019-12-12 00:22:14 +08:00
Nikolai Kochetov
ea05ab293d Fix PVS check. 2019-12-11 19:09:43 +03:00
Konstantin Podshumok
7635cf93bd
fix compilation (std::variant with narrowing) with system libcxx 2019-12-11 18:33:14 +03:00
Alexander Kazakov
eb5040771b Minor correction 2019-12-11 17:54:19 +03:00
Vasily Nemkov
f8fec0402b Merge commit 'e7540dcf686936a490f89d0735f74c2f5f009821' into DateTime64 2019-12-11 17:38:32 +03:00
Pavel Kovalenko
daf064d13b Merge remote-tracking branch 'jokser/aws-s3-sdk-integration' into aws-s3-sdk-integration 2019-12-11 17:32:33 +03:00
Vasily Nemkov
61197370bb Merge branch 'DateTime64' of github.com:Enmk/ClickHouse into DateTime64 2019-12-11 17:25:34 +03:00
Vasily Nemkov
514847609d PR fixes:
* Fixed precision calculation in DataTypeDecimalBase c-tor
* Fixed max precision calculation in getLeastSupertype
* Fixed reading past end of vector in FunctionsConversion with extractToDecimalScale
* More verbose comments on FunctionArgumentTypeValidator and validateFunctionArgumentTypes
* style and other minor fixes.
2019-12-11 17:24:59 +03:00
Pavel Kovalenko
c7f016fc4e AWS SDK integration - code cleanup. 2019-12-11 17:21:48 +03:00
chertus
4907ca734c Decimal specializations for min/max 2019-12-11 17:16:59 +03:00
Alexander Kazakov
292e3a0d24 Reworked TCPHandler::processOrdinaryQuery() to resolve race condition 2019-12-11 16:30:27 +03:00
Nikolai Kochetov
20026d7931 Added perftest. 2019-12-11 16:17:30 +03:00
alesapin
2940aeff23 Fix style 2019-12-11 13:24:20 +03:00
alesapin
fd9483efbe Just trigger CI 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
0ff0a52249 Missed review fixes. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
f2aee64072 Minor style fix. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
e41deb5848 Added comment to MergeTreePartsMover::selectPartsForMove(). 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
7fd1668fde Review fixes. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
065b681a8c Boosted test_ttl_move::test_moves_to_volume_work a little. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
e3ed311273 Fixed Clang build. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
67aa268bbb Finally fixed tests and logic for extended TTL syntax. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
f83b28a1c1 Fixed a typo in MergeTreeData::selectMoveDestination(). 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
618a39cc8c Don't move anything if part already belongs their destination. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
f72da4ab0c Removing expired rows shall not be triggered on move TTL expiration. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
8ed37801ca Finally fixed selection of destination of move TTL. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
15fb64f54b Fixed move TTL expiration logic. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
164360e7ad Fixed test_ttl_move again. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
2e853e3211 Fixed more typos in test_ttl_move. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
df002f20b1 Fixed move TTL metadata. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
14cf530542 Added move TTL rules to metadata of ReplicatedMergeTree. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
7407f7c39d Placed move TTL rules to a vector. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
ae4b2b4ace Fixed some typos in test_ttl_move test. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
3250955b07 Refactored tests a little bit. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
b3427af0c1 Fixed typos in a test. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
108e2b33eb Fixed a bug with erasing columns with same name. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
0da7234d99 Added few FIXMEs to not forget. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
b3e261800d Fixes of tests for extended TTL syntax. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
ce851fc782 Fixed MergeTreeData::hasTableTTL() method according to extended TTLs. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
e163ebb7f0 Fixed more typos in test_ttl_move test. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
cc70f717ed Fixed typos in test_ttl_move test. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
617bf4214f Added first version of tests for extended TTL expressions (still need refactoring). 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
cb777f6c50 Removed redundant template from updateTTL() method. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
62016feab0 Renamed TTLDestinationType to PartDestinationType. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
cc0c21604f Fixed Clang build one more time. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
ce066d3bb0 Style fixes. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
88c7220256 Fixed Clang build. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
07c4fa3cc0 Correct merge of background move pool. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
3e3e9ac56f Moved settings for BackgroundProcessingPool to configuration. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
e519c04bbe Minor fix of JSON handling in MergeTreeDataPartTTLInfo. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
342ea5c30a Removed TODO comments. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
773bf7b35c Removed 'DELETE' keyword from default TTL syntax description. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
58e824b6a1 Refactored, added move enforcement on merges, fixed a bug with wrong disk selection in ReplicatedMergeTree. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
dfe0edc03f Style fix. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
76c4ac9f60 Fixed ttl move logic in background move task and added ttl enforcement on inserts. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
4cd75f926b Fixed 00933 ttl tests. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
575de5ada6 Attempt to add background moves by TTL expressions. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
893e0de37a Minor fix. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
33ded274a3 First attempt to store min/max for move ttl expressions. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
5a12986159 Updated ttl test according to new TTL syntax. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
3e984609fb Fixed ClickHouse after changing syntax. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
7a37c4f6a9 Parser for extended TTL expressions. 2019-12-11 13:24:20 +03:00
Vasily Nemkov
c781908e6d Post-PR fixes
* More precise overflow check in readIntTextImpl
* writeDateTimeText now always writes sub-second part for DateTime64
* comment for validateFunctionArgumentTypes
* DateTime64-related fixes for FunctionConvertFromString
* other minoe fixes: comments, removed commented out code, variable
  renamings, etc.
2019-12-11 12:20:05 +03:00
Vladimir Chebotarev
1ca9cefa1d
Fixed typo. 2019-12-11 11:58:53 +03:00
Vladimir Chebotarev
f5d162c5ed
Fixed test_multiple_disks::test_kill_while_insert a little. 2019-12-11 07:59:37 +03:00
Vasily Nemkov
f56b2b64f2 Post-review refactoring and tests for DateTime64 and Decimal.
* put functions in DecimalFunctions into DecimalUtils namespace
* fixed possible buffer overflow in parseDateTimeBestEffortImpl
* fixed readDateTimeTextImpl not to require fractional part separator
  (if fractional part is missing)
* Tests for code from DecimalFunctions.h
* Fixed serializing DateTime64 to string with writeDateTimeText(), fixed tests
2019-12-11 06:58:49 +03:00
Alexey Milovidov
4f9cd8a3c8 Update contributors 2019-12-11 06:13:33 +03:00
hcz
3a18d6b494 Add performance tests 2019-12-11 10:44:04 +08:00
hcz
2f276c2bb7 Rename bankerRound as bankersRound 2019-12-11 10:43:47 +08:00
alexey-milovidov
3540dd5c53
Update ClusterCopier.cpp 2019-12-11 04:53:29 +03:00
Zhichang Yu
ff1b8d46e2 fixed part mutation, added test_backup_restore integration test case 2019-12-11 09:31:37 +08:00
alexey-milovidov
e73e19dc97
Merge pull request #8111 from azat/dictionary-reload-test-hotfix
Fix async nature of reload in 01036_no_superfluous_dict_reload_on_create_database*
2019-12-11 04:20:17 +03:00
alexey-milovidov
aecd5a5493
Merge pull request #8123 from ClickHouse/aku/field-prepare
Prepare for stricter type checking in Field.
2019-12-11 02:21:34 +03:00
alexey-milovidov
309653f60d
Merge pull request #7182 from ClickHouse/aku/zlib-msan
Update zlib-ng to fix MemorySanitizer problems.
2019-12-11 02:15:16 +03:00
alexey-milovidov
85d668ebf4
Update S3Common.cpp 2019-12-11 02:03:45 +03:00
Pavel Kovalenko
c4b3cce847 AWS SDK integration - move s3 storage syntax tests to integration. 2019-12-10 19:11:13 +03:00
alesapin
67f1ff1c8b
Merge pull request #8104 from excitoon-favorites/test_move_after_merge
FIxed behavior with ALTER MOVE ran immediately after merge finish moves superpart of specified
2019-12-10 17:15:08 +03:00
Alexander Kuzmenkov
50a8a7197f Prepare for stricter type checking in Field. 2019-12-10 16:40:45 +03:00
Alexander Kuzmenkov
3df94283b3 Remove a workaround for zlib-ng MemorySanitizer problems. 2019-12-10 13:15:18 +03:00
alesapin
397a3fc2e7
Merge pull request #8098 from ClickHouse/fix_dictionary_properties
Fix dictionary properties
2019-12-10 12:55:29 +03:00
Vladimir Chebotarev
269a0246aa Added explicit check for existence of part and pair of log messages. 2019-12-10 12:47:23 +03:00
Vladimir Chebotarev
ed719f38b2 Added test_multiple_disks::test_move_after_merge. 2019-12-10 12:47:23 +03:00
VDimir
b6aadf468a Prometheus metric prefixes in CamelCase 2019-12-10 08:31:59 +00:00
hcz
8ed416ed41 Add bankerRound 2019-12-10 14:13:05 +08:00
Azat Khuzhin
65572a23fe Fix async nature of reload in 01036_no_superfluous_dict_reload_on_create_database*
Due to the async nature of SYSTEM RELOAD DICTIONARY/DICTIONARIES the
test can fail, if the reload will happen after the dictGet*():

    .862801 [ 36 ] {61df55ee-4a17-4bf3-8cfb-9478490393c3} <Debug> executeQuery: (from [::1]:37422) SYSTEM RELOAD DICTIONARY `foo 1234.dict`
    .863681 [ 36 ] {cd55d9f9-d176-4b19-bc97-d25575da2d15} <Debug> executeQuery: (from [::1]:37422) SELECT query_count FROM system.dictionaries WHERE (database = 'foo 1234') AND ...
    .863678 [ 54 ] {} <Debug> executeQuery: (internal) SELECT `key`, `val` FROM `foo 1234`.`dict_data`;

This is just a hotfix, long-term solution will be to make SYSTEM RELOAD
DICTIONARY syncronous (by adding another command or making already
existing).

Refs: #7916
2019-12-10 08:31:51 +03:00
Ding Xiang Fei
0f22f90ee5
refine zxid definition: it has two warping uint32 counters 2019-12-10 09:44:06 +08:00
Vladimir Chebotarev
ea44510b44 Minor fix of test. 2019-12-09 23:29:44 +03:00
Vladimir Chebotarev
6afd8d7805 Added test_multiple_disk::test_kill_while_insert, reworked log message and fixed logic of treating stale copies. 2019-12-09 23:29:44 +03:00
Vladimir Chebotarev
a2f238d8da Added more logging and switched to detaching stale part instead of removing. 2019-12-09 23:29:44 +03:00
Vladimir Chebotarev
9cf7ef03af Fixed handling of MergeTreeData::DataPartPtr's in MergeTreeData::swapActivePart(). 2019-12-09 23:29:44 +03:00
Vladimir Chebotarev
374e0f7bb5 Finally fixed tests. 2019-12-09 23:29:44 +03:00
Vladimir Chebotarev
c283776e84 Really fixed tests. 2019-12-09 23:29:44 +03:00
Vladimir Chebotarev
89659a9129 Fixed a typo. 2019-12-09 23:29:44 +03:00
Vladimir Chebotarev
fe3e89fb38 Fixed tests. 2019-12-09 23:29:44 +03:00
filimonov
f545da40e6 style 2019-12-09 23:29:44 +03:00
filimonov
0ab67c7b1f Log when part is removed after move 2019-12-09 23:29:44 +03:00
Vladimir Chebotarev
efa73608b8 Separated constant path to DeleteOnDestroy marker. 2019-12-09 23:29:44 +03:00
Vladimir Chebotarev
13c5c621c1 Attempt to ignore redundant copies of parts after move and restart. 2019-12-09 23:29:44 +03:00
alexey-milovidov
cce78ef018
Merge pull request #8036 from yurriy/mysql
Compatibility with MySQL clients which don't support sha2_password auth plugin
2019-12-09 23:11:31 +03:00
Alexey Milovidov
285139585c Updated test 2019-12-09 23:08:19 +03:00
Alexey Milovidov
da72203ceb Added a comment 2019-12-09 22:53:40 +03:00
Alexey Milovidov
2fe7472a63 Added function "greatCircleAngle"; changed earth radius 2019-12-09 22:35:25 +03:00
Alexey Milovidov
67fd108848 Added a test for "greatCircleAngle" 2019-12-09 22:34:00 +03:00
Alexey Milovidov
1e3b9af66f Added clarifications 2019-12-09 20:25:16 +03:00
Alexey Milovidov
2db25df706 Merge branch 'master' into geodist-less-wrong 2019-12-09 18:42:37 +03:00
Nikolai Kochetov
fd62c09a8b Update FunctionCapture and FunctionExpression. 2019-12-09 17:36:47 +03:00
Alexander Burmak
5a93441445 Merge remote-tracking branch 'refs/remotes/upstream/master' into vfs 2019-12-09 17:18:47 +03:00
alesapin
85aac386aa Missed commit 2019-12-09 17:06:28 +03:00
alesapin
642ce2d751 Fix escaping and add string expressions support 2019-12-09 17:05:58 +03:00
Nikolai Kochetov
18bfa684a2 Rename IFunction.h to IFunctionImpl.h in functions implementations. 2019-12-09 16:12:54 +03:00
Pavel Kovalenko
ba59991912 AWS SDK integration - added new lines at the end of files. 2019-12-09 15:36:06 +03:00
Pavel Kovalenko
971c48e1cf AWS SDK integration - fixed test with remote host filter. 2019-12-09 15:05:16 +03:00
Pavel Kovalenko
94e9638006 AWS SDK integration added url checking. 2019-12-09 13:58:57 +03:00
alexey-milovidov
9106b2854a
Merge pull request #8084 from azat/read-temporary-tables-on-failure
Read temporary tables on failure to avoid interpreting that bits as query
2019-12-09 13:49:09 +03:00
Alexander Burmak
f27d462986 Minor amendments 2019-12-09 08:47:12 +03:00
alexey-milovidov
d051a03794
Merge pull request #8042 from excitoon-favorites/gmtime
Removed `localtime` from `HTTPDictionarySource::getUpdateFieldAndDate…
2019-12-09 04:57:18 +03:00
alexey-milovidov
79215bd029
Merge pull request #8025 from excitoon/patch-2
Added `-D LINKER_NAME=lld` to instruction to sanitizers.
2019-12-09 04:56:17 +03:00
alexey-milovidov
4aa6b61859
Update sanitizers.md 2019-12-09 04:55:58 +03:00