Commit Graph

13686 Commits

Author SHA1 Message Date
Alexey Milovidov
ee5dcd50a0 Lowered CPU overhead for small data parts 2019-06-16 23:42:03 +03:00
Alexey Milovidov
14be0ca281 Reduce number of "stat" syscalls for MergeTree data parts 2019-06-16 23:13:54 +03:00
Alexey Milovidov
49c4f2ffed Reduce number of "stat" syscalls for MergeTree data parts 2019-06-16 23:11:30 +03:00
Alexey Milovidov
e3b21be1bb Reduce number of "stat" syscalls for MergeTree data parts 2019-06-16 23:02:45 +03:00
Alexey Milovidov
0ad13ca3d1 Reduce number of "stat" syscalls for MergeTree data parts 2019-06-16 22:59:30 +03:00
Alexey Milovidov
c1aa767a04 Reduce number of "stat" syscalls for MergeTree data parts 2019-06-16 22:53:05 +03:00
Alexey Milovidov
e4f314f88d Reduce number of "stat" syscalls for MergeTree data parts 2019-06-16 22:49:12 +03:00
Alexey Milovidov
801f34d325 Reduce number of "stat" syscalls for MergeTree data parts 2019-06-16 22:42:05 +03:00
Alexey Milovidov
b6acb29625 Reduce number of "stat" syscalls for MergeTree data parts 2019-06-16 22:36:15 +03:00
Alexey Milovidov
b494d17ca6 Reduce number of "stat" syscalls for MergeTree data parts 2019-06-16 22:32:52 +03:00
Alexey Milovidov
413b780b65 Various fixes for PVS-Studio 2019-06-16 21:13:39 +03:00
dmitry kuzmin
c73ce602bf fix decimal overflow, extreme values 2019-06-16 10:57:30 +03:00
Alexey Milovidov
ba18308080 Merge branch 'master' into levysh-testkeeper 2019-06-16 02:45:34 +03:00
Alexey Milovidov
a576755bec Fixed build 2019-06-16 02:45:17 +03:00
Alexey Milovidov
6418018385 Added comment 2019-06-16 02:35:12 +03:00
Alexey Milovidov
777af5544b Removed tons of trash
Removed tons of trash

Removed tons of trash

Removed tons of trash

Removed tons of trash

Removed tons of trash

Removed tons of trash

Removed tons of trash

Removed tons of trash

Removed tons of trash

Removed tons of trash
2019-06-16 02:35:27 +03:00
levushkin aleksej
bc2789f9ad TestKeeper(mock ZooKeeper)
fix style

fix bug

one more fix style
2019-06-16 02:35:12 +03:00
alexey-milovidov
39c6fbc324
Merge pull request #5567 from vitlibar/really-lazy-dictionary-load
Non-blocking loading of external dictionaries
2019-06-15 22:15:53 +03:00
proller
2a6c7cda0b CLICKHOUSE-4179 Fix function arrayEnumerateUniqRanked (#5622)
* wip

* fix

* clean
2019-06-15 22:14:17 +03:00
alexey-milovidov
a52e13b891
Merge pull request #5640 from yandex/use-ipv6-in-system-tables
Adopted IPv6 data type in system tables; unified client info columns in system.processes and system.query_log
2019-06-15 21:21:24 +03:00
Alexey Milovidov
d8f76152d5 Adopted IPv6 data type in system tables; unified client info columns in system.processes and system.query_log 2019-06-15 17:20:32 +03:00
Alexey Milovidov
b2100c7bcf Removed strange quoting style like `this'. See https://english.stackexchange.com/questions/17695/any-reference-on-the-usage-of-a-backtick-and-single-quotation-mark-like-this
Added backQuote and backQuoteIfNeed when required to correctly quote identifiers with proper escaping.
2019-06-15 15:06:22 +03:00
alexey-milovidov
807bfa913e
Merge pull request #5599 from zhang2014/fix_createtable_bug
Add database engine of MySQL type
2019-06-15 14:52:57 +03:00
zhang2014
ec8d73550b some review fixes 2019-06-15 11:39:04 +08:00
CurtizJ
6d9cbc6f28 ignore query limits from system profile while executing mutations 2019-06-14 22:27:53 +03:00
Vitaly Baranov
b4384ce2a9 Dictionaries can be loaded in parallel.
A bad dictionary cannot block all the loading anymore.
Implemented really lazy loading of external dictionaries.
Provided more detailed information about the loading of each dictionary
to make diagnostics easier.
2019-06-14 22:18:47 +03:00
Alexey Milovidov
10722f53c7 Fixed performance degradation in SELECT from MergeTree tables #5631 2019-06-14 22:11:41 +03:00
proller
7e7b5b3810 Allow run query with remote() in clickhouse-local; Aloow redefine config from command line for clickhouse-local 2019-06-14 18:35:45 +03:00
unknown
7dc95e17a4 movingSum : macros name + indent 2019-06-14 11:14:58 -04:00
alexey-milovidov
f9cab91447
Merge pull request #5617 from proller/fix15
19.8 build fixes
2019-06-14 17:29:51 +03:00
alexey-milovidov
00809c78e2
Merge pull request #5623 from yandex/Quid37-lin_ref_perf
Merging PR #5505
2019-06-14 17:26:46 +03:00
hcz
0385e0923a Fix style 2019-06-14 21:20:21 +08:00
alexey-milovidov
eb1fe2ed17
Merge pull request #5613 from sundy-li/improve/distribute-alter-more
make isSupportedAlterType better
2019-06-14 15:39:09 +03:00
Alexey Milovidov
95c7537656 Merge branch 'lin_ref_perf' of https://github.com/Quid37/ClickHouse into Quid37-lin_ref_perf 2019-06-14 15:33:29 +03:00
proller
fc7ae399c4 Use system rapidjson; Fix types for macos; 2019-06-14 13:28:30 +03:00
alexey-milovidov
9b727d267e
Merge pull request #5535 from infinivision/add_bitmapContains
Add bitmapContains
2019-06-14 09:23:37 +03:00
alexey-milovidov
bc387e865f
Merge pull request #5549 from yandex/fix_deduplication_bug
Fix complex bug in deduplication
2019-06-14 09:23:15 +03:00
alexey-milovidov
e90a7078f3
Merge pull request #5607 from coraxster/decimal-overflow
Fix float to decimal convert overflow
2019-06-14 09:20:39 +03:00
sundy-li
eac978f1e0 make isSupportedAlterType better 2019-06-14 11:06:08 +08:00
dmitry kuzmin
5fc6a6973a float to decimal overflow fix 2019-06-13 23:28:14 +03:00
unknown
0dab40404e movingSum format fix: trailing space 2019-06-13 12:18:32 -04:00
alexey-milovidov
87557d216b
Update DataTypesDecimal.h 2019-06-13 17:49:13 +03:00
alexey-milovidov
5ab1a15075
Update DataTypesDecimal.h 2019-06-13 17:48:13 +03:00
Alexey Milovidov
c846d0f6af Namespace comments are unneeded according to the code style.
find dbms -name '*.h' -or -name '*.cpp' | xargs grep -l -P '}\s*//+\s*namespace\s*' | xargs sed -i -r -e 's/}\s*\/\/+\s*namespace\s*.*$/}/'
2019-06-13 13:43:37 +03:00
Alexey Milovidov
d32ea4d06b Merge branch 'master' of github.com:yandex/ClickHouse 2019-06-13 13:38:48 +03:00
Alexey Milovidov
8b87511e25 Namespace comments are unneeded according to the code style.
find dbms -name '*.h' -or -name '*.cpp' | xargs grep -l -P '}\s*//+\s*namespace\s*' | xargs sed -i -r -e 's/}\s*\/\/+\s*namespace\s*\w+/}/'
2019-06-13 13:37:13 +03:00
alexey-milovidov
33c1072654
Merge pull request #5593 from sundy-li/improve/distribute-alter-more
Support more AlterType in distribute DDL
2019-06-13 13:26:50 +03:00
Alexey Milovidov
261c9cf9ff Whitespace 2019-06-13 13:15:32 +03:00
alexey-milovidov
be51de0903
Merge pull request #5559 from proller/fix28
CLICKHOUSE-4179 Fix of function arrayEnumerateUniqRanked for arguments with empty arrays
2019-06-13 13:14:51 +03:00
zhang2014
d8a14f590f try fix unbundled build failure 2019-06-13 18:01:34 +08:00
dmitry kuzmin
89cc1440d8 fix float to decimal convert overflow 2019-06-13 11:40:30 +03:00
zhang2014
6ccef4d802 Add database engine of MySQL type
Co-authored-by: zhang2014 <coswde@gmail.com>
Co-authored-by: TCeason <tai_chong@foxmail.com>
2019-06-13 11:58:58 +08:00
unknown
1e56a5b7ac movingSum format 2019-06-12 20:03:55 -04:00
chertus
1c3192016b Merge branch 'master' into t 2019-06-12 22:19:26 +03:00
unknown
8028495f78 movingSum fix : deserialize restores sum field 2019-06-12 12:10:47 -04:00
chertus
08983b0669 T64 codec optimisation: unroll cycles 2019-06-12 16:03:51 +03:00
sundy-li
d23e505414 remove line 2019-06-12 18:56:01 +08:00
sundy-li
38d4d2937e Support more AlterType in distribute DDL 2019-06-12 18:50:50 +08:00
alexey-milovidov
96975c8881
Update arrayEnumerateRanked.h 2019-06-12 12:18:51 +03:00
hcz
45529d8489 Fix bugs 2019-06-12 16:25:29 +08:00
hcz
6b6f2293fc Change style 2019-06-12 15:48:40 +08:00
hcz
57db1fac59 Add aggregate function combinator Resample 2019-06-12 15:46:36 +08:00
unknown
d75c73ece2 movingSum with/or without window_size parameter for numeric and decimal types 2019-06-12 01:56:37 -04:00
Danila Kutenin
585e4b75c5 Fix some weird cases in Searchers 2019-06-12 07:14:03 +03:00
Danila Kutenin
4fd85b4136 Clearer interfaces of Searchers 2019-06-12 05:35:25 +03:00
chertus
f9abc8194a make ubsan happy v2 2019-06-12 03:12:38 +03:00
chertus
0c0a1517fb make ubsan happy & minor perf improvement 2019-06-12 00:32:43 +03:00
chertus
3648889aed T64 codec: add test for signed & related fixes 2019-06-11 21:25:34 +03:00
chertus
10c720f059 T64 codec: fix getMaxCompressedDataSize and test 2019-06-11 17:14:45 +03:00
chertus
f099ee5680 T64 support signed types (not tested) 2019-06-10 22:14:48 +03:00
proller
836243d654 Merge remote-tracking branch 'upstream/master' into fix28 2019-06-10 12:44:22 +03:00
tai
e01138a7e7 feature: if MySQL table doesn't exits should report the error. 2019-06-10 15:51:14 +08:00
alexey-milovidov
4c7d71af1c
Merge pull request #5560 from yandex/perftests-file-formats
Fix #5439 bug PrettySpace format
2019-06-09 17:22:47 +03:00
alexey-milovidov
7324e5e8d4
Update PrettySpaceBlockOutputStream.cpp 2019-06-09 17:22:16 +03:00
proller
21d523904b fix style 2019-06-09 14:40:25 +03:00
Igor Hatarist
fc55d38377
Fix typo in a Decimal exception
(presicion -> precision)
2019-06-08 19:56:45 +03:00
stavrolia
6c487a253b Fix #5439 bug pretty space 2019-06-08 00:04:06 +03:00
proller
7449f4f68d clang-format 2019-06-07 21:22:57 +03:00
chertus
a95e0015dc fix build and tests 2019-06-07 21:11:50 +03:00
proller
516ce69d70 CLICKHOUSE-4179 Fix of function arrayEnumerateUniqRanked for arguments with empty arrays 2019-06-07 20:37:01 +03:00
chertus
3007975199 T64 codec concept 2019-06-07 19:12:45 +03:00
alesapin
53e62b83d2 Fix complex bug in deduplication 2019-06-06 18:28:02 +03:00
Zhichang Yu
8a26060ca8 fix style 2019-06-06 08:34:34 +08:00
alesapin
a0e7d183f7
Merge pull request #5534 from yandex/debug_dns_cache
Fix bug in pooled sessions and host ip change
2019-06-05 22:37:17 +03:00
alexey-milovidov
42dbb7e881
Merge pull request #5539 from yandex/alter-ttl-fix
Fixed alter modify ttl on ReplicatedMergeTree.
2019-06-05 22:05:17 +03:00
CurtizJ
27d8b90dd9 fixed alter modify ttl on ReplicatedMergeTree and test added 2019-06-05 19:22:41 +03:00
Orivej Desh
5ec179377a DEVTOOLS-5170 Delete Y_IGNORE markers (#5533)
They have been superseded by a new include resolution configuration that lives
outside clickhouse source tree.
2019-06-05 14:52:39 +03:00
alesapin
07ee60b546 Fix bug with pooled HTTP sessions and host ip change 2019-06-05 12:23:41 +03:00
Zhichang Yu
b694d039c1 added FunctionBitmapContains 2019-06-05 16:25:48 +08:00
alexey-milovidov
4ca476ec80
Merge pull request #5516 from yandex/fix-regression-models
Fix regression models
2019-06-05 08:07:18 +03:00
alexey-milovidov
b7248803d5
Merge pull request #5524 from NanoBjorn/fix-drop-index-if-exists
Fixed DROP INDEX IF EXISTS and added simple test
2019-06-05 08:04:04 +03:00
alexey-milovidov
59a59c34c6
Update FunctionsBitmap.h 2019-06-05 08:03:09 +03:00
Zhichang Yu
0e3f2d5faa added comments for bitmapHasAll and bitmapHasAny 2019-06-05 11:26:13 +08:00
Gleb Novikov
29a26af156 Merge branch 'master' into fix-drop-index-if-exists 2019-06-04 11:32:22 +03:00
Zhichang Yu
6d0e7b7b21 fix https://github.com/yandex/ClickHouse/issues/5479 2019-06-04 14:10:51 +08:00
alexey-milovidov
e389df385c
Merge pull request #5523 from orivej/croaring
DEVTOOLS-5507 Include roaring.h as roaring/roaring.h
2019-06-04 03:58:22 +03:00
Gleb Novikov
8bd2c7b3a7 Fixed DROP INDEX IF EXISTS and added simple test 2019-06-04 00:08:52 +03:00
Anton Yuzhaninov
091b591681 Fix build without Brotli (#5513) (#5521) 2019-06-03 23:27:53 +03:00
alesapin
db6de83fa1
Merge pull request #5520 from yandex/fix_inconsistent_parts_removing
Fix inconsistent parts remove from local FS without dropping them from ZK
2019-06-03 21:18:16 +03:00
Георгий Кондратьев
2499cefdb9 DEVTOOLS-5507 Include roaring.h as roaring/roaring.h
This is needed to unbundle roaring. Its original cmake build system installs:

     /usr/include/roaring/roaring.h
     /usr/include/roaring/roaring.hh

and declares:

     set_target_properties(roaring::roaring PROPERTIES
       INTERFACE_INCLUDE_DIRECTORIES "/usr/include"
     )
2019-06-03 17:03:41 +00:00
Ivan
f70eed78d8
Don't do intermediate commits in Kafka tables by default (#5445)
* Don't do intermediate commits in Kafka tables by default
* Use default settings' values as defaults in code
2019-06-03 19:40:22 +03:00
alesapin
dfe214b37c Fix inconsistent parts remove from local FS without dropping them from ZK 2019-06-03 17:58:19 +03:00
Nikolai Kochetov
7cb3e3b251 Set default learnng_rate to 0.01. 2019-06-03 08:50:07 +03:00
Nikolai Kochetov
47f82dac72 Fix build. 2019-06-03 08:31:04 +03:00
Nikolai Kochetov
d224d3dcd2 Fix build. 2019-06-03 08:25:48 +03:00
Nikolai Kochetov
1034295f04 Fixed UInt32 overflow bug in linear models. Allow eval ML model for non-const model argument. 2019-06-03 08:11:15 +03:00
Konstantin Podshumok
633f2f2664 limit remote timeouts to max_execution_time for SelectStreamFactory 2019-06-02 12:43:20 +03:00
Konstantin Podshumok
e60a2fd1ad clickhouse dictionary source: fix timeouts for remotes 2019-06-02 12:43:20 +03:00
Konstantin Podshumok
d52be42c37 use new timeouts in ClusterProxy 2019-06-02 12:43:20 +03:00
Konstantin Podshumok
bebd19135a remove connections_with_failover_max_tries and getSaturated(settings.max_execution_time) from Cluster 2019-06-02 12:43:20 +03:00
Konstantin Podshumok
9e7387182a StorageReplicatedMergeTree: move timeouts to RemoteBlockInputStream 2019-06-02 12:43:20 +03:00
Konstantin Podshumok
a61a8386f3 update timeouts usage in DistributedBlockOutputStream 2019-06-02 12:43:20 +03:00
Konstantin Podshumok
b801fcb79a fix timeouts usage in directory monitor 2019-06-02 12:43:20 +03:00
Konstantin Podshumok
f993ea6127 add timeouts to remote streams 2019-06-02 12:43:20 +03:00
Konstantin Podshumok
a3d2310d6f add timeouts to multiplexed connections 2019-06-02 12:43:20 +03:00
Konstantin Podshumok
eb31345224 add timeouts to ConnectionPoolWithFailover and use max_tries from settings 2019-06-02 12:43:20 +03:00
Konstantin Podshumok
d18fd5f10b timeouts from ConnectionPool members as they are intended to live longer than timeouts state 2019-06-02 12:43:20 +03:00
Konstantin Podshumok
6836bf6733 connection: make sure connection timeouts are applied during sendQuery 2019-06-02 12:43:20 +03:00
Konstantin Podshumok
94b2bf5551 move timeouts from members to parameters in Connection
maybe it is better to provide some `set_timeouts` method?
2019-06-02 12:43:20 +03:00
alexey-milovidov
005217c9d9
Merge pull request #5492 from Quid37/master
Some changes and fixes on regression methods
2019-06-02 06:31:22 +03:00
alexey-milovidov
086572b604
Merge pull request #5503 from 4ertus2/bugs
Fix union all supertype column
2019-06-02 06:18:33 +03:00
Alexander Kozhikhov
ba3d6c4b6c unique 2019-06-02 01:46:25 +03:00
Danila Kutenin
b5f42d36fa
Merge pull request #5498 from yandex/gcc9-warnings
Fix gcc9 warnings and ICEs
2019-06-01 15:12:41 +03:00
Vitaly Baranov
a4ce427bfa
Merge pull request #5429 from azat-archive/INSERT-into-Distributed-with-MATERIALIZED
Fix INSERT into Distributed() table with MATERIALIZED column
2019-06-01 12:28:45 +03:00
Vitaly Baranov
421c6a90e2
Use function getSampleBlockNonMaterialized() to simplify the solution 2019-05-31 21:31:09 +03:00
Alexander Kozhikhov
da8d49a67a shared to unique 2019-05-31 18:53:31 +03:00
Alexander Kozhikhov
73c07cb9d5 fix on lin_ref_perf 2019-05-31 18:39:17 +03:00
alesapin
117c9edda7
Merge pull request #5489 from azat-archive/DDLWorker-fix
Skip ZNONODE during DDL query processing
2019-05-31 18:34:47 +03:00
chertus
40b5375aa8 fix const optimisation 2019-05-31 16:34:09 +03:00
chertus
28c1a60eb7 fix union all supertype column 2019-05-31 15:36:44 +03:00
Danila Kutenin
7e2b3b59b8 Fix gcc9 warnings and ICE's 2019-05-31 11:55:01 +03:00
alexey-milovidov
4819a34394
Merge pull request #5448 from yandex/low-cardinality
Add setting suspicious type for low cardinality (fixed #4965)
2019-05-31 07:35:19 +03:00
proller
1b0d1a4450 Info about frozen parts in system.parts (#5471)
* wip

*    wip

* wip

* Clean

* fix test

* clean

* fix test

* fix test
2019-05-31 07:03:46 +03:00
alexey-milovidov
261dd5668e
Merge pull request #5477 from yandex/fix-linking-with-lld
Fixed linking with lld
2019-05-31 07:00:55 +03:00
Alexander Kozhikhov
42f3ee2e2b conflict 2019-05-31 01:55:18 +03:00
Alexander Kozhikhov
0f222640d5 style 2019-05-31 01:53:56 +03:00
Alexander Kozhikhov
15fe367f83 few fixes 2019-05-31 01:48:44 +03:00
Alexander Kozhikhov
ef23528452 some changes and fixes on regression methods 2019-05-31 00:59:40 +03:00
Azat Khuzhin
eb5f46fb07
Skip ZNONODE during DDL query processing
Right now if another node removes the znode in task_queue, the one that
did not process it, but already get list of children, will terminated
the DDLWorker thread, and this is very unconvinient because you do not
have any sane way to know is DDLWorker still running or not (except for
timed out DDL queries or via debugger), and the clickhouse-server it
self do not fail either.

Fixes: #5064
2019-05-30 20:25:29 +03:00
Olga Khvostikova
2fc3ce7f5d
Merge branch 'master' into low-cardinality 2019-05-30 16:31:40 +03:00
proller
a813a001e2
Allow to use internal compiler with system includes (fix compile for freebsd) (#5447)
* Allow to use internal compiler with system includes (fix compile for freebsd)
* Fix macos build
2019-05-30 15:58:15 +03:00
Alexey Milovidov
05737678e2 Remove debug logging from MySQL protocol 2019-05-30 11:25:16 +03:00
Alexey Milovidov
1607ec49ba Fixed linking with lld 2019-05-30 11:23:20 +03:00
stavrolia
60459bbb87 Yet another fix 2019-05-29 20:49:35 +03:00
stavrolia
605de8c36c Fixed 2019-05-29 17:59:11 +03:00
chertus
3f2e09ac93 Merge branch 'master' into decimal 2019-05-29 13:58:33 +03:00
Nikolai Kochetov
713ccd1f60 Added comment for IAggregateFunction::getReturnTypeToPredict(). Small code fixes. 2019-05-29 06:42:33 +03:00
Nikolai Kochetov
1c8b7dc96d
Merge pull request #5411 from Quid37/master
small changes on linear regression
2019-05-29 06:31:51 +03:00
zhang2014
80788cd7a8 Rename system sync distributed to system flush distributed 2019-05-29 10:43:52 +08:00
zhang2014
1a33840964 fix review 2019-05-29 10:43:52 +08:00