Commit Graph

5477 Commits

Author SHA1 Message Date
Vitaliy Zakaznikov
e20793b2dc Merge remote-tracking branch 'origin/master' into live_view_support_for_subquery 2019-12-05 06:54:04 -05:00
Mikhail Korotov
88e37020e0 JSONCompactEachRow and JSONCompactEachRowWithNamesAndTypes (#7841)
* Research commit

* Created Output EachRow Format

* Fixed bugs

* Created output format JSONCompactEachRowWithNamesAndTypes without totals

* Fixed bugs

* Fixed bugs

* Totals for JSONCompactEachRowWithNamesAndTypes

* Deleted needless debug

* Working commit

* Working commit

* Working commit

* Working commit

* Working commit

* Working commit

* Working commit

* Working commit

* Working commit

* Working commit

* Working commit

* Working commit

* Tests added

* Input Format for JSONCompactEachRow

* Fixed bugs for JSONCompactEachRow Input format

* Fixed bugs for JSONCompactEachRowRowInputFormat.cpp

* JSONCompactEachRow and JSONCompactEachRowWithNamesAndTypes united

* Created input format for both formats

* fixed bugs

* fixed bugs

* Working commit

* Working commit

* Working commit

* Working commit

* tests

* Working commit

* Final tests

* Performance tests added
2019-12-05 13:13:40 +03:00
Vitaly Baranov
2cc78413ed
Merge pull request #7914 from azat/dist-send-extra-checksum
Add checksum for extra info/query in distributed sends
2019-12-05 11:43:08 +03:00
alesapin
a524e82a7f
Merge pull request #8029 from ClickHouse/fix_dict_partially_update_failover
Fix external dictionaries failover, when they have invalidate_query.
2019-12-05 11:12:17 +03:00
Azat Khuzhin
3a72e1c12a Add checksum for extra info/query in distributed sends
This extras includes:
- server revision
- query settings
- query

Otherwise the code can try to interpret data, and got for instance
std::length_error exception, which is not catched (to mark the part as
broken). Also this will protect from the corruptions on disk.

And add a simple test, since dbms/tests/integration/test_insert_into_distributed too complex.

Also simplify the code by using readStringBinary() over
readVarUInt()+b.readStrict() (this also gains additional checks that
string is not bigger then 1GB).

Refs: #4852 (8ef7f3589a)
v2: avoid ABI breakage (suggested by @vitlibar)
v3: minor code fixes (suggested by @vitlibar) and as a consequence clang-8 build fix
v4: drop DBMS_MIN_REVISION_WITH_EXTRAS_CHECKSUM_IN_DIST_BATCH and also
    revert some renames to make the patch cleaner
2019-12-04 22:54:38 +03:00
alesapin
172bbb1a2f Fix flappy test, because dictionaries are loaded lazily 2019-12-04 21:30:47 +03:00
alesapin
3128b62f0e Create dictionary if not exists 2019-12-04 18:11:36 +03:00
alesapin
a41764cccc Reload dictionary with invalidate query if it has exception 2019-12-04 17:45:56 +03:00
alesapin
ce05cea192 Add sleep for test 2019-12-04 17:22:49 +03:00
alesapin
711fb5e667 Added tests for external dictionary invalidate query failover 2019-12-04 16:53:05 +03:00
alesapin
ace44e0717 Add test for incorrect settings 2019-12-04 12:34:05 +03:00
alesapin
f0e9715f10 Fix test 2019-12-03 20:36:02 +03:00
alesapin
2a43daec5c Buildable code 2019-12-03 20:15:16 +03:00
alesapin
20e4e92c49 Fix some conflicts 2019-12-03 19:32:41 +03:00
CurtizJ
828f3ac3b2 add perf test for function and 2019-12-03 16:28:07 +03:00
alesapin
54088db46a
Merge pull request #8001 from ClickHouse/add_time_to_func_tests
Added argument --print-time to tests.
2019-12-03 15:38:11 +03:00
alexey-milovidov
f09c29a2b6
Merge pull request #7992 from ClickHouse/excitoon-favorites-s3auth
Merging #7623
2019-12-03 15:21:12 +03:00
Nikolai Kochetov
f2ff3b3ddd Added argument --print-time to tests. 2019-12-03 12:59:41 +03:00
alexey-milovidov
0c904f1484
Merge pull request #7721 from 4ertus2/decimal
Basic GatherUtils support for Decimals
2019-12-03 05:15:38 +03:00
alexey-milovidov
0734d4695b
Merge pull request #7724 from 4ertus2/some
Missing array functions for Decimals
2019-12-03 05:14:33 +03:00
alexey-milovidov
812df3aef3
Merge pull request #7755 from nikitamikhaylov/storage_set
Using the Set engine happen Exception: Method read is not supported by storage Set
2019-12-03 05:09:47 +03:00
alexey-milovidov
f1d75d9722
Update 01030_storage_set_supports_read.sql 2019-12-03 05:09:33 +03:00
alexey-milovidov
f5e88f8cd5
Merge pull request #7307 from ClickHouse/new-branch-for-new-geodist
Speed up greatCircleDistance function with test
2019-12-03 04:34:35 +03:00
alexey-milovidov
edede563c9
Merge pull request #7747 from hczhcz/patch-1113
Fix empty array handling in arraySplit
2019-12-03 04:00:31 +03:00
Alexey Milovidov
d70b73f033 Merge branch 's3auth' of https://github.com/excitoon-favorites/ClickHouse into excitoon-favorites-s3auth 2019-12-03 03:06:01 +03:00
Alexey Milovidov
9d099bde8e Merge branch 'master' into fix_check_table_with_empty_pk 2019-12-03 02:36:21 +03:00
alexey-milovidov
3355492f02
Merge pull request #7983 from ClickHouse/fix_dictionary_lifetime
Fix bug with minimal dictionary lifetime equals zero
2019-12-03 02:32:38 +03:00
alexey-milovidov
7af2dc34d2
Merge pull request #7990 from ClickHouse/filimonov-lc_empty_part_bug
Merging #7985
2019-12-03 02:26:44 +03:00
Alexey Milovidov
166e9e414c Fixed bad test 2019-12-03 02:26:15 +03:00
Alexey Milovidov
07d7fd413f Fixed bad test 2019-12-03 02:25:08 +03:00
alexey-milovidov
43c47bdb55
Merge pull request #7717 from MaxFedotov/support_mysql_federated
support clickhouse as mysql federated server
2019-12-03 02:21:35 +03:00
Alexey Milovidov
58c40dc234 Merge branch 'master' of github.com:yandex/ClickHouse into filimonov-lc_empty_part_bug 2019-12-03 02:14:35 +03:00
alexey-milovidov
8338be47dd
Merge pull request #7975 from yurriy/mysql-protocol-text
Support more column types in MySQL compatibility server
2019-12-03 02:08:24 +03:00
Alexey Milovidov
272715cb71 Merge branch 'lc_empty_part_bug' of https://github.com/filimonov/ClickHouse into filimonov-lc_empty_part_bug 2019-12-03 01:58:41 +03:00
alexey-milovidov
bd72b570a3
Update 01035_lc_empty_part_bug.sql 2019-12-03 01:56:37 +03:00
Mikhail Filimonov
5228f5f2eb Test case for altering to LowCardinality when data part is empty 2019-12-02 16:11:28 +01:00
alesapin
7410d17892 Fix bug with minimal dictionary lifetime equals zero 2019-12-02 16:05:43 +03:00
Vitaly Baranov
b2685a3710
Merge pull request #7727 from kekekekule/master
Added lifetime to system.dictionaries #6820
2019-12-02 15:15:44 +03:00
alesapin
a4ca30b5fd Fix bug in check table for tables without primary key 2019-12-02 13:30:04 +03:00
alesapin
af85eb8f80
Merge pull request #7916 from azat/dict-avoid-RELOAD-on-CREATE-DATABASE
Do not reload *all* dictionaries on CREATE DATABASE
2019-12-02 11:50:44 +03:00
Vladimir Chebotarev
03ec61fff3 Fixed 01030_storage_s3_syntax stateless test. 2019-12-01 15:35:04 +03:00
Yuriy
3677d1dcfa implemented ProtocolText 2019-12-01 15:17:49 +03:00
Vladimir Chebotarev
d0760bc169 Fixed tests and logic of authorization in S3. 2019-12-01 14:24:55 +03:00
Артем Стрельцов
95124e910a Fixed test for lifetime 2019-12-01 03:40:59 +03:00
Nikolay Degterinsky
b0eabb690b Test added 2019-11-29 21:46:26 +03:00
Maksim Fedotov
4844b9b230 support clickhouse as mysql federated server. apply code review notes p2 2019-11-28 17:43:52 +03:00
Vladimir Chebotarev
ecaa98e4e4 Allowed to use constant TTL expressions, updated tests. 2019-11-27 13:11:17 +03:00
Vladimir Chebotarev
fa79b7cf7d Updated test checking that constant TTL expression works. 2019-11-27 13:11:17 +03:00
Nikolai Kochetov
4f79476511
Merge pull request #7929 from ClickHouse/fix-union-with-diff-columns
Fix union with diff columns
2019-11-26 19:40:45 +03:00
Maksim Fedotov
b768b0de55 support clickhouse as mysql federated server. apply code review notes. fix typo 2019-11-26 18:42:50 +03:00