Commit Graph

31812 Commits

Author SHA1 Message Date
Nikolai Kochetov
86ff01d3aa
Merge pull request #7988 from ClickHouse/processors-4.4
Better updated ports check in processors
2019-12-05 13:54:40 +03:00
Mikhail Korotov
88e37020e0 JSONCompactEachRow and JSONCompactEachRowWithNamesAndTypes (#7841)
* Research commit

* Created Output EachRow Format

* Fixed bugs

* Created output format JSONCompactEachRowWithNamesAndTypes without totals

* Fixed bugs

* Fixed bugs

* Totals for JSONCompactEachRowWithNamesAndTypes

* Deleted needless debug

* Working commit

* Working commit

* Working commit

* Working commit

* Working commit

* Working commit

* Working commit

* Working commit

* Working commit

* Working commit

* Working commit

* Working commit

* Tests added

* Input Format for JSONCompactEachRow

* Fixed bugs for JSONCompactEachRow Input format

* Fixed bugs for JSONCompactEachRowRowInputFormat.cpp

* JSONCompactEachRow and JSONCompactEachRowWithNamesAndTypes united

* Created input format for both formats

* fixed bugs

* fixed bugs

* Working commit

* Working commit

* Working commit

* Working commit

* tests

* Working commit

* Final tests

* Performance tests added
2019-12-05 13:13:40 +03:00
Sergei Bocharov
529293faad Docs: added docs for trimLeft, trimRight, trimBoth (#7924) 2019-12-05 13:03:35 +03:00
Vitaly Baranov
2cc78413ed
Merge pull request #7914 from azat/dist-send-extra-checksum
Add checksum for extra info/query in distributed sends
2019-12-05 11:43:08 +03:00
alesapin
a524e82a7f
Merge pull request #8029 from ClickHouse/fix_dict_partially_update_failover
Fix external dictionaries failover, when they have invalidate_query.
2019-12-05 11:12:17 +03:00
alexey-milovidov
9fafadf536
Update extended_roadmap.md 2019-12-05 05:17:46 +03:00
Azat Khuzhin
3a72e1c12a Add checksum for extra info/query in distributed sends
This extras includes:
- server revision
- query settings
- query

Otherwise the code can try to interpret data, and got for instance
std::length_error exception, which is not catched (to mark the part as
broken). Also this will protect from the corruptions on disk.

And add a simple test, since dbms/tests/integration/test_insert_into_distributed too complex.

Also simplify the code by using readStringBinary() over
readVarUInt()+b.readStrict() (this also gains additional checks that
string is not bigger then 1GB).

Refs: #4852 (8ef7f3589a)
v2: avoid ABI breakage (suggested by @vitlibar)
v3: minor code fixes (suggested by @vitlibar) and as a consequence clang-8 build fix
v4: drop DBMS_MIN_REVISION_WITH_EXTRAS_CHECKSUM_IN_DIST_BATCH and also
    revert some renames to make the patch cleaner
2019-12-04 22:54:38 +03:00
alesapin
172bbb1a2f Fix flappy test, because dictionaries are loaded lazily 2019-12-04 21:30:47 +03:00
alesapin
cfa1b37fd6
Merge pull request #8032 from ClickHouse/ddl_dictionaries_if_not_exists
Create dictionary if not exists
2019-12-04 21:28:05 +03:00
Nikolai Kochetov
715d7a6455 Disable processors by default. 2019-12-04 20:24:53 +03:00
alesapin
7b8443710d Better code 2019-12-04 19:20:24 +03:00
alesapin
40c6966223 Don't check dictionary modification if it's already have an exception. 2019-12-04 18:23:18 +03:00
alesapin
2592e44eef
Merge pull request #8028 from ClickHouse/fix_libc_compatibility_of_odbc_bridge
Fix unintendent dependency from GLIBC 2.16 in clickhouse-odbc-bridge
2019-12-04 18:15:26 +03:00
alesapin
3128b62f0e Create dictionary if not exists 2019-12-04 18:11:36 +03:00
alesapin
a41764cccc Reload dictionary with invalidate query if it has exception 2019-12-04 17:45:56 +03:00
alesapin
ce05cea192 Add sleep for test 2019-12-04 17:22:49 +03:00
alesapin
711fb5e667 Added tests for external dictionary invalidate query failover 2019-12-04 16:53:05 +03:00
Nikolai Kochetov
3ac103f21c Fix the number of rows in MergingSortedTransform. 2019-12-04 16:45:42 +03:00
alesapin
516876becb Fix unintendent dependency from GLIBC 2.16 in clickhouse-odbc-bridge 2019-12-04 15:39:09 +03:00
alesapin
a651a1e05b
Merge pull request #8024 from ClickHouse/millb-fix_metric_suffix_in_settings_value
Merging [#7678]
2019-12-04 14:27:14 +03:00
Nikolai Kochetov
901a6b4627 Style fix. 2019-12-04 12:56:08 +03:00
Nikolai Kochetov
efe1616fda Fix optimization for 'WHERE column in (empty set)' case. 2019-12-04 12:55:01 +03:00
Nikolai Kochetov
81b5b17828 Fix pvs studio varning. 2019-12-04 12:55:01 +03:00
Nikolai Kochetov
fa98587c19 Init update_info in port. 2019-12-04 12:55:01 +03:00
Nikolai Kochetov
4337fc20b5 Enable processors by default. 2019-12-04 12:55:01 +03:00
Nikolai Kochetov
8524a75580 Check once if filter column can be always false in filter transform. 2019-12-04 12:55:01 +03:00
Nikolai Kochetov
9465183408 Add info about affected ports after prepare. 2019-12-04 12:55:01 +03:00
Nikolai Kochetov
4f2f474fde Add info about affected ports to IProcessor::prepare 2019-12-04 12:55:01 +03:00
alesapin
eb17d51dd4 Remove unused function 2019-12-04 12:49:54 +03:00
alesapin
d1d3bac744 Better 2019-12-04 12:48:08 +03:00
alesapin
ace44e0717 Add test for incorrect settings 2019-12-04 12:34:05 +03:00
alesapin
9e5f13e7af Merge branch 'fix_metric_suffix_in_settings_value' of https://github.com/millb/ClickHouse into millb-fix_metric_suffix_in_settings_value 2019-12-04 12:22:29 +03:00
alesapin
8877129d60
Merge pull request #8012 from ClickHouse/millb-url_engine_problem
Merging [#7154]
2019-12-04 12:13:15 +03:00
Ivan Blinkov
f737f222b2
Remove link to past meetup 2019-12-04 12:03:50 +03:00
BayoNet
a95e585d6a
DOCS-121: Introspection functions description (#7871)
* CLICKHOUSEDOCS-121: EN docs for the addressToLine function and the allow_introspection_functions setting.

* CLICKHOUSEDOCS-121: Introspection functions description.

* Update docs/en/query_language/functions/introspection.md

Co-Authored-By: Ivan Blinkov <github@blinkov.ru>

* CLICKHOUSEDOCS-121: Update by the comments.
2019-12-04 09:55:13 +03:00
BayoNet
52d684614c
DOCS-265: Docs for the max_http_get_redirects setting (#7684)
* CLICKHOUSEDOCS-265: The max_http_get_redirects setting description.

* CLICKHOUSEDOCS-265: Clarification.

* CLICKHOUSEDOCS-265: Clarification.
2019-12-04 09:46:31 +03:00
alesapin
fa4728d44f Fix style 2019-12-03 20:57:00 +03:00
alesapin
f0e9715f10 Fix test 2019-12-03 20:36:02 +03:00
Nikolai Kochetov
7b3c56990d
Merge pull request #8005 from ClickHouse/add-more-checks-to-chunk
Add forgotten rows number check to chunk constructor.
2019-12-03 20:26:19 +03:00
alesapin
2a43daec5c Buildable code 2019-12-03 20:15:16 +03:00
Sergei Shtykov
22399ad7be CLICKHOUSEDOCS-121: Update by the comments. 2019-12-03 19:52:28 +03:00
alesapin
20e4e92c49 Fix some conflicts 2019-12-03 19:32:41 +03:00
alexey-milovidov
8cb5402179
Merge pull request #8006 from CurtizJ/and_perftest
Add perf test for function 'and'.
2019-12-03 19:06:26 +03:00
Sergei Shtykov
6d11f96106 Merge branch 'master' of github.com:ClickHouse/ClickHouse into en-docs/CLICKHOUSEDOCS-121-addressToLine 2019-12-03 18:05:07 +03:00
BayoNet
4205fe8c9b
Update docs/en/query_language/functions/introspection.md
Co-Authored-By: Ivan Blinkov <github@blinkov.ru>
2019-12-03 18:00:45 +03:00
alexey-milovidov
da754943d8
Merge pull request #8008 from Alex-Burmak/typo_fix
Fixed typos in ExternalLoader.h and CrossToInnerJoinVisitor.cpp
2019-12-03 17:29:49 +03:00
Nikolai Kochetov
31d5c66867 Fix num rows in IRowInputFormat 2019-12-03 16:43:40 +03:00
alexey-milovidov
3855540e45
Merge pull request #8007 from ClickHouse/blinkov-patch-15
Fix toc_en.yml error
2019-12-03 16:42:40 +03:00
Alexander Burmak
108c792fd9 Fixed typos in ExternalLoader.h and CrossToInnerJoinVisitor.cpp 2019-12-03 16:39:42 +03:00
Ivan Blinkov
fa4894bd47
Fix toc_en.yml error 2019-12-03 16:34:19 +03:00