thevar1able/ClickHouse
1
0
Fork 0
mirror of https://github.com/ClickHouse/ClickHouse.git synced 2024-12-18 12:22:12 +00:00
Code Issues Packages Projects Releases Wiki Activity
34,799 Commits 9,330 Branches 1,783 Tags 2.2 GiB
d1bfacae4b
Commit Graph

5476 Commits

Author SHA1 Message Date
Nikolai Kochetov
feed418fb3 Disable task pinning and resize. 2019-11-07 14:49:13 +03:00
alesapin
982eae7b30 Remove redundant change 2019-11-07 11:49:09 +03:00
alesapin
18e59f2771 Remove some functions from mutations interpreter 2019-11-07 11:40:36 +03:00
Amos Bird
544af39d23
Vectorize arrayReduce and -Array combinator 
Also devirtualize -State combinator.
 2019-11-07 11:53:47 +08:00
chertus
252fab54a2 less specializations 2019-11-06 23:25:27 +03:00
chertus
d388918c60 Join.cpp refactoring 2019-11-06 22:40:53 +03:00
Azat Khuzhin
0677ae048c Wrap _shard_num with toUInt32 for simpler JOIN with system.clusters.shard_num 2019-11-06 21:02:42 +03:00
alesapin
8c7deaa70d More safier, but still ugly mutations interpreter 2019-11-06 20:28:03 +03:00
Azat Khuzhin
81aeff2d2a Add _shard_num virtual column for the Distributed engine 
With JOIN from system.clusters one can figure out from which server data
came.

TODO:
- optimization to avoid communicating with unrelated shards (for queries
  like "AND _shard_num = n")
- fix aliases (see tests with serverError expected)

v0: AddingConstColumnBlockInputStream
v2: VirtualColumnUtils::rewriteEntityInAst
v3: fix remote(Distributed) by appending _shard_num only if has been requested
 2019-11-06 15:26:12 +03:00
Alexander Kuzmenkov
233212ac68
Merge pull request #7531 from amosbird/getkeymapped 
Unify hash tables interface (separated for review)
 2019-11-06 13:49:39 +03:00
Nikolai Kochetov
86a9c2b98e Try to fix tests. 2019-11-06 12:45:47 +03:00
alexey-milovidov
78f7826a09
Update InterpreterSelectQuery.cpp 2019-11-06 11:17:26 +03:00
chertus
950e95c178 support JOIN ON expression 2019-11-05 23:22:20 +03:00
Nikolai Kochetov
055f21c9b7 Less wrappers for procesors pipeline. 2019-11-05 20:33:03 +03:00
Amos Bird
fbfbe161ec
Unify hash tables interface. 2019-11-06 00:08:04 +08:00
millb
d62cd6efa8 Merge branch 'master' into url_engine_problem 2019-11-05 14:42:53 +03:00
Vasily Nemkov
c6eb0fcff7 Merge remote-tracking branch 'upstream/master' into DateTime64 2019-11-04 17:06:22 +03:00
alexey-milovidov
81e33ca817
Merge pull request #7586 from 4ertus2/joins 
Rewrite NonJoinedBlockInputStream
 2019-11-04 14:49:47 +03:00
alexey-milovidov
782e2f6c13
Merge pull request #7606 from amosbird/nullformat 
Better Null format for tcp handler.
 2019-11-04 14:27:27 +03:00
Amos Bird
8f902dc2a9
Better null format for tcp handler. 2019-11-04 11:53:26 +08:00
chertus
b7b664845d return right x in RIGHT|FULL JOIN .. USING(x) from NonJoinedBlockInputStream if not qualified 2019-11-03 23:30:49 +03:00
chertus
d4e1468022 fix Join.saved_block_sample columns' nullability 2019-11-03 22:33:59 +03:00
Amos Bird
f0b3c1f7c7
early constant folding improvement 2019-11-03 21:17:46 +08:00
alexey-milovidov
dda93e2275
Merge pull request #7561 from ClickHouse/achimbab-master 
Merge for #7363
 2019-11-02 00:57:13 +03:00
chertus
334b91f351 revrite NonJoinedBlockInputStream (in progress) 2019-11-01 20:41:07 +03:00
Nikolai Kochetov
239d92a94c Code cleanup. 2019-11-01 18:31:02 +03:00
Nikolai Kochetov
575eabd4ff Add flag to set that set is created. 2019-11-01 16:56:33 +03:00
alexey-milovidov
4081b0be90
Merge pull request #7497 from amosbird/countopt 
Early constant folding.
 2019-11-01 16:54:02 +03:00
Nikolai Kochetov
1f7a798c97 Add flag to set that set is created. 2019-11-01 13:58:29 +03:00
Nikolai Kochetov
d31cac33b2 Small fixes. 2019-11-01 12:41:20 +03:00
Nikolai Kochetov
5bb47e2484
Merge pull request #7181 from ClickHouse/processors-and-storages 
Processors and storages
 2019-11-01 12:04:49 +03:00
Nikolai Kochetov
c0fccd5b87 Simplified code. 2019-11-01 11:32:41 +03:00
Nikolai Kochetov
9a5a0a2a3b Fix types for set elements. 2019-10-31 19:14:06 +03:00
Vitaly Baranov
56011d4649
Merge pull request #7553 from vitlibar/add-constraints-columns-to-table-system-settings 
Add constraints columns to table system.settings
 2019-10-31 19:06:46 +03:00
Amos Bird
e04cdd4ebb
Early constant folding. 2019-10-31 23:54:32 +08:00
Nikolai Kochetov
a80338e066 Merged with master 2019-10-31 14:41:29 +03:00
Vitaly Baranov
272608762e Fix comment. 2019-10-31 11:45:14 +03:00
Vitaly Baranov
5601d6ae66 Add constraints columns to table system.settings 2019-10-31 01:45:57 +03:00
alexey-milovidov
0d2a2c332f
Merge pull request #7366 from achimbab/fixbug_inop 
Made IN operator support Array(LowCardinality(Nullable(String)))
 2019-10-31 00:26:22 +03:00
alexey-milovidov
883c868b36
Merge pull request #7523 from ClickHouse/fix-thread-context-attach 
Disable context replacement for internal queries
 2019-10-31 00:07:13 +03:00
Alexey Milovidov
fe73354320 Improvements after #7510 2019-10-30 22:15:55 +03:00
alexey-milovidov
ddb58eeb8b
Merge pull request #7510 from amosbird/smartcount 
Instant count() for MergeTree
 2019-10-30 20:42:00 +03:00
Artem Zuikov
0f68c5a12a
Merge pull request #7530 from 4ertus2/joins 
Fix right table key nullability (join_use_keys = 0)
 2019-10-30 13:30:27 +03:00
Ivan
4f2f5cca84
Add support for cross-compiling to the CPU architecture AARCH64 (#7370) 2019-10-30 10:01:53 +03:00
chertus
deb2406b30 fix JOIN right table keys nullability 2019-10-29 22:39:42 +03:00
chertus
12b57aedf0 remove error prone code 2019-10-29 16:52:05 +03:00
alesapin
cde07dd620 Disable context replacement for internal queries 2019-10-29 13:27:19 +03:00
Amos Bird
2c75a51d4f
Instant count() for MergeTree 
Use (Replicated)MergeTree's metadata to do trivial count()
 2019-10-29 17:45:47 +08:00
Nikolai Kochetov
43c8d13de6
Merge pull request #7496 from amosbird/fix15 
Fix HAVING without GROUP BY
 2019-10-28 02:44:24 +03:00
Amos Bird
77bdfb3350
Fix HAVING without GROUP BY 2019-10-27 22:10:54 +08:00
alesapin
04ca163518 Merge branch 'master' into dictionaries_ddl_loader 2019-10-25 10:58:04 +03:00
chertus
f2028e901d review related changes 2019-10-24 16:04:50 +03:00
chertus
12cd21f3c3 Merge branch 'master' into ast 2019-10-24 15:20:09 +03:00
Artem Zuikov
39b64dff87
Merge pull request #7454 from 4ertus2/refactoring 
Refactoring: extract non aliases logic out of QueryNormalizer
 2019-10-24 14:34:53 +03:00
alesapin
a6199b7e69 Merge with master 2019-10-24 12:33:40 +03:00
Vasily Nemkov
d6ff36c760 Merge remote-tracking branch 'upstream/master' into DateTime64 2019-10-24 07:52:50 +03:00
chertus
20093fa065 extract more logic out of QueryNormalizer 2019-10-23 16:59:03 +03:00
Amos Bird
295864e6e0
better scalar query 2019-10-23 21:37:54 +08:00
alesapin
c3519ff376 Better check of dictionary lifetime for updates 2019-10-23 16:02:40 +03:00
Alexander Kuzmenkov
1a609c27bd
Merge pull request #6243 from ClickHouse/aku/hashtables 
Introduce String Hash Map to speed up aggregation over short string keys.
 2019-10-23 12:52:50 +03:00
alesapin
6a0246f58e Fix if 2019-10-23 12:40:09 +03:00
alesapin
0abb2e538b Remove strange logic 2019-10-23 12:36:20 +03:00
alesapin
fb349757ba Fix ubsan error 2019-10-23 12:27:34 +03:00
alesapin
dc6090a2ac More readable code in external loader 2019-10-22 16:41:17 +03:00
alesapin
ae42dd1cea Better doLoading locking logic 2019-10-22 15:57:58 +03:00
alesapin
d3461f9d46 TODO comments 2019-10-22 14:03:16 +03:00
alesapin
4c5d150d7a Review fixes 2019-10-22 13:47:43 +03:00
Ivan
7ba4e36e73
Don't push to MVs when inserting into Kafka table (#7265) 
* Do not insert values into MV when inserting directly to Kafka
* Add method noPushingToViews() to IStorage interface
  To separate InterpreterInsertQuery and StorageKafka
 2019-10-22 13:31:28 +03:00
Nikolai Kochetov
2b334a4adb Review fixes. 2019-10-21 19:26:29 +03:00
chertus
851b00c99f minor visitors improvement 2019-10-21 19:22:54 +03:00
Nikolai Kochetov
2893c35930 Merged with master. 2019-10-21 18:33:44 +03:00
alesapin
ff7850cfbd Remove strange code in favor of less strange code 2019-10-21 17:59:35 +03:00
millb
8b8ca9a141 Support redirect improvement 2019-10-21 17:45:57 +03:00
alesapin
f7043c38bd Less diff 2019-10-21 17:20:42 +03:00
alesapin
fc05110d66 Better naming 2019-10-21 17:07:47 +03:00
alesapin
e4a936cf41 Fix add and reload 2019-10-21 16:54:23 +03:00
Amos Bird
a864447802 Introduce String Hash Map. 
It speeds up aggregation over short string keys. Use it as a default
aggregation method for string keys.
 2019-10-21 16:27:35 +03:00
chertus
4f0859a5fa Merge branch 'master' into ast 2019-10-21 15:08:05 +03:00
chertus
5ef7376cbf fix distributed join on 2019-10-21 14:22:22 +03:00
alesapin
26c87e46c9 Merge branch 'master' into dictionaries_ddl_loader 2019-10-21 11:46:49 +03:00
alesapin
35e66d6696 Merge with master 2019-10-21 11:46:11 +03:00
millb
f64f6658ce Merge branch 'master' into url_engine_problem 2019-10-21 11:44:31 +03:00
alexey-milovidov
8b8cc67873
Merge pull request #7390 from azat/processlist-log-queue_max_wait_ms 
Add a message in case of queue_wait_max_ms wait takes place
 2019-10-20 17:55:36 +03:00
Azat Khuzhin
94948c2579 Add a message in case of queue_wait_max_ms wait takes place 
Since there no information about this, while this can be interesting,
for example to tune max_concurrent_queries in some cases.
 2019-10-18 23:36:12 +03:00
chertus
c5a850240c better ambiguous column detection in multiple join rewriter 2019-10-18 20:09:17 +03:00
chertus
2533652847 columns match priority: table alias > table name> aliased table name 2019-10-18 19:16:57 +03:00
alesapin
cdc195727e Fix some races from lazy load and add ugly interface to loader (need to be refactored) 2019-10-18 19:04:09 +03:00
Alexander Kuzmenkov
5e2cc37381
Distinguish Array and Tuple field types when creating from array of Fields. (#7179) 2019-10-18 18:57:05 +03:00
Alexander Kuzmenkov
3143fa37d7
Merge pull request #7371 from CurtizJ/fix-optimize-read-in-order 
Fix optimize_read_in_order with IN and a subquery.
 2019-10-18 15:55:53 +03:00
philip.han
5f1b14e313 Remove a dynamically sized array in BloomFilterHash.h 2019-10-18 19:39:10 +09:00
philip.han
1d423fad73 Blocked "nested-array-type" for the bloom_filter 2019-10-18 11:55:01 +09:00
chertus
0f6176cc2d throw on ambiguous qualified column 2019-10-18 00:08:28 +03:00
alesapin
c29b39002d Fix race condition, add test 2019-10-17 20:36:53 +03:00
alesapin
05392fd882 Fix deadlock, add test and refactoring 2019-10-17 20:18:54 +03:00
tavplubix
0046b9f137 Wait for jobs to finish on exception (fixes rare segfaults) (#7350) 2019-10-17 17:41:27 +03:00
Alexander Kuzmenkov
b62c9e729d
Merge pull request #7215 from ClickHouse/formats_improvements 
Miscellaneous formats improvements
 2019-10-17 17:37:38 +03:00
CurtizJ
546414c015 fix optimize_read_in_order with in subquery 2019-10-17 16:11:27 +03:00
alesapin
6dfe5c7142 Better introspection 2019-10-17 16:05:12 +03:00
Ivan
e595df05d9
Fix CREATE TABLE AS from table with virtual columns (#7183) 
* Disable undefined instrumentation for rdkafka
 2019-10-17 14:12:35 +03:00
philip.han
08a348fbd1 Made IN operator support Array(LowCardinality(Nullable(String))) 2019-10-17 19:08:36 +09:00
alesapin
3987a45ea2 Fix build and style 2019-10-17 12:05:48 +03:00
alesapin
a19a699bef Fix confused variables 2019-10-16 20:52:56 +03:00
chertus
483108f46f column to table matching refactoring 2019-10-16 20:33:53 +03:00
alesapin
01e23f0a22 Better load of dictionaries 2019-10-16 20:06:52 +03:00
alesapin
b4e0ded048 Almost working 2019-10-16 17:59:52 +03:00
chertus
e6e88241fc SyntaxAnalyzer refactoring: better getTablesWithColumns() 2019-10-16 17:47:58 +03:00
Alexander Tokmakov
aa9d29d6ae Merge branch 'master' into formats_improvements 2019-10-16 17:15:13 +03:00
Artem Zuikov
b70ca30447
Merge pull request #7335 from 4ertus2/ast 
Remove asterisk_left_columns_only setting
 2019-10-16 13:57:17 +03:00
Artem Zuikov
3ceeb95145
Merge pull request #7282 from 4ertus2/asof 
ASOF JOIN inequalities
 2019-10-16 13:46:52 +03:00
philip.han
a2bf848e12 Made bloom_filter type of index supporting LowCardinality and Nullable 2019-10-16 15:22:56 +09:00
alesapin
e690a3ca32 Half working code 2019-10-15 21:04:17 +03:00
chertus
ccc8c1ad2a restore logic for array join (it's probably a hidden error) 2019-10-15 20:39:23 +03:00
Artem Zuikov
cf99f88bc4 PartialMergeJoin flush data on disk (#7186) 2019-10-15 19:31:49 +03:00
chertus
c727777a9c resolve some for review sentences 2019-10-15 18:49:00 +03:00
chertus
9667e54201 remove asterisk_left_columns_only setting 2019-10-15 17:42:57 +03:00
alesapin
3e068b81de Add loading of external dictionaries 2019-10-15 17:09:57 +03:00
Alexander Kuzmenkov
160d8a6416 Ignore non-convertible values at any depth on the right side of IN 
operator.

The values that are not convertible to the left argument type can't
match anyway, so it is safe to discard them.
 2019-10-14 14:25:03 +03:00
alesapin
ecde224692 More tests 2019-10-14 12:52:43 +03:00
alesapin
155731a676 Merge branch 'master' into dictionaries_ddl_interpreter 2019-10-14 11:49:18 +03:00
Nikolai Kochetov
757488369f Merge branch 'master' into processors-3 2019-10-12 19:24:02 +03:00
Nikolai Kochetov
51bce40d5e
Merge pull request #7284 from ClickHouse/fix-7216 
Fix for #7216
 2019-10-12 19:20:33 +03:00
Alexander Kuzmenkov
31bd359100
Merge pull request #7231 from ClickHouse/aku/podarray-includes 
Include PODArray.h into fewer files.
 2019-10-12 15:08:41 +03:00
Nikolai Kochetov
25510e3d38 Try to fix perftests. 2019-10-12 13:06:07 +03:00
Vasily Nemkov
8648ebf75c Initial implementation of DateTime64 parsing functions; 2019-10-12 10:03:38 +03:00
chertus
91c7ae83a3 asof join inequalities 2019-10-11 20:56:26 +03:00
Nikolai Kochetov
217eab0cfa Fix test. 2019-10-11 20:55:33 +03:00
Nikolai Kochetov
2684bd0d5e Fixes for 7216 2019-10-11 20:27:54 +03:00
alesapin
967fe64793 Add simpliest tests 2019-10-11 18:22:30 +03:00
Vitaly Baranov
8c24d5e66a
Merge pull request #7235 from vitlibar/RBAC-1 
RBAC-1
 2019-10-11 17:16:32 +03:00
alesapin
ae42dc0d4c Attach detach and introspection queries for dictionaries 2019-10-11 16:21:52 +03:00
Alexander Kuzmenkov
8a1d57bddb Include PODArray.h into fewer files. 2019-10-11 14:28:16 +03:00
alesapin
3dfe961291 Merge branch 'master' into dictionaries_ddl_interpreter 2019-10-11 12:14:07 +03:00
Vitaly Baranov
060257c8c5 Remove Authentication::setType() function and fix comments. 2019-10-11 00:48:36 +03:00
Nikolai Kochetov
e48755d045 Merge branch 'master' into processors-and-storages 2019-10-11 00:46:37 +03:00
Nikolai Kochetov
9a89ee8eab
Merge pull request #7264 from ClickHouse/disable-memory-tracker-for-stack-trace 
Disable memory tracker for exception stack.
 2019-10-11 00:45:36 +03:00
Vitaly Baranov
18ccb4d64d Move backQuote() and quoteString() to a separate file, use StringRefs. 2019-10-11 00:18:52 +03:00
Vitaly Baranov
9f6d9d6130 Move the code which checks client host to a separate class. 2019-10-11 00:18:52 +03:00
Vitaly Baranov
12d1d87d64 Move authentication code to a separate class. 2019-10-11 00:18:52 +03:00
alesapin
2a5713e6e4 Compilable code 2019-10-10 23:47:47 +03:00
Nikolai Kochetov
0ce86e1f8f Disable memory tracker for exception stack. 2019-10-10 21:55:16 +03:00
alexey-milovidov
9c1c596146
Merge pull request #7252 from ClickHouse/fix-bad-code-in-transform-query-for-external-database 
Fix bad code in transforming query for external database.
 2019-10-10 21:10:36 +03:00
alesapin
67fc3347c2 Preparing databases for dictionaries 2019-10-10 20:33:01 +03:00
Nikolai Kochetov
742b948156 Disable memory tracker for exception stack. 2019-10-10 19:30:33 +03:00
Alexander Kazakov
03c7b7ff8d
Prevent from using non-deterministic functions in mutations of replicated tables (#7247) 
* Added isDeterministic() to IFunctionBuilder i-face
* A test for non-deterministic mutations
* In MutationsInterpreter::validate() ensure deterministic functions
* Adjusted nondeterministic mutation tests
* Moved around some code in MutationsInterpreter::validate()
* Dropped unnecessary check in findFirstNonDeterministicFuncName()
* Corrections to IFunction{Base,Builder} interface
 2019-10-10 17:38:08 +03:00
Nikolai Kochetov
ef14df4632 Added more comments. 2019-10-10 17:16:15 +03:00
millb
350f0b8a1c Merge remote-tracking branch 'origin/url_engine_problem' into url_engine_problem 2019-10-10 16:47:17 +03:00
millb
a00089f0b4 Renamed StorageOfAllowedURL -> RemoteHostFilter 2019-10-10 15:58:06 +03:00
Mikhail Korotov
4710d2184c
Update Context.cpp 2019-10-10 01:24:27 +03:00
millb
a97739f67f Created class StorageOfAllowedURL 
Created test for table function remote and remoteSecure
Created check allowed url in remote and remoteSecure
Fixed tests
 2019-10-09 23:29:41 +03:00
Alexey Milovidov
b302fec362 Fixed bad code in transformQueryForExternalDatabase 2019-10-09 22:58:50 +03:00
Nikolai Kochetov
9c5ae5f536 Merge branch 'master' into processors-and-storages 2019-10-09 14:12:47 +03:00
alesapin
ef0b2f5936
Merge pull request #7209 from ClickHouse/dictionaries_ddl_parser 
Dictionaries ddl parser
 2019-10-09 12:51:08 +03:00
alexey-milovidov
5c2d478543
Merge pull request #7212 from ClickHouse/aku/field-includes 
Include Field.h and FieldVisitor.h into fewer files.
 2019-10-08 22:40:30 +03:00
alexey-milovidov
b9aa5d812d
Merge pull request #7171 from nikvas0/nikvas0/lazy_db 
Lazy Database
 2019-10-08 22:15:55 +03:00
Alexander Kuzmenkov
2b30f2696c Include Field.h in less files. 2019-10-08 16:23:24 +03:00
alesapin
cd05564b17 Add show create dictionary 2019-10-08 15:34:04 +03:00
Vasily Nemkov
8792738944 Prohibit implicit conversion of UInt64-Field to DateTime64 2019-10-08 10:01:17 +03:00
alexey-milovidov
bcc4e3f0ba
Merge branch 'master' into issue-6615 2019-10-07 22:12:25 +03:00
Alexander Kuzmenkov
56b065881a Include FieldVisitors.h in less files. 2019-10-07 20:23:05 +03:00
Alexander Tokmakov
b4d9dc2a90 query parameters in evaluateConstantExpression 2019-10-07 18:46:50 +03:00
alexey-milovidov
d096119529
Merge pull request #7156 from ClickHouse/fix-header-for-now 
Fix header for function 'now'
 2019-10-05 22:35:23 +03:00
alexey-milovidov
ce12fb6b3c
Update ExpressionAnalyzer.cpp 2019-10-05 22:34:57 +03:00
alexey-milovidov
40b22061f0
Update InterpreterSelectQuery.cpp 2019-10-05 22:34:25 +03:00
proller
594c535bd4 Build fixes (#7063) 
* Build fixes

*            fix

* Fix

* fix

* Fix install(export..

* Freebsd fixes

* Freebsd fixes

* Fix warning

* fix

* More PRIVATE linking

* Fix review

* Timmy

* fix

* fix
 2019-10-05 22:25:31 +03:00
Nikolai Kochetov
95ec0f7c2d Merged with master. 2019-10-04 20:53:21 +03:00
Nikolai Kochetov
23069ca6d0 Progress for MergeTreeSelectProcessor. 2019-10-04 20:50:07 +03:00
Nikolai Kochetov
627d48c19a Added ExecutionSpeedLimits. 2019-10-04 20:49:57 +03:00
alexey-milovidov
9c2f3ba41a
Merge pull request #6984 from achimbab/pr_bf 
Made bloom_filter type of index supporting arrays
 2019-10-04 18:08:42 +03:00
Vasily Nemkov
1069812d88 Fixed converting DateTime64-Field on client into DataTypeDateTime64-field type. 
Since DateTime64 is just a typedef, and there is no explicit Field-type
for it, we have to solely rely on type_hint provided by origin column.
If the hint is missing, there is no way of distinguishing DateTime64
from Decimal64.

Alternative could be having explicit converting code, (and it looks like
it has to be added at some point).
 2019-10-04 17:04:17 +03:00
tavplubix
d73db7f779
Merge pull request #6781 from ClickHouse/merging_values_with_expressions 
Merging Values with expressions
 2019-10-04 12:51:22 +03:00
alesapin
cf094cd62b
Merge pull request #7155 from ClickHouse/dictionaries_ddl 
Preparation of ExternalLoader for Dictionaries DDL
 2019-10-03 20:12:19 +03:00
Nikolai Kochetov
76d1412953 Fix actions for distributed. 2019-10-03 18:47:42 +03:00
Nikolai Kochetov
e5c1df010f Remove allow_different_constant_values from InterpreterSelectQuery. 2019-10-03 15:02:30 +03:00
Nikolai Kochetov
3142955e6c InterpreterSelectQuery: reuse actions from getSampleBlock in readImpl. 2019-10-03 14:58:52 +03:00
Alexander Kuzmenkov
8e245d4e8c
Merge pull request #7135 from ClickHouse/aku/msan-field 
Fix some MemorySanitizer warnings for Fields.
 2019-10-03 10:33:44 +03:00
Alexander Tokmakov
a58996817f allow query parameters in Values 2019-10-02 22:54:40 +03:00
Alexander Tokmakov
565c273eaa Merge branch 'master' into merging_values_with_expressions 2019-10-02 20:51:44 +03:00
Alexander Kuzmenkov
4af8e76bdd Use proper types for Field. 
When a Field is inserted into a column, its type should be the same as
the column data type to avoid implicit reinterpret_cast. Change a
couple of usages where these types were different.
 2019-10-02 16:48:26 +03:00
chertus
3b0d870804 rename function 2019-10-02 15:06:34 +03:00
Vasily Nemkov
31d5730513 Merge remote-tracking branch 'upstream/master' into DateTime64 2019-10-02 13:54:59 +03:00
Vasily Nemkov
6e813002d5 Proper serialization of DateTime64 also updated functions support. 2019-10-02 08:53:38 +03:00
chertus
c46cc3ff1a refactoring: remove copy-paste 2019-10-01 21:51:33 +03:00
Artem Zuikov
48ab9afce6
Merge pull request #7122 from 4ertus2/mjoin 
Squash left-hand blocks in partial merge join (optimization)
 2019-10-01 17:23:10 +03:00
chertus
038428bccf do not affect other SquashingBlockInputStream instances 2019-10-01 16:01:08 +03:00
Vasilyev Nikita
5793a02ef9 impr Lazy database 2019-10-01 15:44:17 +03:00
Nikolai Kochetov
9e74b8a6fe Disable check for constants in Converting stream while converting to header. 2019-10-01 13:58:39 +03:00
alesapin
8429f46f3c Return getUpdateTime method to interface 2019-10-01 11:58:47 +03:00
alesapin
709783a1bc Add missed header 2019-09-30 22:42:31 +03:00
alesapin
0e6331e892 Add comments 2019-09-30 19:54:50 +03:00
alesapin
08681ac210 Preparation for AST configurations for external dictionaries 2019-09-30 19:12:08 +03:00
chertus
5df8f870c4 try remove some PVS errors 2019-09-30 18:45:53 +03:00
millb
9246f258e8 Created ability to configure allowed URL in config.xml without tests. 2019-09-30 18:29:05 +03:00
Alexander Tokmakov
979f235e38 Merge branch 'master' into merging_values_with_expressions 2019-09-30 18:06:58 +03:00
chertus
5212d43ae4 simplify pmj settings 2019-09-30 17:36:45 +03:00
Alexander Kuzmenkov
ec2d9a083c Remove excessive includes. 2019-09-30 15:31:14 +03:00
alesapin
bc6caba4db Remove redundant argument 2019-09-30 14:18:01 +03:00
alexey-milovidov
24b3145144
Update evaluateConstantExpression.cpp 2019-09-29 01:12:29 +03:00
alexey-milovidov
102b5a7dd4
Merge pull request #7111 from ClickHouse/dictionaries_ddl 
Small dictionaries refactoring
 2019-09-27 22:05:14 +03:00
root
f54f55bbdc Add const. 2019-09-28 00:38:13 +08:00
root
bc13482eea Add globalIn. 2019-09-27 22:24:48 +08:00
alesapin
9ee031413c Remove a lot of unused code 2019-09-27 15:36:54 +03:00
chertus
baaf0a7c5b partial_merge_join_optimisations -> partial_merge_join_optimizations 2019-09-27 15:25:02 +03:00
root
0189945ad8 Optimize empty IN subquery and empty INNER/RIGHT JOIN. 2019-09-27 19:06:20 +08:00
alesapin
506dbd49cb Add missed row 2019-09-27 12:02:06 +03:00
chertus
10eaef1adc squash left-hand blocks in pmj (phase 2) 2019-09-26 21:51:17 +03:00
alesapin
bba3a96ff4 Remove redundant argument 2019-09-26 20:24:55 +03:00
alesapin
0e28dc4e51 Remove redundant classes 2019-09-26 19:12:15 +03:00
Vasily Nemkov
9cc2baf05c DataType64 as decimal 
compiles
 2019-09-26 18:12:40 +03:00
alesapin
089e3146c9 Add missed files 2019-09-26 14:19:10 +03:00
alesapin
4fdb5a61e5 Rename ExternalDictionaries to ExternalDictionariesLoader 2019-09-26 13:41:33 +03:00
alesapin
5668f55ab7 Rename ExternalModels to ExternalModelsLoader 2019-09-26 13:23:14 +03:00
alesapin
903f826640 Remove runtime factory and remove one redundant object 2019-09-26 13:08:38 +03:00
chertus
dd08f06c81 squash left-hand blocks in partial merge join 2019-09-25 22:17:32 +03:00
alexey-milovidov
64e889d872
Merge pull request #7070 from 4ertus2/mjoin 
PartialMergeJoin optimisation (skip not intersected blocks)
 2019-09-25 02:24:42 +03:00
chertus
0467229eff fix all left partial merge join on block borders 2019-09-24 21:21:57 +03:00
Alexander Kuzmenkov
f3bde19b74 Do not use iterators in find() and emplace() methods of hash tables. 
Instead, these methods return a pointer to the required data as they are
stored inside the hash table. The caller uses overloaded functions to
get the key and "mapped" values from this pointer. Such an interface
avoids the need for constructing iterator-like wrapper objects, which is
especially important for compound hash tables such as the future
StringHashMap.
 2019-09-24 17:44:35 +03:00
chertus
80d902a401 fix case with duplicated right keys 2019-09-24 16:45:59 +03:00
Alexey Milovidov
7384e04430 Revert "CHYT-142: extend KeyCondition interface so that it returns BoolMask." 
This reverts commit 2cacc3cfd2.
 2019-09-24 04:29:26 +03:00
alexey-milovidov
2f195ddb03
Merge pull request #7028 from abyss7/issue-6459 
Implement cross-compilation support Linux → Darwin
 2019-09-24 02:20:17 +03:00
chertus
1f9b8418e0 pmj skip not intersected optimisation 2019-09-23 22:36:47 +03:00
Alexey Milovidov
11e7ea51e9 Fixed compatibility for distributed queries between 19.14 and earlier versions #7068 2019-09-23 22:22:28 +03:00
Alexey Milovidov
8579c26efb Changed repository URL 2019-09-23 19:18:19 +03:00
chertus
016f3b0a45 fix partial merge join with totals 2019-09-23 17:37:42 +03:00
Ivan Lezhankin
4b143c3e0f Merge remote-tracking branch 'upstream/master' into issue-6459 2019-09-23 16:07:19 +03:00
philip.han
613927c36c Removed useless code and improve type checking for bloom_filter index 2019-09-23 12:40:48 +09:00
alexey-milovidov
816ac1ca8d
Merge pull request #7037 from silviucpp/silviu-fix-osx 
Fix osx build
 2019-09-22 04:53:36 +03:00
Silviu Caragea
1fbd2fb6a8 Fix osx build 2019-09-21 21:30:01 +03:00
alexey-milovidov
f8d19f6bf3
Merge pull request #6968 from azat-archive/create_as_skip_indices 
[RFC] Introduce create_as_skip_indices
 2019-09-20 23:53:49 +03:00
alexey-milovidov
1dc58dcb15
Update InterpreterCreateQuery.cpp 2019-09-20 23:53:14 +03:00
alexey-milovidov
2432a68009
Merge pull request #7022 from 4ertus2/bugs 
Fix "Unknown identifier" in ORDER BY and GROUP BY with Multiple Joins
 2019-09-20 23:45:51 +03:00
alexey-milovidov
3f500aad4b
Merge pull request #6976 from sfod/issue-3571 
Throw exceptions if WITH TOTALS/ROLLUP/CUBE are specified without agg…
 2019-09-20 23:39:00 +03:00
Alexander Tokmakov
0080639f79 Merge branch 'master' into merging_values_with_expressions 2019-09-20 23:26:01 +03:00
Alexander Tokmakov
d353746f2b minor fixes 2019-09-20 22:44:52 +03:00
Ivan Lezhankin
9e46118edd Merge remote-tracking branch 'upstream/master' into issue-6459 2019-09-20 21:25:55 +03:00
Ivan Lezhankin
8cb0e58bc7 Fix build for all targets 2019-09-20 21:13:51 +03:00
alexey-milovidov
123b8cb43c
Merge pull request #6990 from Akazz/timeout_for_sync_replica_cmd 
Fixed timeout mechanism for SYNC REPLICA command + simplified related code
 2019-09-20 20:32:51 +03:00
alexey-milovidov
aabd6906f2
Merge pull request #6982 from 4ertus2/mjoin 
PartialMergeJoin bugfixes
 2019-09-20 20:19:00 +03:00
chertus
7726130303 fix multiple joins aliasing for order by and group by 2019-09-20 19:01:19 +03:00
Alexander Kazakov
2d807368e1 Adjusted timings in test + more verbose diagnostics 2019-09-20 00:20:58 +03:00
Azat Khuzhin
b2a3db1048
Ignore indices for CREATE TABLE .. AS .. if storage do not support them 2019-09-19 23:55:38 +03:00
chertus
0bc345fdc0 MergeJoin compare nullables 2019-09-19 20:09:59 +03:00
chertus
da14951ecd implement MergeJoin.joinTotals() 2019-09-19 17:53:03 +03:00
Akazz
4ae3db45c6 Fixed timeout reading in SYNC REPLICA 2019-09-19 14:04:57 +03:00
alexey-milovidov
1fe79ad43c
Merge pull request #6941 from dimarub2000/enums_in_section 
IN with Enums numeric values
 2019-09-19 02:24:34 +03:00
alexey-milovidov
9c675e50bb
Merge pull request #6963 from nicelulu/issue_6616 
optimize limit 1,0 and test.
 2019-09-19 02:23:56 +03:00
chertus
b8b6197288 partial_merge_join settings affects LEFT and INNER JOINs only 2019-09-18 22:12:53 +03:00
chertus
08a28d2dc2 fix pm join bug (wrong right equal range copy) 2019-09-18 21:44:44 +03:00
chertus
194e49e751 fix UB in MergeJoinCursor 2019-09-18 19:46:00 +03:00
Artem Zuikov
aae82eed5a
Merge pull request #6940 from 4ertus2/mjoin 
PartialMergeJoin
 2019-09-18 16:16:10 +03:00
sfod
0bad4b4a05 Throw exceptions if WITH TOTALS/ROLLUP/CUBE are specified without aggregate functions 2019-09-18 16:08:51 +03:00
chertus
dd46c08e90 move JoinCommon funcs out of IJoin.h/cpp 2019-09-18 15:46:57 +03:00
chertus
0cf5bfdf44 fix typo 2019-09-18 15:24:35 +03:00
alexey-milovidov
fe9e110a6a
Merge pull request #6965 from azat-archive/sparsehash-c11 
Replace libsparsehash with sparsehash-c11
 2019-09-18 12:46:13 +03:00
philip.han
b25151b61b Make bloom_filter-index support some types of Arrays. 2019-09-18 18:32:44 +09:00
alexey-milovidov
03014fe920
Merge pull request #6944 from malkfilipp/add-limit-clause-to-show-queries 
Add LIMIT clause to SHOW queries
 2019-09-18 02:07:45 +03:00
Azat Khuzhin
780341060f
Replace libsparsehash with sparsehash-c11 
- use sparsehash-c11 over libsparsehash
- fix typos in find_sparsehash and users of the vars (s/SPARCE/SPARSE/)
- drop libsparsehash-dev from docker images (but keep for unbunlded build)
- use ::google over GOOGLE_NAMESPACE
 2019-09-18 00:08:20 +03:00
root
f4b7cae998 optimize limit 1,0 and test. 2019-09-18 02:55:59 +08:00
chertus
2b3a4b0650 support const and LC columns in partial merge-join 2019-09-17 21:53:52 +03:00
chertus
58fad78980 support MergeJoin nullable convertion (right side) 2019-09-17 19:55:11 +03:00
Dmitry Rubashkin
2252ee5a90 Branch refactoring. 2019-09-17 11:17:46 +03:00
chertus
da5d35b34e partial merge join (minimal tested version) 2019-09-16 22:31:22 +03:00
Dmitry Rubashkin
6f68cfc45c Removed (most probably) redundant if branch. Fixed VALUES table funtion. 2019-09-16 18:44:12 +03:00
chertus
cbd96af079 fix use after free (change Join <-> AnalyzedJoin ownership) 2019-09-16 15:37:46 +03:00
Vitaly Baranov
fae612c3e7
Merge pull request #6907 from PerformanceVision/dict_allow_databases 
Whitelist for dictionary from the current connected database
 2019-09-16 11:52:25 +03:00
malkfilipp
98050c108f Add LIMIT clause to SHOW queries 2019-09-15 19:07:27 +03:00
Ivan Lezhankin
01fdb802d4 Useful changes 2019-09-15 13:35:12 +03:00
alexey-milovidov
831eebe4dc
Merge pull request #6934 from abyss7/CLICKHOUSE-4643 
Name temporary external table with existing subquery alias
 2019-09-15 09:46:10 +03:00
Vitaly Baranov
a2c9bec468
Fix typo 2019-09-15 01:56:37 +03:00
Vitaly Baranov
c17071caf0
Fix typo 2019-09-15 01:55:22 +03:00
Vitaly Baranov
0fb234c63e
Merge branch 'master' into dict_allow_databases 2019-09-15 01:51:44 +03:00
Dmitry Rubashkin
33e7e1ea93 Int64 added. 2019-09-13 21:25:53 +03:00
Dmitry Rubashkin
2705534be7 Merge branch 'enums_in_section' of github.com:dimarub2000/ClickHouse into enums_in_section 2019-09-13 20:50:53 +03:00
Dmitry Rubashkin
cd95e8e5e5 Fix inconsistent behaviour of IN with Enums 2019-09-13 20:49:53 +03:00
chertus
eb3d87032c all|any left|inner, not tested 2019-09-13 20:23:32 +03:00
chertus
bd957168d2 any left join (without use_nulls) 2019-09-13 19:17:37 +03:00
Ivan Lezhankin
dc49303baf Use existing alias as external table name 2019-09-13 16:25:24 +03:00
alesapin
02cff38fef Merge with master 2019-09-13 13:58:23 +03:00
Nikolai Kochetov
86bee0b8b5
Merge pull request #6684 from yandex/processors-2 
Processors 2
 2019-09-13 11:58:04 +03:00
Guillaume Tassery
214d089bb5 Cosmetic and remove documentation 2019-09-13 10:26:04 +02:00
Guillaume Tassery
bb088fbf65 Write dictionary permission on user instead of dictionary configuration 2019-09-13 10:22:34 +02:00
alexey-milovidov
12c26e6013
Merge pull request #6891 from yandex/low_cardinality_in_native_http 
Low cardinality in native http
 2019-09-13 09:01:08 +03:00
chertus
bb5287841f make things wrong 2 2019-09-12 21:06:25 +03:00
chertus
f7f2cface9 better nullability flags for JOINs 2019-09-12 17:09:05 +03:00
Nikolai Kochetov
1319168a3a Merge branch 'master' into processors-2 2019-09-12 16:28:51 +03:00
Nikolai Kochetov
9dea55c284 Do not pin sources for non MergeTree tables. 2019-09-12 16:23:24 +03:00
chertus
441faba0e3 materializeBlockInplace function 2019-09-12 15:59:53 +03:00
chertus
61c940d5a9 better materialization logic in Join.cpp 2019-09-12 15:24:19 +03:00
chertus
fc7ce2753d extract more common join functions 2019-09-11 21:03:21 +03:00
alesapin
b0fce77c3d Fix path to data on disk 2019-09-11 20:17:10 +03:00
chertus
a836f0cfd6 fix columns number in MergeJoin 2019-09-11 19:19:33 +03:00
chertus
73dafaa223 better required-right-keys logic 2019-09-11 18:57:09 +03:00
Nikolai Kochetov
a2248868d8 Fix ast type checking. 2019-09-11 18:37:12 +03:00
Nikolai Kochetov
a59ae3826d Do not flush output stream in copy data. Add special flushing callback to Watch query. 2019-09-11 14:38:05 +03:00
Nikolai Kochetov
96f7eb1141 Change number of aggregating streams. 2019-09-11 13:07:04 +03:00
Amos Bird
8f28a36c17 Use internal iteration over hash tables in Aggregator. 
For compound hash tables such as the future StringHashMap, an
iterator-based API might be inefficient for iterating over a table or
for merging two tables, because:

1) the key has to be converted to a general format from a from a
   component-specific format, which may differ between the components;

2) the information about the component of the compound hash table to
   which the value belongs is lost, and has to be recalculated if the
   value is reinserted.

A more efficient approach is to use internal iteration, that is,
map-like functions, which avoids unnecessary conversions when iterating,
and allows to use an efficient component-wise approach when merging.
 2019-09-10 21:52:53 +03:00
chertus
8afa48fa42 some joins code unification 2019-09-10 21:39:10 +03:00
Alexander Kuzmenkov
160e0faf77 Do not use iterator::getValue() in Aggregator. 
Use separate key and "mapped" value references instead. This is
important for hash tables that do not store the key/"mapped" pair
directly, and cannot provide this interface without some runtime
overhead.
 2019-09-10 20:12:30 +03:00
Nikolai Kochetov
e9e0bd82b9 Change number of aggregating streams. 2019-09-10 20:08:06 +03:00
Nikolai Kochetov
8dd8ab7d1f Use header in native format created in InterpreterSelectQuery. Fill missed columns in Native format. 2019-09-10 19:31:41 +03:00
chertus
02691f50ef make things wrong 2019-09-10 17:51:28 +03:00
chertus
1b313eedfa MergeJoin in progress 2019-09-09 22:43:37 +03:00
Nikolai Kochetov
c9cca3ba8b Merged with master 2019-09-09 16:20:30 +03:00
Vasily Nemkov
1b0410cee7 Merge commit '50928323ebabe0663e26601c3929ee94b9a5127d' into DateTime64 2019-09-09 16:18:22 +03:00
alesapin
27419c965e Merge with master 2019-09-09 14:13:36 +03:00
alexey-milovidov
8389200229
Merge pull request #6832 from CurtizJ/merging_input_function 
Merging #5450 (table function input).
 2019-09-07 20:16:45 +03:00
alexey-milovidov
25de2e12a2
Merge pull request #6399 from Enmk/replica_recovery_interval 
Improvements for failover of Distributed queries
 2019-09-07 03:21:30 +03:00
filimonov
526afd44ed Make SensitiveDataMasker a singleton. (#6810) 
Among other things, it is used to filter logs, which are being written even after the global server context is deinitialized, so we can't keep masker there.
 2019-09-06 20:48:27 +03:00
alexey-milovidov
c90dfc1e48
Merge pull request #6837 from filimonov/fix_some_pvs_reported_issues 
Fix some pvs reported issues
 2019-09-06 20:15:14 +03:00
Anton Popov
69da4f30b3
Merge branch 'master' into merging_input_function 2019-09-06 16:20:00 +03:00
filimonov
f505549b43
changed wrong pvs suppression code 2019-09-06 14:46:42 +02:00
Nikolai Kochetov
52305cefbc Merge branch 'merging-aggregated-processors' into processors-2 2019-09-06 15:21:17 +03:00
Nikolai Kochetov
d10b7d7a2b Added ConvertingAggregatedToChunksTransform. 2019-09-06 15:19:59 +03:00
alesapin
ea8e543b1a Add protocol version to cookies 2019-09-06 15:18:56 +03:00
alesapin
0c9a9dee1c Merge with master 2019-09-06 11:53:32 +03:00
alexey-milovidov
3d8ec8fb33
Merge pull request #6823 from yandex/fancyqlx-master 
Merge #6167
 2019-09-06 03:18:26 +03:00
alexey-milovidov
05a1a7ac71
Update InterpreterSelectQuery.cpp 2019-09-06 03:18:06 +03:00
alexey-milovidov
18dcb3753d
Merge pull request #6824 from 4ertus2/mjoin 
Refactoring (ExpressionAnalyzer & SubqueryForSet)
 2019-09-06 03:17:16 +03:00
Olga Khvostikova
f90642ce23
Merge pull request #6610 from CurtizJ/merging_with_ties_and_with_fill 
WITH TIES modifier for LIMIT and WITH FILL modifier for ORDER BY. (continuation of #5069)
 2019-09-05 22:45:48 +03:00
Mikhail Filimonov
b40204a360 PVS https://clickhouse-test-reports.s3.yandex.net/0/2cda8f1563e9b2d11f75c68db817c3f68ace1160/pvs_studio_report/pvs-studio-html-report/sources/InterpreterSelectQuery.cpp_24.html#ln430 2019-09-05 19:23:36 +02:00
Mikhail Filimonov
622ea38b21 PVS false positive https://clickhouse-test-reports.s3.yandex.net/0/2cda8f1563e9b2d11f75c68db817c3f68ace1160/pvs_studio_report/pvs-studio-html-report/sources/Context.cpp_21.html#ln1226 2019-09-05 18:59:15 +02:00
Mikhail Filimonov
cfb0431994 PVS https://clickhouse-test-reports.s3.yandex.net/0/2cda8f1563e9b2d11f75c68db817c3f68ace1160/pvs_studio_report/pvs-studio-html-report/sources/executeQuery.cpp_26.html#ln33 2019-09-05 18:57:13 +02:00
Vasily Nemkov
c2fc71b5e5 Post-PR fixes 
Renamed settings, updated docs.
 2019-09-05 13:35:36 +03:00
chertus
a395be3e91 minor changes 2019-09-04 19:37:05 +03:00
chertus
b854c945ad some more ExpressionAnalyzer refactoring 2019-09-04 19:20:02 +03:00
Nikolai Kochetov
3bd453985b Merge branch 'master' of https://github.com/fancyqlx/ClickHouse into fancyqlx-master 2019-09-04 18:48:12 +03:00
alesapin
3ffa9fa972 Resolve conflict 2019-09-04 15:44:12 +03:00
alesapin
8b6abab486 Merge branch 'master' into ObjatieGroba-feature_multiple_disks 2019-09-04 15:41:27 +03:00
CurtizJ
7accc09066 Merge branch 'palasonic-add-input-function' of https://github.com/palasonic1/ClickHouse into merging_input_function 2019-09-04 15:25:20 +03:00
chertus
904cfed046 better includes 2019-09-04 13:15:34 +03:00
Alexey Milovidov
6176041935 Fixed style 2019-09-04 02:08:46 +03:00
alexey-milovidov
b2e80b0cd9
Merge branch 'master' into query_masking 2019-09-03 22:58:15 +03:00
alexey-milovidov
1ae8150f28
Update Context.cpp 2019-09-03 22:53:59 +03:00
Artem Zuikov
0a998fddce
Merge pull request #6801 from 4ertus2/mjoin 
Refactoring: wrap Join logic via AnalyzedJoin iface
 2019-09-03 19:53:49 +03:00
alesapin
52442cf549 Add system stop moves query 2019-09-03 17:50:49 +03:00
chertus
bb3dedf1dc move Join object from ExpressionAction into AnalyzedJoin 2019-09-03 17:36:02 +03:00
alexey-milovidov
87e061d0e1
Merge pull request #6733 from 4ertus2/some 
Add subquery_requires_alias setting (disabled by default)
 2019-09-03 14:34:28 +03:00
alexey-milovidov
ab75e8c26d
Merge pull request #6205 from zhang2014/fix/some_mutation 
fix some mutation bug
 2019-09-03 14:33:20 +03:00
alesapin
8d76febe02 Add moves to part log 2019-09-03 14:32:25 +03:00
alexey-milovidov
7847de1947
Merge pull request #6629 from CurtizJ/read-in-order-2 
Implement 'read in order' optimization with processors.
 2019-09-03 14:21:19 +03:00
CurtizJ
22badef1a2 Merge remote-tracking branch 'upstream/master' into merging_with_ties_and_with_fill 2019-09-03 13:47:18 +03:00
Nikolai Kochetov
e55647eee9 Force add resize befor aggregating transform. 2019-09-03 13:14:13 +03:00
CurtizJ
6d821c4877 fix build 2019-09-03 13:07:31 +03:00
alesapin
e7308c1f21 Merge branch 'master' into ObjatieGroba-feature_multiple_disks 2019-09-03 11:02:32 +03:00
zhang2014
9c50c7c718 fix crash when touches all rows alter 2019-09-03 13:48:02 +08:00
CurtizJ
973b533377 Merge remote-tracking branch 'upstream/master' into read-in-order-2 2019-09-03 00:59:51 +03:00
chertus
fce1b47250 more JOIN refactoring: move logic out of ExpressionAnalyzer/ExpressionAction 2019-09-02 22:58:45 +03:00
Nikolai Kochetov
464595a548 Add allow_processors flag to executeQuery. 2019-09-02 18:19:01 +03:00
CurtizJ
de5e2b4d6b Merge remote-tracking branch 'upstream/master' into merging_with_ties_and_with_fill 2019-09-02 17:34:49 +03:00
CurtizJ
da11fb86b7 implement 'with fill' modifier with processors 2019-09-02 17:29:51 +03:00
Vasily Nemkov
f98c488834 Post-review fixes 
* Actually using the replica recovery settings for cluster
* A bit of doc on DBMS_CONNECTION_POOL_WITH_FAILOVER_MAX_ERROR_COUNT
* StorageDistributedDirectoryMonitor using settings for ConnectionPoolWithFailover
* Using SettingSeconds instead of SettingUInt64 for replica_error_decrease_period
 2019-09-02 17:26:25 +03:00
Nikolai Kochetov
bf0c0ed4f1 Merge branch 'master' into processors-2 2019-09-02 16:02:09 +03:00
chertus
bc95027cee better setting name: joined_subquery_requires_alias 2019-09-02 15:53:31 +03:00
chertus
2c0d569fa8 Merge branch 'master' into some 2019-09-02 15:32:24 +03:00
alesapin
e7ee9b7a67 Merge master 2019-09-02 11:46:00 +03:00
alexey-milovidov
2e86aece86
Merge pull request #6763 from yandex/add-os-thread-ids-in-system-tables 
Add "os_thread_ids" column to system tables
 2019-09-01 04:30:16 +03:00
alexey-milovidov
1dd28867b0
Merge pull request #6689 from yandex/merge_tree_settings_alter 
Refactoring of immutable settings
 2019-09-01 04:29:47 +03:00
Alexey Milovidov
cb79e2371e Add "os_thread_ids" column to system tables 2019-09-01 00:47:15 +03:00
alexey-milovidov
d8d2b623d2
Merge pull request #6759 from yandex/add-test-rwr-shard-deadlock 
Added a test for possible deadlock in distributed queries
 2019-08-31 18:51:48 +03:00
Alexey Milovidov
aac0b27daa Fixed possible deadlock in distributed queries 2019-08-31 15:18:14 +03:00
Alexey Milovidov
01035a9e78 Merge branch 'master' of github.com:yandex/ClickHouse into add-test-deadlock-rename-table 2019-08-31 13:46:24 +03:00
Alexey Milovidov
202673e3bd Avoid deadlock in multiple tables RENAME 2019-08-31 13:37:28 +03:00
Nikolai Kochetov
300dc80194 Update Aggregator interface. 2019-08-31 11:58:16 +03:00
Alexey Milovidov
2fd8f5c324 Removed code that I don't understand and that has no comments 2019-08-31 02:09:08 +03:00
alesapin
6f30338c08 Fixes 2019-08-30 21:31:35 +03:00
Nikolai Kochetov
18fff141d1 Update max_threads for processors. 2019-08-30 17:21:22 +03:00
alesapin
d7e54d3c14 Merge branch 'master' of github.com:yandex/ClickHouse into ObjatieGroba-feature_multiple_disks 2019-08-30 12:53:24 +03:00
Vitaly Baranov
da8f67123f Improve error handling in cache dictionaries: 
allow using expired values while the source of a cache dictionary doesn't respond;
clone the source after an error to reset connections;
don't ask the source for a little time after error;
show the last exception in system.dictionaries for a cache dictionary too.
 2019-08-30 12:50:38 +03:00
CurtizJ
048d3da9ab better types comparison and conversion in FillingBlockInputStream 2019-08-30 01:24:33 +03:00
chertus
3ad43daae3 Merge branch 'master' into some 2019-08-29 21:50:47 +03:00
chertus
d5cfbcf6e1 subquery_requires_alias setting (disabled by default) 2019-08-29 21:45:34 +03:00
CurtizJ
a6e43c4119 merging with master 2019-08-29 19:48:02 +03:00
alesapin
1813b96f82 Finally build, possible trash. 2019-08-29 19:17:47 +03:00
Ivan
5851316742
Don't interrupt copyData() used inside Kafka materialized views (#6597) 
* Print better offsets on commit
* Stop consumption on the read buffer level
* Don't use cancellation in the middle of copyData()
* Add test
* Disable squashing stream for Kafka materialized views
* Commit last read message, since rdkafka auto-modifies offset
 2019-08-29 18:36:07 +03:00
alesapin
dac55278ad Better comments 2019-08-29 14:15:56 +03:00
alesapin
67f9753775 Merge branch 'master' into bad_size_of_marks_skip_idx_bug 2019-08-29 11:07:56 +03:00
zhang2014
275c0d88b3 fix build failure 2019-08-29 12:54:09 +08:00
zhang2014
74c9eea657 fix test failure 2019-08-29 11:34:00 +08:00
zhang2014
3c7405bdb0 move test to integration & refer max_expanded_ast_elements 2019-08-29 11:31:22 +08:00
Ivan
b4339f266d
Make a better build scheme (#6500) 
* Fix shared build
* Major default libs refactor
* Fix build with gcc_eh
* Link all libraries as a big group.
* Use global interface library as a group
* Build capnproto using our cmake
* Use only internal libunwind
 2019-08-28 23:49:37 +03:00
Alexey Milovidov
48dce81e61 Minor modifications after #6413 2019-08-28 21:54:30 +03:00
alexey-milovidov
33311a9bf1
Merge branch 'master' into atomic_zookeeper2 2019-08-28 21:34:42 +03:00
alesapin
b4d98f6e13 Trying to fix vertical merge 2019-08-28 21:23:20 +03:00
alexey-milovidov
44dd3bd792
Merge pull request #6692 from yandex/remove-queue_max_wait_ms 
Set default value of "queue_max_wait_ms" to zero, because current value makes no sense
 2019-08-28 21:06:09 +03:00
alexey-milovidov
7b9b67fd71
Merge pull request #6695 from yandex/improve-table-locks 
Avoid possible deadlock in TRUNCATE of Replicated table.
 2019-08-28 21:05:26 +03:00
alexey-milovidov
6d2dca3242
Merge pull request #6705 from 4ertus2/bugs 
JOINs with not nullable types and join_use_nulls=1
 2019-08-28 21:05:16 +03:00
Nikolai Kochetov
d6e13cbb92 Update max_threads for processors. 2019-08-28 20:48:41 +03:00
Nikolai Kochetov
ca232cebfb Update max_threads for processors. 2019-08-28 20:30:48 +03:00
alexey-milovidov
e2b05f6f9c
Merge pull request #6700 from yandex/aku/shm-5417-formatting 
Formatting changes for StringHashMap PR #5417.
 2019-08-28 18:30:59 +03:00
Alexey Milovidov
b6a0dba2df Added a setting "connection_pool_max_wait_ms" 2019-08-28 18:27:26 +03:00
Alexey Milovidov
cced091881 Addition to prev. revision 2019-08-28 18:24:35 +03:00
Alexey Milovidov
d06e350312 Added setting "replace_running_query_max_wait_ms" 2019-08-28 18:20:22 +03:00
chertus
90d5410aaa join_use_nulls with not nullable types 2019-08-28 17:14:09 +03:00
Alexey Milovidov
8b973fd9f2 Merge branch 'improve-table-locks' of github.com:yandex/ClickHouse into improve-table-locks 2019-08-28 15:59:23 +03:00
Alexey Milovidov
625e128770 Merge branch 'master' into improve-table-locks 2019-08-28 15:41:30 +03:00
Alexander Kuzmenkov
0b5a7f5f4a Disable consecutive key optimization for UInt8/16 LowCardinality 
columns.

A follow-up to #6298, this is as well a part of StringHashMap PR #5417
by Amos Bird.
 2019-08-28 14:05:52 +03:00
Alexander Kuzmenkov
24a8755b82 Formatting changes for StringHashMap PR #5417. 2019-08-28 13:52:14 +03:00
Artem Zuikov
8fa4575a88
Merge pull request #6693 from 4ertus2/mjoin 
Minor refactoring
 2019-08-28 10:12:37 +03:00
Alexey Milovidov
c8798b2ffa Slightly improve table locks 2019-08-28 02:47:30 +03:00
Alexey Milovidov
e7cbd34a29 Improve table locks (incomplete) 2019-08-27 23:43:35 +03:00
Alexey Milovidov
285d66cee1 Improve table locks (incomplete) 2019-08-27 23:43:08 +03:00
chertus
5208a70203 one less place with changed nullability columns 2019-08-27 22:41:51 +03:00
Alexey Milovidov
25c53ccd9e Rename setting 2019-08-27 22:05:35 +03:00
Alexey Milovidov
b21fdff77e Merging #6678 2019-08-27 21:59:21 +03:00
Alexey Milovidov
5ca8f8d695 Merge branch 'master' of https://github.com/weiqxu/ClickHouse into weiqxu-master 2019-08-27 21:52:09 +03:00
Nikolai Kochetov
4cb52cebea Update max_threads for processors. 2019-08-27 21:37:28 +03:00
CurtizJ
50d870705c limit with ties for processors 2019-08-27 20:48:42 +03:00
CurtizJ
42633c801b Merge remote-tracking branch 'upstream/master' into merging_with_ties_and_with_fill 2019-08-27 17:11:57 +03:00
alesapin
106b9717cd Refactoring of immutable settings 2019-08-27 16:14:19 +03:00
Weiqing Xu
2fbcd607f3 check free space when use external sort/aggerator 2019-08-27 08:23:07 +08:00
alexey-milovidov
561b173ddc
Merge pull request #6675 from yandex/simplify-shared-ptr-helper 
Simplify shared_ptr_helper
 2019-08-27 00:36:52 +03:00
Alexey Milovidov
0eec226c9a Simplify shared_ptr_helper 2019-08-26 22:07:29 +03:00
alesapin
cf31187254 Resolve conflicts 2019-08-26 21:08:58 +03:00
CurtizJ
4a7459f3b3 cleanup and update comments 2019-08-26 18:25:18 +03:00
CurtizJ
c63eeb8933 add FinishSortingTransform, refactor MergeSortingTransform 2019-08-26 17:54:29 +03:00
alesapin
0d0ebf885f Remove two redundant arguments from alter 2019-08-26 17:50:34 +03:00
alesapin
dff0cc1e1c Remove COW and add MultiVersion 2019-08-26 17:24:29 +03:00
Alexey Milovidov
60d660e263 Merge branch 'master' into merge-constraints 2019-08-26 16:13:44 +03:00
alesapin
062034dfd8 Eventually merged with master 2019-08-26 13:07:32 +03:00
Alexey Milovidov
6e8b7b9c3b Fixed error 2019-08-26 05:53:42 +03:00
Alexey Milovidov
2a3e0eb1f1 Merge branch 'master' into merge-constraints 2019-08-26 04:30:31 +03:00
Alexey Milovidov
6d3250867c Fixed build of tests 2019-08-25 01:08:45 +03:00
Alexey Milovidov
17a1938f0f Addition to prev. revision 2019-08-25 01:04:36 +03:00
Alexey Milovidov
3fef8e92ad Merging CONSTRAINTS support 2019-08-25 00:20:20 +03:00
Alexey Milovidov
cdd6dca517 Remove Compiler 2019-08-24 00:10:26 +03:00
CurtizJ
dae5c650df 'read in order' optimization for processor 2019-08-23 14:39:22 +03:00
CurtizJ
1e1d4eb7c1 temporarily make a dummy for 'with fill' with processors 2019-08-23 14:20:53 +03:00
Alexey Milovidov
4366791b63 Merge branch 'table-constraints' of https://github.com/NanoBjorn/ClickHouse into NanoBjorn-table-constraints 2019-08-23 07:49:10 +03:00
alexey-milovidov
7012a421c6
Merge branch 'master' into alter_table_drop_detached_part 2019-08-23 05:22:07 +03:00
alexey-milovidov
66ff7cd43e
Merge pull request #6619 from yandex/live-view-code-quality 
Basic code quality of LiveView
 2019-08-23 04:27:12 +03:00
alexey-milovidov
5c99780b08
Merge pull request #6606 from yandex/processors-2 
Enable processors by default.
 2019-08-23 02:50:11 +03:00
CurtizJ
659d3857ab fix build for clang 2019-08-23 02:48:20 +03:00
Alexey Milovidov
78c3be175c Added experimental setting for LIVE VIEWs 2019-08-23 02:46:40 +03:00
Alexey Milovidov
c4712f1e6e Make the code less bad 2019-08-23 02:22:57 +03:00
CurtizJ
5c2309132d Merge remote-tracking branch 'upstream/master' into merging_with_ties_and_with_fill 2019-08-23 02:18:45 +03:00
CurtizJ
e069fc495d fix limit with ties 2019-08-23 02:16:00 +03:00
Alexander Tokmakov
81022bb3e9 Merge branch 'master' into alter_table_drop_detached_part 2019-08-22 23:38:58 +03:00
CurtizJ
9a29c218ff improvents and fixes of modifier 'with fill' for 'order by' clause 2019-08-22 17:08:14 +03:00
alexey-milovidov
2ff8f3a5de
Merge pull request #6599 from CurtizJ/fix-order-by-optimization 
Disable "read in order" optimization for aggregation without keys.
 2019-08-22 05:10:14 +03:00
CurtizJ
d573c4ec3e fix wrong check for disabling "read in order" optimization 2019-08-21 20:42:44 +03:00
Nikolai Kochetov
6d81087bdc Remove _dummy column if it is not needed. 2019-08-21 19:53:40 +03:00
CurtizJ
9fdb9e5805 implement modifier 'with fill' for 'order by' clause 2019-08-21 15:59:03 +03:00
alesapin
eb5e052855 merge and fixes 2019-08-21 13:09:29 +03:00
alesapin
70ca7f4156 Merge with master 2019-08-21 11:57:35 +03:00
Alexey Milovidov
3c3ca97218 Addition to prev. revision 2019-08-21 08:47:09 +03:00
alexey-milovidov
308baa182e
Merge branch 'master' into table-constraints 2019-08-21 06:33:08 +03:00
Alexey Milovidov
8966520801 Added "assert_cast" function as a replacement for static_cast for columns 2019-08-21 05:28:04 +03:00
alexey-milovidov
3f607b21fe
Merge pull request #6375 from yandex/try-to-remove-dry-run 
Try to remove dry run
 2019-08-21 03:52:41 +03:00
Alexey Milovidov
c8859febcb Merge branch 'master' into added-test-for-race-conditions 2019-08-20 21:05:25 +03:00
Gleb Novikov
86fecc7501 Merge branch 'master' into table-constraints 2019-08-20 12:17:56 +03:00
Nikolai Kochetov
cdf1ce3171 Merge branch 'master' into vzakaznikov-liveview 2019-08-20 10:41:31 +03:00