Commit Graph

1690 Commits

Author SHA1 Message Date
Alexey Milovidov
b2057159c1 Experiment on parsing backslash escapes in a more convenient way #10922 2020-05-26 17:24:20 +03:00
alesapin
9d0c28d96c Add missing methods 2020-05-26 17:14:08 +03:00
Maxim Akhmedov
e09bcb4290 Make possible adding nested storages to MultipleAccessStorage in run-time. 2020-05-26 17:05:06 +03:00
alesapin
8614487a5a Fix primary key check 2020-05-26 16:46:19 +03:00
Vasily Nemkov
28a2cc0a82 Functions {to,from}UnixTimestamp64{Milli,Micro,Nano}
* Family of functions to convert DateTime64 to Int64 and back, usefull for
   imporintg/exporting raw timestamp values of certain precision.
 * Docs
 * Tests
 * Fixed ya.make
2020-05-26 16:42:22 +03:00
Nikolai Kochetov
12384551da Fix totals and extremes header for views. 2020-05-26 16:19:24 +03:00
Nikolai Kochetov
e9d348ebf9
Merge pull request #11198 from ClickHouse/fix-step-by-step-pipeline-execution
Fix PipelineExecutor::executeStepImpl
2020-05-26 15:27:56 +03:00
alesapin
6626ef08e8 Fix PVS studio errors 2020-05-26 15:14:50 +03:00
Vitaly Baranov
2c8a355f19
Merge pull request #11081 from vitlibar/fix-no-password-mode
Fix settings NO_PASSWORD authentication mode in users.xml.
2020-05-26 14:20:34 +03:00
Vitaly Baranov
e27ded8798
Merge pull request #11172 from vitlibar/grpc-improve-build-scripts
Improve build scripts for protobuf & gRPC
2020-05-26 13:27:54 +03:00
Nikolai Kochetov
709f705886 Fix PipelineExecutor::executeStepImpl 2020-05-26 13:26:38 +03:00
Nikolai Kochetov
54f50745ec Fix StrictResizeProcessor. 2020-05-26 13:19:56 +03:00
alesapin
5780240e88 Fix primry key check 2020-05-26 12:46:04 +03:00
alesapin
7bbb064b34 Fix metadata update 2020-05-26 11:58:32 +03:00
Nikolai Kochetov
1f9e4996c7 Fix PipelineExecutor::executeStepImpl 2020-05-26 10:51:53 +03:00
Ilya Yatsishin
2b155ac989
Merge pull request #11185 from ClickHouse/fix-lambda-lc-args
Fix lambda lc args
2020-05-26 10:27:35 +03:00
Alexander Kuzmenkov
4b1bb43543
Merge pull request #11076 from ClickHouse/aku/join-error-messages
Better error messages about joins
2020-05-26 09:09:59 +03:00
Alexander Kuzmenkov
9d25ae22b5 Merge remote-tracking branch 'origin/master' into HEAD 2020-05-26 09:07:01 +03:00
Alexander Kuzmenkov
bf941755f2 fixup 2020-05-26 09:00:51 +03:00
Alexander Kuzmenkov
7142e68d7a fixup 2020-05-26 08:54:04 +03:00
Alexey Milovidov
c858f4d89c Clarifications 2020-05-26 02:47:21 +03:00
alexey-milovidov
d4acd1af3a
Merge pull request #11179 from excitoon-favorites/s3globfix
Fixed S3 globbing which could fail in case of more than 1000 keys and some backends
2020-05-26 02:45:42 +03:00
Alexey Milovidov
55a02c391d Style 2020-05-26 01:06:02 +03:00
Alexey Milovidov
4bb3381bc9 Fix build after merge 2020-05-26 00:53:29 +03:00
Nikita Mikhaylov
507d98b24b
Merge pull request #11006 from nikitamikhaylov/MorozovVasily-UpdatePermutation
Merging IColumn::updatePermutation
2020-05-26 01:42:41 +04:00
filimonov
73a0ef6c0e
Fix for the hang during deletion of engine=Kafka (one more time) (#11145)
* Added flag for safer rdkafka destruction, but more testing detected another hang case, which has no straigt solutions and can be workarounded currenly only by draining the consumer queue, so destructor is back

* After review fixes

* After review fixes2

* After review fixes3
2020-05-26 00:13:10 +03:00
Nikolai Kochetov
a01b6496b6 Fix types for function Capture. 2020-05-25 22:21:42 +03:00
alesapin
355fbadb31 Fix style 2020-05-25 22:18:01 +03:00
Ivan Blinkov
548fc7141a
Enable log_queries by default 2020-05-25 21:12:03 +03:00
alesapin
211d7e229f Better using 2020-05-25 21:03:04 +03:00
alesapin
adc7439a4c Comments and refactoring 2020-05-25 20:57:08 +03:00
alesapin
62e9f67639 Better 2020-05-25 20:25:18 +03:00
alesapin
d7c59bb4aa Merge branch 'master' into consistent_metadata2 2020-05-25 20:23:52 +03:00
alesapin
c3a6571036 Compilable code 2020-05-25 20:22:20 +03:00
alesapin
9b3cc9e525 Almost working ttl in IStorage 2020-05-25 20:07:14 +03:00
Vitaly Baranov
58a2172154 Improve build scripts related to protobuf and gRPC. 2020-05-25 18:46:57 +03:00
Nikita Mikhaylov
b48deb91ac comments and styles 2020-05-25 17:33:31 +03:00
Nikita Mikhaylov
b7adfc7c07 Merge branch 'master' of github.com:ClickHouse/ClickHouse into MorozovVasily-UpdatePermutation 2020-05-25 17:26:30 +03:00
Vladimir Chebotarev
7f9a257c31 Fixed S3 globbing which could fail in case of more than 1000 keys and some backends. 2020-05-25 15:57:32 +03:00
Artem Zuikov
04322b7b87 remove stale unit-test 2020-05-25 15:06:14 +03:00
Nikolai Kochetov
c83014bc76
Merge pull request #11114 from azat/max_threads-simple-query-optimization-fix
Do not reserve extra threads after max threads optimization for simple queries
2020-05-25 14:05:46 +03:00
alesapin
6281dd6893
Merge pull request #11115 from ClickHouse/consistent_metadata
Refactoring in storage metadata (more consistent keys)
2020-05-25 13:09:56 +03:00
Vitaly Baranov
eeb4cbc433 Fix settings NO_PASSWORD authentication mode in users.xml. 2020-05-25 11:35:26 +03:00
Alexander Kuzmenkov
8d5bbed2de Merge remote-tracking branch 'origin/master' into HEAD 2020-05-25 06:44:11 +03:00
Alexander Kuzmenkov
f1fb7245e5 Merge remote-tracking branch 'origin/master' into HEAD 2020-05-25 06:21:27 +03:00
Alexander Kuzmenkov
09129a6d21 Function for printing array of Asts 2020-05-25 06:19:46 +03:00
hcz
f2e3bcdd15 Improve code style in src and test files of Arrow formats 2020-05-25 10:50:55 +08:00
Alexander Kuzmenkov
3b888e4e33 Add rand32 alias 2020-05-25 04:03:46 +03:00
Albert Kidrachev
3abf7b7dcd fix 2020-05-25 03:32:08 +03:00
Albert Kidrachev
96260cf33a init 2020-05-25 02:56:24 +03:00
alexey-milovidov
bee5849c6a
Merge pull request #11137 from ClickHouse/logger-fmt
fmt-style logging, part 1
2020-05-25 01:38:14 +03:00
alexey-milovidov
16760936a3
Merge pull request #11168 from ClickHouse/radix-sort-experiments
Fix bugs in MSB Radix Sort
2020-05-24 23:31:42 +03:00
alexey-milovidov
9b09cfc611
Merge pull request #11165 from ClickHouse/fix-test-s3
Merging #11036
2020-05-24 22:18:35 +03:00
Alexey Milovidov
4ebf63fb23 Fixed error 2020-05-24 22:17:15 +03:00
Alexey Milovidov
9082a70ee6 Fix clang-tidy 2020-05-24 21:25:58 +03:00
Alexey Milovidov
01be2dadb3 Various comments 2020-05-24 21:05:06 +03:00
Alexey Milovidov
d0c0a0aed6 Unrolled histogram calculation 8 times 2020-05-24 18:51:23 +03:00
Alexey Milovidov
e99ed19586 Unrolled histogram calculation 2020-05-24 18:48:11 +03:00
Alexey Milovidov
04022f71b4 Added comment 2020-05-24 18:35:48 +03:00
Alexey Milovidov
4748de9c85 Fix partial radix sort: it was not working at all 2020-05-24 18:26:07 +03:00
Alexey Milovidov
5e7ea6500c Fix error 2020-05-24 17:48:53 +03:00
Alexey Milovidov
32158d9aee Trying to understand and fix the code of RadixSortMSD 2020-05-24 17:42:20 +03:00
Azat Khuzhin
c36708caf9 Split data skipping indexes from the order by to evaluate order by before merge 2020-05-24 16:12:08 +03:00
Azat Khuzhin
71731b2e99 Fix data skipping indexes for columns with additional actions during merge
For example for AggregatingMergeTree if the column in the data skipping
index is under some aggregate function, then data skipping index will be
incorrect.

Fix this by calculating data skipping indexes after aggregation has been
done.
2020-05-24 16:12:08 +03:00
Alexey Milovidov
a8e8bc4298 Added a comment 2020-05-24 13:49:43 +03:00
Alexey Milovidov
7fca4ce4d0 Added missing test @excitoon #11036 2020-05-24 13:44:03 +03:00
Alexey Milovidov
e3cd085230 Fix test (looks like it was incorrect) 2020-05-24 13:42:13 +03:00
alexey-milovidov
aa8f385085
Merge pull request #11159 from ClickHouse/fix-radix-sort
Fix radix sort after #10981
2020-05-24 02:31:45 +03:00
Alexey Milovidov
bff624e2ef Fix style 2020-05-24 01:30:43 +03:00
Alexey Milovidov
7e1813825b Return old names of macros 2020-05-24 01:24:01 +03:00
Alexey Milovidov
61cc605ee7 Remove old method 2020-05-24 01:21:29 +03:00
Alexey Milovidov
af2a59e49b Progress on task 2020-05-24 00:50:34 +03:00
Alexey Milovidov
d853bc39c5 Apply all transformations again 2020-05-24 00:41:48 +03:00
Alexey Milovidov
c87fb91532 Progress on task 2020-05-24 00:41:35 +03:00
Alexey Milovidov
93626701b8 Apply all transformations again 2020-05-24 00:27:27 +03:00
Alexey Milovidov
ce0619dabf Progress on task 2020-05-24 00:26:45 +03:00
Alexey Milovidov
2d7d5a1547 Apply all transformations again 2020-05-24 00:16:27 +03:00
Alexey Milovidov
bab24879e9 Progress on task 2020-05-24 00:16:05 +03:00
Alexey Milovidov
7c0c328a35 Progress on task 2020-05-24 00:05:47 +03:00
Alexey Milovidov
d2621fee30 Progress on task 2020-05-23 23:57:48 +03:00
Alexey Milovidov
e1695feb7f Apply all transformations again 2020-05-23 23:40:32 +03:00
Alexey Milovidov
38e3e273cd Progress on task 2020-05-23 23:39:59 +03:00
Alexey Milovidov
85f84550ba Progress on task 2020-05-23 23:37:37 +03:00
Azat Khuzhin
9de1a231c9 Add optional default_port argument for the port() function 2020-05-23 23:36:01 +03:00
Alexey Milovidov
f75587e562 Progress on task 2020-05-23 23:13:34 +03:00
Alexey Milovidov
18febd7b97 find {base,src,programs} -name '*.h' -or -name '*.cpp' | xargs grep -l -P 'LOG_[^\_(]+\([^,]+, "[^"]+" << [^<]+ << "[^"]+" << [^<]+ << "[^"]+" << [^<]+ << "[^"]+" << [^<]+ << "[^"]+"\);' | while read file; do perl -pne 's/(LOG_[^\_(]+)\(([^,]+), "([^"]+)" << ([^<]+) << "([^"]+)" << ([^<]+) << "([^"]+)" << ([^<]+) << "([^"]+)" << ([^<]+) << "([^"]+)"\);/${1}_FORMATTED(${2}, "${3}{}${5}{}${7}{}${9}{}${11}", ${4}, ${6}, ${8}, ${10});/' $file > ${file}.tmp; mv ${file}.tmp $file; done 2020-05-23 22:56:05 +03:00
Alexey Milovidov
cd6d3c7509 Progress on task 2020-05-23 22:55:06 +03:00
Alexey Milovidov
d5b7883451 find {base,src,programs} -name '*.h' -or -name '*.cpp' | xargs grep -l -P 'LOG_[^\_(]+\([^,]+, "[^"]+" << [^<]+ << "[^"]+" << [^<]+ << "[^"]+" << [^<]+ << "[^"]+"\);' | xargs sed -i -r -e 's/(LOG_[^\_(]+)\(([^,]+), "([^"]+)" << ([^<]+) << "([^"]+)" << ([^<]+) << "([^"]+)" << ([^<]+) << "([^"]+)"\);/\1_FORMATTED(\2, "\3{}\5{}\7{}\9", \4, \6, \8);/' 2020-05-23 22:41:08 +03:00
Alexey Milovidov
7e2fb9ad65 Apply all transformations again 2020-05-23 22:38:30 +03:00
Alexey Milovidov
eacff92d0e Progress on task 2020-05-23 22:35:08 +03:00
Alexey Milovidov
0ab3ca8534 Apply all transformations again 2020-05-23 22:32:44 +03:00
Alexey Milovidov
29762240de Remove duplicate whitespaces (preparation) 2020-05-23 22:31:54 +03:00
Alexey Milovidov
7fed65cbe2 Remove duplicate whitespaces (preparation) 2020-05-23 22:14:58 +03:00
Alexey Milovidov
86b4d5a86f Remove duplicate whitespaces (preparation) 2020-05-23 22:09:06 +03:00
Alexey Milovidov
ab0562a574 Make all LOG in single line (preparation) 2020-05-23 22:05:41 +03:00
Alexey Milovidov
9d2a0d2dd7 Apply all transformations again 2020-05-23 21:59:49 +03:00
Alexey Milovidov
a2ad11897f Remove duplicate whitespaces (preparation) 2020-05-23 21:53:58 +03:00
Alexey Milovidov
1f13515a65 Make all LOG in single line (preparation) 2020-05-23 21:31:37 +03:00
Alexey Milovidov
45b6abdfee Progress on task 2020-05-23 21:22:40 +03:00
Alexey Milovidov
3384f3b77e Progress on task 2020-05-23 21:07:38 +03:00
Alexey Milovidov
fc412f2d9d Progress on task 2020-05-23 20:59:03 +03:00
Alexey Milovidov
9d24908e53 Progress on task 2020-05-23 20:52:11 +03:00
Azat Khuzhin
409cff11df Add port() function
It uses domain() (getURLHost()) internally so it has the same
limitations:
- no ipv6 support
- no host-without-dots support (i.e. "foobar")
2020-05-23 20:45:56 +03:00
Alexey Milovidov
3a09f9ca1c find {base,src,programs} -name '*.h' -or -name '*.cpp' | xargs grep -l -P 'LOG_[^\W_]+\([^,]+, [^<+)"]+\);' | xargs sed -i -r -e 's/(LOG_[^\W_]+)\(([^,]+), ([^<+)"]+)\);/\1_FORMATTED(\2, \3);/' 2020-05-23 20:29:56 +03:00
Azat Khuzhin
aa656f95dd Fix compilation on osx (where UInt64 and size_t is different) 2020-05-23 20:28:40 +03:00
Alexey Milovidov
b3f4fe12dd Progress on task 2020-05-23 20:25:19 +03:00
Alexey Milovidov
d6bc4d2bd0 find {base,src,programs} -name '*.h' -or -name '*.cpp' | xargs grep -l -P 'LOG_\w+\([^,]+, [^<]+ << "[^"]+" << [^<]+\);' | xargs sed -i -r -e 's/(LOG_\w+)\(([^,]+), ([^<]+) << "([^"]+)" << ([^<]+)\);/\1_FORMATTED(\2, "{}\4{}", \3, \5);/' 2020-05-23 20:14:57 +03:00
Alexey Milovidov
57f6dc66d3 find {base,src,programs} -name '*.h' -or -name '*.cpp' | xargs grep -l -P 'LOG_\w+\([^,]+, "[^"]+" \+ [^+]+ \+ "[^"]+" \+ [^+]+ \+ "[^"]+" \+ [^+]+\);' | xargs sed -i -r -e 's/(LOG_\w+)\(([^,]+), "([^"]+)" \+ ([^+]+) \+ "([^"]+)" \+ ([^+]+) \+ "([^"]+)" \+ ([^+]+)\);/\1_FORMATTED(\2, "\3{}\5{}\7{}", \4, \6, \8);/' 2020-05-23 20:11:09 +03:00
Alexey Milovidov
7bc2b6bbbc find {base,src,programs} -name '*.h' -or -name '*.cpp' | xargs grep -l -P 'LOG_\w+\([^,]+, "[^"]+" \+ [^+]+ \+ "[^"]+" \+ [^+]+\);' | xargs sed -i -r -e 's/(LOG_\w+)\(([^,]+), "([^"]+)" \+ ([^+]+) \+ "([^"]+)" \+ ([^+]+)\);/\1_FORMATTED(\2, "\3{}\5{}", \4, \6);/' 2020-05-23 20:10:45 +03:00
Alexey Milovidov
241f8c5431 find {base,src,programs} -name '*.h' -or -name '*.cpp' | xargs grep -l -P 'LOG_\w+\([^,]+, "[^"]+" \+ [^+]+ \+ "[^"]+"\);' | xargs sed -i -r -e 's/(LOG_\w+)\(([^,]+), "([^"]+)" \+ ([^+]+) \+ "([^"]+)"\);/\1_FORMATTED(\2, "\3{}\5", \4);/' 2020-05-23 20:10:21 +03:00
Alexey Milovidov
f69cbdcbfc find {base,src,programs} -name '*.h' -or -name '*.cpp' | xargs grep -l -P 'LOG_\w+\([^,]+, "[^"]+" \+ [^+]+\);' | xargs sed -i -r -e 's/(LOG_\w+)\(([^,]+), "([^"]+)" \+ ([^+]+)\);/\1_FORMATTED(\2, "\3{}", \4);/' 2020-05-23 20:09:37 +03:00
Alexey Milovidov
f68d1ceb4f find {base,src,programs} -name '*.h' -or -name '*.cpp' | xargs grep -l -P 'LOG_\w+\([^,]+, "[^"]+" << [^<]+ << "[^"]+" << [^<]+ << "[^"]+" << [^<]+\);' | xargs sed -i -r -e 's/(LOG_\w+)\(([^,]+), "([^"]+)" << ([^<]+) << "([^"]+)" << ([^<]+) << "([^"]+)" << ([^<]+)\);/\1_FORMATTED(\2, "\3{}\5{}\7{}", \4, \6, \8);/' 2020-05-23 20:02:09 +03:00
Alexey Milovidov
533f86278a find {base,src,programs} -name '*.h' -or -name '*.cpp' | xargs grep -l -P 'LOG_\w+\([^,]+, "[^"]+" << [^<]+ << "[^"]+" << [^<]+ << "[^"]+"\);' | xargs sed -i -r -e 's/(LOG_\w+)\(([^,]+), "([^"]+)" << ([^<]+) << "([^"]+)" << ([^<]+) << "([^"]+)"\);/\1_FORMATTED(\2, "\3{}\5{}\7", \4, \6);/' 2020-05-23 20:00:41 +03:00
Alexey Milovidov
8042e5febe find {base,src,programs} -name '*.h' -or -name '*.cpp' | xargs grep -l -P 'LOG_\w+\([^,]+, "[^"]+" << [^<]+ << "[^"]+" << [^<]+\);' | xargs sed -i -r -e 's/(LOG_\w+)\(([^,]+), "([^"]+)" << ([^<]+) << "([^"]+)" << ([^<]+)\);/\1_FORMATTED(\2, "\3{}\5{}", \4, \6);/' 2020-05-23 19:58:15 +03:00
Alexey Milovidov
e391b77d81 find {base,src,programs} -name '*.h' -or -name '*.cpp' | xargs grep -l -P 'LOG_\w+\([^,]+, "[^"]+" << [^<]+ << "[^"]+"\);' | xargs sed -i -r -e 's/(LOG_\w+)\(([^,]+), "([^"]+)" << ([^<]+) << "([^"]+)"\);/\1_FORMATTED(\2, "\3{}\5", \4);/' 2020-05-23 19:56:05 +03:00
Alexey Milovidov
ee4ffbc332 find {base,src,programs} -name '*.h' -or -name '*.cpp' | xargs grep -l -P 'LOG_\w+\([^,]+, "[^"]+" << [^<]+\);' | xargs sed -i -r -e 's/(LOG_\w+)\(([^,]+), "([^"]+)" << ([^<]+)\);/\1_FORMATTED(\2, "\3{}", \4);/' 2020-05-23 19:47:56 +03:00
Alexey Milovidov
8d2e80a5e2 find {base,src,programs} -name '*.h' -or -name '*.cpp' | xargs grep -l -P 'LOG_\w+\([^,]+, "[^"]+"\)' | xargs sed -i -r -e 's/(LOG_\w+)\(([^,]+, "[^"]+")\)/\1_FORMATTED(\2)/' 2020-05-23 19:42:39 +03:00
Alexey Milovidov
e884800662 Remove commented code 2020-05-23 19:38:59 +03:00
Alexey Milovidov
35d79e1252 fmt-style logging, part 1 2020-05-23 19:33:07 +03:00
alexey-milovidov
08c7277d2b
Merge pull request #11144 from ClickHouse/dont-validate-polygons-in-non-constant-case
Fix performance issue with pointInPolygon
2020-05-23 18:54:50 +03:00
tavplubix
6ece9649f1
Merge pull request #11151 from naorlov/CLICKHOUSE-7224
Add `FailedQuery`, `FailedSelectQuery` and `FailedInsertQuery`
2020-05-23 18:47:44 +03:00
Alexey Milovidov
9c15e3ad92 Make it right 2020-05-23 18:29:43 +03:00
Alexey Milovidov
82f03fa8ce Fix loop unrolling 2020-05-23 18:22:04 +03:00
Alexey Milovidov
73a3394b3d Clarifications #10981 2020-05-23 17:28:22 +03:00
alexey-milovidov
ac6deaf8ec
Merge pull request #11036 from excitoon-favorites/s3fixes
Fixed parsing of S3 URL
2020-05-23 17:06:59 +03:00
alexey-milovidov
1d0043892b
Merge pull request #11155 from azat/dist-logging
Add table name into logs for StorageDistributed
2020-05-23 16:53:41 +03:00
alexey-milovidov
34eb533842
Merge pull request #10981 from g-arslan/master
Try to remove redundant data move in radix sort
2020-05-23 15:55:35 +03:00
Azat Khuzhin
0e12edb895 Fix max_threads simple query optimization for SELECT with subqueries
Fixes: 01245_limit_infinite_sources
2020-05-23 15:14:27 +03:00
Alexey Milovidov
2df7813177 Whitespaces 2020-05-23 14:52:45 +03:00
Alexey Milovidov
3e87b5fe72 Remove old TODO 2020-05-23 14:50:21 +03:00
Alexey Milovidov
8c63886ba6 Added a comment 2020-05-23 14:26:40 +03:00
Alexey Milovidov
6f39ac27d1 Comments and clarifications 2020-05-23 14:04:29 +03:00
Alexey Milovidov
3b7088262f Comments and clarifications 2020-05-23 14:03:21 +03:00
Alexey Milovidov
146d8253ce Comments and clarifications 2020-05-23 13:57:30 +03:00
Alexey Milovidov
f14b5c02e2 Added a comment 2020-05-23 13:41:49 +03:00
Azat Khuzhin
d4804e070f Do not reserve extra threads after max threads optimization for simple queries
Before this patch pipeline.setMaxThreads() was called with 0 (since
streams.size() == 0, while pipes.size() == 1), which leads that
pipeline.getMaxThreads() returns max_streams.

While this threads were not used, they were reserved, which should not
happens either.
2020-05-23 13:19:09 +03:00
Azat Khuzhin
bc4b75dead Add table name into logs for StorageDistributed 2020-05-23 11:57:14 +03:00
Nikita Orlov
09255b7c46
issue-7224 Codestyle changes 2020-05-23 02:37:14 +03:00
Alexey Milovidov
91b8659b4d Avoid data movement 2020-05-23 02:14:14 +03:00
Alexey Milovidov
ba5d0a9793 Avoid virtual calls 2020-05-23 01:40:00 +03:00
Nikita Orlov
dffd15f643
issue-7224 Add failed Insert and Select query counters to ProfileEvents 2020-05-23 01:00:15 +03:00
Alexey Milovidov
d2cd941f47 Changed strategy to "Franklin" 2020-05-23 00:47:31 +03:00
Alexey Milovidov
5e21a06559 Added bounding box 2020-05-23 00:36:44 +03:00
Azat Khuzhin
6a9ec1396a Access aggregate keys by names over indexes
Relax this to allow accepting aggregate keys in different order (typical
use case is distributed queries, where the initiator server will do
final merge).
2020-05-23 00:36:30 +03:00
Azat Khuzhin
1f45c4302a Drop check for getPositionByName() (it already has it) in ExpressionActions 2020-05-23 00:36:30 +03:00
Azat Khuzhin
6d40c1ea2c Preserve order of expressions during predicates optimization (enable_optimize_predicate_expression)
Before this patch enable_optimize_predicate_expression changes the
order *every* time, so:
  foo AND bar -> bar AND foo

And this causes troubles for distributed queries, since query on shard
will have different order of expressions with the initiating server.
2020-05-23 00:36:30 +03:00
Alexey Milovidov
4deb69599e Improve performance for non-const polygons 2020-05-23 00:27:06 +03:00
Alexey Milovidov
84dd802ba9 Improve performance for non-const polygons 2020-05-23 00:23:49 +03:00
Alexey Milovidov
a39f1d8bdc Preparation 2020-05-22 23:29:28 +03:00
Alexey Milovidov
ad54b83563 Fix clang-tidy 2020-05-22 22:58:08 +03:00
Alexey Milovidov
a309e1050a Finally fix performance issue 2020-05-22 22:54:16 +03:00
Alexey Milovidov
3f31f2b9e2 Replace polygon key to hash for simplicity 2020-05-22 22:37:56 +03:00
Alexey Milovidov
de83c1129f Better "serialize" function for polygons 2020-05-22 22:27:38 +03:00
Alexey Milovidov
902fc8dd82 Fix outstandingly wrong code from #10623 2020-05-22 22:15:29 +03:00
alesapin
cd83ebc599
Merge pull request #11106 from ClickHouse/fix_deadlock_system_logs_startup
Fix deadlock in system tables during server startup
2020-05-22 20:53:07 +03:00
alesapin
e812fa15d1 Merge branch 'consistent_metadata' into consistent_metadata2 2020-05-22 17:41:53 +03:00
alesapin
e971ff627e Fix gcc-9 build 2020-05-22 17:39:49 +03:00
Alexey Milovidov
4dd2015056 Preparation 2020-05-22 17:21:49 +03:00
Alexey Milovidov
a9b3de8542 Remove excessive memory allocations 2020-05-22 17:07:17 +03:00
Alexey Milovidov
07a65c3090 Do not validate polygons in non-constant case 2020-05-22 16:50:12 +03:00
alesapin
f026fa7de1 Rename PartDestinationType to DataDestionationType, because there is no part-specific information 2020-05-22 16:29:33 +03:00
alesapin
a935db4169
boop CI 2020-05-22 15:34:26 +03:00
Vitaly Baranov
5a0f356cd6
Merge pull request #11038 from Enmk/parseDateTime64BestEffort_fix
Fixed parseDateTime64BestEffort implementation
2020-05-22 14:40:39 +03:00
alexey-milovidov
10fd2dd17d
Merge pull request #11118 from ClickHouse/aku/trace-log-overflow-followup
A follow-up for trace log overflow in perftests
2020-05-22 14:29:11 +03:00
alexey-milovidov
e5808c6f2f
Merge pull request #11122 from ClickHouse/aku/addr2line
Remove extra copying from addressToLine
2020-05-22 14:16:46 +03:00
alexey-milovidov
b82c633716
Merge pull request #11048 from filimonov/kafka_missed_data_during_drop
Fixes the potential missed data during termination of Kafka engine table
2020-05-22 14:11:10 +03:00
alesapin
f4b0d475af Fix system.tables output 2020-05-22 14:04:15 +03:00
alesapin
70fe119426 Add clear names 2020-05-22 13:33:57 +03:00
alesapin
98ffefd90c Fix bug with return type 2020-05-22 13:09:24 +03:00
Vladimir Chebotarev
98f31374d5 Added improved S3 URL parsing to DiskS3. 2020-05-22 11:18:34 +03:00
alesapin
cbcdb6219e Slighty more verbose comment 2020-05-22 11:17:57 +03:00
Vladimir Chebotarev
02cb08ea2f Fixed parsing of S3 URL. 2020-05-22 11:17:10 +03:00
alesapin
b9dfa61774
Merge pull request #11042 from CurtizJ/modify-ttl
Apply TTL for old data, after ALTER MODIFY TTL query
2020-05-22 11:12:14 +03:00
Nikolai Kochetov
f7456f8320
Merge pull request #11004 from ClickHouse/remove-experimental-use-processors-flag-2
Remove allow_processors flag from executeQuery()
2020-05-22 10:47:15 +03:00
Alexander Kuzmenkov
322d731d28 Remove extra copying from addressToLine
The line is already serialized to the same arena, so there is no need to
copy it. Also add this function to query profiler test, so that it has
some coverage.
2020-05-22 03:01:35 +03:00
Alexander Kuzmenkov
087d8ab020 A follow-up for trace log overflow in perftests
The start was in https://github.com/ClickHouse/ClickHouse/pull/11026
It turned out that the problem was due to the incorrect mutate()
implementation that lead to quadratic amount of column copying. This
problem has since been fixed.

Remove the excessively verbose logging, and also change appendToBlock of
LogElement's to accept mutable columns instead of accepting a block and
mutating it on each call. It looks wasteful, even though it is almost a
noop.
2020-05-21 23:40:23 +03:00
Alexander Kuzmenkov
fecd84d3c0
Merge pull request #10915 from ClickHouse/aku/mongodb-uri
Support MongoDB URI
2020-05-21 23:02:12 +03:00
alesapin
59b3bc0c05
Merge branch 'master' into fix_deadlock_system_logs_startup 2020-05-21 22:57:52 +03:00
Nikolai Kochetov
c81dd49686 Try fix build. 2020-05-21 22:55:27 +03:00
alesapin
09034157cd Remove comments 2020-05-21 22:53:46 +03:00
alesapin
327d17ac6a Better 2020-05-21 22:46:03 +03:00
alesapin
41914588fd More clear 2020-05-21 22:07:18 +03:00
alesapin
1906762119
Merge pull request #11109 from ClickHouse/less_verbose_logging
Less verbose logging in mutation finalization task
2020-05-21 21:53:08 +03:00
alesapin
37fa26971e
boop ci 2020-05-21 21:49:31 +03:00
alexey-milovidov
655b8e1903
Merge pull request #11021 from ClickHouse/fix_10557
Remove data on DROP DATABASE for DatabaseMemory
2020-05-21 20:17:46 +03:00
Nikolai Kochetov
adfa77be9d Added another one comment. 2020-05-21 20:07:22 +03:00
Alexander Kuzmenkov
f98ffdbc4c
Merge pull request #11087 from azat/context-fwd-decl
[RFC] Forward declaration for Context as much as possible.
2020-05-21 19:43:29 +03:00
alesapin
87eab514fb Merge branch 'master' into consistent_metadata 2020-05-21 18:54:52 +03:00
alesapin
5676340f6b Less verbose logging in mutation finalization task 2020-05-21 18:52:11 +03:00
Vasily Nemkov
403aae9126 Fixed parseDateTime64BestEffort implementation
Fixed argument resolution issues.
Added tests and made sure -orNull and -orZero variants alwo work correctly.
2020-05-21 17:21:39 +03:00
alesapin
c036af0261 Fix deadlock after clickhouse-server update (with changes in one of system log tables structure) during startup between concurrent merge and table rename. 2020-05-21 17:11:56 +03:00
g-arslan
9e350bea33 replace shift array with std::rotate 2020-05-21 17:10:47 +03:00
alexey-milovidov
b480f137f3
Merge pull request #10623 from livace/master
Add point in polygon for non-const polygons
2020-05-21 15:18:24 +03:00
alexey-milovidov
765510d5c3
Merge pull request #10991 from ClickHouse/enable-clang-tidy-for-programs-and-utils
Enable clang-tidy for programs and utils
2020-05-21 15:12:07 +03:00
Alexey Milovidov
581b2358de Added comment 2020-05-21 15:07:12 +03:00
Alexey Milovidov
3c763908c3 Added comment 2020-05-21 15:04:15 +03:00
Alexey Milovidov
6669607e17 Merge branch 'master' into vectorize-sum 2020-05-21 15:02:51 +03:00
g-arslan
3267eaa498 fix style 2020-05-21 15:00:55 +03:00
g-arslan
b88d0dec1c some little improvements 2020-05-21 15:00:55 +03:00
g-arslan
c01a7ef0e2 Implement reverse in radix sort, fix style, fix build 2020-05-21 15:00:55 +03:00
g-arslan
95668def24 Try to remove redundant data move in radix sort 2020-05-21 15:00:55 +03:00
Nikolai Kochetov
d6ce1ed7b9 Added comments. 2020-05-21 14:54:26 +03:00
alexey-milovidov
c1b5d799ee
Merge pull request #11025 from ClickHouse/add-nchar-nvarchar
Add NCHAR and NVARCHAR synonims
2020-05-21 14:05:11 +03:00
Nikolai Kochetov
986dfe79a5
Merge pull request #10858 from azat/min_mv_insert_block_size
[RFC] Introduce min_insert_block_size_{rows,bytes}_for_materialized_views (for MVs)
2020-05-21 12:52:58 +03:00
Alexey Milovidov
2fa264d83e Fix style #10591 2020-05-21 12:46:00 +03:00
alexey-milovidov
b6b62dbdbc
Merge pull request #10591 from excitoon-favorites/ttl_introspection
Added `move_ttl_info` to `system.parts`
2020-05-21 12:43:49 +03:00
alexey-milovidov
4a237faede
Merge pull request #11074 from Jokser/memory-leak-in-register-disk-s3
Fix memory leak in registerDiskS3
2020-05-21 12:42:46 +03:00
Nikolai Kochetov
37e5da737c Fix ya.make. 2020-05-21 12:27:55 +03:00
BohuTANG
c9d315654c Fix Storages/MergeTree typo 2020-05-21 17:00:44 +08:00
Nikolai Kochetov
cfef21be86 Fix build. 2020-05-21 11:54:41 +03:00
Nikolai Kochetov
adac47a845 Fix build. 2020-05-21 10:47:38 +03:00
Nikolai Kochetov
f6d5961915 Fix build. 2020-05-21 10:40:01 +03:00
Nikolai Kochetov
6efc51335a Fix build. 2020-05-21 10:31:43 +03:00
hcz
ab37791134 Fix arrow stream termination 2020-05-21 15:28:10 +08:00
hcz
e11fa03bdd Add ArrowStream input and output format 2020-05-21 12:07:47 +08:00
Azat Khuzhin
d93b9a57f6 Forward declaration for Context as much as possible.
Now after changing Context.h 488 modules will be recompiled instead of 582.
2020-05-21 01:53:18 +03:00
Alexander Kuzmenkov
50df893dc6 Assert that allocator & container are consistent wrt. inline memory
There are lots of places where HashTable is used with
AllocatorWithStackMemory, but the size of allocator inline memory is set
incorrectly, and it's less than the initial HashTable buffer size.
Because of this, HashTable is always allocated on the heap, and the
inline memory becomes a useless dead weight.

For PODArray, we have previously added a helper template that makes sure
these values are in sync, so there was only one such discrepancy left,
in the unit test.
2020-05-20 22:37:13 +03:00
Nikolai Kochetov
bcd38ac207 Fix build. 2020-05-20 22:08:20 +03:00
Alexander Kuzmenkov
9e410444e7 Better error messages about joins 2020-05-20 21:58:20 +03:00
Nikolai Kochetov
6f50700f35 Add PullingOutputFormat and PullingPipelineExecutor. 2020-05-20 21:53:18 +03:00
alexey-milovidov
07924f0ae1
Merge pull request #11029 from azat/system_tables_lazy_load
Disable system_tables_lazy_load by default
2020-05-20 21:15:09 +03:00
alesapin
616902a995 Sorting and primary key (broken) 2020-05-20 21:11:38 +03:00
Pavel Kovalenko
d98c1589ed Better error handling in Proxy Resolver. 2020-05-20 19:01:05 +03:00
Pavel Kovalenko
138154ba6a Fix memory-leak in registerDiskS3 during config->createView invocations. 2020-05-20 18:42:45 +03:00
alesapin
9fb28f5ac0 Add sampling key 2020-05-20 18:16:39 +03:00
Nikolai Kochetov
fcf58fa4a1 Fix clang build. 2020-05-20 17:04:24 +03:00
Anton Popov
d62fe980ef Merge remote-tracking branch 'upstream/master' into modify-ttl 2020-05-20 16:52:30 +03:00
alesapin
8bc527eecd Compile partition key 2020-05-20 15:16:55 +03:00
Vitaly Baranov
06d18a4378
Merge pull request #11050 from vitlibar/amosbird_betterdictget
dictGet with table name
2020-05-20 14:18:24 +03:00
alexey-milovidov
da33858d39 Update StorageSystemParts.cpp 2020-05-20 14:07:31 +03:00
Vladimir Chebotarev
02b52df86d Added delete_ttl_info_min and delete_ttl_info_max to system.parts. 2020-05-20 14:07:31 +03:00
Vladimir Chebotarev
6f68979662 Switched system.parts.move_ttl_info to separate arrays. 2020-05-20 14:07:31 +03:00
Vladimir Chebotarev
3ed5d9434a Added move_ttl_info to system.parts. 2020-05-20 14:07:31 +03:00
Artem Zuikov
9b38324028
fix JOIN with PREWHERE with second analyze() (#11051) 2020-05-20 12:29:23 +03:00
Mikhail Filimonov
e8a13842af Better fix, previous fix was wrong (was leaving the cycle by eof condition) 2020-05-20 11:02:02 +02:00
alesapin
dc330ca7cb
Merge pull request #11037 from ClickHouse/alter_rename_and_modify
Fix alter rename with different types of alter
2020-05-20 11:28:13 +03:00
Nikolai Kochetov
7ba5419190 Update PipelineExecutor. 2020-05-19 23:24:06 +03:00
Alexander Kuzmenkov
bc34e0ff94 fixup 2020-05-19 23:12:10 +03:00
Vitaly Baranov
57bd7afc03 Fix passing dictionary's name to dictGet() with alias. 2020-05-19 21:17:29 +03:00
Amos Bird
ce3c53a00a dictGet* with table name 2020-05-19 20:33:45 +03:00
Mikhail Filimonov
34198336ed Style 2020-05-19 19:02:37 +02:00
Mikhail Filimonov
b50480cbde Fixes the potential missed data during termination of Kafka engine table 2020-05-19 18:55:37 +02:00
alesapin
7d382cc7b5 Return missed command 2020-05-19 19:03:10 +03:00
Nikolai Kochetov
6109e87aed Try fix compatibility. 2020-05-19 18:40:15 +03:00
Nikolai Kochetov
c147badf4f Merge remote-tracking branch 'upstream/master' into min_mv_insert_block_size 2020-05-19 18:24:21 +03:00
Alexander Kuzmenkov
ef6f386ee6
Merge pull request #11026 from ClickHouse/aku/trace-log
Add more logs to debug trace_log overflow
2020-05-19 17:56:06 +03:00
Alexander Kuzmenkov
838b3e9533 fixup 2020-05-19 17:55:27 +03:00
Nikolai Kochetov
b0d9552e1e Try fix compatibility. 2020-05-19 17:06:33 +03:00
Anton Popov
35b916433a fix TTL with defaults after modify 2020-05-19 16:06:35 +03:00
alesapin
4906dbef41 Remove redundant logs 2020-05-19 13:46:56 +03:00