Commit Graph

2162 Commits

Author SHA1 Message Date
tavplubix
9c86c12891
Update ParserShowTablesQuery.cpp 2020-06-10 21:11:30 +03:00
Nikita Mikhaylov
bf262a3b04
more lock_guard 2020-06-10 18:44:28 +03:00
Nikita Mikhaylov
8c19817575
lock_guard 2020-06-10 18:30:50 +03:00
Nikolai Kochetov
d4c8adbaff Fix sanitizeBlock 2020-06-10 18:06:37 +03:00
Alexander Tokmakov
08073903ed fix query_id of http queries 2020-06-10 17:24:42 +03:00
Nikita Mikhaylov
9df693ced5
Merge pull request #11561 from Jokser/s3-http-client-memory-optimization
Avoid copying whole response stream into memory in S3 HTTP client.
2020-06-10 16:53:33 +04:00
Alexander Tokmakov
9166ddea41 fix segfault in show create table 2020-06-10 15:53:12 +03:00
Vxider
7078355449 remove unused local variables 2020-06-10 18:06:24 +08:00
tavplubix
a93ae46ac1
Merge pull request #11079 from ClickHouse/merging_external_source_cassandra
Merging #4978
2020-06-10 10:39:18 +03:00
alexey-milovidov
8e05558a5f
Merge pull request #11540 from ClickHouse/fix-direct-io
Fix direct IO with PREWHERE
2020-06-09 23:53:09 +03:00
Azat Khuzhin
8a78cffe5c Force table creation on SYSTEM FLUSH LOGS 2020-06-09 21:11:08 +03:00
Alexander Tokmakov
6bb68329f8 Merge branch 'master' into merging_external_source_cassandra 2020-06-09 19:51:14 +03:00
Nikolai Kochetov
595fc9eff6
Merge pull request #11440 from ClickHouse/add-remote-source
Add remote source
2020-06-09 19:27:28 +03:00
Nikolai Kochetov
5cc2f318c9
Merge pull request #11495 from vzakaznikov/live_view_support_for_prewhere
Adding support for PREWHERE in live view tables.
2020-06-09 19:09:17 +03:00
Pavel Kovalenko
f623ef635b Avoid copying whole response stream into memory in S3 HTTP client. 2020-06-09 18:26:51 +03:00
alesapin
a6feb81af1 Fix under msan 2020-06-09 18:11:11 +03:00
alesapin
981462db04 Remove dump flag from ReadBufferAIO 2020-06-09 18:01:34 +03:00
Alexander Kuzmenkov
dd41f6a574
Merge pull request #11527 from azat/dist-insert-local-fix
Fix async INSERT into Distributed for prefer_localhost_replica=0 and w/o internal_replication
2020-06-09 15:21:05 +03:00
Ivan
47ad338cb2
Refactor CMake build files (#11390)
* Get rid of lib_name.cmake
* Refactor Boost and HyperScan libraries
* Refactor lz4
* Fix build with xxHash
2020-06-09 13:54:49 +03:00
alexey-milovidov
44b20eee96
Revert "S3 HTTP client - Avoid copying response stream into memory" 2020-06-09 10:23:35 +03:00
Ilya Yatsishin
822c19ddad
Merge pull request #11537 from ClickHouse/usability-exception-message-parse-columns-declaration-list
Better exception message when cannot parse columns declaration list
2020-06-09 09:55:40 +03:00
hexiaoting
75075a7b2b Add DISTINCT keyword when show clusters 2020-06-09 10:39:37 +08:00
alesapin
223f45685f Review fixes 2020-06-09 05:03:22 +03:00
Pavel Kovalenko
c3d0b35195 Fix includes in S3Common.cpp 2020-06-09 05:03:22 +03:00
Pavel Kovalenko
74ea867b1d Fix includes in S3Common.cpp 2020-06-09 05:03:22 +03:00
Pavel Kovalenko
8b8beb26d3 S3 Poco HTTP Client (do not copy response stream body into memory). 2020-06-09 05:03:22 +03:00
Alexey Milovidov
decac918a2 Fix error 2020-06-09 05:03:22 +03:00
alesapin
de59629b38 Fix benign race condition during shutdown 2020-06-09 04:48:30 +03:00
Alexey Milovidov
63f2d92eff Better exception message when cannot parse columns declaration list #10403 2020-06-09 01:49:19 +03:00
Alexey Milovidov
ef7b054443 Speed up merging in AggregatingMergeTree 2020-06-09 00:53:32 +03:00
Azat Khuzhin
c35f5e9271 Fix shard_num/replica_num for <node> (breaks use_compact_format_in_distributed_parts_names)
In system.clusters it was 1/1 while in address into it was 0/0
2020-06-08 22:30:13 +03:00
Azat Khuzhin
d2383f0f5d Fix async INSERT into Distributed for prefer_localhost_replica=0 and w/o internal_replication 2020-06-08 21:58:56 +03:00
Alexey Milovidov
138f3253ba Fix gcc build 2020-06-08 15:33:00 +03:00
Vitaliy Zakaznikov
5fe67c4292 * Removing supportsPrewhere() from StorageLiveView.h as it is not valid.
* Updating test to check using PREWHERE in query against live view table.
* Updating test to check using PREWHERE in the stored query against the table that does
  not support PREWHWERE.
2020-06-08 13:12:40 +02:00
Alexey Milovidov
58e513f59e Corrected implementation for the case without key 2020-06-08 07:23:56 +03:00
Alexey Milovidov
4216f2fe37 Merge branch 'master' into fix-aggregation-state-exception-safety-memory-leak 2020-06-08 06:31:20 +03:00
hexiaoting
71e43934b7 Fix rest errors found by style check 2020-06-08 10:29:53 +08:00
hexiaoting
75768413ad fix errors found by Style Check 2020-06-08 10:23:57 +08:00
alexey-milovidov
ce4f528b73
Merge branch 'master' into kuskarov-add_syntax_highlighting 2020-06-08 02:14:09 +03:00
alexey-milovidov
16f0e3a467
Merge pull request #11493 from ClickHouse/kuskarov-fix_history_bugs
Merging #11453 (save history in clickhouse-client after every query)
2020-06-08 02:13:20 +03:00
Alexey Milovidov
834f8426e0 Fix memory leak 2020-06-08 01:46:58 +03:00
Vitaliy Zakaznikov
75c97ca82a Adding support for PREWHERE in live view tables. 2020-06-08 00:19:23 +02:00
Alexey Milovidov
f2cfb7d132 Whitespaces 2020-06-08 00:05:36 +03:00
Alexey Milovidov
df19db1509 Added a test for history in clickhouse-client 2020-06-07 20:29:34 +03:00
tavplubix
686c0539db
Merge pull request #11487 from ClickHouse/improve_dns_cache
Use DNSResolver to check if user is allowed to connect from an address
2020-06-07 19:55:03 +03:00
tavplubix
103f0d3ead
Update DNSResolver.cpp 2020-06-07 18:17:23 +03:00
alexey-milovidov
f804321cba
Update DNSResolver.cpp 2020-06-07 03:18:54 +03:00
alexey-milovidov
3d2254bc99
Merge pull request #11471 from Enmk/Codec_test_fixes
Fixed using nullptr source and dest buffers in codecs, fixed test
2020-06-07 02:46:09 +03:00
alexey-milovidov
e3c528e661
Merge pull request #11174 from excitoon-favorites/s3tests
Added tests for improved S3 URL parsing
2020-06-07 02:44:40 +03:00
Ivan
d2178cbacd
Merge pull request #11388 from filimonov/kafka_better_settings
Better settings for Kafka
2020-06-07 01:26:21 +03:00
Alexander Tokmakov
f620d97f9f fix 2020-06-07 00:48:38 +03:00
alexey-milovidov
5ff63d9ad5
Merge pull request #11486 from ClickHouse/speed-up-build
Speed up build by removing old example programs
2020-06-07 00:22:03 +03:00
Alexander Tokmakov
0cf8015f4a use DNSResolver to check if user is allowed to connect 2020-06-07 00:02:29 +03:00
Ivan
657ce426d3
Fix build
Checked locally - no PR
2020-06-06 22:27:48 +03:00
BayoNet
e9b7919e12
DOCS-271: Updated the MergeTree() ORDER BY description (#11433)
* CLICKHOUSEDOCS-271: Updated the MergeTree() ORDER BY description.

* CLICKHOUSEDOCS-271: Fixes grammar.

* CLICKHOUSEDOCS-271: Updated by comments.

Co-authored-by: Sergei Shtykov <bayonet@yandex-team.ru>
2020-06-06 20:44:48 +03:00
Ivan
058821fa02
Merge branch 'master' into kafka_better_settings 2020-06-06 19:50:38 +03:00
Alexey Milovidov
4313a52970 Merge branch 'master' into kuskarov-add_syntax_highlighting 2020-06-06 19:35:47 +03:00
Alexey Milovidov
c37627dabf Merge branch 'master' into Enmk-Codec_test_fixes 2020-06-06 19:21:28 +03:00
Alexey Milovidov
d3d02a67f4 Speed up build by removing old example programs 2020-06-06 19:19:16 +03:00
alexey-milovidov
3e84b17cf8
Merge pull request #11394 from azat/system.distribution_queue
Add system.distribution_queue table
2020-06-06 18:59:59 +03:00
Alexander Kuzmenkov
5851d61bb2
Merge pull request #11485 from ClickHouse/aku/fix-master
Remove some LOGICAL_ERROR to fix the tests
2020-06-06 18:59:31 +03:00
alexey-milovidov
82e849e6a1
Update StorageDistributed.cpp 2020-06-06 18:57:52 +03:00
Alexander Kuzmenkov
57cdbaad81 Remove some LOGICAL_ERROR to fix the tests 2020-06-06 16:05:50 +03:00
Anton Popov
5c42408add
Merge pull request #9113 from dimarub2000/group_by_in_order_optimization
[WIP] Optimization of GROUP BY with respect to table sorting key.
2020-06-06 14:25:59 +03:00
Vasily Nemkov
8996f47124 Revived Alexey Milovidov's fixes 2020-06-06 12:52:56 +03:00
alexey-milovidov
42534959e3
Merge pull request #11421 from livace/fix_point_in_polygon_with_nan
Fix pointInPolygon with nan
2020-06-06 12:37:19 +03:00
alexey-milovidov
050ef9eb54
Merge pull request #11455 from azat/INSERT-SELECT-FINAL-pipeline-stuck
Fix Pipeline stuck for INSERT SELECT FINAL
2020-06-06 12:36:07 +03:00
alexey-milovidov
e8a7fab81c
Merge pull request #11480 from 4ertus2/some
Refactoring: remove TableWithColumnNames
2020-06-06 12:33:16 +03:00
alexey-milovidov
937dd79880
Merge pull request #11477 from ClickHouse/aku/generate-random
generateRandom: check that all arguments are literals
2020-06-06 12:08:24 +03:00
Alexey Milovidov
a73b360c80 Update comment 2020-06-06 11:45:54 +03:00
Alexey Milovidov
cbf71d66e6 Fix undefined behaviour of DoubleDelta 2020-06-06 11:43:51 +03:00
Alexander Kuzmenkov
fafa953ee4 fixup 2020-06-06 04:23:21 +03:00
Artem Zuikov
1ee09a9f89 disable ColumnMatch::ColumnName logic 2020-06-06 02:14:18 +03:00
alexey-milovidov
5f99d887cc
Merge pull request #11443 from 4ertus2/strange
Rename setting
2020-06-06 01:45:21 +03:00
alexey-milovidov
f984cb750e
Update gtest_compressionCodec.cpp 2020-06-06 01:06:45 +03:00
Artem Zuikov
fdba90dd12 Merge branch 'master' into some 2020-06-06 00:50:42 +03:00
Artem Zuikov
0f37304521 hotfix: save tmp container 2020-06-06 00:28:44 +03:00
Artem Zuikov
c58f9bd43d refactoring: remove TableWithColumnNames 2020-06-06 00:17:00 +03:00
Alexander Kuzmenkov
3fd40098c4 fix same error in values() as well 2020-06-05 23:45:15 +03:00
Alexander Kuzmenkov
cd9b75db53 Merge remote-tracking branch 'origin/master' into HEAD 2020-06-05 23:43:24 +03:00
Alexander Kuzmenkov
d17a435fb6
Merge pull request #11226 from ClickHouse/aku/merge-perf-events
Merge Perf events metrics #9545
2020-06-05 23:10:54 +03:00
Vitaly Baranov
92ae3e11fa
Merge pull request #11356 from PerformanceVision/netloc_function
Create a netloc function for extracting network location
2020-06-05 22:13:38 +03:00
Vasily Nemkov
05ae8c405b Fixed using nullptr source and dest buffers in codecs, fixed test 2020-06-05 22:08:52 +03:00
Alexander Kuzmenkov
fc69811c7f generateRandom: check that all arguments are literals 2020-06-05 21:45:48 +03:00
Alexander Kuzmenkov
5523444d91 cleanup 2020-06-05 15:53:47 +03:00
Artem Zuikov
ecca78d855
fix trivial count with join (#11454) 2020-06-05 13:28:52 +03:00
Artem Zuikov
9717f3cfe5 make clang tidy happy 2020-06-05 13:27:54 +03:00
Alexander Kuzmenkov
7db8edf402
Merge pull request #11446 from ClickHouse/aku/better-error-messages
Improve error messages
2020-06-05 13:11:02 +03:00
Alexander Kuzmenkov
eaaf005a03
Merge pull request #11410 from ClickHouse/aku/logical-error-synonyms
Remove assorted synonyms of LOGICAL_ERROR
2020-06-05 13:10:40 +03:00
Nikolai Kochetov
f2350d3aec
Merge pull request #11415 from azat/SYSTEM-FLUSH-DISTRIBUTED-ON-CLUSTER
ON CLUSTER support for SYSTEM {FLUSH DISTRIBUTED,STOP/START DISTRIBUTED SENDS}
2020-06-05 12:59:38 +03:00
Nikolai Kochetov
5fea34d0e1 Use Resize instead of Concat in InterpreterInsertQuery. 2020-06-05 12:30:16 +03:00
hexiaoting
d2052dd1d4 show clusters 2020-06-05 17:13:13 +08:00
alexey-milovidov
0d30d1005f
Merge pull request #11448 from ClickHouse/fix-codecs-compression-size
Try fix return compressed size for codecs.
2020-06-05 04:43:58 +03:00
Alexey Milovidov
c9a883f2c4 Remove unneeded files 2020-06-05 02:07:13 +03:00
Alexey Milovidov
02e77e3406 Adjust some colors: minimum safe variant 2020-06-05 02:05:37 +03:00
Alexey Milovidov
275075b6f7 Revert all changes but save commit history from @kuskarov 2020-06-05 01:44:29 +03:00
Alexey Milovidov
fcd7fd8e7c Updates for #11422 2020-06-05 01:31:19 +03:00
Azat Khuzhin
1887e343ec Fix Pipeline stuck for INSERT SELECT FINAL
INSERT SELECT FINAL where SELECT (max_threads>1) has multiple streams
but INSERT has only one (max_insert_threads==0) will add ConcatProcessor
that will stuck the pipeline in this case.
2020-06-05 01:14:30 +03:00
Artem Zuikov
ab86ca2fb6 rename v2 2020-06-05 01:10:52 +03:00
Artem Zuikov
b66ad25841
IColumn::getDataType() (#11438) 2020-06-05 01:02:59 +03:00
Artem Zuikov
6d211bec19 fix trivial count with join 2020-06-05 01:01:40 +03:00
Alexey Milovidov
348d2098a4 Merge branch 'add_syntax_highlighting' of https://github.com/kuskarov/ClickHouse into kuskarov-add_syntax_highlighting 2020-06-04 23:57:20 +03:00
alexey-milovidov
1fd94de4b4
Update CompressionCodecGorilla.cpp 2020-06-04 23:51:07 +03:00
alexey-milovidov
f24a1f5210
Update CompressionCodecDoubleDelta.cpp 2020-06-04 23:50:31 +03:00
Nikolai Kochetov
d87b474665 Remove debug output. 2020-06-04 23:42:59 +03:00
Nikolai Kochetov
31ad5d7e5d Remove debug output. 2020-06-04 23:42:03 +03:00
Alexey Milovidov
f7398a9c09 Fix clang-tidy 2020-06-04 23:39:26 +03:00
Nikolai Kochetov
133037c410 Try fix return compressed size for codecs. 2020-06-04 20:56:53 +03:00
Alexey Milovidov
18999e4e7c Temporarily disable gtest_compressionCodec 2020-06-04 20:56:15 +03:00
Alexander Kuzmenkov
435f53e05a Improve error messages
Also support fmt for exception messages, the same way we use it in
logging macros.
2020-06-04 20:50:29 +03:00
Azat Khuzhin
ff85125326 Fix readability-qualified-auto 2020-06-04 20:23:46 +03:00
Azat Khuzhin
0f368c804d Fix SYSTEM START/STOP DISTRIBUTED SENDS w/o table name 2020-06-04 20:22:29 +03:00
Alexander Kuzmenkov
377da4656d cleanup 2020-06-04 18:51:34 +03:00
Artem Zuikov
24ee7346a9 rename setting 2020-06-04 17:31:57 +03:00
Alexander Kuzmenkov
029005be7c clang-tidy 2020-06-04 17:26:16 +03:00
Alexander Tokmakov
1c982d00e3 try fix sync 2020-06-04 16:59:12 +03:00
alesapin
22235c1951 Tiny fixes for storage s3 2020-06-04 16:48:20 +03:00
Nikolai Kochetov
18516ba09f Fix DelayedSource. 2020-06-04 16:46:27 +03:00
alesapin
b163052d1b
Merge pull request #11134 from GrigoryPervakov/custom-auth
Add default credentials and custom headers for s3 storage.
2020-06-04 16:46:01 +03:00
Nikolai Kochetov
563fe4ea35 Fix DelayedSource. 2020-06-04 16:45:23 +03:00
alesapin
bba558d68e Merge branch 'custom-auth' of https://github.com/GrigoryPervakov/ClickHouse into merging_s3_auth 2020-06-04 16:19:04 +03:00
Nikolai Kochetov
b419d73880 Fix build. 2020-06-04 16:16:58 +03:00
alesapin
603917999b
Merge pull request #11431 from ClickHouse/fix_codecs_arguments_crash
Fix segfault with wrong codecs arguments
2020-06-04 16:15:42 +03:00
Vladimir Chebotarev
d62e85f875 Improved logging of globs in S3. 2020-06-04 16:12:08 +03:00
Vladimir Chebotarev
423db7e39a Added tests for improved S3 URL parsing. 2020-06-04 16:12:04 +03:00
Nikolai Kochetov
dcf9b9ef39 Fix build. 2020-06-04 16:08:09 +03:00
Alexander Tokmakov
4dae169216 fix gcc warnings 2020-06-04 16:03:06 +03:00
Nikita Mikhaylov
4e4218e10d
Merge pull request #11385 from ClickHouse/akz/bg-processing-pool-update1
Extended BackgroundProcessingPool::startTask() to control task execution concurrency
2020-06-04 16:19:29 +04:00
Nikolai Kochetov
f54f948162 Added DelayedSource. 2020-06-04 15:17:35 +03:00
Mikhail Filimonov
26d93fdfba Fix the test, adjust default for queued.min.messages 2020-06-04 14:14:24 +02:00
Alexander Kuzmenkov
30d7d41ebc
Merge pull request #11381 from ClickHouse/aku/fuzz-related
Fuzzing-related changes.
2020-06-04 15:06:11 +03:00
Alexander Kuzmenkov
0943ef3e4b Do not set global context twice in unit tests. 2020-06-04 15:04:05 +03:00
Alexander Kuzmenkov
dacbe8e445
Update src/Interpreters/DatabaseCatalog.cpp 2020-06-04 14:06:07 +03:00
Alexander Kuzmenkov
13762854c6
Update src/Interpreters/DatabaseCatalog.cpp 2020-06-04 14:05:34 +03:00
Anton Popov
4a3d3c6e54
Merge pull request #11419 from CurtizJ/polymorphic-parts-2
Return lost comments and default values
2020-06-04 13:32:38 +03:00
Artem Zuikov
6cdeb060fb
Fix JOIN over LC and Nullable in key (#11414) 2020-06-04 13:07:22 +03:00
alesapin
7fac00ae15 Fix segfault with wrong codecs arguments 2020-06-04 11:55:56 +03:00
exprmntr
dcec02c983
Update ya.make.in 2020-06-04 11:38:25 +03:00
exprmntr
fccf282829
Update ya.make 2020-06-04 11:36:38 +03:00
alesapin
0a453f5c83
Merge pull request #11420 from ClickHouse/fix-msan-failure
Fix MSan failure in MergeTree background task
2020-06-04 10:59:44 +03:00
Tagir Kuskarov
61bfe0b738 Style fix 2020-06-04 07:09:26 +04:00
Tagir Kuskarov
088394a61f Style fix 2020-06-04 06:54:53 +04:00
Tagir Kuskarov
af9e1c7d86 Merge from master 2020-06-04 05:56:30 +04:00
Tagir Kuskarov
bccf2ef39f UTF8 length used 2020-06-04 05:42:32 +04:00
Tagir Kuskarov
fed90652c9 Move files 2020-06-04 05:04:57 +04:00
Alexey Ilyukhov
1daf1146e1 Fix pointInPolygon with nan 2020-06-04 03:59:07 +03:00
Azat Khuzhin
86c5465bf8 Rewrite StorageSystemDistributionQueue interfaces 2020-06-04 03:04:32 +03:00
Azat Khuzhin
aa13bd9530 Fix possible SIGSEGV in StorageSystemDistributionQueue
Refs: #11348
2020-06-04 03:04:28 +03:00
Azat Khuzhin
f0050adc51 Make system.distribution_queue metrics non racy 2020-06-04 02:36:16 +03:00
Azat Khuzhin
09c3ca9c6c Add last_exception into system.distribution_queue 2020-06-04 02:36:16 +03:00