Commit Graph

73049 Commits

Author SHA1 Message Date
Maksim Kita
d59986f224
Merge pull request #29278 from kitaisreal/bloom-filter-map-added-support-for-has-function
Bloom filter map added support for has function
2021-09-23 12:03:56 +03:00
alesapin
d1bb8d666e Move all yaml tests to clickhouse config 2021-09-23 11:08:40 +03:00
Kseniia Sumarokova
2c0b59576e
Merge pull request #29285 from kssenii/remove-debug
Remove debug stderr
2021-09-23 10:54:32 +03:00
kssenii
6c1312760f Remove debug 2021-09-23 07:52:52 +00:00
Kseniia Sumarokova
f7ff14b407
Merge pull request #28577 from kssenii/named-collections
Predefined connections and other parameters for external data sources
2021-09-23 10:25:23 +03:00
Azat Khuzhin
015695b3bf Fix connection timeouts (send_timeout/receive_timeout)
Query is not executed within sendQuery() function.

INSERT query consist from multiple parts:
- sendQuery()
- write()/writePrepared() -- send Data blocks
- writeSuffix() -- send empty Data block and receive EndOfStream
(see RemoteBlockOutputStream for more info)
So as you can see it is not executed completely from the sendQuery() function.

SELECT query (and others) also send Data blocks to the client after.

And what this means that temporary timeout (via TimeoutSetter) is not
enough, since next query can use timeout from the previous query.

Usually you do not see it, because:
- You don't use custom send_timeout/receive_timeout
- SELECT is fast enough

However it is not the case with INSERT, especially with
insert_distributed_sync=1, since
DistributedBlockOutputStream::writeSuffix() may stack because remote
server still INSERT'ing the data (i.e. creating znodes in zookeeper for
ReplicatedMergeTree, syncing blocks, and similar) that was issued from
DistributedBlockOutputStream::write(), and it will lead to the following
exception:

    Code: 209, e.displayText() = DB::NetException: Timeout exceeded while reading from socket (127.1:9000): while receiving packet from ch-47-drt.dpa.semrush.net:9000: Insertion status:
    Wrote X blocks and Y rows on shard Z replica 0, 127.1:9000 (average 0 ms per block, the slowest block N ms)
    0. DB::Exception::Exception()
    1. DB::ReadBufferFromPocoSocket::nextImpl()
    2. void DB::readVarUIntImpl<false>(unsigned long&, DB::ReadBuffer&)
    3. DB::Connection::receivePacket()
    4. DB::RemoteBlockOutputStream::writeSuffix()
    ...
2021-09-23 09:03:13 +03:00
bharatnc
727182c3a4 Add review fixes 2021-09-22 22:50:33 -07:00
Maksim Kita
ebbefd49c3 FullText bloom filter index added support for Array data type 2021-09-23 02:06:54 +03:00
Maksim Kita
d5a7e92b97 Bloom filter map added support for has function 2021-09-23 01:10:14 +03:00
Maksim Kita
1bf375e2b7
Merge pull request #29254 from kitaisreal/map-bloom-filter-index-updated
Updated bloom filter index for map type to work with mapKeys, mapValues functions
2021-09-23 00:31:14 +03:00
Maksim Kita
2920e124f3
Merge pull request #29267 from kitaisreal/function-has-support-map-type
Function has support map type
2021-09-23 00:26:58 +03:00
Nikita Mikhaylov
32aa2ca939
Merge pull request #29257 from nikitamikhaylov/race-merge-task
Fix segfault in fast test
2021-09-23 00:12:31 +03:00
alexey-milovidov
0b0be96f43
Update github-events.md 2021-09-22 23:56:42 +03:00
mergify[bot]
d69fc35dd9
Merge branch 'master' into compressed_logs 2021-09-22 19:43:16 +00:00
alesapin
65f2395165
Merge pull request #29268 from ClickHouse/add_missed_test
Add missed keeper jepsen config
2021-09-22 22:41:58 +03:00
Maksim Kita
be256cc9ed
Merge pull request #29270 from hhell/patch-1
Fix typo in an error message
2021-09-22 21:36:04 +03:00
hhell
fc166570d8
Fix typo in an error message
Related: https://github.com/ClickHouse/ClickHouse/issues/20551
2021-09-22 21:33:15 +03:00
Maksim Kita
7eca0a1486
Merge pull request #29258 from vdimir/fuse-quantileBFloat16Weighted
Add NameQuantileBFloat16Weighted to GatherFunctionQuantileVisitor
2021-09-22 20:38:55 +03:00
Maksim Kita
6dc41ad653 Fixed tests 2021-09-22 20:31:49 +03:00
Maksim Kita
93208fca4b Bloom filter for map data type dded support for IN, mapContains functions 2021-09-22 20:25:10 +03:00
Kseniia Sumarokova
b41a446e8b
Delete getEngineConnectionArguments.h 2021-09-22 19:52:55 +03:00
alesapin
dbff8fd03b Add missed keeper jepsen config 2021-09-22 19:27:11 +03:00
Dmitriy
2755b2d93a Merge remote-tracking branch 'remotes/clickhouse/master' into sevirov-DOCSUP-14334-clickhouse_over_web_server_with_static_files 2021-09-22 19:15:36 +03:00
Dmitriy
8f9a45ea05
DOCSUP-14458: Edit and translate to Russian (two settings and subBitmap function) (#28996)
* Edit and translate to Russian

Выполнил перевод на русский язык.

* Update settings.md

Поправил документацию.

* Update docs/ru/operations/settings/settings.md

Co-authored-by: olgarev <56617294+olgarev@users.noreply.github.com>

* Update docs/ru/operations/settings/settings.md

Co-authored-by: olgarev <56617294+olgarev@users.noreply.github.com>

* Update docs/ru/sql-reference/functions/bitmap-functions.md

Co-authored-by: olgarev <56617294+olgarev@users.noreply.github.com>

* Update docs/ru/sql-reference/functions/bitmap-functions.md

Co-authored-by: olgarev <56617294+olgarev@users.noreply.github.com>

* Update docs/ru/sql-reference/functions/bitmap-functions.md

Co-authored-by: olgarev <56617294+olgarev@users.noreply.github.com>

* Update bitmap-functions.md

Обновил описание.

* Update docs/ru/sql-reference/functions/bitmap-functions.md

Co-authored-by: olgarev <56617294+olgarev@users.noreply.github.com>

* Update docs/ru/sql-reference/functions/bitmap-functions.md

Co-authored-by: olgarev <56617294+olgarev@users.noreply.github.com>

* Update docs/en/sql-reference/functions/bitmap-functions.md

Co-authored-by: olgarev <56617294+olgarev@users.noreply.github.com>

* Update docs/ru/sql-reference/functions/bitmap-functions.md

Co-authored-by: olgarev <56617294+olgarev@users.noreply.github.com>

* Update docs/en/sql-reference/functions/bitmap-functions.md

Co-authored-by: olgarev <56617294+olgarev@users.noreply.github.com>

* Update subBitmap function

Поправил описание функции subBitmap.

Co-authored-by: Dmitriy <sevirov@yandex-team.ru>
Co-authored-by: olgarev <56617294+olgarev@users.noreply.github.com>
2021-09-22 19:12:31 +03:00
Dmitriy
9dad40af9a Merge remote-tracking branch 'remotes/clickhouse/master' into sevirov-DOCSUP-14537-document_the_log_queries_probability_setting 2021-09-22 19:08:33 +03:00
Maksim Kita
c73808615b Function has support map type 2021-09-22 19:08:08 +03:00
Kruglov Pavel
b46e4db70e
Fix PVS check 2.0 2021-09-22 18:22:34 +03:00
kssenii
a84fc77b52 Fixes 2021-09-22 18:10:25 +03:00
alesapin
3bea8d5201 Fix config root name 2021-09-22 18:00:08 +03:00
Vladimir C
c83e2f6fd4
Merge pull request #29259 from vdimir/test-global-multiproc-fix 2021-09-22 17:47:08 +03:00
tavplubix
ba82781e11
Merge pull request #29061 from ClickHouse/remove_some_trash
Fix `system.distributed_ddl_queue`
2021-09-22 16:58:29 +03:00
mergify[bot]
c5ef025b64
Merge branch 'master' into fix-msgpack 2021-09-22 13:33:05 +00:00
tavplubix
7712d0e9df
Update clickhouse-test 2021-09-22 16:17:51 +03:00
vdimir
3a42d11b65
Initialize global variables for multiproc in __main__ in clickhouse-test 2021-09-22 16:00:59 +03:00
vdimir
eb1053d931
Add NameQuantileBFloat16Weighted to GatherFunctionQuantileVisitor 2021-09-22 15:53:39 +03:00
mergify[bot]
a3f62af09c
Merge branch 'master' into race-merge-task 2021-09-22 12:42:45 +00:00
Kruglov Pavel
e8dca52e8b
Merge pull request #28946 from sevirov/sevirov-DOCSUP-13429-document_the_short_circuit_function_evaluation_setting
DOCSUP-13429: Document the short_circuit_function_evaluation setting
2021-09-22 15:33:52 +03:00
vdimir
431a4718ae
Add quantileBFloat16Weighted to doc en,ru 2021-09-22 14:55:14 +03:00
Nikita Mikhaylov
558c74e826 Done 2021-09-22 11:52:47 +00:00
Maksim Kita
daee6054f8
Merge pull request #29208 from olgarev/revolg-DOCSUP-12136-add_heredoc_syntax
Add new syntax heredoc
2021-09-22 14:41:21 +03:00
Kruglov Pavel
7545bff76c
Minor update 2021-09-22 13:47:03 +03:00
alesapin
258ce2436a
Merge pull request #29237 from CurtizJ/better-logging
Better diagnostic in ReplicatedMergeTree
2021-09-22 13:45:10 +03:00
alesapin
f980a414ee Better tests and ability to work without compression 2021-09-22 13:38:06 +03:00
mergify[bot]
627a4fea96
Merge branch 'master' into fix-msgpack 2021-09-22 10:14:18 +00:00
Pavel Kruglov
9ed82fb44a Fix PVS check 2021-09-22 13:13:05 +03:00
olgarev
7de9ce601e Merge branch 'master' into revolg-DOCSUP-12136-add_heredoc_syntax 2021-09-22 09:54:07 +00:00
Maksim Kita
3b505a15e2 Updated test 2021-09-22 12:48:34 +03:00
Maksim Kita
92fd6b376f Updated bloom filter index for map type to work with mapKeys function 2021-09-22 12:45:48 +03:00
Kseniia Sumarokova
192c5397cc
Merge pull request #29211 from kssenii/better-retries-2
Fix retries for disk web
2021-09-22 12:37:25 +03:00
alesapin
3a11cc59b0 Rename back 2021-09-22 12:16:56 +03:00