Commit Graph

94792 Commits

Author SHA1 Message Date
Yakov Olkhovskiy
ea51edde78 dedicated http test 2022-08-05 09:39:20 -04:00
Alexander Tokmakov
c983f14ed1
Merge pull request #39925 from ClickHouse/log_test_on_connection_close
Add logging to debug flaky tests
2022-08-05 16:20:17 +03:00
Anton Popov
530c6bd6a4
Merge pull request #39927 from ClickHouse/CurtizJ-patch-6
Fix flaky test `02360_send_logs_level_colors`
2022-08-05 14:51:54 +02:00
Nikita Taranov
340ff4f1ad
impl (#39908) 2022-08-05 14:51:18 +02:00
Anton Popov
c3608de37e
fix flaky test 02360_send_logs_level_colors 2022-08-05 14:50:39 +02:00
Yakov Olkhovskiy
4c78f0fc7d
Merge branch 'master' into ci-self-extracting-s3-deployment 2022-08-05 08:14:48 -04:00
Yakov Olkhovskiy
9dfd650a7c
Merge pull request #39763 from ClickHouse/util-self-extracting-exec
Self-extracting - run resulting executable with execvp
2022-08-05 08:13:15 -04:00
Alexander Tokmakov
25a9bf5deb
Merge pull request #39922 from ClickHouse/fix_flaky_tests_commit_obsolete_part
Fix flaky tests (`Tried to commit obsolete part`)
2022-08-05 14:36:43 +03:00
Alexander Tokmakov
e59f217f8d add test logs on connection close 2022-08-05 13:33:27 +02:00
Nikolai Kochetov
cf34232675 Output header is now empty for every MV chain.
Instead of checking that number of processors different for different
threads, simply always return empty header from buildChainImpl(), by
adding explicit conversion.

v2: ignore UNKNOWN_TABLE errors in test
2022-08-05 13:16:32 +03:00
Azat Khuzhin
4efa847a1f Fix LOGICAL_ERROR on race between DROP and INSERT with materialized views
In case of parallel INSERT (max_insert_threads > 1) it is possible for
VIEW to be DROP/DETACH'ed while building pipeline for various paralell
streams, and in this case the header will not match since when you have
VIEW you will got empty header and non-empty header otherwise.

And this leads to LOGICAL_ERROR later, while checking that output
headers are the same (in QueryPipelineBuilder::addChains() -> Pipe::addChains()).

However it also makes the pipeline different for various parallel
streams, and it looks like it is better to fail in this case, so instead
of always returning empty header from buildChainImpl() explicit check
had been added.

Note, that I wasn't able to reproduce the issue with the added test,
but CI may have more "luck" (although I've verified it manually).

Fixes: #35902
Cc: @KochetovNicolai
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-08-05 13:16:32 +03:00
alesapin
48e55ff4c7
Merge pull request #39795 from ClickHouse/cloudflare-dns-fallback
Add cloudflare DNS as a fallback
2022-08-05 12:14:45 +02:00
Alexander Tokmakov
65e1ce8ad1
Merge pull request #39674 from tonickkozlov/tonickkozlov/fix-default-database-resolution
Default database resolution in distributed reads
2022-08-05 13:09:15 +03:00
Alexander Tokmakov
4bf7a2ca3a fix warning 2022-08-05 12:05:50 +02:00
alesapin
329120ca7a
Merge pull request #39755 from ClickHouse/keeper-create-snapshot-on-exit
Create Keeper snapshot on exit
2022-08-05 12:00:16 +02:00
Nikolai Kochetov
2fe893ba67
Merge pull request #25563 from ClickHouse/use-dag-in-key-condition
Use ActionsDAG in KeyCondition
2022-08-05 11:22:46 +02:00
Alexander Tokmakov
d9190a8121
Merge pull request #39872 from ClickHouse/store_cleanup_all_disks
Cleanup unused dirs from `store/` on all disks
2022-08-05 12:21:59 +03:00
Constantine Peresypkin
10c76917ea fix nats-io TLS support
nats-io library needs `NATS_HAS_TLS` define to correctly compile-in TLS
support

fixes #39525
2022-08-05 11:20:05 +02:00
Yakov Olkhovskiy
96c1dcdbb1 add HTTP test 2022-08-05 02:32:52 -04:00
Ilya Yatsishin
e583345987
Merge pull request #38978 from qoega/integration-tests-7 2022-08-05 07:21:18 +02:00
Alexey Milovidov
eda78bc130
Merge pull request #39707 from gingerwizard/escape_diag_creds
Escape credentials for diagnostics tool
2022-08-05 07:26:09 +03:00
Alexey Milovidov
3130aa7218
Merge pull request #39732 from HarryLeeIBM/hlee-s390x-unaligned
Fix Endian issue in SipHash for s390x
2022-08-05 07:24:57 +03:00
Alexey Milovidov
995e7ab350
Merge pull request #39886 from pzhdfy/fix_netlink_leak
fix potential netlink leak when init fail in TaskStatsInfoGetter
2022-08-05 07:13:59 +03:00
Alexey Milovidov
67a6b32a89
Update entrypoint.sh 2022-08-05 07:12:50 +03:00
Alexey Milovidov
9b0322e04a
Merge pull request #39911 from ClickHouse/alexey-milovidov-patch-4
Remove cache flush from the Docs Check
2022-08-05 07:11:33 +03:00
Alexey Milovidov
7cdd89a7d8
Merge pull request #39912 from den-crane/patch-30
Doc. Remove note that s3 is experimental Update mergetree.md
2022-08-05 07:10:45 +03:00
santrancisco
c7f0598a6f Fall back to url parameters if file is opened locally 2022-08-05 13:10:45 +10:00
Denny Crane
3f4baa7658
Update mergetree.md 2022-08-04 23:49:19 -03:00
Alexey Milovidov
5363e2cf47
Remove cache flush from the Docs Check 2022-08-05 05:13:46 +03:00
santrancisco
a25b858097 Move username and password from URL parameter to Basic Authentication header 2022-08-05 09:51:12 +10:00
Anton Popov
0492ef63a4
Merge pull request #39464 from CurtizJ/fix-custom-serializations
Fix columns of type `Object` with sparse serialization
2022-08-05 00:55:41 +02:00
Kseniia Sumarokova
ba53ed274b
Merge pull request #39327 from kssenii/update-azure-lib
Update azure library (removed "harmful" function)
2022-08-05 00:20:43 +02:00
Amos Bird
6a3a9dcf96
Fix building aggregate projections when external aggregation is on (#39671) 2022-08-04 23:29:26 +02:00
Alexander Gololobov
3cd9e5b95e
Merge branch 'master' into wait_for_mutation_race 2022-08-04 22:50:03 +02:00
Robert Schulze
cb146ee6f1
Rename LibraryBridgeHelper to ExternalDictionaryLibraryBridgeHelper
- ExternalDictionaryLibraryBridgeHelper provides the server-side
  interface to access the dictionary part of the library bridge.

- In a later commit, CatBoostLibraryBridgeHelper will be added to access
  the catboost part of the library bridge from the server.
2022-08-04 19:58:37 +00:00
Mikhail f. Shiryaev
6c5a2a1214
Merge pull request #39853 from ClickHouse/release-tweak-generate
Update tweak on version part update
2022-08-04 21:34:00 +02:00
Mikhail f. Shiryaev
0d1c31a869
Merge branch 'master' into release-tweak-generate 2022-08-04 21:33:54 +02:00
Robert Schulze
20bb8a248e
Prepare server-side BridgeHelper for catboost integration
Wall of text, sorry, but I also had to document some stuff for myself:

There are three ways to communicate data using HTTP:
- the HTTP verb: for our purposes, PUT and GET,
- the HTTP path: '/ping', '/request' etc.,
- the HTTP URL parameter(s), e.g. 'method=libNew&dictionary_id=1234'

The bridge will use different handlers for communication with the
external dictionary library and for communication with the catboost
library. Handlers are created based on a combination of the HTTP verb
and the HTTP method. More specifically, there will be combinations
- GET + '/extdict_ping'
- PUT + '/extdict_request'
- GET + '/catboost_ping'
- PUT + '/catboost_request'.
For each combination, the bridge expects a certain set of URL
parameters, e.g. for the first combination parameter "dictionary_id" is
expected.

Starting with this commit, the library-bridge creates handlers based on
the first two combinations (the latter two combinations will be added
later). This makes the handler creation mechanism consistent with it's
counterpart in xdbc-bridge.

For that, it was necessary to make both IBridgeHelper methods
"getMainURI()" and "getPingURI()" pure virtual so that derived classes
(LibraryBridgeHelper and XDBCBridgeHelper) must provide custom URLs with
custom paths.

Side note 1: Previously, LibraryBridgeHelper sent HTTP URL parameter
"method=ping" during handshake (PING) but the library-bridge ignored
that parameter. We now omit this parameter, i.e.
LibraryBridgeHelper::PING was removed. Again, this makes things
consistent with xdbc-bridge.

Side note 2: xdbc-bridge is unchanged in this commit. Therefore,
XDBCBridgeHelper now uses the HTTP paths previously in the base class.
For funny reason, XDBCBridgeHelper did not use
IBridgeHelper::getMainURI() - it generates the URLs by itself. I kept it
that way for now but provided an implementation of getMainURI() anyways.
2022-08-04 19:29:51 +00:00
Robert Schulze
7df30747f3
Typos 2022-08-04 19:27:38 +00:00
Robert Schulze
ea73b98fb9
Prepare library-bridge for catboost integration
- Rename generic file and identifier names in library-bridge to
  something more dictionary-specific. This is needed because later on,
  catboost will be integrated into library-bridge.

- Also: Some smaller fixes like typos and un-inlining non-performance
  critical code.

- The logic remains unchanged in this commit.
2022-08-04 19:26:51 +00:00
Arthur Passos
62d48053c0 Use insertDefault instead of insert(0) 2022-08-04 15:53:44 -03:00
Arthur Passos
c307e9a228 Fix ArrowColumn dictionary to CH low cardinality conversion 2022-08-04 15:34:44 -03:00
Alexander Gololobov
eb3e2ed092
Merge branch 'master' into wait_for_mutation_race 2022-08-04 20:27:09 +02:00
Alexander Gololobov
f5e358ecc5 Make sure that the current replica is the first on the list 2022-08-04 20:26:39 +02:00
Alexander Tokmakov
110b60e5b7 fix tests 2022-08-04 19:48:55 +02:00
Alexander Tokmakov
460f2f2e39 Merge branch 'master' into store_cleanup_all_disks 2022-08-04 19:48:41 +02:00
Yakov Olkhovskiy
23037daf17
Merge branch 'master' into fix-quota-key 2022-08-04 12:14:49 -04:00
Alexander Tokmakov
20cf4e8d22 slightly more readable if conditions 2022-08-04 18:04:06 +02:00
Nikolai Kochetov
60599197b2 Review fixes. 2022-08-04 15:23:10 +00:00
Nikolai Kochetov
658a269d56
Merge branch 'master' into use-dag-in-key-condition 2022-08-04 16:18:40 +02:00