Commit Graph

94626 Commits

Author SHA1 Message Date
Azat Khuzhin
a1981f21a1
Merge branch 'master' into stress-oom 2022-08-07 10:42:04 +02:00
Igor Nikonov
b4f5d9ca10
Merge pull request #39740 from ClickHouse/ordinary_distinct_small_refact
Simple refactoring: ordinary DISTINCT implementation
2022-08-07 01:05:23 +02:00
Azat Khuzhin
64aa8c7cde
Merge branch 'master' into stress-oom 2022-08-06 20:47:09 +02:00
Alexander Gololobov
f52b6748db
Merge pull request #39900 from ClickHouse/wait_for_mutation_race
Fix the race between waitMutation and updating local queue from ZK
2022-08-06 12:09:16 +02:00
Azat Khuzhin
3772415588 tests/stress: add dmesg output (to see OOM details)
max_server_memory_usage already set to 75%, so OOM should not happens,
the reason is that because RSS does not match with memory tracker
statistics:

    2022.08.05 12:36:57.869896 [ 82524 ] {} <Trace> AsynchronousMetrics: MemoryTracking: was 64.69 GiB, peak 65.26 GiB, will set to 62.80 GiB (RSS), difference: -1.89 GiB
    ...
    2022.08.05 12:37:00.213440 [ 82334 ] {} <Error> void DB::MergeTreeBackgroundExecutor<DB::MergeMutateRuntimeQueue>::routine(DB::TaskRuntimeDataPtr) [Queue = DB::MergeMutateRuntimeQueue]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 64.68 GiB (attempt to allocate chunk of 1298794 bytes), maximum: 51.44 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or orvercommit denominator are set to zero.. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-08-06 12:34:38 +03:00
Alexey Milovidov
f08952b74c
Merge pull request #39735 from ClickHouse/ci-simple-check-refactoring
CI: refactor Simple Check, use statuses to make it stateful
2022-08-06 02:04:36 +03:00
Alexey Milovidov
adc880f362
Merge pull request #39867 from ClickHouse/keeper-block-memory-tracker-commit
Block memory tracker in Keeper during commit
2022-08-06 02:02:29 +03:00
Alexey Milovidov
a4a3867585
Merge pull request #39849 from skyhotqin/patch-1
Update dbms-naming.md
2022-08-06 02:01:30 +03:00
Alexey Milovidov
ac93f0a2ca
Merge pull request #39910 from santrancisco/enhance-playui-authentication
Move username and password from URL parameters to Basic Authentication
2022-08-06 01:58:09 +03:00
Alexey Milovidov
20fdc5b77b
Merge pull request #39898 from pkit/pkit/fix_mkdir_nfs
fix broken NFS mkdir introduced in #36341
2022-08-06 01:54:57 +03:00
Igor Nikonov
8278da6475 Fix: read row counts before move columns out of chunk 2022-08-05 21:29:57 +00:00
Igor Nikonov
9fddf6efde Merge remote-tracking branch 'origin/master' into ordinary_distinct_small_refact 2022-08-05 19:23:44 +00:00
Alexander Gololobov
b57df6d71d
Merge branch 'master' into wait_for_mutation_race 2022-08-05 18:51:39 +02:00
Nikolai Kochetov
c6e3e14bcc
Merge pull request #39184 from ClickHouse/respect-remote_url_allow_hosts-for-other-dict-sources
Respect remote_url_allow_hosts in relevant dictionary sources.
2022-08-05 17:25:53 +02:00
Nikolai Kochetov
0005c37acc
Merge pull request #39477 from azat/fix-mv-drop-race
Fix LOGICAL_ERROR on race between DROP and INSERT with materialized views
2022-08-05 17:19:45 +02:00
Yakov Olkhovskiy
1a52fa183d rename Simple Check to Mergeable Check, refactor processing 2022-08-05 10:39:58 -04:00
Alexander Tokmakov
c983f14ed1
Merge pull request #39925 from ClickHouse/log_test_on_connection_close
Add logging to debug flaky tests
2022-08-05 16:20:17 +03:00
Anton Popov
530c6bd6a4
Merge pull request #39927 from ClickHouse/CurtizJ-patch-6
Fix flaky test `02360_send_logs_level_colors`
2022-08-05 14:51:54 +02:00
Nikita Taranov
340ff4f1ad
impl (#39908) 2022-08-05 14:51:18 +02:00
Anton Popov
c3608de37e
fix flaky test 02360_send_logs_level_colors 2022-08-05 14:50:39 +02:00
Yakov Olkhovskiy
9dfd650a7c
Merge pull request #39763 from ClickHouse/util-self-extracting-exec
Self-extracting - run resulting executable with execvp
2022-08-05 08:13:15 -04:00
Alexander Tokmakov
25a9bf5deb
Merge pull request #39922 from ClickHouse/fix_flaky_tests_commit_obsolete_part
Fix flaky tests (`Tried to commit obsolete part`)
2022-08-05 14:36:43 +03:00
Alexander Tokmakov
e59f217f8d add test logs on connection close 2022-08-05 13:33:27 +02:00
Nikolai Kochetov
cf34232675 Output header is now empty for every MV chain.
Instead of checking that number of processors different for different
threads, simply always return empty header from buildChainImpl(), by
adding explicit conversion.

v2: ignore UNKNOWN_TABLE errors in test
2022-08-05 13:16:32 +03:00
Azat Khuzhin
4efa847a1f Fix LOGICAL_ERROR on race between DROP and INSERT with materialized views
In case of parallel INSERT (max_insert_threads > 1) it is possible for
VIEW to be DROP/DETACH'ed while building pipeline for various paralell
streams, and in this case the header will not match since when you have
VIEW you will got empty header and non-empty header otherwise.

And this leads to LOGICAL_ERROR later, while checking that output
headers are the same (in QueryPipelineBuilder::addChains() -> Pipe::addChains()).

However it also makes the pipeline different for various parallel
streams, and it looks like it is better to fail in this case, so instead
of always returning empty header from buildChainImpl() explicit check
had been added.

Note, that I wasn't able to reproduce the issue with the added test,
but CI may have more "luck" (although I've verified it manually).

Fixes: #35902
Cc: @KochetovNicolai
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-08-05 13:16:32 +03:00
alesapin
48e55ff4c7
Merge pull request #39795 from ClickHouse/cloudflare-dns-fallback
Add cloudflare DNS as a fallback
2022-08-05 12:14:45 +02:00
Alexander Tokmakov
65e1ce8ad1
Merge pull request #39674 from tonickkozlov/tonickkozlov/fix-default-database-resolution
Default database resolution in distributed reads
2022-08-05 13:09:15 +03:00
Alexander Tokmakov
4bf7a2ca3a fix warning 2022-08-05 12:05:50 +02:00
alesapin
329120ca7a
Merge pull request #39755 from ClickHouse/keeper-create-snapshot-on-exit
Create Keeper snapshot on exit
2022-08-05 12:00:16 +02:00
Nikolai Kochetov
2fe893ba67
Merge pull request #25563 from ClickHouse/use-dag-in-key-condition
Use ActionsDAG in KeyCondition
2022-08-05 11:22:46 +02:00
Alexander Tokmakov
d9190a8121
Merge pull request #39872 from ClickHouse/store_cleanup_all_disks
Cleanup unused dirs from `store/` on all disks
2022-08-05 12:21:59 +03:00
Ilya Yatsishin
e583345987
Merge pull request #38978 from qoega/integration-tests-7 2022-08-05 07:21:18 +02:00
Alexey Milovidov
eda78bc130
Merge pull request #39707 from gingerwizard/escape_diag_creds
Escape credentials for diagnostics tool
2022-08-05 07:26:09 +03:00
Alexey Milovidov
3130aa7218
Merge pull request #39732 from HarryLeeIBM/hlee-s390x-unaligned
Fix Endian issue in SipHash for s390x
2022-08-05 07:24:57 +03:00
Alexey Milovidov
995e7ab350
Merge pull request #39886 from pzhdfy/fix_netlink_leak
fix potential netlink leak when init fail in TaskStatsInfoGetter
2022-08-05 07:13:59 +03:00
Alexey Milovidov
67a6b32a89
Update entrypoint.sh 2022-08-05 07:12:50 +03:00
Alexey Milovidov
9b0322e04a
Merge pull request #39911 from ClickHouse/alexey-milovidov-patch-4
Remove cache flush from the Docs Check
2022-08-05 07:11:33 +03:00
Alexey Milovidov
7cdd89a7d8
Merge pull request #39912 from den-crane/patch-30
Doc. Remove note that s3 is experimental Update mergetree.md
2022-08-05 07:10:45 +03:00
santrancisco
c7f0598a6f Fall back to url parameters if file is opened locally 2022-08-05 13:10:45 +10:00
Denny Crane
3f4baa7658
Update mergetree.md 2022-08-04 23:49:19 -03:00
Alexey Milovidov
5363e2cf47
Remove cache flush from the Docs Check 2022-08-05 05:13:46 +03:00
santrancisco
a25b858097 Move username and password from URL parameter to Basic Authentication header 2022-08-05 09:51:12 +10:00
Anton Popov
0492ef63a4
Merge pull request #39464 from CurtizJ/fix-custom-serializations
Fix columns of type `Object` with sparse serialization
2022-08-05 00:55:41 +02:00
Kseniia Sumarokova
ba53ed274b
Merge pull request #39327 from kssenii/update-azure-lib
Update azure library (removed "harmful" function)
2022-08-05 00:20:43 +02:00
Amos Bird
6a3a9dcf96
Fix building aggregate projections when external aggregation is on (#39671) 2022-08-04 23:29:26 +02:00
Alexander Gololobov
3cd9e5b95e
Merge branch 'master' into wait_for_mutation_race 2022-08-04 22:50:03 +02:00
Mikhail f. Shiryaev
6c5a2a1214
Merge pull request #39853 from ClickHouse/release-tweak-generate
Update tweak on version part update
2022-08-04 21:34:00 +02:00
Mikhail f. Shiryaev
0d1c31a869
Merge branch 'master' into release-tweak-generate 2022-08-04 21:33:54 +02:00
Alexander Gololobov
eb3e2ed092
Merge branch 'master' into wait_for_mutation_race 2022-08-04 20:27:09 +02:00
Alexander Gololobov
f5e358ecc5 Make sure that the current replica is the first on the list 2022-08-04 20:26:39 +02:00