Commit Graph

119492 Commits

Author SHA1 Message Date
Kruglov Pavel
64e88cde21
Merge branch 'master' into better-progress-bar-2 2023-07-18 13:37:53 +02:00
Kruglov Pavel
37054e7b47
Merge pull request #51603 from Avogar/full-filename-placeholder
Add placeholder for full filename in rename_files_after_processing setting
2023-07-18 13:37:06 +02:00
Nikolai Kochetov
b542fe364a
Merge pull request #52223 from ClickHouse/rename-constants-in-key-condition
Fix 01889_key_condition_function_chains for analyzer.
2023-07-18 13:19:02 +02:00
Nikolai Kochetov
83e9ec117c
Merge pull request #51481 from ClickHouse/fix-the-same-names-for-lift-up-functions-before-sorting
Fix optimization to move functions before sorting.
2023-07-18 12:34:51 +02:00
Nikolai Kochetov
008238be71
Merge pull request #52235 from ClickHouse/vdimir/02273_no_upgrade_check
Enable no-upgrade-check for 02273_full_sort_join
2023-07-18 12:16:54 +02:00
robot-ch-test-poll2
d816d8b92f
Merge pull request #52198 from azat/qemu-compressor
Fix self extracting binaries under qemu linux-user (qemu-$ARCH-static)
2023-07-18 12:02:47 +02:00
vdimir
dc55c8ed8e
Enable no-upgrade-check for 02273_full_sort_join 2023-07-18 09:54:33 +00:00
Alexey Milovidov
5637c419bd
Merge pull request #52124 from ClickHouse/update-cctz-5
Update CCTZ
2023-07-18 03:29:52 +03:00
Alexey Milovidov
f4e095b502
Merge pull request #52149 from ucasfl/array_concat_agg
Add array_concat_agg for compatibility with BigQuery
2023-07-18 03:03:27 +03:00
Robert Schulze
46e03432a9
Merge pull request #52196 from rschu1ze/simplify-job-limiting
CMake: Simplify job limiting
2023-07-17 22:43:40 +02:00
robot-clickhouse-ci-1
2b1be4b89d
Merge pull request #52063 from valbok/disconnect-on-dtor
MySQL: Delay disconnection of mysqlxx::Pool::Entry until refcount==0
2023-07-17 22:29:58 +02:00
Nikolai Kochetov
a955d5621d Rename constants in KeyCondition analysis. 2023-07-17 18:53:12 +00:00
Kruglov Pavel
d3d0f101f7
Merge branch 'master' into full-filename-placeholder 2023-07-17 19:14:10 +02:00
Robert Schulze
1dbc88630d
Cosmetics 2023-07-17 17:10:08 +00:00
Alexey Milovidov
9f45513acf
Merge pull request #52173 from ClickHouse/fix-slow-test-02317_distinct_in_order_optimization
Fix slow test `02317_distinct_in_order_optimization`
2023-07-17 19:57:41 +03:00
Kruglov Pavel
2793305a71
Merge pull request #51825 from ucasfl/schema
Fix use_structure_from_insertion_table_in_table_functions does not work with materialized and alias columns
2023-07-17 18:25:54 +02:00
Nikita Mikhaylov
d4c8383627
Merge pull request #52216 from ClickHouse/revert-51736-oss-fuzz-fixes
Revert "Fixed several issues found by OSS-Fuzz"
2023-07-17 17:19:18 +02:00
Antonio Andelic
bfe349a7e4
Merge pull request #52189 from ClickHouse/fix-test_multiple_disks
Fix `test_multiple_disks/test.py::test_start_stop_moves`
2023-07-17 16:28:02 +02:00
Nikita Mikhaylov
2a2ebb1f31 Bump 2023-07-17 14:26:11 +00:00
Antonio Andelic
51f0089457
Merge branch 'master' into fix-test_multiple_disks 2023-07-17 16:25:06 +02:00
vdimir
5de1cfee7d
Merge pull request #51735 from arenadata/ADQM-976 2023-07-17 16:24:11 +02:00
Nikita Mikhaylov
9a30aaa9aa
Revert "Fixed several issues found by OSS-Fuzz" 2023-07-17 16:14:58 +02:00
Robert Schulze
8f8cb5eb82
Update cmake/limit_jobs.cmake
Co-authored-by: János Benjamin Antal <antaljanosbenjamin@users.noreply.github.com>
2023-07-17 15:48:12 +02:00
Antonio Andelic
db1b172770
Merge pull request #52201 from ClickHouse/fix-flaky-checks
Fix  `Integration tests flaky check (asan)`
2023-07-17 14:24:05 +02:00
Robert Schulze
67e9de14de
Merge pull request #51637 from ClibMouse/feature/grouparray-aggregate-function-big-endian
Implement endianness-independent serialization
2023-07-17 14:07:13 +02:00
Robert Schulze
a2e63404b3
Further simplify logic 2023-07-17 12:01:41 +00:00
Antonio Andelic
152f5527a9 Remove wrong assert 2023-07-17 11:58:22 +00:00
Robert Schulze
96c399ff7b
Simplify a bit further 2023-07-17 11:58:18 +00:00
Robert Schulze
8f1e56167c
NUMBER_OF_TOTAL_CORES is on all platforms != 0 2023-07-17 11:53:12 +00:00
Robert Schulze
7204f70547
cmake_host_system_information provides TOTAL_PHYSICAL_MEMORY on all platforms, including FreeBSD 2023-07-17 11:52:23 +00:00
robot-ch-test-poll2
7f960c2379
Merge pull request #51160 from Algunenano/async_to_query_log
Log async insert flush queries into to system.query_log and system.processes
2023-07-17 13:49:22 +02:00
Nikita Mikhaylov
fa137f283c
Merge pull request #51736 from ClickHouse/oss-fuzz-fixes
Fixed several issues found by OSS-Fuzz
2023-07-17 13:44:48 +02:00
Nikita Mikhaylov
d04f39370a
Merge branch 'master' into oss-fuzz-fixes 2023-07-17 13:41:54 +02:00
Robert Schulze
10c15a6548
Refactor limit_jobs.cmake 2023-07-17 11:37:34 +00:00
robot-ch-test-poll1
89a33c5879
Merge pull request #52176 from FFFFFFFHHHHHHH/add_length_alias
Add OCTET_LENGTH as an alias to length
2023-07-17 13:34:01 +02:00
Azat Khuzhin
1fb7605fb4 Fix self extracting binaries under qemu linux-user (qemu-$ARCH-static)
The problem was that the decompressor uses realpath(/proc/self/exe)
instead of readlink(/proc/self/exe), while realpath() does lots of
trickerly [1] which leads to bypassing qemu linux-user override [2] of
/proc/self/exe to the executable with with it had been called -- and
the reason for this is that the getpid() after unshare returns 1, while
reading /proc/self returns the pid that was before unshare (from the
chroot) [3].

  [1]: 4290aed051/stdlib/canonicalize.c (L223)
  [2]: ed8ad9728a/linux-user/syscall.c (L8634)
  [3]: https://gist.github.com/azat/fcbd8b6c26afd505ae5f3387fc15f0e2

But note, that even after this patch qemu without binfmt will not work,
due to internally the code calls execv() while qemu does not handle it
(see [4]).

  [4]: https://patchwork.kernel.org/project/qemu-devel/patch/1453091602-21843-1-git-send-email-petrosagg@gmail.com/

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-07-17 13:10:40 +02:00
Azat Khuzhin
16165d9498 Improve error messages for decompressor
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-07-17 13:10:40 +02:00
Azat Khuzhin
c374653c7b Revert "Merge pull request #52138 from azat/decompressor-inode"
This reverts commit 6524031348, reversing
changes made to 9bf114f9a3.

This was not a good idea, since the underlying problem was that
`/proc/self/exe` was pointing to `qemu-$ARCH-static` (because the code
uses realpath() over normal interface readlink(), which is not caught by
the qemu linux-user).

And this means that later, it will try to overwrite incorrect binary and
then execute some garbage.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-07-17 13:10:29 +02:00
Kruglov Pavel
df363f444e
Merge pull request #51767 from arenadata/Support-range-nullable
Support for function range of Nullable argument
2023-07-17 12:52:19 +02:00
Ilya Yatsishin
65eb937f68
Merge pull request #51765 from arenadata/ADQM-974
Allow toUInt128() for UUIDs
2023-07-17 12:50:37 +02:00
Robert Schulze
9d7737ba09
Merge pull request #50076 from FFFFFFFHHHHHHH/jaccard_similarity
Add function arrayJaccardIndex
2023-07-17 12:22:24 +02:00
robot-ch-test-poll4
036fb1fc9b
Merge pull request #52041 from ClickHouse/docs-organize-user-profiles
Docs organize user setting profiles
2023-07-17 12:03:06 +02:00
Val Doroshchuk
9d396f820a
Merge branch 'master' into disconnect-on-dtor 2023-07-17 10:58:43 +02:00
Antonio Andelic
dfc1cc13c8 Better oldest part selection 2023-07-17 08:57:22 +00:00
Sergei Trifonov
381ab07e1b
Merge pull request #51496 from yariks5s/add-index-bytes-to-system-parts
Add column primary_key_size to system.parts
2023-07-17 10:39:56 +02:00
Alexey Milovidov
44929b7d28
Merge pull request #52154 from ClickHouse/fix-02497_storage_file_reader_selection
Fix test 02497_storage_file_reader_selection
2023-07-17 06:45:48 +03:00
FFFFFFFHHHHHHH
3df812f4f0 fix 2023-07-17 11:18:30 +08:00
FFFFFFFHHHHHHH
ebfc9c25f7 add test 2023-07-17 10:59:40 +08:00
FFFFFFFHHHHHHH
0cdb1d1466 add docs 2023-07-17 10:52:05 +08:00
FFFFFFFHHHHHHH
1cebf03cab add length alias 2023-07-17 10:41:18 +08:00