Commit Graph

119464 Commits

Author SHA1 Message Date
Alexey Milovidov
ffc6f246bf Merge branch 'master' into sparse-columns-by-default 2023-07-18 01:36:52 +02:00
Alexey Milovidov
0902ee1ec7 Remove useless header 2023-07-18 01:36:44 +02:00
Robert Schulze
46e03432a9
Merge pull request #52196 from rschu1ze/simplify-job-limiting
CMake: Simplify job limiting
2023-07-17 22:43:40 +02:00
robot-clickhouse-ci-1
2b1be4b89d
Merge pull request #52063 from valbok/disconnect-on-dtor
MySQL: Delay disconnection of mysqlxx::Pool::Entry until refcount==0
2023-07-17 22:29:58 +02:00
Robert Schulze
1dbc88630d
Cosmetics 2023-07-17 17:10:08 +00:00
Alexey Milovidov
9f45513acf
Merge pull request #52173 from ClickHouse/fix-slow-test-02317_distinct_in_order_optimization
Fix slow test `02317_distinct_in_order_optimization`
2023-07-17 19:57:41 +03:00
Kruglov Pavel
2793305a71
Merge pull request #51825 from ucasfl/schema
Fix use_structure_from_insertion_table_in_table_functions does not work with materialized and alias columns
2023-07-17 18:25:54 +02:00
Nikita Mikhaylov
d4c8383627
Merge pull request #52216 from ClickHouse/revert-51736-oss-fuzz-fixes
Revert "Fixed several issues found by OSS-Fuzz"
2023-07-17 17:19:18 +02:00
Antonio Andelic
bfe349a7e4
Merge pull request #52189 from ClickHouse/fix-test_multiple_disks
Fix `test_multiple_disks/test.py::test_start_stop_moves`
2023-07-17 16:28:02 +02:00
Nikita Mikhaylov
2a2ebb1f31 Bump 2023-07-17 14:26:11 +00:00
Antonio Andelic
51f0089457
Merge branch 'master' into fix-test_multiple_disks 2023-07-17 16:25:06 +02:00
vdimir
5de1cfee7d
Merge pull request #51735 from arenadata/ADQM-976 2023-07-17 16:24:11 +02:00
Nikita Mikhaylov
9a30aaa9aa
Revert "Fixed several issues found by OSS-Fuzz" 2023-07-17 16:14:58 +02:00
Robert Schulze
8f8cb5eb82
Update cmake/limit_jobs.cmake
Co-authored-by: János Benjamin Antal <antaljanosbenjamin@users.noreply.github.com>
2023-07-17 15:48:12 +02:00
Antonio Andelic
db1b172770
Merge pull request #52201 from ClickHouse/fix-flaky-checks
Fix  `Integration tests flaky check (asan)`
2023-07-17 14:24:05 +02:00
Robert Schulze
67e9de14de
Merge pull request #51637 from ClibMouse/feature/grouparray-aggregate-function-big-endian
Implement endianness-independent serialization
2023-07-17 14:07:13 +02:00
Robert Schulze
a2e63404b3
Further simplify logic 2023-07-17 12:01:41 +00:00
Antonio Andelic
152f5527a9 Remove wrong assert 2023-07-17 11:58:22 +00:00
Robert Schulze
96c399ff7b
Simplify a bit further 2023-07-17 11:58:18 +00:00
Robert Schulze
8f1e56167c
NUMBER_OF_TOTAL_CORES is on all platforms != 0 2023-07-17 11:53:12 +00:00
Robert Schulze
7204f70547
cmake_host_system_information provides TOTAL_PHYSICAL_MEMORY on all platforms, including FreeBSD 2023-07-17 11:52:23 +00:00
robot-ch-test-poll2
7f960c2379
Merge pull request #51160 from Algunenano/async_to_query_log
Log async insert flush queries into to system.query_log and system.processes
2023-07-17 13:49:22 +02:00
Nikita Mikhaylov
fa137f283c
Merge pull request #51736 from ClickHouse/oss-fuzz-fixes
Fixed several issues found by OSS-Fuzz
2023-07-17 13:44:48 +02:00
Nikita Mikhaylov
d04f39370a
Merge branch 'master' into oss-fuzz-fixes 2023-07-17 13:41:54 +02:00
Robert Schulze
10c15a6548
Refactor limit_jobs.cmake 2023-07-17 11:37:34 +00:00
robot-ch-test-poll1
89a33c5879
Merge pull request #52176 from FFFFFFFHHHHHHH/add_length_alias
Add OCTET_LENGTH as an alias to length
2023-07-17 13:34:01 +02:00
Kruglov Pavel
df363f444e
Merge pull request #51767 from arenadata/Support-range-nullable
Support for function range of Nullable argument
2023-07-17 12:52:19 +02:00
Ilya Yatsishin
65eb937f68
Merge pull request #51765 from arenadata/ADQM-974
Allow toUInt128() for UUIDs
2023-07-17 12:50:37 +02:00
Robert Schulze
9d7737ba09
Merge pull request #50076 from FFFFFFFHHHHHHH/jaccard_similarity
Add function arrayJaccardIndex
2023-07-17 12:22:24 +02:00
robot-ch-test-poll4
036fb1fc9b
Merge pull request #52041 from ClickHouse/docs-organize-user-profiles
Docs organize user setting profiles
2023-07-17 12:03:06 +02:00
Val Doroshchuk
9d396f820a
Merge branch 'master' into disconnect-on-dtor 2023-07-17 10:58:43 +02:00
Antonio Andelic
dfc1cc13c8 Better oldest part selection 2023-07-17 08:57:22 +00:00
Sergei Trifonov
381ab07e1b
Merge pull request #51496 from yariks5s/add-index-bytes-to-system-parts
Add column primary_key_size to system.parts
2023-07-17 10:39:56 +02:00
Alexey Milovidov
44929b7d28
Merge pull request #52154 from ClickHouse/fix-02497_storage_file_reader_selection
Fix test 02497_storage_file_reader_selection
2023-07-17 06:45:48 +03:00
FFFFFFFHHHHHHH
3df812f4f0 fix 2023-07-17 11:18:30 +08:00
FFFFFFFHHHHHHH
ebfc9c25f7 add test 2023-07-17 10:59:40 +08:00
FFFFFFFHHHHHHH
0cdb1d1466 add docs 2023-07-17 10:52:05 +08:00
FFFFFFFHHHHHHH
1cebf03cab add length alias 2023-07-17 10:41:18 +08:00
FFFFFFFHHHHHHH
0895e47629
Merge branch 'master' into jaccard_similarity 2023-07-17 10:33:10 +08:00
Alexey Milovidov
299149b682 Fix slow test 02317_distinct_in_order_optimization 2023-07-17 01:49:43 +02:00
Alexey Milovidov
60908ac269
Merge pull request #51991 from ClickHouse/test-cleanup
Check that functional tests cleanup their tables
2023-07-17 01:33:54 +03:00
Alexey Milovidov
59ecdbd53e Fix test 02497_storage_file_reader_selection 2023-07-16 22:30:04 +02:00
Alexey Milovidov
09b300cf07
Merge pull request #52143 from ClickHouse/remove-default-value
Remove default argument value
2023-07-16 19:22:30 +03:00
robot-ch-test-poll2
1f1fcd027a
Merge pull request #52130 from zvonand/zvonand-issue-42138
Small fix for toDateTime64() for dates after 2283-12-31
2023-07-16 18:11:28 +02:00
robot-ch-test-poll2
6524031348
Merge pull request #52138 from azat/decompressor-inode
Skip protection from double decompression if inode from maps cannot be obtained
2023-07-16 17:20:43 +02:00
Alexey Milovidov
9bf114f9a3
Merge pull request #52145 from ClickHouse/fix-order-by-tuple-of-window-functions
Fix ORDER BY tuple of WINDOW functions
2023-07-16 17:43:07 +03:00
Alexey Milovidov
71d6206fc4
Fix Python 2023-07-16 17:42:22 +03:00
Azat Khuzhin
20a671b8cf Skip protection from double decompression if inode from maps cannot be obtained
Under some circumstances, like using qemu-$ARCH-static, /proc/self/maps
will not contain information about /proc/self/exe.

Well, strictly speaking it does contains, however qemu will not pass it
to the user program:

<details>

<summary>strace</summary>

    $ sudo strace -s10000 -f arch-chroot . /qemu-riscv64-static /clickhouse
    ...
    execve("/qemu-riscv64-static", ["/qemu-riscv64-static", "/clickhouse"], 0x7fffffffe458 /* 20 vars */) = 0
    readlinkat(AT_FDCWD, "/proc/self/exe", "/qemu-riscv64-static", 4096) = 20
    openat(AT_FDCWD, "/proc/self/maps", O_RDONLY|O_CLOEXEC) = 4
    [pid  3126] read(4, "00010000-00111000 r--p 00000000 fe:01 30312571                           /clickhouse\n00111000-00119000 r--p 00100000 fe:01 30312571                           /clickhouse\n00119000-0011a000 rw-p 00108000 fe:01 30312571                           /clickhouse\n0011a000-0013d000 rw-p 00000000 00:00 0 \n4000000000-4000001000 ---p 00000000 00:00 0 \n4000001000-4000801000 rw-p 00000000 00:00 0 \n4000801000-400081a000 r--p 00000000 fe:01 30316932                       /lib/riscv64-linux-gnu/ld-2.32.so\n400081a000-400081b000 ---p 00000000 00:00 0 \n400081b000-400081c000 r--p 00019000 fe:01 30316932                       /lib/riscv64-linux-gnu/ld-2.32.so\n400081c000-400081e000 rw-p 0001a000 fe:01 30316932                       /lib/riscv64-linux-gnu/ld-2.32.so\n400081e000-400081f000 r--p 00000000 00:00 0 \n400081f000-4000922000 r--p 00000000 fe:01 30316935 /lib/riscv64-linux-gnu/libc-2.32.so\n4000922000-4000926000 r--p 00102000 fe:01 30316935                       /lib/riscv64-linux-gnu/libc-2.32.so\n4000926000-4000928000 rw-p 00106000 fe:01 30316935                       /lib/riscv64-linux-gnu/libc-2.32.so\n4000928000-400092d000 rw-p 00000000 00:00 0 \n400092d000-40009af000 r--p 00000000 fe:01 30316943                       /lib/riscv64-linux-gnu/libm-2.32.so\n40009af000-40009b0000 r--p 00081000 fe:01 30316943                       /lib/riscv64-linux-gnu/libm-2.32.so\n40009b0000-40009b1000 rw-p 00082000 fe:01 30316943 /lib/riscv64-linux-gnu/libm-2.32.so\n40009b1000-40009c5000 r--p 00000000 fe:01 30316946                       /lib/riscv64-linux-gnu/libpthread-2.32.so\n40009c5000-40009c6000 r--p 00013000 fe:01 30316946                       /lib/riscv64-linux-gnu/libpthread-2.32.so\n40009c6000-40009c7000 rw-p 00014000 fe:01 30316946                       /lib/riscv64-linux-gnu/libpthread-2.32.so\n40009c7000-40009cb000 rw-p 00000000 00:00 0 \n40009cb000-40009cd000 r--p 00000000 fe:01 30316939                       /lib/riscv64-linux-gnu/libdl-2.32.so\n40009cd000-40009ce000 r--p 00001000 fe:01 30316939                       /lib/riscv64-linux-gnu/libdl-2.32.so\n40009ce000-40009cf000 rw-p 00002000 fe:01 30316939                       /lib/riscv64-linux-gnu/libdl-2.32.so\n40009cf000-40009d1000 rw-p 00000000 00:00 0 \n7fffe8000000-7fffeffff000 rwxp 00000000 00:00 0 \n7fffeffff000-7ffff0000000 ---p 00000000 00:00 0 \n7ffff0000000-7ffff0021000 rw-p 00000000 00:00 0 \n7ffff0021000-7ffff4000000 ---p 00000000 00:00 0 \n7ffff6b4b000-7ffff6b5b000 rw-p 00000000 00:00 0 \n7ffff71ff000-7ffff7200000 ---p 00000000 00:00 0 \n7ffff7200000-7ffff7a00000 rw-p 00000000 00:00 0\n7ffff7a00000-7ffff7a3c000 r--p 00000000 fe:01 30316953                   /qemu-riscv64-static\n7ffff7a3c000-7ffff7c74000 r-xp 0003c000 fe:01 30316953                   /qemu-riscv64-static\n7ffff7c74000-7ffff7d77000 r--p 00274000 fe:01 30316953                   /qemu-riscv64-static\n7ffff7d77000-7ffff7dce000 r--p 00377000 fe:01 30316953                   /qemu-riscv64-static\n7ffff7dce000-7ffff7df7000 rw-p 003ce000 fe:01 30316953                   /qemu-riscv64-static\n7ffff7df7000-7ffff7e0c000 rw-p 00000000 00:00 0                          [heap]\n7ffff7e0c000-7ffff7e70000 rw-p 00000000 00:00 0                          [heap]\n7ffff7f42000-7ffff7ff9000 rw-p 00000000 00:00 0 \n7ffff7ff9000-7ffff7ffd000 r--p 00000000 00:00 0                          [vvar]\n7ffff7ffd000-7ffff7fff000 r-xp 00000000 00:00 0                          [vdso]\n7ffffffde000-7ffffffff000 rw-p 00000000 00:00 0                          [stack]\nffffffffff600000-ffffffffff601000 --xp 00000000 00:00 0                  [vsyscall]\n", 4096) = 3608
    [pid  3126] read(4, "", 1024)           = 0
    [pid  3126] close(4)                    = 0
    [pid  3126] write(3, "10000-111000 r-xp 00000000 fe:01 30312571", 41) = 41
    [pid  3126] write(3, "                                /clickhouse\n", 44) = 44
    [pid  3126] write(3, "111000-119000 r--p 00100000 fe:01 30312571", 42) = 42
    [pid  3126] write(3, "                               /clickhouse\n", 43) = 43
    [pid  3126] write(3, "119000-11a000 rw-p 00108000 fe:01 30312571", 42) = 42
    [pid  3126] write(3, "                               /clickhouse\n", 43) = 43
    [pid  3126] write(3, "11a000-13d000 rw-p 00000000 00:00 0", 35) = 35
    [pid  3126] write(3, "                                      \n", 39) = 39
    [pid  3126] write(3, "4000000000-4000001000 ---p 00000000 00:00 0", 43) = 43
    [pid  3126] write(3, "                              \n", 31) = 31
    [pid  3126] write(3, "4000001000-4000801000 rw-p 00000000 00:00 0", 43) = 43
    [pid  3126] write(3, "                              [stack]\n", 38) = 38
    [pid  3126] write(3, "4000801000-400081a000 r-xp 00000000 fe:01 30316932", 50) = 50
    [pid  3126] write(3, "                       /lib/riscv64-linux-gnu/ld-2.32.so\n", 57 <unfinished ...>
    [pid  3127] <... clock_nanosleep resumed>0x7ffff79ff060) = 0
    [pid  3126] <... write resumed>)        = 57
    [pid  3127] clock_nanosleep(CLOCK_REALTIME, 0, {tv_sec=0, tv_nsec=10000000},  <unfinished ...>
    [pid  3126] write(3, "400081a000-400081b000 ---p 00000000 00:00 0", 43) = 43
    [pid  3126] write(3, "                              \n", 31) = 31
    [pid  3126] write(3, "400081b000-400081c000 r--p 00019000 fe:01 30316932", 50) = 50
    [pid  3126] write(3, "                       /lib/riscv64-linux-gnu/ld-2.32.so\n", 57) = 57
    [pid  3126] write(3, "400081c000-400081e000 rw-p 0001a000 fe:01 30316932", 50) = 50
    [pid  3126] write(3, "                       /lib/riscv64-linux-gnu/ld-2.32.so\n", 57) = 57
    [pid  3126] write(3, "400081e000-400081f000 r-xp 00000000 00:00 0", 43) = 43
    [pid  3126] write(3, "                              \n", 31) = 31
    [pid  3126] write(3, "400081f000-4000922000 r-xp 00000000 fe:01 30316935", 50) = 50
    [pid  3126] write(3, "                       /lib/riscv64-linux-gnu/libc-2.32.so\n", 59) = 59
    [pid  3126] write(3, "4000922000-4000926000 r--p 00102000 fe:01 30316935", 50) = 50
    [pid  3126] write(3, "                       /lib/riscv64-linux-gnu/libc-2.32.so\n", 59) = 59
    [pid  3126] write(3, "4000926000-4000928000 rw-p 00106000 fe:01 30316935", 50) = 50
    [pid  3126] write(3, "                       /lib/riscv64-linux-gnu/libc-2.32.so\n", 59) = 59
    [pid  3126] write(3, "4000928000-400092d000 rw-p 00000000 00:00 0", 43) = 43
    [pid  3126] write(3, "                              \n", 31) = 31
    [pid  3126] write(3, "400092d000-40009af000 r-xp 00000000 fe:01 30316943", 50) = 50
    [pid  3126] write(3, "                       /lib/riscv64-linux-gnu/libm-2.32.so\n", 59) = 59
    [pid  3126] write(3, "40009af000-40009b0000 r--p 00081000 fe:01 30316943", 50) = 50
    [pid  3126] write(3, "                       /lib/riscv64-linux-gnu/libm-2.32.so\n", 59) = 59
    [pid  3126] write(3, "40009b0000-40009b1000 rw-p 00082000 fe:01 30316943", 50) = 50
    [pid  3126] write(3, "                       /lib/riscv64-linux-gnu/libm-2.32.so\n", 59) = 59
    [pid  3126] write(3, "40009b1000-40009c5000 r-xp 00000000 fe:01 30316946", 50) = 50
    [pid  3126] write(3, "                       /lib/riscv64-linux-gnu/libpthread-2.32.so\n", 65) = 65
    [pid  3126] write(3, "40009c5000-40009c6000 r--p 00013000 fe:01 30316946", 50) = 50
    [pid  3126] write(3, "                       /lib/riscv64-linux-gnu/libpthread-2.32.so\n", 65) = 65
    [pid  3126] write(3, "40009c6000-40009c7000 rw-p 00014000 fe:01 30316946", 50) = 50
    [pid  3126] write(3, "                       /lib/riscv64-linux-gnu/libpthread-2.32.so\n", 65) = 65
    [pid  3126] write(3, "40009c7000-40009cb000 rw-p 00000000 00:00 0", 43) = 43
    [pid  3126] write(3, "                              \n", 31) = 31
    [pid  3126] write(3, "40009cb000-40009cd000 r-xp 00000000 fe:01 30316939", 50) = 50
    [pid  3126] write(3, "                       /lib/riscv64-linux-gnu/libdl-2.32.so\n", 60) = 60
    [pid  3126] write(3, "40009cd000-40009ce000 r--p 00001000 fe:01 30316939", 50) = 50
    [pid  3126] write(3, "                       /lib/riscv64-linux-gnu/libdl-2.32.so\n", 60) = 60
    [pid  3126] write(3, "40009ce000-40009cf000 rw-p 00002000 fe:01 30316939", 50) = 50
    [pid  3126] write(3, "                       /lib/riscv64-linux-gnu/libdl-2.32.so\n", 60) = 60
    [pid  3126] write(3, "40009cf000-40009d1000 rw-p 00000000 00:00 0", 43) = 43
    [pid  3126] write(3, "                              \n", 31) = 31

</details>

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-07-16 08:17:14 +02:00
robot-ch-test-poll
3b0a4040cd
Merge pull request #51876 from evillique/fix-mongodb-inserts
Fix inserts into MongoDB tables
2023-07-16 05:28:43 +02:00
Alexey Milovidov
d900aa467f
Merge pull request #51992 from ClickHouse/fix-test_extreme_deduplication
Fix test_extreme_deduplication
2023-07-16 05:54:44 +03:00