thevar1able/ClickHouse
1
0
Fork 0
mirror of https://github.com/ClickHouse/ClickHouse.git synced 2024-11-26 01:22:04 +00:00
Code Issues Packages Projects Releases Wiki Activity
131,616 Commits 9,175 Branches 1,781 Tags 2.1 GiB
609b2c216c
Commit Graph

2159 Commits

Author SHA1 Message Date
Azat Khuzhin
1fb7605fb4 Fix self extracting binaries under qemu linux-user (qemu-$ARCH-static) 
The problem was that the decompressor uses realpath(/proc/self/exe)
instead of readlink(/proc/self/exe), while realpath() does lots of
trickerly [1] which leads to bypassing qemu linux-user override [2] of
/proc/self/exe to the executable with with it had been called -- and
the reason for this is that the getpid() after unshare returns 1, while
reading /proc/self returns the pid that was before unshare (from the
chroot) [3].

  [1]: 4290aed051/stdlib/canonicalize.c (L223)
  [2]: ed8ad9728a/linux-user/syscall.c (L8634)
  [3]: https://gist.github.com/azat/fcbd8b6c26afd505ae5f3387fc15f0e2

But note, that even after this patch qemu without binfmt will not work,
due to internally the code calls execv() while qemu does not handle it
(see [4]).

  [4]: https://patchwork.kernel.org/project/qemu-devel/patch/1453091602-21843-1-git-send-email-petrosagg@gmail.com/

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-07-17 13:10:40 +02:00
Azat Khuzhin
16165d9498 Improve error messages for decompressor 
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-07-17 13:10:40 +02:00
Azat Khuzhin
c374653c7b Revert "Merge pull request #52138 from azat/decompressor-inode" 
This reverts commit 6524031348, reversing
changes made to 9bf114f9a3.

This was not a good idea, since the underlying problem was that
`/proc/self/exe` was pointing to `qemu-$ARCH-static` (because the code
uses realpath() over normal interface readlink(), which is not caught by
the qemu linux-user).

And this means that later, it will try to overwrite incorrect binary and
then execute some garbage.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-07-17 13:10:29 +02:00
Antonio Andelic
61dc020b4d
Merge branch 'master' into feature/keeper-dyn-reconf 2023-07-17 12:50:17 +02:00
Dmitry Kardymon
2de9ea6925 Merge remote-tracking branch 'origin/master' into ADQM-982 2023-07-17 10:03:16 +00:00
Lloyd-Pottiger
3636c2a847
Merge branch 'master' into add-alias-for-today-and-now 2023-07-17 14:28:24 +08:00
FFFFFFFHHHHHHH
0895e47629
Merge branch 'master' into jaccard_similarity 2023-07-17 10:33:10 +08:00
Lloyd-Pottiger
e38a9de7c9 add aspell 
Signed-off-by: Lloyd-Pottiger <yan1579196623@gmail.com>
 2023-07-17 10:24:45 +08:00
flynn
7f80f7dcb0
Merge branch 'master' into array_concat_agg 2023-07-17 01:15:24 +08:00
flynn
6899070f95 fix 2023-07-16 09:54:13 +00:00
Azat Khuzhin
20a671b8cf Skip protection from double decompression if inode from maps cannot be obtained 
Under some circumstances, like using qemu-$ARCH-static, /proc/self/maps
will not contain information about /proc/self/exe.

Well, strictly speaking it does contains, however qemu will not pass it
to the user program:

<details>

<summary>strace</summary>

    $ sudo strace -s10000 -f arch-chroot . /qemu-riscv64-static /clickhouse
    ...
    execve("/qemu-riscv64-static", ["/qemu-riscv64-static", "/clickhouse"], 0x7fffffffe458 /* 20 vars */) = 0
    readlinkat(AT_FDCWD, "/proc/self/exe", "/qemu-riscv64-static", 4096) = 20
    openat(AT_FDCWD, "/proc/self/maps", O_RDONLY|O_CLOEXEC) = 4
    [pid  3126] read(4, "00010000-00111000 r--p 00000000 fe:01 30312571                           /clickhouse\n00111000-00119000 r--p 00100000 fe:01 30312571                           /clickhouse\n00119000-0011a000 rw-p 00108000 fe:01 30312571                           /clickhouse\n0011a000-0013d000 rw-p 00000000 00:00 0 \n4000000000-4000001000 ---p 00000000 00:00 0 \n4000001000-4000801000 rw-p 00000000 00:00 0 \n4000801000-400081a000 r--p 00000000 fe:01 30316932                       /lib/riscv64-linux-gnu/ld-2.32.so\n400081a000-400081b000 ---p 00000000 00:00 0 \n400081b000-400081c000 r--p 00019000 fe:01 30316932                       /lib/riscv64-linux-gnu/ld-2.32.so\n400081c000-400081e000 rw-p 0001a000 fe:01 30316932                       /lib/riscv64-linux-gnu/ld-2.32.so\n400081e000-400081f000 r--p 00000000 00:00 0 \n400081f000-4000922000 r--p 00000000 fe:01 30316935 /lib/riscv64-linux-gnu/libc-2.32.so\n4000922000-4000926000 r--p 00102000 fe:01 30316935                       /lib/riscv64-linux-gnu/libc-2.32.so\n4000926000-4000928000 rw-p 00106000 fe:01 30316935                       /lib/riscv64-linux-gnu/libc-2.32.so\n4000928000-400092d000 rw-p 00000000 00:00 0 \n400092d000-40009af000 r--p 00000000 fe:01 30316943                       /lib/riscv64-linux-gnu/libm-2.32.so\n40009af000-40009b0000 r--p 00081000 fe:01 30316943                       /lib/riscv64-linux-gnu/libm-2.32.so\n40009b0000-40009b1000 rw-p 00082000 fe:01 30316943 /lib/riscv64-linux-gnu/libm-2.32.so\n40009b1000-40009c5000 r--p 00000000 fe:01 30316946                       /lib/riscv64-linux-gnu/libpthread-2.32.so\n40009c5000-40009c6000 r--p 00013000 fe:01 30316946                       /lib/riscv64-linux-gnu/libpthread-2.32.so\n40009c6000-40009c7000 rw-p 00014000 fe:01 30316946                       /lib/riscv64-linux-gnu/libpthread-2.32.so\n40009c7000-40009cb000 rw-p 00000000 00:00 0 \n40009cb000-40009cd000 r--p 00000000 fe:01 30316939                       /lib/riscv64-linux-gnu/libdl-2.32.so\n40009cd000-40009ce000 r--p 00001000 fe:01 30316939                       /lib/riscv64-linux-gnu/libdl-2.32.so\n40009ce000-40009cf000 rw-p 00002000 fe:01 30316939                       /lib/riscv64-linux-gnu/libdl-2.32.so\n40009cf000-40009d1000 rw-p 00000000 00:00 0 \n7fffe8000000-7fffeffff000 rwxp 00000000 00:00 0 \n7fffeffff000-7ffff0000000 ---p 00000000 00:00 0 \n7ffff0000000-7ffff0021000 rw-p 00000000 00:00 0 \n7ffff0021000-7ffff4000000 ---p 00000000 00:00 0 \n7ffff6b4b000-7ffff6b5b000 rw-p 00000000 00:00 0 \n7ffff71ff000-7ffff7200000 ---p 00000000 00:00 0 \n7ffff7200000-7ffff7a00000 rw-p 00000000 00:00 0\n7ffff7a00000-7ffff7a3c000 r--p 00000000 fe:01 30316953                   /qemu-riscv64-static\n7ffff7a3c000-7ffff7c74000 r-xp 0003c000 fe:01 30316953                   /qemu-riscv64-static\n7ffff7c74000-7ffff7d77000 r--p 00274000 fe:01 30316953                   /qemu-riscv64-static\n7ffff7d77000-7ffff7dce000 r--p 00377000 fe:01 30316953                   /qemu-riscv64-static\n7ffff7dce000-7ffff7df7000 rw-p 003ce000 fe:01 30316953                   /qemu-riscv64-static\n7ffff7df7000-7ffff7e0c000 rw-p 00000000 00:00 0                          [heap]\n7ffff7e0c000-7ffff7e70000 rw-p 00000000 00:00 0                          [heap]\n7ffff7f42000-7ffff7ff9000 rw-p 00000000 00:00 0 \n7ffff7ff9000-7ffff7ffd000 r--p 00000000 00:00 0                          [vvar]\n7ffff7ffd000-7ffff7fff000 r-xp 00000000 00:00 0                          [vdso]\n7ffffffde000-7ffffffff000 rw-p 00000000 00:00 0                          [stack]\nffffffffff600000-ffffffffff601000 --xp 00000000 00:00 0                  [vsyscall]\n", 4096) = 3608
    [pid  3126] read(4, "", 1024)           = 0
    [pid  3126] close(4)                    = 0
    [pid  3126] write(3, "10000-111000 r-xp 00000000 fe:01 30312571", 41) = 41
    [pid  3126] write(3, "                                /clickhouse\n", 44) = 44
    [pid  3126] write(3, "111000-119000 r--p 00100000 fe:01 30312571", 42) = 42
    [pid  3126] write(3, "                               /clickhouse\n", 43) = 43
    [pid  3126] write(3, "119000-11a000 rw-p 00108000 fe:01 30312571", 42) = 42
    [pid  3126] write(3, "                               /clickhouse\n", 43) = 43
    [pid  3126] write(3, "11a000-13d000 rw-p 00000000 00:00 0", 35) = 35
    [pid  3126] write(3, "                                      \n", 39) = 39
    [pid  3126] write(3, "4000000000-4000001000 ---p 00000000 00:00 0", 43) = 43
    [pid  3126] write(3, "                              \n", 31) = 31
    [pid  3126] write(3, "4000001000-4000801000 rw-p 00000000 00:00 0", 43) = 43
    [pid  3126] write(3, "                              [stack]\n", 38) = 38
    [pid  3126] write(3, "4000801000-400081a000 r-xp 00000000 fe:01 30316932", 50) = 50
    [pid  3126] write(3, "                       /lib/riscv64-linux-gnu/ld-2.32.so\n", 57 <unfinished ...>
    [pid  3127] <... clock_nanosleep resumed>0x7ffff79ff060) = 0
    [pid  3126] <... write resumed>)        = 57
    [pid  3127] clock_nanosleep(CLOCK_REALTIME, 0, {tv_sec=0, tv_nsec=10000000},  <unfinished ...>
    [pid  3126] write(3, "400081a000-400081b000 ---p 00000000 00:00 0", 43) = 43
    [pid  3126] write(3, "                              \n", 31) = 31
    [pid  3126] write(3, "400081b000-400081c000 r--p 00019000 fe:01 30316932", 50) = 50
    [pid  3126] write(3, "                       /lib/riscv64-linux-gnu/ld-2.32.so\n", 57) = 57
    [pid  3126] write(3, "400081c000-400081e000 rw-p 0001a000 fe:01 30316932", 50) = 50
    [pid  3126] write(3, "                       /lib/riscv64-linux-gnu/ld-2.32.so\n", 57) = 57
    [pid  3126] write(3, "400081e000-400081f000 r-xp 00000000 00:00 0", 43) = 43
    [pid  3126] write(3, "                              \n", 31) = 31
    [pid  3126] write(3, "400081f000-4000922000 r-xp 00000000 fe:01 30316935", 50) = 50
    [pid  3126] write(3, "                       /lib/riscv64-linux-gnu/libc-2.32.so\n", 59) = 59
    [pid  3126] write(3, "4000922000-4000926000 r--p 00102000 fe:01 30316935", 50) = 50
    [pid  3126] write(3, "                       /lib/riscv64-linux-gnu/libc-2.32.so\n", 59) = 59
    [pid  3126] write(3, "4000926000-4000928000 rw-p 00106000 fe:01 30316935", 50) = 50
    [pid  3126] write(3, "                       /lib/riscv64-linux-gnu/libc-2.32.so\n", 59) = 59
    [pid  3126] write(3, "4000928000-400092d000 rw-p 00000000 00:00 0", 43) = 43
    [pid  3126] write(3, "                              \n", 31) = 31
    [pid  3126] write(3, "400092d000-40009af000 r-xp 00000000 fe:01 30316943", 50) = 50
    [pid  3126] write(3, "                       /lib/riscv64-linux-gnu/libm-2.32.so\n", 59) = 59
    [pid  3126] write(3, "40009af000-40009b0000 r--p 00081000 fe:01 30316943", 50) = 50
    [pid  3126] write(3, "                       /lib/riscv64-linux-gnu/libm-2.32.so\n", 59) = 59
    [pid  3126] write(3, "40009b0000-40009b1000 rw-p 00082000 fe:01 30316943", 50) = 50
    [pid  3126] write(3, "                       /lib/riscv64-linux-gnu/libm-2.32.so\n", 59) = 59
    [pid  3126] write(3, "40009b1000-40009c5000 r-xp 00000000 fe:01 30316946", 50) = 50
    [pid  3126] write(3, "                       /lib/riscv64-linux-gnu/libpthread-2.32.so\n", 65) = 65
    [pid  3126] write(3, "40009c5000-40009c6000 r--p 00013000 fe:01 30316946", 50) = 50
    [pid  3126] write(3, "                       /lib/riscv64-linux-gnu/libpthread-2.32.so\n", 65) = 65
    [pid  3126] write(3, "40009c6000-40009c7000 rw-p 00014000 fe:01 30316946", 50) = 50
    [pid  3126] write(3, "                       /lib/riscv64-linux-gnu/libpthread-2.32.so\n", 65) = 65
    [pid  3126] write(3, "40009c7000-40009cb000 rw-p 00000000 00:00 0", 43) = 43
    [pid  3126] write(3, "                              \n", 31) = 31
    [pid  3126] write(3, "40009cb000-40009cd000 r-xp 00000000 fe:01 30316939", 50) = 50
    [pid  3126] write(3, "                       /lib/riscv64-linux-gnu/libdl-2.32.so\n", 60) = 60
    [pid  3126] write(3, "40009cd000-40009ce000 r--p 00001000 fe:01 30316939", 50) = 50
    [pid  3126] write(3, "                       /lib/riscv64-linux-gnu/libdl-2.32.so\n", 60) = 60
    [pid  3126] write(3, "40009ce000-40009cf000 rw-p 00002000 fe:01 30316939", 50) = 50
    [pid  3126] write(3, "                       /lib/riscv64-linux-gnu/libdl-2.32.so\n", 60) = 60
    [pid  3126] write(3, "40009cf000-40009d1000 rw-p 00000000 00:00 0", 43) = 43
    [pid  3126] write(3, "                              \n", 31) = 31

</details>

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-07-16 08:17:14 +02:00
Alexey Milovidov
527d77bc0f system.licenses table will display hard forks 2023-07-14 21:12:12 +02:00
robot-ch-test-poll
93b40c490f
Merge pull request #51945 from arenadata/ADQM-950-B 
Implement support of date/time format specifiers in log and error log file names
 2023-07-14 18:54:27 +02:00
robot-clickhouse
8916e7d69b Update version_date.tsv and changelogs after v23.3.8.21-lts 2023-07-13 08:49:48 +00:00
robot-clickhouse
798f31a612 Update version_date.tsv and changelogs after v23.4.6.25-stable 2023-07-12 12:36:57 +00:00
Roman Vasin
b6023d9f62 Merge branch 'master' of github.com:ClickHouse/ClickHouse into ADQM-822 2023-07-11 10:35:31 +00:00
Robert Schulze
521c993eff
Merge branch 'master' into jaccard_similarity 2023-07-11 10:36:18 +02:00
Dmitry Kardymon
ae69627d87 Merge remote-tracking branch 'origin/master' into ADQM-982 2023-07-11 08:16:21 +00:00
Dmitry Kardymon
0cd4b753d6 Merge remote-tracking branch 'origin/master' into ADQM-976 2023-07-10 13:27:45 +00:00
Dmitry Kardymon
17891ca1eb Add case ins utf8 impl + tests 2023-07-10 09:18:09 +00:00
Victor Krasnov
e311d31d87 Merge branch 'master' into ADQM-950-B 2023-07-10 15:50:09 +08:00
Alexey Milovidov
dd1c528d2f
Merge pull request #51985 from azat/cleanup-remote-servers 
[RFC] Cleanup remote_servers in dist config.xml
 2023-07-10 01:24:06 +03:00
Azat Khuzhin
2db092f9d8 Cleanup remote_servers in dist config.xml 
At first, there was no such amount of clusters in dist config, they
added when someone need to write some new cluster for tests.

So let's move them to the clusters.xml that is deployed only for tests,
and leave only default cluster.

And cleanup also some configs that had been copied from dist config in
the repo (about test_config_* integration tests, this should be OK,
since there are more_clusters.xml as well, that covers additional
cases).

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-07-09 16:55:27 +02:00
Alexey Milovidov
29f625e7bb Add a check to validate that the stateful tests are stateful 2023-07-09 03:43:18 +02:00
robot-clickhouse
45d36b736a Update version_date.tsv and changelogs after v23.6.2.18-stable 2023-07-08 23:14:02 +00:00
Robert Schulze
08b2441784
Merge branch 'master' into jaccard_similarity 2023-07-07 12:41:09 +02:00
Victor Krasnov
3edee4174c Add AWST time zone abbreviation to the ignore list 2023-07-07 11:34:03 +08:00
Alexey Milovidov
685f2949b7
Revert "Fix build" 2023-07-07 02:53:13 +03:00
Alexey Milovidov
c47b32b17a Fix build 2023-07-07 01:52:18 +02:00
Alexey Milovidov
48eb30de51 Fix build 2023-07-07 01:42:29 +02:00
Mike Kot
c46b125d0a review fixes 2023-07-07 00:20:54 +03:00
Mike Kot
8b6376005a "reconfig" support for CH Keeper 2023-07-07 00:20:54 +03:00
Kruglov Pavel
665b6d4334
Update aspell-dict.txt 2023-07-05 14:50:15 +02:00
Robert Schulze
01caf205bd
Merge branch 'master' into jaccard_similarity 2023-07-04 10:39:52 +02:00
Robert Schulze
d738ae00a3
Merge remote-tracking branch 'rschu1ze/master' into jaccard_similarity 2023-07-03 18:34:18 +00:00
Sergei Trifonov
bbb5850dec
Merge branch 'master' into async-loader-integration 2023-07-03 20:21:26 +02:00
Vitaly Baranov
8dd1b7b8b9
Merge branch 'master' into add-hex-functions-for-cityhash 2023-07-03 18:00:33 +02:00
Dmitry Kardymon
16ab84d804 Style fix 2023-07-03 11:50:26 +00:00
Dmitry Kardymon
1a40e30797 Add initcapUtf8: impl + tests 2023-07-03 11:37:55 +00:00
FFFFFFFHHHHHHH
91d091a806 fix style 2023-07-02 18:58:58 +08:00
Vitaly Baranov
35d1b8448b
Merge branch 'master' into add-hex-functions-for-cityhash 2023-07-02 01:32:54 +02:00
Antonio Andelic
eba60dd81e
Merge branch 'master' into keeper-with-disks 2023-07-01 20:59:16 +02:00
robot-clickhouse
8ed1ec49d1 Update version_date.tsv and changelogs after v23.6.1.1524-stable 2023-06-30 15:21:13 +00:00
DanRoscigno
904c533a84 spelling list 2023-06-30 09:32:54 -04:00
Antonio Andelic
2058b1346e Merge branch 'master' into keeper-with-disks 2023-06-30 13:22:33 +00:00
robot-clickhouse
f48de18640 Update version_date.tsv and changelogs after v23.4.5.22-stable 2023-06-29 20:59:01 +00:00
DanRoscigno
a8172ca5d2 update spelling list 2023-06-29 14:47:23 -04:00
robot-clickhouse
5656d18690 Update version_date.tsv and changelogs after v23.5.4.25-stable 2023-06-29 13:36:55 +00:00
Vitaly Baranov
0cccba62cf Support getHexUIntLowercase() with CityHash_v1_0_2::uint128 parameter. 2023-06-29 15:29:37 +02:00
Vitaly Baranov
fb6243ec9d
Merge pull request #51040 from vitlibar/reorder-part-checksum-halves 
Show halves of checksums in correct order
 2023-06-29 12:04:51 +02:00
Mikhail f. Shiryaev
d8f4e45b21
Merge pull request #51548 from ClickHouse/auto/v23.3.6.7-lts 
Update version_date.tsv and changelogs after v23.3.6.7-lts
 2023-06-28 20:19:17 +02:00
robot-clickhouse
9c2a9a60ea Update version_date.tsv and changelogs after v23.3.6.7-lts 2023-06-28 16:35:41 +00:00
Vitaly Baranov
5570863676
Merge branch 'master' into reorder-part-checksum-halves 2023-06-28 17:25:34 +02:00
taiyang-li
375f7abfeb fix spelling 2023-06-28 12:27:59 +08:00
Sergei Trifonov
b9b007691c
Merge branch 'master' into async-loader-integration 2023-06-27 19:44:52 +02:00
Nikita Mikhaylov
d24c5ab01f
Merge branch 'master' into fix-ip-aggregate-state 2023-06-27 14:11:26 +02:00
Smita Kulkarni
9734871345 Merge branch 'master' into azure_table_function_cluster 2023-06-27 11:09:44 +02:00
Dan Roscigno
bcb106e138
add missing aggregate functions (#51443) 
* add missing aggregate functions

* add sparkBar
 2023-06-27 01:39:47 +02:00
Sergei Trifonov
e2798b5221
Merge branch 'master' into async-loader-integration 2023-06-26 19:18:23 +02:00
Vitaly Baranov
f1f0daa654 Show halves of checksums in "system.parts", "system.projection_parts" and error messages in the correct order. 2023-06-25 17:17:56 +02:00
Dan Roscigno
cd8cdd4e9b
Update aspell-dict.txt 2023-06-23 16:20:56 -04:00
DanRoscigno
4d92fc915f revert to master 2023-06-23 15:16:57 -04:00
DanRoscigno
4d5a4f342d Merge branch 'docs-s3-engine-partition' of github.com:DanRoscigno/ClickHouse into docs-s3-engine-partition 2023-06-23 10:28:23 -04:00
DanRoscigno
3a0db35d16 allow on-prem 2023-06-23 10:01:54 -04:00
Andrey Zvonov
d4316c7189
Merge branch 'master' into zvonand-implicit-tz 2023-06-22 17:23:20 +02:00
robot-clickhouse
df2284b807 Update version_date.tsv and changelogs after v23.3.5.9-lts 2023-06-22 11:56:00 +00:00
Robert Schulze
57070a6a6e
Ignore "modularization" 2023-06-21 18:18:08 +00:00
Sergei Trifonov
02e0d7e204
Merge branch 'master' into async-loader-integration 2023-06-20 12:03:29 +02:00
Andrey Zvonov
07191ce10d
Merge branch 'master' into zvonand-implicit-tz 2023-06-20 00:24:53 +02:00
Smita Kulkarni
0de983e32b Added azureBlobStorageCluster to aspell-dict.txt 2023-06-19 22:55:34 +02:00
Yakov Olkhovskiy
4004be74dc
Merge branch 'master' into fix-ip-aggregate-state 2023-06-19 10:58:06 -04:00
robot-clickhouse
fbcec61aec Update version_date.tsv and changelogs after v22.8.19.10-lts 2023-06-17 14:01:58 +00:00
Roman Vasin
5bba0ff698 Fix build of keeper-bench 2023-06-16 20:13:36 +00:00
Yakov Olkhovskiy
cf301324fb
Merge branch 'master' into fix-ip-aggregate-state 2023-06-16 12:49:17 -04:00
Roman Vasin
d55878d587
Merge branch 'master' into ADQM-822 2023-06-16 18:57:51 +03:00
zvonand
79222bace2 fix style 2023-06-16 11:11:47 +02:00
zvonand
4155d13d69 merge master and resolve conflict 2023-06-16 02:20:32 +02:00
Roman Vasin
f830f24662 Revert "Add dbms in cmake" 
This reverts commit 3d64cf4423.
 2023-06-15 14:31:21 +00:00
Yakov Olkhovskiy
35b7474ccf
add MapState to aspell-dict.txt 2023-06-15 10:22:58 -04:00
Kseniia Sumarokova
f1f8b302bf
Merge pull request #50934 from azat/tests/fix-query_log 
Fix tests sanity checks and avoid dropping system.query_log table
 2023-06-15 12:44:23 +02:00
Roman Vasin
3d64cf4423 Add dbms in cmake 2023-06-14 15:40:32 +00:00
Antonio Andelic
4825286b0c
Merge branch 'master' into keeper-with-disks 2023-06-14 10:48:53 +02:00
Azat Khuzhin
bb971fd7b7 check-style: allow {database} for ReplicatedMergeTree as well 
CLICKHOUSE_TEST_ZOOKEEPER_PREFIX is a {test_name}_{database}, but
actually {database} should be enough, since it is uniq for each test run.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-06-13 19:45:51 +02:00
Azat Khuzhin
945981e5f6 Fix tests sanity checks 
In #43147 the "tests" had been added to EXCLUDE_DIRS, and the reason for
this is that there was some C++ code to ignore [1], however it also
ignores snaity check for query_log.

  [1]: https://s3.amazonaws.com/clickhouse-test-reports/43147/63de577172ee024a08e76db69f5000568673db48/style_check.html

v2: check-style: ignore $EXCLUDE_DIRS for some other sanity checks of tests
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-06-13 19:45:51 +02:00
JackyWoo
9d548315e8
Merge branch 'master' into support_redis 2023-06-13 09:34:32 +08:00
Robert Schulze
7745f7da73
Merge branch 'master' into annoy-misc 2023-06-12 21:46:27 +02:00
Antonio Andelic
cb3ac81110
Merge branch 'master' into keeper-with-disks 2023-06-12 15:14:24 +02:00
robot-clickhouse
11fbc01de5 Update version_date.tsv and changelogs after v23.4.3.48-stable 2023-06-12 12:37:47 +00:00
JackyWoo
a9d4d51949 add word redis to aspell-dict 2023-06-12 10:16:02 +08:00
robot-clickhouse
296b11a1ae Update version_date.tsv and changelogs after v23.5.2.7-stable 2023-06-10 20:56:54 +00:00
alesapin
572c9dec4e
Merge pull request #50812 from ClickHouse/Rename_azure_blob_table_function 
Rename azure_blob_storage to azureBlobStorage
 2023-06-10 18:10:59 +02:00
Smita Kulkarni
e662fa01d0 Added azureBlobStorage to aspell-dict.txt 2023-06-09 20:21:57 +02:00
robot-clickhouse
af153399bf Update version_date.tsv and changelogs after v23.2.7.32-stable 2023-06-09 15:26:13 +00:00
robot-clickhouse
61a20468f7 Update version_date.tsv and changelogs after v23.5.1.3174-stable 2023-06-09 11:53:29 +00:00
Andrey Zvonov
d95be4162f
Merge branch 'master' into zvonand-implicit-tz 2023-06-08 18:34:45 +03:00
zvonand
4d4e5c690e update docs spelling check failed 2023-06-08 17:10:51 +02:00
Robert Schulze
b8178088d0
Misc Annoy fixes 2023-06-08 15:06:17 +00:00
Antonio Andelic
42798e446b Merge branch 'master' into keeper-with-disks 2023-06-06 14:55:47 +00:00
Sergei Trifonov
cb37506421
Merge branch 'master' into async-loader-integration 2023-06-05 21:33:44 +02:00
Antonio Andelic
c4873027c3 Merge branch 'master' into keeper-with-disks 2023-06-05 07:08:33 +00:00
johanngan
5e1c93c9c8 Add dictGetAll to spell-check dictionary 2023-06-04 23:46:04 -05:00
serxa
bacf1d6beb spell 2023-06-03 22:52:50 +00:00
serxa
27b7196961 reply on job_id instead of job name 2023-06-03 15:17:05 +00:00
serxa
5509749e43 fix usage 2023-06-03 14:33:17 +00:00
serxa
e2ae501acf add utils/async_loader_graph graph rendering tool 2023-06-03 14:26:09 +00:00
Kruglov Pavel
85ded501d7
Update aspell-dict.txt 2023-06-02 20:02:14 +02:00
Robert Schulze
54872f9e7e
Typos: Follow-up to #50476 2023-06-02 13:28:09 +00:00
Robert Schulze
a22bb07fbd
Merge remote-tracking branch 'rschu1ze/master' into fix-typo-check-on-nested-docs 2023-06-02 12:33:16 +00:00
Robert Schulze
65cc92a78d
CI: Fix aspell on nested docs 2023-06-02 12:24:41 +00:00
Antonio Andelic
514beb783b Merge branch 'master' into keeper-with-disks 2023-06-01 12:19:43 +00:00
Roman Vasin
fd8c599288 Add encrypt_decrypt example 2023-05-31 15:16:18 +00:00
Robert Schulze
d7002f8b94
Incorporate Dan's feedback 2023-05-30 17:46:21 +00:00
Antonio Andelic
8a2a63a7bd Merge branch 'master' into keeper-with-disks 2023-05-26 10:48:41 +00:00
Roman Vasin
5f73681b00 Make working note descryption 2023-05-25 15:51:20 +00:00
Antonio Andelic
092cf99147 Fix build 2023-05-24 13:45:14 +00:00
Mikhail f. Shiryaev
da59d8a5b7
Speed-up the shellcheck with parallel xargs 2023-05-24 00:27:29 +02:00
Alexey Milovidov
4942026630
Merge pull request #49620 from ClickHouse/rs/utils-not-by-default 
CMake: Don't build utils unless explicitly requested
 2023-05-08 06:18:50 +03:00
Alexey Milovidov
3cf1da7bf3
Merge branch 'master' into deprecate-in-memory-parts 2023-05-08 01:38:00 +03:00
Mikhail f. Shiryaev
e1fa92e078
Add openSUSE and SLES to docs dictionary, sort it 2023-05-07 19:30:55 +02:00
Robert Schulze
31b0f19a2a
CMake: Don't build utils unless explicitly requested 2023-05-07 12:12:35 +00:00
Robert Schulze
fc4288d3ac
Fix FreeBSD build 2023-05-07 06:55:24 +00:00
Robert Schulze
76cf206efe
Fix build when memcpy-bench isn't available 2023-05-06 20:26:27 +00:00
Robert Schulze
6848eafb39
Cleanup utils build 2023-05-06 17:11:06 +00:00
Alexey Milovidov
09f171822e Merge branch 'master' into deprecate-in-memory-parts 2023-05-05 06:43:23 +02:00
Manas Alekar
6d6f3bc58b Static cast std::atomic<size_t> to uint64_t to serialize. 
There are no viable constructors for the atomic in rapidJSON.
 2023-05-03 18:11:17 -07:00
Alexey Milovidov
261907c143 Merge branch 'master' into deprecate-in-memory-parts 2023-05-04 01:07:38 +02:00
Alexey Milovidov
c799bcf6bf
Merge pull request #49437 from azat/build/disable-libraries-fixes 
Build fixes for ENABLE_LIBRARIES=OFF
 2023-05-03 23:55:50 +03:00
Mikhail f. Shiryaev
be7bb02857
Mark all versions after the last supported as * 2023-05-03 19:25:27 +02:00
Azat Khuzhin
d761e24514 Do not build keeper-bench if rapidjson was disabled 
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-05-03 09:49:47 +02:00
Alexey Milovidov
c26ca71077 Improve system.licenses table 2023-05-03 03:12:53 +02:00
Alexey Milovidov
f449df85b6 Deprecate in-memory parts 2023-05-03 00:31:09 +02:00
robot-clickhouse
b7d641cebe Update version_date.tsv and changelogs after v23.4.2.11-stable 2023-05-02 16:39:28 +00:00
alesapin
49a7eb71a7
Merge pull request #48547 from ClickHouse/keeper-bench-2.0 
Keeper bench 2.0
 2023-05-01 14:48:13 +02:00
Alexey Milovidov
d945089df8 Fix tests visualizer 2023-04-29 23:48:45 +02:00
robot-clickhouse
904461773d Update version_date.tsv and changelogs after v23.4.1.1943-stable 2023-04-26 23:50:52 +00:00
Robert Schulze
2c7cb97ce0
Teach aspell something new 2023-04-24 20:31:58 +00:00
robot-clickhouse
662919865a Update version_date.tsv and changelogs after v23.2.6.34-stable 2023-04-23 22:03:17 +00:00
Alexey Milovidov
6f5945175c
Merge pull request #49042 from ClickHouse/log-profile-events 
Add profile events for log messages
 2023-04-23 06:22:58 +03:00
robot-clickhouse
9a3600bda5 Update version_date.tsv and changelogs after v23.3.2.37-lts 2023-04-22 15:54:55 +00:00
Alexey Milovidov
5d3edc9a83 Fix error 2023-04-22 15:06:26 +02:00
robot-ch-test-poll1
f466c89621
Merge pull request #48911 from Avogar/parquet-metadata-format 
Add ParquetMetadata input format to read Parquet file metadata
 2023-04-21 03:46:26 +02:00
Dan Roscigno
95b64eccbc
Merge pull request #48861 from DanRoscigno/add-transactions 
move transactions to clickhouse repo
 2023-04-20 10:55:42 -04:00
avogar
7a67951f64 Add more fields, fix style 2023-04-18 17:59:01 +00:00
Kruglov Pavel
59a74b47ee
Update aspell-dict.txt 2023-04-18 15:57:50 +02:00
DanRoscigno
7bc43e05b3 remove whitespace 2023-04-17 12:55:06 -04:00
DanRoscigno
79c89ad52f remove whitespace 2023-04-17 12:51:34 -04:00
DanRoscigno
bf302653c1 add related words to aspell 2023-04-17 12:30:57 -04:00
Antonio Andelic
10cfc146cb Fix spaces 2023-04-17 15:09:35 +00:00
Antonio Andelic
06087b3bf0 update README 2023-04-17 14:45:39 +00:00
Antonio Andelic
ef5d8b4f37 Add readme 2023-04-17 11:30:59 +00:00
Antonio Andelic
5f96ee029c Merge branch 'master' into keeper-bench-2.0 2023-04-17 11:26:08 +00:00
Antonio Andelic
3dcc7e2f9e Improve outputs 2023-04-17 11:25:46 +00:00
Antonio Andelic
6bc1ab7ab1 Add JSON output 2023-04-14 18:49:28 +00:00
Antonio Andelic
32adebb723 Merge branch 'master' into keeper-bench-2.0 2023-04-14 10:55:15 +00:00
Kseniia Sumarokova
9eee7c72fe
Merge pull request #47307 from kssenii/better-tests-for-data-lakes 
deltalake/iceberg/hudi improvements
 2023-04-14 12:13:17 +02:00
Alexander Tokmakov
5cfcead4a7 limit size of messages from the CI slack bot 2023-04-13 23:28:03 +02:00
kssenii
6f53784f22 Merge remote-tracking branch 'upstream/master' into better-tests-for-data-lakes 2023-04-13 15:56:40 +02:00
Alexander Tokmakov
15081fef32
Merge pull request #48712 from ClickHouse/improve_slack_bot 
Better messages formatting in the CI Slack bot
 2023-04-12 17:16:11 +03:00
Alexander Tokmakov
5f223f24c6 better messages formatting 2023-04-12 15:50:06 +02:00
DanRoscigno
c6907f2a32 add Observability to spell list 2023-04-11 09:53:40 -04:00
Antonio Andelic
ca1e6ac5ca Add example yaml 2023-04-07 15:22:03 +00:00
Antonio Andelic
e9d43a8f6a Remove generator name config 2023-04-07 15:20:36 +00:00
Antonio Andelic
46533c1ea7 CreateRequest more stable 2023-04-07 14:55:23 +00:00
Antonio Andelic
9df7a67306 Add more configurations 2023-04-07 14:15:25 +00:00
Antonio Andelic
22a4d7d1e1 Support connection definition 2023-04-07 13:02:42 +00:00
Antonio Andelic
994b6dd71c Add other requests 2023-04-06 19:17:35 +00:00
Antonio Andelic
d74ff75d83 Add support for create request test 2023-04-06 15:10:58 +00:00
Antonio Andelic
e2e32fa34c Add config 2023-04-06 10:25:37 +00:00
kssenii
be13ce76f4 Merge remote-tracking branch 'upstream/master' into better-tests-for-data-lakes 2023-04-05 18:47:08 +02:00
Alexander Tokmakov
e2679ccb53 make CI slack bot less noisy 2023-04-05 02:16:03 +02:00
kssenii
f44c53b97a Merge remote-tracking branch 'upstream/master' into better-tests-for-data-lakes 2023-04-04 22:41:22 +02:00
Alexander Tokmakov
292d6e65bc
Merge pull request #48382 from ClickHouse/ci_slack_bot 
Add script for a slack bot that reports broken tests
 2023-04-04 15:45:18 +03:00
Alexander Tokmakov
2d4fbdf4b0 add script for a slack bot 2023-04-04 14:27:58 +02:00
robot-clickhouse
57a412745d Update version_date.tsv and changelogs after v22.8.16.32-lts 2023-04-04 11:35:29 +00:00
kssenii
8915f49b7d Merge remote-tracking branch 'upstream/master' into better-tests-for-data-lakes 2023-04-03 17:43:42 +02:00
robot-clickhouse
0af16e4b7a Update version_date.tsv and changelogs after v23.2.5.46-stable 2023-04-03 12:16:27 +00:00
Alexander Tokmakov
1e4ae7a3f2
Merge pull request #48314 from azat/build/strong-typedefs 
Fix ThreadPool for DistributedSink and use StrongTypedef for CurrentMetrics/ProfileEvents/StatusInfo to avoid further errors
 2023-04-02 14:57:33 +03:00
Dan Roscigno
62ecac805f
Add mdadm to aspell-dict.txt 2023-04-01 18:58:48 -04:00
Azat Khuzhin
1794505428 check-style: do not count CurrentMetrics::get as metric 2023-04-01 16:02:28 +02:00
robot-clickhouse
648f80ee4e Update version_date.tsv and changelogs after v22.12.6.22-stable 2023-03-31 19:50:47 +00:00
robot-clickhouse
0c9d7f73ce Update version_date.tsv and changelogs after v23.3.1.2823-lts 2023-03-31 10:35:58 +00:00
kssenii
319417062f Merge remote-tracking branch 'upstream/master' into better-tests-for-data-lakes 2023-03-30 18:29:46 +02:00
kssenii
fcc8e4223c Merge remote-tracking branch 'upstream/master' into better-tests-for-data-lakes 2023-03-29 14:13:27 +02:00
Azat Khuzhin
f38a7aeabe ThreadPool metrics introspection 
There are lots of thread pools and simple local-vs-global is not enough
already, it is good to know which one in particular uses threads.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-03-29 10:46:59 +02:00
kssenii
04b28bf822 Merge remote-tracking branch 'upstream/master' into better-tests-for-data-lakes 2023-03-28 15:39:24 +02:00
Raúl Marín
aace3cb34c Try to prevent large test numbers 2023-03-28 14:07:27 +02:00
Antonio Andelic
61b3500157
Merge pull request #47978 from ClickHouse/more-batching-keeper 
Even more batching in Keeper
 2023-03-27 21:47:29 +02:00
Alexey Milovidov
df35d1abf9
Merge pull request #48052 from ClickHouse/correct-changelog-2 
Automatically correct some mistakes in the changelog
 2023-03-27 22:10:00 +03:00
Alexey Milovidov
4234c38a64 Automatically correct some mistakes in the changelog 2023-03-27 14:48:05 +02:00
Alexey Milovidov
78eb71a49b Remove the old changelog script 2023-03-27 12:11:32 +02:00
Antonio Andelic
e38aa298f4 Merge branch 'master' into more-batching-keeper 2023-03-24 19:44:29 +00:00
robot-clickhouse
7a82830f10 Automatic style fix 2023-03-24 15:04:05 +00:00
Antonio Andelic
f7c0cca297 Maybe better keeper-bench 2023-03-24 14:37:51 +00:00
Mikhail f. Shiryaev
290ee6bbf1
Merge pull request #47790 from CurtizJ/apply-black-to-all-files 
Apply black formatter to all python scripts
 2023-03-24 14:20:50 +03:00
Mikhail f. Shiryaev
4f2c336cfc
Update black version, run it for the repository 2023-03-24 11:54:38 +01:00
Anton Popov
0ee8dfad53 apply black formatter 2023-03-23 15:33:23 +00:00
Robert Schulze
14356e3ee6
Aspell dict: keep sorted things sorted 
Follow-up to #47745
 2023-03-22 09:18:22 +00:00
Robert Schulze
382aa60056
Merge pull request #47745 from jinjunzh/iaadeflate_doc_update 
Create doc and scripts for qpl_deflate benchmark
 2023-03-22 10:15:26 +01:00
jinjunzh
ab44903f15 add to the dictionary file 2023-03-22 10:28:24 -04:00
kssenii
eceb54b001 Hudi tests 2023-03-21 12:51:14 +01:00
Anton Popov
21f5d20b9e apply black to all python scripts 2023-03-20 17:30:20 +00:00
Alexey Milovidov
b97154263d
Merge pull request #47703 from ClickHouse/add-style-check-for-dereference-after-cast 
Add a style check for unsafe code
 2023-03-18 22:07:47 +03:00
rfraposa
292793a231 Update aspell-dict.txt 2023-03-17 21:30:21 -05:00
Alexey Milovidov
aea421cc9b Add a style check for unsafe code 2023-03-18 03:29:14 +01:00
Han Fei
722e6bb2e8
Merge pull request #47680 from ClickHouse/rs/uncruftify-build 
CMake: Remove further cruft from build
 2023-03-17 22:58:46 +01:00
Alexey Milovidov
c7762bd667
Update check-style 2023-03-17 22:55:01 +03:00
Alexey Milovidov
b48c679328 Add style check for #47647 2023-03-17 20:51:58 +01:00
kssenii
f776f4ff46 Merge remote-tracking branch 'upstream/master' into better-tests-for-data-lakes 2023-03-17 19:45:28 +01:00
kssenii
e48d8d12e7 Fixes for hudi 2023-03-17 19:44:30 +01:00
Robert Schulze
f72a337074
Remove cruft from build 
No need to check compiler flags, clang >= 15 supports all of them.
 2023-03-17 13:44:04 +00:00
Alexey Milovidov
4a847f2546
Merge pull request #47436 from ClibMouse/s390x_docs 
Add s390x cross build instructions
 2023-03-11 04:06:07 +03:00
robot-clickhouse
96477e1ea5 Update version_date.tsv and changelogs after v22.8.15.23-lts 2023-03-10 22:01:27 +00:00
robot-clickhouse
eab7204468 Update version_date.tsv and changelogs after v22.12.5.34-stable 2023-03-10 21:42:42 +00:00
robot-clickhouse
86abe160fa Update version_date.tsv and changelogs after v23.1.5.24-stable 2023-03-10 20:23:57 +00:00
Boris Kuschel
663b4fb4a8
Small tweaks 2023-03-10 15:20:57 -05:00
Boris Kuschel
1df592b06b
Remove exclusion 2023-03-10 13:04:32 -05:00
Boris Kuschel
d26466bab9 aspell corrections 2023-03-10 13:01:26 -05:00
robot-clickhouse
363989f3f8 Update version_date.tsv and changelogs after v23.2.4.12-stable 2023-03-10 17:56:29 +00:00
Yakov Olkhovskiy
65d671b7c7
Merge pull request #47116 from ClickHouse/self-extracting-sudo 
Preserve uid gid if running with sudo
 2023-03-09 01:10:28 -05:00
kssenii
0240ad4c68 Add spark to tests, rewrite tests, fix bug 2023-03-08 15:45:35 +01:00
Yakov Olkhovskiy
07a3988749
geteuid is enough 2023-03-08 08:26:07 -05:00
Mike Kot
9920a52c51 use std::lerp, constexpr hex.h 2023-03-07 22:50:17 +00:00
Yakov Olkhovskiy
4a227d6489
Merge branch 'master' into self-extracting-sudo 2023-03-07 08:49:34 -05:00
Yakov Olkhovskiy
aacd05e34b
bugfix + review suggestion 2023-03-06 21:24:04 -05:00
robot-clickhouse
e50fd6e1ef Update version_date.tsv and changelogs after v23.2.3.17-stable 2023-03-06 16:35:17 +00:00
Yakov Olkhovskiy
a8ceab1366
NOLINT for getenv 2023-03-03 09:24:58 -05:00
Yakov Olkhovskiy
df41a83ddb set uid gid to file's original 2023-03-02 14:49:49 +00:00
Yakov Olkhovskiy
566a0e166f preserve uid gid if running with sudo 2023-03-02 00:42:02 +00:00
Alexander Tokmakov
a97e15e36f Merge branch 'master' into fix_insert_cancellation_in_native_protocol 2023-03-01 14:26:41 +01:00
Mike Kot
02950ecf29 aspell fix 2023-03-01 15:34:10 +03:00
robot-clickhouse
463dbdc838 Update version_date.tsv and changelogs after v22.3.19.6-lts 2023-02-27 13:29:21 +00:00
Alexander Tokmakov
cad1e0b768 fix 2023-02-25 01:18:34 +01:00
Alexander Tokmakov
99cf9abe54
Merge branch 'master' into tests/expect-timeout-fixes 2023-02-24 23:07:45 +03:00
rfraposa
7b1b4f1fd6 Update aspell-dict.txt 2023-02-24 11:54:12 -07:00
robot-clickhouse
dd3591cb9c Update version_date.tsv and changelogs after v22.11.6.44-stable 2023-02-23 22:07:08 +00:00
Alexander Tokmakov
fe92fd8a61 Merge branch 'master' into fix_insert_cancellation_in_native_protocol 2023-02-23 22:35:31 +01:00
Alexander Tokmakov
d21a6a3ba4 fix 2023-02-23 20:52:39 +01:00
robot-clickhouse
f2e71bc3b7 Update version_date.tsv and changelogs after v23.2.1.2537-stable 2023-02-23 19:46:46 +00:00
Azat Khuzhin
3d3f511cb4 Add style check for expect_after in tests 
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-02-23 15:27:11 +01:00
Alexey Milovidov
f7df0fa0bf
Merge pull request #46582 from azat/tests/expect 
Fix flakiness of expect tests for clickhouse-client by avoiding history overlap
 2023-02-21 02:49:14 +03:00
Dan Roscigno
32de437533
Update changelog README 2023-02-20 09:49:14 -05:00
Azat Khuzhin
2018559fa5 Add style check for using --history_file in expect tests 
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-02-20 09:51:08 +01:00
Mikhail f. Shiryaev
1565f2c233
Do not destroy symlinks with sed 2023-02-17 18:39:09 +01:00
Mikhail f. Shiryaev
0b6f632584
Add clickhouse/clickhouse-keeper Dockerfile autoupdate 2023-02-17 18:34:26 +01:00
alesapin
d08b2753e4
Merge pull request #46367 from ClickHouse/reduce-keeper-build-time 
Do not build libclickhouse-keeper-lib.a for standalone keeper
 2023-02-16 13:56:27 +01:00
robot-clickhouse
f6c894eb6e Update version_date.tsv and changelogs after v22.3.18.37-lts 2023-02-15 13:03:30 +00:00
Mikhail f. Shiryaev
08ffb8f93d
Install only "programs" directory during build 2023-02-15 11:49:19 +01:00
kssenii
3067c1d723 Merge remote-tracking branch 'upstream/master' into resubmit-prefetches 2023-02-11 11:36:23 +01:00
Robert Schulze
81e943c7f8
More spelling fixes 2023-02-10 11:20:48 +00:00
Robert Schulze
06e1293909
Fix duplicate includes in poco 2023-02-10 10:50:18 +00:00
Robert Schulze
8144c28c3b
Fix spelling 2023-02-10 10:49:55 +00:00
Robert Schulze
d44c6dd1b3
Merge pull request #46133 from ClickHouse/rs/fix-warnings-in-poco 
Stricter warnings + fix whitespaces in poco
 2023-02-10 11:46:33 +01:00
Alexander Tokmakov
8101b044fa
Merge pull request #46091 from azat/sanity-assertions 
Sanity assertions for closing file descriptors
 2023-02-09 01:02:03 +03:00
kssenii
b0b865c32e Resubmit prefetches 2023-02-08 21:26:24 +01:00
serxa
8f87dd9957 add Yasm exception for spell checker 2023-02-08 18:23:15 +00:00
Robert Schulze
537a697f65
Fix whitespaces 2023-02-08 11:36:52 +00:00
Robert Schulze
b79ead9c84
Move poco to base/poco/ (#46075) 
* Replicate poco into base/poco/

* De-register poco submodule

* Build poco from ClickHouse

* Exclude poco from stylecheck

* Exclude poco from whitespace check

* Exclude poco from typo check

* Remove x bit from sources/headers (the style check complained)

* Exclude poco from duplicate include check

* Fix fasttest

* Remove contrib/poco-cmake/*

* Simplify poco build descriptions

* Remove poco stuff not used by ClickHouse

* Glob poco sources

* Exclude poco from clang-tidy
 2023-02-08 12:04:11 +01:00
Azat Khuzhin
6587d11885 Check return value of close() in self-extracting-executable 
And also add description into perror() over callign simply
perror(nullptr).

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-02-07 11:28:22 +01:00
Azat Khuzhin
0ab351c82e Add close() return value check in check-style 
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-02-06 20:20:15 +01:00
robot-clickhouse
a9ab22e45d Update version_date.tsv and changelogs after v23.1.3.5-stable 2023-02-03 13:00:13 +00:00
Antonio Andelic
5de6f86c27 Fix clang-tidy error 2023-02-01 12:28:44 +00:00
Robert Schulze
b5f5018b10
Fix spelling 2023-01-31 11:55:45 +00:00
robot-clickhouse
65ee121dba Update version_date.tsv and changelogs after v23.1.2.9-stable 2023-01-29 16:53:30 +00:00
robot-clickhouse
efb346976e Update version_date.tsv and changelogs after v22.11.5.15-stable 2023-01-29 13:39:03 +00:00
Alexander Tokmakov
067b1f5f13 Merge branch 'master' into exception_message_patterns4 2023-01-26 15:20:58 +01:00
Dan Roscigno
efe94b727c
Merge pull request #45574 from FArthur-cmd/laion_doc 
Add documentation for laion dataset
 2023-01-26 08:43:28 -05:00
robot-clickhouse
976a3d26ec Update version_date.tsv and changelogs after v22.10.7.13-stable 2023-01-26 00:59:09 +01:00
robot-clickhouse
b9ee37f122 Update version_date.tsv and changelogs after v23.1.1.3077-stable 2023-01-25 23:05:49 +00:00
Alexander Tokmakov
ae795d87b2 fix 2023-01-25 16:06:40 +01:00
FArthur-cmd
3d8e8a84f6 ignore laion as it is dataset's name 2023-01-24 18:41:07 +03:00
Robert Schulze
4f90824347
Merge remote-tracking branch 'origin/master' into query-result-cache 2023-01-17 22:49:53 +00:00
Yakov Olkhovskiy
c8f635e40b WSL1 inconsistency 2023-01-16 18:32:41 +00:00
Robert Schulze
099e30ef2a
Merge remote-tracking branch 'origin/master' into query-result-cache 2023-01-16 08:04:49 +00:00
robot-clickhouse
82e73b583e Update version_date.tsv and changelogs after v22.3.17.13-lts 2023-01-12 19:22:22 +00:00
Mikhail f. Shiryaev
807e84da98
Delete unused website directory 2023-01-11 16:31:27 +01:00
robot-clickhouse
686947b8f4 Update version_date.tsv and changelogs after v22.12.3.5-stable 2023-01-10 13:07:45 +00:00
robot-clickhouse
56c9952f19 Update version_date.tsv and changelogs after v22.8.12.45-lts 2023-01-10 10:54:29 +00:00
Robert Schulze
0c3b034887
Merge remote-tracking branch 'origin/master' into query-result-cache 2023-01-10 09:02:41 +00:00
robot-clickhouse
f0f5899319 Update version_date.tsv and changelogs after v22.3.16.1190-lts 2023-01-09 19:59:03 +00:00
Alexey Milovidov
be8df5683e
Merge pull request #44988 from ClickHouse/auto/v22.12.2.25-stable 
Update version_date.tsv and changelogs after v22.12.2.25-stable
 2023-01-08 02:52:59 +03:00
Alexey Milovidov
17c797a405 Enable the check that was commented 2023-01-07 21:42:49 +01:00
Robert Schulze
45dbcf88e5
Merge remote-tracking branch 'origin/master' into query-result-cache 2023-01-06 20:42:48 +00:00
robot-clickhouse
72b9e43295 Update version_date.tsv and changelogs after v22.12.2.25-stable 2023-01-06 15:20:59 +00:00
Robert Schulze
27f5aad49e
What happens if I remove 156 lines of code? 2023-01-03 18:51:16 +00:00
Alexey Milovidov
428404a9f0
Merge pull request #44838 from ClickHouse/check-submodules-escape 
Escape submodules in style-check
 2023-01-02 17:43:13 +03:00
Mikhail f. Shiryaev
ae93af32a0
Escape submodules in style-check 2023-01-02 14:23:53 +01:00
Azat Khuzhin
26718ccddf check-style: check base for std::cerr/cout too 
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-01-02 11:42:59 +01:00
Robert Schulze
e9e04166d9
Merge remote-tracking branch 'origin/master' into query-result-cache 2023-01-02 08:20:27 +00:00
Dan Roscigno
bc456feb4b
Merge pull request #44708 from Avogar/schema-inference-docs 
Add detailed documentation about schema inference
 2022-12-30 11:19:09 -05:00
avogar
872d5a5699 Fix style 2022-12-29 20:45:10 +00:00
Azat Khuzhin
e719fd218d Add excludes for std::cout usage in LineReader 
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2022-12-27 14:23:51 +01:00
Azat Khuzhin
b7f92454bf Move LineReader/ReplxxLineReader out from base 
This will simplify linking dependencies, and anyway this classes are not
base in any sense.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2022-12-27 14:23:51 +01:00
Mikhail f. Shiryaev
b5a791ddbc
Merge pull request #44386 from ClickHouse/check-submodules 
Add check for submodules sanity
 2022-12-19 17:51:56 +01:00
Mikhail f. Shiryaev
815ba5b48f
Add check for submodules sanity 2022-12-19 17:36:03 +01:00
Mikhail f. Shiryaev
3c7cfc297c
Merge pull request #44377 from DanRoscigno/edit-dictionary 
add runnable to ignore list
 2022-12-19 16:47:03 +01:00
DanRoscigno
ca9f27b68c add runnable to ignore list 2022-12-19 08:36:18 -05:00
Robert Schulze
b93c56323c
Merge remote-tracking branch 'origin/master' into query-result-cache 2022-12-19 09:18:36 +00:00
Alexey Milovidov
f3a4163c87
Merge pull request #41099 from peter279k/improve_build 
Improve building steps
 2022-12-19 04:01:14 +03:00
robot-clickhouse
9e7d8d2a6f Update version_date.tsv and changelogs after v22.9.7.34-stable 2022-12-16 11:57:24 +00:00
Robert Schulze
56d9882b43
Fix spell check 2022-12-16 11:24:26 +00:00
robot-clickhouse
f4fbdfa93d Update version_date.tsv and changelogs after v22.12.1.1752-stable 2022-12-15 17:07:16 +00:00
Robert Schulze
3a0bd18b62
Typos 2022-12-15 13:06:24 +00:00
Mikhail f. Shiryaev
fe44b514b7
Create GitHub cache directory optionally by default 2022-12-09 21:33:06 +01:00
Dan Roscigno
59e93bc9c6
Merge branch 'master' into improve_build 2022-12-09 12:40:46 -05:00
Mikhail f. Shiryaev
a0bde8a974
Order the dictionary 2022-12-09 15:29:24 +01:00
Mikhail f. Shiryaev
5fddc411d3
Add retriable and ReplicatedMergeTree 2022-12-09 15:29:02 +01:00
Sema Checherinda
06d6b87bae
Merge pull request #44059 from ClickHouse/nvartolomei-nv/fix-mutate-fetch 
Merging #36877
 2022-12-09 11:16:57 +01:00
DanRoscigno
d3e5116e24 add changelogs 2022-12-08 18:15:19 -05:00
Alexey Milovidov
2bfe74e863 Add style check 2022-12-08 23:14:22 +01:00
robot-clickhouse
c60545a942 Update version_date.tsv and changelogs after v22.8.11.15-lts 2022-12-08 11:30:31 +00:00
Mikhail f. Shiryaev
90a7f2344a
Merge pull request #43942 from ClickHouse/fix-tags-workflow 
Fix tags workflow
 2022-12-05 15:51:21 +01:00
Mikhail f. Shiryaev
be9c673993
Generate missed changelogs for latest releases 2022-12-05 15:00:01 +01:00
Mikhail f. Shiryaev
79179d8a3b
Use python3 as executor for generate_security.py 2022-12-05 14:21:28 +01:00
Mikhail f. Shiryaev
9cb2aa1c46
Add python mypy check to CI 2022-11-29 16:50:22 +01:00
Nikita Taranov
8ed5cfc265
Memory bound merging for distributed aggregation in order (#40879) 
* impl

* fix style

* make executeQueryWithParallelReplicas similar to executeQuery

* impl for parallel replicas

* cleaner code for remote sorting properties

* update test

* fix

* handle when nodes of old versions participate

* small fixes

* temporary enable for testing

* fix after merge

* Revert "temporary enable for testing"

This reverts commit cce7f8884c.

* review fixes

* add bc test

* Update src/Core/Settings.h
 2022-11-28 00:41:31 +01:00
Kruglov Pavel
98d6b96c82
Merge pull request #42033 from mark-polokhov/BSONEachRow 
Add BSONEachRow input/output format
 2022-11-22 14:45:21 +01:00
robot-clickhouse
4ee5d8bd43 Update version_date.tsv and changelogs after v22.8.9.24-lts 2022-11-19 11:51:14 +00:00
Alexey Milovidov
b4664cd525
Merge pull request #43365 from ClickHouse/update-security-on-tag 
Update SECURITY.md on new stable tags
 2022-11-18 22:39:17 +01:00
Mikhail f. Shiryaev
11a5103dfb
Add a comment how the SECURITY.md is generated 2022-11-18 15:10:32 +01:00
Mikhail f. Shiryaev
318a31ab6e
Rewrite SECURITY.md generator to python 2022-11-18 13:45:58 +01:00
robot-clickhouse
77500b7065 Update version_date.tsv and changelogs after v22.11.1.1360-stable 2022-11-17 21:20:45 +00:00
Kruglov Pavel
6b3276a741
Fix style 2022-11-15 14:47:29 +01:00
Kseniia Sumarokova
79206c6eb0
Merge pull request #43147 from kssenii/named-collections-refactoring 
Add generic implementation for arbitrary structured named collections, access type and system.named_collections
 2022-11-14 11:57:17 +01:00
kssenii
616da1f695 Review fixed, style check fix 2022-11-11 16:50:02 +01:00
avogar
cd36caf013 Fix style 2022-11-10 20:37:24 +00:00
Alexander Tokmakov
b8174a63a8 Merge branch 'master' into fix_intersecting_parts2 2022-11-07 20:26:36 +01:00
Sema Checherinda
8860550e87
Merge pull request #42972 from ClickHouse/remove-some-utils 
Remove some utils
 2022-11-07 11:29:55 +01:00
Alexey Milovidov
f1cbf2f28b
Merge pull request #42917 from ClickHouse/alexey-milovidov-patch-7 
Update README.md for utils/antlr
 2022-11-05 00:16:32 +01:00
Alexey Milovidov
c98731a19b Remove some utils 2022-11-04 19:22:04 +01:00
Jordi Villar
3441f42f24 Fix macOS M1 builds due to sprintf deprecation 2022-11-04 12:27:46 +01:00
Dan Roscigno
c92329c56a
Merge branch 'master' into improve_build 2022-11-03 08:27:04 -04:00
Alexey Milovidov
16a39e3880
Update README.md 2022-11-02 23:38:03 +03:00
Alexander Tokmakov
e67d05604c Merge branch 'master' into fix_intersecting_parts2 2022-11-02 19:30:27 +01:00
Alexander Tokmakov
d8b3a2af84 fix race between INSERT and DROP 2022-11-02 19:26:50 +01:00
robot-clickhouse
fc1ae1d99d Update version_date.tsv and changelogs after v22.10.2.11-stable 2022-11-01 15:50:38 +00:00
Alexey Milovidov
3c69f33b7d
Merge branch 'master' into auto/v22.3.14.23-lts 2022-10-29 17:42:26 +02:00
Alexey Milovidov
cd9756bbaa
Merge pull request #42759 from ClickHouse/auto/v22.3.14.18-lts 
Update version_date.tsv and changelogs after v22.3.14.18-lts
 2022-10-29 17:40:22 +02:00
robot-clickhouse
4f62bd6ba0 Update version_date.tsv and changelogs after v22.3.14.23-lts 2022-10-28 11:43:06 +00:00
robot-clickhouse
51e59405bc Update version_date.tsv and changelogs after v22.3.14.18-lts 2022-10-28 09:41:29 +00:00
Jordi Villar
073d81c31f Use nfds_t instead 2022-10-27 20:36:42 +02:00
robot-clickhouse
c46ee42a99 Update version_date.tsv and changelogs after v22.8.8.3-lts 2022-10-27 11:12:23 +00:00
Dan Roscigno
61c3de2ec5
Merge branch 'master' into improve_build 2022-10-26 16:23:48 -04:00
robot-clickhouse
18c0e7b228 Update version_date.tsv and changelogs after v22.8.7.34-lts 2022-10-26 17:19:01 +00:00
robot-clickhouse
42f5a3b2f8
Update version_date.tsv and changelogs after v22.10.1.1877-stable 2022-10-26 15:39:34 +02:00
Mikhail f. Shiryaev
576e6dd9aa
Merge pull request #42676 from ClickHouse/auto/v22.10.1.1875-stable 
Update version_date.tsv and changelogs after v22.10.1.1875-stable
 2022-10-26 13:54:45 +02:00
robot-clickhouse
117674c0ce Update version_date.tsv and changelogs after v22.10.1.1875-stable 2022-10-26 08:48:12 +00:00
Jordi Villar
9c9b8f4400 Minor fix iotest_nonblock build 2022-10-25 15:23:28 +02:00
Dan Roscigno
c6d6873234
Update aspell-dict.txt 2022-10-24 09:12:15 -04:00
Mikhail f. Shiryaev
a29ece3bb8
Merge pull request #42349 from azat/packages/archlinux 
Use nfpm packager for archlinux packages
 2022-10-24 10:26:24 +02:00
Azat Khuzhin
15bcd6250a Fix -Wshorten-64-to-32 for darwin builds 
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2022-10-21 13:25:42 +02:00
Azat Khuzhin
8414ea0691 Fix -Wshorten-64-to-32 in self extracting executable 
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2022-10-21 13:25:42 +02:00
Azat Khuzhin
4e76629aaf Fixes for -Wshorten-64-to-32 
- lots of static_cast
- add safe_cast
- types adjustments
  - config
  - IStorage::read/watch
  - ...
- some TODO's (to convert types in future)

P.S. That was quite a journey...

v2: fixes after rebase
v3: fix conflicts after #42308 merged
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2022-10-21 13:25:19 +02:00
Antonio Andelic
9d7e44409a
Merge pull request #41342 from ClickHouse/keeper-upload-snapshot-to-s3 
Upload Keeper snapshots to S3
 2022-10-20 09:14:59 +02:00
Azat Khuzhin
043c4163f4 Use nfpm packager for archlinux packages 
Since nfpm v2.20.0 it can build packages for archlinux [1].

  [1]: https://github.com/goreleaser/nfpm/pull/543

Something like this:

    $ mkdir -p /src/packages/root
    $ cmake -DCMAKE_INSTALL_PREFIX=/usr /src
    $ DESTDIR=/src/packages/root ninja install
    $ cd /src/packages
    $ ./build --archlinux

    $ root@s3:/src/packages# ./build --archlinux
    Current version is 22.10.1.1
    Building archlinux package for clickhouse-client.yaml
    using archlinux packager...
    created package: /src/clickhouse-client-22.10.1.1-1-x86_64.pkg.tar.zst
    ...

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2022-10-18 18:33:48 +03:00
Antonio Andelic
540728ab96 Simplify logic a bit 2022-10-18 10:58:25 +00:00
Azat Khuzhin
0c62e09a6e
check-style: fix ErrorCodes check 
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2022-10-17 10:32:33 +00:00
Azat Khuzhin
631b8e1abb
check-style: fix pattern of allowed chars for ErrorCodes checks 
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2022-10-14 11:42:52 +00:00
vdimir
ad255206f4
Exclude comments from style-check defined extern 2022-10-14 11:42:18 +00:00
Alexander Tokmakov
4175f8cde6 abort instead of __builtin_unreachable in debug builds 2022-10-07 21:49:08 +02:00
DanRoscigno
700deb152f add toolchain to ignore 2022-10-06 14:47:12 -04:00
Dan Roscigno
ef62f32dd0
Update codespell-ignore-words.list 2022-10-06 14:42:42 -04:00
robot-clickhouse
fd65257153 Update version_date.tsv and changelogs after v22.6.9.11-stable 2022-10-06 08:36:14 +00:00
Anton Popov
a4dee04f7e
fix style check 2022-10-04 15:01:29 +02:00
robot-clickhouse
42760b577a Update version_date.tsv and changelogs after v22.9.3.18-stable 2022-09-29 23:35:12 +00:00
robot-clickhouse
8d2052307e Update version_date.tsv and changelogs after v22.9.2.7-stable 2022-09-23 11:53:04 +00:00
Kruglov Pavel
22e11aef2d
Merge pull request #40910 from Avogar/new-json-formats 
Add new JSON formats, add improvements and refactoring
 2022-09-21 14:19:08 +02:00
robot-clickhouse
fc4a0e0bda Update version_date.tsv and changelogs after v22.6.8.35-stable 2022-09-19 09:34:29 +00:00
Dan Roscigno
002a43a967
Merge pull request #41287 from ClickHouse/DanRoscigno-patch-2 
Update README.md
 2022-09-14 16:50:02 -04:00
Alexey Milovidov
088530b3a2
Update README.md 2022-09-14 17:53:15 +03:00
Dan Roscigno
ad9e7be566
Update README.md 
When running `changelog.py` I did not have tags and needed to supply a `--from` with a commit SHA.  Having the tags allows the script to go back to the last release.
 2022-09-13 17:23:41 -04:00
Mikhail f. Shiryaev
72a77ba8c1
Update VERSION in server Dockerfiles on new tag 2022-09-13 15:54:56 +02:00
robot-clickhouse
b9cb2ad7f7 Update version_date.tsv and changelogs after v22.8.5.29-lts 2022-09-13 12:31:55 +00:00
Kruglov Pavel
060adfbe93
Merge branch 'master' into new-json-formats 2022-09-12 19:37:46 +02:00
Alexey Milovidov
61278c81e4 Merge branch 'master' into remove-useless-line 2022-09-10 05:07:10 +02:00
avogar
ad68b7be0f Better 2022-09-09 15:01:45 +00:00
Alexey Milovidov
928c1cd0d4
Merge pull request #40967 from ClickHouse/alexey-milovidov-patch-4 
Update tips.md about filesystems
 2022-09-08 16:56:27 +03:00
Yakov Olkhovskiy
6339b106be
Merge pull request #41006 from ClickHouse/util-self-extracting-mac 
disable inode lock for macos and freebsd
 2022-09-05 21:45:53 -04:00
Yakov Olkhovskiy
1338f7d65e disable inode lock for macos and freebsd 2022-09-05 15:41:52 +00:00
Alexander Tokmakov
abffd4595e
Merge branch 'master' into zookeeper_client_fault_injection 2022-09-05 15:03:26 +03:00
Alexey Milovidov
74023efa66
Update aspell-dict.txt 2022-09-04 05:29:37 +03:00
Alexey Milovidov
1ae24b3e65 Update spelling dictionary 2022-09-04 04:07:10 +02:00
Alexey Milovidov
13a129bee7 Merge branch 'master' into remove-useless-line 2022-09-04 03:24:40 +02:00
alesapin
6815d79102
Merge pull request #40591 from ClickHouse/util-self-extracting-singl 
Self-extracting: fix possible race condition
 2022-09-02 12:26:01 +02:00
Antonio Andelic
e64436fef3 Fix typos with new codespell 2022-09-02 08:54:48 +00:00
alesapin
9d64e5f902
Merge branch 'master' into util-self-extracting-singl 2022-09-01 17:38:24 +02:00
robot-clickhouse
5309831a1a Update version_date.tsv and changelogs after v22.8.4.7-lts 2022-08-31 14:32:54 +00:00
Alexander Tokmakov
6a50c20734
Merge branch 'master' into zookeeper_client_fault_injection 2022-08-30 15:43:30 +03:00
Yakov Olkhovskiy
a9cab86a73 typo 2022-08-30 01:46:17 +00:00
Yakov Olkhovskiy
7a85a943f1 fix close lock on exec, refactoring, comments added 2022-08-30 01:11:04 +00:00
robot-clickhouse
92c14e80f1 Update version_date.tsv and changelogs after v22.3.12.19-lts 2022-08-29 14:52:19 +00:00
Alexander Tokmakov
8bdb589c2b Merge branch 'master' into zookeeper_client_fault_injection 2022-08-29 13:34:57 +02:00
Azat Khuzhin
35f5e56159 Update aspell-dict to fix doc check 
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2022-08-29 00:27:19 +02:00
Alexey Milovidov
fc68e09554 Fix style 2022-08-28 22:15:09 +02:00
Alexey Milovidov
deac6cfb5d Minor modifications 2022-08-28 20:49:39 +02:00
Yakov Olkhovskiy
ae82c68725 truncate lock 2022-08-25 10:52:56 +00:00
vdimir
f0c13b0531
Add CurrentMetrics::Value to check-style 2022-08-25 09:31:22 +00:00
Yakov Olkhovskiy
6c1a7205e3 fix style 2022-08-24 21:47:37 +00:00
Yakov Olkhovskiy
f043d03053 fix style 2022-08-24 21:28:52 +00:00
Yakov Olkhovskiy
6afd9c176b inode based singleton 2022-08-24 21:05:00 +00:00
robot-clickhouse
274f3dbb95 Update version_date.tsv and changelogs after v22.7.4.16-stable 2022-08-23 19:13:49 +00:00