Commit Graph

3691 Commits

Author SHA1 Message Date
Robert Schulze
93d8fc231c
Try to fix invocation from outside 2023-11-09 11:39:50 +00:00
Robert Schulze
fe397a3110
Parallelize with xargs 2023-11-09 10:17:49 +00:00
Robert Schulze
fa470b16e5
Parallel clone sparse/shallow submodules
(buzzword overload in the title, sorry)

Script update-submodules.sh does a sparse and shallow checkout of
submodules. It is offered as convenience for developers who want to
avoid long checkout times and save disk space. The script is called by a
few build jobs in CI to check that it doesn't break. This PR
parallelizes the actual checkout which reduces script runtime from 425
sec to 258 sec.
2023-11-08 20:02:40 +00:00
Robert Schulze
b9fafb5561
Try to fix sparse checkout 2023-11-08 17:18:05 +00:00
Robert Schulze
85c1588941
Bump gRPC to 1.47.5 2023-11-07 19:53:01 +00:00
Robert Schulze
a1a9cb7577
Bump gRPC to v1.44.1 2023-11-07 19:52:59 +00:00
Robert Schulze
4fe99c77c7
Bump gRPC to v1.43.2 2023-11-07 19:52:58 +00:00
Alexey Milovidov
cd94d02455 Merge branch 'master' into coverage 2023-11-04 21:49:59 +01:00
Alexey Milovidov
788863898d Add an option to disable libssh 2023-11-04 17:10:58 +01:00
avogar
15cb8d1b89 Fix use-of-unitialized-value 2023-11-03 13:16:08 +00:00
jsc0218
7828a4ba85
Merge pull request #56241 from YuanHanzhong/master
Fix doc typo
2023-11-02 21:10:18 -04:00
Raúl Marín
f4296962c6 Fix ORC commit 2023-11-02 13:17:19 +00:00
袁焊忠
47d9b0e6a1
[hotfix] [docs] Fix typo 2023-11-02 15:56:45 +08:00
MeenaRenganathan22
568e5d98d1 Update the libhdfs3 submodule 2023-11-01 06:19:19 -07:00
avogar
f53fdbeead Fix vuild for s390 2023-10-30 19:11:03 +00:00
MeenaRenganathan22
92c1dce57a Changes to support the HDFS for s390x 2023-10-30 08:49:55 -07:00
avogar
136f984154 Update arrow to release-13.0.0 2023-10-30 10:52:57 +00:00
Alexey Milovidov
70e3dd808c Granular code coverage with introspection 2023-10-29 02:07:24 +01:00
Nikita Taranov
213ce63ffb
Merge branch 'master' into optimize_reading3 2023-10-28 00:04:20 +02:00
Alexey Milovidov
0794f1faa7
Merge pull request #55775 from kitaisreal/decimal-column-improve-get-permutation-revert-revert
Improve ColumnDecimal, ColumnVector getPermutation performance using pdqsort with RadixSort fix
2023-10-26 12:36:57 +02:00
Maksim Kita
aa5fc05a55 Revert "Merge pull request #55682 from ClickHouse/revert-35961-decimal-column-improve-get-permutation"
This reverts commit f6dee5fe3c, reversing
changes made to f96bda1deb.
2023-10-25 21:48:13 +03:00
Robert Schulze
50c92dfe11
Update protobuf to v21.9 2023-10-25 11:56:29 +00:00
李扬
465962df7f
Support orc filter push down (file + stripe + rowgroup level) (#55330)
* support orc filter push down

* update orc lib version

* replace setqueryinfo with setkeycondition

* fix issue https://github.com/ClickHouse/ClickHouse/issues/53536

* refactor source with key condition

* fix building error

* remove std::cout

* update orc

* update orc version

* fix bugs

* improve code

* upgrade orc lib

* fix code style

* change as requested

* add performance tests for orc filter push down

* add performance tests for orc filter push down

* fix all bugs

* fix default as null issue

* add uts for null as default issues

* upgrade orc lib

* fix failed orc lib uts and fix typo

* fix failed uts

* fix failed uts

* fix ast fuzzer tests

* fix bug of uint64 overflow in https://s3.amazonaws.com/clickhouse-test-reports/55330/de22fdcaea2e12c96f300e95f59beba84401712d/fuzzer_astfuzzerubsan/report.html

* fix asan fatal caused by reused column vector batch in native orc input format. refer to https://s3.amazonaws.com/clickhouse-test-reports/55330/be39d23af2d7e27f5ec7f168947cf75aeaabf674/stateless_tests__asan__[4_4].htm

* fix wrong performance tests

* disable 02892_orc_filter_pushdown on aarch64. https://s3.amazonaws.com/clickhouse-test-reports/55330/be39d23af2d7e27f5ec7f168947cf75aeaabf674/stateless_tests__aarch64_.html

* add some comments

* add some comments

* inline range::equals and range::less

* fix data race of key condition

* trigger ci
2023-10-24 12:08:17 -07:00
Robert Schulze
57df56733f
Merge pull request #55963 from rschu1ze/bump-protobuf
Bump protobuf to v3.19.6
2023-10-24 19:20:30 +02:00
Robert Schulze
a962161832
Bump to 3.19.6 2023-10-24 10:22:58 +00:00
Robert Schulze
666f854b27
Bump protobuf to 3.19.3 2023-10-24 10:00:02 +00:00
Robert Schulze
430559c328
Merge remote-tracking branch 'rschu1ze/master' into grpc-1.42.0 2023-10-24 09:16:31 +00:00
Nikita Taranov
3320b12e59
impl (#55787) 2023-10-23 20:50:40 +02:00
Kruglov Pavel
32da07b4ee
Merge pull request #55695 from Avogar/restrict-iceberg
Fixes and improvements for Iceberg storage
2023-10-23 13:58:23 +02:00
Robert Schulze
20316c34e9
Bump gRPC to v1.42.0 2023-10-22 20:25:43 +00:00
Robert Schulze
d450314d27
Fix include 2023-10-22 15:40:45 +00:00
Robert Schulze
b2bdb58c09
Bump gRPC to v1.39.1 2023-10-22 15:23:58 +00:00
Nikita Taranov
2a6a97c1fa read sync from cache 2023-10-20 22:24:56 +02:00
Robert Schulze
5a44efb64e
Bump gRPC to v1.37.1 2023-10-19 15:44:23 +00:00
Robert Schulze
f18622b48b
Bump gRPC to 1v.36.4 2023-10-19 09:12:14 +00:00
monchickey
3ef092f83f
Fix the compilation error that occurs when opening avx series instructions (#55049)
* fix the compilation error that occurs when opening avx series instructions

cmake command example:
```shell
cmake .. -DCMAKE_BUILD_TYPE=Release -DENABLE_AVX=ON -DENABLE_AVX2=ON -DENABLE_AVX2_FOR_SPEC_OP=ON
```

* Update snappy CMakeLists.txt add SNAPPY_HAVE_X86_CRC32 parameter
2023-10-18 15:04:27 +02:00
Robert Schulze
2c82329ef7
Update submodule 2023-10-17 17:33:23 +00:00
avogar
4892618aa9 Update with master, fix comments 2023-10-17 11:42:19 +00:00
Robert Schulze
9a8734fa5e
Remove submodules 2023-10-17 10:22:30 +00:00
Robert Schulze
912e3680fb
Merge remote-tracking branch 'rschu1ze/master' into grpc-1.34.1-try-2 2023-10-17 09:26:41 +00:00
Michael Kolupaev
ce7eca0615
DWARF input format (#55450)
* Add ReadBufferFromFileBase::isRegularLocalFile()

* DWARF input format

* Review comments

* Changed things around ENABLE_EMBEDDED_COMPILER build setting

* Added 'ranges' column

* no-msan no-ubsan
2023-10-16 17:00:07 -07:00
Robert Schulze
31ad4a98c8
Bump gRPC 1.34 2023-10-16 18:38:29 +00:00
Alexey Milovidov
2da1ff4b0d
Revert "Improve ColumnDecimal, ColumnVector getPermutation performance using pdqsort with RadixSort" 2023-10-16 19:07:11 +03:00
Alexey Milovidov
33a42d9d13
Merge pull request #55606 from rschu1ze/croaring-v2.0.4
Bump croaring to v2.0.4
2023-10-14 03:32:54 +02:00
Robert Schulze
3d3cf29bf4
Update croaring to v2.0.4 2023-10-13 14:35:02 +00:00
Azat Khuzhin
720ea8441c Fix global context for tests with --gtest_filter
If you run tests that requires context, but do not initialize it, then
it will SIGSEGV, because Context is not initialized.

Fix this by using google test envrionment, and instead of gtest_main
implement own main function that will initialize it.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-10-13 13:44:30 +02:00
Robert Schulze
15a24b1f4c
Merge pull request #55492 from rschu1ze/curl-8.4
Bump curl to 8.4
2023-10-11 16:31:20 +02:00
Yakov Olkhovskiy
0738984edf
Merge pull request #42510 from ClibMouse/Kusto-phase2-oss-pr
Support Kusto Query Language dialect - phase 2
2023-10-11 08:35:26 -04:00
Robert Schulze
3035862c6b
Fix build 2023-10-11 10:54:38 +00:00
Robert Schulze
0ffdaeb1c4
Bump curl to 8.4
Addresses:
- CVE-2023-38546
- CVE-2023-38545
2023-10-11 10:13:16 +00:00
Robert Schulze
727f831c0c
Update croaring
Fixes: #55270
2023-10-07 19:44:19 +00:00
Boris Kuschel
5b9a00d727
new libssh 2023-09-30 06:42:05 -07:00
Boris Kuschel
b618756f0a
Remote compat always 2023-09-30 06:40:18 -07:00
Alexey Milovidov
e8696b62ce
Revert "Fix libssh+openssl3 & s390x (part 2)" 2023-09-30 06:45:19 +03:00
Boris Kuschel
a499cb708f
update libssh 2023-09-29 20:03:00 -07:00
Boris Kuschel
96ec15bd04
Openssl3 does not need compat 2023-09-29 20:02:59 -07:00
Boris Kuschel
09c7af7fab
Fix libssh+openssl3 & s390x 2023-09-29 09:46:15 -07:00
robot-clickhouse
4490217aaf
Merge pull request #55127 from rschu1ze/bump-croaring
Bump croaring to 2.0.2
2023-09-29 17:31:19 +02:00
Robert Schulze
fba19662f4
Bump croaring to 2.0.2 2023-09-29 10:43:40 +00:00
Mikhail f. Shiryaev
8e00e8b3a9
Update googletest 2023-09-28 09:39:57 +02:00
Yong Wang
8c9da6bacf Merge remote-tracking branch 'origin/master' into Kusto-phase2-oss-pr 2023-09-27 22:35:14 -07:00
George Gamezardashvili
0ce30ab6d5
SSH keys authentication (#41109)
Added new type of authentication based on SSH keys. It works only for Native TCP protocol.

Co-authored-by: Nikita Mikhaylov <nikitamikhaylov@clickhouse.com>
Co-authored-by: Robert Schulze <robert@clickhouse.com>
2023-09-26 17:50:19 +02:00
Yong Wang
c936c08835 Kusto-phase2: fix the CMakeList files 2023-09-25 13:43:01 -07:00
Maksim Kita
1de95d8c36 Updated implementation 2023-09-25 17:29:42 +03:00
Robert Schulze
3a3a00f95e
Bump minimal required compiler to Clang 16 2023-09-18 17:44:04 +00:00
Robert Schulze
7d04cf6b58
Merge pull request #54646 from rschu1ze/bump-abseil
Bump abseil
2023-09-18 09:44:35 +02:00
Robert Schulze
f5e8028bb1
Merge pull request #54642 from rschu1ze/broken-re2st
Remove broken lockless variant of re2
2023-09-17 15:30:57 +02:00
Robert Schulze
f0eadd4b22
Merge pull request #54103 from ClickHouse/ustweaks
Small usearch index improvements: metrics and configurable internal data type
2023-09-14 19:58:53 +02:00
Robert Schulze
9fc3d8d90d
Bump abseil to latest HEAD 2023-09-14 17:10:40 +00:00
Robert Schulze
7b378dbad3
Remove broken lockless variant of re2 2023-09-14 16:40:42 +00:00
Robert Schulze
9f8881e795
Bump absl and s2geometry
Fixes: #54623
2023-09-14 15:44:32 +00:00
Michael Kolupaev
8997464867
Small usearch index improvements: metrics and f16 2023-09-14 11:24:47 +00:00
Nikita Taranov
079b52fa93
[Resubmit] Remove mmap/mremap/munmap from Allocator.h (#52792)
* Revert "Revert "Remove `mmap/mremap/munmap` from Allocator.h" (#52589)"

This reverts commit 0a838dc6d1.

* pre-fault pages

* upd contrib to merge commit

* limit log rate

* Update Allocator.h

---------

Co-authored-by: Alexey Milovidov <milovidov@clickhouse.com>
2023-09-14 13:11:12 +02:00
Robert Schulze
d681462646
Merge pull request #54492 from rschu1ze/bump-re2
Bump re2 to latest main
2023-09-11 16:00:49 +02:00
Robert Schulze
ea038380b0
Bump re2 to latest main
Now supports an alternative form for named capturing groups [0]: (?<name>re)

[0] 6148386f0c
2023-09-11 07:51:46 +00:00
Robert Schulze
4d2223defe
Merge pull request #54119 from mkmkme/mkmkme/aklomp-base64
Replace Turbo-Base64 with aklomp/base64
2023-09-09 16:24:26 +02:00
robot-clickhouse-ci-2
533fad1d4e
Merge pull request #51436 from ClickHouse/test-libunwind-changes
Test libunwind changes.
2023-09-08 19:28:09 +02:00
Han Fei
4cc0b7c7f3 update 2023-09-08 16:34:02 +02:00
Robert Schulze
3c9d9ce39e
Fix build 2023-09-08 13:10:35 +00:00
Robert Schulze
89a7f90579
Simplify and enable AVX-512 2023-09-08 10:25:28 +00:00
Robert Schulze
cd3c121a62
Various fixups 2023-09-07 10:32:49 +00:00
Han Fei
fd76bc6412 try to fix build for freeBSD 2023-09-07 10:12:39 +02:00
Han Fei
750b6219a5 Merge branch 'master' into test-libunwind-changes 2023-09-07 08:50:07 +02:00
Boris Kuschel
91a0f5349c
Use abiv2 for generated asm 2023-09-06 13:40:59 -07:00
Mikhail Koviazin
e5a3a9319f
Review fixes
* Remove generated `tables.h` and use the ones from upstream instead
* Add comment about compiling AVX512 codec
2023-09-06 15:17:52 +00:00
Mikhail Koviazin
f98007a4ed
Replace Turbo-Base64 with aklomp/base64
Closes #31643
2023-09-06 13:01:38 +00:00
Azat Khuzhin
d2b31f3447 Merge remote-tracking branch 'u/master' into musl-7 2023-09-04 22:01:02 +02:00
Kseniia Sumarokova
463a197da4
Merge pull request #53847 from kssenii/fix-segfault-in-pg
Fix possible segfault while using PostgreSQL engine
2023-08-29 14:45:46 +02:00
Alexey Milovidov
cb831a5fb7
Merge pull request #53876 from davvard/master
Fix: USearch deserialize
2023-08-29 04:45:30 +03:00
Alexey Milovidov
9b4ded6804
Merge pull request #53756 from ClibMouse/update_openSSL_3.0.10
Upgrade openSSL to  v3.0.10
2023-08-29 03:00:36 +03:00
Robert Schulze
9f9c4293fa
Update usearch to v2.0.2 2023-08-28 20:10:49 +00:00
Robert Schulze
53cca12616
Merge pull request #53760 from ClibMouse/feature/json-handling-on-big-endian
Improve JSON-handling on s390x
2023-08-28 14:18:45 +02:00
Davit Vardanyan
9190fb2ba3 Fix: Deserialize 2023-08-28 16:18:12 +04:00
Alexey Milovidov
bff5cb5629
Merge pull request #53859 from rschu1ze/boost-1.83
Bump boost to 1.83
2023-08-27 23:31:29 +03:00
Alexey Milovidov
a17e6e2d1b
Merge pull request #53759 from amosbird/clickhouse_as_library_3
Slightly build improvement
2023-08-27 23:30:52 +03:00
Robert Schulze
54b3c2f86f
Bump boost to 1.83 2023-08-27 14:47:52 +00:00
ltrk2
4f45a199f9 Implement unit tests for IP functions 2023-08-26 07:40:27 -07:00
Robert Schulze
a7b64fbff5
Merge pull request #53812 from rschu1ze/boost-1.82
Bump boost to 1.82
2023-08-25 18:23:56 +02:00
kssenii
49d33774f9 Fix 2023-08-25 17:47:56 +02:00
ltrk2
394179f44f Enable producing endianness-independent output in lz4 2023-08-24 13:55:13 -07:00
Robert Schulze
bdd16a388c
Bump boost to 1.82 2023-08-24 17:54:13 +00:00
Robert Schulze
90d5ad6146
Merge pull request #53679 from rschu1ze/boost-1.81
Bump boost to 1.81
2023-08-24 16:17:03 +02:00
Amos Bird
84e91044ac
Remove unused file which depends on absl::flags 2023-08-24 17:26:35 +08:00
Amos Bird
814e1fccce
Complete the source files of arrow compute 2023-08-24 17:26:35 +08:00
ltrk2
7f31258956 Enable using simdjson on s390x 2023-08-23 11:22:20 -07:00
Robert Schulze
9766d98fec
Merge remote-tracking branch 'rschu1ze/master' into boost-1.81 2023-08-23 16:05:42 +00:00
Bhavna Jindal
6406043294 Added openSSL header files for x86_64, ppc64le, s309x, aarch64 platforms 2023-08-23 08:53:22 -07:00
Bhavna Jindal
aee8329a61 Updated openSSL to 3.0.10 to address CVEs 2023-08-23 08:52:21 -07:00
Robert Schulze
bbd8bedb4e
Update boost sparse checkout 2023-08-23 10:26:10 +00:00
Kruglov Pavel
e193aec583
Merge branch 'master' into fast-count-from-files 2023-08-23 12:15:34 +02:00
Robert Schulze
ec8da30007
Merge pull request #53558 from rschu1ze/bump-openldap
Bump openldap to LTS version (v2.5.16)
2023-08-23 11:34:28 +02:00
Kruglov Pavel
67c5c0203b
Merge branch 'master' into fast-count-from-files 2023-08-22 15:03:48 +02:00
Robert Schulze
44df7b6427
Bump boost to 1.81 2023-08-22 10:25:58 +00:00
alesapin
fba91b2158
Merge pull request #53552 from rschu1ze/krb5-1.21
Update krb5 to 1.21.2
2023-08-22 11:31:54 +02:00
taiyang-li
ac00a17928 upgrade snappy to 1.1.10 2023-08-22 14:27:44 +08:00
taiyang-li
af81d9afc0 upgrade snappy to 1.1.10 2023-08-22 14:23:15 +08:00
robot-clickhouse
b504df80b7
Merge pull request #53553 from ClibMouse/feature/constrain-isa-l
Enable ISA-L on x86-64 only by default
2023-08-22 05:17:42 +02:00
Nikita Mikhaylov
c039b4a08d
Merge pull request #53625 from rschu1ze/boost-1.80
Bump boost to 1.80
2023-08-22 00:51:16 +02:00
Robert Schulze
a20ceef398
Merge pull request #53447 from davvard/master
USearch HNSW index for ANN search
2023-08-21 23:34:26 +02:00
Michael Kolupaev
6009e1b293
Merge pull request #53324 from bigo-sg/ch_gluten_2583
Implement native orc input format without arrow to improve performance
2023-08-21 13:44:57 -07:00
Alexey Milovidov
30f1ad0028
Merge pull request #53628 from kitaisreal/cmake-small-refactoring
CMake small refactoring
2023-08-21 19:41:05 +03:00
Robert Schulze
9c51da57e6
Merge remote-tracking branch 'rschu1ze/master' into boost-1.80 2023-08-21 13:57:25 +00:00
ltrk2
933b05313e Enable ISA-L for x86-64 only 2023-08-21 06:05:04 -07:00
Kruglov Pavel
88aee95122
Merge branch 'master' into fast-count-from-files 2023-08-21 14:46:33 +02:00
avogar
584bd57f5c Clean up 2023-08-21 12:43:11 +00:00
Antonio Andelic
ed15babddd
Merge pull request #53198 from ClickHouse/improve-archive-reading
Improve reading from archives
2023-08-21 14:11:25 +02:00
Robert Schulze
fcade50942
Fix Darwin & FreeBSD build 2023-08-21 12:04:07 +00:00
Robert Schulze
2c330516b8
Another compile fix 2023-08-21 11:12:39 +00:00
Maksim Kita
034ff13a05 CMake small refactoring 2023-08-21 12:51:39 +03:00
Robert Schulze
5b41c531de
Sort files 2023-08-21 07:50:53 +00:00
Robert Schulze
2ea660cf14
Merge remote-tracking branch 'rschu1ze/master' into krb5-1.21 2023-08-21 07:43:45 +00:00
Robert Schulze
d863b5798f
Bump boost to 1.80 2023-08-21 07:26:53 +00:00
Alexey Milovidov
13676e0a75
Merge pull request #38217 from kitaisreal/aarch64-enable-jit-compilation
AARCH64 enable JIT compilation
2023-08-21 00:31:44 +03:00
Maksim Kita
c760a4c82f Test 2023-08-20 16:26:55 +03:00
Maksim Kita
61415cf117 Test 2023-08-20 14:44:15 +03:00
Maksim Kita
30110d2fc0 Test 2023-08-20 14:37:38 +03:00
Maksim Kita
79542a40a8 Test 2023-08-20 13:34:46 +03:00
Maksim Kita
3a92d05014 Test 2023-08-19 17:26:55 +03:00
Maksim Kita
8a22c8a13b Test 2023-08-19 15:24:12 +03:00
Maksim Kita
10db751c7b Test 2023-08-19 14:54:45 +03:00
Maksim Kita
9772beeffc Test 2023-08-19 14:54:45 +03:00
Maksim Kita
806519acb3 Test 2023-08-19 14:54:45 +03:00
Maksim Kita
d9c4b110ce LLVM AARCH64 cross compilation fix 2023-08-19 14:54:45 +03:00
Maksim Kita
255f171cf9 AARCH64 enable JIT compilation 2023-08-19 14:54:45 +03:00
HarryLeeIBM
2f27c16656 Bump base64 head for s390x 2023-08-18 17:03:51 -07:00
Alexey Milovidov
17b24eb38d
Merge pull request #53490 from rschu1ze/boost-179
Update boost to 1.79
2023-08-19 02:12:13 +03:00
Robert Schulze
eaf2fb837c
Update to 1.21-clickhouse 2023-08-18 20:18:30 +00:00
Robert Schulze
cf0873aaef
Fix build 2023-08-18 20:14:22 +00:00
Robert Schulze
87824bea74
Bump openldap to a LTS branch (v2.5.16) 2023-08-18 15:47:02 +00:00
Nikita Mikhaylov
1822012180
Merge pull request #53485 from rschu1ze/CVE-2023-36054
krb5: Fix CVE-2023-36054
2023-08-18 14:56:08 +02:00