Commit Graph

3787 Commits

Author SHA1 Message Date
Alexey Milovidov
7bc7159a3d Update submodule 2023-12-08 03:35:55 +01:00
Alexey Milovidov
063f08cc5d Merge branch 'master' into rschu1ze-azure-darwin2 2023-12-08 03:34:02 +01:00
Alexey Milovidov
15a0e6ab05 Merge branch 'master' into musl-7 2023-12-08 03:19:55 +01:00
jinjunzh
c1c46b655f add build flag to avoid incompatible integer conversion 2023-12-05 18:02:05 -05:00
jinjunzh
f302ba0e31 Implement hardware-assisted(QAT) ZSTD compression 2023-12-05 17:47:18 -05:00
Robert Schulze
f56dd6561f
Merge remote-tracking branch 'rschu1ze/master' into revert-revert-sqid 2023-12-05 18:41:10 +00:00
Alexey Milovidov
d7d83c99e5
Revert "Implemented series period detect method using pocketfft lib" 2023-12-05 18:17:07 +03:00
Robert Schulze
a2cd240317
Revert "Revert "Add sqid() function""
This reverts commit 8d5d0ef38f.
2023-12-05 10:50:30 +00:00
Alexey Milovidov
8d5d0ef38f
Revert "Add sqid() function" 2023-12-05 13:45:33 +03:00
awakeljw
6c70e32da1 rename squids to sqids 2023-12-04 11:26:55 +08:00
Robert Schulze
f6036fbb29
Some fixups 2023-12-03 16:20:59 +00:00
awakeljw
06241de257 fix codes according to the reviews 2023-12-03 22:00:42 +08:00
awakeljw
e5a72f15dd support sqids 2023-12-02 21:12:48 +08:00
robot-ch-test-poll
1b49463bd2
Merge pull request #55841 from nickitat/optimize_reading3
Optimize reading from cache
2023-12-01 17:36:57 +01:00
jasperzhu
aefc2f1ce4
Merge branch 'ClickHouse:master' into iaadeflate_upgrade_qpl_v1.3.0 2023-11-29 09:00:03 +08:00
Alexander Tokmakov
3ff7aa8dec
Merge pull request #57231 from jsc0218/FixLibpqxxMemLeak
Update Libpqxx for Mem Leak
2023-11-28 22:50:30 +01:00
Nikita Taranov
03450d5077 merge fixes 2023-11-28 18:24:05 +01:00
jinjunzh
3b7811342d upgrade qpl to 1.3.1 and fix qpl_deflate codec bug for the case of BOF=0 2023-11-28 11:39:15 -05:00
Nikita Taranov
52f644c0df Merge branch 'master' into optimize_reading3 2023-11-28 16:36:38 +01:00
János Benjamin Antal
4c2451f837
Merge pull request #56741 from ClickHouse/well-known-protos 2023-11-28 15:21:15 +01:00
Alexey Milovidov
49d4a90a0e Merge branch 'master' of github.com:ClickHouse/ClickHouse into musl-7 2023-11-26 17:55:17 +01:00
jsc0218
96a445d3ac Update Libpqxx for Mem Leak 2023-11-26 02:12:41 +00:00
Alexey Milovidov
e60941f7c5
Revert "Update Sentry" 2023-11-26 04:30:05 +03:00
Alexey Milovidov
9621c519e1 Clarifications 2023-11-26 02:27:54 +01:00
Alexey Milovidov
6d4af13f91 Update HDFS 2023-11-26 02:27:54 +01:00
Alexey Milovidov
6effb1311f Compatibility with Musl in HDFS and RocksDB 2023-11-26 02:27:53 +01:00
Alexey Milovidov
043e9239d6 Update Azure and Sentry 2023-11-26 02:27:53 +01:00
Alexey Milovidov
e5dd78a9e8
Merge pull request #57222 from ClickHouse/update-sentry
Update Sentry
2023-11-25 22:53:27 +01:00
Alexey Milovidov
1e00048cf7 Update Sentry 2023-11-25 19:11:52 +01:00
Alexey Milovidov
2222d8cbf2 Update Sentry 2023-11-25 18:47:21 +01:00
Alexey Milovidov
5eb3cafb52 libunwind: fix slowness under Musl 2023-11-25 16:21:17 +01:00
Alexey Milovidov
143617e303 Remove garbage 2023-11-25 16:21:17 +01:00
Alexey Milovidov
de52ddf3bb Merge branch 'master' into rschu1ze-azure-darwin2 2023-11-22 20:26:47 +01:00
Julia Kartseva
753b22f64c
Merge pull request #56171 from ClibMouse/dev-seriesPeriodDetect
Implemented series period detect method using pocketfft lib
2023-11-22 09:49:58 -08:00
János Benjamin Antal
6f652133a8 Install well-known protobuf types 2023-11-22 12:39:29 +00:00
Robert Schulze
304b636208
Fix gRPC build fix on Mac
Fixes #57050
2023-11-21 16:28:27 +01:00
Bhavna Jindal
ad99cb902f changed method name, updated pocketfft repo reference 2023-11-21 06:52:47 -08:00
Bhavna Jindal
e3826786f1 Added testcases, documentation and addressed comments 2023-11-21 06:52:47 -08:00
Bhavna Jindal
2235adcae5 Implemented series periods detect method using pocketfft lib 2023-11-21 06:52:47 -08:00
Alexey Milovidov
6a1955cb34 Merge branch 'master' of github.com:ClickHouse/ClickHouse into remove-useless-install 2023-11-20 21:34:31 +01:00
Mikhail f. Shiryaev
c3a3cf8d24
Make check for the limited cmake dependencies the part of sparse checkout 2023-11-20 13:08:49 +01:00
Robert Schulze
5ec626127b
Merge pull request #56857 from AVMusorin/fix-update-submodules
Sparse checkout: Use `--remote` for `git submodule update`
2023-11-20 12:53:22 +01:00
Aleksandr Musorin
f9a8df4296 Added comment to prevent using --remote to update submodules 2023-11-20 11:44:21 +01:00
Alexey Milovidov
b205d4919d Remove garbage 2023-11-20 01:24:28 +01:00
Alexey Milovidov
b772189fc1 Merge branch 'master' into own-cmake-for-grpc 2023-11-19 16:17:49 +01:00
Alexey Milovidov
3213443ee2 Own CMake for GRPC 2023-11-19 15:42:35 +01:00
Alexey Milovidov
f27018c141 Own CMake for GRPC 2023-11-19 15:21:11 +01:00
Robert Schulze
cb913821fc
Merge pull request #56861 from rschu1ze/cpu_features
CMake: Small cleanup in cpu_features.cmake
2023-11-18 18:29:40 +01:00
Robert Schulze
fcce5409f4
Simplify 2023-11-17 17:02:52 +00:00
Alexey Milovidov
01000e8b9e Merge with master 2023-11-17 14:57:02 +01:00
Alexey Milovidov
9b9b0a0b9a Merge branch 'master' into simpler-cmake 2023-11-17 14:44:55 +01:00
Robert Schulze
882d0d17f1
Merge remote-tracking branch 'rschu1ze/master' into bump-grpc-and-protobuf 2023-11-17 11:48:16 +00:00
Alexey Milovidov
4f441ec131 Own CMake for Abseil 2023-11-17 11:32:27 +01:00
Alexey Milovidov
c65607484e Remove garbage 2023-11-17 10:03:10 +01:00
Alexey Milovidov
864dd32b05 Remove garbage 2023-11-17 09:48:42 +01:00
Alexey Milovidov
df3c066591 Remove more trash 2023-11-17 08:42:39 +01:00
Alexey Milovidov
224b282d94 Remove garbage 2023-11-17 08:27:19 +01:00
Alexey Milovidov
c72136b123 Simpler CMake 2023-11-17 08:07:32 +01:00
Alexey Milovidov
482d8ca9d8
Merge pull request #56102 from ClickHouse/coverage
Granular code coverage with introspection
2023-11-16 23:23:40 +01:00
Robert Schulze
b13cd9792b
Fix cross build 2023-11-16 14:46:57 +00:00
Robert Schulze
e8c14562ab
Bump absl to HEAD 2023-11-16 11:50:25 +00:00
Robert Schulze
a0934253de
Bump protobuf to v24.4 2023-11-16 11:44:10 +00:00
Robert Schulze
ac7fd357e4
Bump protobuf to v23.2 2023-11-16 11:07:19 +00:00
Robert Schulze
a250c2bb08
Bump gRPC to v1.59.2 2023-11-16 11:07:15 +00:00
Robert Schulze
1ba408eb0b
Bump gRPC to v1.58.2 2023-11-16 11:07:11 +00:00
Robert Schulze
a49db81b9f
Bump gRPC to v1.57.1 2023-11-16 11:07:07 +00:00
Robert Schulze
649d734409
Bump gRPC to v1.56.3 2023-11-16 11:07:03 +00:00
Robert Schulze
8fe093c355
Merge pull request #56664 from rschu1ze/bump-grpc
Bump gRPC to v1.55.4 and protobuf to v22.5
2023-11-16 12:05:43 +01:00
Alexey Milovidov
671a401ded Ask linker to remove garbage from external libraries 2023-11-15 12:26:14 +01:00
Robert Schulze
e8eb425ff8
Try to fix new calamities with cross-compilation 2023-11-14 15:13:37 +00:00
Igor Nikonov
ecef6db1fe
Fix: RabbitMQ OpenSSL dynamic loading issue (#56703)
* Fix: RabbitMQ OpenSSL dynamic loading issue
* Update RabbitMQ
* Fix minor glitch with TLS_client_method()
00f09897ce

---------

Co-authored-by: Robert Schulze <robert@clickhouse.com>
2023-11-14 15:36:50 +01:00
Robert Schulze
cf7f155ce9
Bump gRPC to v1.55.4 and protobuf to v22.5 2023-11-14 12:01:37 +00:00
Alexey Milovidov
4e3e8e32fd Remove more garbage 2023-11-14 07:24:41 +01:00
Alexey Milovidov
80bbe7dcc6 Less CMake checks 2023-11-14 06:55:06 +01:00
Alexey Milovidov
3ef14f6098 Merge branch 'master' of github.com:ClickHouse/ClickHouse into coverage 2023-11-14 06:08:32 +01:00
Robert Schulze
44830555da
Merge pull request #56671 from Algunenano/revert_grpc
gRPC: remove build dependency on systemd
2023-11-13 23:28:54 +01:00
Alexey Milovidov
2ad98a58c9
Better caching of arrow build (#56657)
* Better caching of Arrow build
* Fix error
* Remove useless files
2023-11-13 16:51:01 +01:00
Robert Schulze
ed7bfeff69 Update gRPC to not include systemd 2023-11-13 16:27:48 +01:00
Robert Schulze
51e8c58a38 Revert "Revert "Merge pull request #56543 from rschu1ze/bump-grpc""
This reverts commit d4840adfd4708729ed8f969e61116f58ffe2fb18.
2023-11-13 16:27:48 +01:00
Raúl Marín
993f752900 Revert "Merge pull request #56543 from rschu1ze/bump-grpc"
This reverts commit 213c7cffb5, reversing
changes made to 9ed47749de.
2023-11-13 16:27:48 +01:00
Kruglov Pavel
b1eb80a478
Merge pull request #54800 from Avogar/update-arrow
Update arrow to release-13.0.0
2023-11-13 14:36:33 +00:00
Alexey Milovidov
70d7ef0ca4
Merge pull request #56654 from ClickHouse/Remove-garbage-from-libssh
Remove garbage from libssh
2023-11-13 10:18:01 +01:00
Alexey Milovidov
33a33f5c0a Delete a file 2023-11-13 07:06:52 +01:00
Alexey Milovidov
5b3742221a Remove garbage from libssh 2023-11-13 06:30:24 +01:00
Robert Schulze
28dbfb94c2
Bump gRPC to v1.54.3 2023-11-12 10:56:25 +00:00
Robert Schulze
c75497e746
Bump gRPC to v1.53.2 2023-11-12 10:56:25 +00:00
Robert Schulze
a77f9ce7b2
Bump gRPC to v1.52.2 2023-11-12 10:56:25 +00:00
Robert Schulze
f6b001444c
Bump gRPC to 1.51.3 2023-11-12 10:56:24 +00:00
Robert Schulze
528c5a2c0a
Bump gRPC to 1.50.3 2023-11-12 10:56:24 +00:00
Robert Schulze
f017b2d083
Bump gRPC to v1.49.3 2023-11-12 10:56:24 +00:00
Robert Schulze
6e5407f875
Bump gRPC to v1.48.4 2023-11-12 10:56:24 +00:00
Antonio Andelic
ba7b684810
Merge pull request #53481 from myrrc/fix/reconfig-leader-replace
Keeper `reconfig`: add timeout before yielding/taking leadership
2023-11-10 09:32:40 +01:00
Mike Kot
785183bb3c Keeper reconfig -- sleep before removing leader to avoid losing accepted
but uncommitted commands
2023-11-09 16:22:44 +00:00
Robert Schulze
f5786cf417
Merge remote-tracking branch 'rschu1ze/master' into parallel-submodules 2023-11-09 15:10:23 +00:00
Robert Schulze
44d5617325
12.7% more aesthetic 2023-11-09 14:25:59 +00:00
Robert Schulze
93d8fc231c
Try to fix invocation from outside 2023-11-09 11:39:50 +00:00
Robert Schulze
fe397a3110
Parallelize with xargs 2023-11-09 10:17:49 +00:00
Robert Schulze
fa470b16e5
Parallel clone sparse/shallow submodules
(buzzword overload in the title, sorry)

Script update-submodules.sh does a sparse and shallow checkout of
submodules. It is offered as convenience for developers who want to
avoid long checkout times and save disk space. The script is called by a
few build jobs in CI to check that it doesn't break. This PR
parallelizes the actual checkout which reduces script runtime from 425
sec to 258 sec.
2023-11-08 20:02:40 +00:00
Robert Schulze
b9fafb5561
Try to fix sparse checkout 2023-11-08 17:18:05 +00:00
Robert Schulze
85c1588941
Bump gRPC to 1.47.5 2023-11-07 19:53:01 +00:00
Robert Schulze
a1a9cb7577
Bump gRPC to v1.44.1 2023-11-07 19:52:59 +00:00
Robert Schulze
4fe99c77c7
Bump gRPC to v1.43.2 2023-11-07 19:52:58 +00:00
Alexey Milovidov
cd94d02455 Merge branch 'master' into coverage 2023-11-04 21:49:59 +01:00
Alexey Milovidov
788863898d Add an option to disable libssh 2023-11-04 17:10:58 +01:00
avogar
15cb8d1b89 Fix use-of-unitialized-value 2023-11-03 13:16:08 +00:00
jsc0218
7828a4ba85
Merge pull request #56241 from YuanHanzhong/master
Fix doc typo
2023-11-02 21:10:18 -04:00
Raúl Marín
f4296962c6 Fix ORC commit 2023-11-02 13:17:19 +00:00
袁焊忠
47d9b0e6a1
[hotfix] [docs] Fix typo 2023-11-02 15:56:45 +08:00
MeenaRenganathan22
568e5d98d1 Update the libhdfs3 submodule 2023-11-01 06:19:19 -07:00
avogar
f53fdbeead Fix vuild for s390 2023-10-30 19:11:03 +00:00
MeenaRenganathan22
92c1dce57a Changes to support the HDFS for s390x 2023-10-30 08:49:55 -07:00
avogar
136f984154 Update arrow to release-13.0.0 2023-10-30 10:52:57 +00:00
Alexey Milovidov
70e3dd808c Granular code coverage with introspection 2023-10-29 02:07:24 +01:00
Nikita Taranov
213ce63ffb
Merge branch 'master' into optimize_reading3 2023-10-28 00:04:20 +02:00
Alexey Milovidov
0794f1faa7
Merge pull request #55775 from kitaisreal/decimal-column-improve-get-permutation-revert-revert
Improve ColumnDecimal, ColumnVector getPermutation performance using pdqsort with RadixSort fix
2023-10-26 12:36:57 +02:00
Maksim Kita
aa5fc05a55 Revert "Merge pull request #55682 from ClickHouse/revert-35961-decimal-column-improve-get-permutation"
This reverts commit f6dee5fe3c, reversing
changes made to f96bda1deb.
2023-10-25 21:48:13 +03:00
Robert Schulze
50c92dfe11
Update protobuf to v21.9 2023-10-25 11:56:29 +00:00
李扬
465962df7f
Support orc filter push down (file + stripe + rowgroup level) (#55330)
* support orc filter push down

* update orc lib version

* replace setqueryinfo with setkeycondition

* fix issue https://github.com/ClickHouse/ClickHouse/issues/53536

* refactor source with key condition

* fix building error

* remove std::cout

* update orc

* update orc version

* fix bugs

* improve code

* upgrade orc lib

* fix code style

* change as requested

* add performance tests for orc filter push down

* add performance tests for orc filter push down

* fix all bugs

* fix default as null issue

* add uts for null as default issues

* upgrade orc lib

* fix failed orc lib uts and fix typo

* fix failed uts

* fix failed uts

* fix ast fuzzer tests

* fix bug of uint64 overflow in https://s3.amazonaws.com/clickhouse-test-reports/55330/de22fdcaea2e12c96f300e95f59beba84401712d/fuzzer_astfuzzerubsan/report.html

* fix asan fatal caused by reused column vector batch in native orc input format. refer to https://s3.amazonaws.com/clickhouse-test-reports/55330/be39d23af2d7e27f5ec7f168947cf75aeaabf674/stateless_tests__asan__[4_4].htm

* fix wrong performance tests

* disable 02892_orc_filter_pushdown on aarch64. https://s3.amazonaws.com/clickhouse-test-reports/55330/be39d23af2d7e27f5ec7f168947cf75aeaabf674/stateless_tests__aarch64_.html

* add some comments

* add some comments

* inline range::equals and range::less

* fix data race of key condition

* trigger ci
2023-10-24 12:08:17 -07:00
Robert Schulze
57df56733f
Merge pull request #55963 from rschu1ze/bump-protobuf
Bump protobuf to v3.19.6
2023-10-24 19:20:30 +02:00
Robert Schulze
a962161832
Bump to 3.19.6 2023-10-24 10:22:58 +00:00
Robert Schulze
666f854b27
Bump protobuf to 3.19.3 2023-10-24 10:00:02 +00:00
Robert Schulze
430559c328
Merge remote-tracking branch 'rschu1ze/master' into grpc-1.42.0 2023-10-24 09:16:31 +00:00
Nikita Taranov
3320b12e59
impl (#55787) 2023-10-23 20:50:40 +02:00
Kruglov Pavel
32da07b4ee
Merge pull request #55695 from Avogar/restrict-iceberg
Fixes and improvements for Iceberg storage
2023-10-23 13:58:23 +02:00
Robert Schulze
20316c34e9
Bump gRPC to v1.42.0 2023-10-22 20:25:43 +00:00
Robert Schulze
d450314d27
Fix include 2023-10-22 15:40:45 +00:00
Robert Schulze
b2bdb58c09
Bump gRPC to v1.39.1 2023-10-22 15:23:58 +00:00
Nikita Taranov
2a6a97c1fa read sync from cache 2023-10-20 22:24:56 +02:00
Robert Schulze
5a44efb64e
Bump gRPC to v1.37.1 2023-10-19 15:44:23 +00:00
Robert Schulze
f18622b48b
Bump gRPC to 1v.36.4 2023-10-19 09:12:14 +00:00
monchickey
3ef092f83f
Fix the compilation error that occurs when opening avx series instructions (#55049)
* fix the compilation error that occurs when opening avx series instructions

cmake command example:
```shell
cmake .. -DCMAKE_BUILD_TYPE=Release -DENABLE_AVX=ON -DENABLE_AVX2=ON -DENABLE_AVX2_FOR_SPEC_OP=ON
```

* Update snappy CMakeLists.txt add SNAPPY_HAVE_X86_CRC32 parameter
2023-10-18 15:04:27 +02:00
Robert Schulze
2c82329ef7
Update submodule 2023-10-17 17:33:23 +00:00
avogar
4892618aa9 Update with master, fix comments 2023-10-17 11:42:19 +00:00
Robert Schulze
9a8734fa5e
Remove submodules 2023-10-17 10:22:30 +00:00
Robert Schulze
912e3680fb
Merge remote-tracking branch 'rschu1ze/master' into grpc-1.34.1-try-2 2023-10-17 09:26:41 +00:00
Michael Kolupaev
ce7eca0615
DWARF input format (#55450)
* Add ReadBufferFromFileBase::isRegularLocalFile()

* DWARF input format

* Review comments

* Changed things around ENABLE_EMBEDDED_COMPILER build setting

* Added 'ranges' column

* no-msan no-ubsan
2023-10-16 17:00:07 -07:00
Robert Schulze
31ad4a98c8
Bump gRPC 1.34 2023-10-16 18:38:29 +00:00
Alexey Milovidov
2da1ff4b0d
Revert "Improve ColumnDecimal, ColumnVector getPermutation performance using pdqsort with RadixSort" 2023-10-16 19:07:11 +03:00
Alexey Milovidov
33a42d9d13
Merge pull request #55606 from rschu1ze/croaring-v2.0.4
Bump croaring to v2.0.4
2023-10-14 03:32:54 +02:00
Robert Schulze
3d3cf29bf4
Update croaring to v2.0.4 2023-10-13 14:35:02 +00:00
Azat Khuzhin
720ea8441c Fix global context for tests with --gtest_filter
If you run tests that requires context, but do not initialize it, then
it will SIGSEGV, because Context is not initialized.

Fix this by using google test envrionment, and instead of gtest_main
implement own main function that will initialize it.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-10-13 13:44:30 +02:00
Robert Schulze
15a24b1f4c
Merge pull request #55492 from rschu1ze/curl-8.4
Bump curl to 8.4
2023-10-11 16:31:20 +02:00
Yakov Olkhovskiy
0738984edf
Merge pull request #42510 from ClibMouse/Kusto-phase2-oss-pr
Support Kusto Query Language dialect - phase 2
2023-10-11 08:35:26 -04:00
Robert Schulze
3035862c6b
Fix build 2023-10-11 10:54:38 +00:00
Robert Schulze
0ffdaeb1c4
Bump curl to 8.4
Addresses:
- CVE-2023-38546
- CVE-2023-38545
2023-10-11 10:13:16 +00:00
Robert Schulze
727f831c0c
Update croaring
Fixes: #55270
2023-10-07 19:44:19 +00:00
Boris Kuschel
5b9a00d727
new libssh 2023-09-30 06:42:05 -07:00
Boris Kuschel
b618756f0a
Remote compat always 2023-09-30 06:40:18 -07:00
Alexey Milovidov
e8696b62ce
Revert "Fix libssh+openssl3 & s390x (part 2)" 2023-09-30 06:45:19 +03:00
Boris Kuschel
a499cb708f
update libssh 2023-09-29 20:03:00 -07:00