Compare commits

...

1665 Commits

Author SHA1 Message Date
Vitaly Baranov
eb5c7b1ced Add one more test. 2024-09-19 01:33:11 +02:00
Vitaly Baranov
7cf575c20f Enable by default backup setting "write_access_entities_dependents", restore settings "update_access_entities_dependents" and "skip_unresolved_access_entities_dependencies". 2024-09-18 21:39:13 +02:00
Vitaly Baranov
c038239ec8 Rename restore setting "allow_unresolved_access_dependencies" -> "skip_unresolved_access_entities_dependencies". 2024-09-18 21:39:13 +02:00
Vitaly Baranov
7ff8bf2958 Support writing dependents of access entities to backup, added backup setting "write_access_entities_dependents". 2024-09-18 21:39:12 +02:00
Vitaly Baranov
995b5f7d4b Extend IAccessStorage::findAll() to enable finding all the entities in the storage. 2024-09-18 21:39:12 +02:00
Vitaly Baranov
bd6b7fb6db Change filenames of files with access entities inside a backup:
use "access-<UUID>.txt" instead of "access01.txt", "access02.txt", ...
2024-09-18 21:39:12 +02:00
Vitaly Baranov
11ef73f779 Add more tests. 2024-09-18 21:39:12 +02:00
Vitaly Baranov
6a96710c04 Add new restore setting "update_access_entities_dependents" to allow updating dependents of restored access entities. 2024-09-18 21:39:12 +02:00
Vitaly Baranov
0bcc2b9708 Add UUID to UpdateFunc in IAccessStorage. 2024-09-18 21:39:12 +02:00
Vitaly Baranov
ac0f5a8d52 Remove unresolved dependencies while restoring with "allow_unresolved_access_dependencies = true". 2024-09-18 21:39:12 +02:00
Vitaly Baranov
198974dd7e Change comment for allow_unresolved_access_dependencies. 2024-09-18 21:39:12 +02:00
Vitaly Baranov
f33b6fd5f5 Add some logging to restoring access entities. 2024-09-18 21:39:12 +02:00
Vitaly Baranov
4dc0a2a047 Refactoring of the code for making a backup and restoring access entities. 2024-09-18 21:39:12 +02:00
Robert Schulze
b94a7167a8
Merge pull request #69580 from rschu1ze/bump-libpqxx
Bump libpqxx to v7.7.5
2024-09-18 18:56:12 +00:00
Konstantin Bogdanov
64e58baba1
Merge pull request #69682 from ClickHouse/more-asserts-for-hashjoin
Try fix asserts failure in `HashJoin`
2024-09-18 18:20:27 +00:00
max-vostrikov
a3fe155579
Merge pull request #69737 from ClickHouse/test_printf
added some edge cases for printf tests
2024-09-18 17:49:57 +00:00
Antonio Andelic
a997cfad2b
Merge pull request #68108 from ClickHouse/keeper-some-improvement2
Keeper improvements package
2024-09-18 16:35:57 +00:00
maxvostrikov
f4b4b3cc35 added some edge cases for printf tests
added some edge cases for printf tests
2024-09-18 17:22:36 +02:00
Konstantin Bogdanov
cb24849396
Move assert 2024-09-18 15:24:48 +02:00
Kseniia Sumarokova
7fd2207626
Merge pull request #68504 from ClickHouse/miscellaneous-3
Miscellaneous
2024-09-18 11:21:26 +00:00
Antonio Andelic
4f73c677ac Merge branch 'master' into keeper-some-improvement2 2024-09-18 13:19:24 +02:00
Kseniia Sumarokova
69f45acfd7
Merge pull request #69672 from ClickHouse/s3queue-refactor-2
S3Queue small refactoring
2024-09-18 10:47:14 +00:00
Yarik Briukhovetskyi
4c78206d0a
Merge pull request #69718 from arruw/patch-1
Improve QuantileDD docs
2024-09-18 10:34:46 +00:00
Mikhail Artemenko
429e8ada79
Merge pull request #69690 from ClickHouse/remove_recursive_small_fixes
Remove recursive small fixes
2024-09-18 10:23:27 +00:00
mmav
06b49d18d9
Update quantileddsketch.md
Update function syntax
2024-09-18 10:45:10 +01:00
Kseniia Sumarokova
a17a8febf7
Merge pull request #69714 from tbragin/patch-15
Update README.md - Meetups
2024-09-18 09:20:05 +00:00
Robert Schulze
55529ec5a2
Merge pull request #69674 from rschu1ze/bump-pg
Bump libpq from v14.3 to v15.8
2024-09-18 09:13:13 +00:00
Antonio Andelic
3106653852 Fix watches 2024-09-18 10:47:40 +02:00
Yakov Olkhovskiy
82dbb3bb32
Merge pull request #69615 from ClickHouse/refactor-secret-finder
Unification of FunctionSecretArgumentsFinder
2024-09-18 08:17:52 +00:00
Tanya Bragin
1bcdde3e62
Update README.md - Meetups 2024-09-17 19:48:48 -07:00
Alexey Katsman
2cef99c311
Merge pull request #69576 from bigo-sg/arrayzip_allow_empty
Allow empty arguments for arrayZip/arrayZipUnaligned
2024-09-17 21:25:29 +00:00
Robert Schulze
cd7a1a9288
Merge pull request #69684 from rschu1ze/disallow-alter-table-add-inv-idx
Prohibit `ALTER TABLE ... ADD INDEX ... TYPE` inverted if setting = 0
2024-09-17 21:18:02 +00:00
Alexander Gololobov
6597a8ed04
Merge pull request #69596 from ClickHouse/fix_dedup_in_parallel_replicas_announcement
Optimize complexity of part deduplication in parallel replicas announcement
2024-09-17 20:48:12 +00:00
Kseniia Sumarokova
3b901f49e5
Merge pull request #69673 from ClickHouse/update-assert
Update assert
2024-09-17 20:39:07 +00:00
Raúl Marín
958c3effae
Merge pull request #69705 from ClickHouse/revert-69376-marco-vb/setting-stop-insert-on-full-disk
Revert "Add user-level settings min_free_diskspace_bytes_to_throw_insert and min_free_diskspace_ratio_to_throw_insert"
2024-09-17 19:49:35 +00:00
Raúl Marín
474499d240
Revert "Add user-level settings min_free_diskspace_bytes_to_throw_insert and min_free_diskspace_ratio_to_throw_insert" 2024-09-17 21:48:19 +02:00
jsc0218
839f06035f
Merge pull request #69376 from marco-vb/marco-vb/setting-stop-insert-on-full-disk
Add user-level settings min_free_diskspace_bytes_to_throw_insert and min_free_diskspace_ratio_to_throw_insert
2024-09-17 18:46:43 +00:00
Vitaly Baranov
4f88ccb6a8
Merge pull request #69201 from NikBarykin/allow_arguments_in_custom_database_engines
Allow custom settings in database engine
2024-09-17 18:26:57 +00:00
Kruglov Pavel
a226567bc2
Merge pull request #69560 from Avogar/fix-prewhere-reorder
Keep original order of conditions during move to prewhere
2024-09-17 18:22:19 +00:00
Vitaly Baranov
fcda762a27
Merge pull request #69346 from vitlibar/restore-access-dependencies
Improve restoring of access entities' dependencies
2024-09-17 18:21:55 +00:00
Mikhail Artemenko
9c185374e4 fix level sorting 2024-09-17 18:14:47 +00:00
Mikhail Artemenko
13e82d6439 fix double visit of uncommitted changes 2024-09-17 17:45:04 +00:00
Mikhail f. Shiryaev
fdee35cccc
Merge pull request #69557 from ClickHouse/integration-prepull-kill-runner
Kill runner when integration tests fail to pre-pull
2024-09-17 17:27:20 +00:00
Konstantin Bogdanov
b08e727aef
Count allocated bytes from scratch after rerange 2024-09-17 19:02:10 +02:00
Miсhael Stetsyuk
9eba103c5e
Merge pull request #69670 from ClickHouse/sync-executeToDatabaseImpl-with-private-fork
sync changes to `InterpreterDropQuery::executeToDatabaseImpl` from the private fork
2024-09-17 16:54:15 +00:00
Konstantin Bogdanov
a210f98819
Lint 2024-09-17 18:28:27 +02:00
kssenii
e574c49e25 Fix 2024-09-17 18:19:05 +02:00
Konstantin Bogdanov
7c5d55c6b2
Lint 2024-09-17 18:10:51 +02:00
Robert Schulze
665f362601
Prohibit ALTER TABLE ... ADD INDEX ... TYPE inverted if setting = 0 2024-09-17 16:10:03 +00:00
Konstantin Bogdanov
80259659ff
More asserts 2024-09-17 18:03:19 +02:00
Alexander Gololobov
574a26c63b Use adjacent_find to check adjacent parts 2024-09-17 17:56:44 +02:00
Alexander Gololobov
3674c97ebb Fix for using part after std::move from it 2024-09-17 17:49:02 +02:00
vdimir
8508b1ba37
Merge pull request #67966 from ClickHouse/vdimir/datetime64_constant_to_ast_f
Add test cases to 03217_datetime64_constant_to_ast
2024-09-17 14:56:32 +00:00
Alexander Gololobov
190d3f04c9 More optimal check for intrsecting parts in DefaultCoordinator init 2024-09-17 16:54:49 +02:00
Alexander Gololobov
aba7de5091 Verify that there are no intersecting parts in the resulting all_parts_to_read 2024-09-17 16:53:32 +02:00
Antonio Andelic
8db3dddb3d Fix watches count and list request 2024-09-17 16:15:55 +02:00
Nikita Taranov
ffaf97a390
Merge pull request #68424 from ClickHouse/adaptive_parallel_replicas
Adaptive mark_segment_size for parallel replicas
2024-09-17 13:52:42 +00:00
Antonio Andelic
452fde78c7
Merge pull request #69582 from ClickHouse/keeper-better-ssl-support
Support more advanced SSL options for Keeper internal communication
2024-09-17 13:32:18 +00:00
Kseniia Sumarokova
51fa9ebf8a
Merge pull request #68520 from ClickHouse/fix-bad-exception-messages
Fix bad exception messages
2024-09-17 13:29:53 +00:00
kssenii
e30ebfa23e Add mode validation 2024-09-17 15:24:02 +02:00
Kruglov Pavel
b21be2bc54
Merge pull request #68591 from bigo-sg/orc_dict_encode
Add settings `output_format_orc_dictionary_key_size_threshold` to allow user to enable dict encoding for string column in ORC output format
2024-09-17 13:22:44 +00:00
Alexander Gololobov
14736d95c5
Merge pull request #69606 from ClickHouse/check_time_limit_in_index_analysis
Check time limits while analyzing indexes
2024-09-17 13:14:08 +00:00
NikBarykin
4b69d8e2ca Fix CE 2024-09-17 15:52:20 +03:00
robot-clickhouse
5ce8604869 Automatic style fix 2024-09-17 12:37:31 +00:00
Robert Schulze
813bcd896f
Bump to v18.8 2024-09-17 12:30:12 +00:00
kssenii
3a05282bce Update assert 2024-09-17 14:26:31 +02:00
Yakov Olkhovskiy
fd0c7a1c18 Merge branch 'master' into refactor-secret-finder 2024-09-17 12:16:19 +00:00
Kseniia Sumarokova
4704fb8a3b
Merge branch 'master' into miscellaneous-3 2024-09-17 13:32:01 +02:00
Kseniia Sumarokova
0369aaea87
Merge pull request #69092 from 1on/master
Ability to limit columns for tables in MaterializedPostgreSQL
2024-09-17 11:08:05 +00:00
Kseniia Sumarokova
3f663f8e09
Merge pull request #68821 from joelynch/joelynch/disk-encrypted-missing-method
Fix zero copy bug with encrypted disk and UNFREEZE
2024-09-17 11:05:14 +00:00
Vitaly Baranov
f768717be8 Fix test. 2024-09-17 13:05:02 +02:00
Kseniia Sumarokova
64106e7b3c
Merge pull request #68696 from ucasfl/minor
Use proper ErrorCodes, replace NETWORK_ERROR by HDFS_ERROR
2024-09-17 10:57:30 +00:00
Kseniia Sumarokova
79223045c9
Merge pull request #68592 from Sergey2Gnezdilov/patch-1
Update nats.md
2024-09-17 10:56:37 +00:00
Vitaly Baranov
983b061b58 Corrections after review. 2024-09-17 12:56:10 +02:00
kssenii
3a299f382d Refactor 2024-09-17 12:52:45 +02:00
Vitaly Baranov
f8f72ccb00 Add test. 2024-09-17 12:10:31 +02:00
Vitaly Baranov
1ccd461c97 Fix restoring access entities dependant on existing ones. 2024-09-17 12:10:31 +02:00
vdimir
de308acfad
Merge pull request #69328 from ClickHouse/vdimir/integration-tests-randomize-settings
Randomize integration tests settings
2024-09-17 10:05:17 +00:00
Michael Stetsyuk
5aaff37b36 sync changes to InterpreterDropQuery::executeToDatabaseImpl from the private fork 2024-09-17 09:16:52 +00:00
Robert Schulze
386d54cedf
Merge pull request #69564 from rschu1ze/untrash-libpq
Replace libpq code dump by postgresql fork and bump to v14.3
2024-09-17 09:15:38 +00:00
Yarik Briukhovetskyi
2c1c1a93c6
Merge pull request #69626 from yariks5s/small_tests_fix
Reorder some tests (follow-up to #69514)
2024-09-17 09:09:06 +00:00
Antonio Andelic
9f932fb453 Merge branch 'master' into keeper-better-ssl-support 2024-09-17 10:52:35 +02:00
Antonio Andelic
f3654b8fc8 Merge branch 'master' into keeper-some-improvement2 2024-09-17 10:35:38 +02:00
Antonio Andelic
676b6238d0 Update comments 2024-09-17 10:30:39 +02:00
Antonio Andelic
e876997ebb Merge branch 'master' into keeper-some-improvement2 2024-09-17 10:28:02 +02:00
Nikolai Kochetov
e7eaa01bb3
Merge pull request #69298 from ClickHouse/array-join-step-refactoring
Refactor ArrayJoin step.
2024-09-17 08:26:09 +00:00
Antonio Andelic
52dc9a54a7
Merge pull request #69627 from ClickHouse/keeper-fix-multi-no-auth
Fix Keeper multi request preprocessing with NOAUTH
2024-09-17 06:48:07 +00:00
Konstantin Bogdanov
b4a6d41b52
Merge pull request #69655 from ClickHouse/try-fix-02447_drop_database_replica
Try fix `02447_drop_database_replica`
2024-09-17 01:00:26 +00:00
Konstantin Bogdanov
a329150eef
Merge pull request #69601 from ClickHouse/fix-tsan-writebufferfromhttpserverresponse
Try to fix data race in `WriteBufferFromHTTPServerResponse`
2024-09-17 00:23:17 +00:00
pufit
7b94dc1813
Merge pull request #65277 from arthurpassos/multi_auth_methods
Multi auth methods
2024-09-16 23:53:33 +00:00
Konstantin Bogdanov
8c7c37de1d
temp-commit 2024-09-16 23:41:51 +02:00
Konstantin Bogdanov
6a26c5cf8e
Fix 2024-09-16 20:54:02 +02:00
Miсhael Stetsyuk
0888b9746e
Merge pull request #69588 from ClickHouse/add-sleep-for-in-enqueueQueryImpl
sleep for 50ms before retrying to acquire a lock in `DatabaseReplicatedDDLWorker::enqueueQueryImpl`
2024-09-16 18:41:59 +00:00
Robert Schulze
0424329fc0
Merge pull request #69581 from rschu1ze/remove-n
Remove superfluous `--multiquery/-n`, pt. V
2024-09-16 18:08:00 +00:00
Kruglov Pavel
da993ad0a3
Merge pull request #69635 from ClickHouse/Avogar-patch-7
Update docs of JSONAsObject format with new JSON type
2024-09-16 16:24:21 +00:00
Yarik Briukhovetskyi
19dbee7cdb
Merge pull request #69625 from ClickHouse/fix-filelog-docs
Update filelog.md
2024-09-16 15:50:38 +00:00
Konstantin Bogdanov
5eb3d9496a
Merge pull request #69642 from ClickHouse/fix-invalid-clickhouse-format-invocation
Fix invalid `clickhouse-format` invocation in tests
2024-09-16 15:17:37 +00:00
Yakov Olkhovskiy
19e2197582
fix 2024-09-16 10:38:28 -04:00
Rich Raposa
d793e06860
Merge pull request #69622 from Olexandr88/patch-1
Docs: Update index
2024-09-16 13:12:30 +00:00
Konstantin Bogdanov
23e0e92f5f
Fix 2024-09-16 15:07:40 +02:00
Yakov Olkhovskiy
d223c4547f
fix after master merge 2024-09-16 08:35:05 -04:00
vdimir
1986fb1418
Merge pull request #68595 from ClickHouse/vdimir/fix_function_printf_style
Fix style in Functions/printf.cpp
2024-09-16 12:34:31 +00:00
Yakov Olkhovskiy
58993d3f3b
Merge branch 'master' into refactor-secret-finder 2024-09-16 08:33:16 -04:00
Kruglov Pavel
e5ae4c8e8b
Update docs of JSONAsObject format with new JSON type 2024-09-16 14:19:20 +02:00
Yarik Briukhovetskyi
dc02b168a0
fix references + remove index 2024-09-16 13:53:47 +02:00
Alexander Gololobov
8507d209c0
Merge branch 'master' into check_time_limit_in_index_analysis 2024-09-16 13:36:51 +02:00
Alexander Gololobov
f5b9d5ad34 Test for checking time limit in index analysis 2024-09-16 13:34:40 +02:00
Alexander Gololobov
4af369fbc4 Failpoint for testing slow index analysis 2024-09-16 13:34:01 +02:00
Robert Schulze
20b25566f5
Remove superfluous --multiquery/-n 2024-09-16 11:30:56 +00:00
Antonio Andelic
8cdcc431fe Fix 2024-09-16 13:30:17 +02:00
Antonio Andelic
f401eccc64 Fix Keeper multi request preprocessing with NOAUTH 2024-09-16 12:48:01 +02:00
Yarik Briukhovetskyi
6863dc7647
init 2024-09-16 12:48:01 +02:00
János Benjamin Antal
60f893bf87
Update filelog.md 2024-09-16 12:38:42 +02:00
Mikhail f. Shiryaev
f36408a666
Merge pull request #69599 from ClickHouse/local-debug
Improve debug step in actions
2024-09-16 10:20:12 +00:00
Yarik Briukhovetskyi
de85f5f251
empty commit (I've changed the changelog entry) 2024-09-16 12:15:11 +02:00
Oleksandr
85af661b9c
Docs: Update index 2024-09-16 12:57:24 +03:00
vdimir
1963e971f3
fix 2024-09-16 09:57:20 +00:00
vdimir
056c7af356
comment 2024-09-16 09:14:48 +00:00
vdimir
cf9200f1d0
Randomize integration tests settings 2024-09-16 09:14:44 +00:00
Antonio Andelic
b42c6491e4
Merge pull request #69578 from ClickHouse/issues/68932/enable_in_ci
enable removeRecursive in CI
2024-09-16 09:03:11 +00:00
Robert Schulze
1a4c7b7c61
Merge pull request #69493 from ucasfl/vector-index-insert
Speedup insert performance of vector similarity index by parallelization
2024-09-16 08:54:02 +00:00
Oleksandr
14feba8443
Docs: Update index 2024-09-16 11:42:09 +03:00
vdimir
4c4a051d5e
Merge pull request #69075 from kirillgarbar/remove-stale-moving-parts
Remove stale moving parts without zookeeper
2024-09-16 08:02:05 +00:00
Vitaly Baranov
a55cc03973
Merge pull request #69611 from vitlibar/masking-sensitive-info-in-gcs-table-function
Masking sensitive info in gcs() table function
2024-09-16 07:58:17 +00:00
Antonio Andelic
187a717872 Merge branch 'master' into keeper-better-ssl-support 2024-09-16 09:17:30 +02:00
Robert Schulze
37411bf240
Fix sizing with unconstrained thread pool size 2024-09-15 15:06:14 +00:00
Arthur Passos
5f464a6d74 trigger ic 2024-09-15 07:09:49 -03:00
Robert Schulze
733c57dae7
Merge pull request #69583 from rschu1ze/better-fix-67476
A better fix for #67476
2024-09-15 09:35:37 +00:00
李扬
4412946532
Merge branch 'master' into orc_dict_encode 2024-09-15 17:25:20 +08:00
marco-vb
03737ddcab Reduced disk size on test for faster execution. 2024-09-14 22:24:17 +00:00
marco-vb
038f56cb5e Only make checks to stop inserts if settings are being used. 2024-09-14 21:04:12 +00:00
Nikita Taranov
63577507c9 fix build 2024-09-14 21:43:27 +01:00
Nikita Taranov
9eb78773a6 Merge branch 'master' into adaptive_parallel_replicas 2024-09-14 19:31:02 +01:00
Nikita Taranov
918ead070a
Merge pull request #69602 from ClickHouse/rm_explicit_initial_announce_from_RFMT
Remove explicit announce from local replica in ReadFromMergeTree
2024-09-14 17:58:41 +00:00
Yakov Olkhovskiy
6f63a7b213 fix tidy 2024-09-14 16:46:48 +00:00
Yakov Olkhovskiy
56cfa74a14 fix 2024-09-14 13:32:52 +00:00
Yakov Olkhovskiy
dbb1d043fe unification of FunctionSecretArgumentsFinder 2024-09-14 05:46:08 +00:00
Vitaly Baranov
a461d20af9 Masking sensitive info in gcs() table function. 2024-09-13 23:03:56 +02:00
Nikita Taranov
8fd9345d2d fix 2024-09-13 21:26:58 +01:00
marco-vb
56f3030b17 Black formatting python test. 2024-09-13 17:32:33 +00:00
Alexander Gololobov
31ddfc6f5f Check time limit while analyzing indexes 2024-09-13 19:19:21 +02:00
Marco Vilas Boas
ddf2e07fd0
Merge branch 'ClickHouse:master' into marco-vb/setting-stop-insert-on-full-disk 2024-09-13 18:17:44 +01:00
marco-vb
5cc12ca9ee Added integration testing for newly implemented settings. 2024-09-13 17:16:16 +00:00
Miсhael Stetsyuk
98a2c1c638
Merge pull request #69274 from ClickHouse/fix-metadata-version-in-zookeeper
fix `metadata_version` in ZooKeeper
2024-09-13 17:11:21 +00:00
Nikita Taranov
bab574d674
Merge pull request #69404 from bigo-sg/69135
`have_compressed` is lost in `HashJoin::reuseJoinedData`
2024-09-13 16:39:43 +00:00
Miсhael Stetsyuk
4225ba79f9
use base/sleep.h 2024-09-13 17:35:11 +01:00
Nikita Taranov
57a6a64d8c fix 2024-09-13 17:31:47 +01:00
Nikita Taranov
de78992966
Update tests/integration/test_parallel_replicas_snapshot_from_initiator/test.py
Co-authored-by: Igor Nikonov <954088+devcrafter@users.noreply.github.com>
2024-09-13 18:25:51 +02:00
Nikita Taranov
42670a46d4 impl 2024-09-13 17:00:46 +01:00
Mikhail f. Shiryaev
b55d0b54ea
Merge steps together to minimize grouping 2024-09-13 17:35:09 +02:00
Mikhail f. Shiryaev
418ef3f8bc
Use local debug action in every action 2024-09-13 17:20:49 +02:00
Mikhail f. Shiryaev
b420bbf855
Improve debug action 2024-09-13 17:17:10 +02:00
Alexander Gololobov
e13247b67e Fix clang-18 build 2024-09-13 16:50:43 +02:00
Alexander Gololobov
2650a20628 Make dedup logic O(n*log(n)) instead of O(n^2) 2024-09-13 16:21:17 +02:00
Antonio Andelic
9a31fc385d Fixes 2024-09-13 15:58:17 +02:00
marco-vb
ddc506a677 Corrected implementation for check of new settings and fix lint of settings change history. 2024-09-13 13:48:42 +00:00
Michael Stetsyuk
2b6238a5e5 sleep for 10ms beforen retrying to acquire a lock in DatabaseReplicatedDDLWorker::enqueueQueryImpl 2024-09-13 13:41:01 +00:00
avogar
2812953a8a Try to fix tests 2024-09-13 13:37:42 +00:00
Alexander Tokmakov
8111a32c72
Merge pull request #69539 from ClickHouse/evillique-patch-2
Fix attach of ReplicatedMergeTree tables in Replicated databases
2024-09-13 13:06:21 +00:00
Antonio Andelic
492461271b Merge branch 'master' into keeper-better-ssl-support 2024-09-13 14:44:12 +02:00
Michael Stetsyuk
721e9a7356 empty 2024-09-13 12:38:58 +00:00
Michael Stetsyuk
1b1db0081f do not fix metadata_version if replica is read_only 2024-09-13 12:38:25 +00:00
Кирилл Гарбар
6a7cfd13f7 Set PRESERVE_BLOBS if part is fetched from another replica 2024-09-13 15:25:17 +03:00
Antonio Andelic
3c47f3df4b Support more advanced SSL options for Keeper internal communication 2024-09-13 14:23:01 +02:00
Arthur Passos
54e75fd4dc fix black 2024-09-13 09:04:14 -03:00
Arthur Passos
ae6e236acf update recently introduced test 2024-09-13 08:59:59 -03:00
Robert Schulze
51f3245030
A better fix for #67476
Throw an exception instead of silently ignoring two conflicting settings.
2024-09-13 11:45:15 +00:00
Mikhail Artemenko
baf6aaef1d fix tests 2024-09-13 11:32:33 +00:00
Robert Schulze
9ca149a487
Fix GWP-asan crash 2024-09-13 11:07:09 +00:00
Daniil Ivanik
2fce90ab76
Merge pull request #66782 from a-a-f/input_format_json_empty_as_default
Add support for the `input_format_json_empty_as_default` setting
2024-09-13 10:33:45 +00:00
李扬
11c7cdabf8
Merge branch 'ClickHouse:master' into orc_dict_encode 2024-09-13 18:26:20 +08:00
李扬
71553022e0
fix 03230_array_zip_unaligned 2024-09-13 18:16:13 +08:00
李扬
53e1975833
fix 01045_array_zip 2024-09-13 18:15:47 +08:00
Yarik Briukhovetskyi
e0c4a88f98
Merge pull request #69514 from aiven-sal/aiven-sal/showcolumns
Correctly handle tables' names with dots in SHOW COLUMNS and SHOW INDEX
2024-09-13 10:12:53 +00:00
János Benjamin Antal
d5c3adabde
Merge pull request #69301 from aohoyd/master
Add xml char escaping to docker's entrypoint
2024-09-13 10:11:30 +00:00
Marco Vilas Boas
8299b31d47
Merge branch 'master' into marco-vb/setting-stop-insert-on-full-disk 2024-09-13 10:44:04 +01:00
Robert Schulze
97c8d2897c
Bump to v14.13 2024-09-13 09:36:19 +00:00
lgbo-ustc
08fd6c8ab6 have_compressed is lost in reuseJoinedData 2024-09-13 17:18:27 +08:00
Nikita Taranov
f330fdb1bf
Merge pull request #69406 from canhld94/parallel_join_limit_threads
Not retaining thread in concurrent hash join threadpool
2024-09-13 09:14:48 +00:00
Mikhail Artemenko
042194e3f6 enable removeRecursive in CI 2024-09-13 08:50:28 +00:00
Arthur Passos
2c165096cd Merge branch 'master' into multi_auth_methods 2024-09-13 05:18:11 -03:00
李扬
11d2963497
fix style 2024-09-13 11:56:47 +08:00
Michael Kolupaev
e1a206c84d
Merge pull request #64953 from ClickHouse/tomic
Disallow creating refreshable MV on Linux < 3.15
2024-09-13 03:42:28 +00:00
taiyang-li
f9335a2fd5 update uts 2024-09-13 10:50:50 +08:00
taiyang-li
8a89d7b2b9 allow empty inputs for arrayZip or arrayZipUnaligned 2024-09-13 10:46:38 +08:00
Duc Canh Le
59763a937e Merge branch 'master' into parallel_join_limit_threads
Fix CI
2024-09-13 01:47:20 +00:00
Michael Kolupaev
7e99f05981 Merge remote-tracking branch 'origin/master' into tomic 2024-09-12 21:45:09 +00:00
Alexander Gololobov
09f22920d9
Merge pull request #69525 from ClickHouse/backport_mergetask
Backport MergeTask changes from private to minimize merge conflicts
2024-09-12 19:52:10 +00:00
Robert Schulze
aab0d3dd9e
Bump to 7.7.5 2024-09-12 19:42:32 +00:00
Robert Schulze
5a34b9f24e
Bump to 7.6.1 2024-09-12 19:14:41 +00:00
Robert Schulze
a0a4858e00
Scratch build of libpqxx at 7.5.3 + patches 2024-09-12 18:55:35 +00:00
Kruglov Pavel
8610a01745
Merge pull request #69147 from Avogar/fix-s3-cluster-structure
Fix propogating structure argument in s3Cluster
2024-09-12 17:24:26 +00:00
avogar
9c1f4f4545 Remove bad files 2024-09-12 17:21:28 +00:00
Antonio Andelic
f62cb32c5c
Merge pull request #69332 from ClickHouse/issues/68932/remove-recursive
Support removeRecursive natively in keeper
2024-09-12 17:14:34 +00:00
avogar
2e82e06330 Update tests 2024-09-12 16:59:25 +00:00
Kseniia Sumarokova
f50898ae98
Merge pull request #69513 from ClickHouse/s3queue-refactor
S3Queue: small refactoring
2024-09-12 16:56:59 +00:00
Кирилл Гарбар
120e38c72a Merge remote-tracking branch 'kirillgarbar/master' into remove-stale-moving-parts 2024-09-12 19:26:58 +03:00
Yakov Olkhovskiy
d3533742d5
Merge pull request #68236 from marco-vb/marco-vb/x509-san-support-wildcard
Added support for wildcard usage in x509 SubjectAltName identification.
2024-09-12 16:00:35 +00:00
Robert Schulze
4963ab603c
Switch Postgres to 2f7bae2f92, adjust build description, delete libqp
Based on the code state of July 2021 which Kseniia copied over here:
https://github.com/ClickHouse/libpq/pull/5 (found out the hard way)
2024-09-12 15:53:26 +00:00
Nikita Taranov
7b2810bea2 Merge branch 'master' into adaptive_parallel_replicas 2024-09-12 16:51:15 +01:00
Robert Schulze
e2bfce66dd
Add postgres as a submodule 2024-09-12 15:20:10 +00:00
Robert Schulze
0bb3967d14
Remove obsolete target_include_directories (/config does not exist) 2024-09-12 15:20:10 +00:00
avogar
401a3d0931 Add test 2024-09-12 15:10:29 +00:00
1on
51d770fa7a Ability to limit columns for tables in MaterializedPostgreSQL 2024-09-12 18:10:19 +03:00
Nikita Taranov
54f0a8c0e2
Merge pull request #69554 from KevinyhZou/fix_settings_join_to_sort
Fix upgrade check failure for join_to_sort settings
2024-09-12 15:07:17 +00:00
avogar
beffb92411 Keep original order of conditions during move to prewhere 2024-09-12 14:52:09 +00:00
Robert Schulze
877002f689
3% more aesthetic build description 2024-09-12 14:42:17 +00:00
Nikita Taranov
16f93ea1b3 revive separate protocol versioning for PRs 2024-09-12 15:40:51 +01:00
Nikita Taranov
1e3bc6d359 log mark_segment_size on initiator 2024-09-12 15:15:57 +01:00
Robert Schulze
bde54b96f7
Move ENABLE_LIBPQXX in a central place 2024-09-12 14:03:22 +00:00
Robert Schulze
4a9b376e2a
Fix typo 2024-09-12 14:01:26 +00:00
Robert Schulze
c9dd409baa
Merge pull request #69549 from rschu1ze/qc-with-truncated-results
Disallow query cache for queries with non-throw overflow mode
2024-09-12 13:58:38 +00:00
marco-vb
562c23eac6 Add new settings to settings change history. 2024-09-12 13:28:49 +00:00
Mikhail f. Shiryaev
8d5babf65f
Kill the runner process if integration tests fail to pre-pull 2024-09-12 15:26:21 +02:00
Mikhail f. Shiryaev
99ede620be
Add kill_ci_runner to ci_utils, will allow restarts 2024-09-12 15:24:25 +02:00
Robert Schulze
38b5ea9066
Fix docs 2024-09-12 12:43:27 +00:00
kevinyhzou
2225389474 Fix upgrade check failed for join_to_sort settings 2024-09-12 20:10:42 +08:00
Alexander Gololobov
e15b86cd9d
Merge branch 'master' into backport_mergetask 2024-09-12 13:29:59 +02:00
Alexander Gololobov
bbcde19910
Merge pull request #69383 from ClickHouse/tmp_files_lookup
Refactor temporary file usage in MergeTask with QueryPlan
2024-09-12 10:57:15 +00:00
Ilya Yatsishin
98ef5f6e10
Merge pull request #69253 from ClickHouse/restore-replace-to-null-settings-fix
Restore external tables to Null supports no settings
2024-09-12 10:40:54 +00:00
Robert Schulze
fe5e061fff
Some fixups 2024-09-12 10:38:14 +00:00
kssenii
3e3a80e714 Merge remote-tracking branch 'origin/s3queue-refactor' into s3queue-refactor 2024-09-12 12:35:59 +02:00
kssenii
6e94c9f617 Fix 2024-09-12 12:34:56 +02:00
Marco Vilas Boas
185d9401e5
Merge branch 'ClickHouse:master' into marco-vb/x509-san-support-wildcard 2024-09-12 11:08:45 +01:00
Joe Lynch
92351a67e8
Merge branch 'master' into joelynch/disk-encrypted-missing-method 2024-09-12 11:58:41 +02:00
Marco Vilas Boas
f292767778
Merge branch 'master' into marco-vb/setting-stop-insert-on-full-disk 2024-09-12 10:56:32 +01:00
marco-vb
7d36f3b764 Implemented checks for new settings. 2024-09-12 09:53:56 +00:00
marco-vb
21bd47f09e Add settings min_free_disk_bytes_to_throw_insert and min_free_disk_ratio_to_throw_insert and update documentation. 2024-09-12 09:45:43 +00:00
Alexey Katsman
d7f271c658
Merge pull request #69269 from alexkats/external-data-checksum
Use another error code for external data in buffer
2024-09-12 09:38:09 +00:00
Robert Schulze
5fe5cc8611
Disallow query cache for queries with non-throw overflow mode 2024-09-12 09:21:27 +00:00
Mikhail Artemenko
494455e4eb Merge branch 'master' into issues/68932/remove-recursive 2024-09-12 08:51:41 +00:00
Alexander Gololobov
8ea2573a9d Merge branch 'master' of github.com:ClickHouse/ClickHouse into backport_mergetask 2024-09-12 09:31:54 +02:00
Alexander Gololobov
856a66d45f Merge branch 'master' of github.com:ClickHouse/ClickHouse into tmp_files_lookup 2024-09-12 09:26:36 +02:00
flynn
f6b965872f Merge branch 'master' of github.com:ClickHouse/ClickHouse into vector-index-insert 2024-09-12 06:40:33 +00:00
Yakov Olkhovskiy
fd53b39352
bump 2024-09-12 02:33:15 -04:00
Mikhail f. Shiryaev
8a70017815
Merge pull request #69538 from ClickHouse/fix-latest-sync-commit
Get rid of broken `get_commits().reversed`
2024-09-12 05:34:35 +00:00
Yakov Olkhovskiy
c124533ef9
fix 2024-09-12 00:08:53 -04:00
flynn
22c3b71196 Make vector similarity index creation thread pool globally 2024-09-12 03:54:25 +00:00
Yakov Olkhovskiy
98c0f82f28
make it compatible with multiple runs 2024-09-11 20:45:54 -04:00
robot-clickhouse
1da5729f89 Automatic style fix 2024-09-11 21:08:43 +00:00
Nikolay Degterinsky
8e3ba4bd6c
Add test 2024-09-11 22:59:06 +02:00
Igor Nikonov
56b39c37a1
Merge pull request #64448 from ClickHouse/pr-local-plan
Local plan for parallel replicas
2024-09-11 20:44:37 +00:00
Nikolay Degterinsky
b30aabf635
Fix attach of ReplicatedMergeTree tables in Replicated databases 2024-09-11 22:38:54 +02:00
Mikhail f. Shiryaev
370ce5ef63
Get rid of broken get_commits().reversed 2024-09-11 22:37:30 +02:00
Nikita Taranov
fc83c1c7a2 use final task size in segment size calculation 2024-09-11 20:20:18 +01:00
Julia Kartseva
b5289c1f08
Merge pull request #60341 from KevinyhZou/improve_join_insert_from
Improve left/inner join performance by rerange right table by keys
2024-09-11 19:04:41 +00:00
Kseniia Sumarokova
b216e1a74b
Merge branch 'master' into s3queue-refactor 2024-09-11 20:56:11 +02:00
Yatsishin Ilya
ccc6390a9e merge remote-tracking branch 'origin/master' into restore-replace-to-null-settings-fix 2024-09-11 18:23:07 +00:00
Antonio Andelic
de4774be74
Merge pull request #69469 from yariks5s/squashing_mem_usage
Fix high memory consumption on Squashing
2024-09-11 16:52:19 +00:00
robot-clickhouse
c0a42ef877 Automatic style fix 2024-09-11 15:42:12 +00:00
Alex Katsman
9a2a6d71d2 Fix check in test_broken_projections 2024-09-11 15:32:26 +00:00
Kseniia Sumarokova
abe8f29bf8
Update test 2024-09-11 17:32:20 +02:00
Alexander Gololobov
c3416859d5 Merge branch 'master' of github.com:ClickHouse/ClickHouse into tmp_files_lookup 2024-09-11 17:22:08 +02:00
Alex Katsman
22ceaa0066 Use another error code for external data in buffer
Use CANNOT_DECOMPRESS error code for the compressed external data in
CompressedReadBufferBase for checksum validation and decompression.
2024-09-11 14:59:31 +00:00
Alexander Gololobov
f69cb73df0
Merge pull request #69167 from ClickHouse/query_plan_for_merge
Use QueryPlan for merge
2024-09-11 14:41:25 +00:00
Joe Lynch
f378047f30
Properly clean up 2024-09-11 16:02:36 +02:00
Robert Schulze
1ce4d6d8e5
Merge pull request #69511 from rschu1ze/icu-comment
CMake: Add comment about ICU data files
2024-09-11 13:58:18 +00:00
Alexander Gololobov
3aef79b5a2 Backport changes from private to minimize merge conflicts 2024-09-11 15:45:55 +02:00
Salvatore Mesoraca
dca72d2e0b Add tests for SHOW INDEX from tables with dots 2024-09-11 15:39:02 +02:00
Salvatore Mesoraca
146edca4f7 Add tests for SHOW COLUMNS from tables with dots 2024-09-11 15:35:48 +02:00
kssenii
a05610c38f Move creation and validation of table metadata before creating queue metadata & save to factory 2024-09-11 15:32:22 +02:00
Antonio Andelic
9b42af7263
Merge pull request #66648 from ClickHouse/read-cgroup-memory-usage-async-metrics
Simplify some memory tracking parts
2024-09-11 13:24:38 +00:00
Salvatore Mesoraca
3556cf92c3 Allow SHOW INDEXES to work with tables that contain dots in the name 2024-09-11 15:15:31 +02:00
Salvatore Mesoraca
075a85f15c Allow SHOW COLUMNS to work with tables that contain dots in the name 2024-09-11 15:15:08 +02:00
Robert Schulze
9e335abe17
CMake: Add comment about ICU data files 2024-09-11 13:06:17 +00:00
Igor Nikonov
c53e165118
Merge branch 'master' into pr-local-plan 2024-09-11 14:03:35 +02:00
Kseniia Sumarokova
4e0b3f8415
Merge pull request #69432 from ClickHouse/add-documnetation-for-azure-queue
Add azure-queue.md
2024-09-11 12:02:19 +00:00
Mikhail f. Shiryaev
22f389d415
Merge pull request #69483 from ClickHouse/logs-export-improvement
Another attempt to address EAGAIN "Resource unavailable"
2024-09-11 13:47:38 +02:00
Kseniia Sumarokova
6f9d1631e2
Update aspell-ignore 2024-09-11 13:11:29 +02:00
Mikhail f. Shiryaev
c1830bc041
Escape the \n in statements 2024-09-11 13:08:58 +02:00
Nikita Taranov
bdddab6a1f
Merge pull request #69449 from ClickHouse/fix_test2
Fix test_disks_app_func
2024-09-11 11:07:18 +00:00
Yarik Briukhovetskyi
af469ffde4
remove sanitizer builds 2024-09-11 12:32:36 +02:00
Mikhail f. Shiryaev
3921f910f5
Another attempt to address EAGAIN "Resource unavailable" 2024-09-11 12:14:16 +02:00
flynn
7425d4aa1a remove blank line 2024-09-11 10:12:42 +00:00
Mikhail Artemenko
55d6672bc4 add early break for test keeper impl 2024-09-11 10:00:40 +00:00
flynn
cf12e3924f Speedup insert data with vector similarity index by add data to index parallel 2024-09-11 09:31:46 +00:00
Yarik Briukhovetskyi
fd3bd785b8
Update 03236_squashing_high_memory.sql 2024-09-11 11:17:06 +02:00
Yarik Briukhovetskyi
ccfb7ad38c
Merge pull request #69455 from yariks5s/group_concat_return_string
`groupConcat` consistency with `arrayStringConcat`
2024-09-11 08:59:48 +00:00
Robert Schulze
7a3d69b626
Merge pull request #69451 from rschu1ze/sqid-crash
Fix crash in `sqidDecode`
2024-09-11 08:56:05 +00:00
Duc Canh Le
085be6bf59 remove unwanted include
Signed-off-by: Duc Canh Le <duccanh.le@ahrefs.com>
2024-09-11 06:42:48 +00:00
李扬
0de3b1dacb
Merge branch 'ClickHouse:master' into orc_dict_encode 2024-09-11 12:08:06 +08:00
Yarik Briukhovetskyi
3d36f6dce3
Update 03236_squashing_high_memory.sql 2024-09-10 23:48:32 +02:00
Kseniia Sumarokova
cb1b7dc43c
Merge pull request #69454 from ClickHouse/revert-s3queue-problem
Quick fix for s3queue problem
2024-09-10 21:13:16 +00:00
Alexander Tokmakov
629d27fec8
Merge pull request #69422 from ClickHouse/add_a_setting
Add a setting to disallow DETACH PERMANENTLY in Replicated database
2024-09-10 19:56:10 +00:00
Michael Kolupaev
263cd9e1c3 Fix error message 2024-09-10 19:41:15 +00:00
Michael Kolupaev
5539faa54e Disallow creating refreshable MV on Linux < 3.15 2024-09-10 19:41:15 +00:00
Alexander Gololobov
d4aa06524b Add materialization when building indices in vertical merge 2024-09-10 20:57:55 +02:00
Alexander Gololobov
2f15fcd23f Test with sparse serialization, vertical merge and skip indices 2024-09-10 20:57:03 +02:00
Yarik Briukhovetskyi
63aebfa5d7
Update 03236_squashing_high_memory.sql 2024-09-10 20:15:36 +02:00
Yarik Briukhovetskyi
9b517a939f
Update 03236_squashing_high_memory.sql 2024-09-10 19:53:16 +02:00
Mikhail Artemenko
3e3d652320 refactor tests 2024-09-10 17:52:41 +00:00
Mikhail Artemenko
00fe1d12ee add acl test for rmr 2024-09-10 17:45:39 +00:00
Mikhail Artemenko
3730582d06 add full tree acl check 2024-09-10 17:43:35 +00:00
Antonio Andelic
df1821a579
Update tests/queries/0_stateless/03236_squashing_high_memory.sql 2024-09-10 19:32:28 +02:00
Igor Nikonov
c3dfdd41d3 Merge remote-tracking branch 'origin/master' into pr-local-plan 2024-09-10 17:24:44 +00:00
Mikhail f. Shiryaev
d093dd2c71
Merge pull request #69416 from ClickHouse/logs-export-improvement
Hide exported logs statements in GH logs
2024-09-10 19:19:47 +02:00
Nikita Taranov
8534aa07fc
Merge pull request #69400 from ClickHouse/support_more_oss_endpoints
Support more oss endpoints
2024-09-10 17:01:02 +00:00
Nikita Taranov
8fa31c0750
Merge pull request #69385 from ClickHouse/fix
Fix type mismatch
2024-09-10 16:52:57 +00:00
Alexander Tokmakov
b3a5101f34
Merge pull request #69430 from ClickHouse/tavplubix-patch-10
Update 03232_pr_not_ready_set.sql
2024-09-10 16:43:22 +00:00
Alexander Gololobov
bb82465a5f Merge branch 'master' of github.com:ClickHouse/ClickHouse into query_plan_for_merge 2024-09-10 18:27:59 +02:00
Yarik Briukhovetskyi
caab4dd8b9
fix 2024-09-10 18:20:48 +02:00
Nikita Taranov
8d5d7dd83a fix wording 2024-09-10 17:18:27 +01:00
Kseniia Sumarokova
6a6d26aeed
Update StorageObjectStorageQueue.cpp 2024-09-10 18:16:27 +02:00
Kseniia Sumarokova
b7e863b0e9
Update docs/en/engines/table-engines/integrations/azure-queue.md
Co-authored-by: Kruglov Pavel <48961922+Avogar@users.noreply.github.com>
2024-09-10 18:13:04 +02:00
Kseniia Sumarokova
dcd1874520
Update docs/en/engines/table-engines/integrations/azure-queue.md
Co-authored-by: Kruglov Pavel <48961922+Avogar@users.noreply.github.com>
2024-09-10 18:12:56 +02:00
Mikhail f. Shiryaev
7727b30f5c
Attempt to fix EAGAIN error 2024-09-10 18:06:32 +02:00
Joe Lynch
35df5ff28e
Add test for SYSTEM UNFREEZE with zero_copy 2024-09-10 17:52:02 +02:00
Mikhail Artemenko
8b7a5616a2 update test 2024-09-10 15:51:31 +00:00
Alexander Gololobov
e4761d40ba
Merge pull request #69429 from ClickHouse/materialize_sparse
Make `materialize()` function return full column when parameter is a sparse column
2024-09-10 15:49:29 +00:00
Robert Schulze
080193cfc3
14% more aesthetic code 2024-09-10 15:46:21 +00:00
Yarik Briukhovetskyi
f588e3c31b
rename tests 2024-09-10 17:43:50 +02:00
Yarik Briukhovetskyi
d8e670297b
groupConcat consistency 2024-09-10 17:42:27 +02:00
kssenii
d43264c44e Quick fix for s3queue problem 2024-09-10 17:41:52 +02:00
Robert Schulze
04dcf73e8f
Fix crash in sqidDecode 2024-09-10 15:35:59 +00:00
Kruglov Pavel
d226b13fd4
Merge pull request #69272 from Avogar/json-memory-usage
Reduce memory usage of inserts to JSON by using adaptive write buffer size
2024-09-10 15:23:18 +00:00
Nikita Taranov
acbeaa6d33 fix 2024-09-10 16:14:53 +01:00
Mikhail Artemenko
1aacb48bcf fix collector 2024-09-10 14:34:27 +00:00
Pablo Marcos
a34a544f4a
Merge pull request #67938 from mwoenker/incomplete-utf8-sequence
Handle incomplete sequences at end of input
2024-09-10 14:04:58 +00:00
Michael Stetsyuk
be55e1d2e1 better 2024-09-10 13:52:40 +00:00
kssenii
6719112b02 Add azure-queue.md 2024-09-10 15:10:53 +02:00
Alexander Tokmakov
30cf6ee711
Update 03232_pr_not_ready_set.sql 2024-09-10 14:30:07 +02:00
Mikhail Artemenko
0bd7ef39c4 unify processWatches 2024-09-10 12:27:34 +00:00
Mikhail Artemenko
0453d5e91a small fixes 2024-09-10 12:26:03 +00:00
Alexander Gololobov
a01229bba2 Convert sparse columns to full in materialize() 2024-09-10 14:23:31 +02:00
Alexander Gololobov
41aaf07537 Test materialize() on sparse columns 2024-09-10 14:23:19 +02:00
Nikita Taranov
5ef98cd275
Merge pull request #69413 from ClickHouse/fix_test
Fix 01603_read_with_backoff_bug
2024-09-10 12:20:12 +00:00
Antonio Andelic
bdf8c859b1 Merge branch 'master' into read-cgroup-memory-usage-async-metrics 2024-09-10 14:13:48 +02:00
Alexander Tokmakov
89dd3188bb add a setting to disallow DETACH PERMANENTLY in Replicated 2024-09-10 13:35:18 +02:00
Nikita Fomichev
24d81fe00b
Merge pull request #69394 from ClickHouse/rows-before-aggregation-compatibility
Fix 24.8 setting compatibility `rows_before_aggregation`
2024-09-10 11:33:33 +00:00
Robert Schulze
4d0941072f
Merge pull request #69367 from rschu1ze/bump-libarchive
Bump libarchive to v3.7.4
2024-09-10 11:09:37 +00:00
Nikita Taranov
61ebcdc2ed fix 2024-09-10 12:07:44 +01:00
Igor Nikonov
b0c4f6b9e7 Merge remote-tracking branch 'origin/master' into pr-local-plan 2024-09-10 11:06:10 +00:00
Nikita Taranov
1df897db27 Merge branch 'master' into adaptive_parallel_replicas 2024-09-10 12:03:46 +01:00
Mikhail f. Shiryaev
6e6e705486
Add a hostname to log; we need something to grep remote query_log 2024-09-10 12:56:19 +02:00
Sergei Trifonov
db42cf12fd
Merge pull request #68933 from Blargian/docs_toRelativeXYZ
[Docs] update `toReference*Num` docs
2024-09-10 10:48:24 +00:00
Mikhail f. Shiryaev
8b1f21e7dd
Hide exported logs statements in GH logs 2024-09-10 12:22:19 +02:00
Pablo Marcos
ac3cfef8c1
Merge pull request #69390 from pamarcos/fix-invalid-connection-logical-error
Fix undefined behavior if all connection tries fail
2024-09-10 09:45:37 +00:00
Nikita Taranov
49ea016a3d impl 2024-09-10 10:19:23 +01:00
Daniil Ivanik
25a5768adc
Merge pull request #68952 from Blargian/docs_toDateTime64XYZ
[Docs] update docs for `DateTime64OrZero/Null/Default` functions
2024-09-10 09:15:34 +00:00
Daniil Ivanik
8263815451
Merge pull request #69007 from jww0924/patch-1
[Docs] Add CKibana as third-party GUI
2024-09-10 09:14:37 +00:00
alesapin
41798be63f
Merge pull request #69339 from ClickHouse/cp-mv-docs
Docs: Add cp/mv to keeper client docs
2024-09-10 09:10:32 +00:00
kevinyhzou
597181c45e review 2024-09-10 16:32:52 +08:00
Duc Canh Le
d089a56272 only set max_free_threads_ = 0 when creating pool
Signed-off-by: Duc Canh Le <duccanh.le@ahrefs.com>
2024-09-10 05:51:48 +00:00
Duc Canh Le
11478b949f limit threadpool size in concurrent hash join
Signed-off-by: Duc Canh Le <duccanh.le@ahrefs.com>
2024-09-10 03:12:44 +00:00
Robert Schulze
6464d47d34
Bump to v3.7.4 2024-09-09 20:33:20 +00:00
Robert Schulze
e252bdc30d
Bump to v3.7.3 2024-09-09 20:27:10 +00:00
Igor Nikonov
bb063babff
Merge branch 'master' into pr-local-plan 2024-09-09 21:17:51 +02:00
Nikita Taranov
47589d4898 impl 2024-09-09 19:53:58 +01:00
Alexander Tokmakov
9ab3ee1b13
Merge pull request #66104 from ClickHouse/break_compatibility
Don't allow explicit UUIDs and ReplicatedMergeTree arguments in Replicated databases
2024-09-09 18:29:16 +00:00
Robert Schulze
2b2cd8e3e0
Merge pull request #69377 from JackyWoo/rename_statistics_count_min
Rename `count_min` statistics to `countmin`
2024-09-09 18:25:11 +00:00
Alexander Tokmakov
7fe8775361
Merge pull request #69306 from ClickHouse/tavplubix-patch-14
Update StackTrace.cpp
2024-09-09 17:55:07 +00:00
Alexander Gololobov
38b8edae97 Fix the case with empty temp file 2024-09-09 19:34:59 +02:00
Nikita Taranov
8cdc10cf65 fix settings changes 2024-09-09 18:11:03 +01:00
Kseniia Sumarokova
ef94d3422c
Merge pull request #69305 from ClickHouse/fix-segfault-deltalake
Add checks against segfault in DeltaLakeMetadata
2024-09-09 16:23:29 +00:00
Kruglov Pavel
804012b2e4
Merge pull request #69311 from Avogar/dynamic-primary-key
Mark Dynamic type as not safe primary key type to avoid issues with Fields
2024-09-09 15:33:48 +00:00
Alexander Tokmakov
936c63fd33
Merge pull request #69393 from ClickHouse/revert-69344-remove-multiquery-arg
Revert "Remove obsolete `--multiquery` parameter (follow-up to #63898), pt. V"
2024-09-09 15:33:09 +00:00
Alexander Tokmakov
d2ee805d8f
Revert "Remove obsolete --multiquery parameter (follow-up to #63898), pt. V" 2024-09-09 17:32:22 +02:00
avogar
72dbc8205b Fix unit tests 2024-09-09 15:12:17 +00:00
Robert Schulze
0a9faf05aa
Merge pull request #69361 from rschu1ze/remove-multiquery-arg-2
Remove obsolete `--multiquery` parameter (follow-up to #63898), pt. VI
2024-09-09 14:51:58 +00:00
Robert Schulze
40e887d218
Merge pull request #69344 from rschu1ze/remove-multiquery-arg
Remove obsolete `--multiquery` parameter (follow-up to #63898), pt. V
2024-09-09 14:51:50 +00:00
Robert Schulze
965977500b
Merge pull request #69240 from rschu1ze/update-icu-cmake
CMake: Update ICU build description
2024-09-09 14:40:13 +00:00
Pablo Marcos
f7dee10030 Make a more assertive exception text 2024-09-09 14:38:06 +00:00
Robert Schulze
d749869f00
Merge pull request #67707 from bigo-sg/opt_array_map
Optimize function `array()` and `map()`
2024-09-09 14:37:50 +00:00
Alexander Gololobov
4da1e10ac6 Move sorting key calculation step outside the loop 2024-09-09 16:01:00 +02:00
Pablo Marcos
67b57eb89f Fix undefined behavior if all connection tries fail
For some reason, getManyCheckedForInsert was calling getManyImpl with
skip_unavailable_endpoints=nullptr, which resulted in getManyImpl using
the `skip_unavailable_shards` settings. Since this is true by default,
min_entries was set to 0.

Having min_entries set to 0 while using PoolMode::GET_ONE was strange,
to say the least. There was an edge case where if all connection
attempts failed and min_entries was 0, it was returning an empty vector.
That was not considered to be possible by the caller and it was getting
the front entry of an empty vector, causing undefined behavior.

Conclusion: set `skip_unavailable_endpoints=false` explicitly in
getManyCheckedForInsert so that min_entries=1. In case all connections
fail, an exception will be thrown. Also, add some defensive programming
to ensure we never ever try to get the front element of an empty vector.
2024-09-09 14:00:35 +00:00
Pablo Marcos
e6e79c3c4a Fix minor typos 2024-09-09 13:35:45 +00:00
Alexander Gololobov
8c1f434b1a Do column materialization using ActionsDAG::addMaterializingOutputActions instead of a special step 2024-09-09 15:31:43 +02:00
Alexander Gololobov
1bcc4ba823 Renamed ApplyMergeStep into MergePartsStep 2024-09-09 15:30:19 +02:00
Nikita Fomichev
66572aa029 Fix 24.8 setting compatibility rows_before_aggregation
https://github.com/ClickHouse/ClickHouse/pull/66084
2024-09-09 15:25:14 +02:00
imddba
942d0fab4a
spelling fixes 2024-09-09 20:24:16 +08:00
Robert Schulze
420bc3a072
Merge pull request #69382 from rschu1ze/doc-from
Docs: Document per-logger level overrides
2024-09-09 12:21:22 +00:00
Nikita Taranov
43d057ed0f impl 2024-09-09 13:04:45 +01:00
Alexander Gololobov
5a8bd5b4f5 Encapsulte and cleanup "rows_sources" temp file usage 2024-09-09 13:22:38 +02:00
Alexander Gololobov
7d042be8eb A simple interface to find temporary files by their logical names when building pipeline from query plan 2024-09-09 13:21:00 +02:00
Miсhael Stetsyuk
2364949c95
Merge pull request #69102 from ClickHouse/make-replicated-database-creation-operations-idempotent
Make `Replicated` database creation operations idempotent
2024-09-09 11:19:15 +00:00
Robert Schulze
c4720d9728
Minor doc fixups 2024-09-09 11:18:42 +00:00
Robert Schulze
3363fe3388
Docs: Document per-logger level overriding 2024-09-09 11:14:25 +00:00
Kruglov Pavel
7bf6bdf639
Merge pull request #69149 from Avogar/values-respect-settings
Respect format settings in Values format during conversion from expression to the destination type
2024-09-09 11:02:39 +00:00
Nikita Taranov
57e3812087
Merge pull request #68441 from jiebinn/parallelMergeWithKey
Add thread pool and cancellation to support parallel merge with key
2024-09-09 10:41:45 +00:00
Robert Schulze
5639fed2a5
Merge pull request #69379 from rschu1ze/doc-from
Docs: Mention `FROM`-before-`SELECT` syntax
2024-09-09 10:13:48 +00:00
Igor Nikonov
eda6dabe41 Merge remote-tracking branch 'origin/master' into pr-local-plan 2024-09-09 09:58:36 +00:00
Mikhail Artemenko
08368d1d65 update keeper client docs 2024-09-09 09:46:17 +00:00
Mikhail Artemenko
6309f36232 add limit option to rmr command 2024-09-09 09:44:19 +00:00
JackyWoo
6539cbd1ce Add CountMin to dictionary file and a little fixup 2024-09-09 17:34:15 +08:00
Raúl Marín
d968de6d26
Merge pull request #66205 from alexkorep/output-format-json-compact-with-progress
JSONCompactWithProgress query output format
2024-09-09 09:30:42 +00:00
Yarik Briukhovetskyi
2c35d53bf6
Merge pull request #56738 from yariks5s/time_buckets_impl
Add time-bucket overload to function `toStartOfInterval()`
2024-09-09 09:18:35 +00:00
Mikhail Artemenko
2fe6991124 Merge branch 'master' into issues/68932/remove-recursive 2024-09-09 08:55:53 +00:00
Robert Schulze
c5f8802ac8
Docs: Mention FROM-before-SELECT 2024-09-09 08:05:18 +00:00
JackyWoo
077b8239f5 Rename in tests 2024-09-09 11:52:58 +08:00
JackyWoo
eb800d9e39 Rename statistics of type count_min to countmin 2024-09-09 11:45:39 +08:00
taiyang-li
774ec08faf fix style 2024-09-09 11:37:27 +08:00
taiyang-li
d04997bc98 Merge branch 'opt_array_map' of https://github.com/bigo-sg/ClickHouse into opt_array_map 2024-09-09 11:36:28 +08:00
taiyang-li
f1c43472d8 change as request 2024-09-09 11:35:54 +08:00
Alexey Korepanov
1eb7cdbd42 Merge branch 'master' into output-format-json-compact-with-progress 2024-09-08 17:12:51 +02:00
Robert Schulze
2bbede2d93
Remove superfluous --multiquery/-n 2024-09-08 13:09:44 +00:00
Robert Schulze
26f21a0d94
Merge pull request #69326 from rschu1ze/overlay-followup
Minor follow-up for #66933
2024-09-08 09:07:54 +00:00
Robert Schulze
483dd7eebe
Bump to v3.7.2 2024-09-08 08:55:59 +00:00
Robert Schulze
33866fb5bd
Fix config.h for v3.7.1 2024-09-08 08:38:05 +00:00
Alexey Milovidov
7d670bf3c2
Merge pull request #69136 from ilejn/kdc_network_reject
Do not use docker pause for Kerberos KDC container in integration tests
2024-09-08 05:00:29 +00:00
Alexey Milovidov
47c91ffa70
Merge pull request #69334 from rschu1ze/citation
Add CITATION.cff
2024-09-08 00:26:03 +00:00
Antonio Andelic
65019c4b9b Merge branch 'master' into keeper-some-improvement2 2024-09-07 20:59:04 +02:00
Robert Schulze
2910580b12
Merge pull request #69318 from rschu1ze/bump-libarchive
Bump libarchive from v3.7.0 to v3.7.1
2024-09-07 18:53:18 +00:00
Robert Schulze
654f8b98de
Update docs/en/sql-reference/functions/string-replace-functions.md
Co-authored-by: Yakov Olkhovskiy <99031427+yakov-olkhovskiy@users.noreply.github.com>
2024-09-07 20:47:03 +02:00
Robert Schulze
7ff244d7a3
Update docs/en/sql-reference/functions/string-replace-functions.md
Co-authored-by: Yakov Olkhovskiy <99031427+yakov-olkhovskiy@users.noreply.github.com>
2024-09-07 20:46:56 +02:00
Robert Schulze
65161dc085
Merge pull request #69323 from rschu1ze/bump-grpc
Bump grpc to v1.59.5
2024-09-07 18:44:39 +00:00
Robert Schulze
d464bb5138
Merge pull request #69345 from rschu1ze/bump-libuv
Bump libuv to v1.48.0
2024-09-07 18:43:51 +00:00
Robert Schulze
b13df0b462
Merge pull request #69341 from rschu1ze/bump-openssl
Bump OpenSSL to v3.2.3
2024-09-07 18:39:40 +00:00
Nikita Mikhaylov
16c21ef135
Merge pull request #69359 from tbragin/patch-14
Update README.md - Meetups
2024-09-07 18:29:49 +00:00
Robert Schulze
5362b117bf
Remove superfluous --multiquery/-n 2024-09-07 16:20:46 +00:00
Robert Schulze
8a87cffb82
Merge pull request #69336 from rschu1ze/fix-icu-memleak
Fix memleak in `lower/upperUTF8`
2024-09-07 15:40:01 +00:00
Antonio Andelic
190339c4e6 Fix snapshot sync 2024-09-07 17:34:59 +02:00
Tanya Bragin
c335f4b1e4
Update README.md - Meetups
Adjusting meetup listings per latest
2024-09-07 07:39:31 -07:00
Nikita Mikhaylov
b161ce0c4c
Merge pull request #69356 from ClickHouse/revert-69324-speed-up-slightly-kafka-tests
Revert "Speed up some Kafka tests with multiprocessing"
2024-09-07 11:27:47 +00:00
Antonio Andelic
5a86371b02 Merge branch 'master' into keeper-some-improvement2 2024-09-07 11:32:44 +02:00
Nikita Mikhaylov
9667c19b6e
Revert "Speed up some Kafka tests with multiprocessing" 2024-09-07 09:16:38 +02:00
Julia Kartseva
cc165f9349
Merge pull request #68917 from jkartseva/02378_part_log_profile_events
Fix `02378_part_log_profile_events` flakiness
2024-09-06 23:49:40 +00:00
Ilya Golshtein
f16d4c9567 kdc_network_reject: bugfix (again) 2024-09-06 22:16:11 +00:00
Ilya Golshtein
f5c6612a0b kdc_network_reject: bugfix 2024-09-06 22:16:11 +00:00
Ilya Golshtein
a9fcd61b92 kdc_network_reject: fix test_kafka_config_from_sql_named_collection 2024-09-06 22:16:11 +00:00
Ilya Golshtein
4212ad02e3 kdc_network_reject: make black formatter happy 2024-09-06 22:16:11 +00:00
Ilya Golshtein
c264f1c468 kdc_network_reject: no redundant loop 2024-09-06 22:16:11 +00:00
Ilya Golshtein
7f637f7acf kdc_network_reject: test passed 2024-09-06 22:16:11 +00:00
Igor Nikonov
f5d49f8e10
Merge branch 'master' into adaptive_parallel_replicas 2024-09-06 23:08:30 +02:00
Julia Kartseva
bf74b600e5 rm tests/queries/0_stateless/02378_part_log_profile_events.sql 2024-09-06 21:05:56 +00:00
Julia Kartseva
99667c42f3 sync with the private 2024-09-06 21:05:56 +00:00
Julia Kartseva
ba038cba47 Fix 02378_part_log_profile_events flakiness 2024-09-06 21:05:56 +00:00
Nikita Mikhaylov
ccaa8d03a9
Merge pull request #69324 from ClickHouse/speed-up-slightly-kafka-tests
Speed up some Kafka tests with multiprocessing
2024-09-06 20:12:56 +00:00
Igor Nikonov
42d3cd2b91 Merge remote-tracking branch 'origin/master' into pr-local-plan 2024-09-06 20:10:50 +00:00
Igor Nikonov
ebd9c294aa Fix build 2024-09-06 20:09:48 +00:00
Robert Schulze
f65c869d4c
Bump libuv to v1.48.0 2024-09-06 18:52:43 +00:00
Robert Schulze
ac6eb1c520
Bump libuv to 1.47.0 2024-09-06 18:51:23 +00:00
Robert Schulze
22f1d9752e
Bump libuv to 1.46.0 2024-09-06 18:51:20 +00:00
Robert Schulze
cc2467542b
Bump libuv to 1.45.0 2024-09-06 18:50:08 +00:00
Robert Schulze
fb3de3451c
Make a clean start with v1.44.2 2024-09-06 18:49:35 +00:00
Igor Nikonov
fe5c0e127f
Merge pull request #69264 from ClickHouse/fix-pr-not-ready-set
Fix: Not-ready Set with parallel replicas
2024-09-06 18:48:02 +00:00
Igor Nikonov
b436057cba Merge remote-tracking branch 'origin/master' into pr-local-plan 2024-09-06 18:46:42 +00:00
Robert Schulze
2bd36997f7
Bump grpc to v1.59.5
CVE-2024-7246
2024-09-06 18:36:32 +00:00
Robert Schulze
02c9d33cfb
Merge pull request #69321 from rschu1ze/bump-curl
Bump curl to v8.9.1
2024-09-06 18:31:31 +00:00
Robert Schulze
52024b7af3
Bump openssl to 3.2.3 2024-09-06 17:51:03 +00:00
Robert Schulze
4bd66f4187
Add test 2024-09-06 17:31:20 +00:00
robot-clickhouse
28367f1792
Merge pull request #69340 from ClickHouse/auto/v24.8.4.13-lts
Update version_date.tsv and changelog after v24.8.4.13-lts
2024-09-06 17:26:36 +00:00
Robert Schulze
fdf8ff0e66
Don't forget to call ucasemap_close for every ucasemap_open 2024-09-06 17:25:14 +00:00
Robert Schulze
86842766e4
Bump OpenSSL to 3.2.2 2024-09-06 16:59:14 +00:00
Mikhail Artemenko
3431e2ec4a add dest to aspell ignore 2024-09-06 16:52:31 +00:00
robot-clickhouse
8be745e8c2 Update version_date.tsv and changelogs after v24.8.4.13-lts 2024-09-06 16:43:55 +00:00
robot-clickhouse
82fd9bab4e
Merge pull request #69337 from ClickHouse/auto/v24.7.6.8-stable
Update version_date.tsv and changelog after v24.7.6.8-stable
2024-09-06 16:39:49 +00:00
Robert Schulze
11fae9f321
Bump libarchive to v3.7.1 2024-09-06 16:37:42 +00:00
Michael Stetsyuk
8544718d32 initialize max_log_ptr_at_creation on attach 2024-09-06 16:31:39 +00:00
Mikhail Artemenko
9d07d002f1 update keeper client docs 2024-09-06 16:20:30 +00:00
Robert Schulze
a73eb1c177
Merge pull request #67013 from JackyWoo/add_statistics_minmax
Add `min_max` statistics type
2024-09-06 16:14:04 +00:00
robot-clickhouse
4c9713717f Update version_date.tsv and changelogs after v24.7.6.8-stable 2024-09-06 16:10:11 +00:00
robot-clickhouse
4baf0b2ed4
Merge pull request #69335 from ClickHouse/auto/v24.6.6.6-stable
Update version_date.tsv and changelog after v24.6.6.6-stable
2024-09-06 16:08:22 +00:00
Nikolai Kochetov
ee304c7fc3 Fix tidy 2024-09-06 16:02:47 +00:00
Michael Stetsyuk
06632b9bcd fxs 2024-09-06 15:58:46 +00:00
Yarik Briukhovetskyi
70cee20bf4
Merge branch 'ClickHouse:master' into time_buckets_impl 2024-09-06 17:57:47 +02:00
robot-clickhouse
4665867400 Update version_date.tsv and changelogs after v24.6.6.6-stable 2024-09-06 15:39:40 +00:00
robot-clickhouse
3946dbd883
Merge pull request #69333 from ClickHouse/auto/v24.5.8.10-stable
Update version_date.tsv and changelog after v24.5.8.10-stable
2024-09-06 15:36:25 +00:00
Robert Schulze
b430e27a50
Add CITATION.cff 2024-09-06 15:33:53 +00:00
robot-clickhouse
9b87f2e6d4 Update version_date.tsv and changelogs after v24.5.8.10-stable 2024-09-06 15:10:13 +00:00
Antonio Andelic
86f11e221e Speed up more tests 2024-09-06 17:08:35 +02:00
robot-clickhouse
bf9bf317e2
Merge pull request #69330 from ClickHouse/auto/v24.3.11.7-lts
Update version_date.tsv and changelog after v24.3.11.7-lts
2024-09-06 15:06:59 +00:00
Nikita Mikhaylov
92bdafa19e
Merge pull request #69322 from ClickHouse/disable-long-tests
Disable long tests with sanitizers
2024-09-06 15:02:03 +00:00
Kseniia Sumarokova
0c18c38cac
Merge branch 'master' into fix-segfault-deltalake 2024-09-06 16:57:32 +02:00
robot-clickhouse
dea714d169 Update version_date.tsv and changelogs after v24.3.11.7-lts 2024-09-06 14:25:02 +00:00
Antonio Andelic
03c7f3817b Correct lock order 2024-09-06 15:41:04 +02:00
Mikhail Artemenko
81972b97e7 support test keeper 2024-09-06 13:23:57 +00:00
Robert Schulze
84a5c88b50
Minor follow-up to #66933 2024-09-06 12:39:05 +00:00
Antonio Andelic
06507190d4 Speed up some Kafka tests with multiprocessing 2024-09-06 14:29:26 +02:00
Mikhail Artemenko
068ada57ba update api 2024-09-06 12:23:57 +00:00
Robert Schulze
b3f4f3459b
Bump curl to v8.9.1 2024-09-06 12:03:53 +00:00
Robert Schulze
1b6fa8ef53
Bump curl to v8.9.0 2024-09-06 12:03:08 +00:00
Robert Schulze
66bd32bd18
Bump curl to v8.8.0 2024-09-06 12:02:29 +00:00
Alexander Tokmakov
238c9b5789
Update 01153_attach_mv_uuid.sql 2024-09-06 13:51:06 +02:00
Nikita Mikhaylov
fde9f23829 Disable long tests with sanitizers 2024-09-06 13:48:20 +02:00
vdimir
1b71ad26ee
Merge pull request #69186 from ClickHouse/vdimir/client-context-race2
Fix possible timeouts in `sh` tests with tsan, att. 2
2024-09-06 11:09:24 +00:00
JackyWoo
3974e9060a Fix docs and some fixups 2024-09-06 18:50:02 +08:00
Nikolai Kochetov
fdbf8e71ab Stable explain 2024-09-06 10:30:09 +00:00
Robert Schulze
8c9cf37858
Merge pull request #69090 from ucasfl/fix-vector-index
Fix bug that vector similarity index does not work for cosine distance
2024-09-06 10:24:46 +00:00
Robert Schulze
d9d83fd56b
Merge pull request #69065 from ucasfl/vector-index
Disable alter table add vector similarity index if setting does not enabled
2024-09-06 10:11:38 +00:00
Alexander Tokmakov
e2a7a1f662
Update StackTrace.cpp 2024-09-06 12:08:14 +02:00
Yarik Briukhovetskyi
eb540da247
Merge branch 'ClickHouse:master' into time_buckets_impl 2024-09-06 11:56:22 +02:00
Mikhail Artemenko
cf0e0b766d add test for watches 2024-09-06 09:34:26 +00:00
Mikhail Artemenko
2bbe933531 fix watches logic 2024-09-06 09:33:47 +00:00
robot-clickhouse
b3b8abb413 Automatic style fix 2024-09-06 09:13:48 +00:00
Igor Nikonov
2de3a6175a Merge remote-tracking branch 'origin/master' into fix-pr-not-ready-set 2024-09-06 08:36:04 +00:00
Igor Nikonov
2ace0c55eb Increase timeout for intergration test tsan job 2024-09-06 08:35:39 +00:00
Mikhail Artemenko
231a7c97cc move code 2024-09-06 08:34:59 +00:00
Antonio Andelic
a348993d6a
Merge pull request #69013 from shiyer7474/fix_integ_tests
Fix test_role & test_keeper_s3_snapshot integration tests
2024-09-06 07:55:02 +00:00
Antonio Andelic
f44eaa808d Merge branch 'master' into keeper-some-improvement2 2024-09-06 09:35:56 +02:00
Antonio Andelic
e388f6f99b Remove useless log 2024-09-06 09:35:02 +02:00
kevinyhzou
02e129f0d1 modify test 2024-09-06 10:15:43 +08:00
Konstantin Bogdanov
0c9ed351ef
Merge pull request #68900 from ClickHouse/add-ip6tables-to-ci-helper
ci: add IPv6 support to `NetworkManager`
2024-09-06 02:00:02 +00:00
kevinyhzou
f8b6025e07 rename to allow_experimental_join_right_table_sorting and modify comments 2024-09-06 09:43:32 +08:00
Mikhail Artemenko
aa2721f7e4 update tests 2024-09-06 00:09:46 +00:00
Mikhail Artemenko
cb1c11c74a change traverse 2024-09-06 00:08:08 +00:00
avogar
ff86b1872f Remove extra files 2024-09-05 23:38:31 +00:00
avogar
f22876302e Mark Dynamic type as not safe primary key type to avoid issues with Fields 2024-09-05 23:37:29 +00:00
Nikita Mikhaylov
2f668a0d5d
Merge pull request #69299 from ClickHouse/tavplubix-patch-10
Don't run 01287_max_execution_speed with slow builds
2024-09-05 23:21:25 +00:00
Konstantin Bogdanov
4ad2b04702
Merge pull request #69289 from cwurm/docs_clarify_lightweight_delete_v2
Docs: Add info on lightweight_deletes_sync
2024-09-05 23:03:34 +00:00
Konstantin Bogdanov
a463b2b44c
Poke CI 2024-09-06 00:22:56 +02:00
robot-clickhouse
798f4b4c3b
Automatic style fix 2024-09-06 00:22:56 +02:00
Konstantin Bogdanov
da3a7d0691
Setup missing ip6tables chain 2024-09-06 00:22:55 +02:00
Konstantin Bogdanov
26add45c70
Poke CI 2024-09-06 00:22:54 +02:00
Konstantin Bogdanov
1f5eb2cd2c
Set IPv6 instance to the node object 2024-09-06 00:22:54 +02:00
Konstantin Bogdanov
58b84e9e3d
Update network.py 2024-09-06 00:22:53 +02:00
Konstantin Bogdanov
d46065360b
Fix 2024-09-06 00:22:52 +02:00
Konstantin Bogdanov
335ca75174
Lint 2024-09-06 00:22:51 +02:00
Konstantin Bogdanov
9be79614a3
Fix 2024-09-06 00:22:50 +02:00
Konstantin Bogdanov
5ee5c8224e
Fix 2024-09-06 00:22:50 +02:00
Konstantin Bogdanov
d49d413c8d
No legacy 2024-09-06 00:22:49 +02:00
Konstantin Bogdanov
fe42299928
Typo 2024-09-06 00:22:48 +02:00
Konstantin Bogdanov
cedddf6fa4
PoC 2024-09-06 00:22:46 +02:00
Pablo Marcos
dde915681c
Merge pull request #69297 from pamarcos/tryresult-logical-error-trace
Improve logical error trace for TryResult
2024-09-05 20:14:47 +00:00
Alexander Gololobov
2df5edc1c1 Merge branch 'master' of github.com:ClickHouse/ClickHouse into query_plan_for_merge 2024-09-05 20:58:47 +02:00
Igor Nikonov
a2cfe62a67
Merge branch 'master' into fix-pr-not-ready-set 2024-09-05 20:40:13 +02:00
Yarik Briukhovetskyi
e799adc618
Merge branch 'ClickHouse:master' into time_buckets_impl 2024-09-05 19:57:53 +02:00
Alexander Tokmakov
c6f0e29eca
Update StackTrace.cpp 2024-09-05 18:36:13 +02:00
kssenii
364ad4315b Add checks agains segfault in DeltaLakeMetadata 2024-09-05 18:20:46 +02:00
Mikhail Artemenko
c3cc2a3fb1 intro new request type 2024-09-05 16:14:50 +00:00
Miсhael Stetsyuk
c9aedee24f
Merge branch 'master' into fix-metadata-version-in-zookeeper 2024-09-05 16:52:56 +01:00
Michael Stetsyuk
32cfdc98b2 fix metadata_version in keeper 2024-09-05 15:51:37 +00:00
Kseniia Sumarokova
92507d9938
Update nats.md 2024-09-05 17:10:12 +02:00
Kseniia Sumarokova
6170c15c90
Merge branch 'master' into minor 2024-09-05 17:08:30 +02:00
Christoph Wurm
5e0673d207 Remove version note 2024-09-05 16:07:33 +01:00
Nikolai Kochetov
d23145fd19
Update emptyArrayToSingle.h 2024-09-05 16:59:14 +02:00
Alexander Tokmakov
b6572e36b4
Merge pull request #61987 from allmazz/feat/59376
support ATTACH PARTITION `ALL` FROM `TABLE`
2024-09-05 14:57:38 +00:00
Alexey Olshanskiy
d17b20705a
Add char escaping to docker's entrypoint 2024-09-05 17:55:56 +03:00
Pablo Marcos
0996ed5246 Create a deep copy of Settings to ensure they don't change 2024-09-05 14:53:14 +00:00
Nikolai Kochetov
fb8999a885 Remove commented code. 2024-09-05 14:44:51 +00:00
Nikolai Kochetov
03ac70f988 Fising build. 2024-09-05 14:41:06 +00:00
Alexander Tokmakov
6621365526
Update 01287_max_execution_speed.sql 2024-09-05 16:40:44 +02:00
Nikolai Kochetov
5f5acd3c44 Refactor ArrayJoin step. 2024-09-05 14:34:30 +00:00
Igor Nikonov
536e0808e3
Merge branch 'master' into pr-local-plan 2024-09-05 16:19:47 +02:00
Pablo Marcos
18a6b970eb Improve logical error trace
This will provide meaningful information whenever
the issue happens again.
2024-09-05 13:58:26 +00:00
shiyer7474
4d87e349a0 Python formatting 2024-09-05 13:57:46 +00:00
Anton Popov
27d81fd357
Merge pull request #69256 from CurtizJ/fix-drop-cache-transactions
Fix dropping of file cache in CHECK query in case of enabled transactions
2024-09-05 13:55:30 +00:00
Alexander Tokmakov
df3c5c9791
Update 00609_mv_index_in_in.sql 2024-09-05 15:51:03 +02:00
Igor Nikonov
3dcf87a804
Merge branch 'master' into fix-pr-not-ready-set 2024-09-05 15:32:24 +02:00
Mikhail f. Shiryaev
94a62b1df2
Merge pull request #69260 from ClickHouse/make-worker-private
Make infrastructure related scripts private
2024-09-05 12:49:30 +00:00
Christoph Wurm
57f80473cc Docs: Add info on lightweight_deletes_sync 2024-09-05 13:42:09 +01:00
Nikita Mikhaylov
2b0fe084ae
Merge pull request #69277 from den-crane/patch-73
Doc. Remove a misleading statement
2024-09-05 12:01:44 +00:00
Michael Stetsyuk
a991a58766 rm test_database_creation_idempotency 2024-09-05 11:58:05 +00:00
Alexander Gololobov
20eaecc4f3
Fix build 2024-09-05 13:50:26 +02:00
shiyer7474
ef177d2c9f Proper cleanup & restart for subsequent iterations 2024-09-05 11:37:57 +00:00
Alexander Gololobov
e1b2952a60
Merge branch 'master' into query_plan_for_merge 2024-09-05 13:32:12 +02:00
Daniil Ivanik
6c52c3d015
Merge pull request #69285 from cwurm/docs_clarify_lightweight_delete
Clarify timing of lightweight delete
2024-09-05 11:22:32 +00:00
Mikhail Artemenko
6455e1dfa1 add ephemerals check 2024-09-05 11:14:43 +00:00
Mikhail Artemenko
ae512fe533 add test for single delete 2024-09-05 11:05:23 +00:00
Mikhail Artemenko
5180e58dca fix collector 2024-09-05 11:01:37 +00:00
Anton Popov
cf022d3a6d
Merge pull request #65832 from CurtizJ/add-mutations-snapshot
Improved getting of alter conversions for queries
2024-09-05 10:37:00 +00:00
Yarik Briukhovetskyi
ab378a0a46
Merge branch 'ClickHouse:master' into time_buckets_impl 2024-09-05 11:36:28 +02:00
Robert Schulze
ddd1f537cb
Merge pull request #69241 from rschu1ze/ann-subquery
Add testcase for ANN index usage with subquery
2024-09-05 09:33:40 +00:00
Christoph Wurm
35748dffb2 Clarify lightweight delete. 2024-09-05 10:31:14 +01:00
avogar
b4ef10ad1c Make better 2024-09-05 08:52:22 +00:00
Anton Popov
10d2631ec9
Merge pull request #69030 from bigo-sg/improve_array_zip
Add new function arrayZipUnaligned
2024-09-05 08:05:56 +00:00
JackyWoo
431a917cda Merge branch 'master' into add_statistics_minmax 2024-09-05 15:12:00 +08:00
Julia Kartseva
39d4a7bf1e
Merge pull request #69237 from jkartseva/fix-infile-format-async-insert
Fix `INFILE` format detection for async inserts
2024-09-05 02:19:16 +00:00
kevinyhzou
d14e03abad fix tests incompatible and add new test example 2024-09-05 09:54:27 +08:00
Denny Crane
ec8d0f94fe
Update index.md 2024-09-04 20:56:16 -03:00
Nikolay Degterinsky
d1f551e8c9
Merge pull request #69271 from ClickHouse/evillique-patch-2
Minor improvements for Lemmatizers
2024-09-04 23:33:42 +00:00
Michael Kolupaev
14cb96722a
Merge pull request #68313 from ClickHouse/musysroot
Update musl to 1.2.5 with unwind info
2024-09-04 23:18:09 +00:00
Mikhail Artemenko
c6777af485 add remove recursive support 2024-09-04 22:59:18 +00:00
János Benjamin Antal
e1b29eae17
Merge pull request #69268 from ClickHouse/revert-69076-create_as
Revert "CREATE TABLE AS copy PRIMARY KEY, ORDER BY, and similar clauses."
2024-09-04 21:09:20 +00:00
Yarik Briukhovetskyi
c997593e61
Merge branch 'ClickHouse:master' into time_buckets_impl 2024-09-04 23:08:57 +02:00
Julia Kartseva
19b33e87eb fix test 2024-09-04 19:44:57 +00:00
Nikita Mikhaylov
b8b8421102
Merge pull request #69255 from Algunenano/01114_database_atomic_timeouts
01114_database_atomic: Increase time frames to reduce flakiness
2024-09-04 19:44:57 +00:00
Yatsishin Ilya
ef2dd93418 crazy stuff 2024-09-04 19:43:39 +00:00
Alexander Tokmakov
6eef6a7759 fix 2024-09-04 21:43:36 +02:00
Igor Nikonov
a37b345694
Merge branch 'master' into fix-pr-not-ready-set 2024-09-04 21:36:37 +02:00
avogar
b7b88737ad Treat dynamic/object structure streams as dynamic 2024-09-04 18:37:33 +00:00
avogar
0dad8b088a Fix typo 2024-09-04 18:35:10 +00:00
avogar
68a8b5a3a1 Better 2024-09-04 18:22:20 +00:00
Nikolay Degterinsky
91447fabf7
Fix style 2024-09-04 20:17:59 +02:00
Nikolay Degterinsky
89ca1c0759
Update Lemmatizers.cpp 2024-09-04 20:08:27 +02:00
János Benjamin Antal
9b9db40a0b
Merge pull request #68935 from ClickHouse/fix-mutation-commands-parse-with-modify-column
Fix mutation commands parsing with modify column
2024-09-04 17:37:44 +00:00
Nikolay Degterinsky
c10455ca03
Minor improvements for Lemmatizers 2024-09-04 19:36:16 +02:00
avogar
4b322ee3c5 Reduce memory usage of inserts to JSON by using adaptive write buffer size 2024-09-04 17:12:17 +00:00
János Benjamin Antal
4634b83ab5
Revert "CREATE TABLE AS copy PRIMARY KEY, ORDER BY, and similar clauses." 2024-09-04 18:44:35 +02:00
Alexander Tokmakov
35ab639d1a fix 2024-09-04 18:38:32 +02:00
Alexander Tokmakov
d948de53c6
Merge pull request #68584 from baolinhuang/covered_by_broken_duplicate
Avoid detached covered-by-broken part duplicates
2024-09-04 16:06:42 +00:00
Alexander Tokmakov
d2ae779368
Update 00626_replace_partition_from_table_zookeeper.sh 2024-09-04 17:18:16 +02:00
Igor Nikonov
5709dc585f Fix: Not-ready Set with parallel replicas 2024-09-04 15:09:21 +00:00
Yarik Briukhovetskyi
018a62777b
small fixes for Date32 2024-09-04 16:56:07 +02:00
Yarik Briukhovetskyi
6acb5ab5a1
add Date32 support 2024-09-04 15:52:23 +02:00
Max K.
708d5bbc2d
Merge pull request #69257 from ClickHouse/ci_stress_to_func_runners
CI: Merge stress and func runners type
2024-09-04 13:32:58 +00:00
vdimir
d38551a178
resetOutput 2024-09-04 13:29:45 +00:00
Mikhail f. Shiryaev
63931be6a0
Make infrastructure related scripts private 2024-09-04 15:28:35 +02:00
shiyer7474
51464be3e1 Set use_cluster=false 2024-09-04 13:26:09 +00:00
Antonio Andelic
a3e233a537 Fix watch 2024-09-04 15:19:56 +02:00
taiyang-li
4bd9e10ce4 Merge branch 'improve_array_zip' of https://github.com/bigo-sg/ClickHouse into improve_array_zip 2024-09-04 21:11:11 +08:00
taiyang-li
fd05f30ee1 change as request 2024-09-04 21:10:32 +08:00
Yarik Briukhovetskyi
f497fde2ca
fix templates 2024-09-04 15:08:12 +02:00
Yarik Briukhovetskyi
945c930322
fix build 2024-09-04 14:53:19 +02:00
Mikhail f. Shiryaev
938b5ba0ed
Merge pull request #69252 from Algunenano/backport_pr
Backports should read tags from its repo only
2024-09-04 12:43:58 +00:00
Yarik Briukhovetskyi
e16c85d94f
fix suggestions 2024-09-04 14:32:57 +02:00
Max Kainov
ea7cff43f6 CI: Merge stress and func runners type 2024-09-04 14:21:44 +02:00
Anton Popov
10d19b47b7 fix dropping of file cache in CHECK query in case of enabled transactions 2024-09-04 12:18:44 +00:00
Raúl Marín
404aea55a9 01114_database_atomic: Increase time frames to reduce flakiness 2024-09-04 14:09:45 +02:00
Yatsishin Ilya
dff153b59e Null supports no settings 2024-09-04 11:48:22 +00:00
Anton Popov
6042637e67 fix clang-tidy 2024-09-04 11:36:16 +00:00
Raúl Marín
3807bea354 Backports should read tags from its repo only 2024-09-04 13:28:04 +02:00
Kruglov Pavel
54c6aa957d
Merge pull request #67150 from Avogar/dynamic-cast-or-default
Improve castOrDefault from Variant/Dynamic columns
2024-09-04 11:27:35 +00:00
Kruglov Pavel
10893d3ea8
Merge pull request #69109 from Avogar/csv-bool-from-string
Don't infer Bool type from String in CSV when input_format_csv_try_infer_numbers_from_strings = 1
2024-09-04 11:27:21 +00:00
avogar
f926a0fff7 Fix tidy build 2024-09-04 11:25:22 +00:00
Igor Nikonov
3898f52868 Merge remote-tracking branch 'origin/master' into pr-local-plan 2024-09-04 11:15:54 +00:00
Nikita Mikhaylov
6fbeca5cb8
Merge pull request #69204 from ClickHouse/vdimir/cleint-log-sanitizer-reports
Collect sanitizer report from client to `client_log`
2024-09-04 10:44:40 +00:00
alesapin
e695814e1f
Merge pull request #69190 from ClickHouse/fix_flaky_move_partition
Fix flaky 02915_move_partition_inactive_replica
2024-09-04 10:40:32 +00:00
Nikita Mikhaylov
73bbc16250
Update tests/queries/0_stateless/03233_async_insert_infile_format.sh
Co-authored-by: vdimir <vdimir@clickhouse.com>
2024-09-04 12:39:15 +02:00
Mikhail Artemenko
6c57adee7c add remove recursive entry point 2024-09-04 10:38:03 +00:00
Igor Nikonov
042dbea094
Merge pull request #69146 from ClickHouse/pr-duplicate-announcement
Fix: parallel replicas duplicate announcement request
2024-09-04 10:27:20 +00:00
Igor Nikonov
4dc8159b43
Merge pull request #69202 from ClickHouse/pr-incorrect-reverse-order
Test for parallel replicas, reverse in order reading mode
2024-09-04 10:27:04 +00:00
Robert Schulze
7a98f7fecc
Add testcase for ANN index usage with subquery 2024-09-04 10:21:19 +00:00
Yarik Briukhovetskyi
54bdd392ee
fix build 2024-09-04 11:50:09 +02:00
Robert Schulze
6f03c51368
Update 2024-09-04 09:40:45 +00:00
Robert Schulze
1c6e960719
Sort 2024-09-04 09:35:06 +00:00
Robert Schulze
e047c7c419
Update sources 2024-09-04 09:33:26 +00:00
Robert Schulze
e28066645b
Sort 2024-09-04 09:31:06 +00:00
Antonio Andelic
955412888c Merge branch 'master' into keeper-some-improvement2 2024-09-04 11:30:29 +02:00
Antonio Andelic
9633563fbd Fix 2024-09-04 11:30:05 +02:00
Yarik Briukhovetskyi
efdef8c186
fix build 2024-09-04 11:18:55 +02:00
Robert Schulze
2620325b30
Minor fixups + add a tests 2024-09-04 09:00:56 +00:00
Robert Schulze
c5df9f13bf
Merge remote-tracking branch 'ClickHouse/master' into fix-vector-index 2024-09-04 08:50:53 +00:00
kevinyhzou
49548ed4d5 update the description 2024-09-04 16:40:46 +08:00
Robert Schulze
0b1a0999e3
Some fixups 2024-09-04 08:40:07 +00:00
Max K.
a3e5a3cd10
Merge pull request #69181 from ClickHouse/ci_rerun_check_rollback
CI: Rerun check: do not check if manual rerun
2024-09-04 08:29:54 +00:00
kevinyhzou
dbf6e6c85e review fix 2024-09-04 16:05:13 +08:00
Michael Kolupaev
ac861768bc Final submodule commit 2024-09-04 07:53:41 +00:00
Robert Schulze
0957075a94
Merge remote-tracking branch 'ClickHouse/master' into vector-index 2024-09-04 07:51:29 +00:00
Antonio Andelic
a5d7298446
Merge pull request #69199 from ClickHouse/fix-jepsen-aarch64
Fix jepsen for aarch64
2024-09-04 07:48:40 +00:00
Michael Kolupaev
e6af5d611d
Merge pull request #69234 from ClickHouse/memprog
Fix progress bar when reading from Memory tables
2024-09-04 07:45:25 +00:00
János Benjamin Antal
26cb783e6f Remove unnecessary nullptr check 2024-09-04 07:44:07 +00:00
János Benjamin Antal
fb19005968 Remove more queries that fail client side parsing 2024-09-04 07:39:41 +00:00
Julia Kartseva
7e03621a40 Fix INFILE file format detection for async inserts 2024-09-04 05:45:56 +00:00
Michael Kolupaev
bd0a07f199 Merge remote-tracking branch 'origin/master' into musysroot 2024-09-03 23:14:04 +00:00
Alexander Tokmakov
239cdf908b
Update src/Storages/MergeTree/MergeTreeData.cpp 2024-09-03 23:35:11 +02:00
Yarik Briukhovetskyi
de0e608919
Merge branch 'master' into time_buckets_impl 2024-09-03 23:24:14 +02:00
Alexander Tokmakov
a5a16aa7fa Merge branch 'master' into break_compatibility 2024-09-03 23:13:59 +02:00
Michael Kolupaev
7caacb7c0c Fix progress bar when reading from Memory tables 2024-09-03 20:57:36 +00:00
Igor Nikonov
fc1228e3a4 Update settings history 2024-09-03 20:45:43 +00:00
Igor Nikonov
8629f7e592
Merge branch 'master' into pr-local-plan 2024-09-03 22:43:20 +02:00
Igor Nikonov
ab317fb3ec
Merge branch 'master' into pr-duplicate-announcement 2024-09-03 21:55:17 +02:00
Igor Nikonov
6debeafe2e Fix 2024-09-03 19:43:27 +00:00
Nikita Mikhaylov
592910d538
Merge pull request #69205 from ClickHouse/fix-flaky-get-dictionary-test
Fix flaky 00157_cache_dictionary
2024-09-03 19:26:42 +00:00
Arthur Passos
d9a4964cd9 Merge branch 'master' into multi_auth_methods 2024-09-03 15:01:59 -03:00
Yarik Briukhovetskyi
4fad12ecb0
rewrite the main logic 2024-09-03 19:53:28 +02:00
Kruglov Pavel
17baa4f51b
Merge pull request #68463 from Avogar/dynamic-json-distinct-aggregate-functions
Add aggregate functions distinctDynamicTypes/distinctJSONPaths/distinctJSONPathsAndTypes
2024-09-03 17:51:51 +00:00
Michael Stetsyuk
ecfe9d9782 make replicated database creation operations idempotent 2024-09-03 17:39:36 +00:00
Igor Nikonov
e94531d5b9 Merge remote-tracking branch 'origin/master' into pr-incorrect-reverse-order 2024-09-03 17:24:59 +00:00
Igor Nikonov
5684db7edc Improve the test 2024-09-03 17:24:36 +00:00
Konstantin Bogdanov
dc0b491f11
Merge pull request #69130 from m4xxx1m/hostname-validation-config
Add validation of IP addresses and domains in settings
2024-09-03 17:09:17 +00:00
Ilya Yatsishin
959e8567bb
Merge pull request #68380 from qoega/improve-integration-tests-5
Rework integration test flaky tests runner to split per module as a separate group
2024-09-03 16:38:17 +00:00
alesapin
b7ec3f66e2
Merge pull request #69193 from ClickHouse/disable_memory_test_with_sanitizers
Disable memory test with sanitizer
2024-09-03 16:14:08 +00:00
alesapin
41898bb7d1
Merge pull request #69194 from ClickHouse/disable_perf_test_with_sanitizers
Disable perf-like test with sanitizers
2024-09-03 16:13:30 +00:00
NikBarykin
83854cf293 Make method of DatabaseFactory 2024-09-03 19:13:05 +03:00
robot-clickhouse
8967e6f9b8 Automatic style fix 2024-09-03 16:11:28 +00:00
Igor Nikonov
fa773f177b Polish test 2024-09-03 16:08:13 +00:00
Pablo Marcos
253d099f1c
Merge pull request #69211 from pamarcos/fix-doc-mistake
Fix small doc mistake
2024-09-03 16:07:57 +00:00
NikBarykin
e874c6e1de Fix typo 2024-09-03 18:58:39 +03:00
Raúl Marín
dd6e818c68
Merge pull request #69175 from azat/revert-client-log_comment-file
Revert "Merge pull request #57191 from azat/client-log_comment-file"
2024-09-03 15:47:54 +00:00
Alexander Gololobov
472e6eb856 typo 2024-09-03 17:16:43 +02:00
Pablo Marcos
be5a5353e3
Merge pull request #69207 from ClickHouse/clarify-transactions-doc
Update transactions doc
2024-09-03 15:12:30 +00:00
Konstantin Bogdanov
e50a8b4f61
Merge pull request #68975 from ClickHouse/fix-encoding-with-progress-headers
`Content-Encoding` was not sent on progress
2024-09-03 15:09:00 +00:00
Alexander Gololobov
8361724539 Build pipeline for next column for prefetching 2024-09-03 17:02:25 +02:00
János Benjamin Antal
4a524256eb Make all queries fail by SYNTAX_ERROR exception 2024-09-03 14:58:56 +00:00
Alexander Gololobov
e94a2875de
Merge pull request #68954 from ClickHouse/processors_profile_log_plan_step_name
Add plan_step_name and plan_step_description columns to system.processors_profile_log
2024-09-03 14:53:08 +00:00
alesapin
8ccabe9659
Update 02916_another_move_partition_inactive_replica.sql 2024-09-03 16:39:44 +02:00
alesapin
4a45d53dd9
Update 02915_move_partition_inactive_replica.sql 2024-09-03 16:39:33 +02:00
Pablo Marcos
12f6b83d60
Update transactions doc
Clarify isolation levels when inside/outside of a transaction.
Also fix some weird formatting using hyphen instead of comma or period.
2024-09-03 16:35:11 +02:00
Igor Nikonov
52b9f47977 Fix flaky 00157_cache_dictionary
+ disable paralell replicas on insert to avoid hitting
  `max_estimated_execution_time` setting
2024-09-03 14:18:25 +00:00
vdimir
6f1511c9a2
Collect sanitizer report from client to client_log 2024-09-03 14:17:41 +00:00
Alexander Tokmakov
f9d7080711
Merge pull request #68896 from tuanpach/add-identifier-quoting-style-settings
Add identifier quoting style settings
2024-09-03 13:52:37 +00:00
Igor Nikonov
7b4a38453a Test 03231_pr_reverse_in_order 2024-09-03 13:49:54 +00:00
Antonio Andelic
2ae4cf375b Fix jepsen for aarch64 2024-09-03 15:24:11 +02:00
NikBarykin
03ccf05d14 Allow custom settings in database engine 2024-09-03 16:14:15 +03:00
Alexander Gololobov
a1cec53b7c Fix updateOutputStream and Traits 2024-09-03 14:57:33 +02:00
Alexander Gololobov
6a6935cb84 Cleanup 2024-09-03 14:57:19 +02:00
marco-vb
d6ea08e812 Fixed documentation related to wildcard support. 2024-09-03 12:47:20 +00:00
Anton Popov
34c14a6493
Merge pull request #68837 from CurtizJ/fix-async-insert-alter
Fix async inserts with `ALTER ADD/MODIFY COLUMN`
2024-09-03 12:37:27 +00:00
alesapin
89e42e3814 Disable perf-like test with sanitizers 2024-09-03 14:23:59 +02:00
robot-clickhouse
9822b2f306
Merge pull request #69191 from ClickHouse/auto/v24.8.3.59-lts
Update version_date.tsv and changelog after v24.8.3.59-lts
2024-09-03 12:17:04 +00:00
alesapin
0d30fbb8fb Disable memory test with sanitizer 2024-09-03 14:15:12 +02:00
Han Fei
8bda99c5a6
Merge pull request #69086 from liuneng1994/fix-typo-in-actionsdag
Fix typo in ActionsDag
2024-09-03 11:47:47 +00:00
robot-clickhouse
ff6a781dca Update version_date.tsv and changelogs after v24.8.3.59-lts 2024-09-03 11:37:16 +00:00
Igor Nikonov
51eef72624
Merge branch 'master' into pr-duplicate-announcement 2024-09-03 13:31:44 +02:00
Igor Nikonov
d0d2509c69
Merge branch 'master' into pr-local-plan 2024-09-03 13:31:36 +02:00
Han Fei
1b29a89107 Merge branch 'master' into fix-typo-in-actionsdag 2024-09-03 11:29:19 +00:00
alesapin
ebdd3af16c Fix flaky 02915_move_partition_inactive_replica 2024-09-03 13:24:02 +02:00
alesapin
31a37c7736 Fix flaky 02915_move_partition_inactive_replica 2024-09-03 13:23:18 +02:00
Pablo Marcos
cd1a8c03b1 Fix small doc mistake 2024-09-03 11:10:56 +00:00
vdimir
45556278c9
Fix possible timeouts in sh tests with tsan, att. 2 2024-09-03 11:06:28 +00:00
robot-clickhouse
715a18dc40
Merge pull request #69184 from ClickHouse/auto/v24.6.5.30-stable
Update version_date.tsv and changelog after v24.6.5.30-stable
2024-09-03 10:58:54 +00:00
robot-clickhouse
2e90581908 Update version_date.tsv and changelogs after v24.6.5.30-stable 2024-09-03 10:32:49 +00:00
robot-clickhouse
d112dc8f1d
Merge pull request #69182 from ClickHouse/auto/v24.5.7.31-stable
Update version_date.tsv and changelog after v24.5.7.31-stable
2024-09-03 10:29:22 +00:00
m4xxx1m
99fbeacddd Fix 'file not found' error 2024-09-03 13:28:39 +03:00
Kruglov Pavel
cec5037c4d
Update Configuration.h 2024-09-03 12:05:26 +02:00
robot-clickhouse
237a54be69 Update version_date.tsv and changelogs after v24.5.7.31-stable 2024-09-03 10:05:11 +00:00
robot-clickhouse
60a4d31be5
Merge pull request #69177 from ClickHouse/auto/v24.3.10.33-lts
Update version_date.tsv and changelog after v24.3.10.33-lts
2024-09-03 10:01:54 +00:00
Kruglov Pavel
6273c7ca80
Merge pull request #69150 from Avogar/better-json-alias-check
Don't create Object type if use_json_alias_for_old_object_type=1 but allow_experimental_object_type=0
2024-09-03 09:58:23 +00:00
李扬
5832f982d6
Merge branch 'ClickHouse:master' into improve_array_zip 2024-09-03 17:48:13 +08:00
Max Kainov
214f8a0102 CI: Rerun check: do not check if manual rerun 2024-09-03 11:44:25 +02:00
m4xxx1m
611ae2c013 Use Poco implementation of IP addresses validation 2024-09-03 12:41:39 +03:00
marco-vb
919f51533a Fixed style issues. 2024-09-03 09:37:03 +00:00
Raúl Marín
7ba6eff181
Merge pull request #69148 from Algunenano/rmt_retries
RMT: Do not block retries when establishing a new keeper connection
2024-09-03 09:35:16 +00:00
robot-clickhouse
df5f5049ac Update version_date.tsv and changelogs after v24.3.10.33-lts 2024-09-03 09:19:10 +00:00
Max Kainov
c6b2d81af7 fix flaky check results processing 2024-09-03 10:25:10 +02:00
vdimir
5d3d2c2139
Merge pull request #66926 from ClickHouse/vdimir/multiple_joins_with_storage_join
Analyzer: Storage Join support joining with nullable columns
2024-09-03 06:59:47 +00:00
Alexander Gololobov
d28cba981c Fix clang_tidy 2024-09-03 08:59:01 +02:00
Azat Khuzhin
300d06b995 Revert "Merge pull request #57191 from azat/client-log_comment-file"
The problem with this patch is that it breaks readonly users.

There are possible other ways to fix this, but it has other downsides:
- readonly detection with getSetting - one extra query + code
  complexity, don't think that it worth it
- add is_hint for each setting (like is_important) - this will blow the
  settings structure and requires protocol changes, and even though this
  could be useful in other places, i.e. play UI, not sure that this worth
  either

So for now let's simply revert it.

This reverts commit fde14f0daf, reversing
changes made to f636dea879.
2024-09-03 08:42:14 +02:00
taiyang-li
aaf62aca73 fix uts 2024-09-03 11:59:54 +08:00
Constantine Peresypkin
ca514c6556
fix: Content-Encoding was not sent on progress
fixes: #64802
2024-09-03 02:13:23 +02:00
Konstantin Bogdanov
009cccd20a
Merge pull request #68979 from ClickHouse/put-strange-trash-back
Revert "Fix strange trash"
2024-09-02 22:07:01 +00:00
jsc0218
379d551832
Merge pull request #69076 from sakulali/create_as
CREATE TABLE AS copy PRIMARY KEY, ORDER BY, and similar clauses.
2024-09-02 20:56:58 +00:00
Alexander Gololobov
48cacd6f31 Use query plan for column vertical merges 2024-09-02 22:36:42 +02:00
Alexander Gololobov
13f4eb3fac Fix for graphite merge mode 2024-09-02 22:24:53 +02:00
Alexey Korepanov
ba9c8a1625 Merge branch 'master' into output-format-json-compact-with-progress 2024-09-02 22:22:57 +02:00
avogar
b7e1dda2e0 Remove unneded code 2024-09-02 20:13:44 +00:00
avogar
d281333db2 Better process of object storage arguments 2024-09-02 20:11:00 +00:00
m4xxx1m
37516a4cc2 Add tests 2024-09-02 22:02:24 +03:00
marco-vb
547276780c Removed unnecessary code and restored test certificates. 2024-09-02 17:14:10 +00:00
Alexander Gololobov
7e444136bb Use QueryPlan for horizontal part of merge 2024-09-02 18:27:24 +02:00
Alexander Tokmakov
d65b298268
Update src/Storages/StorageReplicatedMergeTree.cpp 2024-09-02 18:08:46 +02:00
Raúl Marín
fda6a48ff5 Parameterized tests 2024-09-02 18:05:23 +02:00
Anton Popov
8a5454a548 slightly better 2024-09-02 15:41:35 +00:00
Anton Popov
46702f6a1e Merge remote-tracking branch 'upstream/master' into HEAD 2024-09-02 14:52:08 +00:00
Anton Popov
2e4f6f26f0 fix after merge 2024-09-02 14:26:25 +00:00
Anton Popov
71d03f58bb
Merge branch 'master' into fix-async-insert-alter 2024-09-02 16:23:15 +02:00
Sergei Trifonov
1f5082ee8a
Merge pull request #65182 from ClickHouse/s3-streams-scheduler
IO scheduling on HTTP session level
2024-09-02 14:17:58 +00:00
Igor Nikonov
db8ce31bb7 Increase flaky check timeout 2024-09-02 14:08:22 +00:00
Igor Nikonov
d064692125 Merge remote-tracking branch 'origin/master' into pr-local-plan 2024-09-02 14:06:46 +00:00
vdimir
dfe8508a3a
Merge branch 'master' into vdimir/multiple_joins_with_storage_join 2024-09-02 16:05:13 +02:00
vdimir
cfc931160d
Merge branch 'master' into vdimir/fix_function_printf_style 2024-09-02 16:05:02 +02:00
Nikita Mikhaylov
af9291e613
Merge pull request #69099 from ClickHouse/mr-regex
Fix regex for changelog generation script
2024-09-02 13:55:25 +00:00
Antonio Andelic
79fc8d67ad More fixes 2024-09-02 15:46:04 +02:00
Arthur Passos
0bf95655aa add new line 2024-09-02 10:45:37 -03:00
Kruglov Pavel
218e601ef8
Better exception message 2024-09-02 15:35:56 +02:00
Raúl Marín
dbdf54cacf Style 2024-09-02 15:24:35 +02:00
avogar
457db103c0 Don't create Object type if use_json_alias_for_old_object_type=1 but allow_experimental_object_type=0 2024-09-02 13:20:27 +00:00
Igor Nikonov
ab6843e65e One more test 2024-09-02 13:11:45 +00:00
avogar
a3522072d4 Respect format settings in Values format during conversion from expression to the destination type 2024-09-02 13:09:22 +00:00
Arthur Passos
15a67f10dc add cleanup code to existing tests so flaky tests pass.. 2024-09-02 09:59:28 -03:00
Kruglov Pavel
0cb8c9f148
Fix typo 2024-09-02 14:58:09 +02:00
avogar
d7aaf053f9 Fix propogating structure argument in s3Cluster 2024-09-02 12:50:12 +00:00
Raúl Marín
8225acae3a RMT: Do not block retries when establishing a new keeper connection 2024-09-02 14:48:54 +02:00
Raúl Marín
b409c0657d
Merge pull request #68950 from Algunenano/anyHeavy_merge
Fix possible wrong result during anyHeavy state merge
2024-09-02 12:45:19 +00:00
Igor Nikonov
f0fa895e7c Merge remote-tracking branch 'origin/master' into pr-duplicate-announcement 2024-09-02 12:44:04 +00:00
Igor Nikonov
4b4976c9b0 Fix 2024-09-02 12:37:53 +00:00
Sergei Trifonov
64af7363c2
Merge pull request #68674 from filimonov/thread_pool_metrics
Thread pool metrics
2024-09-02 12:19:27 +00:00
Alexey Korepanov
33512a0d6e Merge branch 'master' into output-format-json-compact-with-progress 2024-09-02 13:32:52 +02:00
Igor Nikonov
d1bf8d7bfe Test 03231_pr_duplicate_announcement 2024-09-02 11:06:24 +00:00
avogar
ed2da41a79 Merge branch 'master' of github.com:ClickHouse/ClickHouse into dynamic-json-distinct-aggregate-functions 2024-09-02 10:41:49 +00:00
avogar
3be359bf11 Merge branch 'master' of github.com:ClickHouse/ClickHouse into dynamic-cast-or-default 2024-09-02 10:21:24 +00:00
Kruglov Pavel
a9d79f9d8a
Fix test 2024-09-02 12:19:33 +02:00
Nikita Mikhaylov
1c839ff4b9
Merge pull request #69125 from ClickHouse/Avogar-patch-7
Fix types in JSON docs
2024-09-02 10:13:30 +00:00
Sergei Trifonov
0f4b296295
Merge pull request #69081 from ClickHouse/fix-progress-indication-race
Fix ProgressIndication data race on `cancelQuery()`
2024-09-02 09:58:31 +00:00
Yarik Briukhovetskyi
1b67fde591
Merge pull request #67436 from iceFireser/master
Fix the problem that alter modfiy order by causes inconsistent metadata
2024-09-02 09:54:38 +00:00
alesapin
8d3601f43e
Merge pull request #69034 from Michicosun/issues/68934/cp
cp/mv operations for keeper client
2024-09-02 09:29:23 +00:00
Yarik Briukhovetskyi
f89290cdbf
Merge pull request #68874 from liuneng1994/support-datetrunc-on-date32
Support Date32 on dateTrunc and toStartOfInterval
2024-09-02 09:26:54 +00:00
Yarik Briukhovetskyi
e3c5caf6db
Merge pull request #69055 from Warfields/patch-1
Update parametric-functions.md
2024-09-02 09:09:25 +00:00
Sergei Trifonov
579b891c57
Merge pull request #69132 from ClickHouse/serxa-patch-3
Fix locking in UserDefinedSQLObjectsZooKeeperStorage.cpp
2024-09-02 09:08:33 +00:00
Igor Nikonov
1d1f41521e
Merge branch 'master' into pr-local-plan 2024-09-02 11:07:07 +02:00
Yarik Briukhovetskyi
a1747493ac
Merge pull request #69066 from yariks5s/sandbox_
Path normalization in StorageFile
2024-09-02 08:27:41 +00:00
Igor Nikonov
11c6ba15fb
Merge pull request #69124 from ClickHouse/lift-up-union-expr-desc
Fix: expression description in plan after lift up union optimization
2024-09-02 08:25:21 +00:00
János Benjamin Antal
64d463bb09 Merge remote-tracking branch 'origin/master' into fix-mutation-commands-parse-with-modify-column 2024-09-02 07:50:57 +00:00
Antonio Andelic
596ba574e3 Merge branch 'master' into keeper-some-improvement2 2024-09-02 09:31:02 +02:00
Antonio Andelic
e968984d17 More changes 2024-09-02 08:25:17 +02:00
taiyang-li
bd0ddf85eb fix style 2024-09-02 14:16:20 +08:00
taiyang-li
450730cef8 fix failed uts 2024-09-02 12:16:41 +08:00
taiyang-li
1cd4af1564 add new function arrayZipUnaligned 2024-09-02 11:55:41 +08:00
flynn
f9538bbe49 Merge branch 'master' of github.com:ClickHouse/ClickHouse into fix-vector-index 2024-09-02 03:34:22 +00:00
shiyer7474
4f16797cd1 Formatting 2024-09-02 00:35:59 +00:00
Sergei Trifonov
fba6620dc4
Fix locking in UserDefinedSQLObjectsZooKeeperStorage.cpp 2024-09-01 23:43:05 +02:00
Igor Nikonov
37a9ff451e
Merge branch 'master' into lift-up-union-expr-desc 2024-09-01 17:51:09 +02:00
shiyer7474
81d0a04ecb Added restart of node1 for running multiple iterations of test 2024-09-01 13:53:56 +00:00
m4xxx1m
6fd7656aeb Added Poco::Util::AbstractConfiguration::getHost method 2024-09-01 12:36:36 +03:00
iceFireser
79776dbbad
Merge branch 'ClickHouse:master' into master 2024-09-01 09:34:25 +08:00
Yakov Olkhovskiy
44f76ed713
Merge pull request #69123 from wxybear/fix_explain_insert_query_multiquery_mode
Fix analyze explain ast insert query in multiquery mode
2024-08-31 21:07:43 +00:00
Yakov Olkhovskiy
b6ea3442b4
Merge pull request #69032 from alexon1234/include_real_time_execution_in_http_header
Add RealTimeMicroseconds to HTTP Header X-ClickHouse-Summary
2024-08-31 20:47:23 +00:00
Michael Kolupaev
e955b2fc71 Merge remote-tracking branch 'origin/master' into musysroot 2024-08-31 19:48:19 +00:00
wxybear
b066760a21 fix: explainedQuery nullptr && 02504_explain_ast_insert 2024-08-31 22:18:33 +08:00
Nikita Mikhaylov
0076084f9a
Merge pull request #69121 from ilejn/compose_subnet
Fix subnet in docker_compose_net.yml
2024-08-31 13:11:32 +00:00
Kruglov Pavel
0857a10fc1
Fix types in JSON docs 2024-08-31 14:17:24 +02:00
serxa
c6aa12feae Merge branch 'master' into s3-streams-scheduler 2024-08-31 12:13:38 +00:00
Igor Nikonov
425a93e360 Fix 2024-08-31 12:12:32 +00:00
serxa
34d8a20307 Merge branch 'master' into fix-progress-indication-race 2024-08-31 12:12:23 +00:00
Igor Nikonov
a6145e5099 Fix: expression description in plan after lift up unioin optimization 2024-08-31 12:09:02 +00:00
avogar
2287f280da Merge branch 'master' of github.com:ClickHouse/ClickHouse into dynamic-json-distinct-aggregate-functions 2024-08-31 11:36:23 +00:00
wxybear
5ef1830f55 feat: add explain ast insert queries test 2024-08-31 18:39:01 +08:00
sakulali
199aaff711 Kindly ping CI and try to reproduce failed CI tests 2024-08-31 18:13:07 +08:00
wxybear
c702d2581e fix: handle insert query in explain queries in multiquery mode 2024-08-31 14:50:35 +08:00
Igor Nikonov
bfa27d6650 Fix 02500_remove_redundant_distinct 2024-08-31 06:11:50 +00:00
liuneng
cd1685d409 fix error message 2024-08-31 10:49:50 +08:00
liuneng
5e0000c4ca add test case and doc 2024-08-31 10:49:50 +08:00
liuneng
74f99d1f07 support datetrunc and toStartOfxxx on date32 2024-08-31 10:49:50 +08:00
Nikita Mikhaylov
3ffb965b23
Fix gateway 2024-08-31 02:02:15 +02:00
Ilya Golshtein
a031ec7452 compose_subnet: dns tests passed 2024-08-30 22:02:17 +00:00
Igor Nikonov
81b8f8594c Fix tests 2024-08-30 21:23:07 +00:00
Igor Nikonov
5b4b08b711 Merge remote-tracking branch 'origin/master' into pr-local-plan 2024-08-30 20:06:03 +00:00
Igor Nikonov
3c29f27dd2 Fix 03228_pr_subquery_view_order_by 2024-08-30 20:04:43 +00:00
Arthur Passos
a22f9fd91f Merge branch 'master' into multi_auth_methods 2024-08-30 16:59:40 -03:00
serxa
9f96d18060 cleanup 2024-08-30 19:33:34 +00:00
serxa
3675e83a3f Fix data race in ResourceGuard 2024-08-30 19:27:26 +00:00
serxa
30dd82324a revert wrong data race fix 2024-08-30 19:26:59 +00:00
Yarik Briukhovetskyi
e7f403a27e
Merge pull request #68823 from yariks5s/remove_integration_test_datetime
Convert integration test `test_incorrect_datetime_format` to stateless
2024-08-30 16:35:44 +00:00
Yakov Olkhovskiy
950ca28f53
Merge pull request #67805 from sunny19930321/feature/add-delete-from-in-partition-command
Lightweight Delete In Partition
2024-08-30 15:44:46 +00:00
Han Fei
a812cc0809
Merge pull request #69080 from hanfei1991/hanfei/fix-logical-error-async-insert-dup-offsets
fix logical error for empty async inserts
2024-08-30 15:41:25 +00:00
avogar
cf87893758 Don't infer Bool type from String in CSV when input_format_csv_try_infer_numbers_from_strings=1 2024-08-30 15:28:53 +00:00
Mikhail Artemenko
edd5817d1e Merge branch 'master' into issues/68934/cp 2024-08-30 14:43:36 +00:00
Arthur Passos
7c766e7458 split tests again and randomize user name to be able to parallel 2024-08-30 11:41:44 -03:00
Nikita Mikhaylov
0238534358
Merge pull request #68984 from ClickHouse/slowenc
no-tsan in 02735_parquet_encoder
2024-08-30 14:13:39 +00:00
Nikita Mikhaylov
cbf8271254 Better 2024-08-30 15:45:51 +02:00
Sergei Trifonov
f59ed02acb
Merge pull request #68956 from Blargian/docs_toBool
[Docs] add `toBool` to docs
2024-08-30 13:11:50 +00:00
Alejandro
91b345714d Revert enabling the legacy analyzer 2024-08-30 13:16:31 +01:00
Raúl Marín
b4b6819624 Adapt backward compatibility test 2024-08-30 14:07:30 +02:00
Yarik Briukhovetskyi
b7eb7cceeb
remake test to remove the head of path 2024-08-30 14:02:59 +02:00
Nikolai Kochetov
84d37c1bab
Merge pull request #69035 from VOkunev/master
Support for the Spanish language in the embedded dictionaries
2024-08-30 11:14:08 +00:00
vdimir
17cdcf4c74
Merge pull request #68957 from ClickHouse/vdimir/perf-test-cgrp-mem
perf tests set cgroups_memory_usage_observer_wait_time to zero
2024-08-30 11:09:14 +00:00
Yarik Briukhovetskyi
45face77aa
Merge branch 'ClickHouse:master' into remove_integration_test_datetime 2024-08-30 13:02:07 +02:00
Han Fei
b0ecacc0c3 remove no-parallel 2024-08-30 12:53:42 +02:00
Yarik Briukhovetskyi
76b938acaf
Update docs/en/sql-reference/aggregate-functions/parametric-functions.md 2024-08-30 12:50:08 +02:00
Yarik Briukhovetskyi
9a4c32e8de
Update docs/en/sql-reference/aggregate-functions/parametric-functions.md 2024-08-30 12:50:02 +02:00
Yarik Briukhovetskyi
b1fc15ffc9
Update docs/en/sql-reference/aggregate-functions/parametric-functions.md 2024-08-30 12:49:56 +02:00
flynn
af7adfe4b2 Remove unused code 2024-08-30 09:03:23 +00:00
flynn
c5b92413ca Fix vector similarity index does not work for cosineDistance 2024-08-30 08:28:31 +00:00
Alejandro
8ed128792d remove comment 2024-08-30 08:59:40 +01:00
Alejandro
aeaaef4347 Run tests without new analyzer 2024-08-30 08:59:27 +01:00
flynn
6ad8e5558a Fix typo 2024-08-30 07:25:25 +00:00
sunny19930321
6143f99f7a fix: change alter query to ternary expression 2024-08-30 15:02:09 +08:00
liuneng
f7fda2471c fix typo 2024-08-30 14:09:31 +08:00
Shaun Struwig
4ac4806b14
Update aspell-dict.txt 2024-08-30 08:07:21 +02:00
flynn
a6fdc81bdc Merge branch 'master' of github.com:ClickHouse/ClickHouse into vector-index 2024-08-30 03:19:29 +00:00
Han Fei
8fbfc61c55
Merge pull request #69018 from hanfei1991/hanfei/fix-false-leak-in-fiu
fix false leak detect in libfiu
2024-08-30 00:31:10 +00:00
Yarik Briukhovetskyi
69c6419f6d
Merge branch 'ClickHouse:master' into sandbox_ 2024-08-30 00:58:38 +02:00
Han Fei
429905afa1 fix token 2024-08-30 00:44:03 +02:00
serxa
f5a88171a6 Fix ProgressIndication data race on cancelQuery() 2024-08-29 20:37:07 +00:00
Nikita Mikhaylov
d132a29e17
Merge pull request #69077 from ClickHouse/tylerhannan-patch-1
Update README.md
2024-08-29 20:01:24 +00:00
Han Fei
1a28621b9f fix style 2024-08-29 21:59:09 +02:00
Kirill Nikiforov
563f3a4880
Merge remote-tracking branch 'origin/master' into feat/59376 2024-08-29 23:20:13 +04:00
Kirill Nikiforov
79c01e717f
rm comment, add docs 2024-08-29 23:15:39 +04:00
avogar
25f31f9149 Fix conversion for Dynamic, add more tests 2024-08-29 18:15:05 +00:00
Han Fei
1772a877ad fix logical error in async inserts 2024-08-29 20:10:34 +02:00
Michael Kolupaev
a474a5bc7c asan timed out too (because flaky check has timeout of ~36 seconds instead of 600) 2024-08-29 17:15:39 +00:00
Tyler Hannan
93143b6116
Update README.md 2024-08-29 19:11:41 +02:00
Alexander Tokmakov
df16831cc8
Update tests/integration/test_covered_by_broken_exists/test.py 2024-08-29 18:56:37 +02:00
Кирилл Гарбар
b2c4b771d8 Minor fixes 2024-08-29 19:33:04 +03:00
sakulali
aad57f438c CREATE TABLE AS copy PRIMARY KEY, ORDER BY, and similar clauses. 2024-08-30 00:16:10 +08:00
Arthur Passos
f9b845486a Merge branch 'master' into multi_auth_methods 2024-08-29 13:12:19 -03:00
Anton Popov
a4ddca773b return back num_bytes 2024-08-29 16:03:41 +00:00
Кирилл Гарбар
edf4e09fb2 Remove stale moving parts without zookeeper 2024-08-29 18:46:06 +03:00
Mikhail Artemenko
1aae191b81 use db name in keeper path 2024-08-29 15:26:42 +00:00
Yarik Briukhovetskyi
a7d0a5991e
Merge pull request #69068 from AleksaC/patch-2
Fix row policy documentation grammar
2024-08-29 14:59:40 +00:00
Anton Popov
4499f20ca8 better code in AsynchronousInsertQueue 2024-08-29 14:38:59 +00:00
Alejandro
36725fb5e1 Improved comment to force CI to re-run 2024-08-29 15:05:19 +01:00
Yarik Briukhovetskyi
13311bd666
fix test 2024-08-29 16:02:06 +02:00
Anton Popov
b3dae16fd4
Merge pull request #68951 from CurtizJ/fix-subcolumns-mv
Fix materialized views with `optimize_functions_to_subcolumns`
2024-08-29 13:41:56 +00:00
Mikhail Artemenko
d8f0ce92af fix style 2024-08-29 13:28:00 +00:00
Mikhail Artemenko
f06678ee6c add test 2024-08-29 13:12:37 +00:00
Arthur Passos
7000f214ab add head -n 1 to make sure only on occurrence of error code is grepped 2024-08-29 09:47:18 -03:00
Yarik Briukhovetskyi
5e8c8084cb
Merge pull request #69042 from konnectr/patch-5
RU Docs add ON CLUSTER SYSTEM SYNC REPLICA
2024-08-29 12:42:01 +00:00
Aleksa Cukovic
cd9be01c65
Fix row policy documentation grammar 2024-08-29 14:40:38 +02:00
flynn
0400dcb03e no-fastest 2024-08-29 12:34:58 +00:00
Yarik Briukhovetskyi
9e51894cff
Merge branch 'ClickHouse:master' into remove_integration_test_datetime 2024-08-29 14:22:35 +02:00
Mikhail Artemenko
e9497cdcbc use tryMulti instead of NoThrow 2024-08-29 12:20:42 +00:00
Mikhail Artemenko
8bbb78375e add try limit 2024-08-29 12:18:51 +00:00
Yarik Briukhovetskyi
97be458b58 add no-fasttest tag 2024-08-29 12:05:15 +00:00
Yarik Briukhovetskyi
34ce439043 chmod +x on test 2024-08-29 12:04:40 +00:00
János Benjamin Antal
b6a6d93152 Remove completely invalid queries from test 2024-08-29 11:28:56 +00:00
Yarik Briukhovetskyi
96a2685f91
empty commit 2024-08-29 13:24:23 +02:00
Yarik Briukhovetskyi
653b0802c0
init 2024-08-29 13:17:27 +02:00
avogar
83e75f96c8 Merge branch 'master' of github.com:ClickHouse/ClickHouse into dynamic-cast-or-default 2024-08-29 11:16:27 +00:00
Kruglov Pavel
d533c24321
Reduce test size 2024-08-29 13:14:43 +02:00
Alejandro
e9d806ea34 Added missing breakline 2024-08-29 12:10:18 +01:00
Nikolai Kochetov
70ae3314c6
Merge pull request #68744 from ClickHouse/fix-grouping-sets-mergine-aggregated
Fix merging of aggregated data for grouping sets.
2024-08-29 11:02:55 +00:00
flynn
d88aa3952d Disable alter table add vector similarity index if setting does not enabled 2024-08-29 10:56:26 +00:00
Alejandro
920a1b2801 Added test to validate that the value is being populated 2024-08-29 11:39:29 +01:00
baolin.hbl
7d56c8bd43 Avoid detached covered-by-broken part duplicates
Problem:
When a broken part is found during the startup, it will clone the parts which are
covered by the broken part, to the detached directory (with the 'covered-by-broken' prefix).
A part may be covered by multiple merged parts, which will result in multiple clones, which
leads to path conflicts and further attempts to clone to the try-n directory. If n exceeds 9,
the clone is abandoned and the table is marked as read-only.

pull#41981 tried fixed the problem, but the fix is incomplete. The metadata_version.txt file
is deleted during covered-by-broken clone. As a result,
looksLikeBrokenDetachedPartHasTheSameContent finds differences during part comparison.

Fix:
covered-by-broken retain metadata_version.txt file when cloning
2024-08-29 07:55:23 +00:00
Alejandro
88c99fa063 Do not depend on the response of getInfo for increasing the RealTimeMicroseconds 2024-08-29 08:43:01 +01:00
JackyWoo
a9b6c04705 Merge branch 'master' into add_statistics_minmax
# Conflicts:
#	src/Storages/Statistics/Statistics.cpp
2024-08-29 14:35:33 +08:00
李扬
3d04f3d33a
Merge branch 'ClickHouse:master' into orc_dict_encode 2024-08-29 10:16:06 +08:00
Tuan Pham Anh
57ba0f0b32 format gtest_Parser.cpp 2024-08-29 00:31:33 +00:00
Alejandro
91724c29a4 Only increase if profile_counters is intialized 2024-08-28 23:26:13 +01:00
Michael Kolupaev
d390999912
Update tests/queries/0_stateless/02735_parquet_encoder.sql 2024-08-28 15:26:06 -07:00
Arthur Passos
cb6d142947 remove non clustered tests to make it faster :D 2024-08-28 18:09:30 -03:00
Arthur Passos
a690539935 fix test 2024-08-28 18:03:27 -03:00
Konstantin Bogdanov
589a63a256
Merge pull request #69037 from ClickHouse/add-system-processor-to-short-fault
Add CPU arch to short fault info
2024-08-28 20:14:17 +00:00
Samuel Warfield
2898b123c3
Update parametric-functions.md
Fix link to pattern syntax
2024-08-28 14:11:16 -06:00
Alejandro
100c560cb8 Added RealTimeMicroseconds event 2024-08-28 20:37:49 +01:00
Konstantin Bogdanov
30eca0f4a0
Lint harder 2024-08-28 20:59:23 +02:00
Konstantin Bogdanov
0815a85e2b
Lint 2024-08-28 20:59:22 +02:00
Konstantin Bogdanov
896b1726e7
Add a comment 2024-08-28 20:59:21 +02:00
Konstantin Bogdanov
0c23257aa8
Revert "Fix integration test"
This reverts commit 0f3506bf7a.
2024-08-28 20:59:20 +02:00
Konstantin Bogdanov
ab567bad13
What if I just strip quotes 2024-08-28 20:59:20 +02:00
Konstantin Bogdanov
0dacd16947
Update SettingsFields.h 2024-08-28 20:59:19 +02:00
Konstantin Bogdanov
3f9f70d27d
Revert "Fix strange trash"
This reverts commit aee9612e51.
2024-08-28 20:59:17 +02:00
Konstantin Smirnov
d6127d5f49
add ON CLUSTER 2024-08-28 22:30:12 +05:00
Yarik Briukhovetskyi
ba604301b1
Merge branch 'ClickHouse:master' into remove_integration_test_datetime 2024-08-28 19:26:56 +02:00
Tyler Hannan
d6d29d9fe6
Merge pull request #69041 from ClickHouse/tylerhannan-patch-1
Update README.md
2024-08-28 17:13:47 +00:00
Raúl Marín
e1291cdb95
Merge pull request #68930 from Algunenano/01114_database_atomic
Fix 01114_database_atomic flakiness
2024-08-28 17:10:19 +00:00
Arthur Passos
b2795f06dc add extra line 2024-08-28 14:02:09 -03:00
Arthur Passos
7879915493 merge test fils now that they are faster 2024-08-28 14:01:24 -03:00
Arthur Passos
313b6b533f further optimize test by using http client instead of clickhouse-client 2024-08-28 13:54:31 -03:00
Tyler Hannan
c96eeb45f0
Update README.md
Adding more meetups
2024-08-28 18:47:52 +02:00
Konstantin Bogdanov
b6966f6c88
Use Poco 2024-08-28 18:26:26 +02:00
Yatsishin Ilya
82eae9f09f tune 2024-08-28 16:18:57 +00:00
Konstantin Bogdanov
ca13b13d81
Add CPU arch to short fault info 2024-08-28 17:54:42 +02:00
Arthur Passos
9f7f6c6f93 use curl client for create/drop/alter queries to make test run faster 2024-08-28 12:54:22 -03:00
Alejandro
6b08d2b6de Update docs 2024-08-28 16:51:56 +01:00
okunev
42039331ad Support for the Spanish language in the embedded dictionaries. 2024-08-28 17:47:43 +02:00
Mikhail Artemenko
4d486f1a74 update error policy 2024-08-28 15:36:15 +00:00
Yarik Briukhovetskyi
c4d4da8480
Merge pull request #69031 from rodrigargar/docs-fix-case-operator-link
Link to CASE changed after explicit anchor removed
2024-08-28 15:29:17 +00:00
Alejandro
41a4dd7705 Rename variable 2024-08-28 16:09:23 +01:00
avogar
0aba986372 Address review comments 2024-08-28 15:06:05 +00:00
Kruglov Pavel
a1c9cc471d
Apply suggestions from code review
Co-authored-by: János Benjamin Antal <antaljanosbenjamin@users.noreply.github.com>
2024-08-28 16:51:45 +02:00
Alejandro
644cfb27d6 Add RealTimeMicroseconds to HTTP Header X-ClickHouse-Summary 2024-08-28 15:34:34 +01:00
taiyang-li
5b3ca6b2b9 allow unsligned arrays in arrayZip 2024-08-28 22:14:43 +08:00
Rodrigo Garcia
3314042278
Link to CASE changed after explicit anchor removed 2024-08-28 16:14:31 +02:00
Mikhail Artemenko
7f613563e1 initial impl for cp/mv 2024-08-28 13:39:29 +00:00
János Benjamin Antal
f109c141b0 Add safety check 2024-08-28 13:30:41 +00:00
János Benjamin Antal
f76e6ecdaf Make check more specific 2024-08-28 13:30:25 +00:00
János Benjamin Antal
0d463b839e Remove unused parser 2024-08-28 13:29:41 +00:00
Han Fei
a842994af1 fix false leak detect in libfiu 2024-08-28 15:21:49 +02:00
János Benjamin Antal
a0fa693f0b Add safety assertion 2024-08-28 13:20:58 +00:00
Nikita Mikhaylov
47f0b9fbed
Merge pull request #68994 from ClickHouse/alexey-milovidov-patch-8
Update CHANGELOG.md
2024-08-28 13:20:15 +00:00
János Benjamin Antal
3c6b2a48c3 Prevent specifying properties in MODIFY COLUMN queries when using REMOVE/RESET SETTING/MODIFY SETTING 2024-08-28 13:05:43 +00:00
李扬
553c309477
Merge branch 'master' into orc_dict_encode 2024-08-28 21:00:18 +08:00
taiyang-li
ae582120ae change as request 2024-08-28 20:56:33 +08:00
Tuan Pham Anh
2c6563ee69 Fix test in tests/integration/test_materialized_mysql_database/materialized_with_ddl.py 2024-08-28 12:37:28 +00:00
Arthur Passos
b29e00b838 add space 2024-08-28 09:17:04 -03:00
Arthur Passos
ae8d90f6b8 no replicated database 2024-08-28 09:05:25 -03:00
imddba
ad08db39e5
Add CKibana as third-party GUI 2024-08-28 20:05:06 +08:00
shiyer7474
d218b04fba Fix test_role & test_keeper_s3_snapshot 2024-08-28 11:52:51 +00:00
Kruglov Pavel
2c0ddd10a0
Fix build 2024-08-28 13:49:48 +02:00
Kruglov Pavel
e7d63b5f79
Merge pull request #68953 from Avogar/fix-dynamic-unitialized-value
Don't use serializations cache in const Dynamic column methods
2024-08-28 11:39:00 +00:00
Kruglov Pavel
b1e7c067c9
Merge pull request #68955 from Avogar/fix-json-type-parsing-null-as-default
Fix JSON type parsing with nulls as defaults
2024-08-28 11:38:49 +00:00
vdimir
d6af09ea27
Merge pull request #68878 from ClickHouse/vdimir/faster_00653_verification_monotonic_data_load
Speedup test 00653_verification_monotonic_data_load
2024-08-28 11:12:17 +00:00
vdimir
31a376953d
Merge pull request #68644 from linkwk7/fix_full_text_with_multi_col
Fix wrong row id when using full text index with multi column
2024-08-28 11:11:37 +00:00
alesapin
d3e8ed9f4d
Merge pull request #68983 from ClickHouse/hhhh
Actually fix false "Killed by signal (output files)" in stress_tests.lib
2024-08-28 10:53:05 +00:00
Raúl Marín
0fe8f94b15 Fix missing check 2024-08-28 12:50:25 +02:00
alesapin
d8bf6bfc07
Merge pull request #68487 from azat/tests/capture-kill-output
Fix output of clickhouse-test in case of tests timeouts
2024-08-28 09:40:32 +00:00
Kseniia Sumarokova
fd3fca9f66
Merge pull request #68901 from jrdi/system-projections
Add system.projections table
2024-08-28 09:36:23 +00:00
Pedro Ferreira
f158ac624d
Merge pull request #68701 from PedroTadim/fix-test
Fix for failing test in CI
2024-08-28 09:31:43 +00:00
Robert Schulze
cbf60f83b2
Merge pull request #68822 from bigo-sg/improve_upper_lower
Speed up functions `lowerUTF8`/`upperUTF8`
2024-08-28 08:53:30 +00:00
Robert Schulze
9fb4c23c06
Merge pull request #68678 from rschu1ze/usearch-2.14
Vector similarity index: make `bf16` the default quantization
2024-08-28 08:45:02 +00:00
Nikita Mikhaylov
8a923d2b21
Update 02735_parquet_encoder.sql
Co-authored-by: János Benjamin Antal <antaljanosbenjamin@users.noreply.github.com>
2024-08-28 09:58:50 +02:00
Alexey Milovidov
1f10ba2901
Update CHANGELOG.md
Remove the server setting just in case, because its applicability was not clarified, and its name is not proper.
2024-08-28 09:16:08 +02:00
Tuan Pham Anh
e0b9c0f14f Remove settings update in ASTTableOverride::formatImpl 2024-08-28 03:47:27 +00:00
Raúl Marín
61599108c7 Make 01114_database_atomic timings consistent 2024-08-28 01:37:38 +02:00
Michael Kolupaev
f4038e3153
Merge pull request #68918 from ClickHouse/long
Make long_parquet* tests less long
2024-08-27 23:15:07 +00:00
Michael Kolupaev
ea32862187 no-tsan in 02735_parquet_encoder 2024-08-27 23:10:48 +00:00
Arthur Passos
41a4a97ca3 no parallel 2024-08-27 19:57:59 -03:00
Michael Kolupaev
ea1289a2b3 Actually fix false "Killed by signal (output files)" in stress_tests.lib 2024-08-27 22:42:14 +00:00
Konstantin Bogdanov
a2a1b47ee3
Merge pull request #68902 from ClickHouse/add-integration-test-runner-checks
ci: add checks for `iptables-nft` in integration test runner
2024-08-27 20:59:55 +00:00
Arthur Passos
50b3d3172c add no fast test 2024-08-27 16:48:10 -03:00
Arthur Passos
c298b20ba9 extract some tests into sql as an attempt to make them run faster for flaky check.. 2024-08-27 16:17:35 -03:00
Arthur Passos
0b29aef1a0 remove extra dot from ex message 2024-08-27 15:25:41 -03:00
Konstantin Bogdanov
26e1338c4e
Update runner 2024-08-27 19:05:10 +02:00
Nikolai Kochetov
a1517cb9d6 Refactor a bit and add a comment. 2024-08-27 16:56:03 +00:00
alesapin
3d40f700cf
Merge branch 'master' into tests/capture-kill-output 2024-08-27 18:40:22 +02:00
Nikolai Kochetov
a7584bbb80 Remove comments. 2024-08-27 16:07:31 +00:00
Anton Popov
ac91471042 add comment 2024-08-27 16:06:12 +00:00
Arthur Passos
a0ab22e031 style 2024-08-27 13:01:10 -03:00
Yatsishin Ilya
aed953bf94 black 2024-08-27 16:00:33 +00:00
Nikolai Kochetov
2b495e22cd Fixing a test. 2024-08-27 15:38:52 +00:00
Arthur Passos
6f806124a3 Merge branch 'master' into multi_auth_methods 2024-08-27 12:24:53 -03:00
Arthur Passos
a65d175a81 change parsing logic a bit 2024-08-27 12:23:42 -03:00
Nikolai Kochetov
90cc619966 Better care about grouping keys order for GROUPING SETS. 2024-08-27 15:06:43 +00:00
Tuan Pham Anh
9ae0d51613 Reformat the code, pass variable names in comments when calling 2024-08-27 15:02:02 +00:00
János Benjamin Antal
b8d5a82f97 Fix test 2024-08-27 14:31:37 +00:00
Pedro Ferreira
53bfab4703 Missing newline 2024-08-27 14:20:31 +00:00
vdimir
c884a2fb9d
perf tests set cgroups_memory_usage_observer_wait_time to zero 2024-08-27 13:26:20 +00:00
Blargian
35adf8d12b add toBool to docs 2024-08-27 15:22:54 +02:00
Alexander Gololobov
2a68ad8704
Fill plan_step_name and plan_step_description 2024-08-27 15:12:01 +02:00
avogar
88b72238c8 Fix JSON type parsing with nulls as defaults 2024-08-27 13:09:19 +00:00
Alexander Gololobov
cc701c92b4 Add plan_step_name and plan_step_description columns to system.processors_profile_log 2024-08-27 15:05:05 +02:00
avogar
6ee197ea59 Don't use serializations cache in const Dynamic column methods 2024-08-27 13:01:37 +00:00
Blargian
6febfc78b3 updates docs for DateTime64OrZero/Null/Default 2024-08-27 14:52:46 +02:00
iceFireser
55eb2953c7
Merge branch 'ClickHouse:master' into master 2024-08-27 20:51:47 +08:00
Anton Popov
c7d0d790e2 fix materialized views with optimize_functions_to_subcolumns 2024-08-27 12:38:37 +00:00
Raúl Marín
c1a83f4734 Fix possible wrong result during anyHeavy state merge 2024-08-27 13:45:25 +02:00
Yatsishin Ilya
fc2aade699 Merge remote-tracking branch 'qoega/improve-integration-tests-5' into improve-integration-tests-5 2024-08-27 11:33:26 +00:00
Yatsishin Ilya
c44cc71310 forgot several files 2024-08-27 11:32:05 +00:00
Yatsishin Ilya
6c84f9ccfb Merge remote-tracking branch 'origin/master' into improve-integration-tests-5 2024-08-27 11:28:32 +00:00
Blargian
29664d12fc update example of toTime 2024-08-27 12:44:28 +02:00
Pedro Ferreira
3fde3cb85c Merge remote-tracking branch 'upstream/master' into fix-test 2024-08-27 10:43:14 +00:00
Pedro Ferreira
43482c4ed0 Recreate database at each run 2024-08-27 10:42:47 +00:00
Blargian
c1c4cabe9f Update toReference*Num function documentation 2024-08-27 12:41:02 +02:00
János Benjamin Antal
793b549291 Fix typo in docs 2024-08-27 10:31:22 +00:00
János Benjamin Antal
1523df6ec3 Ignore MODIFY_COLUMN commands without column type when parsing mutation commands 2024-08-27 10:31:11 +00:00
Yarik Briukhovetskyi
5ce8a08e72
Merge branch 'ClickHouse:master' into remove_integration_test_datetime 2024-08-27 12:08:15 +02:00
Raúl Marín
2d2e8b3a96 Make the test parallelizable 2024-08-27 11:52:24 +02:00
Raúl Marín
1aebcc1cb7 Fix 01114_database_atomic flakiness 2024-08-27 11:43:15 +02:00
Tuan Pham Anh
69cf54192c 1) Add tests for the identifier quoting style setting. 2) Update uni-test for table overrides 2024-08-27 09:38:21 +00:00
taiyang-li
aa4688a982 fix style 2024-08-27 12:25:22 +08:00
Michael Kolupaev
89359c1e6b Make long_parquet* tests less long 2024-08-27 00:53:33 +00:00
Ilya Yatsishin
f9f960a5ed
Update ci_config.py 2024-08-26 22:04:54 +02:00
Konstantin Bogdanov
fb3c4671f0
Improve error messages 2024-08-26 20:45:25 +02:00
Jordi
c43fcce77d Fix style check 2024-08-26 20:04:19 +02:00
Konstantin Bogdanov
07cb5b27eb
Lint 2024-08-26 19:41:56 +02:00
Ilya Yatsishin
34d13bd746
Update ci_config.py 2024-08-26 19:33:04 +02:00
Konstantin Bogdanov
df7d44bc3a
Lint 2024-08-26 19:27:07 +02:00
Konstantin Bogdanov
13593340f2
Add checks 2024-08-26 19:24:00 +02:00
Jordi
cf58ce217a Add system.projections table 2024-08-26 19:20:26 +02:00
Max Kainov
d799a0b6ee increase timeout for flaky check 2024-08-26 18:43:21 +02:00
Yarik Briukhovetskyi
3fec25eb92
Merge branch 'ClickHouse:master' into remove_integration_test_datetime 2024-08-26 18:28:53 +02:00
Tuan Pham Anh
8e6de7e767 1) Fix: move new setting to 24.9 key. 2) Fix: fource quoting dictionary attribute names 2024-08-26 15:26:21 +00:00
Tuan Pham Anh
32e995acbb Update settings change history version 2024-08-26 15:26:21 +00:00
Tuan Pham Anh
e1d66b9e26 Add output_format_always_quote_identifiers into the settings 2024-08-26 15:26:21 +00:00
Tuan Pham Anh
d6ca589ebe Treat PROJECTION, DICTIONARY, COLUMN, INDEX names as identifiers when formating 2024-08-26 15:26:21 +00:00
Tuan Pham Anh
5bad631d46 Add config for outout_format_identifers_quoting_style 2024-08-26 15:26:21 +00:00
Nikolai Kochetov
9d9ef69196 Fixing check. 2024-08-26 15:21:48 +00:00
Nikolai Kochetov
5f587af078 Review fix. 2024-08-26 15:15:16 +00:00
Nikolai Kochetov
42e7cc476e Fixing typos. 2024-08-26 14:48:29 +00:00
Nikolai Kochetov
77061db955 Adding comments and checks. 2024-08-26 14:37:02 +00:00
Yarik Briukhovetskyi
87af67a927
Merge branch 'ClickHouse:master' into remove_integration_test_datetime 2024-08-26 14:05:26 +02:00
Kruglov Pavel
bf4b53390b
Merge branch 'master' into input_format_json_empty_as_default 2024-08-26 13:40:48 +02:00
Max Kainov
9339c0593b handle timeout in flaky check 2024-08-26 13:37:37 +02:00
vdimir
aeac6c5498
fix reference 2024-08-26 13:15:52 +02:00
vdimir
7d89425273
Speedup test 00653_verification_monotonic_data_load 2024-08-26 13:15:26 +02:00
Pedro Ferreira
652ff82ae9 Merge remote-tracking branch 'upstream/master' into fix-test 2024-08-26 10:11:49 +00:00
vdimir
50e08ed4f4
Merge branch 'master' into fix_full_text_with_multi_col 2024-08-26 11:52:59 +02:00
taiyang-li
53ace69ede fix failed performance tests 2024-08-26 16:47:47 +08:00
taiyang-li
6c0102e971 fix failed uts 2024-08-26 16:28:56 +08:00
taiyang-li
7aaa0289e1 revert files 2024-08-26 14:58:57 +08:00
taiyang-li
d6df83d561 add uts about orc string encode 2024-08-26 14:57:51 +08:00
taiyang-li
1011f8ef9c add uts about orc string encode 2024-08-26 14:45:41 +08:00
taiyang-li
9bcafbc90f improve_upper_lower 2024-08-26 10:46:18 +08:00
Nikita Mikhaylov
21eeda9d0b Merge branch 'master' of github.com:ClickHouse/ClickHouse into remove_integration_test_datetime 2024-08-25 14:32:26 +02:00
Alexey Korepanov
312d32aaf9 Fix formatting 2024-08-25 12:14:18 +02:00
Alexey Korepanov
c42815a139
Merge branch 'master' into output-format-json-compact-with-progress 2024-08-25 11:43:06 +02:00
Alexey Korepanov
0e4f2b17cc Remove unnecessary check 2024-08-25 11:38:29 +02:00
Alexey Korepanov
af3f600b5c Fix commas in the statistics section 2024-08-25 11:35:35 +02:00
Alexey Korepanov
58aab9b8c7 Remove wrong bracket in the meta section 2024-08-25 11:29:07 +02:00
Alexey Korepanov
06f0267ed1 Do not show statistics if exception happens 2024-08-25 11:27:43 +02:00
iceFireser
6afe3fc500
Merge branch 'ClickHouse:master' into master 2024-08-24 17:18:54 +08:00
Alexey Korepanov
b772140514 Fix PR comments: check exception in the test 2024-08-23 22:56:24 +02:00
Igor Nikonov
d12aac7d12 Test 03228_pr_subquery_view_order_by
PR + subquery with view and order by
2024-08-23 20:11:33 +00:00
Alexey Korepanov
83fa51f400 PR fixes: update documentation on JSONCompactWithProgress format 2024-08-23 21:42:54 +02:00
Yatsishin Ilya
66be44e7aa better 2024-08-23 19:09:09 +00:00
Igor Nikonov
17c1e82bc0 Merge remote-tracking branch 'origin/master' into pr-local-plan 2024-08-23 18:27:19 +00:00
Arthur Passos
cb7ef910e2
Update 03174_multiple_authentication_methods.sh 2024-08-23 13:50:38 -03:00
Yarik Briukhovetskyi
bea98fed5e chmod +x on test 2024-08-23 16:45:38 +00:00
Yarik Briukhovetskyi
b83c6239ac
rename tests 2024-08-23 18:21:06 +02:00
Anton Popov
b39c5cdb40 fix tests 2024-08-23 16:17:14 +00:00
Anton Popov
7517ef4cc9 fix async insert with alter modify column 2024-08-23 16:08:04 +00:00
Yarik Briukhovetskyi
223de64072
init 2024-08-23 17:09:28 +02:00
taiyang-li
ab6aed6c6a merge master 2024-08-23 23:08:28 +08:00
taiyang-li
9ad7cfc71f host fix lower upper performance issue 2024-08-23 23:04:51 +08:00
joelynch
1c6976d7a5
Fix zero copy bug with encrypted disk and UNFREEZE
When running UNFREEZE with encrypted disk, zookeeper
metadata would be erroneously removed here
src/Storages/StorageReplicatedMergeTree.cpp#L10418.
2024-08-23 17:04:39 +02:00
iceFireser
35db026e33
Merge branch 'ClickHouse:master' into master 2024-08-23 19:08:20 +08:00
Robert Schulze
c40c8b7adb
Enable bf16 + f64 quantization, make bf16 the default 2024-08-23 07:32:34 +00:00
Robert Schulze
1dc7d37ff7
Bump usearch to v2.14.0 2024-08-23 07:32:34 +00:00
iceFireser
0966072951
Merge branch 'ClickHouse:master' into master 2024-08-23 10:01:58 +08:00
Anton Popov
1aaf9a08c4 fix async inserts with alter 2024-08-22 23:25:38 +00:00
Nikolai Kochetov
0e136ded28 Fixing header. 2024-08-22 19:06:04 +00:00
Yatsishin Ilya
e6b18f2b30 black 2024-08-22 19:05:07 +00:00
Nikolai Kochetov
de2f1adf91 Fix mergine of aggregated data for grouping sets. 2024-08-22 18:02:03 +00:00
Yatsishin Ilya
b4a0a9b00c rework test_async_insert_adaptive_busy_timeout 2024-08-22 16:58:19 +00:00
Arthur Passos
43e9a7ba4b Merge branch 'master' into multi_auth_methods 2024-08-22 10:57:23 -03:00
Arthur Passos
62ce2999ae minor grammar 2024-08-22 10:00:20 -03:00
Arthur Passos
91cceccb4b add setting docs 2024-08-22 09:48:53 -03:00
Arthur Passos
13d5b029a4 make max_number_of_authentication_methods=0 unlimited 2024-08-22 09:41:10 -03:00
Pedro Ferreira
526be4759d SQL as a set language, doesn't have order in the output, so add ORDER BY or min call for it 2024-08-22 10:34:05 +00:00
vdimir
07f44fdb89
Merge branch 'master' into vdimir/fix_function_printf_style 2024-08-22 11:23:50 +02:00
vdimir
0ef5d46582
Merge branch 'master' into fix_full_text_with_multi_col 2024-08-22 11:21:38 +02:00
flynn
ca40da5c03 Proper ErrorCodes 2024-08-22 09:03:02 +00:00
taiyang-li
b0a0988c5b change as request 2024-08-22 10:46:44 +08:00
Michael Kolupaev
f6edaeaade Merge remote-tracking branch 'origin/master' into musysroot 2024-08-22 01:49:41 +00:00
Arthur Passos
d7d40db036 make sure all alters except id related are allowed even if state of user is invalid afterwards 2024-08-21 19:07:54 -03:00
Mikhail Filimonov
64d4ef002d fix style 2024-08-21 18:20:05 +02:00
Mikhail Filimonov
a66bd99d2f make jobs queue in the ThreadPool stable (i.e. FIFO for the same priority), otherwise some jobs can stay in queue untaken for a long time 2024-08-21 16:50:58 +02:00
Kruglov Pavel
34d02304d3
Merge branch 'master' into input_format_json_empty_as_default 2024-08-21 14:50:36 +02:00
JackyWoo
d71afba234 Fix tests 2024-08-21 18:58:34 +08:00
Mikhail Filimonov
d5aec83ce7 Mark LocalThread metrics obsolete due to https://github.com/ClickHouse/ClickHouse/pull/47880 2024-08-21 11:48:04 +02:00
iceFireser
06b3ea2a30 emptry commit 2024-08-21 15:52:44 +08:00
siyuan
f12840eb5f Fix wrong row id when using full text index with multi column 2024-08-21 15:45:58 +08:00
JackyWoo
fc704020e9 Update tests 2024-08-21 13:29:42 +08:00
JackyWoo
6fb5051237 Fix conflicts 2024-08-21 12:47:12 +08:00
JackyWoo
2502ca766f Merge branch 'master' into add_statistics_minmax
# Conflicts:
#	src/Storages/Statistics/ConditionSelectivityEstimator.cpp
#	src/Storages/Statistics/Statistics.cpp
#	src/Storages/Statistics/Statistics.h
#	src/Storages/Statistics/StatisticsCountMinSketch.cpp
#	src/Storages/Statistics/StatisticsCountMinSketch.h
#	src/Storages/Statistics/StatisticsTDigest.cpp
#	src/Storages/Statistics/StatisticsTDigest.h
#	src/Storages/Statistics/StatisticsUniq.cpp
#	src/Storages/Statistics/StatisticsUniq.h
2024-08-21 10:56:23 +08:00
Arthur Passos
4fd19c3ad9 do not allow reset auth to new to be used along with add identified clauses 2024-08-20 17:16:12 -03:00
Arthur Passos
f0223aedde add on cluster tests 2024-08-20 16:28:12 -03:00
Mikhail Filimonov
843d869631 add one more metric 2024-08-20 21:22:25 +02:00
Mikhail Filimonov
1f2f3c69b9 New metrics for ThreadPool
- Introduced performance metrics for better monitoring and troubleshooting of ThreadPool.
2024-08-20 21:22:14 +02:00
Arthur Passos
1980959c8b exception message 2024-08-20 14:27:53 -03:00
Arthur Passos
27ee4dd611 throw syntax error instead of bad arguments in case of add not identified 2024-08-20 14:17:05 -03:00
Michael Kolupaev
6d837fbaba Merge remote-tracking branch 'origin/master' into musysroot 2024-08-20 17:14:45 +00:00
iceFireser
1dfe559db4 emptry commit 2024-08-20 19:52:33 +08:00
avogar
a5a451efe2 Merge branch 'master' of github.com:ClickHouse/ClickHouse into dynamic-json-distinct-aggregate-functions 2024-08-20 09:57:46 +00:00
kevinyhzou
add486b62a rebase and reslove conflict 2024-08-20 17:33:08 +08:00
vdimir
2fcbe2465a
Fix style in Functions/printf.cpp 2024-08-20 09:07:15 +00:00
Sergey (Finn) Gnezdilov
21e64f2aa9
Update nats.md
"kafka_handle_error_mode" fixed on "nats_handle_error_mode"
2024-08-20 11:33:13 +03:00
kevinyhzou
cfa4ca6fb1 remove useless code 2024-08-20 15:56:34 +08:00
kevinyhzou
b8e967ff9c add allowReadCaseInsentitive func 2024-08-20 15:56:34 +08:00
kevinyhzou
29c94195e1 add setting tests/performance/all_join_opt.xml 2024-08-20 15:56:34 +08:00
kevinyhzou
37c3f4a870 add threshold for table rows 2024-08-20 15:55:06 +08:00
taiyang-li
03ab625265 enable string dict encoding in orc output format 2024-08-20 15:47:26 +08:00
taiyang-li
dbd4ee44ed enable dict encoding in orc writer 2024-08-20 14:09:14 +08:00
Michael Kolupaev
11658c07b6 Merge remote-tracking branch 'origin/master' into musysroot 2024-08-19 21:52:41 +00:00
avogar
a2b08e93e4 Change test 2024-08-19 20:16:50 +00:00
Arthur Passos
623c507e5f fix in the right place.. 2024-08-19 16:42:48 -03:00
Arthur Passos
01f5337f69 fix serialization to fix on cluster commands 2024-08-19 15:13:39 -03:00
Yatsishin Ilya
718957886d Merge remote-tracking branch 'origin/master' into improve-integration-tests-5 2024-08-19 16:32:08 +00:00
Kruglov Pavel
64bce7afa1
Fix spaces 2024-08-19 17:22:17 +02:00
Kruglov Pavel
0793585acd
Fix bad conflict resolution 2024-08-19 16:59:30 +02:00
Yatsishin Ilya
9ee7ae3d3c Merge remote-tracking branch 'qoega/improve-integration-tests-5' into improve-integration-tests-5 2024-08-19 14:12:34 +00:00
Yatsishin Ilya
90ad110a7d more 2024-08-19 13:58:44 +00:00
Ilya Yatsishin
65087d88b5 Merge remote-tracking branch 'origin/master' into improve-integration-tests-5 2024-08-19 14:11:54 +02:00
Nikita Taranov
d4a3a033b0
Merge branch 'master' into adaptive_parallel_replicas 2024-08-19 12:48:39 +02:00
vdimir
e307b25664
Merge branch 'master' into vdimir/multiple_joins_with_storage_join 2024-08-19 11:06:06 +02:00
Yatsishin Ilya
228cdfde63 more tests 2024-08-19 10:04:49 +02:00
Alexey Milovidov
165d08f088 Fix bad exception messages 2024-08-19 05:54:37 +02:00
Alexey Milovidov
e0dbc53b58 Merge branch 'master' into miscellaneous-3 2024-08-19 01:18:48 +02:00
avogar
9d183b8905 Add check for loo large array size 2024-08-18 20:35:30 +00:00
Alexey Milovidov
f97551e2ad Fix tests 2024-08-18 22:17:16 +02:00
Nikita Taranov
c252b3c8b0 fix build 2024-08-18 18:29:48 +01:00
Nikita Taranov
30229a3bfd better 2024-08-18 17:44:16 +01:00
Nikita Taranov
8a0f41da7a
Merge branch 'master' into adaptive_parallel_replicas 2024-08-18 17:55:29 +02:00
Nikita Taranov
628a4300ba fix 2024-08-18 16:53:00 +01:00
Alexey Milovidov
f88b5988c1 Update test 2024-08-18 09:44:39 +02:00
Alexey Milovidov
4bb2f7b3f6 Miscellaneous 2024-08-18 09:09:58 +02:00
Alexey Milovidov
95edca513c Fix tests 2024-08-18 05:43:01 +02:00
Alexey Milovidov
5004e4d2cc Miscellaneous 2024-08-18 03:27:42 +02:00
Igor Nikonov
9fe65f750e Merge remote-tracking branch 'origin/master' into pr-local-plan 2024-08-17 14:44:02 +00:00
Arthur Passos
accade2390 Merge branch 'master' into multi_auth_methods 2024-08-17 10:26:11 -03:00
Kruglov Pavel
41f6e06cbe
Update 03227_distinct_dynamic_types_json_paths.sql 2024-08-17 13:08:30 +02:00
Michael Kolupaev
52c5619a92 Merge remote-tracking branch 'origin/master' into musysroot 2024-08-17 03:28:31 +00:00
avogar
4bf9197849 Merge branch 'master' of github.com:ClickHouse/ClickHouse into dynamic-json-distinct-aggregate-functions 2024-08-16 22:38:52 +00:00
Nikita Taranov
e7fc89ba26 add bw-compatibility test 2024-08-16 23:23:03 +01:00
Azat Khuzhin
a66db7abc2 Fix output of clickhouse-test in case of tests timeouts
After https://github.com/ClickHouse/ClickHouse/pull/67737 the output
will be broken, since in case of timeout it will print to stdout.

Let's just capture it and add it to stderr.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-08-17 00:20:08 +02:00
avogar
b29d5242be Fix tidy build 2024-08-16 22:10:11 +00:00
Igor Nikonov
6e0a74f74d Merge remote-tracking branch 'origin/master' into pr-local-plan 2024-08-16 19:35:19 +00:00
Michael Kolupaev
76960eff80 This should work 2024-08-16 18:38:03 +00:00
avogar
f21e982f03 Fix style, update tests 2024-08-16 18:01:35 +00:00
avogar
85a813bbed Better example 2024-08-16 17:55:57 +00:00
avogar
32f4b1f891 Add aggregate functions distinctDynamicTypes/distinctJSONPaths/distinctJSONPathsAndTypes 2024-08-16 17:49:38 +00:00
Jiebin Sun
cb9039e91d Add thread pool and cancellation if merge data with key
This patch will add thread pool and cancellation if merge data with key.
During the merge, if the data size is large, we may convert the
singleLevelHash to twoLevelHash and merge in parallel.

Test the patch with 2 x 80 vCPUs, Q8 and Q9 has got 10.3% and 7.6%
performance improvement.

Signed-off-by: Jiebin Sun <jiebin.sun@intel.com>
2024-08-17 01:32:18 +08:00
Arthur Passos
770804ffdc change default setting value to 100 2024-08-16 08:57:11 -03:00
Kirill Nikiforov
46f27b03f9
fix transaction 2024-08-16 15:48:28 +04:00
Igor Nikonov
9dc288faa8 Merge remote-tracking branch 'origin/master' into pr-local-plan 2024-08-16 11:07:35 +00:00
Igor Nikonov
29fffd34ac Fix: check if table expression is present 2024-08-16 11:06:20 +00:00
Ilya Yatsishin
7c691cbb79 style 2024-08-16 10:44:11 +02:00
Michael Kolupaev
b3a3d1e720 another rebase 2024-08-16 05:53:17 +00:00
Kirill Nikiforov
c31c4154ca fix cs 2024-08-16 01:49:54 +04:00
Michael Kolupaev
b1963738bd Rebase 2024-08-15 21:41:40 +00:00
Michael Kolupaev
82fc6bfa9e Merge remote-tracking branch 'origin/master' into musysroot 2024-08-15 21:39:38 +00:00
Kirill Nikiforov
624afd68c8 parallel attach from multiple partitions 2024-08-16 01:24:52 +04:00
Igor Nikonov
49fc4cb87b Merge remote-tracking branch 'origin/master' into pr-local-plan 2024-08-15 20:48:56 +00:00
vdimir
49ce2c7619
Merge branch 'master' into vdimir/datetime64_constant_to_ast_f 2024-08-15 21:41:56 +02:00
Nikita Taranov
80d985a690 add setting change 2024-08-15 19:11:43 +01:00
Nikita Taranov
891f9c5358 fix typo 2024-08-15 18:44:37 +01:00
Nikita Taranov
cb0335446e impl 2024-08-15 18:34:06 +01:00
Ilya Yatsishin
1d2aa037b8 Merge remote-tracking branch 'origin/master' into improve-integration-tests-5 2024-08-15 18:48:10 +02:00
Arthur Passos
70e7c4e63d fix black with script 2024-08-15 12:21:06 -03:00
Arthur Passos
12e6645058 fix black 2024-08-15 12:19:36 -03:00
Arthur Passos
714a4d871c add integ tests for defa7ult value 2024-08-15 12:18:09 -03:00
Arthur Passos
72f1695014 add integ tests for new setting 2024-08-15 12:03:30 -03:00
Igor Nikonov
5d9f105fe3 Merge remote-tracking branch 'origin/master' into pr-local-plan 2024-08-15 14:34:15 +00:00
Arthur Passos
17c1cef52b add server setting 2024-08-15 10:30:33 -03:00
Igor Nikonov
b4e8c14729 Merge remote-tracking branch 'origin/master' into pr-local-plan 2024-08-15 11:12:56 +00:00
Igor Nikonov
a3978b24d0 Fix for subqueries with FINAL 2024-08-15 11:11:49 +00:00
Yatsishin Ilya
9f88f60a1c Merge branch 'improve-integration-tests-4' into improve-integration-tests-5 2024-08-15 08:59:00 +00:00
Yatsishin Ilya
c48b6d25f7 more tests 2024-08-15 08:58:36 +00:00
Yatsishin Ilya
d31b36ca50 Rework integration flaky check as it was timeouting too fast as run as a single group 2024-08-15 07:16:01 +00:00
Yatsishin Ilya
7a4bd49c42 More improvements in integration test 2024-08-14 17:16:36 +00:00
Arthur Passos
3247f3ad08 make sure reset authentication methods can only be used on alter queries 2024-08-14 12:44:43 -03:00
Arthur Passos
026fa0a7fd fix leading id method without WITH and with type specified being allowed 2024-08-14 12:39:27 -03:00
sunny
4f77893c79
Update ParserDeleteQuery.cpp
fix: delete space
2024-08-14 18:24:03 +08:00
Alexis Arnaud
29bc7cf5d5 post-review changes 2024-08-14 12:03:29 +02:00
sunny
9754620c07
Update 02352_lightweight_delete_in_partition.sql
update test
2024-08-14 17:51:45 +08:00
Marco Vilas Boas
0a1f61fcbd
Merge branch 'ClickHouse:master' into marco-vb/x509-san-support-wildcard 2024-08-14 10:15:30 +01:00
Michael Kolupaev
c869b06519 Remove getpwuid() calls in Poco::PathImpl 2024-08-14 03:43:48 +00:00
Michael Kolupaev
0716b460db Fix duplicate symbol errors 2024-08-14 03:00:51 +00:00
Michael Kolupaev
0dc7cd7eb4 Update musl to have unwind info 2024-08-14 01:12:11 +00:00
Igor Nikonov
1a8f45464c Fix min_marks_to_read overflow 2024-08-13 21:05:29 +00:00
Igor Nikonov
62e45a4c8f Test 03222_parallel_replicas_min_marks_to_read_overflow 2024-08-13 21:05:15 +00:00
Alexis Arnaud
a39a4b1080 better 2024-08-13 18:30:43 +02:00
Alexis Arnaud
229fffcd56 post-review changes 2024-08-13 18:30:43 +02:00
Alexis Arnaud
3c586d80c8 post-rebase fixes 2024-08-13 18:30:43 +02:00
Alexis Arnaud
0ff90e4a5c post-review changes 2024-08-13 18:30:43 +02:00
Alexis Arnaud
5d6d378f24 renumbered tests 2024-08-13 18:30:43 +02:00
Alexis Arnaud
14dad25adc trigger build 2024-08-13 18:30:43 +02:00
Alexis Arnaud
906a181b97 fix for clang-tidy 2024-08-13 18:30:43 +02:00
Alexis Arnaud
7b09ec9ccb added input_format_json_empty_as_default to setting changes history 2024-08-13 18:30:43 +02:00
Alexis Arnaud
d5bea37c96 post-review changes 2024-08-13 18:30:43 +02:00
Alexis Arnaud
ad24989b31 slightly better comment 2024-08-13 18:30:43 +02:00
Alexis Arnaud
d36176ad85 Support for the input_format_json_empty_as_default setting 2024-08-13 18:30:43 +02:00
Igor Nikonov
5339717c11 Merge remote-tracking branch 'origin/master' into pr-local-plan 2024-08-13 16:16:31 +00:00
Igor Nikonov
4448880bbe Remove settings 03222_pr_final_not_supported 2024-08-13 16:15:28 +00:00
Igor Nikonov
99dcf7e60e Add 03222_pr_final_not_supported.sql 2024-08-13 15:57:09 +00:00
vdimir
64e10b2dda
Merge branch 'master' into vdimir/datetime64_constant_to_ast_f 2024-08-13 17:00:51 +02:00
Igor Nikonov
e42b58082b Merge remote-tracking branch 'origin/master' into pr-local-plan 2024-08-13 14:30:33 +00:00
Igor Nikonov
8d6e2e26a5 New test for asan issue with pr 2024-08-13 14:29:52 +00:00
Arthur Passos
e8a40d9d52 Merge branch 'master' into multi_auth_methods 2024-08-13 10:30:01 -03:00
Arthur Passos
9abc001296 fix trailing comma issue 2024-08-13 10:17:05 -03:00
Antonio Andelic
c61fc591c4 Use functions instead of classes 2024-08-13 11:33:17 +02:00
Antonio Andelic
dcbc590302 Merge branch 'master' into keeper-some-improvement2 2024-08-13 09:01:10 +02:00
李扬
fb80bc2afa
Merge branch 'ClickHouse:master' into opt_array_map 2024-08-13 11:41:12 +08:00
Arthur Passos
4c6aca2eed add docs about reset auth method 2024-08-12 15:58:10 -03:00
Arthur Passos
64d50d6e5b Merge branch 'master' into multi_auth_methods 2024-08-12 15:42:37 -03:00
marco-vb
2068fbb157 Added support for single wildcard usage in x509 SubjectAltName user identification (both DNS and URI). 2024-08-12 15:39:52 +00:00
Igor Nikonov
b6f5eb1211 Fix screwed merge 2024-08-11 23:15:19 +00:00
Igor Nikonov
d04db7e26d Merge remote-tracking branch 'origin/master' into pr-local-plan 2024-08-11 20:11:32 +00:00
Kirill Nikiforov
ee89a36b4a
Merge remote-tracking branch 'origin' into feat/59376 2024-08-10 00:28:36 +03:00
Antonio Andelic
0d38aa98ce Merge branch 'master' into read-cgroup-memory-usage-async-metrics 2024-08-09 15:44:47 +02:00
Antonio Andelic
b6c3619543 Whitespace 2024-08-09 15:41:11 +02:00
Antonio Andelic
b2172af817 Merge branch 'master' into keeper-some-improvement2 2024-08-09 14:50:52 +02:00
Anton Popov
66534e3795 fix build 2024-08-08 16:32:40 +00:00
Anton Popov
31b17d12fd Merge remote-tracking branch 'upstream/master' into HEAD 2024-08-08 14:32:58 +00:00
vdimir
39b2a5d9b8
Merge branch 'master' into vdimir/multiple_joins_with_storage_join 2024-08-08 12:13:01 +02:00
vdimir
ef40cc3bae
Merge branch 'master' into vdimir/datetime64_constant_to_ast_f 2024-08-08 12:12:22 +02:00
JackyWoo
6e7587e9b3 Fix test for old analyzer 2024-08-08 14:44:08 +08:00
JackyWoo
21cdbe03f9 Add more test cases 2024-08-08 11:21:19 +08:00
JackyWoo
5f747bc411 Add more test for implicitly type conversion 2024-08-08 11:09:59 +08:00
Matt Woenker
f8a14e86d8 Add const a few places 2024-08-07 16:32:13 -04:00
Matt Woenker
d09531e48a Rename test files 2024-08-07 16:25:01 -04:00
Matt Woenker
cff7cbac94 Style fix 2024-08-07 16:21:16 -04:00
iceFireser
eee3811e89 empty commit 2024-08-08 00:43:37 +08:00
iceFireser
3a89b7034f modify integration test 2024-08-07 19:16:22 +08:00
vdimir
f5c07b8938
Add test cases to 03217_datetime64_constant_to_ast 2024-08-07 09:43:13 +00:00
Antonio Andelic
5ea4844d69 Merge branch 'master' into keeper-some-improvement2 2024-08-07 11:26:33 +02:00
iceFireser
7d42101593 Re-trigger ci 2024-08-07 14:19:40 +08:00
JackyWoo
cfaa852af9 Little fix 2024-08-07 11:40:01 +08:00
JackyWoo
aafe498b7f Handle edge case: col_int32 > 10.6 2024-08-07 11:29:34 +08:00
taiyang-li
f0f1015162 fix style 2024-08-07 10:47:13 +08:00
Matt Woenker
f4ed3f5c6d Add test 2024-08-06 16:14:26 -04:00
Matt Woenker
2a1ee419b4 Fix style issue 2024-08-06 15:53:49 -04:00
Matt Woenker
704ec8dea6 Handle incomplete sequences at end of input 2024-08-06 12:49:23 -04:00
Anton Popov
0a54ba6575 better on-fly mutations 2024-08-06 16:46:32 +00:00
Anton Popov
21f7e0788c Merge remote-tracking branch 'upstream/master' into HEAD 2024-08-06 15:13:51 +00:00
sunny
20cd84960e
modify code style
modify code style
2024-08-06 21:42:14 +08:00
JackyWoo
3769f8a465 Fix tests 2024-08-06 20:44:42 +08:00
vdimir
b89107f1ae
Merge branch 'master' into vdimir/multiple_joins_with_storage_join 2024-08-06 11:19:14 +02:00
iceFireser
222079e032 empty commit 2024-08-06 12:48:52 +08:00
iceFireser
4a0300736d empty commit 2024-08-06 12:46:22 +08:00
JackyWoo
8259a9827e Update reference file for tests 2024-08-06 10:29:42 +08:00
JackyWoo
46da03030c Add test for implicitly type conversion 2024-08-06 10:05:45 +08:00
JackyWoo
4fa30da118 Fix docs 2024-08-06 09:56:38 +08:00
sunny19930321
e2b74e4176 feat: add delete from in pastition cmd 2024-08-05 19:32:45 +08:00
JackyWoo
a36424fc8c Add supported data types to documents 2024-08-05 18:59:09 +08:00
JackyWoo
c61225ede4 Rewrite tests 2024-08-05 18:37:36 +08:00
Robert Schulze
7765ff6d52
Minor fixups 2024-08-05 07:51:58 +00:00
taiyang-li
045551f509 fix bugs 2024-08-05 11:33:58 +08:00
JackyWoo
d1305d9fad Some fixups and split tests 2024-08-05 11:26:57 +08:00
taiyang-li
d0cb299b22 merge master 2024-08-04 22:05:01 +08:00
taiyang-li
1120a51bd2 merge master 2024-08-04 17:07:16 +08:00
taiyang-li
122c9794a6 remove useless codes 2024-08-04 17:04:04 +08:00
taiyang-li
00a9c30363 optimize map function 2024-08-04 16:16:51 +08:00
taiyang-li
a498259ec8 optimize array with mutiple arguments 2024-08-04 13:32:17 +08:00
taiyang-li
e5d4eaa458 fix bugs 2024-08-03 21:08:21 +08:00
taiyang-li
0f2024306d optimize array() with single arguments and map() with double arguments 2024-08-03 17:03:27 +08:00
serxa
3bff7ddcf8 fix data race: delay reset of data hooks until the next sendRequest() 2024-08-02 13:19:00 +00:00
serxa
8724c5ad52 Merge branch 'master' into s3-streams-scheduler 2024-08-02 09:52:55 +00:00
vdimir
7e0be5b48d
Merge branch 'master' into vdimir/multiple_joins_with_storage_join 2024-08-02 10:58:28 +02:00
JackyWoo
7a5dd4401d Merge branch 'master' into add_statistics_minmax 2024-08-02 16:14:23 +08:00
iceFireser
5ebb2c54b0 Re-trigger ci 2024-08-02 14:07:44 +08:00
Igor Nikonov
36036c3da9 Merge remote-tracking branch 'origin/master' into pr-local-plan 2024-08-01 20:33:41 +00:00
Igor Nikonov
85b8c11175 Fix flaky 0_stateless/02784_parallel_replicas_automatic_decision
- avoid max_threads randomzation
2024-08-01 20:32:03 +00:00
Igor Nikonov
7082a9797e Merge remote-tracking branch 'origin/master' into pr-local-plan 2024-08-01 14:22:26 +00:00
Igor Nikonov
c5a2f3aafb Limit min_marks_for_concurrent_read 2024-08-01 14:21:54 +00:00
vdimir
1c0a09a98a
Merge branch 'master' into vdimir/multiple_joins_with_storage_join 2024-08-01 12:10:04 +02:00
Dmitry Novik
d24fe7c7a3
Merge branch 'master' into vdimir/multiple_joins_with_storage_join 2024-07-31 14:04:03 +02:00
Igor Nikonov
936e3d9a21 Merge remote-tracking branch 'origin/master' into pr-local-plan 2024-07-31 11:04:01 +00:00
JackyWoo
43a3f717be Merge branch 'master' into add_statistics_minmax 2024-07-31 15:15:12 +08:00
JackyWoo
3adbc4cd33 Fix code style 2024-07-31 15:10:29 +08:00
Igor Nikonov
0705bbb42b Merge remote-tracking branch 'origin/master' into pr-local-plan 2024-07-30 16:59:07 +00:00
Igor Nikonov
7d443c6b97 Merge remote-tracking branch 'origin/master' into pr-local-plan 2024-07-30 16:27:50 +00:00
Igor Nikonov
bce0f46254 Simplify tests/queries/0_stateless/02967_parallel_replicas_join_algo_and_analyzer_3.sh
+ enable parallel_replicas_local_plan by default
2024-07-30 16:26:01 +00:00
Arthur Passos
fa6564dbe3 Merge branch 'master' into multi_auth_methods 2024-07-30 10:32:13 -03:00
iceFireser
ec759699f3 format the tests/integration/test_replicated_database/test.py 2024-07-30 21:07:59 +08:00
haozelong
16d7ff11be Fix the problem that alter modfiy order by causes inconsistent metadata 2024-07-30 17:16:19 +08:00
Igor Nikonov
d711ec118c Fix build 2024-07-30 09:04:59 +00:00
Igor Nikonov
5ffa54bd70 Merge remote-tracking branch 'origin/master' into pr-local-plan 2024-07-30 08:00:08 +00:00
Igor Nikonov
9501bc8a75 Fix forgotten conflict 2024-07-29 20:33:06 +00:00
Igor Nikonov
cf27f2665e Merge remote-tracking branch 'origin/master' into pr-local-plan 2024-07-29 20:00:55 +00:00
Igor Nikonov
ce134830b7 Disable pr local plan by default 2024-07-29 17:15:15 +00:00
Arthur Passos
ae72bd57f2 try to fix docs? is it broken at all 2024-07-29 09:50:54 -03:00
Arthur Passos
c433d9cfdb retrigger ci 2024-07-28 12:33:15 -03:00
Arthur Passos
f5ee7aaf26 update some integ tests 2024-07-28 10:04:38 -03:00
Arthur Passos
352b502559 update logout session 2024-07-26 14:47:37 -03:00
Arthur Passos
546cca1251 small comment update 2024-07-26 14:42:58 -03:00
Arthur Passos
456613e7fa minor doc change 2024-07-26 14:40:50 -03:00
Arthur Passos
5a45563f1b add note about downgrading 2024-07-26 14:36:58 -03:00
Arthur Passos
a21529f66a style 2024-07-26 11:05:05 -03:00
Antonio Andelic
91e0df33db Merge branch 'master' into read-cgroup-memory-usage-async-metrics 2024-07-26 15:55:42 +02:00
Arthur Passos
921947e368 fix tests and add new one 2024-07-26 10:45:25 -03:00
Antonio Andelic
71a5a42f8f Merge branch 'master' into read-cgroup-memory-usage-async-metrics 2024-07-26 11:17:54 +02:00
Arthur Passos
93cbd4bf9a update test 2024-07-25 17:44:38 -03:00
avogar
eb300f4f78 Better implementation 2024-07-25 18:59:06 +00:00
avogar
f00928afa1 Improve castOrDefault from Variant/Dynamic columns 2024-07-25 18:41:43 +00:00
Arthur Passos
77d46aad05 change auth_params type from string to array<string> 2024-07-25 14:24:26 -03:00
Arthur Passos
0404a8e800 make auth_type a vector of int8_t and auth_params a json array 2024-07-25 14:14:31 -03:00
Anton Popov
4d15407b60 Merge remote-tracking branch 'upstream/master' into HEAD 2024-07-25 13:19:10 +00:00
Alexey Korepanov
63ccbcbdfc Remove test tags 2024-07-25 13:22:47 +01:00
Anton Popov
97ceca4b92 fix reading from Merge tables 2024-07-25 12:20:39 +00:00
Arthur Passos
8eda32600f remove todo 2024-07-25 09:13:09 -03:00
Arthur Passos
f3f9d5f4de add notes about no_password behavior 2024-07-25 09:07:13 -03:00
JackyWoo
b9703ad924 Fix logical error when estimating 2024-07-25 15:14:12 +08:00
Antonio Andelic
f449c2fea0 Fix 2024-07-25 08:45:08 +02:00
Igor Nikonov
420075ada0 Merge remote-tracking branch 'origin/master' into pr-local-plan 2024-07-24 19:51:47 +00:00
Alexey Korepanov
caaf14a0a9 Fix flaky test by ignoring progress lines when comparing output 2024-07-24 17:56:14 +01:00
Alexey Korepanov
b0ec8c92fc Fix totals json object 2024-07-24 17:49:33 +01:00
Alexey Korepanov
118e329e23 Fix flaky test 2024-07-24 13:09:47 +01:00
JackyWoo
3f7cd09d16 Remove useless function tryConvertToFloat64 2024-07-24 18:02:26 +08:00
JackyWoo
5ae356e6df Add document for min_max statistics 2024-07-24 17:54:48 +08:00
JackyWoo
40fc0ca574 Uniq statistics supports more datatypes and refactor logical when there is no statistics. 2024-07-24 17:43:27 +08:00
JackyWoo
4712b79960 Add min_max as statistics type 2024-07-24 16:41:37 +08:00
Antonio Andelic
e2e4c8ee0f Better 2024-07-24 10:21:09 +02:00
Antonio Andelic
7e026aec8b Merge branch 'master' into read-cgroup-memory-usage-async-metrics 2024-07-24 09:55:25 +02:00
Antonio Andelic
ec5459a60d Update allocated with resident if no jemalloc 2024-07-24 09:15:34 +02:00
Igor Nikonov
f49412e967 Change local replica position in parallel_replicas cluster 2024-07-23 17:16:40 +00:00
Igor Nikonov
87ad12e5fc Fix typo 2024-07-23 17:16:11 +00:00
Igor Nikonov
6a6147a97f Merge remote-tracking branch 'origin/master' into pr-local-plan 2024-07-23 15:44:18 +00:00
Igor Nikonov
f5630f86e4 Fix: resize pools_to_use correctly (keep local replica in it) 2024-07-23 15:43:25 +00:00
Anton Popov
36b264fe01 Merge remote-tracking branch 'upstream/master' into HEAD 2024-07-23 14:58:34 +00:00
Antonio Andelic
04d80ec276 Fix non-linux build 2024-07-23 16:13:07 +02:00
Antonio Andelic
9d92bcff46 Merge branch 'master' into read-cgroup-memory-usage-async-metrics 2024-07-23 16:09:21 +02:00
Alexey Korepanov
f3710e9a29 Add stateless test for JSONCompactWithProgress output format 2024-07-23 15:04:05 +01:00
Alexey Korepanov
ef4ad01d7d Fix totals formatting 2024-07-23 15:03:01 +01:00
Igor Nikonov
217e50d12e Merge remote-tracking branch 'origin/master' into pr-local-plan 2024-07-23 13:38:28 +00:00
Igor Nikonov
842b51c782 Try assigning replica numbers consistently independent of initiator 2024-07-23 13:30:40 +00:00
Arthur Passos
0204de640f fix test that was recently introduced 2024-07-23 09:32:59 -03:00
Alexey Korepanov
a4a0611c1c Fix docs spelling 2024-07-23 12:29:40 +01:00
Alexey Korepanov
53a5522184 Fix example output in the documentation 2024-07-23 12:19:06 +01:00
Alexey Korepanov
0631ff9377 Add jsoncompactwithprogress to aspell-dict.txt 2024-07-23 12:14:54 +01:00
vdimir
383221b04d
Analyzer: Storage Join support joining with nullable columns 2024-07-23 10:36:18 +00:00
Antonio Andelic
ade79cfd7a More fixes 2024-07-23 12:27:08 +02:00
Antonio Andelic
5b51a35e01 Add unused variables 2024-07-23 11:31:34 +02:00
Antonio Andelic
5a1b96ac84 Style fix 2024-07-23 10:52:14 +02:00
Antonio Andelic
d78cfd030f Use cgroups as source 2024-07-23 10:33:12 +02:00
Igor Nikonov
fbaca99e3a Merge remote-tracking branch 'origin/master' into pr-local-plan 2024-07-23 06:38:58 +00:00
Igor Nikonov
420716d702 Fix clang-tidy warning 2024-07-23 06:38:37 +00:00
Arthur Passos
0b151bbe8f fix conflict 2024-07-22 14:31:57 -03:00
Igor Nikonov
4483f4b389 Better logging for announcement 2024-07-22 16:39:07 +00:00
Antonio Andelic
48e7057200 Merge branch 'master' into keeper-some-improvement2 2024-07-22 16:51:20 +02:00
Igor Nikonov
9900abade6 Merge remote-tracking branch 'origin/master' into pr-local-plan 2024-07-22 13:45:31 +00:00
Igor Nikonov
fa0f4543b6 Fix marks multiplier for local replica to avoid overflow with fuzzer 2024-07-22 13:44:25 +00:00
Antonio Andelic
1c3f7d0fd0 Small fix 2024-07-22 15:18:13 +02:00
Antonio Andelic
a3840179cc Merge branch 'master' into read-cgroup-memory-usage-async-metrics 2024-07-22 12:58:36 +02:00
Antonio Andelic
1d1dc9c7ad
Merge branch 'master' into read-cgroup-memory-usage-async-metrics 2024-07-21 10:37:01 +01:00
Antonio Andelic
2147a96475 Better 2024-07-21 11:32:57 +02:00
Igor Nikonov
4753f4cb33 Merge remote-tracking branch 'origin/master' into pr-local-plan 2024-07-20 20:54:11 +00:00
Igor Nikonov
4e69cd0d52 Avoid getting callbacks from context for local plan 2024-07-20 20:53:18 +00:00
Igor Nikonov
daabf2275e Remove wrong comment 2024-07-19 21:46:14 +00:00
Anton Popov
2df3e99666 better mutations snapshot 2024-07-19 17:22:54 +00:00
Anton Popov
c16aab6c25 Merge remote-tracking branch 'upstream/master' into HEAD 2024-07-19 13:59:41 +00:00
Igor Nikonov
75f7816c46 Merge remote-tracking branch 'origin/master' into pr-local-plan 2024-07-19 08:24:54 +00:00
Igor Nikonov
6db09e884b Simplify code 2024-07-19 08:24:29 +00:00
Arthur Passos
f2c22408da
Merge branch 'master' into multi_auth_methods 2024-07-18 17:13:50 -03:00
Antonio Andelic
7d66f400b2 Better 2024-07-18 17:40:17 +02:00
Igor Nikonov
7ad07657a3 Fix 2024-07-18 14:16:44 +00:00
Igor Nikonov
7523dafc06 Fix after incorrect merge conflict resolution 2024-07-18 13:09:07 +00:00
Igor Nikonov
e47fe15968 Simplify condition 2024-07-18 12:22:03 +00:00
Antonio Andelic
05c7dc582a Add some comments 2024-07-18 13:40:03 +02:00
Igor Nikonov
e438f58f21 Merge remote-tracking branch 'origin/master' into pr-local-plan 2024-07-18 11:34:04 +00:00
Antonio Andelic
9ec1fd1ab7 Fix non-jemalloc builds 2024-07-18 12:13:44 +02:00
Antonio Andelic
9a43183eb3 Finish background memory thread 2024-07-18 10:40:47 +02:00
Antonio Andelic
c413e7a494 Merge branch 'master' into read-cgroup-memory-usage-async-metrics 2024-07-18 09:01:54 +02:00
Antonio Andelic
21009577d8 Dedicated memory background thread 2024-07-18 09:01:20 +02:00
Antonio Andelic
97f4ec2adb Read cgroup memory usage in async metrics thread 2024-07-17 16:59:35 +02:00
Igor Nikonov
7fba824ed2 Merge remote-tracking branch 'origin/master' into pr-local-plan 2024-07-17 11:45:34 +00:00
Igor Nikonov
baf3408b16 Fix: fallback to local plan w/o PR in case of empty table 2024-07-17 11:45:00 +00:00
Igor Nikonov
a3d4fd9246 Fix 02950_parallel_replicas_used_count 2024-07-17 10:01:26 +00:00
Igor Nikonov
fc693cc982 Fix 02982_parallel_replicas_unexpected_cluster 2024-07-16 21:05:27 +00:00
Igor Nikonov
5347754aed Merge remote-tracking branch 'origin/master' into pr-local-plan 2024-07-16 20:03:36 +00:00
Igor Nikonov
08dc1c8c37 Fallback to local execution in case of cluster(shard) has only one node 2024-07-16 19:59:16 +00:00
Igor Nikonov
0056db42be Merge remote-tracking branch 'origin/master' into pr-local-plan 2024-07-16 08:57:57 +00:00
Igor Nikonov
4caf9b6e6f Better diagnostic message formatting 2024-07-16 08:57:15 +00:00
Igor Nikonov
27db36cd4f Separate converting actions in separte source file 2024-07-16 08:46:24 +00:00
Igor Nikonov
69c1e68359 Fix clang-tidy warning: remove include duplicate 2024-07-16 07:48:40 +00:00
Igor Nikonov
65ba0dd669 Merge remote-tracking branch 'origin/master' into pr-local-plan 2024-07-15 20:42:25 +00:00
Igor Nikonov
860b18c251 Update test for in-(reverse)-order coordinator 2024-07-15 20:40:55 +00:00
Arthur Passos
006f20858a remove dupl inc 2024-07-15 17:01:02 -03:00
Igor Nikonov
02a2f50916 Fix clang warning 2024-07-15 18:37:19 +00:00
Arthur Passos
cc02ebca75 Merge branch 'master' into multi_auth_methods 2024-07-15 10:55:40 -03:00
Igor Nikonov
fdbafdb8db Merge remote-tracking branch 'origin/master' into pr-local-plan 2024-07-15 12:04:04 +00:00
Igor Nikonov
261ff133b8 Fix 02784_parallel_replicas_automatic_decision_join 2024-07-15 12:03:12 +00:00
Igor Nikonov
f7befaf68e Polish + comments 2024-07-14 18:46:14 +00:00
Igor Nikonov
9f20e33d50 Fix 2024-07-14 17:52:51 +00:00
Igor Nikonov
c494096d33 Merge remote-tracking branch 'origin/master' into pr-local-plan 2024-07-14 16:39:06 +00:00
Igor Nikonov
0c986cca7c Fix in-order coordinator
+ register all replicas for parts in working set
2024-07-14 16:37:00 +00:00
Igor Nikonov
32dc3fe8d1 Simplify code 2024-07-13 21:19:14 +00:00
Igor Nikonov
f42fe31396 Merge remote-tracking branch 'origin/master' into pr-local-plan 2024-07-12 21:21:04 +00:00
Igor Nikonov
b952a11f35 Fix 00177_memory_bound_merging 2024-07-12 21:20:23 +00:00
Arthur Passos
3ab6760412 update docs 2024-07-12 15:21:29 -03:00
Alexander Tokmakov
ae77d70a03 Merge branch 'master' into break_compatibility 2024-07-12 19:30:31 +02:00
Arthur Passos
ca0b821aaf fix a few ut 2024-07-12 14:26:24 -03:00
Igor Nikonov
e22d6035fa Cleanup 2024-07-12 14:11:04 +00:00
Igor Nikonov
4e44ecf286 Fixate setting in 02967_parallel_replicas_joins_and_analyzer 2024-07-12 13:52:33 +00:00
Igor Nikonov
6b1a63792d Merge remote-tracking branch 'origin/master' into pr-local-plan 2024-07-12 13:43:34 +00:00
Igor Nikonov
04c3661b0b Randomize parallel_replicas_local_plan 2024-07-12 13:42:25 +00:00
Arthur Passos
2e9b7e8334 Removed stale comment and added log_info about skipped auth methods 2024-07-12 10:20:59 -03:00
Arthur Passos
b428327c6e trigger ci 2024-07-12 09:20:36 -03:00
Arthur Passos
8e0e2cec28 fix hilite test 2024-07-11 18:06:40 -03:00
Arthur Passos
300d4ae593 add comment back and missing file 2024-07-11 17:23:37 -03:00
Arthur Passos
ee62318348 rename test and add a few more 2024-07-11 17:21:33 -03:00
Arthur Passos
29e0d5c1e3 use comma separated instead of multiple add id add id 2024-07-11 17:04:28 -03:00
Igor Nikonov
1a8e1eb0fe Merge remote-tracking branch 'origin/master' into pr-local-plan 2024-07-11 11:14:12 +00:00
Igor Nikonov
69652477f4 Merge remote-tracking branch 'origin/master' into pr-local-plan 2024-07-11 10:17:28 +00:00
Arthur Passos
91e8ef6776 do not allow no_pwd to co-exist with other auth methods 2024-07-10 09:11:02 -03:00
Antonio Andelic
5a96290cce Merge branch 'master' into keeper-some-improvement2 2024-07-10 12:45:43 +02:00
Arthur Passos
acc2249288 do not allow no_password to co-exist with other auth methods 2024-07-09 22:05:04 -03:00
Arthur Passos
e36776551e remove unused extern 2024-07-09 15:58:57 -03:00
Arthur Passos
cd0145113f allow other auth methods to be used if no_password is setup but not allowed 2024-07-09 15:05:24 -03:00
Alexander Tokmakov
6cb361413e fix 2024-07-09 17:56:12 +02:00
Alexander Tokmakov
b948d5ad85 Merge branch 'master' into break_compatibility 2024-07-09 15:42:09 +02:00
Anton Popov
7e790d8084 fix rename 2024-07-08 13:25:51 +00:00
Alexey Korepanov
a3360d0e63 Fix code style 2024-07-08 13:53:24 +02:00
Anton Popov
9382349238 Merge remote-tracking branch 'upstream/master' into HEAD 2024-07-08 10:33:48 +00:00
Alexey Korepanov
7fbcaeaae2 Remove wrong comment 2024-07-08 09:29:14 +02:00
Alexey Korepanov
78cb02503f Remove extra space 2024-07-08 09:22:07 +02:00
Alexey Korepanov
58d34e306c Add documentation on JSONCompactWithProgress 2024-07-08 09:08:03 +02:00
Alexey Korepanov
00e47d64b0 Add JSONCompactWithProgressStrings format 2024-07-08 09:02:07 +02:00
Alexey Korepanov
2469647609 Fix statistics section 2024-07-07 21:30:36 +02:00
Alexey Korepanov
2ae9490a68 Fix progress rows and bytes read 2024-07-07 21:22:02 +02:00
Alexey Korepanov
88736a0d74 Update JSONCompactWithProgressRowOutputFormat to print JSON on each row 2024-07-07 21:12:26 +02:00
Alexander Tokmakov
e7105a3faa fix 2024-07-05 22:43:35 +02:00
Arthur Passos
5a2b0ea1cc simplify formatting of astauth 2024-07-05 16:08:10 -03:00
Alexander Tokmakov
0e6fd2251e fix 2024-07-05 17:57:21 +02:00
Alexander Tokmakov
ac17c7194d Merge branch 'master' into break_compatibility 2024-07-05 16:35:52 +02:00
Alexander Tokmakov
613636bb1b fix 2024-07-05 16:34:13 +02:00
serxa
fefcc52c24 add logging of too long resource requests for http sessions 2024-07-05 11:09:10 +00:00
serxa
3fa5ad92b4 rename IHTTPSessionDataHooks methods 2024-07-05 10:33:22 +00:00
serxa
54fda05094 reset session send/recv hooks at connection destruction 2024-07-05 10:25:04 +00:00
serxa
d7ee82b3fe Merge branch 'master' into s3-streams-scheduler 2024-07-05 10:08:45 +00:00
Anton Popov
826f6c1ce5 fix initialization 2024-07-04 17:56:08 +00:00
Alexander Tokmakov
aa9591419d fix 2024-07-04 19:15:06 +02:00
Alexander Tokmakov
995413662b Merge branch 'master' into break_compatibility 2024-07-04 19:00:13 +02:00
Alexander Tokmakov
4e350ff44a don't allow explicit uuids and rmt args in replicated db 2024-07-04 18:56:37 +02:00
Anton Popov
cb884d0ac7 fix applying of metadata mutations 2024-07-03 15:35:52 +00:00
Igor Nikonov
b51e1b27db Merge remote-tracking branch 'origin/master' into pr-local-plan 2024-07-03 07:51:38 +00:00
Igor Nikonov
3b31590477 Merge remote-tracking branch 'origin/master' into pr-local-plan 2024-07-02 20:40:04 +00:00
Igor Nikonov
6124772cd8 Merge remote-tracking branch 'origin/master' into pr-local-plan 2024-07-02 15:09:40 +00:00
Igor Nikonov
105d39b09f Twick number of threads 2024-07-02 15:06:19 +00:00
Arthur Passos
cc13783acd Merge branch 'master' into multi_auth_methods 2024-07-02 09:11:20 -03:00
Antonio Andelic
7e22af06f1 Merge branch 'master' into keeper-some-improvement2 2024-07-02 09:01:48 +02:00
Igor Nikonov
6b3750ff83 Clean up 2024-07-01 08:28:54 +00:00
Igor Nikonov
71b0ab94be Merge remote-tracking branch 'origin/master' into pr-local-plan 2024-06-30 20:54:42 +00:00
Igor Nikonov
37fbf905dd Use only local snapshot for in order coordinator 2024-06-30 20:33:43 +00:00
Arthur Passos
6f020901a8 add a few comments 2024-06-29 18:39:01 -03:00
Arthur Passos
306d55f636 add some docs 2024-06-29 18:29:05 -03:00
Anton Popov
096616bd1f introduce mutations snapshot 2024-06-28 22:27:44 +00:00
Igor Nikonov
a471716a7f Merge remote-tracking branch 'origin/master' into pr-local-plan 2024-06-28 22:18:07 +00:00
Igor Nikonov
ebcf455f4a Fix: progress bar for reading in order 2024-06-28 22:17:34 +00:00
Arthur Passos
27c9bb9b10 add missing reference qualifier 2024-06-28 17:06:06 -03:00
Arthur Passos
1cd253e05f fix integ test 2024-06-28 12:48:38 -03:00
Igor Nikonov
9b694e611c Merge remote-tracking branch 'origin/master' into pr-local-plan 2024-06-28 14:02:28 +00:00
Arthur Passos
e9360221b7 trigger ci 2024-06-28 08:40:32 -03:00
Igor Nikonov
23d7e0148f Merge remote-tracking branch 'origin/master' into pr-local-plan 2024-06-27 20:31:35 +00:00
Igor Nikonov
372b948d34 Fix: progress bar, reading in order 2024-06-27 20:30:05 +00:00
Arthur Passos
eb8a18304f rename somem stuff 2024-06-27 17:08:14 -03:00
Arthur Passos
e111958762 remmovev optional from auth data in session object 2024-06-27 14:33:28 -03:00
Arthur Passos
43a9194739 remove optional from auth_result 2024-06-27 14:21:29 -03:00
Arthur Passos
50da0cb732 remove definition of logical_error from auth.cpp 2024-06-27 12:14:08 -03:00
Arthur Passos
a948334b8b minor 2024-06-27 11:53:42 -03:00
Arthur Passos
b219b99380 small refactor 2024-06-27 11:50:16 -03:00
Arthur Passos
21de3e2961 try to fix black 2024-06-27 10:05:37 -03:00
Arthur Passos
f69a19d01d try to fix black 2024-06-27 09:20:12 -03:00
Arthur Passos
ec0d426a6f try to fix black 2024-06-27 08:52:20 -03:00
Arthur Passos
678700f137 update some other tests 2024-06-26 22:26:46 -03:00
Arthur Passos
95f584c5d0 black 2024-06-26 17:25:46 -03:00
Arthur Passos
c0e1095e66 initial fix for session_log, shall be refactored 2024-06-26 17:06:38 -03:00
Arthur Passos
938004c090 update yet another test 2024-06-26 16:40:40 -03:00
Arthur Passos
a77a0b5eb0 black 2024-06-26 13:59:57 -03:00
Arthur Passos
3e77101b16 update some other tests 2024-06-26 13:29:13 -03:00
Arthur Passos
341071402c fix wrong expected error code & add test 2024-06-26 11:00:13 -03:00
Arthur Passos
f15551b47b black 2024-06-26 09:38:55 -03:00
Arthur Passos
c2dd3bb5d2 Merge branch 'master' into multi_auth_methods 2024-06-26 09:03:58 -03:00
Arthur Passos
b93c21a041 add no-parallel to grant_and_Revoke.sql 2024-06-26 08:58:44 -03:00
Arthur Passos
4d800a8487 update test_disk_access_storage 2024-06-26 08:54:58 -03:00
Arthur Passos
11e537cb28 update some more tests 2024-06-26 08:51:30 -03:00
Igor Nikonov
60153d428d Merge remote-tracking branch 'origin/master' into pr-local-plan 2024-06-26 10:12:42 +00:00
Igor Nikonov
7c6293a747 Fix test_parallel_replicas_no_replicas 2024-06-26 10:12:09 +00:00
Arthur Passos
35214a34ee update some tests 2024-06-25 22:39:30 -03:00
Arthur Passos
57afc5f035 serialize no_password 2024-06-25 20:02:19 -03:00
Igor Nikonov
3d35d31655 More cleanup 2024-06-25 16:11:04 +00:00
Igor Nikonov
64cfe1628f Cleanup ReadFromMergeTree.h 2024-06-25 15:21:44 +00:00
Igor Nikonov
0eff924475 Use parallel_replicas_local_plan in test 2024-06-25 15:11:02 +00:00
Igor Nikonov
510cb961a1 Fix 2024-06-25 14:47:38 +00:00
Igor Nikonov
318af3af95 Cleanup 2024-06-25 14:31:11 +00:00
Igor Nikonov
96b68cb920 Update setting in 02404_memory_bound_merging 2024-06-25 13:33:36 +00:00
Igor Nikonov
36793bb126 Merge remote-tracking branch 'origin/master' into pr-local-plan 2024-06-25 12:30:03 +00:00
Igor Nikonov
f62873b173 Fix 02404_memory_bound_merging 2024-06-25 12:29:21 +00:00
Arthur Passos
907a54e9f6 add no parallel 2024-06-24 21:21:03 -03:00
Arthur Passos
a1928bd299 no-fast test 2024-06-24 19:39:26 -03:00
Arthur Passos
c7aed3c98c Revert "dont test ssh at all, it wont work if openssl is not built"
This reverts commit 4d5676f455.
2024-06-24 19:37:46 -03:00
Arthur Passos
96cb9f13dd remove comments 2024-06-24 16:51:34 -03:00
Arthur Passos
4d5676f455 dont test ssh at all, it wont work if openssl is not built 2024-06-24 16:50:23 -03:00
Arthur Passos
5bdd49f36c do not gen at runtime, use pre-built ones 2024-06-24 16:43:19 -03:00
Arthur Passos
d4da0a0a21 use plaintext_password instead of sha256 because of cicd 2024-06-24 16:30:08 -03:00
Arthur Passos
fe0d3b3e27 initial tests 2024-06-24 15:48:46 -03:00
Igor Nikonov
afa4d7fd5c Merge remote-tracking branch 'origin/master' into pr-local-plan 2024-06-24 14:32:05 +00:00
Igor Nikonov
5d91fd9717 Cleanup 2024-06-24 14:31:05 +00:00
Alexey Korepanov
e1c60c4e40 Remove debug output 2024-06-24 10:11:46 +02:00
Alexey Korepanov
20860ed8b0 Enable onProgress calls to JSONCompactWithProgressRowOutputFormat 2024-06-23 14:34:54 +02:00
Arthur Passos
9d19001945 Merge branch 'master' into multi_auth_methods 2024-06-22 10:52:47 -03:00
Alexey Korepanov
f9b70ea77a Add JSONCompactWithProgressRowOutputFormat 2024-06-22 09:30:16 +02:00
Arthur Passos
f55d15d9b9 Merge branch 'master' into multi_auth_methods 2024-06-21 15:39:02 -03:00
Arthur Passos
237abda2eb add some ut 2024-06-21 15:35:50 -03:00
Arthur Passos
08c9cc18d6 fix astcreateuserquery clone 2024-06-21 12:05:58 -03:00
Arthur Passos
55da169fe7 fix wrong condition 2024-06-21 10:30:12 -03:00
Arthur Passos
a1211a0f5a simplify syntax 2024-06-20 16:51:52 -03:00
Arthur Passos
179d54505a make progress, seems functional 2024-06-20 15:07:16 -03:00
Arthur Passos
1514dcbb34 ptal 2024-06-19 11:57:38 -03:00
Yarik Briukhovetskyi
a2f2d88cec
Merge branch 'ClickHouse:master' into time_buckets_impl 2024-06-19 15:26:03 +02:00
Igor Nikonov
9658d37d49 Add parallel_replicas_local_plan to settings history 2024-06-19 11:27:50 +00:00
serxa
7a01b8189c fix typo, renames 2024-06-19 00:49:21 +00:00
Igor Nikonov
dba6ea078f Setting parallel_replicas_local_plan 2024-06-18 19:47:07 +00:00
serxa
3458087ee4 Merge branch 'master' into s3-streams-scheduler 2024-06-18 17:08:41 +00:00
Yarik Briukhovetskyi
0804fa6dfc
Merge branch 'ClickHouse:master' into time_buckets_impl 2024-06-18 17:52:02 +02:00
Igor Nikonov
4093a6bacc Merge remote-tracking branch 'origin/master' into pr-local-plan 2024-06-18 13:05:16 +00:00
serxa
a9bfaf6454 style 2024-06-18 11:52:40 +00:00
serxa
ea21f61f19 Merge branch 'master' into s3-streams-scheduler 2024-06-18 11:23:12 +00:00
Igor Nikonov
7c82f45fb0 Merge remote-tracking branch 'origin/master' into pr-local-plan 2024-06-18 11:12:40 +00:00
Igor Nikonov
0ecefa6973 Better replicas notation in plan description 2024-06-18 11:07:15 +00:00
Igor Nikonov
366de07856 Remove prefer_localhost_replica 2024-06-18 10:39:50 +00:00
Igor Nikonov
c286188419 Update 00177_memory_bound_merging.reference 2024-06-18 10:39:13 +00:00
serxa
31795bdd5c Merge branch 's3-streams-scheduler' of github.com:ClickHouse/ClickHouse into s3-streams-scheduler 2024-06-18 10:01:30 +00:00
serxa
b598c3ee7b Merge branch 'master' into s3-streams-scheduler 2024-06-18 10:01:21 +00:00
Antonio Andelic
ac78184fe7 Merge branch 'tracing-try-2' into keeper-some-improvement2 2024-06-18 11:04:00 +02:00
Antonio Andelic
1777ff37c0 Merge branch 'master' into keeper-some-improvement2 2024-06-18 11:03:38 +02:00
Igor Nikonov
81668cc290 Merge remote-tracking branch 'origin/master' into pr-local-plan 2024-06-17 12:25:13 +00:00
Igor Nikonov
c87bfe102e Fix: correct local replica exclusion
- fixes 02731_parallel_replicas_join_subquery
2024-06-17 12:24:14 +00:00
Antonio Andelic
7dca59da56 Revert "Merge branch 'use-thread-from-global-pool-in-poco-threadpool' into keeper-some-improvement"
This reverts commit 737d7484c5, reversing
changes made to b3a742304e.
2024-06-17 09:03:49 +02:00
Arthur Passos
6ac24fcf54 fix test build 2024-06-14 18:08:01 -03:00
Igor Nikonov
70a33e633c Fix 02784_parallel_replicas_automatic_decision 2024-06-14 19:53:04 +00:00
Arthur Passos
70e4933221 fix no pwd authentication 2024-06-14 14:39:55 -03:00
robot-clickhouse
f3c3d419bb Automatic style fix 2024-06-14 16:18:06 +00:00
Sergei Trifonov
e15b1fbb45
Merge branch 'master' into s3-streams-scheduler 2024-06-14 18:12:19 +02:00
serxa
eaf91c1bb2 Merge branch 's3-streams-scheduler' of github.com:ClickHouse/ClickHouse into s3-streams-scheduler 2024-06-14 16:11:01 +00:00
serxa
709ef2ba85 add metrics and budget checks 2024-06-14 16:09:00 +00:00
Igor Nikonov
08032e97fd Merge remote-tracking branch 'origin/master' into pr-local-plan 2024-06-14 14:10:54 +00:00
Igor Nikonov
c2d38b3c93 Fix crash 2024-06-14 14:06:12 +00:00
Arthur Passos
c1250ccb35 append default constructed auth method upon alter without auth data 2024-06-14 10:58:57 -03:00
serxa
ec71d35aa6 add test for scheduler queue budget 2024-06-14 13:12:23 +00:00
Arthur Passos
98e5ea5206 style fix 2024-06-14 10:02:40 -03:00
serxa
a5eeeb3422 bugfix: wrong estimated cost passed for budget adjusting 2024-06-14 13:01:14 +00:00
Arthur Passos
b22776d3a8 throw exception upon auth 2024-06-14 09:34:10 -03:00
Igor Nikonov
245476b34b Consistent replica id assignment 2024-06-14 12:02:47 +00:00
Igor Nikonov
048cbb17a6 Comment to 02769_parallel_replicas_unavailable_shards.sql 2024-06-13 19:55:30 +00:00
serxa
937e170825 make ResourceGuards more straight-forward 2024-06-13 18:58:39 +00:00
robot-clickhouse
b74cf1a356 Automatic style fix 2024-06-13 15:43:16 +00:00
serxa
f1f354f22b add test for granularity and total byte size of resource requests 2024-06-13 15:33:59 +00:00
serxa
eb3c61915d fix mixed read and write links 2024-06-13 14:27:39 +00:00
Arthur Passos
d4c1faad3b testing the waters 2024-06-13 11:24:00 -03:00
serxa
19c2f7109f Merge branch 'master' into s3-streams-scheduler 2024-06-12 14:51:13 +00:00
serxa
aad55ab55f IO scheduling on HTTP session level 2024-06-12 14:49:06 +00:00
Igor Nikonov
f8afb299f6 Merge remote-tracking branch 'origin/master' into pr-local-plan 2024-06-12 10:30:43 +00:00
Igor Nikonov
164b5e47a8 Fix 02769_parallel_replicas_unavailable_shards 2024-06-12 10:30:15 +00:00
Igor Nikonov
eccd56c9b9 Fix style check 2024-06-11 20:16:00 +00:00
Igor Nikonov
da4ed273e3 Fix 02811_parallel_replicas_prewhere_count 2024-06-11 19:24:50 +00:00
Igor Nikonov
f46deb4e79 Fix clang-tidy 2024-06-11 16:49:51 +00:00
Igor Nikonov
f999eed376 Fix 02967_parallel_replicas_join_algo_and_analyzer 2024-06-11 16:49:11 +00:00
Antonio Andelic
0fa45c3954 More parallel storage 2024-06-11 16:39:35 +02:00
Igor Nikonov
a473ecd004 Merge remote-tracking branch 'origin/master' into pr-local-plan 2024-06-11 14:38:21 +00:00
Igor Nikonov
d6dec38103 Fix test_parallel_replicas_over_distributed 2024-06-11 14:37:42 +00:00
Igor Nikonov
23ca8608ba Fix 03006_parallel_replicas_prewhere 2024-06-11 13:25:19 +00:00
Antonio Andelic
c802d7d58a Writing improvements 2024-06-11 14:35:26 +02:00
Antonio Andelic
5ab06caffc Merge branch 'keeper-parallel-storage' into keeper-some-improvement2 2024-06-11 10:18:27 +02:00
Antonio Andelic
737d7484c5 Merge branch 'use-thread-from-global-pool-in-poco-threadpool' into keeper-some-improvement 2024-06-11 09:46:58 +02:00
Antonio Andelic
b3a742304e Merge branch 'master' into keeper-some-improvement 2024-06-11 09:46:41 +02:00
Igor Nikonov
bb57e0bc9c Merge remote-tracking branch 'origin/master' into pr-local-plan 2024-06-10 18:54:21 +00:00
kssenii
6514d72fea Move servers pool back 2024-06-10 18:53:51 +02:00
kssenii
c3d4b429d9 Fix merge 2024-06-10 15:39:54 +02:00
kssenii
7ff848c2c8 Merge remote-tracking branch 'origin/master' into use-thread-from-global-pool-in-poco-threadpool 2024-06-10 15:20:03 +02:00
kssenii
a11ba3f437 Fix shutdown 2024-06-10 15:19:03 +02:00
kssenii
6604d94271 Ping CI: skip fast test to see all stateless runs 2024-06-07 17:11:49 +02:00
Igor Nikonov
29d56b61b3 fix 02404_memory_bound_merging 2024-06-07 14:54:00 +00:00
Igor Nikonov
0999501308 Fix crash in in-order coordinator 2024-06-07 14:35:06 +00:00
kssenii
e30fa1da4d Fix ThreadStatus 2024-06-07 15:03:13 +02:00
Yarik Briukhovetskyi
f6d525f6df
Merge branch 'ClickHouse:master' into time_buckets_impl 2024-06-07 13:24:46 +02:00
Igor Nikonov
44fecf66ca Fix 02967_parallel_replicas_joins_and_analyzer 2024-06-06 17:11:42 +00:00
Igor Nikonov
7be90470d5 Fix 02731_parallel_replicas_join_subquery 2024-06-06 16:49:05 +00:00
yariks5s
c5ba8eb477 fix for origin 2024-06-06 16:46:38 +00:00
Igor Nikonov
7c1ffaec95 Merge remote-tracking branch 'origin/master' into pr-local-plan 2024-06-06 16:21:56 +00:00
yariks5s
63b0d13a62 trying to fix tests 2024-06-06 16:15:35 +00:00
Igor Nikonov
4f37fafe42 Fix 02771_parallel_replicas_analyzer 2024-06-06 15:57:12 +00:00
kssenii
7ea3345e0d Use ThreadFromGlobalPool in Poco::ThreadPool 2024-06-06 17:25:15 +02:00
kssenii
1e97d73bd0 Squashed commit of the following:
commit 27fe0439fa
Merge: bfb1c4c793 bb469e0d45
Author: Antonio Andelic <antonio@clickhouse.com>
Date:   Thu Jun 6 14:36:02 2024 +0200

    Merge branch 'master' into fix-global-trace-collector

commit bfb1c4c793
Author: Antonio Andelic <antonio@clickhouse.com>
Date:   Thu Jun 6 11:29:42 2024 +0200

    better

commit fcee260b25
Author: Antonio Andelic <antonio2368@users.noreply.github.com>
Date:   Thu Jun 6 11:22:48 2024 +0200

    Update src/Interpreters/TraceCollector.h

    Co-authored-by: alesapin <alesapin@clickhouse.com>

commit 1d3cf17053
Author: Antonio Andelic <antonio@clickhouse.com>
Date:   Thu Jun 6 11:11:08 2024 +0200

    Fix global trace collector
2024-06-06 17:13:37 +02:00
Yarik Briukhovetskyi
26503e1c53
Merge branch 'ClickHouse:master' into time_buckets_impl 2024-06-06 16:36:39 +02:00
Igor Nikonov
f8d4aabfe0 Initiliaze working set on pipelie initialization, right after analysis 2024-06-06 14:28:17 +00:00
Antonio Andelic
f0e9703384 Some small improvements 2024-06-06 09:45:07 +02:00
Yarik Briukhovetskyi
9a7888ba51
fix tests 2024-06-05 16:39:54 +02:00
Antonio Andelic
514941627b Merge branch 'master' into keeper-parallel-storage 2024-06-05 15:31:57 +02:00
Igor Nikonov
69009b886f Merge remote-tracking branch 'origin/master' into pr-local-plan 2024-06-05 11:58:42 +00:00
Igor Nikonov
3210d0f471 Simple renaming 2024-06-05 11:56:12 +00:00
Igor Nikonov
f39dbac9a0 Merge remote-tracking branch 'origin/master' into pr-local-plan 2024-06-05 06:46:56 +00:00
Igor Nikonov
6476e9ad9b Temporary test fix 2024-06-05 06:45:56 +00:00
Igor Nikonov
eece76bc41 Fix build 2024-06-01 20:53:46 +00:00
Igor Nikonov
2bc236f635 Merge remote-tracking branch 'origin/pr-plan-rewrite' into pr-local-plan 2024-06-01 18:22:03 +00:00
Igor Nikonov
e8a1a800dc Fix crash with JOINs 2024-05-29 20:57:16 +00:00
Igor Nikonov
40aab93db1 Correct replica id for inorder case 2024-05-29 20:55:02 +00:00
Igor Nikonov
e28ca7ebe8 Merge remote-tracking branch 'origin/pr-plan-rewrite' into pr-local-plan 2024-05-29 10:52:59 +00:00
Igor Nikonov
d756729f38 Use local working set for parallel replicas 2024-05-28 21:04:33 +00:00
Igor Nikonov
a9b485a2c1 Disable temporary PR inorder test 2024-05-28 19:05:09 +00:00
Igor Nikonov
4916e3376e Merge remote-tracking branch 'origin/pr-plan-rewrite' into pr-local-plan 2024-05-28 15:13:30 +00:00
Igor Nikonov
0c1bd2e477 Merge remote-tracking branch 'origin/master' into pr-local-plan 2024-05-28 14:35:22 +00:00
Igor Nikonov
1aa5d70d2a Fix style 2024-05-28 13:03:24 +00:00
Igor Nikonov
29346f6073 Init coordinator separately 2024-05-28 12:16:18 +00:00
Yarik Briukhovetskyi
1f26281493
build fix 2024-05-27 15:43:14 +02:00
Igor Nikonov
5cdf8d336c Local reading step from merge tree 2024-05-27 12:22:18 +00:00
Igor Nikonov
be08ebd0f4 Fix 2024-05-24 13:01:30 +00:00
Yarik Briukhovetskyi
a959663e97
Update toStartOfInterval.cpp 2024-05-23 16:43:18 +02:00
Yarik Briukhovetskyi
872818b363
Merge branch 'master' into time_buckets_impl 2024-05-23 13:39:35 +02:00
Igor Nikonov
fa8aafa942 Local plan for parallel replicas: save 2024-05-22 21:28:33 +00:00
Antonio Andelic
acc08c65d9 Add stopwatch 2024-05-22 11:56:45 +02:00
Antonio Andelic
f1e4403f98 Merge branch 'master' into keeper-parallel-storage 2024-05-22 11:39:57 +02:00
Antonio Andelic
b1d53f0472 Merge branch 'master' into keeper-parallel-storage 2024-04-29 15:13:19 +02:00
Kirill Nikiforov
115d7cfa57
fix after merge 2024-04-26 15:22:34 +03:00
Kirill Nikiforov
0b5d8ee6fb
Merge branch 'master' into feat/59376 2024-04-26 13:03:49 +03:00
Yarik Briukhovetskyi
938c888b13
Reload CI to remove build error (empty commit) 2024-04-11 17:01:01 +02:00
Yarik Briukhovetskyi
6109da248f
fix test 2024-04-10 14:29:13 +02:00
Yarik Briukhovetskyi
9aa0fa11f8
IntervalKind -> IntervalKind::Kind 2024-04-10 14:01:53 +02:00
Yarik Briukhovetskyi
b8073a6667
Merge branch 'master' into time_buckets_impl 2024-04-10 13:21:42 +02:00
Kirill Nikiforov
1d4aa10099
fix cs 2024-03-31 00:09:40 +03:00
Kirill Nikiforov
9c5e094289
fix cs 2024-03-27 19:57:41 +03:00
Kirill Nikiforov
0fbf612e15
support ATTACH PARTITION ALL FROM TABLE 2024-03-27 18:41:24 +03:00
Kirill Nikiforov
3e2f41f301
support ATTACH PARTITION ALL FROM TABLE 2024-03-27 18:35:44 +03:00
Antonio Andelic
bc3cfb008e Merge branch 'master' into keeper-parallel-storage 2024-03-25 13:14:57 +01:00
Yarik Briukhovetskyi
85a35dce28 fix tests 2024-01-12 17:22:16 +00:00
Yarik Briukhovetskyi
b6a98f7a24
Merge branch 'master' into time_buckets_impl 2024-01-12 17:48:14 +01:00
Yarik Briukhovetskyi
26561c6bdd
fix due to #58557 2024-01-12 17:47:17 +01:00
Yarik Briukhovetskyi
07f031ec8a
fix fuzzer 2024-01-08 15:34:22 +01:00
Yarik Briukhovetskyi
aadf5fab74
Merge branch 'ClickHouse:master' into time_buckets_impl 2024-01-08 13:28:31 +01:00
Yarik Briukhovetskyi
435439d6b3
Merge branch 'ClickHouse:master' into time_buckets_impl 2024-01-06 01:21:10 +01:00
Yarik Briukhovetskyi
1bfdc9a223 Merge branch 'time_buckets_impl' of https://github.com/yariks5s/ClickHouse into time_buckets_impl 2024-01-05 23:45:05 +00:00
Yarik Briukhovetskyi
1117284be7 fix overflow 2024-01-05 23:43:58 +00:00
Yarik Briukhovetskyi
cb645f8219
fix style 2024-01-05 17:18:56 +01:00
Yarik Briukhovetskyi
861421d27a fixes 2024-01-05 16:03:22 +00:00
Robert Schulze
174309821a
Small fixups 2023-12-19 20:48:30 +00:00
Yarik Briukhovetskyi
202ca21e3f
fix tests 2023-12-13 15:16:51 +01:00
Yarik Briukhovetskyi
36fa954f50
Stly check 2023-12-12 18:19:11 +01:00
Yarik Briukhovetskyi
2ebcd7ba42
Merge branch 'master' into time_buckets_impl 2023-12-12 17:58:37 +01:00
Yarik Briukhovetskyi
d1c49cc9bc
Added comments, simplified and fixed review 2023-12-12 17:55:53 +01:00
Yarik Briukhovetskyi
87bda03da1
logical error 2023-12-08 21:36:24 +01:00
Yarik Briukhovetskyi
53ef9c0cb8
Update 02207_subseconds_intervals.reference 2023-12-08 18:38:25 +01:00
Yarik Briukhovetskyi
5793725bc7 tests 2023-12-08 16:45:45 +00:00
Yarik Briukhovetskyi
4c83b7e46f style fix 2023-12-08 15:18:43 +00:00
Yarik Briukhovetskyi
e13eec9c5a fix 2023-12-08 15:07:39 +00:00
Yarik Briukhovetskyi
d08fd931be fix error 2023-12-08 13:42:00 +00:00
Yarik Briukhovetskyi
3027f3a04f fix tests 2023-12-07 15:29:11 +00:00
Yarik Briukhovetskyi
969c7f36a5
fix tests 2023-12-06 19:28:45 +01:00
Yarik Briukhovetskyi
7be47eca5e
Update 02916_to_start_of_interval_with_origin.reference 2023-12-06 19:28:27 +01:00
Yarik Briukhovetskyi
ac8d80da51
fix 2023-12-06 19:28:06 +01:00
Yarik Briukhovetskyi
e5fdad2160
fix non-const arguments 2023-12-06 19:09:55 +01:00
Yarik Briukhovetskyi
885e44c50e
style fix 2023-12-06 18:17:41 +01:00
Yarik Briukhovetskyi
bd105d51ce
fixed tests 2023-12-06 17:46:00 +01:00
Yarik Briukhovetskyi
65f34394cf
Update 02916_to_start_of_interval_with_origin.reference 2023-12-06 17:45:29 +01:00
Yarik Briukhovetskyi
01036a21f5
Fixed bugs regarding precision 2023-12-06 17:44:40 +01:00
Robert Schulze
450f609227
Various updates 2023-12-02 22:58:52 +00:00
Yarik Briukhovetskyi
8626506b2e
Merge branch 'master' into time_buckets_impl 2023-11-30 15:33:28 +01:00
Yarik Briukhovetskyi
b298bed1cf
Rename 02916_to_start_of_interva_with_origin.reference to 02916_to_start_of_interval_with_origin.reference 2023-11-29 23:08:19 +01:00
Yarik Briukhovetskyi
8cd4d35ead fixed review 2023-11-29 17:35:33 +00:00
Yarik Briukhovetskyi
7444987218 need to deal with week+ time intervals 2023-11-20 18:23:18 +00:00
Robert Schulze
ea2ba82c10
Update docs 2023-11-18 16:37:50 +00:00
Robert Schulze
f596ae7a2c
Fix style 2023-11-18 16:27:55 +00:00
Yarik Briukhovetskyi
76b923b3c3
Merge branch 'master' into time_buckets_impl 2023-11-17 18:53:38 +01:00
yariks5s
6605a375b6 style check, docs, tests and modified logic 2023-11-17 17:35:04 +00:00
yariks5s
188c469318 done suggestings about logic 2023-11-17 14:22:39 +00:00
Robert Schulze
aef1ea3df7 Extend with origin argument, pt. I 2023-11-17 14:17:10 +00:00
Robert Schulze
cd94eda704 Simplify 2023-11-17 14:16:25 +00:00
Antonio Andelic
9791a2ea40 Merge branch 'keeper-batch-flushes' into keeper-parallel-storage 2023-09-08 16:26:12 +00:00
Antonio Andelic
9fb9d16737 Merge branch 'keeper-batch-flushes' into keeper-parallel-storage 2023-09-06 13:30:05 +00:00
Antonio Andelic
6be1d0724a More mutex 2023-09-06 13:04:08 +00:00
Antonio Andelic
9238520490 Merge branch 'master' into keeper-parallel-storage 2023-09-06 10:57:33 +00:00
Antonio Andelic
dd1bb579df Better 2023-09-05 12:05:37 +00:00
Antonio Andelic
57943798b7 Merge branch 'master' into keeper-parallel-storage 2023-09-05 08:46:38 +00:00
Antonio Andelic
b43c3d75a2 Initial implementation 2023-09-04 14:49:49 +00:00
1080 changed files with 28153 additions and 10037 deletions

View File

@ -4,15 +4,31 @@ description: Prints workflow debug info
runs:
using: "composite"
steps:
- name: Print envs
- name: Envs, event.json and contexts
shell: bash
run: |
echo "::group::Envs"
env
echo "::endgroup::"
- name: Print Event.json
shell: bash
run: |
echo "::group::Event.json"
echo '::group::Environment variables'
env | sort
echo '::endgroup::'
echo '::group::event.json'
python3 -m json.tool "$GITHUB_EVENT_PATH"
echo "::endgroup::"
echo '::endgroup::'
cat << 'EOF'
::group::github context
${{ toJSON(github) }}
::endgroup::
::group::env context
${{ toJSON(env) }}
::endgroup::
::group::runner context
${{ toJSON(runner) }}
::endgroup::
::group::job context
${{ toJSON(job) }}
::endgroup::
EOF

View File

@ -27,6 +27,8 @@ jobs:
clear-repository: true # to ensure correct digests
fetch-depth: 0 # to get version
filter: tree:0
- name: Debug Info
uses: ./.github/actions/debug
- name: Labels check
run: |
cd "$GITHUB_WORKSPACE/tests/ci"

View File

@ -33,6 +33,8 @@ jobs:
clear-repository: true
token: ${{secrets.ROBOT_CLICKHOUSE_COMMIT_TOKEN}}
fetch-depth: 0
- name: Debug Info
uses: ./.github/actions/debug
- name: Cherry pick
run: |
cd "$GITHUB_WORKSPACE/tests/ci"

View File

@ -56,13 +56,13 @@ jobs:
GH_TOKEN: ${{ secrets.ROBOT_CLICKHOUSE_COMMIT_TOKEN }}
runs-on: [self-hosted, release-maker]
steps:
- name: DebugInfo
uses: hmarr/debug-action@f7318c783045ac39ed9bb497e22ce835fdafbfe6
- name: Check out repository code
uses: ClickHouse/checkout@v1
with:
token: ${{secrets.ROBOT_CLICKHOUSE_COMMIT_TOKEN}}
fetch-depth: 0
- name: Debug Info
uses: ./.github/actions/debug
- name: Prepare Release Info
shell: bash
run: |

View File

@ -11,6 +11,7 @@ name: Build docker images
required: false
type: boolean
default: false
jobs:
DockerBuildAarch64:
runs-on: [self-hosted, style-checker-aarch64]

View File

@ -8,27 +8,28 @@ on: # yamllint disable-line rule:truthy
schedule:
- cron: '0 */6 * * *'
workflow_dispatch:
jobs:
RunConfig:
runs-on: [self-hosted, style-checker-aarch64]
outputs:
data: ${{ steps.runconfig.outputs.CI_DATA }}
steps:
- name: DebugInfo
uses: hmarr/debug-action@f7318c783045ac39ed9bb497e22ce835fdafbfe6
- name: Check out repository code
uses: ClickHouse/checkout@v1
with:
clear-repository: true # to ensure correct digests
fetch-depth: 0 # to get version
filter: tree:0
- name: Debug Info
uses: ./.github/actions/debug
- name: PrepareRunConfig
id: runconfig
run: |
echo "::group::configure CI run"
python3 "$GITHUB_WORKSPACE/tests/ci/ci.py" --configure --workflow "$GITHUB_WORKFLOW" --outfile ${{ runner.temp }}/ci_run_data.json
echo "::endgroup::"
echo "::group::CI run configure results"
python3 -m json.tool ${{ runner.temp }}/ci_run_data.json
echo "::endgroup::"

View File

@ -15,14 +15,14 @@ jobs:
outputs:
data: ${{ steps.runconfig.outputs.CI_DATA }}
steps:
- name: DebugInfo
uses: hmarr/debug-action@f7318c783045ac39ed9bb497e22ce835fdafbfe6
- name: Check out repository code
uses: ClickHouse/checkout@v1
with:
clear-repository: true # to ensure correct digests
fetch-depth: 0 # to get version
filter: tree:0
- name: Debug Info
uses: ./.github/actions/debug
- name: Merge sync PR
run: |
cd "$GITHUB_WORKSPACE/tests/ci"

View File

@ -14,14 +14,14 @@ jobs:
outputs:
data: ${{ steps.runconfig.outputs.CI_DATA }}
steps:
- name: DebugInfo
uses: hmarr/debug-action@f7318c783045ac39ed9bb497e22ce835fdafbfe6
- name: Check out repository code
uses: ClickHouse/checkout@v1
with:
clear-repository: true # to ensure correct digests
fetch-depth: 0 # to get a version
filter: tree:0
- name: Debug Info
uses: ./.github/actions/debug
- name: Cancel PR workflow
run: |
python3 "$GITHUB_WORKSPACE/tests/ci/ci.py" --cancel-previous-run

View File

@ -15,14 +15,14 @@ jobs:
outputs:
data: ${{ steps.runconfig.outputs.CI_DATA }}
steps:
- name: DebugInfo
uses: hmarr/debug-action@f7318c783045ac39ed9bb497e22ce835fdafbfe6
- name: Check out repository code
uses: ClickHouse/checkout@v1
with:
clear-repository: true # to ensure correct digests
fetch-depth: 0 # to get version
filter: tree:0
- name: Debug Info
uses: ./.github/actions/debug
- name: PrepareRunConfig
id: runconfig
run: |

View File

@ -25,14 +25,14 @@ jobs:
outputs:
data: ${{ steps.runconfig.outputs.CI_DATA }}
steps:
- name: DebugInfo
uses: hmarr/debug-action@f7318c783045ac39ed9bb497e22ce835fdafbfe6
- name: Check out repository code
uses: ClickHouse/checkout@v1
with:
clear-repository: true # to ensure correct digests
fetch-depth: 0 # to get a version
filter: tree:0
- name: Debug Info
uses: ./.github/actions/debug
- name: Cancel previous Sync PR workflow
run: |
python3 "$GITHUB_WORKSPACE/tests/ci/ci.py" --cancel-previous-run

View File

@ -24,6 +24,8 @@ jobs:
clear-repository: true # to ensure correct digests
fetch-depth: 0 # to get version
filter: tree:0
- name: Debug Info
uses: ./.github/actions/debug
- name: Labels check
run: |
cd "$GITHUB_WORKSPACE/tests/ci"

View File

@ -62,8 +62,6 @@ jobs:
env:
GITHUB_JOB_OVERRIDDEN: ${{inputs.test_name}}
steps:
- name: DebugInfo
uses: hmarr/debug-action@f7318c783045ac39ed9bb497e22ce835fdafbfe6
- name: Check out repository code
uses: ClickHouse/checkout@v1
with:
@ -72,6 +70,8 @@ jobs:
submodules: ${{inputs.submodules}}
fetch-depth: ${{inputs.checkout_depth}}
filter: tree:0
- name: Debug Info
uses: ./.github/actions/debug
- name: Set build envs
run: |
cat >> "$GITHUB_ENV" << 'EOF'

6
.gitmodules vendored
View File

@ -170,9 +170,6 @@
[submodule "contrib/fast_float"]
path = contrib/fast_float
url = https://github.com/fastfloat/fast_float
[submodule "contrib/libpq"]
path = contrib/libpq
url = https://github.com/ClickHouse/libpq
[submodule "contrib/NuRaft"]
path = contrib/NuRaft
url = https://github.com/ClickHouse/NuRaft
@ -369,3 +366,6 @@
[submodule "contrib/numactl"]
path = contrib/numactl
url = https://github.com/ClickHouse/numactl.git
[submodule "contrib/postgres"]
path = contrib/postgres
url = https://github.com/ClickHouse/postgres.git

View File

@ -30,7 +30,6 @@
* Support more variants of JOIN strictness (`LEFT/RIGHT SEMI/ANTI/ANY JOIN`) with inequality conditions which involve columns from both left and right table. e.g. `t1.y < t2.y` (see the setting `allow_experimental_join_condition`). [#64281](https://github.com/ClickHouse/ClickHouse/pull/64281) ([lgbo](https://github.com/lgbo-ustc)).
* Intrpret Hive-style partitioning for different engines (`File`, `URL`, `S3`, `AzureBlobStorage`, `HDFS`). Hive-style partitioning organizes data into partitioned sub-directories, making it efficient to query and manage large datasets. Currently, it only creates virtual columns with the appropriate name and data. The follow-up PR will introduce the appropriate data filtering (performance speedup). [#65997](https://github.com/ClickHouse/ClickHouse/pull/65997) ([Yarik Briukhovetskyi](https://github.com/yariks5s)).
* Add function `printf` for Spark compatiability (but you can use the existing `format` function). [#66257](https://github.com/ClickHouse/ClickHouse/pull/66257) ([李扬](https://github.com/taiyang-li)).
* Added a new server setting, `disable_insertion_and_mutation`. If it is enabled, the server will deny all insertions and mutations. This includes asynchronous INSERTs. This setting can be used to create read-only replicas. [#66519](https://github.com/ClickHouse/ClickHouse/pull/66519) ([Xu Jia](https://github.com/XuJia0210)).
* Add options `restore_replace_external_engines_to_null` and `restore_replace_external_table_functions_to_null` to replace external engines and table_engines to `Null` engine that can be useful for testing. It should work for RESTORE and explicit table creation. [#66536](https://github.com/ClickHouse/ClickHouse/pull/66536) ([Ilya Yatsishin](https://github.com/qoega)).
* Added support for reading `MULTILINESTRING` geometry in `WKT` format using function `readWKTLineString`. [#67647](https://github.com/ClickHouse/ClickHouse/pull/67647) ([Jacob Reckhard](https://github.com/jacobrec)).
* Add a new table function `fuzzQuery`. This function allows the modification of a given query string with random variations. Example: `SELECT query FROM fuzzQuery('SELECT 1') LIMIT 5;`. [#67655](https://github.com/ClickHouse/ClickHouse/pull/67655) ([pufit](https://github.com/pufit)).

31
CITATION.cff Normal file
View File

@ -0,0 +1,31 @@
# This CITATION.cff file was generated with cffinit.
cff-version: 1.2.0
title: "ClickHouse"
message: "If you use this software, please cite it as below."
type: software
authors:
- family-names: "Milovidov"
given-names: "Alexey"
repository-code: 'https://github.com/ClickHouse/ClickHouse'
url: 'https://clickhouse.com'
license: Apache-2.0
preferred-citation:
type: article
authors:
- family-names: "Schulze"
given-names: "Robert"
- family-names: "Schreiber"
given-names: "Tom"
- family-names: "Yatsishin"
given-names: "Ilya"
- family-names: "Dahimene"
given-names: "Ryadh"
- family-names: "Milovidov"
given-names: "Alexey"
journal: "Proceedings of the VLDB Endowment"
title: "ClickHouse - Lightning Fast Analytics for Everyone"
year: 2024
volume: 17
issue: 12
doi: 10.14778/3685800.3685802

View File

@ -40,22 +40,33 @@ Every month we get together with the community (users, contributors, customers,
Keep an eye out for upcoming meetups and events around the world. Somewhere else you want us to be? Please feel free to reach out to tyler `<at>` clickhouse `<dot>` com. You can also peruse [ClickHouse Events](https://clickhouse.com/company/news-events) for a list of all upcoming trainings, meetups, speaking engagements, etc.
The following upcoming meetups are featuring creator of ClickHouse & CTO, Alexey Milovidov:
Upcoming meetups
* [Bangalore Meetup](https://www.meetup.com/clickhouse-bangalore-user-group/events/303208274/) - September 18
* [Tel Aviv Meetup](https://www.meetup.com/clickhouse-meetup-israel/events/303095121) - September 22
* [Jakarta Meetup](https://www.meetup.com/clickhouse-indonesia-user-group/events/303191359/) - October 1
* [Singapore Meetup](https://www.meetup.com/clickhouse-singapore-meetup-group/events/303212064/) - October 3
* [Madrid Meetup](https://www.meetup.com/clickhouse-spain-user-group/events/303096564/) - October 22
* [Barcelona Meetup](https://www.meetup.com/clickhouse-spain-user-group/events/303096876/) - October 29
* [Oslo Meetup](https://www.meetup.com/open-source-real-time-data-warehouse-real-time-analytics/events/302938622) - October 31
* [Ghent Meetup](https://www.meetup.com/clickhouse-belgium-user-group/events/303049405/) - November 19
* [Dubai Meetup](https://www.meetup.com/clickhouse-dubai-meetup-group/events/303096989/) - November 21
* [Paris Meetup](https://www.meetup.com/clickhouse-france-user-group/events/303096434) - November 26
Recently completed meetups
* [ClickHouse Guangzhou User Group Meetup](https://mp.weixin.qq.com/s/GSvo-7xUoVzCsuUvlLTpCw) - August 25
* [San Francisco Meetup (Cloudflare)](https://www.meetup.com/clickhouse-silicon-valley-meetup-group/events/302540575) - September 5
* [Raleigh Meetup (Deutsche Bank)](https://www.meetup.com/triangletechtalks/events/302723486/) - September 9
* [New York Meetup (Rokt)](https://www.meetup.com/clickhouse-new-york-user-group/events/302575342) - September 10
* [Chicago Meetup (Jump Capital)](https://lu.ma/43tvmrfw) - September 12
Other upcoming meetups
* [Seattle Meetup (Statsig)](https://www.meetup.com/clickhouse-seattle-user-group/events/302518075/) - August 27
* [Melbourne Meetup](https://www.meetup.com/clickhouse-australia-user-group/events/302732666/) - August 27
* [Sydney Meetup](https://www.meetup.com/clickhouse-australia-user-group/events/302862966/) - September 5
* [Zurich Meetup](https://www.meetup.com/clickhouse-switzerland-meetup-group/events/302267429/) - September 5
* [San Francisco Meetup (Cloudflare)](https://www.meetup.com/clickhouse-silicon-valley-meetup-group/events/302540575) - September 5
* [Raleigh Meetup (Deutsche Bank)](https://www.meetup.com/triangletechtalks/events/302723486/) - September 9
* [New York Meetup (Rokt)](https://www.meetup.com/clickhouse-new-york-user-group/events/302575342) - September 10
* [Toronto Meetup (Shopify)](https://www.meetup.com/clickhouse-toronto-user-group/events/301490855/) - September 10
* [Austin Meetup](https://www.meetup.com/clickhouse-austin-user-group/events/302558689/) - September 17
* [Chicago Meetup (Jump Capital)](https://lu.ma/43tvmrfw) - September 12
* [London Meetup](https://www.meetup.com/clickhouse-london-user-group/events/302977267) - September 17
* [Austin Meetup](https://www.meetup.com/clickhouse-austin-user-group/events/302558689/) - September 17
## Recent Recordings
* **Recent Meetup Videos**: [Meetup Playlist](https://www.youtube.com/playlist?list=PL0Z2YDlm0b3iNDUzpY1S3L_iV4nARda_U) Whenever possible recordings of the ClickHouse Community Meetups are edited and presented as individual talks. Current featuring "Modern SQL in 2023", "Fast, Concurrent, and Consistent Asynchronous INSERTS in ClickHouse", and "Full-Text Indices: Design and Experiments"

View File

@ -66,13 +66,11 @@ TRAP(gethostbyname)
TRAP(gethostbyname2)
TRAP(gethostent)
TRAP(getlogin)
TRAP(getmntent)
TRAP(getnetbyaddr)
TRAP(getnetbyname)
TRAP(getnetent)
TRAP(getnetgrent)
TRAP(getnetgrent_r)
TRAP(getopt)
TRAP(getopt_long)
TRAP(getopt_long_only)
TRAP(getpass)
@ -133,7 +131,6 @@ TRAP(nrand48)
TRAP(__ppc_get_timebase_freq)
TRAP(ptsname)
TRAP(putchar_unlocked)
TRAP(putenv)
TRAP(pututline)
TRAP(pututxline)
TRAP(putwchar_unlocked)
@ -148,7 +145,6 @@ TRAP(sethostent)
TRAP(sethostid)
TRAP(setkey)
//TRAP(setlocale) // Used by replxx at startup
TRAP(setlogmask)
TRAP(setnetent)
TRAP(setnetgrent)
TRAP(setprotoent)
@ -203,7 +199,6 @@ TRAP(lgammal)
TRAP(nftw)
TRAP(nl_langinfo)
TRAP(putc_unlocked)
TRAP(rand)
/** In the current POSIX.1 specification (POSIX.1-2008), readdir() is not required to be thread-safe. However, in modern
* implementations (including the glibc implementation), concurrent calls to readdir() that specify different directory streams
* are thread-safe. In cases where multiple threads must read from the same directory stream, using readdir() with external
@ -288,4 +283,14 @@ TRAP(tss_get)
TRAP(tss_set)
TRAP(tss_delete)
#ifndef USE_MUSL
/// These produce duplicate symbol errors when statically linking with musl.
/// Maybe we can remove them from the musl fork.
TRAP(getopt)
TRAP(putenv)
TRAP(setlogmask)
TRAP(rand)
TRAP(getmntent)
#endif
#endif

View File

@ -188,8 +188,9 @@ namespace Crypto
pFile = fopen(keyFile.c_str(), "r");
if (pFile)
{
pem_password_cb * pCB = pass.empty() ? (pem_password_cb *)0 : &passCB;
void * pPassword = pass.empty() ? (void *)0 : (void *)pass.c_str();
pem_password_cb * pCB = &passCB;
static constexpr char * no_password = "";
void * pPassword = pass.empty() ? (void *)no_password : (void *)pass.c_str();
if (readFunc(pFile, &pKey, pCB, pPassword))
{
fclose(pFile);
@ -225,6 +226,13 @@ namespace Crypto
error:
if (pFile)
fclose(pFile);
if (*ppKey)
{
if constexpr (std::is_same_v<K, EVP_PKEY>)
EVP_PKEY_free(*ppKey);
else
EC_KEY_free(*ppKey);
}
throw OpenSSLException("EVPKey::loadKey(string)");
}
@ -286,6 +294,13 @@ namespace Crypto
error:
if (pBIO)
BIO_free(pBIO);
if (*ppKey)
{
if constexpr (std::is_same_v<K, EVP_PKEY>)
EVP_PKEY_free(*ppKey);
else
EC_KEY_free(*ppKey);
}
throw OpenSSLException("EVPKey::loadKey(stream)");
}

View File

@ -48,25 +48,17 @@ std::string PathImpl::currentImpl()
std::string PathImpl::homeImpl()
{
std::string path;
#if defined(_POSIX_C_SOURCE) || defined(_BSD_SOURCE) || defined(_POSIX_C_SOURCE)
size_t buf_size = 1024; // Same as glibc use for getpwuid
std::vector<char> buf(buf_size);
struct passwd res;
struct passwd* pwd = nullptr;
getpwuid_r(getuid(), &res, buf.data(), buf_size, &pwd);
#else
struct passwd* pwd = getpwuid(getuid());
#endif
if (pwd)
path = pwd->pw_dir;
else
{
#if defined(_POSIX_C_SOURCE) || defined(_BSD_SOURCE) || defined(_POSIX_C_SOURCE)
getpwuid_r(getuid(), &res, buf.data(), buf_size, &pwd);
#else
pwd = getpwuid(geteuid());
#endif
if (pwd)
path = pwd->pw_dir;
else
@ -82,7 +74,7 @@ std::string PathImpl::configHomeImpl()
{
std::string path = PathImpl::homeImpl();
std::string::size_type n = path.size();
if (n > 0 && path[n - 1] == '/')
if (n > 0 && path[n - 1] == '/')
#if POCO_OS == POCO_OS_MAC_OS_X
path.append("Library/Preferences/");
#else
@ -97,7 +89,7 @@ std::string PathImpl::dataHomeImpl()
{
std::string path = PathImpl::homeImpl();
std::string::size_type n = path.size();
if (n > 0 && path[n - 1] == '/')
if (n > 0 && path[n - 1] == '/')
#if POCO_OS == POCO_OS_MAC_OS_X
path.append("Library/Application Support/");
#else
@ -112,7 +104,7 @@ std::string PathImpl::cacheHomeImpl()
{
std::string path = PathImpl::homeImpl();
std::string::size_type n = path.size();
if (n > 0 && path[n - 1] == '/')
if (n > 0 && path[n - 1] == '/')
#if POCO_OS == POCO_OS_MAC_OS_X
path.append("Library/Caches/");
#else
@ -127,7 +119,7 @@ std::string PathImpl::tempHomeImpl()
{
std::string path = PathImpl::homeImpl();
std::string::size_type n = path.size();
if (n > 0 && path[n - 1] == '/')
if (n > 0 && path[n - 1] == '/')
#if POCO_OS == POCO_OS_MAC_OS_X
path.append("Library/Caches/");
#else
@ -159,7 +151,7 @@ std::string PathImpl::tempImpl()
std::string PathImpl::configImpl()
{
std::string path;
#if POCO_OS == POCO_OS_MAC_OS_X
path = "/Library/Preferences/";
#else

View File

@ -19,6 +19,8 @@
#include <ios>
#include <memory>
#include <functional>
#include "Poco/Any.h"
#include "Poco/Buffer.h"
#include "Poco/Exception.h"
@ -33,6 +35,27 @@ namespace Net
{
class IHTTPSessionDataHooks
/// Interface to control stream of data bytes being sent or received though socket by HTTPSession
/// It allows to monitor, throttle and schedule data streams with syscall granulatrity
{
public:
virtual ~IHTTPSessionDataHooks() = default;
virtual void atStart(int bytes) = 0;
/// Called before sending/receiving data `bytes` to/from socket.
virtual void atFinish(int bytes) = 0;
/// Called when sending/receiving of data `bytes` is successfully finished.
virtual void atFail() = 0;
/// If an error occurred during send/receive `fail()` is called instead of `finish()`.
};
using HTTPSessionDataHooksPtr = std::shared_ptr<IHTTPSessionDataHooks>;
class Net_API HTTPSession
/// HTTPSession implements basic HTTP session management
/// for both HTTP clients and HTTP servers.
@ -73,6 +96,12 @@ namespace Net
Poco::Timespan getReceiveTimeout() const;
/// Returns receive timeout for the HTTP session.
void setSendDataHooks(const HTTPSessionDataHooksPtr & sendDataHooks = {});
/// Sets data hooks that will be called on every sent to the socket.
void setReceiveDataHooks(const HTTPSessionDataHooksPtr & receiveDataHooks = {});
/// Sets data hooks that will be called on every receive from the socket.
bool connected() const;
/// Returns true if the underlying socket is connected.
@ -211,6 +240,10 @@ namespace Net
Poco::Exception * _pException;
Poco::Any _data;
// Data hooks
HTTPSessionDataHooksPtr _sendDataHooks;
HTTPSessionDataHooksPtr _receiveDataHooks;
friend class HTTPStreamBuf;
friend class HTTPHeaderStreamBuf;
friend class HTTPFixedLengthStreamBuf;
@ -246,6 +279,16 @@ namespace Net
return _receiveTimeout;
}
inline void HTTPSession::setSendDataHooks(const HTTPSessionDataHooksPtr & sendDataHooks)
{
_sendDataHooks = sendDataHooks;
}
inline void HTTPSession::setReceiveDataHooks(const HTTPSessionDataHooksPtr & receiveDataHooks)
{
_receiveDataHooks = receiveDataHooks;
}
inline StreamSocket & HTTPSession::socket()
{
return _socket;

View File

@ -128,14 +128,14 @@ int HTTPSession::get()
{
if (_pCurrent == _pEnd)
refill();
if (_pCurrent < _pEnd)
return *_pCurrent++;
else
return std::char_traits<char>::eof();
}
int HTTPSession::peek()
{
if (_pCurrent == _pEnd)
@ -147,7 +147,7 @@ int HTTPSession::peek()
return std::char_traits<char>::eof();
}
int HTTPSession::read(char* buffer, std::streamsize length)
{
if (_pCurrent < _pEnd)
@ -166,10 +166,17 @@ int HTTPSession::write(const char* buffer, std::streamsize length)
{
try
{
return _socket.sendBytes(buffer, (int) length);
if (_sendDataHooks)
_sendDataHooks->atStart((int) length);
int result = _socket.sendBytes(buffer, (int) length);
if (_sendDataHooks)
_sendDataHooks->atFinish(result);
return result;
}
catch (Poco::Exception& exc)
{
if (_sendDataHooks)
_sendDataHooks->atFail();
setException(exc);
throw;
}
@ -180,10 +187,17 @@ int HTTPSession::receive(char* buffer, int length)
{
try
{
return _socket.receiveBytes(buffer, length);
if (_receiveDataHooks)
_receiveDataHooks->atStart(length);
int result = _socket.receiveBytes(buffer, length);
if (_receiveDataHooks)
_receiveDataHooks->atFinish(result);
return result;
}
catch (Poco::Exception& exc)
{
if (_receiveDataHooks)
_receiveDataHooks->atFail();
setException(exc);
throw;
}

View File

@ -63,7 +63,7 @@ bool checkIsBrokenTimeout()
SocketImpl::SocketImpl():
_sockfd(POCO_INVALID_SOCKET),
_blocking(true),
_blocking(true),
_isBrokenTimeout(checkIsBrokenTimeout())
{
}
@ -82,7 +82,7 @@ SocketImpl::~SocketImpl()
close();
}
SocketImpl* SocketImpl::acceptConnection(SocketAddress& clientAddr)
{
if (_sockfd == POCO_INVALID_SOCKET) throw InvalidSocketException();
@ -118,7 +118,7 @@ void SocketImpl::connect(const SocketAddress& address)
rc = ::connect(_sockfd, address.addr(), address.length());
}
while (rc != 0 && lastError() == POCO_EINTR);
if (rc != 0)
if (rc != 0)
{
int err = lastError();
error(err, address.toString());
@ -205,7 +205,7 @@ void SocketImpl::bind6(const SocketAddress& address, bool reuseAddress, bool reu
#if defined(POCO_HAVE_IPv6)
if (address.family() != SocketAddress::IPv6)
throw Poco::InvalidArgumentException("SocketAddress must be an IPv6 address");
if (_sockfd == POCO_INVALID_SOCKET)
{
init(address.af());
@ -226,11 +226,11 @@ void SocketImpl::bind6(const SocketAddress& address, bool reuseAddress, bool reu
#endif
}
void SocketImpl::listen(int backlog)
{
if (_sockfd == POCO_INVALID_SOCKET) throw InvalidSocketException();
int rc = ::listen(_sockfd, backlog);
if (rc != 0) error();
}
@ -254,7 +254,7 @@ void SocketImpl::shutdownReceive()
if (rc != 0) error();
}
void SocketImpl::shutdownSend()
{
if (_sockfd == POCO_INVALID_SOCKET) throw InvalidSocketException();
@ -263,7 +263,7 @@ void SocketImpl::shutdownSend()
if (rc != 0) error();
}
void SocketImpl::shutdown()
{
if (_sockfd == POCO_INVALID_SOCKET) throw InvalidSocketException();
@ -318,7 +318,7 @@ int SocketImpl::receiveBytes(void* buffer, int length, int flags)
throw TimeoutException();
}
}
int rc;
do
{
@ -326,7 +326,7 @@ int SocketImpl::receiveBytes(void* buffer, int length, int flags)
rc = ::recv(_sockfd, reinterpret_cast<char*>(buffer), length, flags);
}
while (blocking && rc < 0 && lastError() == POCO_EINTR);
if (rc < 0)
if (rc < 0)
{
int err = lastError();
if ((err == POCO_EAGAIN || err == POCO_EWOULDBLOCK) && !blocking)
@ -364,7 +364,7 @@ int SocketImpl::receiveFrom(void* buffer, int length, SocketAddress& address, in
throw TimeoutException();
}
}
sockaddr_storage abuffer;
struct sockaddr* pSA = reinterpret_cast<struct sockaddr*>(&abuffer);
poco_socklen_t saLen = sizeof(abuffer);
@ -451,7 +451,7 @@ bool SocketImpl::pollImpl(Poco::Timespan& remainingTime, int mode)
}
while (rc < 0 && lastError() == POCO_EINTR);
if (rc < 0) error();
return rc > 0;
return rc > 0;
#else
@ -494,7 +494,7 @@ bool SocketImpl::pollImpl(Poco::Timespan& remainingTime, int mode)
}
while (rc < 0 && errorCode == POCO_EINTR);
if (rc < 0) error(errorCode);
return rc > 0;
return rc > 0;
#endif // POCO_HAVE_FD_POLL
}
@ -504,13 +504,13 @@ bool SocketImpl::poll(const Poco::Timespan& timeout, int mode)
Poco::Timespan remainingTime(timeout);
return pollImpl(remainingTime, mode);
}
void SocketImpl::setSendBufferSize(int size)
{
setOption(SOL_SOCKET, SO_SNDBUF, size);
}
int SocketImpl::getSendBufferSize()
{
int result;
@ -524,7 +524,7 @@ void SocketImpl::setReceiveBufferSize(int size)
setOption(SOL_SOCKET, SO_RCVBUF, size);
}
int SocketImpl::getReceiveBufferSize()
{
int result;
@ -570,7 +570,7 @@ Poco::Timespan SocketImpl::getReceiveTimeout()
return result;
}
SocketAddress SocketImpl::address()
{
if (_sockfd == POCO_INVALID_SOCKET) throw InvalidSocketException();
@ -581,7 +581,7 @@ SocketAddress SocketImpl::address()
int rc = ::getsockname(_sockfd, pSA, &saLen);
if (rc == 0)
return SocketAddress(pSA, saLen);
else
else
error();
return SocketAddress();
}

View File

@ -248,6 +248,9 @@ namespace Net
SSL_CTX * sslContext() const;
/// Returns the underlying OpenSSL SSL Context object.
SSL_CTX * takeSslContext();
/// Takes ownership of the underlying OpenSSL SSL Context object.
Usage usage() const;
/// Returns whether the context is for use by a client or by a server
/// and whether TLSv1 is required.
@ -401,6 +404,13 @@ namespace Net
return _pSSLContext;
}
inline SSL_CTX * Context::takeSslContext()
{
auto * result = _pSSLContext;
_pSSLContext = nullptr;
return result;
}
inline bool Context::extendedCertificateVerificationEnabled() const
{

View File

@ -106,6 +106,11 @@ Context::Context(
Context::~Context()
{
if (_pSSLContext == nullptr)
{
return;
}
try
{
SSL_CTX_free(_pSSLContext);

View File

@ -18,4 +18,4 @@ target_compile_options (_poco_util
-Wno-zero-as-null-pointer-constant
)
target_include_directories (_poco_util SYSTEM PUBLIC "include")
target_link_libraries (_poco_util PUBLIC Poco::JSON Poco::XML)
target_link_libraries (_poco_util PUBLIC Poco::JSON Poco::XML Poco::Net)

View File

@ -241,6 +241,20 @@ namespace Util
/// If the value contains references to other properties (${<property>}), these
/// are expanded.
std::string getHost(const std::string & key) const;
/// Returns the string value of the host property with the given name.
/// Throws a NotFoundException if the key does not exist.
/// Throws a SyntaxException if the property is not a valid host (IP address or domain).
/// If the value contains references to other properties (${<property>}), these
/// are expanded.
std::string getHost(const std::string & key, const std::string & defaultValue) const;
/// If a property with the given key exists, returns the host property's string value,
/// otherwise returns the given default value.
/// Throws a SyntaxException if the property is not a valid host (IP address or domain).
/// If the value contains references to other properties (${<property>}), these
/// are expanded.
virtual void setString(const std::string & key, const std::string & value);
/// Sets the property with the given key to the given value.
/// An already existing value for the key is overwritten.
@ -339,12 +353,35 @@ namespace Util
static bool parseBool(const std::string & value);
void setRawWithEvent(const std::string & key, std::string value);
static void checkHostValidity(const std::string & value);
/// Throws a SyntaxException if the value is not a valid host (IP address or domain).
virtual ~AbstractConfiguration();
private:
std::string internalExpand(const std::string & value) const;
std::string uncheckedExpand(const std::string & value) const;
static bool isValidIPv4Address(const std::string & value);
/// IPv4 address considered valid if it is "0.0.0.0" or one of those,
/// defined by inet_aton() or inet_addr()
static bool isValidIPv6Address(const std::string & value);
/// IPv6 address considered valid if it is "::" or one of those,
/// defined by inet_pton() with AF_INET6 flag
/// (in this case it may have scope id and may be surrounded by '[', ']')
static bool isValidDomainName(const std::string & value);
/// <domain> ::= <subdomain> [ "." ]
/// <subdomain> ::= <label> | <subdomain> "." <label>
/// <label> ::= <letter> [ [ <ldh-str> ] <let-dig> ]
/// <ldh-str> ::= <let-dig-hyp> | <let-dig-hyp> <ldh-str>
/// <let-dig-hyp> ::= <let-dig> | "-"
/// <let-dig> ::= <letter> | <digit>
/// <letter> ::= any one of the 52 alphabetic characters A through Z in
/// upper case and a through z in lower case
/// <digit> ::= any one of the ten digits 0 through 9
AbstractConfiguration(const AbstractConfiguration &);
AbstractConfiguration & operator=(const AbstractConfiguration &);

View File

@ -18,6 +18,7 @@
#include "Poco/NumberParser.h"
#include "Poco/NumberFormatter.h"
#include "Poco/String.h"
#include "Poco/Net/IPAddressImpl.h"
using Poco::Mutex;
@ -263,6 +264,41 @@ bool AbstractConfiguration::getBool(const std::string& key, bool defaultValue) c
}
std::string AbstractConfiguration::getHost(const std::string& key) const
{
Mutex::ScopedLock lock(_mutex);
std::string value;
if (getRaw(key, value))
{
std::string expandedValue = internalExpand(value);
checkHostValidity(expandedValue);
return expandedValue;
}
else
throw NotFoundException(key);
}
std::string AbstractConfiguration::getHost(const std::string& key, const std::string& defaultValue) const
{
Mutex::ScopedLock lock(_mutex);
std::string value;
if (getRaw(key, value))
{
std::string expandedValue = internalExpand(value);
checkHostValidity(expandedValue);
return expandedValue;
}
else
{
checkHostValidity(defaultValue);
return defaultValue;
}
}
void AbstractConfiguration::setString(const std::string& key, const std::string& value)
{
setRawWithEvent(key, value);
@ -529,4 +565,68 @@ void AbstractConfiguration::setRawWithEvent(const std::string& key, std::string
}
void AbstractConfiguration::checkHostValidity(const std::string& value)
{
if (!isValidIPv4Address(value) && !isValidIPv6Address(value) && !isValidDomainName(value))
{
throw SyntaxException("Property is not a valid host name", value);
}
}
bool AbstractConfiguration::isValidIPv4Address(const std::string& value)
{
using Poco::Net::Impl::IPv4AddressImpl;
IPv4AddressImpl empty4 = IPv4AddressImpl();
IPv4AddressImpl ipAddress = IPv4AddressImpl::parse(value);
return ipAddress != empty4 || value == "0.0.0.0";
}
bool AbstractConfiguration::isValidIPv6Address(const std::string& value)
{
#if defined(POCO_HAVE_IPv6)
using Poco::Net::Impl::IPv6AddressImpl;
IPv6AddressImpl empty6 = IPv6AddressImpl();
IPv6AddressImpl ipAddress = IPv6AddressImpl::parse(value);
return ipAddress != empty6 || value == "::";
#else
return false;
#endif
}
bool AbstractConfiguration::isValidDomainName(const std::string& value)
{
if (value.empty() || value == "." || value.length() > 253)
return false;
int labelLength = 0;
char oldChar = 0;
for (char ch : value)
{
if (ch == '.')
{
if (labelLength == 0 || labelLength > 63 || oldChar == '-')
return false;
labelLength = 0;
}
else if (isalnum(ch) || ch == '-')
{
if (labelLength == 0 && (ch == '-' || isdigit(ch)))
return false;
++labelLength;
}
else
{
return false;
}
oldChar = ch;
}
return oldChar == '.' || (labelLength > 0 && labelLength <= 63 && oldChar != '-');
}
} } // namespace Poco::Util

View File

@ -145,8 +145,13 @@ add_contrib (isa-l-cmake isa-l)
add_contrib (libhdfs3-cmake libhdfs3) # requires: google-protobuf, krb5, isa-l
add_contrib (hive-metastore-cmake hive-metastore) # requires: thrift, avro, arrow, libhdfs3
add_contrib (cppkafka-cmake cppkafka)
add_contrib (libpqxx-cmake libpqxx)
add_contrib (libpq-cmake libpq)
option(ENABLE_LIBPQXX "Enable PostgreSQL" ${ENABLE_LIBRARIES})
if (ENABLE_LIBPQXX)
add_contrib (postgres-cmake postgres)
add_contrib (libpqxx-cmake libpqxx)
endif()
add_contrib (rocksdb-cmake rocksdb) # requires: jemalloc, snappy, zlib, lz4, zstd, liburing
add_contrib (nuraft-cmake NuRaft)
add_contrib (fast_float-cmake fast_float)

2
contrib/curl vendored

@ -1 +1 @@
Subproject commit de7b3e89218467159a7af72d58cea8425946e97d
Subproject commit 83bedbd730d62b83744cc26fa0433d3f6e2e4cd6

2
contrib/grpc vendored

@ -1 +1 @@
Subproject commit 1716359d2e28d304a250f9df0e6c0ccad03de8db
Subproject commit 7bc3abe952aba1dc7bce7f2f790dc781cb51a41e

View File

@ -15,162 +15,64 @@ set(ICUDATA_SOURCE_DIR "${ClickHouse_SOURCE_DIR}/contrib/icudata/")
# These lists of sources were generated from build log of the original ICU build system (configure + make).
set(ICUUC_SOURCES
"${ICU_SOURCE_DIR}/common/errorcode.cpp"
"${ICU_SOURCE_DIR}/common/putil.cpp"
"${ICU_SOURCE_DIR}/common/umath.cpp"
"${ICU_SOURCE_DIR}/common/utypes.cpp"
"${ICU_SOURCE_DIR}/common/uinvchar.cpp"
"${ICU_SOURCE_DIR}/common/umutex.cpp"
"${ICU_SOURCE_DIR}/common/ucln_cmn.cpp"
"${ICU_SOURCE_DIR}/common/uinit.cpp"
"${ICU_SOURCE_DIR}/common/uobject.cpp"
"${ICU_SOURCE_DIR}/common/cmemory.cpp"
"${ICU_SOURCE_DIR}/common/charstr.cpp"
"${ICU_SOURCE_DIR}/common/cstr.cpp"
"${ICU_SOURCE_DIR}/common/udata.cpp"
"${ICU_SOURCE_DIR}/common/ucmndata.cpp"
"${ICU_SOURCE_DIR}/common/udatamem.cpp"
"${ICU_SOURCE_DIR}/common/umapfile.cpp"
"${ICU_SOURCE_DIR}/common/udataswp.cpp"
"${ICU_SOURCE_DIR}/common/utrie_swap.cpp"
"${ICU_SOURCE_DIR}/common/ucol_swp.cpp"
"${ICU_SOURCE_DIR}/common/utrace.cpp"
"${ICU_SOURCE_DIR}/common/uhash.cpp"
"${ICU_SOURCE_DIR}/common/uhash_us.cpp"
"${ICU_SOURCE_DIR}/common/uenum.cpp"
"${ICU_SOURCE_DIR}/common/ustrenum.cpp"
"${ICU_SOURCE_DIR}/common/uvector.cpp"
"${ICU_SOURCE_DIR}/common/ustack.cpp"
"${ICU_SOURCE_DIR}/common/uvectr32.cpp"
"${ICU_SOURCE_DIR}/common/uvectr64.cpp"
"${ICU_SOURCE_DIR}/common/ucnv.cpp"
"${ICU_SOURCE_DIR}/common/ucnv_bld.cpp"
"${ICU_SOURCE_DIR}/common/ucnv_cnv.cpp"
"${ICU_SOURCE_DIR}/common/ucnv_io.cpp"
"${ICU_SOURCE_DIR}/common/ucnv_cb.cpp"
"${ICU_SOURCE_DIR}/common/ucnv_err.cpp"
"${ICU_SOURCE_DIR}/common/ucnvlat1.cpp"
"${ICU_SOURCE_DIR}/common/ucnv_u7.cpp"
"${ICU_SOURCE_DIR}/common/ucnv_u8.cpp"
"${ICU_SOURCE_DIR}/common/ucnv_u16.cpp"
"${ICU_SOURCE_DIR}/common/ucnv_u32.cpp"
"${ICU_SOURCE_DIR}/common/ucnvscsu.cpp"
"${ICU_SOURCE_DIR}/common/ucnvbocu.cpp"
"${ICU_SOURCE_DIR}/common/ucnv_ext.cpp"
"${ICU_SOURCE_DIR}/common/ucnvmbcs.cpp"
"${ICU_SOURCE_DIR}/common/ucnv2022.cpp"
"${ICU_SOURCE_DIR}/common/ucnvhz.cpp"
"${ICU_SOURCE_DIR}/common/ucnv_lmb.cpp"
"${ICU_SOURCE_DIR}/common/ucnvisci.cpp"
"${ICU_SOURCE_DIR}/common/ucnvdisp.cpp"
"${ICU_SOURCE_DIR}/common/ucnv_set.cpp"
"${ICU_SOURCE_DIR}/common/ucnv_ct.cpp"
"${ICU_SOURCE_DIR}/common/resource.cpp"
"${ICU_SOURCE_DIR}/common/uresbund.cpp"
"${ICU_SOURCE_DIR}/common/ures_cnv.cpp"
"${ICU_SOURCE_DIR}/common/uresdata.cpp"
"${ICU_SOURCE_DIR}/common/resbund.cpp"
"${ICU_SOURCE_DIR}/common/resbund_cnv.cpp"
"${ICU_SOURCE_DIR}/common/ucurr.cpp"
"${ICU_SOURCE_DIR}/common/localebuilder.cpp"
"${ICU_SOURCE_DIR}/common/localeprioritylist.cpp"
"${ICU_SOURCE_DIR}/common/messagepattern.cpp"
"${ICU_SOURCE_DIR}/common/ucat.cpp"
"${ICU_SOURCE_DIR}/common/locmap.cpp"
"${ICU_SOURCE_DIR}/common/uloc.cpp"
"${ICU_SOURCE_DIR}/common/locid.cpp"
"${ICU_SOURCE_DIR}/common/locutil.cpp"
"${ICU_SOURCE_DIR}/common/locavailable.cpp"
"${ICU_SOURCE_DIR}/common/locdispnames.cpp"
"${ICU_SOURCE_DIR}/common/locdspnm.cpp"
"${ICU_SOURCE_DIR}/common/loclikely.cpp"
"${ICU_SOURCE_DIR}/common/locresdata.cpp"
"${ICU_SOURCE_DIR}/common/lsr.cpp"
"${ICU_SOURCE_DIR}/common/loclikelysubtags.cpp"
"${ICU_SOURCE_DIR}/common/locdistance.cpp"
"${ICU_SOURCE_DIR}/common/localematcher.cpp"
"${ICU_SOURCE_DIR}/common/bytestream.cpp"
"${ICU_SOURCE_DIR}/common/stringpiece.cpp"
"${ICU_SOURCE_DIR}/common/bytesinkutil.cpp"
"${ICU_SOURCE_DIR}/common/stringtriebuilder.cpp"
"${ICU_SOURCE_DIR}/common/bytestriebuilder.cpp"
"${ICU_SOURCE_DIR}/common/bytestrie.cpp"
"${ICU_SOURCE_DIR}/common/bytestrieiterator.cpp"
"${ICU_SOURCE_DIR}/common/ucharstrie.cpp"
"${ICU_SOURCE_DIR}/common/ucharstriebuilder.cpp"
"${ICU_SOURCE_DIR}/common/ucharstrieiterator.cpp"
"${ICU_SOURCE_DIR}/common/dictionarydata.cpp"
"${ICU_SOURCE_DIR}/common/edits.cpp"
"${ICU_SOURCE_DIR}/common/appendable.cpp"
"${ICU_SOURCE_DIR}/common/ustr_cnv.cpp"
"${ICU_SOURCE_DIR}/common/unistr_cnv.cpp"
"${ICU_SOURCE_DIR}/common/unistr.cpp"
"${ICU_SOURCE_DIR}/common/unistr_case.cpp"
"${ICU_SOURCE_DIR}/common/unistr_props.cpp"
"${ICU_SOURCE_DIR}/common/utf_impl.cpp"
"${ICU_SOURCE_DIR}/common/ustring.cpp"
"${ICU_SOURCE_DIR}/common/ustrcase.cpp"
"${ICU_SOURCE_DIR}/common/ucasemap.cpp"
"${ICU_SOURCE_DIR}/common/ucasemap_titlecase_brkiter.cpp"
"${ICU_SOURCE_DIR}/common/cstring.cpp"
"${ICU_SOURCE_DIR}/common/ustrfmt.cpp"
"${ICU_SOURCE_DIR}/common/ustrtrns.cpp"
"${ICU_SOURCE_DIR}/common/ustr_wcs.cpp"
"${ICU_SOURCE_DIR}/common/utext.cpp"
"${ICU_SOURCE_DIR}/common/unistr_case_locale.cpp"
"${ICU_SOURCE_DIR}/common/ustrcase_locale.cpp"
"${ICU_SOURCE_DIR}/common/unistr_titlecase_brkiter.cpp"
"${ICU_SOURCE_DIR}/common/ustr_titlecase_brkiter.cpp"
"${ICU_SOURCE_DIR}/common/normalizer2impl.cpp"
"${ICU_SOURCE_DIR}/common/normalizer2.cpp"
"${ICU_SOURCE_DIR}/common/filterednormalizer2.cpp"
"${ICU_SOURCE_DIR}/common/normlzr.cpp"
"${ICU_SOURCE_DIR}/common/unorm.cpp"
"${ICU_SOURCE_DIR}/common/unormcmp.cpp"
"${ICU_SOURCE_DIR}/common/loadednormalizer2impl.cpp"
"${ICU_SOURCE_DIR}/common/chariter.cpp"
"${ICU_SOURCE_DIR}/common/schriter.cpp"
"${ICU_SOURCE_DIR}/common/uchriter.cpp"
"${ICU_SOURCE_DIR}/common/uiter.cpp"
"${ICU_SOURCE_DIR}/common/patternprops.cpp"
"${ICU_SOURCE_DIR}/common/uchar.cpp"
"${ICU_SOURCE_DIR}/common/uprops.cpp"
"${ICU_SOURCE_DIR}/common/ucase.cpp"
"${ICU_SOURCE_DIR}/common/propname.cpp"
"${ICU_SOURCE_DIR}/common/ubidi_props.cpp"
"${ICU_SOURCE_DIR}/common/characterproperties.cpp"
"${ICU_SOURCE_DIR}/common/ubidi.cpp"
"${ICU_SOURCE_DIR}/common/ubidiwrt.cpp"
"${ICU_SOURCE_DIR}/common/ubidiln.cpp"
"${ICU_SOURCE_DIR}/common/ushape.cpp"
"${ICU_SOURCE_DIR}/common/uscript.cpp"
"${ICU_SOURCE_DIR}/common/uscript_props.cpp"
"${ICU_SOURCE_DIR}/common/usc_impl.cpp"
"${ICU_SOURCE_DIR}/common/unames.cpp"
"${ICU_SOURCE_DIR}/common/utrie.cpp"
"${ICU_SOURCE_DIR}/common/utrie2.cpp"
"${ICU_SOURCE_DIR}/common/utrie2_builder.cpp"
"${ICU_SOURCE_DIR}/common/ucptrie.cpp"
"${ICU_SOURCE_DIR}/common/umutablecptrie.cpp"
"${ICU_SOURCE_DIR}/common/bmpset.cpp"
"${ICU_SOURCE_DIR}/common/unisetspan.cpp"
"${ICU_SOURCE_DIR}/common/uset_props.cpp"
"${ICU_SOURCE_DIR}/common/uniset_props.cpp"
"${ICU_SOURCE_DIR}/common/uniset_closure.cpp"
"${ICU_SOURCE_DIR}/common/uset.cpp"
"${ICU_SOURCE_DIR}/common/uniset.cpp"
"${ICU_SOURCE_DIR}/common/usetiter.cpp"
"${ICU_SOURCE_DIR}/common/ruleiter.cpp"
"${ICU_SOURCE_DIR}/common/caniter.cpp"
"${ICU_SOURCE_DIR}/common/unifilt.cpp"
"${ICU_SOURCE_DIR}/common/unifunct.cpp"
"${ICU_SOURCE_DIR}/common/uarrsort.cpp"
"${ICU_SOURCE_DIR}/common/brkiter.cpp"
"${ICU_SOURCE_DIR}/common/ubrk.cpp"
"${ICU_SOURCE_DIR}/common/brkeng.cpp"
"${ICU_SOURCE_DIR}/common/brkiter.cpp"
"${ICU_SOURCE_DIR}/common/bytesinkutil.cpp"
"${ICU_SOURCE_DIR}/common/bytestream.cpp"
"${ICU_SOURCE_DIR}/common/bytestrie.cpp"
"${ICU_SOURCE_DIR}/common/bytestriebuilder.cpp"
"${ICU_SOURCE_DIR}/common/bytestrieiterator.cpp"
"${ICU_SOURCE_DIR}/common/caniter.cpp"
"${ICU_SOURCE_DIR}/common/characterproperties.cpp"
"${ICU_SOURCE_DIR}/common/chariter.cpp"
"${ICU_SOURCE_DIR}/common/charstr.cpp"
"${ICU_SOURCE_DIR}/common/cmemory.cpp"
"${ICU_SOURCE_DIR}/common/cstr.cpp"
"${ICU_SOURCE_DIR}/common/cstring.cpp"
"${ICU_SOURCE_DIR}/common/cwchar.cpp"
"${ICU_SOURCE_DIR}/common/dictbe.cpp"
"${ICU_SOURCE_DIR}/common/dictionarydata.cpp"
"${ICU_SOURCE_DIR}/common/dtintrv.cpp"
"${ICU_SOURCE_DIR}/common/edits.cpp"
"${ICU_SOURCE_DIR}/common/emojiprops.cpp"
"${ICU_SOURCE_DIR}/common/errorcode.cpp"
"${ICU_SOURCE_DIR}/common/filteredbrk.cpp"
"${ICU_SOURCE_DIR}/common/filterednormalizer2.cpp"
"${ICU_SOURCE_DIR}/common/icudataver.cpp"
"${ICU_SOURCE_DIR}/common/icuplug.cpp"
"${ICU_SOURCE_DIR}/common/loadednormalizer2impl.cpp"
"${ICU_SOURCE_DIR}/common/localebuilder.cpp"
"${ICU_SOURCE_DIR}/common/localematcher.cpp"
"${ICU_SOURCE_DIR}/common/localeprioritylist.cpp"
"${ICU_SOURCE_DIR}/common/locavailable.cpp"
"${ICU_SOURCE_DIR}/common/locbased.cpp"
"${ICU_SOURCE_DIR}/common/locdispnames.cpp"
"${ICU_SOURCE_DIR}/common/locdistance.cpp"
"${ICU_SOURCE_DIR}/common/locdspnm.cpp"
"${ICU_SOURCE_DIR}/common/locid.cpp"
"${ICU_SOURCE_DIR}/common/loclikely.cpp"
"${ICU_SOURCE_DIR}/common/loclikelysubtags.cpp"
"${ICU_SOURCE_DIR}/common/locmap.cpp"
"${ICU_SOURCE_DIR}/common/locresdata.cpp"
"${ICU_SOURCE_DIR}/common/locutil.cpp"
"${ICU_SOURCE_DIR}/common/lsr.cpp"
"${ICU_SOURCE_DIR}/common/lstmbe.cpp"
"${ICU_SOURCE_DIR}/common/messagepattern.cpp"
"${ICU_SOURCE_DIR}/common/mlbe.cpp"
"${ICU_SOURCE_DIR}/common/normalizer2.cpp"
"${ICU_SOURCE_DIR}/common/normalizer2impl.cpp"
"${ICU_SOURCE_DIR}/common/normlzr.cpp"
"${ICU_SOURCE_DIR}/common/parsepos.cpp"
"${ICU_SOURCE_DIR}/common/patternprops.cpp"
"${ICU_SOURCE_DIR}/common/pluralmap.cpp"
"${ICU_SOURCE_DIR}/common/propname.cpp"
"${ICU_SOURCE_DIR}/common/propsvec.cpp"
"${ICU_SOURCE_DIR}/common/punycode.cpp"
"${ICU_SOURCE_DIR}/common/putil.cpp"
"${ICU_SOURCE_DIR}/common/rbbi.cpp"
"${ICU_SOURCE_DIR}/common/rbbi_cache.cpp"
"${ICU_SOURCE_DIR}/common/rbbidata.cpp"
"${ICU_SOURCE_DIR}/common/rbbinode.cpp"
"${ICU_SOURCE_DIR}/common/rbbirb.cpp"
@ -178,166 +80,180 @@ set(ICUUC_SOURCES
"${ICU_SOURCE_DIR}/common/rbbisetb.cpp"
"${ICU_SOURCE_DIR}/common/rbbistbl.cpp"
"${ICU_SOURCE_DIR}/common/rbbitblb.cpp"
"${ICU_SOURCE_DIR}/common/rbbi_cache.cpp"
"${ICU_SOURCE_DIR}/common/resbund.cpp"
"${ICU_SOURCE_DIR}/common/resbund_cnv.cpp"
"${ICU_SOURCE_DIR}/common/resource.cpp"
"${ICU_SOURCE_DIR}/common/restrace.cpp"
"${ICU_SOURCE_DIR}/common/ruleiter.cpp"
"${ICU_SOURCE_DIR}/common/schriter.cpp"
"${ICU_SOURCE_DIR}/common/serv.cpp"
"${ICU_SOURCE_DIR}/common/servnotf.cpp"
"${ICU_SOURCE_DIR}/common/servls.cpp"
"${ICU_SOURCE_DIR}/common/servlk.cpp"
"${ICU_SOURCE_DIR}/common/servlkf.cpp"
"${ICU_SOURCE_DIR}/common/servls.cpp"
"${ICU_SOURCE_DIR}/common/servnotf.cpp"
"${ICU_SOURCE_DIR}/common/servrbf.cpp"
"${ICU_SOURCE_DIR}/common/servslkf.cpp"
"${ICU_SOURCE_DIR}/common/uidna.cpp"
"${ICU_SOURCE_DIR}/common/usprep.cpp"
"${ICU_SOURCE_DIR}/common/uts46.cpp"
"${ICU_SOURCE_DIR}/common/punycode.cpp"
"${ICU_SOURCE_DIR}/common/util.cpp"
"${ICU_SOURCE_DIR}/common/util_props.cpp"
"${ICU_SOURCE_DIR}/common/parsepos.cpp"
"${ICU_SOURCE_DIR}/common/locbased.cpp"
"${ICU_SOURCE_DIR}/common/cwchar.cpp"
"${ICU_SOURCE_DIR}/common/wintz.cpp"
"${ICU_SOURCE_DIR}/common/dtintrv.cpp"
"${ICU_SOURCE_DIR}/common/ucnvsel.cpp"
"${ICU_SOURCE_DIR}/common/propsvec.cpp"
"${ICU_SOURCE_DIR}/common/ulist.cpp"
"${ICU_SOURCE_DIR}/common/uloc_tag.cpp"
"${ICU_SOURCE_DIR}/common/icudataver.cpp"
"${ICU_SOURCE_DIR}/common/icuplug.cpp"
"${ICU_SOURCE_DIR}/common/sharedobject.cpp"
"${ICU_SOURCE_DIR}/common/simpleformatter.cpp"
"${ICU_SOURCE_DIR}/common/unifiedcache.cpp"
"${ICU_SOURCE_DIR}/common/uloc_keytype.cpp"
"${ICU_SOURCE_DIR}/common/ubiditransform.cpp"
"${ICU_SOURCE_DIR}/common/pluralmap.cpp"
"${ICU_SOURCE_DIR}/common/static_unicode_sets.cpp"
"${ICU_SOURCE_DIR}/common/restrace.cpp"
"${ICU_SOURCE_DIR}/common/emojiprops.cpp"
"${ICU_SOURCE_DIR}/common/lstmbe.cpp")
"${ICU_SOURCE_DIR}/common/stringpiece.cpp"
"${ICU_SOURCE_DIR}/common/stringtriebuilder.cpp"
"${ICU_SOURCE_DIR}/common/uarrsort.cpp"
"${ICU_SOURCE_DIR}/common/ubidi.cpp"
"${ICU_SOURCE_DIR}/common/ubidi_props.cpp"
"${ICU_SOURCE_DIR}/common/ubidiln.cpp"
"${ICU_SOURCE_DIR}/common/ubiditransform.cpp"
"${ICU_SOURCE_DIR}/common/ubidiwrt.cpp"
"${ICU_SOURCE_DIR}/common/ubrk.cpp"
"${ICU_SOURCE_DIR}/common/ucase.cpp"
"${ICU_SOURCE_DIR}/common/ucasemap.cpp"
"${ICU_SOURCE_DIR}/common/ucasemap_titlecase_brkiter.cpp"
"${ICU_SOURCE_DIR}/common/ucat.cpp"
"${ICU_SOURCE_DIR}/common/uchar.cpp"
"${ICU_SOURCE_DIR}/common/ucharstrie.cpp"
"${ICU_SOURCE_DIR}/common/ucharstriebuilder.cpp"
"${ICU_SOURCE_DIR}/common/ucharstrieiterator.cpp"
"${ICU_SOURCE_DIR}/common/uchriter.cpp"
"${ICU_SOURCE_DIR}/common/ucln_cmn.cpp"
"${ICU_SOURCE_DIR}/common/ucmndata.cpp"
"${ICU_SOURCE_DIR}/common/ucnv.cpp"
"${ICU_SOURCE_DIR}/common/ucnv2022.cpp"
"${ICU_SOURCE_DIR}/common/ucnv_bld.cpp"
"${ICU_SOURCE_DIR}/common/ucnv_cb.cpp"
"${ICU_SOURCE_DIR}/common/ucnv_cnv.cpp"
"${ICU_SOURCE_DIR}/common/ucnv_ct.cpp"
"${ICU_SOURCE_DIR}/common/ucnv_err.cpp"
"${ICU_SOURCE_DIR}/common/ucnv_ext.cpp"
"${ICU_SOURCE_DIR}/common/ucnv_io.cpp"
"${ICU_SOURCE_DIR}/common/ucnv_lmb.cpp"
"${ICU_SOURCE_DIR}/common/ucnv_set.cpp"
"${ICU_SOURCE_DIR}/common/ucnv_u16.cpp"
"${ICU_SOURCE_DIR}/common/ucnv_u32.cpp"
"${ICU_SOURCE_DIR}/common/ucnv_u7.cpp"
"${ICU_SOURCE_DIR}/common/ucnv_u8.cpp"
"${ICU_SOURCE_DIR}/common/ucnvbocu.cpp"
"${ICU_SOURCE_DIR}/common/ucnvdisp.cpp"
"${ICU_SOURCE_DIR}/common/ucnvhz.cpp"
"${ICU_SOURCE_DIR}/common/ucnvisci.cpp"
"${ICU_SOURCE_DIR}/common/ucnvlat1.cpp"
"${ICU_SOURCE_DIR}/common/ucnvmbcs.cpp"
"${ICU_SOURCE_DIR}/common/ucnvscsu.cpp"
"${ICU_SOURCE_DIR}/common/ucnvsel.cpp"
"${ICU_SOURCE_DIR}/common/ucol_swp.cpp"
"${ICU_SOURCE_DIR}/common/ucptrie.cpp"
"${ICU_SOURCE_DIR}/common/ucurr.cpp"
"${ICU_SOURCE_DIR}/common/udata.cpp"
"${ICU_SOURCE_DIR}/common/udatamem.cpp"
"${ICU_SOURCE_DIR}/common/udataswp.cpp"
"${ICU_SOURCE_DIR}/common/uenum.cpp"
"${ICU_SOURCE_DIR}/common/uhash.cpp"
"${ICU_SOURCE_DIR}/common/uhash_us.cpp"
"${ICU_SOURCE_DIR}/common/uidna.cpp"
"${ICU_SOURCE_DIR}/common/uinit.cpp"
"${ICU_SOURCE_DIR}/common/uinvchar.cpp"
"${ICU_SOURCE_DIR}/common/uiter.cpp"
"${ICU_SOURCE_DIR}/common/ulist.cpp"
"${ICU_SOURCE_DIR}/common/uloc.cpp"
"${ICU_SOURCE_DIR}/common/uloc_keytype.cpp"
"${ICU_SOURCE_DIR}/common/uloc_tag.cpp"
"${ICU_SOURCE_DIR}/common/ulocale.cpp"
"${ICU_SOURCE_DIR}/common/ulocbuilder.cpp"
"${ICU_SOURCE_DIR}/common/umapfile.cpp"
"${ICU_SOURCE_DIR}/common/umath.cpp"
"${ICU_SOURCE_DIR}/common/umutablecptrie.cpp"
"${ICU_SOURCE_DIR}/common/umutex.cpp"
"${ICU_SOURCE_DIR}/common/unames.cpp"
"${ICU_SOURCE_DIR}/common/unifiedcache.cpp"
"${ICU_SOURCE_DIR}/common/unifilt.cpp"
"${ICU_SOURCE_DIR}/common/unifunct.cpp"
"${ICU_SOURCE_DIR}/common/uniset.cpp"
"${ICU_SOURCE_DIR}/common/uniset_closure.cpp"
"${ICU_SOURCE_DIR}/common/uniset_props.cpp"
"${ICU_SOURCE_DIR}/common/unisetspan.cpp"
"${ICU_SOURCE_DIR}/common/unistr.cpp"
"${ICU_SOURCE_DIR}/common/unistr_case.cpp"
"${ICU_SOURCE_DIR}/common/unistr_case_locale.cpp"
"${ICU_SOURCE_DIR}/common/unistr_cnv.cpp"
"${ICU_SOURCE_DIR}/common/unistr_props.cpp"
"${ICU_SOURCE_DIR}/common/unistr_titlecase_brkiter.cpp"
"${ICU_SOURCE_DIR}/common/unorm.cpp"
"${ICU_SOURCE_DIR}/common/unormcmp.cpp"
"${ICU_SOURCE_DIR}/common/uobject.cpp"
"${ICU_SOURCE_DIR}/common/uprops.cpp"
"${ICU_SOURCE_DIR}/common/ures_cnv.cpp"
"${ICU_SOURCE_DIR}/common/uresbund.cpp"
"${ICU_SOURCE_DIR}/common/uresdata.cpp"
"${ICU_SOURCE_DIR}/common/usc_impl.cpp"
"${ICU_SOURCE_DIR}/common/uscript.cpp"
"${ICU_SOURCE_DIR}/common/uscript_props.cpp"
"${ICU_SOURCE_DIR}/common/uset.cpp"
"${ICU_SOURCE_DIR}/common/uset_props.cpp"
"${ICU_SOURCE_DIR}/common/usetiter.cpp"
"${ICU_SOURCE_DIR}/common/ushape.cpp"
"${ICU_SOURCE_DIR}/common/usprep.cpp"
"${ICU_SOURCE_DIR}/common/ustack.cpp"
"${ICU_SOURCE_DIR}/common/ustr_cnv.cpp"
"${ICU_SOURCE_DIR}/common/ustr_titlecase_brkiter.cpp"
"${ICU_SOURCE_DIR}/common/ustr_wcs.cpp"
"${ICU_SOURCE_DIR}/common/ustrcase.cpp"
"${ICU_SOURCE_DIR}/common/ustrcase_locale.cpp"
"${ICU_SOURCE_DIR}/common/ustrenum.cpp"
"${ICU_SOURCE_DIR}/common/ustrfmt.cpp"
"${ICU_SOURCE_DIR}/common/ustring.cpp"
"${ICU_SOURCE_DIR}/common/ustrtrns.cpp"
"${ICU_SOURCE_DIR}/common/utext.cpp"
"${ICU_SOURCE_DIR}/common/utf_impl.cpp"
"${ICU_SOURCE_DIR}/common/util.cpp"
"${ICU_SOURCE_DIR}/common/util_props.cpp"
"${ICU_SOURCE_DIR}/common/utrace.cpp"
"${ICU_SOURCE_DIR}/common/utrie.cpp"
"${ICU_SOURCE_DIR}/common/utrie2.cpp"
"${ICU_SOURCE_DIR}/common/utrie2_builder.cpp"
"${ICU_SOURCE_DIR}/common/utrie_swap.cpp"
"${ICU_SOURCE_DIR}/common/uts46.cpp"
"${ICU_SOURCE_DIR}/common/utypes.cpp"
"${ICU_SOURCE_DIR}/common/uvector.cpp"
"${ICU_SOURCE_DIR}/common/uvectr32.cpp"
"${ICU_SOURCE_DIR}/common/uvectr64.cpp"
"${ICU_SOURCE_DIR}/common/wintz.cpp")
set(ICUI18N_SOURCES
"${ICU_SOURCE_DIR}/i18n/ucln_in.cpp"
"${ICU_SOURCE_DIR}/i18n/fmtable.cpp"
"${ICU_SOURCE_DIR}/i18n/format.cpp"
"${ICU_SOURCE_DIR}/i18n/msgfmt.cpp"
"${ICU_SOURCE_DIR}/i18n/umsg.cpp"
"${ICU_SOURCE_DIR}/i18n/numfmt.cpp"
"${ICU_SOURCE_DIR}/i18n/unum.cpp"
"${ICU_SOURCE_DIR}/i18n/decimfmt.cpp"
"${ICU_SOURCE_DIR}/i18n/dcfmtsym.cpp"
"${ICU_SOURCE_DIR}/i18n/fmtable_cnv.cpp"
"${ICU_SOURCE_DIR}/i18n/choicfmt.cpp"
"${ICU_SOURCE_DIR}/i18n/datefmt.cpp"
"${ICU_SOURCE_DIR}/i18n/smpdtfmt.cpp"
"${ICU_SOURCE_DIR}/i18n/reldtfmt.cpp"
"${ICU_SOURCE_DIR}/i18n/dtfmtsym.cpp"
"${ICU_SOURCE_DIR}/i18n/udat.cpp"
"${ICU_SOURCE_DIR}/i18n/dtptngen.cpp"
"${ICU_SOURCE_DIR}/i18n/udatpg.cpp"
"${ICU_SOURCE_DIR}/i18n/nfrs.cpp"
"${ICU_SOURCE_DIR}/i18n/nfrule.cpp"
"${ICU_SOURCE_DIR}/i18n/nfsubs.cpp"
"${ICU_SOURCE_DIR}/i18n/rbnf.cpp"
"${ICU_SOURCE_DIR}/i18n/numsys.cpp"
"${ICU_SOURCE_DIR}/i18n/unumsys.cpp"
"${ICU_SOURCE_DIR}/i18n/ucsdet.cpp"
"${ICU_SOURCE_DIR}/i18n/ucal.cpp"
"${ICU_SOURCE_DIR}/i18n/calendar.cpp"
"${ICU_SOURCE_DIR}/i18n/gregocal.cpp"
"${ICU_SOURCE_DIR}/i18n/timezone.cpp"
"${ICU_SOURCE_DIR}/i18n/simpletz.cpp"
"${ICU_SOURCE_DIR}/i18n/olsontz.cpp"
"${ICU_SOURCE_DIR}/i18n/alphaindex.cpp"
"${ICU_SOURCE_DIR}/i18n/anytrans.cpp"
"${ICU_SOURCE_DIR}/i18n/astro.cpp"
"${ICU_SOURCE_DIR}/i18n/taiwncal.cpp"
"${ICU_SOURCE_DIR}/i18n/basictz.cpp"
"${ICU_SOURCE_DIR}/i18n/bocsu.cpp"
"${ICU_SOURCE_DIR}/i18n/brktrans.cpp"
"${ICU_SOURCE_DIR}/i18n/buddhcal.cpp"
"${ICU_SOURCE_DIR}/i18n/persncal.cpp"
"${ICU_SOURCE_DIR}/i18n/islamcal.cpp"
"${ICU_SOURCE_DIR}/i18n/japancal.cpp"
"${ICU_SOURCE_DIR}/i18n/gregoimp.cpp"
"${ICU_SOURCE_DIR}/i18n/hebrwcal.cpp"
"${ICU_SOURCE_DIR}/i18n/indiancal.cpp"
"${ICU_SOURCE_DIR}/i18n/chnsecal.cpp"
"${ICU_SOURCE_DIR}/i18n/calendar.cpp"
"${ICU_SOURCE_DIR}/i18n/casetrn.cpp"
"${ICU_SOURCE_DIR}/i18n/cecal.cpp"
"${ICU_SOURCE_DIR}/i18n/coptccal.cpp"
"${ICU_SOURCE_DIR}/i18n/dangical.cpp"
"${ICU_SOURCE_DIR}/i18n/ethpccal.cpp"
"${ICU_SOURCE_DIR}/i18n/chnsecal.cpp"
"${ICU_SOURCE_DIR}/i18n/choicfmt.cpp"
"${ICU_SOURCE_DIR}/i18n/coleitr.cpp"
"${ICU_SOURCE_DIR}/i18n/coll.cpp"
"${ICU_SOURCE_DIR}/i18n/sortkey.cpp"
"${ICU_SOURCE_DIR}/i18n/bocsu.cpp"
"${ICU_SOURCE_DIR}/i18n/ucoleitr.cpp"
"${ICU_SOURCE_DIR}/i18n/ucol.cpp"
"${ICU_SOURCE_DIR}/i18n/ucol_res.cpp"
"${ICU_SOURCE_DIR}/i18n/ucol_sit.cpp"
"${ICU_SOURCE_DIR}/i18n/collation.cpp"
"${ICU_SOURCE_DIR}/i18n/collationsettings.cpp"
"${ICU_SOURCE_DIR}/i18n/collationbuilder.cpp"
"${ICU_SOURCE_DIR}/i18n/collationcompare.cpp"
"${ICU_SOURCE_DIR}/i18n/collationdata.cpp"
"${ICU_SOURCE_DIR}/i18n/collationtailoring.cpp"
"${ICU_SOURCE_DIR}/i18n/collationdatabuilder.cpp"
"${ICU_SOURCE_DIR}/i18n/collationdatareader.cpp"
"${ICU_SOURCE_DIR}/i18n/collationdatawriter.cpp"
"${ICU_SOURCE_DIR}/i18n/collationfastlatin.cpp"
"${ICU_SOURCE_DIR}/i18n/collationfastlatinbuilder.cpp"
"${ICU_SOURCE_DIR}/i18n/collationfcd.cpp"
"${ICU_SOURCE_DIR}/i18n/collationiterator.cpp"
"${ICU_SOURCE_DIR}/i18n/utf16collationiterator.cpp"
"${ICU_SOURCE_DIR}/i18n/utf8collationiterator.cpp"
"${ICU_SOURCE_DIR}/i18n/uitercollationiterator.cpp"
"${ICU_SOURCE_DIR}/i18n/collationsets.cpp"
"${ICU_SOURCE_DIR}/i18n/collationcompare.cpp"
"${ICU_SOURCE_DIR}/i18n/collationfastlatin.cpp"
"${ICU_SOURCE_DIR}/i18n/collationkeys.cpp"
"${ICU_SOURCE_DIR}/i18n/rulebasedcollator.cpp"
"${ICU_SOURCE_DIR}/i18n/collationroot.cpp"
"${ICU_SOURCE_DIR}/i18n/collationrootelements.cpp"
"${ICU_SOURCE_DIR}/i18n/collationdatabuilder.cpp"
"${ICU_SOURCE_DIR}/i18n/collationweights.cpp"
"${ICU_SOURCE_DIR}/i18n/collationruleparser.cpp"
"${ICU_SOURCE_DIR}/i18n/collationbuilder.cpp"
"${ICU_SOURCE_DIR}/i18n/collationfastlatinbuilder.cpp"
"${ICU_SOURCE_DIR}/i18n/listformatter.cpp"
"${ICU_SOURCE_DIR}/i18n/ulistformatter.cpp"
"${ICU_SOURCE_DIR}/i18n/strmatch.cpp"
"${ICU_SOURCE_DIR}/i18n/usearch.cpp"
"${ICU_SOURCE_DIR}/i18n/search.cpp"
"${ICU_SOURCE_DIR}/i18n/stsearch.cpp"
"${ICU_SOURCE_DIR}/i18n/translit.cpp"
"${ICU_SOURCE_DIR}/i18n/utrans.cpp"
"${ICU_SOURCE_DIR}/i18n/esctrn.cpp"
"${ICU_SOURCE_DIR}/i18n/unesctrn.cpp"
"${ICU_SOURCE_DIR}/i18n/funcrepl.cpp"
"${ICU_SOURCE_DIR}/i18n/strrepl.cpp"
"${ICU_SOURCE_DIR}/i18n/tridpars.cpp"
"${ICU_SOURCE_DIR}/i18n/collationsets.cpp"
"${ICU_SOURCE_DIR}/i18n/collationsettings.cpp"
"${ICU_SOURCE_DIR}/i18n/collationtailoring.cpp"
"${ICU_SOURCE_DIR}/i18n/collationweights.cpp"
"${ICU_SOURCE_DIR}/i18n/compactdecimalformat.cpp"
"${ICU_SOURCE_DIR}/i18n/coptccal.cpp"
"${ICU_SOURCE_DIR}/i18n/cpdtrans.cpp"
"${ICU_SOURCE_DIR}/i18n/rbt.cpp"
"${ICU_SOURCE_DIR}/i18n/rbt_data.cpp"
"${ICU_SOURCE_DIR}/i18n/rbt_pars.cpp"
"${ICU_SOURCE_DIR}/i18n/rbt_rule.cpp"
"${ICU_SOURCE_DIR}/i18n/rbt_set.cpp"
"${ICU_SOURCE_DIR}/i18n/nultrans.cpp"
"${ICU_SOURCE_DIR}/i18n/remtrans.cpp"
"${ICU_SOURCE_DIR}/i18n/casetrn.cpp"
"${ICU_SOURCE_DIR}/i18n/titletrn.cpp"
"${ICU_SOURCE_DIR}/i18n/tolowtrn.cpp"
"${ICU_SOURCE_DIR}/i18n/toupptrn.cpp"
"${ICU_SOURCE_DIR}/i18n/anytrans.cpp"
"${ICU_SOURCE_DIR}/i18n/name2uni.cpp"
"${ICU_SOURCE_DIR}/i18n/uni2name.cpp"
"${ICU_SOURCE_DIR}/i18n/nortrans.cpp"
"${ICU_SOURCE_DIR}/i18n/quant.cpp"
"${ICU_SOURCE_DIR}/i18n/transreg.cpp"
"${ICU_SOURCE_DIR}/i18n/brktrans.cpp"
"${ICU_SOURCE_DIR}/i18n/regexcmp.cpp"
"${ICU_SOURCE_DIR}/i18n/rematch.cpp"
"${ICU_SOURCE_DIR}/i18n/repattrn.cpp"
"${ICU_SOURCE_DIR}/i18n/regexst.cpp"
"${ICU_SOURCE_DIR}/i18n/regextxt.cpp"
"${ICU_SOURCE_DIR}/i18n/regeximp.cpp"
"${ICU_SOURCE_DIR}/i18n/uregex.cpp"
"${ICU_SOURCE_DIR}/i18n/uregexc.cpp"
"${ICU_SOURCE_DIR}/i18n/ulocdata.cpp"
"${ICU_SOURCE_DIR}/i18n/measfmt.cpp"
"${ICU_SOURCE_DIR}/i18n/currfmt.cpp"
"${ICU_SOURCE_DIR}/i18n/curramt.cpp"
"${ICU_SOURCE_DIR}/i18n/currunit.cpp"
"${ICU_SOURCE_DIR}/i18n/measure.cpp"
"${ICU_SOURCE_DIR}/i18n/utmscale.cpp"
"${ICU_SOURCE_DIR}/i18n/csdetect.cpp"
"${ICU_SOURCE_DIR}/i18n/csmatch.cpp"
"${ICU_SOURCE_DIR}/i18n/csr2022.cpp"
@ -346,60 +262,80 @@ set(ICUI18N_SOURCES
"${ICU_SOURCE_DIR}/i18n/csrsbcs.cpp"
"${ICU_SOURCE_DIR}/i18n/csrucode.cpp"
"${ICU_SOURCE_DIR}/i18n/csrutf8.cpp"
"${ICU_SOURCE_DIR}/i18n/inputext.cpp"
"${ICU_SOURCE_DIR}/i18n/wintzimpl.cpp"
"${ICU_SOURCE_DIR}/i18n/windtfmt.cpp"
"${ICU_SOURCE_DIR}/i18n/winnmfmt.cpp"
"${ICU_SOURCE_DIR}/i18n/basictz.cpp"
"${ICU_SOURCE_DIR}/i18n/dtrule.cpp"
"${ICU_SOURCE_DIR}/i18n/rbtz.cpp"
"${ICU_SOURCE_DIR}/i18n/tzrule.cpp"
"${ICU_SOURCE_DIR}/i18n/tztrans.cpp"
"${ICU_SOURCE_DIR}/i18n/vtzone.cpp"
"${ICU_SOURCE_DIR}/i18n/zonemeta.cpp"
"${ICU_SOURCE_DIR}/i18n/standardplural.cpp"
"${ICU_SOURCE_DIR}/i18n/upluralrules.cpp"
"${ICU_SOURCE_DIR}/i18n/plurrule.cpp"
"${ICU_SOURCE_DIR}/i18n/plurfmt.cpp"
"${ICU_SOURCE_DIR}/i18n/selfmt.cpp"
"${ICU_SOURCE_DIR}/i18n/curramt.cpp"
"${ICU_SOURCE_DIR}/i18n/currfmt.cpp"
"${ICU_SOURCE_DIR}/i18n/currpinf.cpp"
"${ICU_SOURCE_DIR}/i18n/currunit.cpp"
"${ICU_SOURCE_DIR}/i18n/dangical.cpp"
"${ICU_SOURCE_DIR}/i18n/datefmt.cpp"
"${ICU_SOURCE_DIR}/i18n/dayperiodrules.cpp"
"${ICU_SOURCE_DIR}/i18n/dcfmtsym.cpp"
"${ICU_SOURCE_DIR}/i18n/decContext.cpp"
"${ICU_SOURCE_DIR}/i18n/decNumber.cpp"
"${ICU_SOURCE_DIR}/i18n/decimfmt.cpp"
"${ICU_SOURCE_DIR}/i18n/displayoptions.cpp"
"${ICU_SOURCE_DIR}/i18n/double-conversion-bignum-dtoa.cpp"
"${ICU_SOURCE_DIR}/i18n/double-conversion-bignum.cpp"
"${ICU_SOURCE_DIR}/i18n/double-conversion-cached-powers.cpp"
"${ICU_SOURCE_DIR}/i18n/double-conversion-double-to-string.cpp"
"${ICU_SOURCE_DIR}/i18n/double-conversion-fast-dtoa.cpp"
"${ICU_SOURCE_DIR}/i18n/double-conversion-string-to-double.cpp"
"${ICU_SOURCE_DIR}/i18n/double-conversion-strtod.cpp"
"${ICU_SOURCE_DIR}/i18n/dtfmtsym.cpp"
"${ICU_SOURCE_DIR}/i18n/dtitvfmt.cpp"
"${ICU_SOURCE_DIR}/i18n/dtitvinf.cpp"
"${ICU_SOURCE_DIR}/i18n/udateintervalformat.cpp"
"${ICU_SOURCE_DIR}/i18n/tmunit.cpp"
"${ICU_SOURCE_DIR}/i18n/tmutamt.cpp"
"${ICU_SOURCE_DIR}/i18n/tmutfmt.cpp"
"${ICU_SOURCE_DIR}/i18n/currpinf.cpp"
"${ICU_SOURCE_DIR}/i18n/uspoof.cpp"
"${ICU_SOURCE_DIR}/i18n/uspoof_impl.cpp"
"${ICU_SOURCE_DIR}/i18n/uspoof_build.cpp"
"${ICU_SOURCE_DIR}/i18n/uspoof_conf.cpp"
"${ICU_SOURCE_DIR}/i18n/smpdtfst.cpp"
"${ICU_SOURCE_DIR}/i18n/ztrans.cpp"
"${ICU_SOURCE_DIR}/i18n/zrule.cpp"
"${ICU_SOURCE_DIR}/i18n/vzone.cpp"
"${ICU_SOURCE_DIR}/i18n/dtptngen.cpp"
"${ICU_SOURCE_DIR}/i18n/dtrule.cpp"
"${ICU_SOURCE_DIR}/i18n/erarules.cpp"
"${ICU_SOURCE_DIR}/i18n/esctrn.cpp"
"${ICU_SOURCE_DIR}/i18n/ethpccal.cpp"
"${ICU_SOURCE_DIR}/i18n/fmtable.cpp"
"${ICU_SOURCE_DIR}/i18n/fmtable_cnv.cpp"
"${ICU_SOURCE_DIR}/i18n/format.cpp"
"${ICU_SOURCE_DIR}/i18n/formatted_string_builder.cpp"
"${ICU_SOURCE_DIR}/i18n/formattedval_iterimpl.cpp"
"${ICU_SOURCE_DIR}/i18n/formattedval_sbimpl.cpp"
"${ICU_SOURCE_DIR}/i18n/formattedvalue.cpp"
"${ICU_SOURCE_DIR}/i18n/fphdlimp.cpp"
"${ICU_SOURCE_DIR}/i18n/fpositer.cpp"
"${ICU_SOURCE_DIR}/i18n/ufieldpositer.cpp"
"${ICU_SOURCE_DIR}/i18n/decNumber.cpp"
"${ICU_SOURCE_DIR}/i18n/decContext.cpp"
"${ICU_SOURCE_DIR}/i18n/alphaindex.cpp"
"${ICU_SOURCE_DIR}/i18n/tznames.cpp"
"${ICU_SOURCE_DIR}/i18n/tznames_impl.cpp"
"${ICU_SOURCE_DIR}/i18n/tzgnames.cpp"
"${ICU_SOURCE_DIR}/i18n/tzfmt.cpp"
"${ICU_SOURCE_DIR}/i18n/compactdecimalformat.cpp"
"${ICU_SOURCE_DIR}/i18n/funcrepl.cpp"
"${ICU_SOURCE_DIR}/i18n/gender.cpp"
"${ICU_SOURCE_DIR}/i18n/region.cpp"
"${ICU_SOURCE_DIR}/i18n/scriptset.cpp"
"${ICU_SOURCE_DIR}/i18n/uregion.cpp"
"${ICU_SOURCE_DIR}/i18n/reldatefmt.cpp"
"${ICU_SOURCE_DIR}/i18n/quantityformatter.cpp"
"${ICU_SOURCE_DIR}/i18n/gregocal.cpp"
"${ICU_SOURCE_DIR}/i18n/gregoimp.cpp"
"${ICU_SOURCE_DIR}/i18n/hebrwcal.cpp"
"${ICU_SOURCE_DIR}/i18n/indiancal.cpp"
"${ICU_SOURCE_DIR}/i18n/inputext.cpp"
"${ICU_SOURCE_DIR}/i18n/islamcal.cpp"
"${ICU_SOURCE_DIR}/i18n/iso8601cal.cpp"
"${ICU_SOURCE_DIR}/i18n/japancal.cpp"
"${ICU_SOURCE_DIR}/i18n/listformatter.cpp"
"${ICU_SOURCE_DIR}/i18n/measfmt.cpp"
"${ICU_SOURCE_DIR}/i18n/measunit.cpp"
"${ICU_SOURCE_DIR}/i18n/sharedbreakiterator.cpp"
"${ICU_SOURCE_DIR}/i18n/scientificnumberformatter.cpp"
"${ICU_SOURCE_DIR}/i18n/dayperiodrules.cpp"
"${ICU_SOURCE_DIR}/i18n/measunit_extra.cpp"
"${ICU_SOURCE_DIR}/i18n/measure.cpp"
"${ICU_SOURCE_DIR}/i18n/messageformat2.cpp"
"${ICU_SOURCE_DIR}/i18n/messageformat2_arguments.cpp"
"${ICU_SOURCE_DIR}/i18n/messageformat2_checker.cpp"
"${ICU_SOURCE_DIR}/i18n/messageformat2_data_model.cpp"
"${ICU_SOURCE_DIR}/i18n/messageformat2_errors.cpp"
"${ICU_SOURCE_DIR}/i18n/messageformat2_evaluation.cpp"
"${ICU_SOURCE_DIR}/i18n/messageformat2_formattable.cpp"
"${ICU_SOURCE_DIR}/i18n/messageformat2_formatter.cpp"
"${ICU_SOURCE_DIR}/i18n/messageformat2_function_registry.cpp"
"${ICU_SOURCE_DIR}/i18n/messageformat2_parser.cpp"
"${ICU_SOURCE_DIR}/i18n/messageformat2_serializer.cpp"
"${ICU_SOURCE_DIR}/i18n/msgfmt.cpp"
"${ICU_SOURCE_DIR}/i18n/name2uni.cpp"
"${ICU_SOURCE_DIR}/i18n/nfrs.cpp"
"${ICU_SOURCE_DIR}/i18n/nfrule.cpp"
"${ICU_SOURCE_DIR}/i18n/nfsubs.cpp"
"${ICU_SOURCE_DIR}/i18n/nortrans.cpp"
"${ICU_SOURCE_DIR}/i18n/nultrans.cpp"
"${ICU_SOURCE_DIR}/i18n/number_affixutils.cpp"
"${ICU_SOURCE_DIR}/i18n/number_asformat.cpp"
"${ICU_SOURCE_DIR}/i18n/number_capi.cpp"
"${ICU_SOURCE_DIR}/i18n/number_compact.cpp"
"${ICU_SOURCE_DIR}/i18n/number_currencysymbols.cpp"
"${ICU_SOURCE_DIR}/i18n/number_decimalquantity.cpp"
"${ICU_SOURCE_DIR}/i18n/number_decimfmtprops.cpp"
"${ICU_SOURCE_DIR}/i18n/number_fluent.cpp"
@ -407,7 +343,9 @@ set(ICUI18N_SOURCES
"${ICU_SOURCE_DIR}/i18n/number_grouping.cpp"
"${ICU_SOURCE_DIR}/i18n/number_integerwidth.cpp"
"${ICU_SOURCE_DIR}/i18n/number_longnames.cpp"
"${ICU_SOURCE_DIR}/i18n/number_mapper.cpp"
"${ICU_SOURCE_DIR}/i18n/number_modifiers.cpp"
"${ICU_SOURCE_DIR}/i18n/number_multiplier.cpp"
"${ICU_SOURCE_DIR}/i18n/number_notation.cpp"
"${ICU_SOURCE_DIR}/i18n/number_output.cpp"
"${ICU_SOURCE_DIR}/i18n/number_padding.cpp"
@ -415,46 +353,125 @@ set(ICUI18N_SOURCES
"${ICU_SOURCE_DIR}/i18n/number_patternstring.cpp"
"${ICU_SOURCE_DIR}/i18n/number_rounding.cpp"
"${ICU_SOURCE_DIR}/i18n/number_scientific.cpp"
"${ICU_SOURCE_DIR}/i18n/number_utils.cpp"
"${ICU_SOURCE_DIR}/i18n/number_asformat.cpp"
"${ICU_SOURCE_DIR}/i18n/number_mapper.cpp"
"${ICU_SOURCE_DIR}/i18n/number_multiplier.cpp"
"${ICU_SOURCE_DIR}/i18n/number_currencysymbols.cpp"
"${ICU_SOURCE_DIR}/i18n/number_simple.cpp"
"${ICU_SOURCE_DIR}/i18n/number_skeletons.cpp"
"${ICU_SOURCE_DIR}/i18n/number_capi.cpp"
"${ICU_SOURCE_DIR}/i18n/double-conversion-string-to-double.cpp"
"${ICU_SOURCE_DIR}/i18n/double-conversion-double-to-string.cpp"
"${ICU_SOURCE_DIR}/i18n/double-conversion-bignum-dtoa.cpp"
"${ICU_SOURCE_DIR}/i18n/double-conversion-bignum.cpp"
"${ICU_SOURCE_DIR}/i18n/double-conversion-cached-powers.cpp"
"${ICU_SOURCE_DIR}/i18n/double-conversion-fast-dtoa.cpp"
"${ICU_SOURCE_DIR}/i18n/double-conversion-strtod.cpp"
"${ICU_SOURCE_DIR}/i18n/string_segment.cpp"
"${ICU_SOURCE_DIR}/i18n/numparse_parsednumber.cpp"
"${ICU_SOURCE_DIR}/i18n/numparse_impl.cpp"
"${ICU_SOURCE_DIR}/i18n/numparse_symbols.cpp"
"${ICU_SOURCE_DIR}/i18n/numparse_decimal.cpp"
"${ICU_SOURCE_DIR}/i18n/numparse_scientific.cpp"
"${ICU_SOURCE_DIR}/i18n/numparse_currency.cpp"
"${ICU_SOURCE_DIR}/i18n/numparse_affixes.cpp"
"${ICU_SOURCE_DIR}/i18n/numparse_compositions.cpp"
"${ICU_SOURCE_DIR}/i18n/numparse_validators.cpp"
"${ICU_SOURCE_DIR}/i18n/numrange_fluent.cpp"
"${ICU_SOURCE_DIR}/i18n/numrange_impl.cpp"
"${ICU_SOURCE_DIR}/i18n/erarules.cpp"
"${ICU_SOURCE_DIR}/i18n/formattedvalue.cpp"
"${ICU_SOURCE_DIR}/i18n/formattedval_iterimpl.cpp"
"${ICU_SOURCE_DIR}/i18n/formattedval_sbimpl.cpp"
"${ICU_SOURCE_DIR}/i18n/formatted_string_builder.cpp"
"${ICU_SOURCE_DIR}/i18n/measunit_extra.cpp"
"${ICU_SOURCE_DIR}/i18n/number_symbolswrapper.cpp"
"${ICU_SOURCE_DIR}/i18n/number_usageprefs.cpp"
"${ICU_SOURCE_DIR}/i18n/number_utils.cpp"
"${ICU_SOURCE_DIR}/i18n/numfmt.cpp"
"${ICU_SOURCE_DIR}/i18n/numparse_affixes.cpp"
"${ICU_SOURCE_DIR}/i18n/numparse_compositions.cpp"
"${ICU_SOURCE_DIR}/i18n/numparse_currency.cpp"
"${ICU_SOURCE_DIR}/i18n/numparse_decimal.cpp"
"${ICU_SOURCE_DIR}/i18n/numparse_impl.cpp"
"${ICU_SOURCE_DIR}/i18n/numparse_parsednumber.cpp"
"${ICU_SOURCE_DIR}/i18n/numparse_scientific.cpp"
"${ICU_SOURCE_DIR}/i18n/numparse_symbols.cpp"
"${ICU_SOURCE_DIR}/i18n/numparse_validators.cpp"
"${ICU_SOURCE_DIR}/i18n/numrange_capi.cpp"
"${ICU_SOURCE_DIR}/i18n/numrange_fluent.cpp"
"${ICU_SOURCE_DIR}/i18n/numrange_impl.cpp"
"${ICU_SOURCE_DIR}/i18n/numsys.cpp"
"${ICU_SOURCE_DIR}/i18n/olsontz.cpp"
"${ICU_SOURCE_DIR}/i18n/persncal.cpp"
"${ICU_SOURCE_DIR}/i18n/pluralranges.cpp"
"${ICU_SOURCE_DIR}/i18n/plurfmt.cpp"
"${ICU_SOURCE_DIR}/i18n/plurrule.cpp"
"${ICU_SOURCE_DIR}/i18n/quant.cpp"
"${ICU_SOURCE_DIR}/i18n/quantityformatter.cpp"
"${ICU_SOURCE_DIR}/i18n/rbnf.cpp"
"${ICU_SOURCE_DIR}/i18n/rbt.cpp"
"${ICU_SOURCE_DIR}/i18n/rbt_data.cpp"
"${ICU_SOURCE_DIR}/i18n/rbt_pars.cpp"
"${ICU_SOURCE_DIR}/i18n/rbt_rule.cpp"
"${ICU_SOURCE_DIR}/i18n/rbt_set.cpp"
"${ICU_SOURCE_DIR}/i18n/rbtz.cpp"
"${ICU_SOURCE_DIR}/i18n/regexcmp.cpp"
"${ICU_SOURCE_DIR}/i18n/regeximp.cpp"
"${ICU_SOURCE_DIR}/i18n/regexst.cpp"
"${ICU_SOURCE_DIR}/i18n/regextxt.cpp"
"${ICU_SOURCE_DIR}/i18n/region.cpp"
"${ICU_SOURCE_DIR}/i18n/reldatefmt.cpp"
"${ICU_SOURCE_DIR}/i18n/reldtfmt.cpp"
"${ICU_SOURCE_DIR}/i18n/rematch.cpp"
"${ICU_SOURCE_DIR}/i18n/remtrans.cpp"
"${ICU_SOURCE_DIR}/i18n/repattrn.cpp"
"${ICU_SOURCE_DIR}/i18n/rulebasedcollator.cpp"
"${ICU_SOURCE_DIR}/i18n/scientificnumberformatter.cpp"
"${ICU_SOURCE_DIR}/i18n/scriptset.cpp"
"${ICU_SOURCE_DIR}/i18n/search.cpp"
"${ICU_SOURCE_DIR}/i18n/selfmt.cpp"
"${ICU_SOURCE_DIR}/i18n/sharedbreakiterator.cpp"
"${ICU_SOURCE_DIR}/i18n/simpletz.cpp"
"${ICU_SOURCE_DIR}/i18n/smpdtfmt.cpp"
"${ICU_SOURCE_DIR}/i18n/smpdtfst.cpp"
"${ICU_SOURCE_DIR}/i18n/sortkey.cpp"
"${ICU_SOURCE_DIR}/i18n/standardplural.cpp"
"${ICU_SOURCE_DIR}/i18n/string_segment.cpp"
"${ICU_SOURCE_DIR}/i18n/strmatch.cpp"
"${ICU_SOURCE_DIR}/i18n/strrepl.cpp"
"${ICU_SOURCE_DIR}/i18n/stsearch.cpp"
"${ICU_SOURCE_DIR}/i18n/taiwncal.cpp"
"${ICU_SOURCE_DIR}/i18n/timezone.cpp"
"${ICU_SOURCE_DIR}/i18n/titletrn.cpp"
"${ICU_SOURCE_DIR}/i18n/tmunit.cpp"
"${ICU_SOURCE_DIR}/i18n/tmutamt.cpp"
"${ICU_SOURCE_DIR}/i18n/tmutfmt.cpp"
"${ICU_SOURCE_DIR}/i18n/tolowtrn.cpp"
"${ICU_SOURCE_DIR}/i18n/toupptrn.cpp"
"${ICU_SOURCE_DIR}/i18n/translit.cpp"
"${ICU_SOURCE_DIR}/i18n/transreg.cpp"
"${ICU_SOURCE_DIR}/i18n/tridpars.cpp"
"${ICU_SOURCE_DIR}/i18n/tzfmt.cpp"
"${ICU_SOURCE_DIR}/i18n/tzgnames.cpp"
"${ICU_SOURCE_DIR}/i18n/tznames.cpp"
"${ICU_SOURCE_DIR}/i18n/tznames_impl.cpp"
"${ICU_SOURCE_DIR}/i18n/tzrule.cpp"
"${ICU_SOURCE_DIR}/i18n/tztrans.cpp"
"${ICU_SOURCE_DIR}/i18n/ucal.cpp"
"${ICU_SOURCE_DIR}/i18n/ucln_in.cpp"
"${ICU_SOURCE_DIR}/i18n/ucol.cpp"
"${ICU_SOURCE_DIR}/i18n/ucol_res.cpp"
"${ICU_SOURCE_DIR}/i18n/ucol_sit.cpp"
"${ICU_SOURCE_DIR}/i18n/ucoleitr.cpp"
"${ICU_SOURCE_DIR}/i18n/ucsdet.cpp"
"${ICU_SOURCE_DIR}/i18n/udat.cpp"
"${ICU_SOURCE_DIR}/i18n/udateintervalformat.cpp"
"${ICU_SOURCE_DIR}/i18n/udatpg.cpp"
"${ICU_SOURCE_DIR}/i18n/ufieldpositer.cpp"
"${ICU_SOURCE_DIR}/i18n/uitercollationiterator.cpp"
"${ICU_SOURCE_DIR}/i18n/ulistformatter.cpp"
"${ICU_SOURCE_DIR}/i18n/ulocdata.cpp"
"${ICU_SOURCE_DIR}/i18n/umsg.cpp"
"${ICU_SOURCE_DIR}/i18n/unesctrn.cpp"
"${ICU_SOURCE_DIR}/i18n/uni2name.cpp"
"${ICU_SOURCE_DIR}/i18n/units_complexconverter.cpp"
"${ICU_SOURCE_DIR}/i18n/units_converter.cpp"
"${ICU_SOURCE_DIR}/i18n/units_data.cpp"
"${ICU_SOURCE_DIR}/i18n/units_router.cpp")
"${ICU_SOURCE_DIR}/i18n/units_router.cpp"
"${ICU_SOURCE_DIR}/i18n/unum.cpp"
"${ICU_SOURCE_DIR}/i18n/unumsys.cpp"
"${ICU_SOURCE_DIR}/i18n/upluralrules.cpp"
"${ICU_SOURCE_DIR}/i18n/uregex.cpp"
"${ICU_SOURCE_DIR}/i18n/uregexc.cpp"
"${ICU_SOURCE_DIR}/i18n/uregion.cpp"
"${ICU_SOURCE_DIR}/i18n/usearch.cpp"
"${ICU_SOURCE_DIR}/i18n/uspoof.cpp"
"${ICU_SOURCE_DIR}/i18n/uspoof_build.cpp"
"${ICU_SOURCE_DIR}/i18n/uspoof_conf.cpp"
"${ICU_SOURCE_DIR}/i18n/uspoof_impl.cpp"
"${ICU_SOURCE_DIR}/i18n/utf16collationiterator.cpp"
"${ICU_SOURCE_DIR}/i18n/utf8collationiterator.cpp"
"${ICU_SOURCE_DIR}/i18n/utmscale.cpp"
"${ICU_SOURCE_DIR}/i18n/utrans.cpp"
"${ICU_SOURCE_DIR}/i18n/vtzone.cpp"
"${ICU_SOURCE_DIR}/i18n/vzone.cpp"
"${ICU_SOURCE_DIR}/i18n/windtfmt.cpp"
"${ICU_SOURCE_DIR}/i18n/winnmfmt.cpp"
"${ICU_SOURCE_DIR}/i18n/wintzimpl.cpp"
"${ICU_SOURCE_DIR}/i18n/zonemeta.cpp"
"${ICU_SOURCE_DIR}/i18n/zrule.cpp"
"${ICU_SOURCE_DIR}/i18n/ztrans.cpp")
file(GENERATE OUTPUT "${CMAKE_CURRENT_BINARY_DIR}/empty.cpp" CONTENT " ")
enable_language(ASM)
@ -464,6 +481,11 @@ if (ARCH_S390X)
else()
set(ICUDATA_SOURCE_FILE "${ICUDATA_SOURCE_DIR}/icudt75l_dat.S" )
endif()
# ^^ you might be confused how for different little endian platforms (x86, ARM) the same assembly files can be used.
# These files are indeed assembly but they only contain data ('.long' directive), which makes them portable accross CPUs.
# Only the endianness and the character set (ASCII, EBCDIC) makes a difference, also see
# https://unicode-org.github.io/icu/userguide/icu_data/#sharing-icu-data-between-platforms, 'Sharing ICU Data Between Platforms')
# (and as an experiment, try re-generating the data files on x86 vs. ARM, ... you'll get exactly the same files)
set(ICUDATA_SOURCES
"${ICUDATA_SOURCE_FILE}"

2
contrib/libarchive vendored

@ -1 +1 @@
Subproject commit ee45796171324519f0c0bfd012018dd099296336
Subproject commit 313aa1fa10b657de791e3202c168a6c833bc3543

View File

@ -1,6 +1,6 @@
set (LIBRARY_DIR "${ClickHouse_SOURCE_DIR}/contrib/libarchive")
set(SRCS
set(SRCS
"${LIBRARY_DIR}/libarchive/archive_acl.c"
"${LIBRARY_DIR}/libarchive/archive_blake2sp_ref.c"
"${LIBRARY_DIR}/libarchive/archive_blake2s_ref.c"
@ -135,7 +135,7 @@ set(SRCS
)
add_library(_libarchive ${SRCS})
target_include_directories(_libarchive PUBLIC
target_include_directories(_libarchive PUBLIC
${CMAKE_CURRENT_SOURCE_DIR}
"${LIBRARY_DIR}/libarchive"
)
@ -157,7 +157,7 @@ if (TARGET ch_contrib::zlib)
endif()
if (TARGET ch_contrib::zstd)
target_compile_definitions(_libarchive PUBLIC HAVE_ZSTD_H=1 HAVE_LIBZSTD=1 HAVE_LIBZSTD_COMPRESSOR=1)
target_compile_definitions(_libarchive PUBLIC HAVE_ZSTD_H=1 HAVE_LIBZSTD=1 HAVE_ZSTD_compressStream=1)
target_link_libraries(_libarchive PRIVATE ch_contrib::zstd)
endif()
@ -179,4 +179,4 @@ if (OS_LINUX)
)
endif()
add_library(ch_contrib::libarchive ALIAS _libarchive)
add_library(ch_contrib::libarchive ALIAS _libarchive)

View File

@ -334,13 +334,16 @@ typedef uint64_t uintmax_t;
/* #undef ARCHIVE_XATTR_LINUX */
/* Version number of bsdcpio */
#define BSDCPIO_VERSION_STRING "3.7.0"
#define BSDCPIO_VERSION_STRING "3.7.4"
/* Version number of bsdtar */
#define BSDTAR_VERSION_STRING "3.7.0"
#define BSDTAR_VERSION_STRING "3.7.4"
/* Version number of bsdcat */
#define BSDCAT_VERSION_STRING "3.7.0"
#define BSDCAT_VERSION_STRING "3.7.4"
/* Version number of bsdunzip */
#define BSDUNZIP_VERSION_STRING "3.7.4"
/* Define to 1 if you have the `acl_create_entry' function. */
/* #undef HAVE_ACL_CREATE_ENTRY */
@ -642,8 +645,8 @@ typedef uint64_t uintmax_t;
/* Define to 1 if you have the `getgrnam_r' function. */
#define HAVE_GETGRNAM_R 1
/* Define to 1 if platform uses `optreset` to reset `getopt` */
#define HAVE_GETOPT_OPTRESET 1
/* Define to 1 if you have the `getline' function. */
#define HAVE_GETLINE 1
/* Define to 1 if you have the `getpid' function. */
#define HAVE_GETPID 1
@ -750,6 +753,12 @@ typedef uint64_t uintmax_t;
/* Define to 1 if you have the `pcreposix' library (-lpcreposix). */
/* #undef HAVE_LIBPCREPOSIX */
/* Define to 1 if you have the `pcre2-8' library (-lpcre2-8). */
/* #undef HAVE_LIBPCRE2 */
/* Define to 1 if you have the `pcreposix' library (-lpcre2posix). */
/* #undef HAVE_LIBPCRE2POSIX */
/* Define to 1 if you have the `xml2' library (-lxml2). */
#define HAVE_LIBXML2 1
@ -765,9 +774,8 @@ typedef uint64_t uintmax_t;
/* Define to 1 if you have the `zstd' library (-lzstd). */
/* #undef HAVE_LIBZSTD */
/* Define to 1 if you have the `zstd' library (-lzstd) with compression
support. */
/* #undef HAVE_LIBZSTD_COMPRESSOR */
/* Define to 1 if you have the ZSTD_compressStream function. */
/* #undef HAVE_ZSTD_compressStream */
/* Define to 1 if you have the <limits.h> header file. */
#define HAVE_LIMITS_H 1
@ -923,6 +931,9 @@ typedef uint64_t uintmax_t;
/* Define to 1 if you have the <pcreposix.h> header file. */
/* #undef HAVE_PCREPOSIX_H */
/* Define to 1 if you have the <pcre2posix.h> header file. */
/* #undef HAVE_PCRE2POSIX_H */
/* Define to 1 if you have the `pipe' function. */
#define HAVE_PIPE 1
@ -1029,6 +1040,12 @@ typedef uint64_t uintmax_t;
/* Define to 1 if you have the `strrchr' function. */
#define HAVE_STRRCHR 1
/* Define to 1 if the system has the type `struct statfs'. */
/* #undef HAVE_STRUCT_STATFS */
/* Define to 1 if `f_iosize' is a member of `struct statfs'. */
/* #undef HAVE_STRUCT_STATFS_F_IOSIZE */
/* Define to 1 if `f_namemax' is a member of `struct statfs'. */
/* #undef HAVE_STRUCT_STATFS_F_NAMEMAX */
@ -1077,6 +1094,9 @@ typedef uint64_t uintmax_t;
/* Define to 1 if you have the `symlink' function. */
#define HAVE_SYMLINK 1
/* Define to 1 if you have the `sysconf' function. */
#define HAVE_SYSCONF 1
/* Define to 1 if you have the <sys/acl.h> header file. */
/* #undef HAVE_SYS_ACL_H */
@ -1273,13 +1293,13 @@ typedef uint64_t uintmax_t;
/* #undef HAVE__MKGMTIME */
/* Define as const if the declaration of iconv() needs const. */
#define ICONV_CONST
#define ICONV_CONST
/* Version number of libarchive as a single integer */
#define LIBARCHIVE_VERSION_NUMBER "3007000"
#define LIBARCHIVE_VERSION_NUMBER "3007004"
/* Version number of libarchive */
#define LIBARCHIVE_VERSION_STRING "3.7.0"
#define LIBARCHIVE_VERSION_STRING "3.7.4"
/* Define to 1 if `lstat' dereferences a symlink specified with a trailing
slash. */
@ -1333,7 +1353,7 @@ typedef uint64_t uintmax_t;
#endif /* SAFE_TO_DEFINE_EXTENSIONS */
/* Version number of package */
#define VERSION "3.7.0"
#define VERSION "3.7.4"
/* Number of bits in a file offset, on hosts where this is settable. */
/* #undef _FILE_OFFSET_BITS */

2
contrib/libfiu vendored

@ -1 +1 @@
Subproject commit b85edbde4cf974b1b40d27828a56f0505f4e2ee5
Subproject commit a1290d8cd3d7b4541d6c976e0a54f572ac03f2a3

1
contrib/libpq vendored

@ -1 +0,0 @@
Subproject commit 2446f2c85650b56df9d4ebc4c2ea7f4b01beee57

View File

@ -1,78 +0,0 @@
if (NOT ENABLE_LIBPQXX)
return()
endif()
set(LIBPQ_SOURCE_DIR "${ClickHouse_SOURCE_DIR}/contrib/libpq")
set(SRCS
"${LIBPQ_SOURCE_DIR}/fe-auth.c"
"${LIBPQ_SOURCE_DIR}/fe-auth-scram.c"
"${LIBPQ_SOURCE_DIR}/fe-connect.c"
"${LIBPQ_SOURCE_DIR}/fe-exec.c"
"${LIBPQ_SOURCE_DIR}/fe-lobj.c"
"${LIBPQ_SOURCE_DIR}/fe-misc.c"
"${LIBPQ_SOURCE_DIR}/fe-print.c"
"${LIBPQ_SOURCE_DIR}/fe-trace.c"
"${LIBPQ_SOURCE_DIR}/fe-protocol3.c"
"${LIBPQ_SOURCE_DIR}/fe-secure.c"
"${LIBPQ_SOURCE_DIR}/fe-secure-common.c"
"${LIBPQ_SOURCE_DIR}/fe-secure-openssl.c"
"${LIBPQ_SOURCE_DIR}/legacy-pqsignal.c"
"${LIBPQ_SOURCE_DIR}/libpq-events.c"
"${LIBPQ_SOURCE_DIR}/pqexpbuffer.c"
"${LIBPQ_SOURCE_DIR}/common/scram-common.c"
"${LIBPQ_SOURCE_DIR}/common/sha2.c"
"${LIBPQ_SOURCE_DIR}/common/sha1.c"
"${LIBPQ_SOURCE_DIR}/common/md5.c"
"${LIBPQ_SOURCE_DIR}/common/md5_common.c"
"${LIBPQ_SOURCE_DIR}/common/hmac_openssl.c"
"${LIBPQ_SOURCE_DIR}/common/cryptohash.c"
"${LIBPQ_SOURCE_DIR}/common/saslprep.c"
"${LIBPQ_SOURCE_DIR}/common/unicode_norm.c"
"${LIBPQ_SOURCE_DIR}/common/ip.c"
"${LIBPQ_SOURCE_DIR}/common/jsonapi.c"
"${LIBPQ_SOURCE_DIR}/common/wchar.c"
"${LIBPQ_SOURCE_DIR}/common/base64.c"
"${LIBPQ_SOURCE_DIR}/common/link-canary.c"
"${LIBPQ_SOURCE_DIR}/common/fe_memutils.c"
"${LIBPQ_SOURCE_DIR}/common/string.c"
"${LIBPQ_SOURCE_DIR}/common/pg_get_line.c"
"${LIBPQ_SOURCE_DIR}/common/stringinfo.c"
"${LIBPQ_SOURCE_DIR}/common/psprintf.c"
"${LIBPQ_SOURCE_DIR}/common/encnames.c"
"${LIBPQ_SOURCE_DIR}/common/logging.c"
"${LIBPQ_SOURCE_DIR}/port/snprintf.c"
"${LIBPQ_SOURCE_DIR}/port/strlcpy.c"
"${LIBPQ_SOURCE_DIR}/port/strerror.c"
"${LIBPQ_SOURCE_DIR}/port/inet_net_ntop.c"
"${LIBPQ_SOURCE_DIR}/port/getpeereid.c"
"${LIBPQ_SOURCE_DIR}/port/chklocale.c"
"${LIBPQ_SOURCE_DIR}/port/noblock.c"
"${LIBPQ_SOURCE_DIR}/port/pg_strong_random.c"
"${LIBPQ_SOURCE_DIR}/port/pgstrcasecmp.c"
"${LIBPQ_SOURCE_DIR}/port/thread.c"
"${LIBPQ_SOURCE_DIR}/port/path.c"
)
add_library(_libpq ${SRCS})
add_definitions(-DHAVE_BIO_METH_NEW)
add_definitions(-DHAVE_HMAC_CTX_NEW)
add_definitions(-DHAVE_HMAC_CTX_FREE)
target_include_directories (_libpq SYSTEM PUBLIC ${LIBPQ_SOURCE_DIR})
target_include_directories (_libpq SYSTEM PUBLIC "${LIBPQ_SOURCE_DIR}/include")
target_include_directories (_libpq SYSTEM PRIVATE "${LIBPQ_SOURCE_DIR}/configs")
# NOTE: this is a dirty hack to avoid and instead pg_config.h should be shipped
# for different OS'es like for jemalloc, not one generic for all OS'es like
# now.
if (OS_DARWIN OR OS_FREEBSD OR USE_MUSL)
target_compile_definitions(_libpq PRIVATE -DSTRERROR_R_INT=1)
endif()
target_link_libraries (_libpq PRIVATE OpenSSL::SSL)
add_library(ch_contrib::libpq ALIAS _libpq)

2
contrib/libpqxx vendored

@ -1 +1 @@
Subproject commit c995193a3a14d71f4711f1f421f65a1a1db64640
Subproject commit 41e4c331564167cca97ad6eccbd5b8879c2ca044

View File

@ -1,16 +1,9 @@
option(ENABLE_LIBPQXX "Enalbe libpqxx" ${ENABLE_LIBRARIES})
if (NOT ENABLE_LIBPQXX)
message(STATUS "Not using libpqxx")
return()
endif()
set (LIBRARY_DIR "${ClickHouse_SOURCE_DIR}/contrib/libpqxx")
set (SRCS
"${LIBRARY_DIR}/src/strconv.cxx"
"${LIBRARY_DIR}/src/array.cxx"
"${LIBRARY_DIR}/src/binarystring.cxx"
"${LIBRARY_DIR}/src/blob.cxx"
"${LIBRARY_DIR}/src/connection.cxx"
"${LIBRARY_DIR}/src/cursor.cxx"
"${LIBRARY_DIR}/src/encodings.cxx"
@ -19,59 +12,25 @@ set (SRCS
"${LIBRARY_DIR}/src/field.cxx"
"${LIBRARY_DIR}/src/largeobject.cxx"
"${LIBRARY_DIR}/src/notification.cxx"
"${LIBRARY_DIR}/src/params.cxx"
"${LIBRARY_DIR}/src/pipeline.cxx"
"${LIBRARY_DIR}/src/result.cxx"
"${LIBRARY_DIR}/src/robusttransaction.cxx"
"${LIBRARY_DIR}/src/row.cxx"
"${LIBRARY_DIR}/src/sql_cursor.cxx"
"${LIBRARY_DIR}/src/strconv.cxx"
"${LIBRARY_DIR}/src/stream_from.cxx"
"${LIBRARY_DIR}/src/stream_to.cxx"
"${LIBRARY_DIR}/src/subtransaction.cxx"
"${LIBRARY_DIR}/src/time.cxx"
"${LIBRARY_DIR}/src/transaction.cxx"
"${LIBRARY_DIR}/src/transaction_base.cxx"
"${LIBRARY_DIR}/src/row.cxx"
"${LIBRARY_DIR}/src/params.cxx"
"${LIBRARY_DIR}/src/util.cxx"
"${LIBRARY_DIR}/src/version.cxx"
"${LIBRARY_DIR}/src/wait.cxx"
)
# Need to explicitly include each header file, because in the directory include/pqxx there are also files
# like just 'array'. So if including the whole directory with `target_include_directories`, it will make
# conflicts with all includes of <array>.
set (HDRS
"${LIBRARY_DIR}/include/pqxx/array.hxx"
"${LIBRARY_DIR}/include/pqxx/params.hxx"
"${LIBRARY_DIR}/include/pqxx/binarystring.hxx"
"${LIBRARY_DIR}/include/pqxx/composite.hxx"
"${LIBRARY_DIR}/include/pqxx/connection.hxx"
"${LIBRARY_DIR}/include/pqxx/cursor.hxx"
"${LIBRARY_DIR}/include/pqxx/dbtransaction.hxx"
"${LIBRARY_DIR}/include/pqxx/errorhandler.hxx"
"${LIBRARY_DIR}/include/pqxx/except.hxx"
"${LIBRARY_DIR}/include/pqxx/field.hxx"
"${LIBRARY_DIR}/include/pqxx/isolation.hxx"
"${LIBRARY_DIR}/include/pqxx/largeobject.hxx"
"${LIBRARY_DIR}/include/pqxx/nontransaction.hxx"
"${LIBRARY_DIR}/include/pqxx/notification.hxx"
"${LIBRARY_DIR}/include/pqxx/pipeline.hxx"
"${LIBRARY_DIR}/include/pqxx/prepared_statement.hxx"
"${LIBRARY_DIR}/include/pqxx/result.hxx"
"${LIBRARY_DIR}/include/pqxx/robusttransaction.hxx"
"${LIBRARY_DIR}/include/pqxx/row.hxx"
"${LIBRARY_DIR}/include/pqxx/separated_list.hxx"
"${LIBRARY_DIR}/include/pqxx/strconv.hxx"
"${LIBRARY_DIR}/include/pqxx/stream_from.hxx"
"${LIBRARY_DIR}/include/pqxx/stream_to.hxx"
"${LIBRARY_DIR}/include/pqxx/subtransaction.hxx"
"${LIBRARY_DIR}/include/pqxx/transaction.hxx"
"${LIBRARY_DIR}/include/pqxx/transaction_base.hxx"
"${LIBRARY_DIR}/include/pqxx/types.hxx"
"${LIBRARY_DIR}/include/pqxx/util.hxx"
"${LIBRARY_DIR}/include/pqxx/version.hxx"
"${LIBRARY_DIR}/include/pqxx/zview.hxx"
)
add_library(_libpqxx ${SRCS} ${HDRS})
add_library(_libpqxx ${SRCS})
target_link_libraries(_libpqxx PUBLIC ch_contrib::libpq)
target_include_directories (_libpqxx SYSTEM BEFORE PUBLIC "${LIBRARY_DIR}/include")

2
contrib/libuv vendored

@ -1 +1 @@
Subproject commit 4482964660c77eec1166cd7d14fb915e3dbd774a
Subproject commit 714b58b9849568211ade86b44dd91d37f8a2175e

View File

@ -10,6 +10,7 @@ set(uv_sources
src/random.c
src/strscpy.c
src/strtok.c
src/thread-common.c
src/threadpool.c
src/timer.c
src/uv-common.c
@ -70,10 +71,7 @@ if(CMAKE_SYSTEM_NAME STREQUAL "Linux")
list(APPEND uv_defines _GNU_SOURCE _POSIX_C_SOURCE=200112)
list(APPEND uv_libraries rt)
list(APPEND uv_sources
src/unix/epoll.c
src/unix/linux-core.c
src/unix/linux-inotify.c
src/unix/linux-syscalls.c
src/unix/linux.c
src/unix/procfs-exepath.c
src/unix/random-getrandom.c
src/unix/random-sysctl-linux.c)

View File

@ -140,6 +140,12 @@ if (CMAKE_CROSSCOMPILING)
message (STATUS "CROSS COMPILING SET LLVM HOST TRIPLE ${LLVM_HOST_TRIPLE}")
endif()
# llvm-project/llvm/cmake/config-ix.cmake does a weird thing: it defines _LARGEFILE64_SOURCE,
# then checks if lseek64() function exists, then undefines _LARGEFILE64_SOURCE.
# Then the actual code that uses this function *doesn't* define _LARGEFILE64_SOURCE, so lseek64()
# may not exist and compilation fails. This happens with musl.
add_compile_definitions("_LARGEFILE64_SOURCE")
add_subdirectory ("${LLVM_SOURCE_DIR}" "${LLVM_BINARY_DIR}")
set_directory_properties (PROPERTIES

2
contrib/openssl vendored

@ -1 +1 @@
Subproject commit 66deddc1e53cda8706604a019777259372d1bd62
Subproject commit b3e62c440f390e12e77c80675f883af82ad3d5ed

1
contrib/postgres vendored Submodule

@ -0,0 +1 @@
Subproject commit cfd77000af28469fcb650485bad65a35e7649e41

View File

@ -0,0 +1,78 @@
# Build description for libpq which is part of the PostgreSQL sources
set(POSTGRES_SOURCE_DIR "${ClickHouse_SOURCE_DIR}/contrib/postgres")
set(LIBPQ_SOURCE_DIR "${POSTGRES_SOURCE_DIR}/src/interfaces/libpq")
set(LIBPQ_CMAKE_SOURCE_DIR "${ClickHouse_SOURCE_DIR}/contrib/postgres-cmake")
set(SRCS
"${LIBPQ_SOURCE_DIR}/fe-auth.c"
"${LIBPQ_SOURCE_DIR}/fe-auth-scram.c"
"${LIBPQ_SOURCE_DIR}/fe-connect.c"
"${LIBPQ_SOURCE_DIR}/fe-exec.c"
"${LIBPQ_SOURCE_DIR}/fe-lobj.c"
"${LIBPQ_SOURCE_DIR}/fe-misc.c"
"${LIBPQ_SOURCE_DIR}/fe-print.c"
"${LIBPQ_SOURCE_DIR}/fe-trace.c"
"${LIBPQ_SOURCE_DIR}/fe-protocol3.c"
"${LIBPQ_SOURCE_DIR}/fe-secure.c"
"${LIBPQ_SOURCE_DIR}/fe-secure-common.c"
"${LIBPQ_SOURCE_DIR}/fe-secure-openssl.c"
"${LIBPQ_SOURCE_DIR}/legacy-pqsignal.c"
"${LIBPQ_SOURCE_DIR}/libpq-events.c"
"${LIBPQ_SOURCE_DIR}/pqexpbuffer.c"
"${POSTGRES_SOURCE_DIR}/src/common/scram-common.c"
"${POSTGRES_SOURCE_DIR}/src/common/sha2.c"
"${POSTGRES_SOURCE_DIR}/src/common/sha1.c"
"${POSTGRES_SOURCE_DIR}/src/common/md5.c"
"${POSTGRES_SOURCE_DIR}/src/common/md5_common.c"
"${POSTGRES_SOURCE_DIR}/src/common/hmac_openssl.c"
"${POSTGRES_SOURCE_DIR}/src/common/cryptohash.c"
"${POSTGRES_SOURCE_DIR}/src/common/saslprep.c"
"${POSTGRES_SOURCE_DIR}/src/common/unicode_norm.c"
"${POSTGRES_SOURCE_DIR}/src/common/ip.c"
"${POSTGRES_SOURCE_DIR}/src/common/jsonapi.c"
"${POSTGRES_SOURCE_DIR}/src/common/wchar.c"
"${POSTGRES_SOURCE_DIR}/src/common/base64.c"
"${POSTGRES_SOURCE_DIR}/src/common/link-canary.c"
"${POSTGRES_SOURCE_DIR}/src/common/fe_memutils.c"
"${POSTGRES_SOURCE_DIR}/src/common/string.c"
"${POSTGRES_SOURCE_DIR}/src/common/pg_get_line.c"
"${POSTGRES_SOURCE_DIR}/src/common/stringinfo.c"
"${POSTGRES_SOURCE_DIR}/src/common/psprintf.c"
"${POSTGRES_SOURCE_DIR}/src/common/encnames.c"
"${POSTGRES_SOURCE_DIR}/src/common/logging.c"
"${POSTGRES_SOURCE_DIR}/src/port/snprintf.c"
"${POSTGRES_SOURCE_DIR}/src/port/strlcpy.c"
"${POSTGRES_SOURCE_DIR}/src/port/strerror.c"
"${POSTGRES_SOURCE_DIR}/src/port/inet_net_ntop.c"
"${POSTGRES_SOURCE_DIR}/src/port/getpeereid.c"
"${POSTGRES_SOURCE_DIR}/src/port/chklocale.c"
"${POSTGRES_SOURCE_DIR}/src/port/noblock.c"
"${POSTGRES_SOURCE_DIR}/src/port/pg_strong_random.c"
"${POSTGRES_SOURCE_DIR}/src/port/pgstrcasecmp.c"
"${POSTGRES_SOURCE_DIR}/src/port/thread.c"
"${POSTGRES_SOURCE_DIR}/src/port/path.c"
)
add_library(_libpq ${SRCS})
add_definitions(-DHAVE_BIO_METH_NEW)
add_definitions(-DHAVE_HMAC_CTX_NEW)
add_definitions(-DHAVE_HMAC_CTX_FREE)
target_include_directories (_libpq SYSTEM PUBLIC ${LIBPQ_SOURCE_DIR})
target_include_directories (_libpq SYSTEM PUBLIC "${POSTGRES_SOURCE_DIR}/src/include")
target_include_directories (_libpq SYSTEM PUBLIC "${LIBPQ_CMAKE_SOURCE_DIR}") # pre-generated headers
# NOTE: this is a dirty hack to avoid and instead pg_config.h should be shipped
# for different OS'es like for jemalloc, not one generic for all OS'es like
# now.
if (OS_DARWIN OR OS_FREEBSD OR USE_MUSL)
target_compile_definitions(_libpq PRIVATE -DSTRERROR_R_INT=1)
endif()
target_link_libraries (_libpq PRIVATE OpenSSL::SSL)
add_library(ch_contrib::libpq ALIAS _libpq)

View File

@ -0,0 +1,943 @@
/* src/include/pg_config.h. Generated from pg_config.h.in by configure. */
/* src/include/pg_config.h.in. Generated from configure.in by autoheader. */
/* Define if building universal (internal helper macro) */
/* #undef AC_APPLE_UNIVERSAL_BUILD */
/* The normal alignment of `double', in bytes. */
#define ALIGNOF_DOUBLE 4
/* The normal alignment of `int', in bytes. */
#define ALIGNOF_INT 4
/* The normal alignment of `long', in bytes. */
#define ALIGNOF_LONG 4
/* The normal alignment of `long long int', in bytes. */
#define ALIGNOF_LONG_LONG_INT 4
/* The normal alignment of `short', in bytes. */
#define ALIGNOF_SHORT 2
/* Size of a disk block --- this also limits the size of a tuple. You can set
it bigger if you need bigger tuples (although TOAST should reduce the need
to have large tuples, since fields can be spread across multiple tuples).
BLCKSZ must be a power of 2. The maximum possible value of BLCKSZ is
currently 2^15 (32768). This is determined by the 15-bit widths of the
lp_off and lp_len fields in ItemIdData (see include/storage/itemid.h).
Changing BLCKSZ requires an initdb. */
#define BLCKSZ 8192
/* Define to the default TCP port number on which the server listens and to
which clients will try to connect. This can be overridden at run-time, but
it's convenient if your clients have the right default compiled in.
(--with-pgport=PORTNUM) */
#define DEF_PGPORT 5432
/* Define to the default TCP port number as a string constant. */
#define DEF_PGPORT_STR "5432"
/* Define to the file name extension of dynamically-loadable modules. */
#define DLSUFFIX ".so"
/* Define to build with GSSAPI support. (--with-gssapi) */
//#define ENABLE_GSS 0
/* Define to 1 if you want National Language Support. (--enable-nls) */
/* #undef ENABLE_NLS */
/* Define to 1 to build client libraries as thread-safe code.
(--enable-thread-safety) */
#define ENABLE_THREAD_SAFETY 1
/* Define to nothing if C supports flexible array members, and to 1 if it does
not. That way, with a declaration like `struct s { int n; double
d[FLEXIBLE_ARRAY_MEMBER]; };', the struct hack can be used with pre-C99
compilers. When computing the size of such an object, don't use 'sizeof
(struct s)' as it overestimates the size. Use 'offsetof (struct s, d)'
instead. Don't use 'offsetof (struct s, d[0])', as this doesn't work with
MSVC and with C++ compilers. */
#define FLEXIBLE_ARRAY_MEMBER /**/
/* float4 values are passed by value if 'true', by reference if 'false' */
#define FLOAT4PASSBYVAL true
/* float8, int8, and related values are passed by value if 'true', by
reference if 'false' */
#define FLOAT8PASSBYVAL false
/* Define to 1 if gettimeofday() takes only 1 argument. */
/* #undef GETTIMEOFDAY_1ARG */
#ifdef GETTIMEOFDAY_1ARG
# define gettimeofday(a,b) gettimeofday(a)
#endif
/* Define to 1 if you have the `append_history' function. */
/* #undef HAVE_APPEND_HISTORY */
/* Define to 1 if you want to use atomics if available. */
#define HAVE_ATOMICS 1
/* Define to 1 if you have the <atomic.h> header file. */
/* #undef HAVE_ATOMIC_H */
/* Define to 1 if you have the `cbrt' function. */
#define HAVE_CBRT 1
/* Define to 1 if you have the `class' function. */
/* #undef HAVE_CLASS */
/* Define to 1 if you have the <crtdefs.h> header file. */
/* #undef HAVE_CRTDEFS_H */
/* Define to 1 if you have the `crypt' function. */
#define HAVE_CRYPT 1
/* Define to 1 if you have the <crypt.h> header file. */
#define HAVE_CRYPT_H 1
/* Define to 1 if you have the declaration of `fdatasync', and to 0 if you
don't. */
#define HAVE_DECL_FDATASYNC 1
/* Define to 1 if you have the declaration of `F_FULLFSYNC', and to 0 if you
don't. */
#define HAVE_DECL_F_FULLFSYNC 0
/* Define to 1 if you have the declaration of `posix_fadvise', and to 0 if you
don't. */
#define HAVE_DECL_POSIX_FADVISE 1
/* Define to 1 if you have the declaration of `snprintf', and to 0 if you
don't. */
#define HAVE_DECL_SNPRINTF 1
/* Define to 1 if you have the declaration of `sigwait', and to 0 if you don't. */
#define HAVE_DECL_SIGWAIT 1
/* Define to 1 if you have the declaration of `strlcat', and to 0 if you
don't. */
#if OS_DARWIN
#define HAVE_DECL_STRLCAT 1
#endif
/* Define to 1 if you have the declaration of `strlcpy', and to 0 if you
don't. */
#if OS_DARWIN
#define HAVE_DECL_STRLCPY 1
#endif
/* Define to 1 if you have the declaration of `sys_siglist', and to 0 if you
don't. */
#define HAVE_DECL_SYS_SIGLIST 1
/* Define to 1 if you have the declaration of `vsnprintf', and to 0 if you
don't. */
#define HAVE_DECL_VSNPRINTF 1
/* Define to 1 if you have the <dld.h> header file. */
/* #undef HAVE_DLD_H */
/* Define to 1 if you have the `dlopen' function. */
#define HAVE_DLOPEN 1
/* Define to 1 if you have the <editline/history.h> header file. */
/* #undef HAVE_EDITLINE_HISTORY_H */
/* Define to 1 if you have the <editline/readline.h> header file. */
#define HAVE_EDITLINE_READLINE_H 1
/* Define to 1 if you have the `fdatasync' function. */
#define HAVE_FDATASYNC 1
/* Define to 1 if you have the `fls' function. */
/* #undef HAVE_FLS */
/* Define to 1 if you have the `fpclass' function. */
/* #undef HAVE_FPCLASS */
/* Define to 1 if you have the `fp_class' function. */
/* #undef HAVE_FP_CLASS */
/* Define to 1 if you have the `fp_class_d' function. */
/* #undef HAVE_FP_CLASS_D */
/* Define to 1 if you have the <fp_class.h> header file. */
/* #undef HAVE_FP_CLASS_H */
/* Define to 1 if fseeko (and presumably ftello) exists and is declared. */
#define HAVE_FSEEKO 1
/* Define to 1 if your compiler understands __func__. */
#define HAVE_FUNCNAME__FUNC 1
/* Define to 1 if your compiler understands __FUNCTION__. */
/* #undef HAVE_FUNCNAME__FUNCTION */
/* Define to 1 if you have __atomic_compare_exchange_n(int *, int *, int). */
/* #undef HAVE_GCC__ATOMIC_INT32_CAS */
/* Define to 1 if you have __atomic_compare_exchange_n(int64 *, int *, int64).
*/
/* #undef HAVE_GCC__ATOMIC_INT64_CAS */
/* Define to 1 if you have __sync_lock_test_and_set(char *) and friends. */
#define HAVE_GCC__SYNC_CHAR_TAS 1
/* Define to 1 if you have __sync_compare_and_swap(int *, int, int). */
/* #undef HAVE_GCC__SYNC_INT32_CAS */
/* Define to 1 if you have __sync_lock_test_and_set(int *) and friends. */
#define HAVE_GCC__SYNC_INT32_TAS 1
/* Define to 1 if you have __sync_compare_and_swap(int64 *, int64, int64). */
/* #undef HAVE_GCC__SYNC_INT64_CAS */
/* Define to 1 if you have the `getaddrinfo' function. */
#define HAVE_GETADDRINFO 1
/* Define to 1 if you have the `gethostbyname_r' function. */
#define HAVE_GETHOSTBYNAME_R 1
/* Define to 1 if you have the `getifaddrs' function. */
#define HAVE_GETIFADDRS 1
/* Define to 1 if you have the `getopt' function. */
#define HAVE_GETOPT 1
/* Define to 1 if you have the <getopt.h> header file. */
#define HAVE_GETOPT_H 1
/* Define to 1 if you have the `getopt_long' function. */
#define HAVE_GETOPT_LONG 1
/* Define to 1 if you have the `getpeereid' function. */
/* #undef HAVE_GETPEEREID */
/* Define to 1 if you have the `getpeerucred' function. */
/* #undef HAVE_GETPEERUCRED */
/* Define to 1 if you have the `getpwuid_r' function. */
#define HAVE_GETPWUID_R 1
/* Define to 1 if you have the `getrlimit' function. */
#define HAVE_GETRLIMIT 1
/* Define to 1 if you have the `getrusage' function. */
#define HAVE_GETRUSAGE 1
/* Define to 1 if you have the `gettimeofday' function. */
/* #undef HAVE_GETTIMEOFDAY */
/* Define to 1 if you have the <gssapi/gssapi.h> header file. */
//#define HAVE_GSSAPI_GSSAPI_H 0
/* Define to 1 if you have the <gssapi.h> header file. */
/* #undef HAVE_GSSAPI_H */
/* Define to 1 if you have the <history.h> header file. */
/* #undef HAVE_HISTORY_H */
/* Define to 1 if you have the `history_truncate_file' function. */
#define HAVE_HISTORY_TRUNCATE_FILE 1
/* Define to 1 if you have the <ieeefp.h> header file. */
/* #undef HAVE_IEEEFP_H */
/* Define to 1 if you have the <ifaddrs.h> header file. */
#define HAVE_IFADDRS_H 1
/* Define to 1 if you have the `inet_aton' function. */
#define HAVE_INET_ATON 1
/* Define to 1 if you have the `inet_pton' function. */
#define HAVE_INET_PTON 1
/* Define to 1 if the system has the type `int64'. */
/* #undef HAVE_INT64 */
/* Define to 1 if the system has the type `int8'. */
/* #undef HAVE_INT8 */
/* Define to 1 if the system has the type `intptr_t'. */
#define HAVE_INTPTR_T 1
/* Define to 1 if you have the <inttypes.h> header file. */
#define HAVE_INTTYPES_H 1
/* Define to 1 if you have the global variable 'int opterr'. */
#define HAVE_INT_OPTERR 1
/* Define to 1 if you have the global variable 'int optreset'. */
/* #undef HAVE_INT_OPTRESET */
/* Define to 1 if you have the global variable 'int timezone'. */
#define HAVE_INT_TIMEZONE 1
/* Define to 1 if you have support for IPv6. */
#define HAVE_IPV6 1
/* Define to 1 if you have isinf(). */
#define HAVE_ISINF 1
/* Define to 1 if you have the <langinfo.h> header file. */
#define HAVE_LANGINFO_H 1
/* Define to 1 if you have the <ldap.h> header file. */
//#define HAVE_LDAP_H 0
/* Define to 1 if you have the `crypto' library (-lcrypto). */
#define HAVE_LIBCRYPTO 1
/* Define to 1 if you have the `ldap' library (-lldap). */
//#define HAVE_LIBLDAP 0
/* Define to 1 if you have the `m' library (-lm). */
#define HAVE_LIBM 1
/* Define to 1 if you have the `pam' library (-lpam). */
#define HAVE_LIBPAM 1
/* Define if you have a function readline library */
#define HAVE_LIBREADLINE 1
/* Define to 1 if you have the `selinux' library (-lselinux). */
/* #undef HAVE_LIBSELINUX */
/* Define to 1 if you have the `ssl' library (-lssl). */
#define HAVE_LIBSSL 0
/* Define to 1 if you have the `wldap32' library (-lwldap32). */
/* #undef HAVE_LIBWLDAP32 */
/* Define to 1 if you have the `xml2' library (-lxml2). */
#define HAVE_LIBXML2 1
/* Define to 1 if you have the `xslt' library (-lxslt). */
#define HAVE_LIBXSLT 1
/* Define to 1 if you have the `z' library (-lz). */
#define HAVE_LIBZ 1
/* Define to 1 if you have the `zstd' library (-lzstd). */
/* #undef HAVE_LIBZSTD */
/* Define to 1 if constants of type 'long long int' should have the suffix LL.
*/
#define HAVE_LL_CONSTANTS 1
/* Define to 1 if the system has the type `locale_t'. */
#define HAVE_LOCALE_T 1
/* Define to 1 if `long int' works and is 64 bits. */
/* #undef HAVE_LONG_INT_64 */
/* Define to 1 if the system has the type `long long int'. */
#define HAVE_LONG_LONG_INT 1
/* Define to 1 if `long long int' works and is 64 bits. */
#define HAVE_LONG_LONG_INT_64 1
/* Define to 1 if you have the <mbarrier.h> header file. */
/* #undef HAVE_MBARRIER_H */
/* Define to 1 if you have the `mbstowcs_l' function. */
/* #undef HAVE_MBSTOWCS_L */
/* Define to 1 if you have the `memmove' function. */
#define HAVE_MEMMOVE 1
/* Define to 1 if you have the <memory.h> header file. */
#define HAVE_MEMORY_H 1
/* Define to 1 if the system has the type `MINIDUMP_TYPE'. */
/* #undef HAVE_MINIDUMP_TYPE */
/* Define to 1 if you have the `mkdtemp' function. */
#define HAVE_MKDTEMP 1
/* Define to 1 if you have the <netinet/in.h> header file. */
#define HAVE_NETINET_IN_H 1
/* Define to 1 if you have the <netinet/tcp.h> header file. */
#define HAVE_NETINET_TCP_H 1
/* Define to 1 if you have the <net/if.h> header file. */
#define HAVE_NET_IF_H 1
/* Define to 1 if you have the <ossp/uuid.h> header file. */
/* #undef HAVE_OSSP_UUID_H */
/* Define to 1 if you have the <pam/pam_appl.h> header file. */
/* #undef HAVE_PAM_PAM_APPL_H */
/* Define to 1 if you have the `poll' function. */
#define HAVE_POLL 1
/* Define to 1 if you have the <poll.h> header file. */
#define HAVE_POLL_H 1
/* Define to 1 if you have a POSIX-conforming sigwait declaration. */
/* #undef HAVE_POSIX_DECL_SIGWAIT */
/* Define to 1 if you have the `posix_fadvise' function. */
#define HAVE_POSIX_FADVISE 1
/* Define to 1 if you have the declaration of `preadv', and to 0 if you don't. */
/* #undef HAVE_DECL_PREADV */
/* Define to 1 if you have the declaration of `pwritev', and to 0 if you don't. */
/* #define HAVE_DECL_PWRITEV */
/* Define to 1 if you have the `X509_get_signature_info' function. */
/* #undef HAVE_X509_GET_SIGNATURE_INFO */
/* Define to 1 if you have the POSIX signal interface. */
#define HAVE_POSIX_SIGNALS 1
/* Define to 1 if the assembler supports PPC's LWARX mutex hint bit. */
/* #undef HAVE_PPC_LWARX_MUTEX_HINT */
/* Define to 1 if you have the `pstat' function. */
/* #undef HAVE_PSTAT */
/* Define to 1 if the PS_STRINGS thing exists. */
/* #undef HAVE_PS_STRINGS */
/* Define to 1 if you have the `pthread_is_threaded_np' function. */
/* #undef HAVE_PTHREAD_IS_THREADED_NP */
/* Define to 1 if you have the <pwd.h> header file. */
#define HAVE_PWD_H 1
/* Define to 1 if you have the <readline.h> header file. */
/* #undef HAVE_READLINE_H */
/* Define to 1 if you have the <readline/history.h> header file. */
#define HAVE_READLINE_HISTORY_H 1
/* Define to 1 if you have the <readline/readline.h> header file. */
/* #undef HAVE_READLINE_READLINE_H */
/* Define to 1 if you have the `readlink' function. */
#define HAVE_READLINK 1
/* Define to 1 if you have the `rint' function. */
#define HAVE_RINT 1
/* Define to 1 if you have the `rl_completion_matches' function. */
#define HAVE_RL_COMPLETION_MATCHES 1
/* Define to 1 if you have the `rl_filename_completion_function' function. */
#define HAVE_RL_FILENAME_COMPLETION_FUNCTION 1
/* Define to 1 if you have the `rl_reset_screen_size' function. */
/* #undef HAVE_RL_RESET_SCREEN_SIZE */
/* Define to 1 if you have the `rl_variable_bind' function. */
#define HAVE_RL_VARIABLE_BIND 1
/* Define to 1 if you have the <security/pam_appl.h> header file. */
#define HAVE_SECURITY_PAM_APPL_H 1
/* Define to 1 if you have the `setproctitle' function. */
/* #undef HAVE_SETPROCTITLE */
/* Define to 1 if you have the `setsid' function. */
#define HAVE_SETSID 1
/* Define to 1 if you have the `shm_open' function. */
#define HAVE_SHM_OPEN 1
/* Define to 1 if the system has the type `socklen_t'. */
#define HAVE_SOCKLEN_T 1
/* Define to 1 if you have the `sigprocmask' function. */
#define HAVE_SIGPROCMASK 1
/* Define to 1 if you have sigsetjmp(). */
#define HAVE_SIGSETJMP 1
/* Define to 1 if the system has the type `sig_atomic_t'. */
#define HAVE_SIG_ATOMIC_T 1
/* Define to 1 if you have the `snprintf' function. */
#define HAVE_SNPRINTF 1
/* Define to 1 if you have spinlocks. */
#define HAVE_SPINLOCKS 1
/* Define to 1 if you have the `SSL_CTX_set_num_tickets' function. */
/* #define HAVE_SSL_CTX_SET_NUM_TICKETS */
/* Define to 1 if you have the `SSL_get_current_compression' function. */
#define HAVE_SSL_GET_CURRENT_COMPRESSION 0
/* Define to 1 if you have the <stdint.h> header file. */
#define HAVE_STDINT_H 1
/* Define to 1 if you have the <stdlib.h> header file. */
#define HAVE_STDLIB_H 1
/* Define to 1 if you have the `strerror' function. */
#define HAVE_STRERROR 1
/* Define to 1 if you have the `strerror_r' function. */
#define HAVE_STRERROR_R 1
/* Define to 1 if you have the <strings.h> header file. */
//#define HAVE_STRINGS_H 1
/* Define to 1 if you have the <string.h> header file. */
#define HAVE_STRING_H 1
/* Define to 1 if you have the `strlcat' function. */
/* #undef HAVE_STRLCAT */
/* Define to 1 if you have the `strlcpy' function. */
/* #undef HAVE_STRLCPY */
/* Define to 1 if you have the `strtoll' function. */
#define HAVE_STRTOLL 1
#if (!OS_DARWIN)
#define HAVE_STRCHRNUL 1
#endif
/* Define to 1 if you have the `strtoq' function. */
/* #undef HAVE_STRTOQ */
/* Define to 1 if you have the `strtoull' function. */
#define HAVE_STRTOULL 1
/* Define to 1 if you have the `strtouq' function. */
/* #undef HAVE_STRTOUQ */
/* Define to 1 if the system has the type `struct addrinfo'. */
#define HAVE_STRUCT_ADDRINFO 1
/* Define to 1 if the system has the type `struct cmsgcred'. */
/* #undef HAVE_STRUCT_CMSGCRED */
/* Define to 1 if the system has the type `struct option'. */
#define HAVE_STRUCT_OPTION 1
/* Define to 1 if `sa_len' is a member of `struct sockaddr'. */
/* #undef HAVE_STRUCT_SOCKADDR_SA_LEN */
/* Define to 1 if the system has the type `struct sockaddr_storage'. */
#define HAVE_STRUCT_SOCKADDR_STORAGE 1
/* Define to 1 if `ss_family' is a member of `struct sockaddr_storage'. */
#define HAVE_STRUCT_SOCKADDR_STORAGE_SS_FAMILY 1
/* Define to 1 if `ss_len' is a member of `struct sockaddr_storage'. */
/* #undef HAVE_STRUCT_SOCKADDR_STORAGE_SS_LEN */
/* Define to 1 if `__ss_family' is a member of `struct sockaddr_storage'. */
/* #undef HAVE_STRUCT_SOCKADDR_STORAGE___SS_FAMILY */
/* Define to 1 if `__ss_len' is a member of `struct sockaddr_storage'. */
/* #undef HAVE_STRUCT_SOCKADDR_STORAGE___SS_LEN */
/* Define to 1 if `tm_zone' is a member of `struct tm'. */
#define HAVE_STRUCT_TM_TM_ZONE 1
/* Define to 1 if you have the `symlink' function. */
#define HAVE_SYMLINK 1
/* Define to 1 if you have the `sync_file_range' function. */
/* #undef HAVE_SYNC_FILE_RANGE */
/* Define to 1 if you have the syslog interface. */
#define HAVE_SYSLOG 1
/* Define to 1 if you have the <sys/ioctl.h> header file. */
#define HAVE_SYS_IOCTL_H 1
/* Define to 1 if you have the <sys/ipc.h> header file. */
#define HAVE_SYS_IPC_H 1
/* Define to 1 if you have the <sys/personality.h> header file. */
/* #undef HAVE_SYS_PERSONALITY_H */
/* Define to 1 if you have the <sys/poll.h> header file. */
#define HAVE_SYS_POLL_H 1
/* Define to 1 if you have the <sys/pstat.h> header file. */
/* #undef HAVE_SYS_PSTAT_H */
/* Define to 1 if you have the <sys/resource.h> header file. */
#define HAVE_SYS_RESOURCE_H 1
/* Define to 1 if you have the <sys/select.h> header file. */
#define HAVE_SYS_SELECT_H 1
/* Define to 1 if you have the <sys/sem.h> header file. */
#define HAVE_SYS_SEM_H 1
/* Define to 1 if you have the <sys/shm.h> header file. */
#define HAVE_SYS_SHM_H 1
/* Define to 1 if you have the <sys/signalfd.h> header file. */
/* #undef HAVE_SYS_SIGNALFD_H */
/* Define to 1 if you have the <sys/socket.h> header file. */
#define HAVE_SYS_SOCKET_H 1
/* Define to 1 if you have the <sys/sockio.h> header file. */
/* #undef HAVE_SYS_SOCKIO_H */
/* Define to 1 if you have the <sys/stat.h> header file. */
#define HAVE_SYS_STAT_H 1
/* Define to 1 if you have the <sys/tas.h> header file. */
/* #undef HAVE_SYS_TAS_H */
/* Define to 1 if you have the <sys/time.h> header file. */
#define HAVE_SYS_TIME_H 1
/* Define to 1 if you have the <sys/types.h> header file. */
#define HAVE_SYS_TYPES_H 1
/* Define to 1 if you have the <sys/ucred.h> header file. */
#if (OS_DARWIN || OS_FREEBSD)
#define HAVE_SYS_UCRED_H 1
#endif
/* Define to 1 if you have the <sys/un.h> header file. */
#define HAVE_SYS_UN_H 1
#define _GNU_SOURCE 1 /* Needed for glibc struct ucred */
/* Define to 1 if you have the <termios.h> header file. */
#define HAVE_TERMIOS_H 1
/* Define to 1 if your `struct tm' has `tm_zone'. Deprecated, use
`HAVE_STRUCT_TM_TM_ZONE' instead. */
#define HAVE_TM_ZONE 1
/* Define to 1 if you have the `towlower' function. */
#define HAVE_TOWLOWER 1
/* Define to 1 if you have the external array `tzname'. */
#define HAVE_TZNAME 1
/* Define to 1 if you have the <ucred.h> header file. */
/* #undef HAVE_UCRED_H */
/* Define to 1 if the system has the type `uint64'. */
/* #undef HAVE_UINT64 */
/* Define to 1 if the system has the type `uint8'. */
/* #undef HAVE_UINT8 */
/* Define to 1 if the system has the type `uintptr_t'. */
#define HAVE_UINTPTR_T 1
/* Define to 1 if the system has the type `union semun'. */
/* #undef HAVE_UNION_SEMUN */
/* Define to 1 if you have the <unistd.h> header file. */
#define HAVE_UNISTD_H 1
/* Define to 1 if you have unix sockets. */
#define HAVE_UNIX_SOCKETS 1
/* Define to 1 if you have the `unsetenv' function. */
#define HAVE_UNSETENV 1
/* Define to 1 if the system has the type `unsigned long long int'. */
#define HAVE_UNSIGNED_LONG_LONG_INT 1
/* Define to 1 if you have the `utime' function. */
#define HAVE_UTIME 1
/* Define to 1 if you have the `utimes' function. */
#define HAVE_UTIMES 1
/* Define to 1 if you have the <utime.h> header file. */
#define HAVE_UTIME_H 1
/* Define to 1 if you have BSD UUID support. */
/* #undef HAVE_UUID_BSD */
/* Define to 1 if you have E2FS UUID support. */
/* #undef HAVE_UUID_E2FS */
/* Define to 1 if you have the <uuid.h> header file. */
#define HAVE_UUID_H 1
/* Define to 1 if you have OSSP UUID support. */
#define HAVE_UUID_OSSP 1
/* Define to 1 if you have the <uuid/uuid.h> header file. */
/* #undef HAVE_UUID_UUID_H */
/* Define to 1 if you have the `vsnprintf' function. */
#define HAVE_VSNPRINTF 1
/* Define to 1 if you have the <wchar.h> header file. */
#define HAVE_WCHAR_H 1
/* Define to 1 if you have the `wcstombs' function. */
#define HAVE_WCSTOMBS 1
/* Define to 1 if you have the `wcstombs_l' function. */
/* #undef HAVE_WCSTOMBS_L */
/* Define to 1 if you have the <wctype.h> header file. */
#define HAVE_WCTYPE_H 1
/* Define to 1 if you have the <winldap.h> header file. */
/* #undef HAVE_WINLDAP_H */
/* Define to 1 if your compiler understands __builtin_bswap32. */
/* #undef HAVE__BUILTIN_BSWAP32 */
/* Define to 1 if your compiler understands __builtin_constant_p. */
#define HAVE__BUILTIN_CONSTANT_P 1
/* Define to 1 if your compiler understands __builtin_frame_address. */
/* #undef HAVE__BUILTIN_FRAME_ADDRESS */
/* Define to 1 if your compiler understands __builtin_types_compatible_p. */
#define HAVE__BUILTIN_TYPES_COMPATIBLE_P 1
/* Define to 1 if your compiler understands __builtin_unreachable. */
/* #undef HAVE__BUILTIN_UNREACHABLE */
/* Define to 1 if you have __cpuid. */
/* #undef HAVE__CPUID */
/* Define to 1 if you have __get_cpuid. */
/* #undef HAVE__GET_CPUID */
/* Define to 1 if your compiler understands _Static_assert. */
/* #undef HAVE__STATIC_ASSERT */
/* Define to 1 if your compiler understands __VA_ARGS__ in macros. */
#define HAVE__VA_ARGS 1
/* Define to the appropriate snprintf length modifier for 64-bit ints. */
#define INT64_MODIFIER "ll"
/* Define to 1 if `locale_t' requires <xlocale.h>. */
/* #undef LOCALE_T_IN_XLOCALE */
/* Define as the maximum alignment requirement of any C data type. */
#define MAXIMUM_ALIGNOF 4
/* Define bytes to use libc memset(). */
#define MEMSET_LOOP_LIMIT 1024
/* Define to the address where bug reports for this package should be sent. */
#define PACKAGE_BUGREPORT "pgsql-bugs@postgresql.org"
/* Define to the full name of this package. */
#define PACKAGE_NAME "PostgreSQL"
/* Define to the full name and version of this package. */
#define PACKAGE_STRING "PostgreSQL 9.5.4"
/* Define to the one symbol short name of this package. */
#define PACKAGE_TARNAME "postgresql"
/* Define to the home page for this package. */
#define PACKAGE_URL ""
/* Define to the version of this package. */
#define PACKAGE_VERSION "9.5.4"
/* Define to the name of a signed 128-bit integer type. */
/* #undef PG_INT128_TYPE */
/* Define to the name of a signed 64-bit integer type. */
#define PG_INT64_TYPE long long int
/* Define to the name of the default PostgreSQL service principal in Kerberos
(GSSAPI). (--with-krb-srvnam=NAME) */
#define PG_KRB_SRVNAM "postgres"
/* PostgreSQL major version as a string */
#define PG_MAJORVERSION "9.5"
/* Define to gnu_printf if compiler supports it, else printf. */
#define PG_PRINTF_ATTRIBUTE printf
/* Define to 1 if "static inline" works without unwanted warnings from
compilations where static inline functions are defined but not called. */
#define PG_USE_INLINE 1
/* PostgreSQL version as a string */
#define PG_VERSION "9.5.4"
/* PostgreSQL version as a number */
#define PG_VERSION_NUM 90504
/* A string containing the version number, platform, and C compiler */
#define PG_VERSION_STR "PostgreSQL 9.5.4 on i686-pc-linux-gnu, compiled by gcc (GCC) 4.1.2 20080704 (Red Hat 4.1.2-55), 32-bit"
/* Define to 1 to allow profiling output to be saved separately for each
process. */
/* #undef PROFILE_PID_DIR */
/* RELSEG_SIZE is the maximum number of blocks allowed in one disk file. Thus,
the maximum size of a single file is RELSEG_SIZE * BLCKSZ; relations bigger
than that are divided into multiple files. RELSEG_SIZE * BLCKSZ must be
less than your OS' limit on file size. This is often 2 GB or 4GB in a
32-bit operating system, unless you have large file support enabled. By
default, we make the limit 1 GB to avoid any possible integer-overflow
problems within the OS. A limit smaller than necessary only means we divide
a large relation into more chunks than necessary, so it seems best to err
in the direction of a small limit. A power-of-2 value is recommended to
save a few cycles in md.c, but is not absolutely required. Changing
RELSEG_SIZE requires an initdb. */
#define RELSEG_SIZE 131072
/* The size of `long', as computed by sizeof. */
#define SIZEOF_LONG 4
/* The size of `off_t', as computed by sizeof. */
#define SIZEOF_OFF_T 8
/* The size of `size_t', as computed by sizeof. */
#define SIZEOF_SIZE_T 4
/* The size of `void *', as computed by sizeof. */
#define SIZEOF_VOID_P 4
/* Define to 1 if you have the ANSI C header files. */
#define STDC_HEADERS 1
/* Define to 1 if strerror_r() returns a int. */
/* #undef STRERROR_R_INT */
/* Define to 1 if your <sys/time.h> declares `struct tm'. */
/* #undef TM_IN_SYS_TIME */
/* Define to 1 to build with assertion checks. (--enable-cassert) */
/* #undef USE_ASSERT_CHECKING */
/* Define to 1 to build with Bonjour support. (--with-bonjour) */
/* #undef USE_BONJOUR */
/* Define to 1 if you want float4 values to be passed by value.
(--enable-float4-byval) */
#define USE_FLOAT4_BYVAL 1
/* Define to 1 if you want float8, int8, etc values to be passed by value.
(--enable-float8-byval) */
/* #undef USE_FLOAT8_BYVAL */
/* Define to 1 if you want 64-bit integer timestamp and interval support.
(--enable-integer-datetimes) */
#define USE_INTEGER_DATETIMES 1
/* Define to 1 to build with LDAP support. (--with-ldap) */
//#define USE_LDAP 0
/* Define to 1 to build with XML support. (--with-libxml) */
#define USE_LIBXML 1
/* Define to 1 to use XSLT support when building contrib/xml2.
(--with-libxslt) */
#define USE_LIBXSLT 1
/* Define to select named POSIX semaphores. */
/* #undef USE_NAMED_POSIX_SEMAPHORES */
/* Define to build with OpenSSL support. (--with-openssl) */
#define USE_OPENSSL 0
#define USE_OPENSSL_RANDOM 0
#define FRONTEND 1
/* Define to 1 to build with PAM support. (--with-pam) */
#define USE_PAM 1
/* Use replacement snprintf() functions. */
/* #undef USE_REPL_SNPRINTF */
/* Define to 1 to use Intel SSE 4.2 CRC instructions with a runtime check. */
#define USE_SLICING_BY_8_CRC32C 1
/* Define to 1 use Intel SSE 4.2 CRC instructions. */
/* #undef USE_SSE42_CRC32C */
/* Define to 1 to use Intel SSSE 4.2 CRC instructions with a runtime check. */
/* #undef USE_SSE42_CRC32C_WITH_RUNTIME_CHECK */
/* Define to select SysV-style semaphores. */
#define USE_SYSV_SEMAPHORES 1
/* Define to select SysV-style shared memory. */
#define USE_SYSV_SHARED_MEMORY 1
/* Define to select unnamed POSIX semaphores. */
/* #undef USE_UNNAMED_POSIX_SEMAPHORES */
/* Define to select Win32-style semaphores. */
/* #undef USE_WIN32_SEMAPHORES */
/* Define to select Win32-style shared memory. */
/* #undef USE_WIN32_SHARED_MEMORY */
/* Define to 1 to build with ZSTD support. (--with-zstd) */
/* #undef USE_ZSTD */
/* Define to 1 if `wcstombs_l' requires <xlocale.h>. */
/* #undef WCSTOMBS_L_IN_XLOCALE */
/* Define WORDS_BIGENDIAN to 1 if your processor stores words with the most
significant byte first (like Motorola and SPARC, unlike Intel). */
#if defined AC_APPLE_UNIVERSAL_BUILD
# if defined __BIG_ENDIAN__
# define WORDS_BIGENDIAN 1
# endif
#else
# ifndef WORDS_BIGENDIAN
/* # undef WORDS_BIGENDIAN */
# endif
#endif
/* Size of a WAL file block. This need have no particular relation to BLCKSZ.
XLOG_BLCKSZ must be a power of 2, and if your system supports O_DIRECT I/O,
XLOG_BLCKSZ must be a multiple of the alignment requirement for direct-I/O
buffers, else direct I/O may fail. Changing XLOG_BLCKSZ requires an initdb.
*/
#define XLOG_BLCKSZ 8192
/* XLOG_SEG_SIZE is the size of a single WAL file. This must be a power of 2
and larger than XLOG_BLCKSZ (preferably, a great deal larger than
XLOG_BLCKSZ). Changing XLOG_SEG_SIZE requires an initdb. */
#define XLOG_SEG_SIZE (16 * 1024 * 1024)
/* Number of bits in a file offset, on hosts where this is settable. */
#define _FILE_OFFSET_BITS 64
/* Define to 1 to make fseeko visible on some hosts (e.g. glibc 2.2). */
/* #undef _LARGEFILE_SOURCE */
/* Define for large files, on AIX-style hosts. */
/* #undef _LARGE_FILES */
/* Define to `__inline__' or `__inline' if that's what the C compiler
calls it, or to nothing if 'inline' is not supported under any name. */
#ifndef __cplusplus
/* #undef inline */
#endif
/* Define to the type of a signed integer type wide enough to hold a pointer,
if such a type exists, and if the system does not define it. */
/* #undef intptr_t */
/* Define to empty if the C compiler does not understand signed types. */
/* #undef signed */
/* Define to the type of an unsigned integer type wide enough to hold a
pointer, if such a type exists, and if the system does not define it. */
/* #undef uintptr_t */

View File

@ -0,0 +1,7 @@
/*
* * src/include/pg_config_ext.h.in. This is generated manually, not by
* * autoheader, since we want to limit which symbols get defined here.
* */
/* Define to the name of a signed 64-bit integer type. */
#define PG_INT64_TYPE long long int

View File

@ -0,0 +1,34 @@
#if defined(OS_DARWIN)
/* src/include/port/darwin.h */
#define __darwin__ 1
#if HAVE_DECL_F_FULLFSYNC /* not present before macOS 10.3 */
#define HAVE_FSYNC_WRITETHROUGH
#endif
#else
/* src/include/port/linux.h */
/*
* As of July 2007, all known versions of the Linux kernel will sometimes
* return EIDRM for a shmctl() operation when EINVAL is correct (it happens
* when the low-order 15 bits of the supplied shm ID match the slot number
* assigned to a newer shmem segment). We deal with this by assuming that
* EIDRM means EINVAL in PGSharedMemoryIsInUse(). This is reasonably safe
* since in fact Linux has no excuse for ever returning EIDRM; it doesn't
* track removed segments in a way that would allow distinguishing them from
* private ones. But someday that code might get upgraded, and we'd have
* to have a kernel version test here.
*/
#define HAVE_LINUX_EIDRM_BUG
/*
* Set the default wal_sync_method to fdatasync. With recent Linux versions,
* xlogdefs.h's normal rules will prefer open_datasync, which (a) doesn't
* perform better and (b) causes outright failures on ext4 data=journal
* filesystems, because those don't support O_DIRECT.
*/
#define PLATFORM_DEFAULT_SYNC_METHOD SYNC_METHOD_FDATASYNC
#endif

View File

@ -0,0 +1,12 @@
#define PGBINDIR "/bin"
#define PGSHAREDIR "/share"
#define SYSCONFDIR "/etc"
#define INCLUDEDIR "/include"
#define PKGINCLUDEDIR "/include"
#define INCLUDEDIRSERVER "/include/server"
#define LIBDIR "/lib"
#define PKGLIBDIR "/lib"
#define LOCALEDIR "/share/locale"
#define DOCDIR "/doc"
#define HTMLDIR "/doc"
#define MANDIR "/man"

2
contrib/sysroot vendored

@ -1 +1 @@
Subproject commit cc385041b226d1fc28ead14dbab5d40a5f821dd8
Subproject commit 5be834147d5b5dd77ca2b821f356982029320513

2
contrib/usearch vendored

@ -1 +1 @@
Subproject commit e21a5778a0d4469ddaf38c94b7be0196bb701ee4
Subproject commit 7a8967cb442b08ca20c3dd781414378e65957d37

View File

@ -34,7 +34,7 @@ RUN arch=${TARGETARCH:-amd64} \
# lts / testing / prestable / etc
ARG REPO_CHANNEL="stable"
ARG REPOSITORY="https://packages.clickhouse.com/tgz/${REPO_CHANNEL}"
ARG VERSION="24.8.2.3"
ARG VERSION="24.8.4.13"
ARG PACKAGES="clickhouse-keeper"
ARG DIRECT_DOWNLOAD_URLS=""

View File

@ -32,7 +32,7 @@ RUN arch=${TARGETARCH:-amd64} \
# lts / testing / prestable / etc
ARG REPO_CHANNEL="stable"
ARG REPOSITORY="https://packages.clickhouse.com/tgz/${REPO_CHANNEL}"
ARG VERSION="24.8.2.3"
ARG VERSION="24.8.4.13"
ARG PACKAGES="clickhouse-client clickhouse-server clickhouse-common-static"
ARG DIRECT_DOWNLOAD_URLS=""

View File

@ -28,7 +28,7 @@ RUN sed -i "s|http://archive.ubuntu.com|${apt_archive}|g" /etc/apt/sources.list
ARG REPO_CHANNEL="stable"
ARG REPOSITORY="deb [signed-by=/usr/share/keyrings/clickhouse-keyring.gpg] https://packages.clickhouse.com/deb ${REPO_CHANNEL} main"
ARG VERSION="24.8.2.3"
ARG VERSION="24.8.4.13"
ARG PACKAGES="clickhouse-client clickhouse-server clickhouse-common-static"
#docker-official-library:off

View File

@ -109,7 +109,7 @@ if [ -n "$CLICKHOUSE_USER" ] && [ "$CLICKHOUSE_USER" != "default" ] || [ -n "$CL
<networks>
<ip>::/0</ip>
</networks>
<password>${CLICKHOUSE_PASSWORD}</password>
<password><![CDATA[${CLICKHOUSE_PASSWORD//]]>/]]]]><![CDATA[>}]]></password>
<quota>default</quota>
<access_management>${CLICKHOUSE_ACCESS_MANAGEMENT}</access_management>
</${CLICKHOUSE_USER}>

View File

@ -124,6 +124,8 @@ function setup_logs_replication
check_logs_credentials || return 0
__set_connection_args
echo "My hostname is ${HOSTNAME}"
echo 'Create all configured system logs'
clickhouse-client --query "SYSTEM FLUSH LOGS"
@ -184,7 +186,17 @@ function setup_logs_replication
/^TTL /d
')
echo -e "Creating remote destination table ${table}_${hash} with statement:\n${statement}" >&2
echo -e "Creating remote destination table ${table}_${hash} with statement:" >&2
echo "::group::${table}"
# there's the only way big "$statement" can be printed without causing EAGAIN error
# cat: write error: Resource temporarily unavailable
statement_print="${statement}"
if [ "${#statement_print}" -gt 4000 ]; then
statement_print="${statement::1999}\n…\n${statement:${#statement}-1999}"
fi
echo -e "$statement_print"
echo "::endgroup::"
echo "$statement" | clickhouse-client --database_replicated_initial_query_timeout_sec=10 \
--distributed_ddl_task_timeout=30 --distributed_ddl_output_mode=throw_only_active \

View File

@ -3,6 +3,8 @@
FROM alpine:3.18
RUN apk add --no-cache -U iproute2 \
&& for bin in iptables iptables-restore iptables-save; \
&& for bin in \
iptables iptables-restore iptables-save \
ip6tables ip6tables-restore ip6tables-save; \
do ln -sf xtables-nft-multi "/sbin/$bin"; \
done

View File

@ -13,7 +13,8 @@ entry="/usr/share/clickhouse-test/performance/scripts/entrypoint.sh"
# https://www.kernel.org/doc/Documentation/filesystems/tmpfs.txt
# Double-escaped backslashes are a tribute to the engineering wonder of docker --
# it gives '/bin/sh: 1: [bash,: not found' otherwise.
numactl --hardware
echo > compare.log
numactl --hardware | tee -a compare.log
node=$(( RANDOM % $(numactl --hardware | sed -n 's/^.*available:\(.*\)nodes.*$/\1/p') ));
echo Will bind to NUMA node $node;
echo Will bind to NUMA node $node | tee -a compare.log
numactl --cpunodebind=$node --membind=$node $entry

View File

@ -0,0 +1,32 @@
---
sidebar_position: 1
sidebar_label: 2024
---
# 2024 Changelog
### ClickHouse release v24.3.10.33-lts (37b6502ebf0) FIXME as compared to v24.3.9.5-lts (a939270465e)
#### Improvement
* Backported in [#68870](https://github.com/ClickHouse/ClickHouse/issues/68870): Make allow_experimental_analyzer be controlled by the initiator for distributed queries. This ensures compatibility and correctness during operations in mixed version clusters. [#65777](https://github.com/ClickHouse/ClickHouse/pull/65777) ([Nikita Mikhaylov](https://github.com/nikitamikhaylov)).
* Backported in [#69095](https://github.com/ClickHouse/ClickHouse/issues/69095): Support for the Spanish language in the embedded dictionaries. [#69035](https://github.com/ClickHouse/ClickHouse/pull/69035) ([Vasily Okunev](https://github.com/VOkunev)).
#### Bug Fix (user-visible misbehavior in an official stable release)
* Backported in [#68995](https://github.com/ClickHouse/ClickHouse/issues/68995): Fix the upper bound of the function `fromModifiedJulianDay`. It was supposed to be `9999-12-31` but was mistakenly set to `9999-01-01`. [#67583](https://github.com/ClickHouse/ClickHouse/pull/67583) ([PHO](https://github.com/depressed-pho)).
* Backported in [#68844](https://github.com/ClickHouse/ClickHouse/issues/68844): Fixed crash in Parquet filtering when data types in the file substantially differ from requested types (e.g. `... FROM file('a.parquet', Parquet, 'x String')`, but the file has `x Int64`). Without this fix, use `input_format_parquet_filter_push_down = 0` as a workaround. [#68131](https://github.com/ClickHouse/ClickHouse/pull/68131) ([Michael Kolupaev](https://github.com/al13n321)).
* Backported in [#68881](https://github.com/ClickHouse/ClickHouse/issues/68881): Fixes [#50868](https://github.com/ClickHouse/ClickHouse/issues/50868). Small DateTime64 constant values returned by a nested subquery inside a distributed query were wrongly transformed to Nulls, thus causing errors and possible incorrect query results. [#68323](https://github.com/ClickHouse/ClickHouse/pull/68323) ([Shankar](https://github.com/shiyer7474)).
* Backported in [#69054](https://github.com/ClickHouse/ClickHouse/issues/69054): Added back virtual columns ` _table` and `_database` to distributed tables. They were available until version 24.3. [#68672](https://github.com/ClickHouse/ClickHouse/pull/68672) ([Anton Popov](https://github.com/CurtizJ)).
* Backported in [#68856](https://github.com/ClickHouse/ClickHouse/issues/68856): Fix possible error `Size of permutation (0) is less than required (...)` during Variant column permutation. [#68681](https://github.com/ClickHouse/ClickHouse/pull/68681) ([Kruglov Pavel](https://github.com/Avogar)).
* Backported in [#69152](https://github.com/ClickHouse/ClickHouse/issues/69152): Fix possible wrong result during anyHeavy state merge. [#68950](https://github.com/ClickHouse/ClickHouse/pull/68950) ([Raúl Marín](https://github.com/Algunenano)).
* Backported in [#69112](https://github.com/ClickHouse/ClickHouse/issues/69112): Fix logical error when we have empty async insert. [#69080](https://github.com/ClickHouse/ClickHouse/pull/69080) ([Han Fei](https://github.com/hanfei1991)).
#### NO CL CATEGORY
* Backported in [#68938](https://github.com/ClickHouse/ClickHouse/issues/68938):. [#68897](https://github.com/ClickHouse/ClickHouse/pull/68897) ([Alexander Gololobov](https://github.com/davenger)).
#### NOT FOR CHANGELOG / INSIGNIFICANT
* Backported in [#68826](https://github.com/ClickHouse/ClickHouse/issues/68826): Turn off fault injection for insert in `01396_inactive_replica_cleanup_nodes_zookeeper`. [#68715](https://github.com/ClickHouse/ClickHouse/pull/68715) ([alesapin](https://github.com/alesapin)).
* Backported in [#68754](https://github.com/ClickHouse/ClickHouse/issues/68754): To make patch release possible from every commit on release branch, package_debug build is required and must not be skipped. [#68750](https://github.com/ClickHouse/ClickHouse/pull/68750) ([Max K.](https://github.com/maxknv)).
* Backported in [#69044](https://github.com/ClickHouse/ClickHouse/issues/69044): Fix 01114_database_atomic flakiness. [#68930](https://github.com/ClickHouse/ClickHouse/pull/68930) ([Raúl Marín](https://github.com/Algunenano)).

View File

@ -0,0 +1,17 @@
---
sidebar_position: 1
sidebar_label: 2024
---
# 2024 Changelog
### ClickHouse release v24.3.11.7-lts (28795d0a47e) FIXME as compared to v24.3.10.33-lts (37b6502ebf0)
#### Bug Fix (user-visible misbehavior in an official stable release)
* Backported in [#67479](https://github.com/ClickHouse/ClickHouse/issues/67479): In rare cases ClickHouse could consider parts as broken because of some unexpected projections on disk. Now it's fixed. [#66898](https://github.com/ClickHouse/ClickHouse/pull/66898) ([alesapin](https://github.com/alesapin)).
* Backported in [#69243](https://github.com/ClickHouse/ClickHouse/issues/69243): `UNION` clause in subqueries wasn't handled correctly in queries with parallel replicas and lead to LOGICAL_ERROR `Duplicate announcement received for replica`. [#69146](https://github.com/ClickHouse/ClickHouse/pull/69146) ([Igor Nikonov](https://github.com/devcrafter)).
#### NOT FOR CHANGELOG / INSIGNIFICANT
* Backported in [#69221](https://github.com/ClickHouse/ClickHouse/issues/69221): Disable memory test with sanitizer. [#69193](https://github.com/ClickHouse/ClickHouse/pull/69193) ([alesapin](https://github.com/alesapin)).

View File

@ -0,0 +1,29 @@
---
sidebar_position: 1
sidebar_label: 2024
---
# 2024 Changelog
### ClickHouse release v24.5.7.31-stable (6c185e9aec1) FIXME as compared to v24.5.6.45-stable (bdca8604c29)
#### Bug Fix (user-visible misbehavior in an official stable release)
* Backported in [#68564](https://github.com/ClickHouse/ClickHouse/issues/68564): Fix indexHint function case found by fuzzer. [#66286](https://github.com/ClickHouse/ClickHouse/pull/66286) ([Anton Popov](https://github.com/CurtizJ)).
* Backported in [#68996](https://github.com/ClickHouse/ClickHouse/issues/68996): Fix the upper bound of the function `fromModifiedJulianDay`. It was supposed to be `9999-12-31` but was mistakenly set to `9999-01-01`. [#67583](https://github.com/ClickHouse/ClickHouse/pull/67583) ([PHO](https://github.com/depressed-pho)).
* Backported in [#68865](https://github.com/ClickHouse/ClickHouse/issues/68865): Fixed crash in Parquet filtering when data types in the file substantially differ from requested types (e.g. `... FROM file('a.parquet', Parquet, 'x String')`, but the file has `x Int64`). Without this fix, use `input_format_parquet_filter_push_down = 0` as a workaround. [#68131](https://github.com/ClickHouse/ClickHouse/pull/68131) ([Michael Kolupaev](https://github.com/al13n321)).
* Backported in [#69004](https://github.com/ClickHouse/ClickHouse/issues/69004): After https://github.com/ClickHouse/ClickHouse/pull/61984 `schema_inference_make_columns_nullable=0` still can make columns `Nullable` in Parquet/Arrow formats. The change was backward incompatible and users noticed the changes in the behaviour. This PR makes `schema_inference_make_columns_nullable=0` to work as before (no Nullable columns will be inferred) and introduces new value `auto` for this setting that will make columns `Nullable` only if data has information about nullability. [#68298](https://github.com/ClickHouse/ClickHouse/pull/68298) ([Kruglov Pavel](https://github.com/Avogar)).
* Backported in [#68882](https://github.com/ClickHouse/ClickHouse/issues/68882): Fixes [#50868](https://github.com/ClickHouse/ClickHouse/issues/50868). Small DateTime64 constant values returned by a nested subquery inside a distributed query were wrongly transformed to Nulls, thus causing errors and possible incorrect query results. [#68323](https://github.com/ClickHouse/ClickHouse/pull/68323) ([Shankar](https://github.com/shiyer7474)).
* Backported in [#69023](https://github.com/ClickHouse/ClickHouse/issues/69023): Added back virtual columns ` _table` and `_database` to distributed tables. They were available until version 24.3. [#68672](https://github.com/ClickHouse/ClickHouse/pull/68672) ([Anton Popov](https://github.com/CurtizJ)).
* Backported in [#68858](https://github.com/ClickHouse/ClickHouse/issues/68858): Fix possible error `Size of permutation (0) is less than required (...)` during Variant column permutation. [#68681](https://github.com/ClickHouse/ClickHouse/pull/68681) ([Kruglov Pavel](https://github.com/Avogar)).
* Backported in [#68784](https://github.com/ClickHouse/ClickHouse/issues/68784): Fix issue with materialized constant keys when hashing maps with arrays as keys in functions `sipHash(64/128)Keyed`. [#68731](https://github.com/ClickHouse/ClickHouse/pull/68731) ([Salvatore Mesoraca](https://github.com/aiven-sal)).
* Backported in [#69154](https://github.com/ClickHouse/ClickHouse/issues/69154): Fix possible wrong result during anyHeavy state merge. [#68950](https://github.com/ClickHouse/ClickHouse/pull/68950) ([Raúl Marín](https://github.com/Algunenano)).
#### NO CL CATEGORY
* Backported in [#68940](https://github.com/ClickHouse/ClickHouse/issues/68940):. [#68897](https://github.com/ClickHouse/ClickHouse/pull/68897) ([Alexander Gololobov](https://github.com/davenger)).
#### NOT FOR CHANGELOG / INSIGNIFICANT
* Backported in [#68828](https://github.com/ClickHouse/ClickHouse/issues/68828): Turn off fault injection for insert in `01396_inactive_replica_cleanup_nodes_zookeeper`. [#68715](https://github.com/ClickHouse/ClickHouse/pull/68715) ([alesapin](https://github.com/alesapin)).
* Backported in [#69046](https://github.com/ClickHouse/ClickHouse/issues/69046): Fix 01114_database_atomic flakiness. [#68930](https://github.com/ClickHouse/ClickHouse/pull/68930) ([Raúl Marín](https://github.com/Algunenano)).

View File

@ -0,0 +1,18 @@
---
sidebar_position: 1
sidebar_label: 2024
---
# 2024 Changelog
### ClickHouse release v24.5.8.10-stable (f11729638ea) FIXME as compared to v24.5.7.31-stable (6c185e9aec1)
#### Bug Fix (user-visible misbehavior in an official stable release)
* Backported in [#69295](https://github.com/ClickHouse/ClickHouse/issues/69295): TODO. [#68744](https://github.com/ClickHouse/ClickHouse/pull/68744) ([Nikolai Kochetov](https://github.com/KochetovNicolai)).
* Backported in [#69245](https://github.com/ClickHouse/ClickHouse/issues/69245): `UNION` clause in subqueries wasn't handled correctly in queries with parallel replicas and lead to LOGICAL_ERROR `Duplicate announcement received for replica`. [#69146](https://github.com/ClickHouse/ClickHouse/pull/69146) ([Igor Nikonov](https://github.com/devcrafter)).
* Fix crash when using `s3` table function with GLOB paths and filters. [#69176](https://github.com/ClickHouse/ClickHouse/pull/69176) ([János Benjamin Antal](https://github.com/antaljanosbenjamin)).
#### NOT FOR CHANGELOG / INSIGNIFICANT
* Backported in [#69223](https://github.com/ClickHouse/ClickHouse/issues/69223): Disable memory test with sanitizer. [#69193](https://github.com/ClickHouse/ClickHouse/pull/69193) ([alesapin](https://github.com/alesapin)).

View File

@ -0,0 +1,29 @@
---
sidebar_position: 1
sidebar_label: 2024
---
# 2024 Changelog
### ClickHouse release v24.6.5.30-stable (e6e196c92d6) FIXME as compared to v24.6.4.42-stable (c534bb4b4dd)
#### Bug Fix (user-visible misbehavior in an official stable release)
* Backported in [#68969](https://github.com/ClickHouse/ClickHouse/issues/68969): Fix the upper bound of the function `fromModifiedJulianDay`. It was supposed to be `9999-12-31` but was mistakenly set to `9999-01-01`. [#67583](https://github.com/ClickHouse/ClickHouse/pull/67583) ([PHO](https://github.com/depressed-pho)).
* Backported in [#68814](https://github.com/ClickHouse/ClickHouse/issues/68814): Fixed crash in Parquet filtering when data types in the file substantially differ from requested types (e.g. `... FROM file('a.parquet', Parquet, 'x String')`, but the file has `x Int64`). Without this fix, use `input_format_parquet_filter_push_down = 0` as a workaround. [#68131](https://github.com/ClickHouse/ClickHouse/pull/68131) ([Michael Kolupaev](https://github.com/al13n321)).
* Backported in [#69005](https://github.com/ClickHouse/ClickHouse/issues/69005): After https://github.com/ClickHouse/ClickHouse/pull/61984 `schema_inference_make_columns_nullable=0` still can make columns `Nullable` in Parquet/Arrow formats. The change was backward incompatible and users noticed the changes in the behaviour. This PR makes `schema_inference_make_columns_nullable=0` to work as before (no Nullable columns will be inferred) and introduces new value `auto` for this setting that will make columns `Nullable` only if data has information about nullability. [#68298](https://github.com/ClickHouse/ClickHouse/pull/68298) ([Kruglov Pavel](https://github.com/Avogar)).
* Backported in [#68883](https://github.com/ClickHouse/ClickHouse/issues/68883): Fixes [#50868](https://github.com/ClickHouse/ClickHouse/issues/50868). Small DateTime64 constant values returned by a nested subquery inside a distributed query were wrongly transformed to Nulls, thus causing errors and possible incorrect query results. [#68323](https://github.com/ClickHouse/ClickHouse/pull/68323) ([Shankar](https://github.com/shiyer7474)).
* Backported in [#69025](https://github.com/ClickHouse/ClickHouse/issues/69025): Added back virtual columns ` _table` and `_database` to distributed tables. They were available until version 24.3. [#68672](https://github.com/ClickHouse/ClickHouse/pull/68672) ([Anton Popov](https://github.com/CurtizJ)).
* Backported in [#68860](https://github.com/ClickHouse/ClickHouse/issues/68860): Fix possible error `Size of permutation (0) is less than required (...)` during Variant column permutation. [#68681](https://github.com/ClickHouse/ClickHouse/pull/68681) ([Kruglov Pavel](https://github.com/Avogar)).
* Backported in [#68786](https://github.com/ClickHouse/ClickHouse/issues/68786): Fix issue with materialized constant keys when hashing maps with arrays as keys in functions `sipHash(64/128)Keyed`. [#68731](https://github.com/ClickHouse/ClickHouse/pull/68731) ([Salvatore Mesoraca](https://github.com/aiven-sal)).
* Backported in [#69156](https://github.com/ClickHouse/ClickHouse/issues/69156): Fix possible wrong result during anyHeavy state merge. [#68950](https://github.com/ClickHouse/ClickHouse/pull/68950) ([Raúl Marín](https://github.com/Algunenano)).
* Backported in [#69116](https://github.com/ClickHouse/ClickHouse/issues/69116): Fix logical error when we have empty async insert. [#69080](https://github.com/ClickHouse/ClickHouse/pull/69080) ([Han Fei](https://github.com/hanfei1991)).
#### NO CL CATEGORY
* Backported in [#68942](https://github.com/ClickHouse/ClickHouse/issues/68942):. [#68897](https://github.com/ClickHouse/ClickHouse/pull/68897) ([Alexander Gololobov](https://github.com/davenger)).
#### NOT FOR CHANGELOG / INSIGNIFICANT
* Backported in [#68830](https://github.com/ClickHouse/ClickHouse/issues/68830): Turn off fault injection for insert in `01396_inactive_replica_cleanup_nodes_zookeeper`. [#68715](https://github.com/ClickHouse/ClickHouse/pull/68715) ([alesapin](https://github.com/alesapin)).
* Backported in [#69048](https://github.com/ClickHouse/ClickHouse/issues/69048): Fix 01114_database_atomic flakiness. [#68930](https://github.com/ClickHouse/ClickHouse/pull/68930) ([Raúl Marín](https://github.com/Algunenano)).

View File

@ -0,0 +1,16 @@
---
sidebar_position: 1
sidebar_label: 2024
---
# 2024 Changelog
### ClickHouse release v24.6.6.6-stable (a4c4580e639) FIXME as compared to v24.6.5.30-stable (e6e196c92d6)
#### Bug Fix (user-visible misbehavior in an official stable release)
* Backported in [#69197](https://github.com/ClickHouse/ClickHouse/issues/69197): TODO. [#68744](https://github.com/ClickHouse/ClickHouse/pull/68744) ([Nikolai Kochetov](https://github.com/KochetovNicolai)).
#### NOT FOR CHANGELOG / INSIGNIFICANT
* Backported in [#69225](https://github.com/ClickHouse/ClickHouse/issues/69225): Disable memory test with sanitizer. [#69193](https://github.com/ClickHouse/ClickHouse/pull/69193) ([alesapin](https://github.com/alesapin)).

View File

@ -0,0 +1,17 @@
---
sidebar_position: 1
sidebar_label: 2024
---
# 2024 Changelog
### ClickHouse release v24.7.6.8-stable (7779883593a) FIXME as compared to v24.7.5.37-stable (f2533ca97be)
#### Bug Fix (user-visible misbehavior in an official stable release)
* Backported in [#69198](https://github.com/ClickHouse/ClickHouse/issues/69198): TODO. [#68744](https://github.com/ClickHouse/ClickHouse/pull/68744) ([Nikolai Kochetov](https://github.com/KochetovNicolai)).
* Backported in [#69249](https://github.com/ClickHouse/ClickHouse/issues/69249): `UNION` clause in subqueries wasn't handled correctly in queries with parallel replicas and lead to LOGICAL_ERROR `Duplicate announcement received for replica`. [#69146](https://github.com/ClickHouse/ClickHouse/pull/69146) ([Igor Nikonov](https://github.com/devcrafter)).
#### NOT FOR CHANGELOG / INSIGNIFICANT
* Backported in [#69227](https://github.com/ClickHouse/ClickHouse/issues/69227): Disable memory test with sanitizer. [#69193](https://github.com/ClickHouse/ClickHouse/pull/69193) ([alesapin](https://github.com/alesapin)).

View File

@ -0,0 +1,50 @@
---
sidebar_position: 1
sidebar_label: 2024
---
# 2024 Changelog
### ClickHouse release v24.8.3.59-lts (e729b9fa40e) FIXME as compared to v24.8.2.3-lts (b54f79ed323)
#### New Feature
* Backported in [#68710](https://github.com/ClickHouse/ClickHouse/issues/68710): Query cache entries can now be dropped by tag. For example, the query cache entry created by `SELECT 1 SETTINGS use_query_cache = true, query_cache_tag = 'abc'` can now be dropped by `SYSTEM DROP QUERY CACHE TAG 'abc'` (or of course just: `SYSTEM DROP QUERY CACHE` which will clear the entire query cache). [#68477](https://github.com/ClickHouse/ClickHouse/pull/68477) ([Michał Tabaszewski](https://github.com/pinsvin00)).
#### Improvement
* Backported in [#69097](https://github.com/ClickHouse/ClickHouse/issues/69097): Support for the Spanish language in the embedded dictionaries. [#69035](https://github.com/ClickHouse/ClickHouse/pull/69035) ([Vasily Okunev](https://github.com/VOkunev)).
#### Bug Fix (user-visible misbehavior in an official stable release)
* Backported in [#68973](https://github.com/ClickHouse/ClickHouse/issues/68973): Fix the upper bound of the function `fromModifiedJulianDay`. It was supposed to be `9999-12-31` but was mistakenly set to `9999-01-01`. [#67583](https://github.com/ClickHouse/ClickHouse/pull/67583) ([PHO](https://github.com/depressed-pho)).
* Backported in [#68818](https://github.com/ClickHouse/ClickHouse/issues/68818): Fixed crash in Parquet filtering when data types in the file substantially differ from requested types (e.g. `... FROM file('a.parquet', Parquet, 'x String')`, but the file has `x Int64`). Without this fix, use `input_format_parquet_filter_push_down = 0` as a workaround. [#68131](https://github.com/ClickHouse/ClickHouse/pull/68131) ([Michael Kolupaev](https://github.com/al13n321)).
* Backported in [#68893](https://github.com/ClickHouse/ClickHouse/issues/68893): After https://github.com/ClickHouse/ClickHouse/pull/61984 `schema_inference_make_columns_nullable=0` still can make columns `Nullable` in Parquet/Arrow formats. The change was backward incompatible and users noticed the changes in the behaviour. This PR makes `schema_inference_make_columns_nullable=0` to work as before (no Nullable columns will be inferred) and introduces new value `auto` for this setting that will make columns `Nullable` only if data has information about nullability. [#68298](https://github.com/ClickHouse/ClickHouse/pull/68298) ([Kruglov Pavel](https://github.com/Avogar)).
* Backported in [#68721](https://github.com/ClickHouse/ClickHouse/issues/68721): Fixes [#50868](https://github.com/ClickHouse/ClickHouse/issues/50868). Small DateTime64 constant values returned by a nested subquery inside a distributed query were wrongly transformed to Nulls, thus causing errors and possible incorrect query results. [#68323](https://github.com/ClickHouse/ClickHouse/pull/68323) ([Shankar](https://github.com/shiyer7474)).
* Backported in [#69029](https://github.com/ClickHouse/ClickHouse/issues/69029): Added back virtual columns ` _table` and `_database` to distributed tables. They were available until version 24.3. [#68672](https://github.com/ClickHouse/ClickHouse/pull/68672) ([Anton Popov](https://github.com/CurtizJ)).
* Backported in [#68864](https://github.com/ClickHouse/ClickHouse/issues/68864): Fix possible error `Size of permutation (0) is less than required (...)` during Variant column permutation. [#68681](https://github.com/ClickHouse/ClickHouse/pull/68681) ([Kruglov Pavel](https://github.com/Avogar)).
* Backported in [#68854](https://github.com/ClickHouse/ClickHouse/issues/68854): Fix possible error `DB::Exception: Block structure mismatch in joined block stream: different columns:` with new JSON column. [#68686](https://github.com/ClickHouse/ClickHouse/pull/68686) ([Kruglov Pavel](https://github.com/Avogar)).
* Backported in [#68790](https://github.com/ClickHouse/ClickHouse/issues/68790): Fix issue with materialized constant keys when hashing maps with arrays as keys in functions `sipHash(64/128)Keyed`. [#68731](https://github.com/ClickHouse/ClickHouse/pull/68731) ([Salvatore Mesoraca](https://github.com/aiven-sal)).
* Backported in [#69108](https://github.com/ClickHouse/ClickHouse/issues/69108): TODO. [#68744](https://github.com/ClickHouse/ClickHouse/pull/68744) ([Nikolai Kochetov](https://github.com/KochetovNicolai)).
* Backported in [#68850](https://github.com/ClickHouse/ClickHouse/issues/68850): Fix resolving dynamic subcolumns from subqueries in analyzer. [#68824](https://github.com/ClickHouse/ClickHouse/pull/68824) ([Kruglov Pavel](https://github.com/Avogar)).
* Backported in [#68911](https://github.com/ClickHouse/ClickHouse/issues/68911): Fix complex types metadata parsing in DeltaLake. Closes [#68739](https://github.com/ClickHouse/ClickHouse/issues/68739). [#68836](https://github.com/ClickHouse/ClickHouse/pull/68836) ([Kseniia Sumarokova](https://github.com/kssenii)).
* Backported in [#69160](https://github.com/ClickHouse/ClickHouse/issues/69160): Fix possible wrong result during anyHeavy state merge. [#68950](https://github.com/ClickHouse/ClickHouse/pull/68950) ([Raúl Marín](https://github.com/Algunenano)).
* Backported in [#69072](https://github.com/ClickHouse/ClickHouse/issues/69072): Fixed writing to Materialized Views with enabled setting `optimize_functions_to_subcolumns`. [#68951](https://github.com/ClickHouse/ClickHouse/pull/68951) ([Anton Popov](https://github.com/CurtizJ)).
* Backported in [#69016](https://github.com/ClickHouse/ClickHouse/issues/69016): Don't use serializations cache in const Dynamic column methods. It could let to use-of-unitialized value or even race condition during aggregations. [#68953](https://github.com/ClickHouse/ClickHouse/pull/68953) ([Kruglov Pavel](https://github.com/Avogar)).
* Backported in [#69120](https://github.com/ClickHouse/ClickHouse/issues/69120): Fix logical error when we have empty async insert. [#69080](https://github.com/ClickHouse/ClickHouse/pull/69080) ([Han Fei](https://github.com/hanfei1991)).
#### NO CL CATEGORY
* Backported in [#68947](https://github.com/ClickHouse/ClickHouse/issues/68947):. [#68897](https://github.com/ClickHouse/ClickHouse/pull/68897) ([Alexander Gololobov](https://github.com/davenger)).
#### NOT FOR CHANGELOG / INSIGNIFICANT
* Backported in [#68704](https://github.com/ClickHouse/ClickHouse/issues/68704): Fix enumerating dynamic subcolumns. [#68582](https://github.com/ClickHouse/ClickHouse/pull/68582) ([Kruglov Pavel](https://github.com/Avogar)).
* Backported in [#69000](https://github.com/ClickHouse/ClickHouse/issues/69000): Prioritizing of virtual columns in hive partitioning. [#68606](https://github.com/ClickHouse/ClickHouse/pull/68606) ([Yarik Briukhovetskyi](https://github.com/yariks5s)).
* Backported in [#68799](https://github.com/ClickHouse/ClickHouse/issues/68799): CI: Disable SQLLogic job. [#68654](https://github.com/ClickHouse/ClickHouse/pull/68654) ([Max K.](https://github.com/maxknv)).
* Backported in [#68834](https://github.com/ClickHouse/ClickHouse/issues/68834): Turn off fault injection for insert in `01396_inactive_replica_cleanup_nodes_zookeeper`. [#68715](https://github.com/ClickHouse/ClickHouse/pull/68715) ([alesapin](https://github.com/alesapin)).
* Backported in [#68781](https://github.com/ClickHouse/ClickHouse/issues/68781): Fix flaky test 00989_parallel_parts_loading. [#68737](https://github.com/ClickHouse/ClickHouse/pull/68737) ([alesapin](https://github.com/alesapin)).
* Backported in [#68762](https://github.com/ClickHouse/ClickHouse/issues/68762): To make patch release possible from every commit on release branch, package_debug build is required and must not be skipped. [#68750](https://github.com/ClickHouse/ClickHouse/pull/68750) ([Max K.](https://github.com/maxknv)).
* Backported in [#68810](https://github.com/ClickHouse/ClickHouse/issues/68810): Try to disable rerun check if job triggered manually. [#68751](https://github.com/ClickHouse/ClickHouse/pull/68751) ([Max K.](https://github.com/maxknv)).
* Backported in [#68962](https://github.com/ClickHouse/ClickHouse/issues/68962): Fix 2477 timeout. [#68752](https://github.com/ClickHouse/ClickHouse/pull/68752) ([jsc0218](https://github.com/jsc0218)).
* Backported in [#68977](https://github.com/ClickHouse/ClickHouse/issues/68977): Check setting use_json_alias_for_old_object_type in runtime. [#68793](https://github.com/ClickHouse/ClickHouse/pull/68793) ([Kruglov Pavel](https://github.com/Avogar)).
* Backported in [#68852](https://github.com/ClickHouse/ClickHouse/issues/68852): Make dynamic structure selection more consistent. [#68802](https://github.com/ClickHouse/ClickHouse/pull/68802) ([Kruglov Pavel](https://github.com/Avogar)).
* Backported in [#69052](https://github.com/ClickHouse/ClickHouse/issues/69052): Fix 01114_database_atomic flakiness. [#68930](https://github.com/ClickHouse/ClickHouse/pull/68930) ([Raúl Marín](https://github.com/Algunenano)).

View File

@ -0,0 +1,22 @@
---
sidebar_position: 1
sidebar_label: 2024
---
# 2024 Changelog
### ClickHouse release v24.8.4.13-lts (53195bc189b) FIXME as compared to v24.8.3.59-lts (e729b9fa40e)
#### Improvement
* Backported in [#68699](https://github.com/ClickHouse/ClickHouse/issues/68699): Delete old code of named collections from dictionaries and substitute it to the new, which allows to use DDL created named collections in dictionaries. Closes [#60936](https://github.com/ClickHouse/ClickHouse/issues/60936), closes [#36890](https://github.com/ClickHouse/ClickHouse/issues/36890). [#68412](https://github.com/ClickHouse/ClickHouse/pull/68412) ([Kseniia Sumarokova](https://github.com/kssenii)).
#### Bug Fix (user-visible misbehavior in an official stable release)
* Backported in [#69231](https://github.com/ClickHouse/ClickHouse/issues/69231): Fix parsing error when null should be inserted as default in some cases during JSON type parsing. [#68955](https://github.com/ClickHouse/ClickHouse/pull/68955) ([Kruglov Pavel](https://github.com/Avogar)).
* Backported in [#69251](https://github.com/ClickHouse/ClickHouse/issues/69251): `UNION` clause in subqueries wasn't handled correctly in queries with parallel replicas and lead to LOGICAL_ERROR `Duplicate announcement received for replica`. [#69146](https://github.com/ClickHouse/ClickHouse/pull/69146) ([Igor Nikonov](https://github.com/devcrafter)).
#### NOT FOR CHANGELOG / INSIGNIFICANT
* Backported in [#69189](https://github.com/ClickHouse/ClickHouse/issues/69189): Don't create Object type if use_json_alias_for_old_object_type=1 but allow_experimental_object_type=0. [#69150](https://github.com/ClickHouse/ClickHouse/pull/69150) ([Kruglov Pavel](https://github.com/Avogar)).
* Backported in [#69229](https://github.com/ClickHouse/ClickHouse/issues/69229): Disable memory test with sanitizer. [#69193](https://github.com/ClickHouse/ClickHouse/pull/69193) ([alesapin](https://github.com/alesapin)).
* Backported in [#69219](https://github.com/ClickHouse/ClickHouse/issues/69219): Disable perf-like test with sanitizers. [#69194](https://github.com/ClickHouse/ClickHouse/pull/69194) ([alesapin](https://github.com/alesapin)).

View File

@ -13,16 +13,17 @@ Here is a complete list of available database engines. Follow the links for more
- [Atomic](../../engines/database-engines/atomic.md)
- [MySQL](../../engines/database-engines/mysql.md)
- [Lazy](../../engines/database-engines/lazy.md)
- [MaterializedPostgreSQL](../../engines/database-engines/materialized-postgresql.md)
- [MaterializedMySQL](../../engines/database-engines/materialized-mysql.md)
- [Lazy](../../engines/database-engines/lazy.md)
- [MySQL](../../engines/database-engines/mysql.md)
- [PostgreSQL](../../engines/database-engines/postgresql.md)
- [MaterializedPostgreSQL](../../engines/database-engines/materialized-postgresql.md)
- [Replicated](../../engines/database-engines/replicated.md)
- [SQLite](../../engines/database-engines/sqlite.md)

View File

@ -155,6 +155,12 @@ Replication of [**TOAST**](https://www.postgresql.org/docs/9.5/storage-toast.htm
Sets a comma-separated list of PostgreSQL database tables, which will be replicated via [MaterializedPostgreSQL](../../engines/database-engines/materialized-postgresql.md) database engine.
Each table can have subset of replicated columns in brackets. If subset of columns is omitted, then all columns for table will be replicated.
``` sql
materialized_postgresql_tables_list = 'table1(co1, col2),table2,table3(co3, col5, col7)
```
Default value: empty list — means whole PostgreSQL database will be replicated.
### `materialized_postgresql_schema` {#materialized-postgresql-schema}

View File

@ -0,0 +1,72 @@
---
slug: /en/engines/table-engines/integrations/azure-queue
sidebar_position: 181
sidebar_label: AzureQueue
---
# AzureQueue Table Engine
This engine provides an integration with [Azure Blob Storage](https://azure.microsoft.com/en-us/products/storage/blobs) ecosystem, allowing streaming data import.
## Create Table {#creating-a-table}
``` sql
CREATE TABLE test (name String, value UInt32)
ENGINE = AzureQueue(...)
[SETTINGS]
[mode = '',]
[after_processing = 'keep',]
[keeper_path = '',]
...
```
**Engine parameters**
`AzureQueue` parameters are the same as `AzureBlobStorage` table engine supports. See parameters section [here](../../../engines/table-engines/integrations/azureBlobStorage.md).
**Example**
```sql
CREATE TABLE azure_queue_engine_table (name String, value UInt32)
ENGINE=AzureQueue('DefaultEndpointsProtocol=http;AccountName=devstoreaccount1;AccountKey=Eby8vdM02xNOcqFlqUwJPLlmEtlCDXJ1OUzFT50uSRZ6IFsuFq2UVErCz4I6tq/K1SZFPTOtr/KBHBeksoGMGw==;BlobEndpoint=http://azurite1:10000/devstoreaccount1/data/')
SETTINGS
mode = 'unordered'
```
## Settings {#settings}
The set of supported settings is the same as for `S3Queue` table engine, but without `s3queue_` prefix. See [full list of settings settings](../../../engines/table-engines/integrations/s3queue.md#settings).
## Description {#description}
`SELECT` is not particularly useful for streaming import (except for debugging), because each file can be imported only once. It is more practical to create real-time threads using [materialized views](../../../sql-reference/statements/create/view.md). To do this:
1. Use the engine to create a table for consuming from specified path in S3 and consider it a data stream.
2. Create a table with the desired structure.
3. Create a materialized view that converts data from the engine and puts it into a previously created table.
When the `MATERIALIZED VIEW` joins the engine, it starts collecting data in the background.
Example:
``` sql
CREATE TABLE azure_queue_engine_table (name String, value UInt32)
ENGINE=AzureQueue('<endpoint>', 'CSV', 'gzip')
SETTINGS
mode = 'unordered';
CREATE TABLE stats (name String, value UInt32)
ENGINE = MergeTree() ORDER BY name;
CREATE MATERIALIZED VIEW consumer TO stats
AS SELECT name, value FROM azure_queue_engine_table;
SELECT * FROM stats ORDER BY name;
```
## Virtual columns {#virtual-columns}
- `_path` — Path to the file.
- `_file` — Name of the file.
For more information about virtual columns see [here](../../../engines/table-engines/index.md#table_engines-virtual_columns).

View File

@ -112,7 +112,7 @@ Example:
```
The NATS server configuration can be added using the ClickHouse config file.
More specifically you can add Redis password for NATS engine:
More specifically you can add Redis password for NATS engine:
``` xml
<nats>
@ -167,7 +167,7 @@ If you want to change the target table by using `ALTER`, we recommend disabling
- `_subject` - NATS message subject. Data type: `String`.
Additional virtual columns when `kafka_handle_error_mode='stream'`:
Additional virtual columns when `nats_handle_error_mode='stream'`:
- `_raw_message` - Raw message that couldn't be parsed successfully. Data type: `Nullable(String)`.
- `_error` - Exception message happened during failed parsing. Data type: `Nullable(String)`.

View File

@ -35,7 +35,7 @@ CREATE TABLE s3_engine_table (name String, value UInt32)
[SETTINGS ...]
```
### Engine parameters
### Engine parameters {#parameters}
- `path` — Bucket url with path to file. Supports following wildcards in readonly mode: `*`, `**`, `?`, `{abc,def}` and `{N..M}` where `N`, `M` — numbers, `'abc'`, `'def'` — strings. For more information see [below](#wildcards-in-path).
- `NOSIGN` - If this keyword is provided in place of credentials, all the requests will not be signed.

View File

@ -5,6 +5,7 @@ sidebar_label: S3Queue
---
# S3Queue Table Engine
This engine provides integration with [Amazon S3](https://aws.amazon.com/s3/) ecosystem and allows streaming import. This engine is similar to the [Kafka](../../../engines/table-engines/integrations/kafka.md), [RabbitMQ](../../../engines/table-engines/integrations/rabbitmq.md) engines, but provides S3-specific features.
## Create Table {#creating-a-table}
@ -16,27 +17,25 @@ CREATE TABLE s3_queue_engine_table (name String, value UInt32)
[mode = '',]
[after_processing = 'keep',]
[keeper_path = '',]
[s3queue_loading_retries = 0,]
[s3queue_processing_threads_num = 1,]
[s3queue_enable_logging_to_s3queue_log = 0,]
[s3queue_polling_min_timeout_ms = 1000,]
[s3queue_polling_max_timeout_ms = 10000,]
[s3queue_polling_backoff_ms = 0,]
[s3queue_tracked_file_ttl_sec = 0,]
[s3queue_tracked_files_limit = 1000,]
[s3queue_cleanup_interval_min_ms = 10000,]
[s3queue_cleanup_interval_max_ms = 30000,]
[loading_retries = 0,]
[processing_threads_num = 1,]
[enable_logging_to_s3queue_log = 0,]
[polling_min_timeout_ms = 1000,]
[polling_max_timeout_ms = 10000,]
[polling_backoff_ms = 0,]
[tracked_file_ttl_sec = 0,]
[tracked_files_limit = 1000,]
[cleanup_interval_min_ms = 10000,]
[cleanup_interval_max_ms = 30000,]
```
Starting with `24.7` settings without `s3queue_` prefix are also supported.
:::warning
Before `24.7`, it is required to use `s3queue_` prefix for all settings apart from `mode`, `after_processing` and `keeper_path`.
:::
**Engine parameters**
- `path` — Bucket url with path to file. Supports following wildcards in readonly mode: `*`, `**`, `?`, `{abc,def}` and `{N..M}` where `N`, `M` — numbers, `'abc'`, `'def'` — strings. For more information see [below](#wildcards-in-path).
- `NOSIGN` - If this keyword is provided in place of credentials, all the requests will not be signed.
- `format` — The [format](../../../interfaces/formats.md#formats) of the file.
- `aws_access_key_id`, `aws_secret_access_key` - Long-term credentials for the [AWS](https://aws.amazon.com/) account user. You can use these to authenticate your requests. Parameter is optional. If credentials are not specified, they are used from the configuration file. For more information see [Using S3 for Data Storage](../mergetree-family/mergetree.md#table_engine-mergetree-s3).
- `compression` — Compression type. Supported values: `none`, `gzip/gz`, `brotli/br`, `xz/LZMA`, `zstd/zst`. Parameter is optional. By default, it will autodetect compression by file extension.
`S3Queue` parameters are the same as `S3` table engine supports. See parameters section [here](../../../engines/table-engines/integrations/s3.md#parameters).
**Example**

View File

@ -54,7 +54,7 @@ Parameters:
- `distance_function`: either `L2Distance` (the [Euclidean distance](https://en.wikipedia.org/wiki/Euclidean_distance) - the length of a
line between two points in Euclidean space), or `cosineDistance` (the [cosine
distance](https://en.wikipedia.org/wiki/Cosine_similarity#Cosine_distance)- the angle between two non-zero vectors).
- `quantization`: either `f32`, `f16`, or `i8` for storing the vector with reduced precision (optional, default: `f32`)
- `quantization`: either `f64`, `f32`, `f16`, `bf16`, or `i8` for storing the vector with reduced precision (optional, default: `bf16`)
- `m`: the number of neighbors per graph node (optional, default: 16)
- `ef_construction`: (optional, default: 128)
- `ef_search`: (optional, default: 64)
@ -107,19 +107,24 @@ The vector similarity index currently does not work with per-table, non-default
[here](https://github.com/ClickHouse/ClickHouse/pull/51325#issuecomment-1605920475)). If necessary, the value must be changed in config.xml.
:::
Vector index creation is known to be slow. To speed the process up, index creation can be parallelized. The maximum number of threads can be
configured using server configuration
setting [max_build_vector_similarity_index_thread_pool_size](../../../operations/server-configuration-parameters/settings.md#server_configuration_parameters_max_build_vector_similarity_index_thread_pool_size).
ANN indexes are built during column insertion and merge. As a result, `INSERT` and `OPTIMIZE` statements will be slower than for ordinary
tables. ANNIndexes are ideally used only with immutable or rarely changed data, respectively when are far more read requests than write
requests.
ANN indexes support these queries:
ANN indexes support this type of query:
``` sql
SELECT *
FROM table
[WHERE ...]
ORDER BY Distance(vectors, Point)
LIMIT N
```
``` sql
WITH [...] AS reference_vector
SELECT *
FROM table
WHERE ... -- WHERE clause is optional
ORDER BY Distance(vectors, reference_vector)
LIMIT N
```
:::tip
To avoid writing out large vectors, you can use [query

View File

@ -989,19 +989,52 @@ ALTER TABLE tab DROP STATISTICS a;
These lightweight statistics aggregate information about distribution of values in columns. Statistics are stored in every part and updated when every insert comes.
They can be used for prewhere optimization only if we enable `set allow_statistics_optimize = 1`.
#### Available Types of Column Statistics {#available-types-of-column-statistics}
### Available Types of Column Statistics {#available-types-of-column-statistics}
- `MinMax`
The minimum and maximum column value which allows to estimate the selectivity of range filters on numeric columns.
Syntax: `minmax`
- `TDigest`
[TDigest](https://github.com/tdunning/t-digest) sketches which allow to compute approximate percentiles (e.g. the 90th percentile) for numeric columns.
Syntax: `tdigest`
- `Uniq`
[HyperLogLog](https://en.wikipedia.org/wiki/HyperLogLog) sketches which provide an estimation how many distinct values a column contains.
- `count_min`
Syntax: `uniq`
- `CountMin`
[CountMin](https://en.wikipedia.org/wiki/Count%E2%80%93min_sketch) sketches which provide an approximate count of the frequency of each value in a column.
Syntax `countmin`
### Supported Data Types {#supported-data-types}
| | (U)Int*, Float*, Decimal(*), Date*, Boolean, Enum* | String or FixedString |
|-----------|----------------------------------------------------|-----------------------|
| CountMin | ✔ | ✔ |
| MinMax | ✔ | ✗ |
| TDigest | ✔ | ✗ |
| Uniq | ✔ | ✔ |
### Supported Operations {#supported-operations}
| | Equality filters (==) | Range filters (>, >=, <, <=) |
|-----------|-----------------------|------------------------------|
| CountMin | ✔ | ✗ |
| MinMax | ✗ | ✔ |
| TDigest | ✗ | ✔ |
| Uniq | ✔ | ✗ |
[Count-min](https://en.wikipedia.org/wiki/Count%E2%80%93min_sketch) sketches which provide an approximate count of the frequency of each value in a column.
## Column-level Settings {#column-level-settings}

View File

@ -97,7 +97,7 @@ If you want to change the target table by using `ALTER`, we recommend disabling
- `_filename` - Name of the log file. Data type: `LowCardinality(String)`.
- `_offset` - Offset in the log file. Data type: `UInt64`.
Additional virtual columns when `kafka_handle_error_mode='stream'`:
Additional virtual columns when `handle_error_mode='stream'`:
- `_raw_record` - Raw record that couldn't be parsed successfully. Data type: `Nullable(String)`.
- `_error` - Exception message happened during failed parsing. Data type: `Nullable(String)`.

View File

@ -39,6 +39,7 @@ The supported formats are:
| [JSONCompact](#jsoncompact) | ✔ | ✔ |
| [JSONCompactStrings](#jsoncompactstrings) | ✗ | ✔ |
| [JSONCompactColumns](#jsoncompactcolumns) | ✔ | ✔ |
| [JSONCompactWithProgress](#jsoncompactwithprogress) | ✗ | ✔ |
| [JSONEachRow](#jsoneachrow) | ✔ | ✔ |
| [PrettyJSONEachRow](#prettyjsoneachrow) | ✗ | ✔ |
| [JSONEachRowWithProgress](#jsoneachrowwithprogress) | ✗ | ✔ |
@ -825,17 +826,17 @@ Result:
## JSONAsObject {#jsonasobject}
In this format, a single JSON object is interpreted as a single [Object('json')](/docs/en/sql-reference/data-types/json.md) value. If the input has several JSON objects (comma separated), they are interpreted as separate rows. If the input data is enclosed in square brackets, it is interpreted as an array of JSONs.
In this format, a single JSON object is interpreted as a single [JSON](/docs/en/sql-reference/data-types/newjson.md) value. If the input has several JSON objects (comma separated), they are interpreted as separate rows. If the input data is enclosed in square brackets, it is interpreted as an array of JSONs.
This format can only be parsed for a table with a single field of type [Object('json')](/docs/en/sql-reference/data-types/json.md). The remaining columns must be set to [DEFAULT](/docs/en/sql-reference/statements/create/table.md/#default) or [MATERIALIZED](/docs/en/sql-reference/statements/create/table.md/#materialized).
This format can only be parsed for a table with a single field of type [JSON](/docs/en/sql-reference/data-types/newjson.md). The remaining columns must be set to [DEFAULT](/docs/en/sql-reference/statements/create/table.md/#default) or [MATERIALIZED](/docs/en/sql-reference/statements/create/table.md/#materialized).
**Examples**
Query:
``` sql
SET allow_experimental_object_type = 1;
CREATE TABLE json_as_object (json Object('json')) ENGINE = Memory;
SET allow_experimental_json_type = 1;
CREATE TABLE json_as_object (json JSON) ENGINE = Memory;
INSERT INTO json_as_object (json) FORMAT JSONAsObject {"foo":{"bar":{"x":"y"},"baz":1}},{},{"any json stucture":1}
SELECT * FROM json_as_object FORMAT JSONEachRow;
```
@ -843,9 +844,9 @@ SELECT * FROM json_as_object FORMAT JSONEachRow;
Result:
``` response
{"json":{"any json stucture":0,"foo":{"bar":{"x":"y"},"baz":1}}}
{"json":{"any json stucture":0,"foo":{"bar":{"x":""},"baz":0}}}
{"json":{"any json stucture":1,"foo":{"bar":{"x":""},"baz":0}}}
{"json":{"foo":{"bar":{"x":"y"},"baz":"1"}}}
{"json":{}}
{"json":{"any json stucture":"1"}}
```
**An array of JSON objects**
@ -853,35 +854,34 @@ Result:
Query:
``` sql
SET allow_experimental_object_type = 1;
CREATE TABLE json_square_brackets (field Object('json')) ENGINE = Memory;
SET allow_experimental_json_type = 1;
CREATE TABLE json_square_brackets (field JSON) ENGINE = Memory;
INSERT INTO json_square_brackets FORMAT JSONAsObject [{"id": 1, "name": "name1"}, {"id": 2, "name": "name2"}];
SELECT * FROM json_square_brackets FORMAT JSONEachRow;
```
Result:
```response
{"field":{"id":1,"name":"name1"}}
{"field":{"id":2,"name":"name2"}}
{"field":{"id":"1","name":"name1"}}
{"field":{"id":"2","name":"name2"}}
```
**Columns with default values**
```sql
SET allow_experimental_object_type = 1;
CREATE TABLE json_as_object (json Object('json'), time DateTime MATERIALIZED now()) ENGINE = Memory;
SET allow_experimental_json_type = 1;
CREATE TABLE json_as_object (json JSON, time DateTime MATERIALIZED now()) ENGINE = Memory;
INSERT INTO json_as_object (json) FORMAT JSONAsObject {"foo":{"bar":{"x":"y"},"baz":1}};
INSERT INTO json_as_object (json) FORMAT JSONAsObject {};
INSERT INTO json_as_object (json) FORMAT JSONAsObject {"any json stucture":1}
SELECT * FROM json_as_object FORMAT JSONEachRow
SELECT time, json FROM json_as_object FORMAT JSONEachRow
```
```resonse
{"json":{"any json stucture":0,"foo":{"bar":{"x":"y"},"baz":1}},"time":"2024-07-25 17:02:45"}
{"json":{"any json stucture":0,"foo":{"bar":{"x":""},"baz":0}},"time":"2024-07-25 17:02:47"}
{"json":{"any json stucture":1,"foo":{"bar":{"x":""},"baz":0}},"time":"2024-07-25 17:02:50"}
{"time":"2024-09-16 12:18:10","json":{}}
{"time":"2024-09-16 12:18:13","json":{"any json stucture":"1"}}
{"time":"2024-09-16 12:18:08","json":{"foo":{"bar":{"x":"y"},"baz":"1"}}}
```
## JSONCompact {#jsoncompact}
@ -988,6 +988,59 @@ Example:
Columns that are not present in the block will be filled with default values (you can use [input_format_defaults_for_omitted_fields](/docs/en/operations/settings/settings-formats.md/#input_format_defaults_for_omitted_fields) setting here)
## JSONCompactWithProgress (#jsoncompactwithprogress)
In this format, ClickHouse outputs each row as a separated, newline-delimited JSON Object.
Each row is either a metadata object, data object, progress information or statistics object:
1. **Metadata Object (`meta`)**
- Describes the structure of the data rows.
- Fields: `name` (column name), `type` (data type, e.g., `UInt32`, `String`, etc.).
- Example: `{"meta": [{"name":"id", "type":"UInt32"}, {"name":"name", "type":"String"}]}`
- Appears before any data objects.
2. **Data Object (`data`)**
- Represents a row of query results.
- Fields: An array with values corresponding to the columns defined in the metadata.
- Example: `{"data":["1", "John Doe"]}`
- Appears after the metadata object, one per row.
3. **Progress Information Object (`progress`)**
- Provides real-time progress feedback during query execution.
- Fields: `read_rows`, `read_bytes`, `written_rows`, `written_bytes`, `total_rows_to_read`, `result_rows`, `result_bytes`, `elapsed_ns`.
- Example: `{"progress":{"read_rows":"8","read_bytes":"168"}}`
- May appear intermittently.
4. **Statistics Object (`statistics`)**
- Summarizes query execution statistics.
- Fields: `rows`, `rows_before_limit_at_least`, `elapsed`, `rows_read`, `bytes_read`.
- Example: `{"statistics": {"rows":2, "elapsed":0.001995, "rows_read":8}}`
- Appears at the end.
5. **Exception Object (`exception`)**
- Represents an error that occurred during query execution.
- Fields: A single text field containing the error message.
- Example: `{"exception": "Code: 395. DB::Exception: Value passed to 'throwIf' function is non-zero..."}`
- Appears when an error is encountered.
6. **Totals Object (`totals`)**
- Provides the totals for each numeric column in the result set.
- Fields: An array with total values corresponding to the columns defined in the metadata.
- Example: `{"totals": ["", "3"]}`
- Appears at the end of the data rows, if applicable.
Example:
```json
{"meta": [{"name":"id", "type":"UInt32"}, {"name":"name", "type":"String"}]}
{"progress":{"read_rows":"8","read_bytes":"168","written_rows":"0","written_bytes":"0","total_rows_to_read":"2","result_rows":"0","result_bytes":"0","elapsed_ns":"0"}}
{"data":["1", "John Doe"]}
{"data":["2", "Joe Doe"]}
{"statistics": {"rows":2, "rows_before_limit_at_least":8, "elapsed":0.001995, "rows_read":8, "bytes_read":168}}
```
## JSONEachRow {#jsoneachrow}
In this format, ClickHouse outputs each row as a separated, newline-delimited JSON Object.
@ -1342,6 +1395,7 @@ SELECT * FROM json_each_row_nested
- [input_format_json_ignore_unknown_keys_in_named_tuple](/docs/en/operations/settings/settings-formats.md/#input_format_json_ignore_unknown_keys_in_named_tuple) - ignore unknown keys in json object for named tuples. Default value - `false`.
- [input_format_json_compact_allow_variable_number_of_columns](/docs/en/operations/settings/settings-formats.md/#input_format_json_compact_allow_variable_number_of_columns) - allow variable number of columns in JSONCompact/JSONCompactEachRow format, ignore extra columns and use default values on missing columns. Default value - `false`.
- [input_format_json_throw_on_bad_escape_sequence](/docs/en/operations/settings/settings-formats.md/#input_format_json_throw_on_bad_escape_sequence) - throw an exception if JSON string contains bad escape sequence. If disabled, bad escape sequences will remain as is in the data. Default value - `true`.
- [input_format_json_empty_as_default](/docs/en/operations/settings/settings-formats.md/#input_format_json_empty_as_default) - treat empty fields in JSON input as default values. Default value - `false`. For complex default expressions [input_format_defaults_for_omitted_fields](/docs/en/operations/settings/settings-formats.md/#input_format_defaults_for_omitted_fields) must be enabled too.
- [output_format_json_quote_64bit_integers](/docs/en/operations/settings/settings-formats.md/#output_format_json_quote_64bit_integers) - controls quoting of 64-bit integers in JSON output format. Default value - `true`.
- [output_format_json_quote_64bit_floats](/docs/en/operations/settings/settings-formats.md/#output_format_json_quote_64bit_floats) - controls quoting of 64-bit floats in JSON output format. Default value - `false`.
- [output_format_json_quote_denormals](/docs/en/operations/settings/settings-formats.md/#output_format_json_quote_denormals) - enables '+nan', '-nan', '+inf', '-inf' outputs in JSON output format. Default value - `false`.

View File

@ -58,7 +58,7 @@ Connection: Close
Content-Type: text/tab-separated-values; charset=UTF-8
X-ClickHouse-Server-Display-Name: clickhouse.ru-central1.internal
X-ClickHouse-Query-Id: 5abe861c-239c-467f-b955-8a201abb8b7f
X-ClickHouse-Summary: {"read_rows":"0","read_bytes":"0","written_rows":"0","written_bytes":"0","total_rows_to_read":"0","elapsed_ns":"662334"}
X-ClickHouse-Summary: {"read_rows":"0","read_bytes":"0","written_rows":"0","written_bytes":"0","total_rows_to_read":"0","elapsed_ns":"662334", "real_time_microseconds": "0"}
1
```
@ -472,7 +472,7 @@ $ curl -v 'http://localhost:8123/predefined_query'
< X-ClickHouse-Format: Template
< X-ClickHouse-Timezone: Asia/Shanghai
< Keep-Alive: timeout=10
< X-ClickHouse-Summary: {"read_rows":"0","read_bytes":"0","written_rows":"0","written_bytes":"0","total_rows_to_read":"0","elapsed_ns":"662334"}
< X-ClickHouse-Summary: {"read_rows":"0","read_bytes":"0","written_rows":"0","written_bytes":"0","total_rows_to_read":"0","elapsed_ns":"662334", "real_time_microseconds":"0"}
<
# HELP "Query" "Number of executing queries"
# TYPE "Query" counter
@ -668,7 +668,7 @@ $ curl -vv -H 'XXX:xxx' 'http://localhost:8123/hi'
< Content-Type: text/html; charset=UTF-8
< Transfer-Encoding: chunked
< Keep-Alive: timeout=10
< X-ClickHouse-Summary: {"read_rows":"0","read_bytes":"0","written_rows":"0","written_bytes":"0","total_rows_to_read":"0","elapsed_ns":"662334"}
< X-ClickHouse-Summary: {"read_rows":"0","read_bytes":"0","written_rows":"0","written_bytes":"0","total_rows_to_read":"0","elapsed_ns":"662334", "real_time_microseconds":"0"}
<
* Connection #0 to host localhost left intact
Say Hi!%
@ -708,7 +708,7 @@ $ curl -v -H 'XXX:xxx' 'http://localhost:8123/get_config_static_handler'
< Content-Type: text/plain; charset=UTF-8
< Transfer-Encoding: chunked
< Keep-Alive: timeout=10
< X-ClickHouse-Summary: {"read_rows":"0","read_bytes":"0","written_rows":"0","written_bytes":"0","total_rows_to_read":"0","elapsed_ns":"662334"}
< X-ClickHouse-Summary: {"read_rows":"0","read_bytes":"0","written_rows":"0","written_bytes":"0","total_rows_to_read":"0","elapsed_ns":"662334", "real_time_microseconds":"0"}
<
* Connection #0 to host localhost left intact
<html ng-app="SMI2"><head><base href="http://ui.tabix.io/"></head><body><div ui-view="" class="content-ui"></div><script src="http://loader.tabix.io/master.js"></script></body></html>%
@ -766,7 +766,7 @@ $ curl -vv -H 'XXX:xxx' 'http://localhost:8123/get_absolute_path_static_handler'
< Content-Type: text/html; charset=UTF-8
< Transfer-Encoding: chunked
< Keep-Alive: timeout=10
< X-ClickHouse-Summary: {"read_rows":"0","read_bytes":"0","written_rows":"0","written_bytes":"0","total_rows_to_read":"0","elapsed_ns":"662334"}
< X-ClickHouse-Summary: {"read_rows":"0","read_bytes":"0","written_rows":"0","written_bytes":"0","total_rows_to_read":"0","elapsed_ns":"662334", "real_time_microseconds":"0"}
<
<html><body>Absolute Path File</body></html>
* Connection #0 to host localhost left intact
@ -785,7 +785,7 @@ $ curl -vv -H 'XXX:xxx' 'http://localhost:8123/get_relative_path_static_handler'
< Content-Type: text/html; charset=UTF-8
< Transfer-Encoding: chunked
< Keep-Alive: timeout=10
< X-ClickHouse-Summary: {"read_rows":"0","read_bytes":"0","written_rows":"0","written_bytes":"0","total_rows_to_read":"0","elapsed_ns":"662334"}
< X-ClickHouse-Summary: {"read_rows":"0","read_bytes":"0","written_rows":"0","written_bytes":"0","total_rows_to_read":"0","elapsed_ns":"662334", "real_time_microseconds":"0"}
<
<html><body>Relative Path File</body></html>
* Connection #0 to host localhost left intact

View File

@ -233,6 +233,16 @@ Features:
- Useful tools: Zookeeper data exploration, query EXPLAIN, kill queries, etc.
- Visualization metric charts: queries and resource usage, number of merges/mutation, merge performance, query performance, etc.
### CKibana {#ckibana}
[CKibana](https://github.com/TongchengOpenSource/ckibana) is a lightweight service that allows you to effortlessly search, explore, and visualize ClickHouse data using the native Kibana UI.
Features:
- Translates chart requests from the native Kibana UI into ClickHouse query syntax.
- Supports advanced features such as sampling and caching to enhance query performance.
- Minimizes the learning cost for users after migrating from ElasticSearch to ClickHouse.
## Commercial {#commercial}
### DataGrip {#datagrip}

View File

@ -6,7 +6,7 @@ import SelfManaged from '@site/docs/en/_snippets/_self_managed_only_no_roadmap.m
<SelfManaged />
[SSL 'strict' option](../server-configuration-parameters/settings.md#server_configuration_parameters-openssl) enables mandatory certificate validation for the incoming connections. In this case, only connections with trusted certificates can be established. Connections with untrusted certificates will be rejected. Thus, certificate validation allows to uniquely authenticate an incoming connection. `Common Name` or `subjectAltName extension` field of the certificate is used to identify the connected user. This allows to associate multiple certificates with the same user. Additionally, reissuing and revoking of the certificates does not affect the ClickHouse configuration.
[SSL 'strict' option](../server-configuration-parameters/settings.md#server_configuration_parameters-openssl) enables mandatory certificate validation for the incoming connections. In this case, only connections with trusted certificates can be established. Connections with untrusted certificates will be rejected. Thus, certificate validation allows to uniquely authenticate an incoming connection. `Common Name` or `subjectAltName extension` field of the certificate is used to identify the connected user. `subjectAltName extension` supports the usage of one wildcard '*' in the server configuration. This allows to associate multiple certificates with the same user. Additionally, reissuing and revoking of the certificates does not affect the ClickHouse configuration.
To enable SSL certificate authentication, a list of `Common Name`'s or `Subject Alt Name`'s for each ClickHouse user must be specified in the settings file `users.xml `:
@ -30,6 +30,12 @@ To enable SSL certificate authentication, a list of `Common Name`'s or `Subject
</ssl_certificates>
<!-- Other settings -->
</user_name_2>
<user_name_3>
<ssl_certificates>
<!-- Wildcard support -->
<subject_alt_name>URI:spiffe://foo.com/*/bar</subject_alt_name>
</ssl_certificates>
</user_name_3>
</users>
</clickhouse>
```

View File

@ -491,6 +491,14 @@ Type: Double
Default: 0.9
## max_build_vector_similarity_index_thread_pool_size {#server_configuration_parameters_max_build_vector_similarity_index_thread_pool_size}
The maximum number of threads to use for building vector indexes. 0 means all cores.
Type: UInt64
Default: 16
## cgroups_memory_usage_observer_wait_time
Interval in seconds during which the server's maximum allowed memory consumption is adjusted by the corresponding threshold in cgroups. (see
@ -1463,26 +1471,29 @@ Examples:
## logger {#logger}
Logging settings.
The location and format of log messages.
Keys:
- `level` Logging level. Acceptable values: `trace`, `debug`, `information`, `warning`, `error`.
- `log` The log file. Contains all the entries according to `level`.
- `errorlog` Error log file.
- `size` Size of the file. Applies to `log` and `errorlog`. Once the file reaches `size`, ClickHouse archives and renames it, and creates a new log file in its place.
- `count` The number of archived log files that ClickHouse stores.
- `console` Send `log` and `errorlog` to the console instead of file. To enable, set to `1` or `true`.
- `console_log_level` Logging level for console. Default to `level`.
- `use_syslog` - Log to syslog as well.
- `syslog_level` - Logging level for logging to syslog.
- `stream_compress` Compress `log` and `errorlog` with `lz4` stream compression. To enable, set to `1` or `true`.
- `formatting` Specify log format to be printed in console log (currently only `json` supported).
- `level` Log level. Acceptable values: `none` (turn logging off), `fatal`, `critical`, `error`, `warning`, `notice`, `information`,
`debug`, `trace`, `test`
- `log` The path to the log file.
- `errorlog` The path to the error log file.
- `size` Rotation policy: Maximum size of the log files in bytes. Once the log file size exceeds this threshold, it is renamed and archived, and a new log file is created.
- `count` Rotation policy: How many historical log files Clickhouse are kept at most.
- `stream_compress` Compress log messages using LZ4. Set to `1` or `true` to enable.
- `console` Do not write log messages to log files, instead print them in the console. Set to `1` or `true` to enable. Default is
`1` if Clickhouse does not run in daemon mode, `0` otherwise.
- `console_log_level` Log level for console output. Defaults to `level`.
- `formatting` Log format for console output. Currently, only `json` is supported).
- `use_syslog` - Also forward log output to syslog.
- `syslog_level` - Log level for logging to syslog.
Both log and error log file names (only file names, not directories) support date and time format specifiers.
**Log format specifiers**
**Format specifiers**
Using the following format specifiers, you can define a pattern for the resulting file name. “Example” column shows possible results for `2023-07-06 18:32:07`.
File names in `log` and `errorLog` paths support below format specifiers for the resulting file name (the directory part does not support them).
Column “Example” shows the output at `2023-07-06 18:32:07`.
| Specifier | Description | Example |
|-------------|---------------------------------------------------------------------------------------------------------------------|--------------------------|
@ -1537,18 +1548,37 @@ Using the following format specifiers, you can define a pattern for the resultin
</logger>
```
Writing to the console can be configured. Config example:
To print log messages only in the console:
``` xml
<logger>
<level>information</level>
<console>1</console>
<console>true</console>
</logger>
```
**Per-level Overrides**
The log level of individual log names can be overridden. For example, to mute all messages of loggers "Backup" and "RBAC".
```xml
<logger>
<levels>
<logger>
<name>Backup</name>
<level>none</level>
</logger>
<logger>
<name>RBAC</name>
<level>none</level>
</logger>
</levels>
</logger>
```
### syslog
Writing to the syslog is also supported. Config example:
To write log messages additionally to syslog:
``` xml
<logger>
@ -1562,14 +1592,12 @@ Writing to the syslog is also supported. Config example:
</logger>
```
Keys for syslog:
Keys for `<syslog>`:
- use_syslog — Required setting if you want to write to the syslog.
- address — The host\[:port\] of syslogd. If omitted, the local daemon is used.
- hostname — Optional. The name of the host that logs are sent from.
- facility — [The syslog facility keyword](https://en.wikipedia.org/wiki/Syslog#Facility) in uppercase letters with the “LOG_” prefix: (`LOG_USER`, `LOG_DAEMON`, `LOG_LOCAL3`, and so on).
Default value: `LOG_USER` if `address` is specified, `LOG_DAEMON` otherwise.
- format Message format. Possible values: `bsd` and `syslog.`
- `address` — The address of syslog in format `host\[:port\]`. If omitted, the local daemon is used.
- `hostname` — The name of the host from which logs are send. Optional.
- `facility` — The syslog [facility keyword](https://en.wikipedia.org/wiki/Syslog#Facility). Must be specified uppercase with a “LOG_” prefix, e.g. `LOG_USER`, `LOG_DAEMON`, `LOG_LOCAL3`, etc. Default value: `LOG_USER` if `address` is specified, `LOG_DAEMON` otherwise.
- `format` Log message format. Possible values: `bsd` and `syslog.`
### Log formats
@ -1588,6 +1616,7 @@ You can specify the log format that will be outputted in the console log. Curren
"source_line": "192"
}
```
To enable JSON logging support, use the following snippet:
```xml
@ -3121,3 +3150,15 @@ Default value: "default"
**See Also**
- [Workload Scheduling](/docs/en/operations/workload-scheduling.md)
## max_authentication_methods_per_user {#max_authentication_methods_per_user}
The maximum number of authentication methods a user can be created with or altered to.
Changing this setting does not affect existing users. Create/alter authentication-related queries will fail if they exceed the limit specified in this setting.
Non authentication create/alter queries will succeed.
Type: UInt64
Default value: 100
Zero means unlimited

View File

@ -752,6 +752,17 @@ Possible values:
Default value: 0.
### input_format_json_empty_as_default {#input_format_json_empty_as_default}
When enabled, replace empty input fields in JSON with default values. For complex default expressions `input_format_defaults_for_omitted_fields` must be enabled too.
Possible values:
+ 0 — Disable.
+ 1 — Enable.
Default value: 0.
## TSV format settings {#tsv-format-settings}
### input_format_tsv_empty_as_default {#input_format_tsv_empty_as_default}

View File

@ -3226,7 +3226,7 @@ Default value: `0`.
## lightweight_deletes_sync {#lightweight_deletes_sync}
The same as 'mutation_sync', but controls only execution of lightweight deletes.
The same as [`mutations_sync`](#mutations_sync), but controls only execution of lightweight deletes.
Possible values:

View File

@ -499,7 +499,7 @@ Required parameters:
- `type``encrypted`. Otherwise the encrypted disk is not created.
- `disk` — Type of disk for data storage.
- `key` — The key for encryption and decryption. Type: [Uint64](/docs/en/sql-reference/data-types/int-uint.md). You can use `key_hex` parameter to encode the key in hexadecimal form.
You can specify multiple keys using the `id` attribute (see example above).
You can specify multiple keys using the `id` attribute (see example below).
Optional parameters:

View File

@ -0,0 +1,41 @@
---
slug: /en/operations/system-tables/projections
---
# projections
Contains information about existing projections in all the tables.
Columns:
- `database` ([String](../../sql-reference/data-types/string.md)) — Database name.
- `table` ([String](../../sql-reference/data-types/string.md)) — Table name.
- `name` ([String](../../sql-reference/data-types/string.md)) — Projection name.
- `type` ([Enum](../../sql-reference/data-types/enum.md)) — Projection type ('Normal' = 0, 'Aggregate' = 1).
- `sorting_key` ([Array(String)](../../sql-reference/data-types/array.md)) — Projection sorting key.
- `query` ([String](../../sql-reference/data-types/string.md)) — Projection query.
**Example**
```sql
SELECT * FROM system.projections LIMIT 2 FORMAT Vertical;
```
```text
Row 1:
──────
database: default
table: landing
name: improved_sorting_key
type: Normal
sorting_key: ['user_id','date']
query: SELECT * ORDER BY user_id, date
Row 2:
──────
database: default
table: landing
name: agg_no_key
type: Aggregate
sorting_key: []
query: SELECT count()
```

View File

@ -47,13 +47,15 @@ keeper foo bar
- `ls '[path]'` -- Lists the nodes for the given path (default: cwd)
- `cd '[path]'` -- Changes the working path (default `.`)
- `cp '<src>' '<dest>'` -- Copies 'src' node to 'dest' path
- `mv '<src>' '<dest>'` -- Moves 'src' node to the 'dest' path
- `exists '<path>'` -- Returns `1` if node exists, `0` otherwise
- `set '<path>' <value> [version]` -- Updates the node's value. Only updates if version matches (default: -1)
- `create '<path>' <value> [mode]` -- Creates new node with the set value
- `touch '<path>'` -- Creates new node with an empty string as value. Doesn't throw an exception if the node already exists
- `get '<path>'` -- Returns the node's value
- `rm '<path>' [version]` -- Removes the node only if version matches (default: -1)
- `rmr '<path>'` -- Recursively deletes path. Confirmation required
- `rmr '<path>' [limit]` -- Recursively deletes path if the subtree size is smaller than the limit. Confirmation required (default limit = 100)
- `flwc <command>` -- Executes four-letter-word command
- `help` -- Prints this message
- `get_direct_children_number '[path]'` -- Get numbers of direct children nodes under a specific path

View File

@ -104,7 +104,7 @@ Events that occur at the same second may lay in the sequence in an undefined ord
**Parameters**
- `pattern` — Pattern string. See [Pattern syntax](#sequencematch).
- `pattern` — Pattern string. See [Pattern syntax](#pattern-syntax).
**Returned values**
@ -113,8 +113,7 @@ Events that occur at the same second may lay in the sequence in an undefined ord
Type: `UInt8`.
<a name="sequence-function-pattern-syntax"></a>
**Pattern syntax**
#### Pattern syntax
- `(?N)` — Matches the condition argument at position `N`. Conditions are numbered in the `[1, 32]` range. For example, `(?1)` matches the argument passed to the `cond1` parameter.
@ -196,7 +195,7 @@ sequenceCount(pattern)(timestamp, cond1, cond2, ...)
**Parameters**
- `pattern` — Pattern string. See [Pattern syntax](#sequencematch).
- `pattern` — Pattern string. See [Pattern syntax](#pattern-syntax).
**Returned values**

View File

@ -0,0 +1,44 @@
---
slug: /en/sql-reference/aggregate-functions/reference/distinctdynamictypes
sidebar_position: 215
---
# distinctDynamicTypes
Calculates the list of distinct data types stored in [Dynamic](../../data-types/dynamic.md) column.
**Syntax**
```sql
distinctDynamicTypes(dynamic)
```
**Arguments**
- `dynamic` — [Dynamic](../../data-types/dynamic.md) column.
**Returned Value**
- The sorted list of data type names [Array(String)](../../data-types/array.md).
**Example**
Query:
```sql
DROP TABLE IF EXISTS test_dynamic;
CREATE TABLE test_dynamic(d Dynamic) ENGINE = Memory;
INSERT INTO test_dynamic VALUES (42), (NULL), ('Hello'), ([1, 2, 3]), ('2020-01-01'), (map(1, 2)), (43), ([4, 5]), (NULL), ('World'), (map(3, 4))
```
```sql
SELECT distinctDynamicTypes(d) FROM test_dynamic;
```
Result:
```reference
┌─distinctDynamicTypes(d)──────────────────────────────────────┐
│ ['Array(Int64)','Date','Int64','Map(UInt8, UInt8)','String'] │
└──────────────────────────────────────────────────────────────┘
```

View File

@ -0,0 +1,125 @@
---
slug: /en/sql-reference/aggregate-functions/reference/distinctjsonpaths
sidebar_position: 216
---
# distinctJSONPaths
Calculates the list of distinct paths stored in [JSON](../../data-types/newjson.md) column.
**Syntax**
```sql
distinctJSONPaths(json)
```
**Arguments**
- `json` — [JSON](../../data-types/newjson.md) column.
**Returned Value**
- The sorted list of paths [Array(String)](../../data-types/array.md).
**Example**
Query:
```sql
DROP TABLE IF EXISTS test_json;
CREATE TABLE test_json(json JSON) ENGINE = Memory;
INSERT INTO test_json VALUES ('{"a" : 42, "b" : "Hello"}'), ('{"b" : [1, 2, 3], "c" : {"d" : {"e" : "2020-01-01"}}}'), ('{"a" : 43, "c" : {"d" : {"f" : [{"g" : 42}]}}}')
```
```sql
SELECT distinctJSONPaths(json) FROM test_json;
```
Result:
```reference
┌─distinctJSONPaths(json)───┐
│ ['a','b','c.d.e','c.d.f'] │
└───────────────────────────┘
```
# distinctJSONPathsAndTypes
Calculates the list of distinct paths and their types stored in [JSON](../../data-types/newjson.md) column.
**Syntax**
```sql
distinctJSONPathsAndTypes(json)
```
**Arguments**
- `json` — [JSON](../../data-types/newjson.md) column.
**Returned Value**
- The sorted map of paths and types [Map(String, Array(String))](../../data-types/map.md).
**Example**
Query:
```sql
DROP TABLE IF EXISTS test_json;
CREATE TABLE test_json(json JSON) ENGINE = Memory;
INSERT INTO test_json VALUES ('{"a" : 42, "b" : "Hello"}'), ('{"b" : [1, 2, 3], "c" : {"d" : {"e" : "2020-01-01"}}}'), ('{"a" : 43, "c" : {"d" : {"f" : [{"g" : 42}]}}}')
```
```sql
SELECT distinctJSONPathsAndTypes(json) FROM test_json;
```
Result:
```reference
┌─distinctJSONPathsAndTypes(json)───────────────────────────────────────────────────────────────────────────────────────────────────────────────┐
│ {'a':['Int64'],'b':['Array(Nullable(Int64))','String'],'c.d.e':['Date'],'c.d.f':['Array(JSON(max_dynamic_types=16, max_dynamic_paths=256))']} │
└───────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┘
```
**Note**
If JSON declaration contains paths with specified types, these paths will be always included in the result of `distinctJSONPaths/distinctJSONPathsAndTypes` functions even if input data didn't have values for these paths.
```sql
DROP TABLE IF EXISTS test_json;
CREATE TABLE test_json(json JSON(a UInt32)) ENGINE = Memory;
INSERT INTO test_json VALUES ('{"b" : "Hello"}'), ('{"b" : "World", "c" : [1, 2, 3]}');
```
```sql
SELECT json FROM test_json;
```
```text
┌─json──────────────────────────────────┐
│ {"a":0,"b":"Hello"} │
│ {"a":0,"b":"World","c":["1","2","3"]} │
└───────────────────────────────────────┘
```
```sql
SELECT distinctJSONPaths(json) FROM test_json;
```
```text
┌─distinctJSONPaths(json)─┐
│ ['a','b','c'] │
└─────────────────────────┘
```
```sql
SELECT distinctJSONPathsAndTypes(json) FROM test_json;
```
```text
┌─distinctJSONPathsAndTypes(json)────────────────────────────────┐
│ {'a':['UInt32'],'b':['String'],'c':['Array(Nullable(Int64))']} │
└────────────────────────────────────────────────────────────────┘
```

View File

@ -9,7 +9,7 @@ Computes an approximate [quantile](https://en.wikipedia.org/wiki/Quantile) of a
**Syntax**
``` sql
quantileDDsketch[relative_accuracy, (level)](expr)
quantileDD(relative_accuracy, [level])(expr)
```
**Arguments**

View File

@ -453,8 +453,8 @@ As we can see, after inserting paths `e` and `f.g` the limit was reached and we
### During merges of data parts in MergeTree table engines
During merge of several data parts in MergeTree table the `JSON` column in the resulting data part can reach the limit of dynamic paths won't be able to store all paths from source parts as subcolumns.
In this case ClickHouse chooses what paths will remain as subcolumns after merge and what types will be stored in the shared data structure. In most cases ClickHouse tries to keep paths that contains
During merge of several data parts in MergeTree table the `JSON` column in the resulting data part can reach the limit of dynamic paths and won't be able to store all paths from source parts as subcolumns.
In this case ClickHouse chooses what paths will remain as subcolumns after merge and what paths will be stored in the shared data structure. In most cases ClickHouse tries to keep paths that contain
the largest number of non-null values and move the rarest paths to the shared data structure, but it depends on the implementation.
Let's see an example of such merge. First, let's create a table with `JSON` column, set the limit of dynamic paths to `3` and insert values with `5` different paths:
@ -505,7 +505,130 @@ As we can see, ClickHouse kept the most frequent paths `a`, `b` and `c` and move
## Introspection functions
There are several functions that can help to inspect the content of the JSON column: [JSONAllPaths](../functions/json-functions.md#jsonallpaths), [JSONAllPathsWithTypes](../functions/json-functions.md#jsonallpathswithtypes), [JSONDynamicPaths](../functions/json-functions.md#jsondynamicpaths), [JSONDynamicPathsWithTypes](../functions/json-functions.md#jsondynamicpathswithtypes), [JSONSharedDataPaths](../functions/json-functions.md#jsonshareddatapaths), [JSONSharedDataPathsWithTypes](../functions/json-functions.md#jsonshareddatapathswithtypes).
There are several functions that can help to inspect the content of the JSON column: [JSONAllPaths](../functions/json-functions.md#jsonallpaths), [JSONAllPathsWithTypes](../functions/json-functions.md#jsonallpathswithtypes), [JSONDynamicPaths](../functions/json-functions.md#jsondynamicpaths), [JSONDynamicPathsWithTypes](../functions/json-functions.md#jsondynamicpathswithtypes), [JSONSharedDataPaths](../functions/json-functions.md#jsonshareddatapaths), [JSONSharedDataPathsWithTypes](../functions/json-functions.md#jsonshareddatapathswithtypes), [distinctDynamicTypes](../aggregate-functions/reference/distinctdynamictypes.md), [distinctJSONPaths and distinctJSONPathsAndTypes](../aggregate-functions/reference/distinctjsonpaths.md)
**Examples**
Let's investigate the content of [GH Archive](https://www.gharchive.org/) dataset for `2020-01-01` date:
```sql
SELECT arrayJoin(distinctJSONPaths(json)) FROM s3('s3://clickhouse-public-datasets/gharchive/original/2020-01-01-*.json.gz', JSONAsObject)
```
```text
┌─arrayJoin(distinctJSONPaths(json))─────────────────────────┐
│ actor.avatar_url │
│ actor.display_login │
│ actor.gravatar_id │
│ actor.id │
│ actor.login │
│ actor.url │
│ created_at │
│ id │
│ org.avatar_url │
│ org.gravatar_id │
│ org.id │
│ org.login │
│ org.url │
│ payload.action │
│ payload.before │
│ payload.comment._links.html.href │
│ payload.comment._links.pull_request.href │
│ payload.comment._links.self.href │
│ payload.comment.author_association │
│ payload.comment.body │
│ payload.comment.commit_id │
│ payload.comment.created_at │
│ payload.comment.diff_hunk │
│ payload.comment.html_url │
│ payload.comment.id │
│ payload.comment.in_reply_to_id │
│ payload.comment.issue_url │
│ payload.comment.line │
│ payload.comment.node_id │
│ payload.comment.original_commit_id │
│ payload.comment.original_position │
│ payload.comment.path │
│ payload.comment.position │
│ payload.comment.pull_request_review_id │
...
│ payload.release.node_id │
│ payload.release.prerelease │
│ payload.release.published_at │
│ payload.release.tag_name │
│ payload.release.tarball_url │
│ payload.release.target_commitish │
│ payload.release.upload_url │
│ payload.release.url │
│ payload.release.zipball_url │
│ payload.size │
│ public │
│ repo.id │
│ repo.name │
│ repo.url │
│ type │
└─arrayJoin(distinctJSONPaths(json))─────────────────────────┘
```
```sql
SELECT arrayJoin(distinctJSONPathsAndTypes(json)) FROM s3('s3://clickhouse-public-datasets/gharchive/original/2020-01-01-*.json.gz', JSONAsObject) SETTINGS date_time_input_format='best_effort'
```
```text
┌─arrayJoin(distinctJSONPathsAndTypes(json))──────────────────┐
│ ('actor.avatar_url',['String']) │
│ ('actor.display_login',['String']) │
│ ('actor.gravatar_id',['String']) │
│ ('actor.id',['Int64']) │
│ ('actor.login',['String']) │
│ ('actor.url',['String']) │
│ ('created_at',['DateTime']) │
│ ('id',['String']) │
│ ('org.avatar_url',['String']) │
│ ('org.gravatar_id',['String']) │
│ ('org.id',['Int64']) │
│ ('org.login',['String']) │
│ ('org.url',['String']) │
│ ('payload.action',['String']) │
│ ('payload.before',['String']) │
│ ('payload.comment._links.html.href',['String']) │
│ ('payload.comment._links.pull_request.href',['String']) │
│ ('payload.comment._links.self.href',['String']) │
│ ('payload.comment.author_association',['String']) │
│ ('payload.comment.body',['String']) │
│ ('payload.comment.commit_id',['String']) │
│ ('payload.comment.created_at',['DateTime']) │
│ ('payload.comment.diff_hunk',['String']) │
│ ('payload.comment.html_url',['String']) │
│ ('payload.comment.id',['Int64']) │
│ ('payload.comment.in_reply_to_id',['Int64']) │
│ ('payload.comment.issue_url',['String']) │
│ ('payload.comment.line',['Int64']) │
│ ('payload.comment.node_id',['String']) │
│ ('payload.comment.original_commit_id',['String']) │
│ ('payload.comment.original_position',['Int64']) │
│ ('payload.comment.path',['String']) │
│ ('payload.comment.position',['Int64']) │
│ ('payload.comment.pull_request_review_id',['Int64']) │
...
│ ('payload.release.node_id',['String']) │
│ ('payload.release.prerelease',['Bool']) │
│ ('payload.release.published_at',['DateTime']) │
│ ('payload.release.tag_name',['String']) │
│ ('payload.release.tarball_url',['String']) │
│ ('payload.release.target_commitish',['String']) │
│ ('payload.release.upload_url',['String']) │
│ ('payload.release.url',['String']) │
│ ('payload.release.zipball_url',['String']) │
│ ('payload.size',['Int64']) │
│ ('public',['Bool']) │
│ ('repo.id',['Int64']) │
│ ('repo.name',['String']) │
│ ('repo.url',['String']) │
│ ('type',['String']) │
└─arrayJoin(distinctJSONPathsAndTypes(json))──────────────────┘
```
## Tips for better usage of the JSON type

View File

@ -2035,6 +2035,7 @@ Query:
SELECT arrayZip(['a', 'b', 'c'], [5, 2, 1]);
```
Result:
``` text
@ -2043,6 +2044,43 @@ Result:
└──────────────────────────────────────┘
```
## arrayZipUnaligned
Combines multiple arrays into a single array, allowing for unaligned arrays. The resulting array contains the corresponding elements of the source arrays grouped into tuples in the listed order of arguments.
**Syntax**
``` sql
arrayZipUnaligned(arr1, arr2, ..., arrN)
```
**Arguments**
- `arrN` — [Array](../data-types/array.md).
The function can take any number of arrays of different types.
**Returned value**
- Array with elements from the source arrays grouped into [tuples](../data-types/tuple.md). Data types in the tuple are the same as types of the input arrays and in the same order as arrays are passed. [Array](../data-types/array.md). If the arrays have different sizes, the shorter arrays will be padded with `null` values.
**Example**
Query:
``` sql
SELECT arrayZipUnaligned(['a'], [1, 2, 3]);
```
Result:
``` text
┌─arrayZipUnaligned(['a'], [1, 2, 3])─┐
│ [('a',1),(NULL,2),(NULL,3)] │
└─────────────────────────────────────┘
```
## arrayAUC
Calculate AUC (Area Under the Curve, which is a concept in machine learning, see more details: <https://en.wikipedia.org/wiki/Receiver_operating_characteristic#Area_under_the_curve>).

View File

@ -49,7 +49,7 @@ Result:
## multiIf
Allows to write the [CASE](../../sql-reference/operators/index.md#operator_case) operator more compactly in the query.
Allows to write the [CASE](../../sql-reference/operators/index.md#conditional-expression) operator more compactly in the query.
**Syntax**
@ -264,4 +264,4 @@ SELECT clamp(1, 2, 3) result, toTypeName(result) type;
┌─result─┬─type────┐
│ 2 │ Float64 │
└────────┴─────────┘
```
```

View File

@ -1617,45 +1617,348 @@ The calculation is performed relative to specific points in time:
If unit `WEEK` was specified, `toStartOfInterval` assumes that weeks start on Monday. Note that this behavior is different from that of function `toStartOfWeek` in which weeks start by default on Sunday.
**See Also**
**Syntax**
```sql
toStartOfInterval(value, INTERVAL x unit[, time_zone])
toStartOfInterval(value, INTERVAL x unit[, origin[, time_zone]])
```
The second overload emulates TimescaleDB's `time_bucket()` function, respectively PostgreSQL's `date_bin()` function, e.g.
``` SQL
SELECT toStartOfInterval(toDateTime('2023-01-01 14:45:00'), INTERVAL 1 MINUTE, toDateTime('2023-01-01 14:35:30'));
```
**See Also**
- [date_trunc](#date_trunc)
## toTime
Converts a date with time to a certain fixed date, while preserving the time.
**Syntax**
```sql
toTime(date[,timezone])
```
**Arguments**
- `date` — Date to convert to a time. [Date](../data-types/date.md)/[DateTime](../data-types/datetime.md)/[DateTime64](../data-types/datetime64.md).
- `timezone` (optional) — Timezone for the returned value. [String](../data-types/string.md).
**Returned value**
- DateTime with date equated to `1970-01-02` while preserving the time. [DateTime](../data-types/datetime.md).
:::note
If the `date` input argument contained sub-second components,
they will be dropped in the returned `DateTime` value with second-accuracy.
:::
**Example**
Query:
```sql
SELECT toTime(toDateTime64('1970-12-10 01:20:30.3000',3)) AS result, toTypeName(result);
```
Result:
```response
┌──────────────result─┬─toTypeName(result)─┐
│ 1970-01-02 01:20:30 │ DateTime │
└─────────────────────┴────────────────────┘
```
## toRelativeYearNum
Converts a date, or date with time, to the number of the year, starting from a certain fixed point in the past.
Converts a date, or date with time, to the number of years elapsed since a certain fixed point in the past.
**Syntax**
```sql
toRelativeYearNum(date)
```
**Arguments**
- `date` — Date or date with time. [Date](../data-types/date.md)/[DateTime](../data-types/datetime.md)/[DateTime64](../data-types/datetime64.md).
**Returned value**
- The number of years from a fixed reference point in the past. [UInt16](../data-types/int-uint.md).
**Example**
Query:
```sql
SELECT
toRelativeYearNum(toDate('2002-12-08')) AS y1,
toRelativeYearNum(toDate('2010-10-26')) AS y2
```
Result:
```response
┌───y1─┬───y2─┐
│ 2002 │ 2010 │
└──────┴──────┘
```
## toRelativeQuarterNum
Converts a date, or date with time, to the number of the quarter, starting from a certain fixed point in the past.
Converts a date, or date with time, to the number of quarters elapsed since a certain fixed point in the past.
**Syntax**
```sql
toRelativeQuarterNum(date)
```
**Arguments**
- `date` — Date or date with time. [Date](../data-types/date.md)/[DateTime](../data-types/datetime.md)/[DateTime64](../data-types/datetime64.md).
**Returned value**
- The number of quarters from a fixed reference point in the past. [UInt32](../data-types/int-uint.md).
**Example**
Query:
```sql
SELECT
toRelativeQuarterNum(toDate('1993-11-25')) AS q1,
toRelativeQuarterNum(toDate('2005-01-05')) AS q2
```
Result:
```response
┌───q1─┬───q2─┐
│ 7975 │ 8020 │
└──────┴──────┘
```
## toRelativeMonthNum
Converts a date, or date with time, to the number of the month, starting from a certain fixed point in the past.
Converts a date, or date with time, to the number of months elapsed since a certain fixed point in the past.
**Syntax**
```sql
toRelativeMonthNum(date)
```
**Arguments**
- `date` — Date or date with time. [Date](../data-types/date.md)/[DateTime](../data-types/datetime.md)/[DateTime64](../data-types/datetime64.md).
**Returned value**
- The number of months from a fixed reference point in the past. [UInt32](../data-types/int-uint.md).
**Example**
Query:
```sql
SELECT
toRelativeMonthNum(toDate('2001-04-25')) AS m1,
toRelativeMonthNum(toDate('2009-07-08')) AS m2
```
Result:
```response
┌────m1─┬────m2─┐
│ 24016 │ 24115 │
└───────┴───────┘
```
## toRelativeWeekNum
Converts a date, or date with time, to the number of the week, starting from a certain fixed point in the past.
Converts a date, or date with time, to the number of weeks elapsed since a certain fixed point in the past.
**Syntax**
```sql
toRelativeWeekNum(date)
```
**Arguments**
- `date` — Date or date with time. [Date](../data-types/date.md)/[DateTime](../data-types/datetime.md)/[DateTime64](../data-types/datetime64.md).
**Returned value**
- The number of weeks from a fixed reference point in the past. [UInt32](../data-types/int-uint.md).
**Example**
Query:
```sql
SELECT
toRelativeWeekNum(toDate('2000-02-29')) AS w1,
toRelativeWeekNum(toDate('2001-01-12')) AS w2
```
Result:
```response
┌───w1─┬───w2─┐
│ 1574 │ 1619 │
└──────┴──────┘
```
## toRelativeDayNum
Converts a date, or date with time, to the number of the day, starting from a certain fixed point in the past.
Converts a date, or date with time, to the number of days elapsed since a certain fixed point in the past.
**Syntax**
```sql
toRelativeDayNum(date)
```
**Arguments**
- `date` — Date or date with time. [Date](../data-types/date.md)/[DateTime](../data-types/datetime.md)/[DateTime64](../data-types/datetime64.md).
**Returned value**
- The number of days from a fixed reference point in the past. [UInt32](../data-types/int-uint.md).
**Example**
Query:
```sql
SELECT
toRelativeDayNum(toDate('1993-10-05')) AS d1,
toRelativeDayNum(toDate('2000-09-20')) AS d2
```
Result:
```response
┌───d1─┬────d2─┐
│ 8678 │ 11220 │
└──────┴───────┘
```
## toRelativeHourNum
Converts a date, or date with time, to the number of the hour, starting from a certain fixed point in the past.
Converts a date, or date with time, to the number of hours elapsed since a certain fixed point in the past.
**Syntax**
```sql
toRelativeHourNum(date)
```
**Arguments**
- `date` — Date or date with time. [Date](../data-types/date.md)/[DateTime](../data-types/datetime.md)/[DateTime64](../data-types/datetime64.md).
**Returned value**
- The number of hours from a fixed reference point in the past. [UInt32](../data-types/int-uint.md).
**Example**
Query:
```sql
SELECT
toRelativeHourNum(toDateTime('1993-10-05 05:20:36')) AS h1,
toRelativeHourNum(toDateTime('2000-09-20 14:11:29')) AS h2
```
Result:
```response
┌─────h1─┬─────h2─┐
│ 208276 │ 269292 │
└────────┴────────┘
```
## toRelativeMinuteNum
Converts a date, or date with time, to the number of the minute, starting from a certain fixed point in the past.
Converts a date, or date with time, to the number of minutes elapsed since a certain fixed point in the past.
**Syntax**
```sql
toRelativeMinuteNum(date)
```
**Arguments**
- `date` — Date or date with time. [Date](../data-types/date.md)/[DateTime](../data-types/datetime.md)/[DateTime64](../data-types/datetime64.md).
**Returned value**
- The number of minutes from a fixed reference point in the past. [UInt32](../data-types/int-uint.md).
**Example**
Query:
```sql
SELECT
toRelativeMinuteNum(toDateTime('1993-10-05 05:20:36')) AS m1,
toRelativeMinuteNum(toDateTime('2000-09-20 14:11:29')) AS m2
```
Result:
```response
┌───────m1─┬───────m2─┐
│ 12496580 │ 16157531 │
└──────────┴──────────┘
```
## toRelativeSecondNum
Converts a date, or date with time, to the number of the second, starting from a certain fixed point in the past.
Converts a date, or date with time, to the number of the seconds elapsed since a certain fixed point in the past.
**Syntax**
```sql
toRelativeSecondNum(date)
```
**Arguments**
- `date` — Date or date with time. [Date](../data-types/date.md)/[DateTime](../data-types/datetime.md)/[DateTime64](../data-types/datetime64.md).
**Returned value**
- The number of seconds from a fixed reference point in the past. [UInt32](../data-types/int-uint.md).
**Example**
Query:
```sql
SELECT
toRelativeSecondNum(toDateTime('1993-10-05 05:20:36')) AS s1,
toRelativeSecondNum(toDateTime('2000-09-20 14:11:29')) AS s2
```
Result:
```response
┌────────s1─┬────────s2─┐
│ 749794836 │ 969451889 │
└───────────┴───────────┘
```
## toISOYear
@ -2019,7 +2322,7 @@ Alias: `dateTrunc`.
`unit` argument is case-insensitive.
- `value` — Date and time. [DateTime](../data-types/datetime.md) or [DateTime64](../data-types/datetime64.md).
- `value` — Date and time. [Date](../data-types/date.md), [Date32](../data-types/date32.md), [DateTime](../data-types/datetime.md) or [DateTime64](../data-types/datetime64.md).
- `timezone` — [Timezone name](../../operations/server-configuration-parameters/settings.md#server_configuration_parameters-timezone) for the returned value (optional). If not specified, the function uses the timezone of the `value` parameter. [String](../data-types/string.md).
**Returned value**
@ -3884,19 +4187,29 @@ Result:
└───────────────────────────────────────────────────────────────────────┘
```
## timeSlots(StartTime, Duration,\[, Size\])
## timeSlots
For a time interval starting at StartTime and continuing for Duration seconds, it returns an array of moments in time, consisting of points from this interval rounded down to the Size in seconds. Size is an optional parameter set to 1800 (30 minutes) by default.
This is necessary, for example, when searching for pageviews in the corresponding session.
Accepts DateTime and DateTime64 as StartTime argument. For DateTime, Duration and Size arguments must be `UInt32`. For DateTime64 they must be `Decimal64`.
Returns an array of DateTime/DateTime64 (return type matches the type of StartTime). For DateTime64, the return value's scale can differ from the scale of StartTime --- the highest scale among all given arguments is taken.
Example:
**Syntax**
```sql
timeSlots(StartTime, Duration,\[, Size\])
```
**Example**
```sql
SELECT timeSlots(toDateTime('2012-01-01 12:20:00'), toUInt32(600));
SELECT timeSlots(toDateTime('1980-12-12 21:01:02', 'UTC'), toUInt32(600), 299);
SELECT timeSlots(toDateTime64('1980-12-12 21:01:02.1234', 4, 'UTC'), toDecimal64(600.1, 1), toDecimal64(299, 0));
```
Result:
``` text
┌─timeSlots(toDateTime('2012-01-01 12:20:00'), toUInt32(600))─┐
│ ['2012-01-01 12:00:00','2012-01-01 12:30:00'] │

View File

@ -20,10 +20,10 @@ overlay(s, replace, offset[, length])
**Parameters**
- `input`: A string type [String](../data-types/string.md).
- `s`: A string type [String](../data-types/string.md).
- `replace`: A string type [String](../data-types/string.md).
- `offset`: An integer type [Int](../data-types/int-uint.md). If `offset` is negative, it is counted from the end of the `input` string.
- `length`: Optional. An integer type [Int](../data-types/int-uint.md). `length` specifies the length of the snippet within input to be replaced. If `length` is not specified, the number of bytes removed from `input` equals the length of `replace`; otherwise `length` bytes are removed.
- `offset`: An integer type [Int](../data-types/int-uint.md) (1-based). If `offset` is negative, it is counted from the end of the string `s`.
- `length`: Optional. An integer type [Int](../data-types/int-uint.md). `length` specifies the length of the snippet within the input string `s` to be replaced. If `length` is not specified, the number of bytes removed from `s` equals the length of `replace`; otherwise `length` bytes are removed.
**Returned value**
@ -32,22 +32,35 @@ overlay(s, replace, offset[, length])
**Example**
```sql
SELECT overlay('ClickHouse SQL', 'CORE', 12) AS res;
SELECT overlay('My father is from Mexico.', 'mother', 4) AS res;
```
Result:
```text
┌─res─────────────┐
│ ClickHouse CORE │
└─────────────────┘
┌─res──────────────────────┐
│ My mother is from Mexico.│
└──────────────────────────┘
```
```sql
SELECT overlay('My father is from Mexico.', 'dad', 4, 6) AS res;
```
Result:
```text
┌─res───────────────────┐
│ My dad is from Mexico.│
└───────────────────────┘
```
## overlayUTF8
Replace part of the string `input` with another string `replace`, starting at the 1-based index `offset`.
Assumes that the string contains valid UTF-8 encoded text. If this assumption is violated, no exception is thrown and the result is undefined.
Assumes that the string contains valid UTF-8 encoded text.
If this assumption is violated, no exception is thrown and the result is undefined.
**Syntax**
@ -59,8 +72,8 @@ overlayUTF8(s, replace, offset[, length])
- `s`: A string type [String](../data-types/string.md).
- `replace`: A string type [String](../data-types/string.md).
- `offset`: An integer type [Int](../data-types/int-uint.md). If `offset` is negative, it is counted from the end of the `input` string.
- `length`: Optional. An integer type [Int](../data-types/int-uint.md). `length` specifies the length of the snippet within input to be replaced. If `length` is not specified, the number of characters removed from `input` equals the length of `replace`; otherwise `length` characters are removed.
- `offset`: An integer type [Int](../data-types/int-uint.md) (1-based). If `offset` is negative, it is counted from the end of the input string `s`.
- `length`: Optional. An integer type [Int](../data-types/int-uint.md). `length` specifies the length of the snippet within the input string `s` to be replaced. If `length` is not specified, the number of characters removed from `s` equals the length of `replace`; otherwise `length` characters are removed.
**Returned value**
@ -69,15 +82,15 @@ overlayUTF8(s, replace, offset[, length])
**Example**
```sql
SELECT overlayUTF8('ClickHouse是一款OLAP数据库', '开源', 12, 2) AS res;
SELECT overlay('Mein Vater ist aus Österreich.', 'der Türkei', 20) AS res;
```
Result:
```text
┌─res────────────────────────┐
ClickHouse是开源OLAP数据库
└────────────────────────────┘
┌─res───────────────────────────
Mein Vater ist aus der Türkei.
└───────────────────────────────
```
## replaceOne

View File

@ -49,6 +49,55 @@ SETTINGS cast_keep_nullable = 1
└──────────────────┴─────────────────────┴──────────────────┘
```
## toBool
Converts an input value to a value of type [`Bool`](../data-types/boolean.md). Throws an exception in case of an error.
**Syntax**
```sql
toBool(expr)
```
**Arguments**
- `expr` — Expression returning a number or a string. [Expression](../syntax.md/#syntax-expressions).
Supported arguments:
- Values of type (U)Int8/16/32/64/128/256.
- Values of type Float32/64.
- Strings `true` or `false` (case-insensitive).
**Returned value**
- Returns `true` or `false` based on evaluation of the argument. [Bool](../data-types/boolean.md).
**Example**
Query:
```sql
SELECT
toBool(toUInt8(1)),
toBool(toInt8(-1)),
toBool(toFloat32(1.01)),
toBool('true'),
toBool('false'),
toBool('FALSE')
FORMAT Vertical
```
Result:
```response
toBool(toUInt8(1)): true
toBool(toInt8(-1)): true
toBool(toFloat32(1.01)): true
toBool('true'): true
toBool('false'): false
toBool('FALSE'): false
```
## toInt8
Converts an input value to a value of type [`Int8`](../data-types/int-uint.md). Throws an exception in case of an error.
@ -3857,7 +3906,7 @@ Result:
## toDateTime64
Converts the argument to the [DateTime64](../data-types/datetime64.md) data type.
Converts an input value to a value of type [DateTime64](../data-types/datetime64.md).
**Syntax**
@ -3869,7 +3918,7 @@ toDateTime64(expr, scale, [timezone])
- `expr` — The value. [String](../data-types/string.md), [UInt32](../data-types/int-uint.md), [Float](../data-types/float.md) or [DateTime](../data-types/datetime.md).
- `scale` - Tick size (precision): 10<sup>-precision</sup> seconds. Valid range: [ 0 : 9 ].
- `timezone` - Time zone of the specified datetime64 object.
- `timezone` (optional) - Time zone of the specified datetime64 object.
**Returned value**
@ -3928,10 +3977,137 @@ SELECT toDateTime64('2019-01-01 00:00:00', 3, 'Asia/Istanbul') AS value, toTypeN
## toDateTime64OrZero
Like [toDateTime64](#todatetime64), this function converts an input value to a value of type [DateTime64](../data-types/datetime64.md) but returns the min value of [DateTime64](../data-types/datetime64.md) if an invalid argument is received.
**Syntax**
``` sql
toDateTime64OrZero(expr, scale, [timezone])
```
**Arguments**
- `expr` — The value. [String](../data-types/string.md), [UInt32](../data-types/int-uint.md), [Float](../data-types/float.md) or [DateTime](../data-types/datetime.md).
- `scale` - Tick size (precision): 10<sup>-precision</sup> seconds. Valid range: [ 0 : 9 ].
- `timezone` (optional) - Time zone of the specified DateTime64 object.
**Returned value**
- A calendar date and time of day, with sub-second precision, otherwise the minimum value of `DateTime64`: `1970-01-01 01:00:00.000`. [DateTime64](../data-types/datetime64.md).
**Example**
Query:
```sql
SELECT toDateTime64OrZero('2008-10-12 00:00:00 00:30:30', 3) AS invalid_arg
```
Result:
```response
┌─────────────invalid_arg─┐
│ 1970-01-01 01:00:00.000 │
└─────────────────────────┘
```
**See also**
- [toDateTime64](#todatetime64).
- [toDateTime64OrNull](#todatetime64ornull).
- [toDateTime64OrDefault](#todatetime64ordefault).
## toDateTime64OrNull
Like [toDateTime64](#todatetime64), this function converts an input value to a value of type [DateTime64](../data-types/datetime64.md) but returns `NULL` if an invalid argument is received.
**Syntax**
``` sql
toDateTime64OrNull(expr, scale, [timezone])
```
**Arguments**
- `expr` — The value. [String](../data-types/string.md), [UInt32](../data-types/int-uint.md), [Float](../data-types/float.md) or [DateTime](../data-types/datetime.md).
- `scale` - Tick size (precision): 10<sup>-precision</sup> seconds. Valid range: [ 0 : 9 ].
- `timezone` (optional) - Time zone of the specified DateTime64 object.
**Returned value**
- A calendar date and time of day, with sub-second precision, otherwise `NULL`. [DateTime64](../data-types/datetime64.md)/[NULL](../data-types/nullable.md).
**Example**
Query:
```sql
SELECT
toDateTime64OrNull('1976-10-18 00:00:00.30', 3) AS valid_arg,
toDateTime64OrNull('1976-10-18 00:00:00 30', 3) AS invalid_arg
```
Result:
```response
┌───────────────valid_arg─┬─invalid_arg─┐
│ 1976-10-18 00:00:00.300 │ ᴺᵁᴸᴸ │
└─────────────────────────┴─────────────┘
```
**See also**
- [toDateTime64](#todatetime64).
- [toDateTime64OrZero](#todatetime64orzero).
- [toDateTime64OrDefault](#todatetime64ordefault).
## toDateTime64OrDefault
Like [toDateTime64](#todatetime64), this function converts an input value to a value of type [DateTime64](../data-types/datetime64.md),
but returns either the default value of [DateTime64](../data-types/datetime64.md)
or the provided default if an invalid argument is received.
**Syntax**
``` sql
toDateTime64OrNull(expr, scale, [timezone, default])
```
**Arguments**
- `expr` — The value. [String](../data-types/string.md), [UInt32](../data-types/int-uint.md), [Float](../data-types/float.md) or [DateTime](../data-types/datetime.md).
- `scale` - Tick size (precision): 10<sup>-precision</sup> seconds. Valid range: [ 0 : 9 ].
- `timezone` (optional) - Time zone of the specified DateTime64 object.
- `default` (optional) - Default value to return if an invalid argument is received. [DateTime64](../data-types/datetime64.md).
**Returned value**
- A calendar date and time of day, with sub-second precision, otherwise the minimum value of `DateTime64` or the `default` value if provided. [DateTime64](../data-types/datetime64.md).
**Example**
Query:
```sql
SELECT
toDateTime64OrDefault('1976-10-18 00:00:00 30', 3) AS invalid_arg,
toDateTime64OrDefault('1976-10-18 00:00:00 30', 3, 'UTC', toDateTime64('2001-01-01 00:00:00.00',3)) AS invalid_arg_with_default
```
Result:
```response
┌─────────────invalid_arg─┬─invalid_arg_with_default─┐
│ 1970-01-01 01:00:00.000 │ 2000-12-31 23:00:00.000 │
└─────────────────────────┴──────────────────────────┘
```
**See also**
- [toDateTime64](#todatetime64).
- [toDateTime64OrZero](#todatetime64orzero).
- [toDateTime64OrNull](#todatetime64ornull).
## toDecimal32
Converts an input value to a value of type [`Decimal(9, S)`](../data-types/decimal.md) with scale of `S`. Throws an exception in case of an error.

View File

@ -265,8 +265,6 @@ SELECT now() AS current_date_time, current_date_time + INTERVAL '4' day + INTERV
└─────────────────────┴────────────────────────────────────────────────────────────┘
```
You can work with dates without using `INTERVAL`, just by adding or subtracting seconds, minutes, and hours. For example, an interval of one day can be set by adding `60*60*24`.
:::note
The `INTERVAL` syntax or `addDays` function are always preferred. Simple addition or subtraction (syntax like `now() + ...`) doesn't consider time settings. For example, daylight saving time.
:::

View File

@ -351,7 +351,7 @@ ALTER TABLE mt DELETE IN PARTITION ID '2' WHERE p = 2;
You can specify the partition expression in `ALTER ... PARTITION` queries in different ways:
- As a value from the `partition` column of the `system.parts` table. For example, `ALTER TABLE visits DETACH PARTITION 201901`.
- Using the keyword `ALL`. It can be used only with DROP/DETACH/ATTACH. For example, `ALTER TABLE visits ATTACH PARTITION ALL`.
- Using the keyword `ALL`. It can be used only with DROP/DETACH/ATTACH/ATTACH FROM. For example, `ALTER TABLE visits ATTACH PARTITION ALL`.
- As a tuple of expressions or constants that matches (in types) the table partitioning keys tuple. In the case of a single element partitioning key, the expression should be wrapped in the `tuple (...)` function. For example, `ALTER TABLE visits DETACH PARTITION tuple(toYYYYMM(toDate('2019-01-25')))`.
- Using the partition ID. Partition ID is a string identifier of the partition (human-readable, if possible) that is used as the names of partitions in the file system and in ZooKeeper. The partition ID must be specified in the `PARTITION ID` clause, in a single quotes. For example, `ALTER TABLE visits DETACH PARTITION ID '201901'`.
- In the [ALTER ATTACH PART](#attach-partitionpart) and [DROP DETACHED PART](#drop-detached-partitionpart) query, to specify the name of a part, use string literal with a value from the `name` column of the [system.detached_parts](/docs/en/operations/system-tables/detached_parts.md/#system_tables-detached_parts) table. For example, `ALTER TABLE visits ATTACH PART '201901_1_1_0'`.

View File

@ -12,9 +12,10 @@ Syntax:
``` sql
ALTER USER [IF EXISTS] name1 [ON CLUSTER cluster_name1] [RENAME TO new_name1]
[, name2 [ON CLUSTER cluster_name2] [RENAME TO new_name2] ...]
[NOT IDENTIFIED | IDENTIFIED {[WITH {no_password | plaintext_password | sha256_password | sha256_hash | double_sha1_password | double_sha1_hash}] BY {'password' | 'hash'}} | {WITH ldap SERVER 'server_name'} | {WITH kerberos [REALM 'realm']} | {WITH ssl_certificate CN 'common_name' | SAN 'TYPE:subject_alt_name'}]
[NOT IDENTIFIED | IDENTIFIED | ADD IDENTIFIED {[WITH {no_password | plaintext_password | sha256_password | sha256_hash | double_sha1_password | double_sha1_hash}] BY {'password' | 'hash'}} | {WITH ldap SERVER 'server_name'} | {WITH kerberos [REALM 'realm']} | {WITH ssl_certificate CN 'common_name' | SAN 'TYPE:subject_alt_name'}]
[[ADD | DROP] HOST {LOCAL | NAME 'name' | REGEXP 'name_regexp' | IP 'address' | LIKE 'pattern'} [,...] | ANY | NONE]
[VALID UNTIL datetime]
[RESET AUTHENTICATION METHODS TO NEW]
[DEFAULT ROLE role [,...] | ALL | ALL EXCEPT role [,...] ]
[GRANTEES {user | role | ANY | NONE} [,...] [EXCEPT {user | role} [,...]]]
[SETTINGS variable [= value] [MIN [=] min_value] [MAX [=] max_value] [READONLY | WRITABLE] | PROFILE 'profile_name'] [,...]
@ -62,3 +63,31 @@ Allows the user with `john` account to grant his privileges to the user with `ja
``` sql
ALTER USER john GRANTEES jack;
```
Adds new authentication methods to the user while keeping the existing ones:
``` sql
ALTER USER user1 ADD IDENTIFIED WITH plaintext_password by '1', bcrypt_password by '2', plaintext_password by '3'
```
Notes:
1. Older versions of ClickHouse might not support the syntax of multiple authentication methods. Therefore, if the ClickHouse server contains such users and is downgraded to a version that does not support it, such users will become unusable and some user related operations will be broken. In order to downgrade gracefully, one must set all users to contain a single authentication method prior to downgrading. Alternatively, if the server was downgraded without the proper procedure, the faulty users should be dropped.
2. `no_password` can not co-exist with other authentication methods for security reasons.
Because of that, it is not possible to `ADD` a `no_password` authentication method. The below query will throw an error:
``` sql
ALTER USER user1 ADD IDENTIFIED WITH no_password
```
If you want to drop authentication methods for a user and rely on `no_password`, you must specify in the below replacing form.
Reset authentication methods and adds the ones specified in the query (effect of leading IDENTIFIED without the ADD keyword):
``` sql
ALTER USER user1 IDENTIFIED WITH plaintext_password by '1', bcrypt_password by '2', plaintext_password by '3'
```
Reset authentication methods and keep the most recent added one:
``` sql
ALTER USER user1 RESET AUTHENTICATION METHODS TO NEW
```

Some files were not shown because too many files have changed in this diff Show More