Commit Graph

49930 Commits

Author SHA1 Message Date
Raúl Marín
d4290ade61 Remove optimize_move_functions_out_of_any optimization 2023-11-24 12:20:46 +01:00
alesapin
a3c2896e9d
Merge pull request #56846 from aalexfvk/add_cancellation_point_for_moving_background_operation
Add cancellation hook for moving background operation
2023-11-24 12:12:47 +01:00
Robert Schulze
8e93ea509d
Merge pull request #57002 from slvrtrn/from-days-all-integer-types
Allow to use any integer types with `fromDaysSinceYearZero` function
2023-11-24 11:28:53 +01:00
taiyang-li
35cf4cd1dd reuse some intermediate results while executing array join 2023-11-24 15:17:39 +08:00
Alexey Milovidov
98cddf5312
Merge pull request #57153 from ClickHouse/better-server-exit-code
Better server exit code
2023-11-23 23:55:28 +01:00
Alexey Milovidov
e7d01cd0fa
Merge pull request #57142 from ClickHouse/close-interserver-connection-unathenticated
Close interserver connection on any exception before authentication
2023-11-23 23:49:17 +01:00
Alexey Milovidov
10d5ba57e8
Merge pull request #57124 from azat/build/split-HashedDictionary-CU
Split HashedDictionary CU
2023-11-23 23:14:47 +01:00
Alexey Milovidov
f138ddbdfa
Merge pull request #57102 from ClickHouse/vdimir/analyzer_to_ast_crash
Fix FunctionNode::toASTImpl
2023-11-23 23:12:30 +01:00
Alexey Milovidov
d72bc854d1
Merge pull request #57074 from ClickHouse/less-allocation-in-arenas
Avoid excessive allocation in Arena
2023-11-23 23:02:26 +01:00
Igor Nikonov
0434044a7e
Merge pull request #57054 from ClickHouse/pr-cleanup-narrow-dependency
Parallel replicas: cleanup, narrow dependency
2023-11-23 20:12:37 +01:00
Robert Schulze
e392fcab5b
Allow global and individual disabling of settings
- 'query_plan_enable_optimizations' is now a global kill switch for all
  plan-level optimizations

- even if it is true, individual optimizations can still be disabled
  individually via their respective settings
2023-11-23 18:46:48 +00:00
Robert Schulze
194e676c70
Put all query plan settings under their own settings 2023-11-23 18:45:08 +00:00
Robert Schulze
4b764b8bc9
Cosmetics 2023-11-23 18:43:10 +00:00
Robert Schulze
77d48e4d55
"optimise" --> "optimize". Sorry, friends from the UK. 2023-11-23 18:41:35 +00:00
Robert Schulze
674159857e
Merge pull request #57144 from rschu1ze/disable-reorder-functions-after-sorting
Allow to disable reorder-functions-after-sorting optimization
2023-11-23 19:38:31 +01:00
Robert Schulze
aee3c9651b
Fix ubsan bug 2023-11-23 18:35:54 +00:00
Nikolay Degterinsky
644e671e81
Merge pull request #57083 from evillique/better-metadata-path
Better metadata path
2023-11-23 19:27:55 +01:00
Sergei Trifonov
9436ae6d7d
Merge pull request #56771 from ClickHouse/dashboards-table
Load queries for dashboard page from new `system.dashboards` table
2023-11-23 19:07:52 +01:00
Alexey Milovidov
8e8fcb159a Merge branch 'master' of github.com:ClickHouse/ClickHouse into less-allocation-in-arenas 2023-11-23 19:03:19 +01:00
Alexey Milovidov
b62e9d3a1a Address review comments 2023-11-23 18:13:12 +01:00
Alexey Milovidov
87fc2a1348
Merge pull request #57107 from evillique/gix-gorilla-overflow-issue
Fix buffer overflow in Gorilla codec
2023-11-23 17:23:33 +01:00
Nikolay Degterinsky
cf717bdb62 Fix segfault after ALTER UPDATE with Nullable MATERIALIZED column 2023-11-23 14:51:36 +00:00
Aleksei Filatov
1a03f5f7f4 Merge remote-tracking branch 'upstream/master' into add_cancellation_point_for_moving_background_operation 2023-11-23 16:43:33 +03:00
Vitaly Baranov
2eca762c39
Merge pull request #57134 from vitlibar/check-dictionary-source-type-on-creation
Check dictionary source type on creation
2023-11-23 14:24:42 +01:00
Robert Schulze
4f10ad3f3c
Allow to disable reorder-functions-after-sorting optimization 2023-11-23 13:16:03 +00:00
Igor Nikonov
def4a62365 Remove DBMS_CONNECTION_POOL_WITH_FAILOVER_DEFAULT_MAX_TRIES 2023-11-23 12:22:44 +00:00
Kruglov Pavel
4ff15a01ec
Merge pull request #57104 from ClickHouse/Avogar-patch-2
Cancel PipelineExecutor properly in case of exception in spawnThreads
2023-11-23 13:22:09 +01:00
Antonio Andelic
c43b84c68d
Typo 2023-11-23 13:12:16 +01:00
vdimir
db4aa19f90
Fix FunctionNode::toASTImpl 2023-11-23 12:08:41 +00:00
Antonio Andelic
953a8d774a Close interserver connection on exception that happened before first authentication 2023-11-23 11:43:03 +00:00
serxa
663c8cd944 Merge branch 'master' into dashboards-table 2023-11-23 10:29:48 +00:00
vdimir
bbc577646f
Merge pull request #57123 from ClickHouse/vdimir/fix_logical_error_analyzer_or_optimize
Analyzer: Fix logical error in LogicalExpressionOptimizerVisitor
2023-11-23 11:24:28 +01:00
Vitaly Baranov
e0c9661115 Check dictionary source type on creation even if "dictionaries_lazy_load" is enabled. 2023-11-23 01:45:08 +01:00
Andrej Hoos
f447c5418d
Optimize query uniqueness check in ProcessList - move after cancelled_cv.wait 2023-11-23 00:21:56 +01:00
Alexander Tokmakov
a0ce9f46cf fix 2023-11-22 23:15:20 +01:00
Alexey Milovidov
2ba2f48051 Merge branch 'master' of github.com:ClickHouse/ClickHouse into less-allocation-in-arenas 2023-11-22 22:11:59 +01:00
Alexey Milovidov
96410cee6a Fix error 2023-11-22 22:09:24 +01:00
avogar
70f45c11bd Fix 2023-11-22 19:56:42 +00:00
Alexander Tokmakov
ef3e558a65 fix no such key for empty parts 2023-11-22 20:51:10 +01:00
Alexander Tokmakov
d9eb68ba35 fix unexpected outdated parts 2023-11-22 20:29:57 +01:00
Alexander Tokmakov
9f1a9826af fix replace/move partition 2023-11-22 20:04:14 +01:00
Alexander Tokmakov
86f7732c24
Update StorageReplicatedMergeTree.cpp 2023-11-22 19:41:27 +01:00
avogar
031f030102 Remove unused method 2023-11-22 18:27:32 +00:00
Kruglov Pavel
b84e3cf683
Merge branch 'master' into size-virtual-column 2023-11-22 19:25:00 +01:00
avogar
4a86f4a7b9 Fix style changes 2023-11-22 18:24:34 +00:00
avogar
007353a2dd Add _size virtual column to s3/file/hdfs/url/azureBlobStorage engines 2023-11-22 18:12:36 +00:00
Azat Khuzhin
cf3cd099a5 Split HashedDictionary CU
Before HashedDictionary.cpp exceeds 50MiB, now:

    -rw-r--r-- 1 azat azat  37M Nov 22 17:56 SparseHashedDictionary.cpp.o
    -rw-r--r-- 1 azat azat  34M Nov 22 17:56 HashedDictionary.cpp.o
    -rw-r--r-- 1 azat azat 716K Nov 22 17:56 registerHashedDictionary.cpp.o

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-11-22 19:00:40 +01:00
Julia Kartseva
753b22f64c
Merge pull request #56171 from ClibMouse/dev-seriesPeriodDetect
Implemented series period detect method using pocketfft lib
2023-11-22 09:49:58 -08:00
Alexander Tokmakov
d277bfb225 setActualPartName for executeReplaceRange 2023-11-22 18:48:25 +01:00
Nikolai Kochetov
1919ec723d Cancel executor in ~CreatingSetsTransform 2023-11-22 17:31:29 +00:00
Nikolay Degterinsky
761b55ccf4 Make overflow not possible 2023-11-22 16:37:30 +00:00
vdimir
7fb4a90d0b
Analyzer: Fix logical error in LogicalExpressionOptimizerVisitor 2023-11-22 16:34:31 +00:00
Alexey Milovidov
662c653eec
Merge pull request #57034 from jrdi/fix-bloom-filter-fpr
Avoid returning biggest resolution when fpr > 0.283
2023-11-22 17:28:51 +01:00
Alexey Milovidov
21d3ebcf35 Disable checksums for builds with fuzzer 2023-11-22 17:19:59 +01:00
vdimir
ffbe85d3a0
Merge pull request #56668 from ClickHouse/vdimir/analyzer_s3_partition_pruning
Analyzer: filtering by virtual columns for StorageS3
2023-11-22 16:44:44 +01:00
Nikolay Degterinsky
a6b659cf04 Fix buffer overflow in Gorilla codec 2023-11-22 15:21:27 +00:00
Nikolay Degterinsky
09496715b0 Add a check for empty metadata path 2023-11-22 15:04:54 +00:00
Duc Canh Le
44a3dc1cd8 add new method to check if two types are exactly identical
Signed-off-by: Duc Canh Le <duccanh.le@ahrefs.com>
2023-11-22 15:02:34 +00:00
Dmitry Novik
7539928814
Merge pull request #56079 from ZhiguoZh/20231027-combine-filter-avx512
Optimize DB::combineFilters with AVX512_VBMI2 intrinsic
2023-11-22 15:42:33 +01:00
Robert Schulze
f184d69115
Remove equivalent_integer typedef 2023-11-22 14:26:46 +00:00
Andrej Hoos
9b549fd4fc
Optimize query uniqueness check in ProcessList 2023-11-22 15:26:44 +01:00
Kruglov Pavel
e1904cbdf1
Cancel PipelineExecutor properly in case of exception in spawnThreads 2023-11-22 14:43:52 +01:00
Kruglov Pavel
9fb1acc947
Merge pull request #56810 from Avogar/iceberg-metadata-files
Iceberg metadata files
2023-11-22 14:40:04 +01:00
Alexey Milovidov
3463d9af7d
Merge pull request #57048 from ClickHouse/vdimir/pmj_crash_57016
Fix Nullptr dereference in partial merge join with joined_subquery_re…
2023-11-22 13:44:19 +01:00
János Benjamin Antal
ab935e3dd7 Use the google proto files when importing protobuf schemas 2023-11-22 12:39:41 +00:00
Alexey Milovidov
d0653f244b
Merge pull request #57062 from ClickHouse/add-comment-to-transformPipeline
Better comment for ITransformingStep::transformPipeline
2023-11-22 13:37:11 +01:00
Alexey Milovidov
54410f16c6
Merge pull request #57063 from ClickHouse/fix-duplicate-storage-set-analyzer
Fix `Duplicate set` for StorageSet with analyzer.
2023-11-22 13:36:44 +01:00
Kruglov Pavel
96a3cefff6
Merge pull request #56118 from edef1c/large-arrow-list
Support reading arrow::LargeListArray
2023-11-22 13:28:46 +01:00
Alexey Milovidov
77fc95ab67 Minor changes 2023-11-22 12:13:47 +01:00
Alexey Milovidov
9cf7ebeced Minor changes 2023-11-22 12:13:47 +01:00
Alexey Milovidov
dd54c7e224 Fix error 2023-11-22 12:13:47 +01:00
Alexey Milovidov
84f669c113 Fix error 2023-11-22 12:13:47 +01:00
Alexey Milovidov
aa41bc49bf Faster build time 2023-11-22 12:13:47 +01:00
Alexey Milovidov
bba3e2a189 Faster build time 2023-11-22 12:13:47 +01:00
Alexey Milovidov
c72b256c63 Fix error 2023-11-22 12:13:47 +01:00
Alexey Milovidov
a3c4c84c87 Fix error 2023-11-22 12:13:47 +01:00
Alexey Milovidov
d25b556223 Avoid excessive allocation in Arena 2023-11-22 12:13:47 +01:00
Alexey Milovidov
d1015aae8e
Merge pull request #57073 from ClickHouse/implement-bit-hamming-distance-for-big-integers
Implement `bitHammingDistance` for big integers
2023-11-22 11:56:33 +01:00
Kseniia Sumarokova
2880e6437e
Merge pull request #56936 from jrdi/fs-cache-hit-profile-events
Add CachedReadBufferReadFromCache{Hits,Misses} profile events
2023-11-22 11:26:00 +01:00
Igor Nikonov
7c0198a26c Fix clang-tidy warning 2023-11-22 09:48:18 +00:00
Raúl Marín
e92044cec0
Merge pull request #57052 from Algunenano/fix_race_remotesource
Fix race condition in RemoteSource
2023-11-22 09:23:57 +01:00
Raúl Marín
a1bb31525a
Merge pull request #57029 from ClickHouse/fix_DatabaseFilesystem_path_validation
Fix file path validation for DatabaseFileSystem
2023-11-22 09:19:19 +01:00
Antonio Andelic
b18cb1e5cd
Merge pull request #57047 from ClickHouse/keeper-small-fixes
Small Keeper fixes
2023-11-22 08:47:58 +01:00
Antonio Andelic
8c88dbe5aa
Merge pull request #57033 from ClickHouse/fix-fuzzbits
Fix `fuzzBits` with `ARRAY JOIN`
2023-11-22 08:46:28 +01:00
Jordi Villar
3fcc6031a5 Fix unit test 2023-11-22 08:33:41 +01:00
Jordi Villar
80d21e2ccd Adding a unit test 2023-11-22 08:33:41 +01:00
Jordi Villar
0a14b39aed Avoid returning bigger resolution when fpr > 0.283 2023-11-22 08:33:41 +01:00
Nikolay Degterinsky
58b51a7f23 Better metadata path 2023-11-22 05:37:51 +00:00
Alexey Milovidov
5cb55d3f8c Fix style 2023-11-22 01:24:58 +01:00
Alexey Milovidov
de5556b458 Add a test 2023-11-22 00:29:43 +01:00
Alexey Milovidov
8ed04c7645 Merge branch 'master' into implement-bit-hamming-distance-for-big-integers 2023-11-22 00:10:11 +01:00
Ilya Golshtein
c2816ec589 merge_row_policy: make clang-tidy happy 2023-11-21 22:06:18 +00:00
Dmitry Novik
1e0b4f979c
Add extra test 2023-11-21 22:55:55 +01:00
Kseniia Sumarokova
e4f66b8469
Merge pull request #55158 from kssenii/fs-cache-improvement
fs cache improvement for big reads
2023-11-21 21:50:00 +01:00
Kseniia Sumarokova
04aa0b10fc
Merge pull request #56990 from ClickHouse/s3queue-fix-incorrect-ref-count-from-exception-in-ctor
S3Queue: fix metadata reference increment
2023-11-21 21:37:23 +01:00
Alexey Milovidov
fd8714ac29 Implement bitHammingDistance for big integers 2023-11-21 18:38:00 +01:00
Alexander Tokmakov
990e3ea1c8 Merge branch 'master' into rmt_check_shutdown_flags_in_retry_loops 2023-11-21 18:01:16 +01:00
vdimir
a139ae97eb
Merge pull request #52918 from ClickHouse/vdimir/s3_blob_log
Add system table with blob storage operations log
2023-11-21 17:40:42 +01:00
Igor Nikonov
63a1625b77 Merge remote-tracking branch 'origin/master' into pr-cleanup-narrow-dependency 2023-11-21 16:05:48 +00:00
Igor Nikonov
ce98dfb251 Settings pointer to reference 2023-11-21 16:04:54 +00:00
Nikolai Kochetov
c85d739486 Fix Duplicate set for StorageSet with analyzer. 2023-11-21 15:57:53 +00:00
Nikolai Kochetov
b1ec8a3670 Better comment for ITransformingStep::transformPipeline 2023-11-21 15:35:09 +00:00
SmitaRKulkarni
e0ceb5d6a5
Merge pull request #56004 from ClickHouse/Fix_parameterized_view_explain_ast
Bug fix explain ast with parameterized view
2023-11-21 16:02:28 +01:00
Bhavna Jindal
eb35e61aea added validateFunctionArgumentTypes 2023-11-21 06:52:48 -08:00
Bhavna Jindal
4767859ba5 added validateFunctionArgumentTypes 2023-11-21 06:52:48 -08:00
Bhavna Jindal
f0d9037e74 Added embeded function documentation 2023-11-21 06:52:48 -08:00
Bhavna Jindal
64292f36f5 fixed getReturnTypeImpl to accept only array argument 2023-11-21 06:52:48 -08:00
Bhavna Jindal
464cdc4a91 fixed getReturnTypeImpl to accept only array argument 2023-11-21 06:52:48 -08:00
Bhavna Jindal
0843d5e890 added macro to enable/disable pocketfft lib 2023-11-21 06:52:47 -08:00
Bhavna Jindal
90df67a6b1 fix header file issue and added edge case handling 2023-11-21 06:52:47 -08:00
Bhavna Jindal
2c1cf7ed43 fix header file issue and added edge case handling 2023-11-21 06:52:47 -08:00
Bhavna Jindal
56a7fe6c86 fix header file issue and added edge case handling 2023-11-21 06:52:47 -08:00
Bhavna Jindal
ad99cb902f changed method name, updated pocketfft repo reference 2023-11-21 06:52:47 -08:00
Bhavna Jindal
62d69946eb Added testcases, documentation and addressed comments 2023-11-21 06:52:47 -08:00
Bhavna Jindal
3fa104ec11 format file 2023-11-21 06:52:47 -08:00
Bhavna Jindal
c4c12509ee removed commented code and fixed a bug 2023-11-21 06:52:47 -08:00
Bhavna Jindal
2235adcae5 Implemented series periods detect method using pocketfft lib 2023-11-21 06:52:47 -08:00
Igor Nikonov
66f6a6575f Cleanup iteration: settings usage 2023-11-21 13:29:04 +00:00
vdimir
8f34b36293
Merge pull request #56538 from ClickHouse/vdimir/join_on_nullsafe_optimization
Rewrite equality with is null check in JOIN ON section
2023-11-21 14:17:58 +01:00
Antonio Andelic
90bb796d63 Small Keeper fixes 2023-11-21 13:11:33 +00:00
Raúl Marín
47abb9e879 Fix race condition in RemoteSource 2023-11-21 14:07:14 +01:00
凌涛
6052cfc990
Modified spelling 2023-11-21 20:34:11 +08:00
vdimir
ee4d5d758f
Fix Nullptr dereference in partial merge join with joined_subquery_requires_alias = 0 2023-11-21 12:15:12 +00:00
Igor Nikonov
83c6ac4f6c Remove storage as parameter dependency, only columns are needed 2023-11-21 12:14:12 +00:00
Antonio Andelic
2ae32d3383
Update src/Functions/getClientHTTPHeader.cpp 2023-11-21 13:12:44 +01:00
Alexander Gololobov
8cf93fe133
Merge pull request #56905 from ClickHouse/disk_encrypted_create_dirs
Allow delegate disk to handle retries for createDirectories
2023-11-21 12:51:05 +01:00
凌涛
e86aa433c5
Merge branch 'master' into feature/getHTTPHeader 2023-11-21 19:48:47 +08:00
凌涛
5e581a9fa4 optimize code 2023-11-21 19:47:39 +08:00
alesapin
227bb30d02
Merge pull request #56986 from kevinmingtarja/implicit-constraint-collapsing-merged-tree
Add implicit constraint for CollapsingMergeTree sign column
2023-11-21 12:43:51 +01:00
Robert Schulze
6851c1dbbc
Suppress bs clang-tidy warning 2023-11-21 11:15:19 +00:00
Robert Schulze
c5828cf856
Merge pull request #57000 from slvrtrn/concat-single-arg
Allow to use `concat` function with a single argument
2023-11-21 12:06:29 +01:00
kssenii
474f1ae0b6 Better 2023-11-21 11:42:23 +01:00
Raúl Marín
e34fea5495
Merge pull request #56984 from ClickHouse/fix_sqlite_file_path_validation
Fix sqlite file path validation
2023-11-21 11:40:20 +01:00
Aleksandr Musorin
ee0ae17ce2 Added optimize_trivial_approximate_count_query documentatiosn for RocksDB 2023-11-21 11:31:56 +01:00
Kseniia Sumarokova
d384762123
Merge branch 'master' into fs-cache-improvement 2023-11-21 11:24:52 +01:00
Salvatore Mesoraca
f96cd4cfb8
Update src/Storages/NamedCollectionsHelpers.cpp
Co-authored-by: Nikolay Degterinsky <43110995+evillique@users.noreply.github.com>
2023-11-21 11:14:48 +01:00
Kseniia Sumarokova
958030758a
Merge pull request #56999 from ClickHouse/s3queue-fix-empty-key-check
S3Queue minor fix
2023-11-21 11:11:08 +01:00
Antonio Andelic
f996dac75d Fix fuzzBits 2023-11-21 09:43:27 +00:00
Jordi Villar
6bd20abb90 Add CachedReadBufferReadFromCache{Hits,Misses} profile events 2023-11-21 10:34:12 +01:00
Salvatore Mesoraca
970e34f32e
NamedCollections: make exception message more informative.
Fix test 00002_log_and_exception_messages_formatting
2023-11-21 10:21:28 +01:00
vdimir
15234474d7
Implement system table blob_storage_log 2023-11-21 09:18:25 +00:00
santrancisco
f4d936fc55
Fix style 2023-11-21 17:39:12 +11:00
santrancisco
3eef0601e3
Fix file path validation for DatabaseFileSystem 2023-11-21 16:29:40 +11:00
凌涛
c5f16725ec add function getClientHTTPHeader 2023-11-21 11:12:01 +08:00
Alexey Milovidov
fdc8b0ceb1
Merge pull request #56956 from evillique/local-send-fatal-log
Send fatal logs by default in clickhouse-local
2023-11-20 23:08:13 +01:00
Alexey Milovidov
0de18bfa6f
Merge pull request #56972 from Michicosun/fix_select_query_options_pass
Something InterpreterSelectQueryAnalyzer::getSampleBlock
2023-11-20 22:46:19 +01:00
Sema Checherinda
485f1834d8
Merge pull request #56938 from CheSema/lz4-buffering
Lz4 compression: buffer block in a rare case
2023-11-20 20:33:30 +01:00
Kseniia Sumarokova
2beee5d9cb
Merge branch 'master' into s3queue-fix-empty-key-check 2023-11-20 20:17:47 +01:00
vdimir
31a6c7c1c4
Style changes around filterKeysForPartitionPruning 2023-11-20 18:08:45 +00:00
vdimir
95e9a27417
Remove ast based code from filterKeysForPartitionPruning 2023-11-20 17:59:58 +00:00