Commit Graph

49930 Commits

Author SHA1 Message Date
Raúl Marín
0754ee4901 Fix embarrasing bug number 1 2023-11-27 23:12:17 +01:00
Raúl Marín
80cc1b3a17 Remove addBatchSinglePlaceFromInterval 2023-11-27 23:12:17 +01:00
Antonio Andelic
544f6081eb
Merge pull request #57259 from ClickHouse/ignore-column-comments
Ignore comments when comparing column descriptions
2023-11-27 20:43:39 +01:00
Raúl Marín
9bd54be6e0
Merge pull request #57190 from Algunenano/remove_optimize_move_functions_out_of_any
Remove optimize_move_functions_out_of_any optimization
2023-11-27 19:31:38 +01:00
Antonio Andelic
1242834256 Merge branch 'master' into ignore-memory-exception-asio 2023-11-27 15:21:56 +00:00
Antonio Andelic
9077550bb1 Better Readonly metric 2023-11-27 14:25:45 +00:00
lgbo
b38469ddf8
Optimization for getting value from map, arrayElement(2/2) (#55957) 2023-11-27 15:11:56 +01:00
Antonio Andelic
9707796869 Ignore comments when comparing column descriptions 2023-11-27 12:25:41 +00:00
Robert Schulze
4c236b34f0
Another small cleanup 2023-11-27 11:09:07 +00:00
vdimir
bbc202a891
Merge pull request #56816 from AVMusorin/improve-settings-rocksdb
Show total_bytes and total_rows in system tables for RocksDB storage
2023-11-27 11:42:15 +01:00
Antonio Andelic
3941520cb0 Avoid memory exceptions in asio workers 2023-11-27 10:08:06 +00:00
Kruglov Pavel
b10e46b2bc
Merge pull request #57126 from Avogar/size-virtual-column
Add _size virtual column to s3/file/hdfs/url/azureBlobStorage engines
2023-11-27 10:12:18 +01:00
Robert Schulze
a8671049e1
Various smaller fixups 2023-11-27 08:49:54 +00:00
Antonio Andelic
4c2de5219d
Merge pull request #57196 from amosbird/fix-57194
Fix incorrect JOIN plan optimization with partially materialized normal projection
2023-11-27 09:15:13 +01:00
flynn
aa15a4e46d Merge branch 'master' of github.com:ClickHouse/ClickHouse into alias_column_in_indices 2023-11-27 03:52:00 +00:00
flynn
f995ac87c5 review fix 2023-11-27 03:50:34 +00:00
taiyang-li
f33f231725 fix failed ut 2023-11-27 10:48:01 +08:00
Azat Khuzhin
315906b380 Add ability to parse hours/months without leading zeros
Recently I was looking into one dataset, that has such format.

So I've changed the meaning of the following formatters for
formatDateTime()/parseDateTime(), like in other implementations [1]:

- %l/%k - to handle hours without leading zeros
- %c - handle months without leading zeros

  [1]: https://www.php.net/strftime

And since this is kind of behaviour change (even though it is unlikely
will break something), there is a new setting to control this new
behaviour:
- parsedatetime_enable_format_without_leading_zeros=1 (default ON)
- formatdatetime_enable_format_without_leading_zeros=0 (default OFF, since this could change users output)

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-11-26 19:10:17 +01:00
Alexey Milovidov
a9bb76378f
Merge pull request #56724 from canhld94/ch_replicated_column_mismatch
Do not allow tables on different replicas have different aggregate functions in SimpleAggregateFunction column
2023-11-26 17:20:10 +01:00
Alexey Milovidov
1cc33f3430
Merge pull request #56164 from azat/not-byte-identical-message
Add more details to "Data after merge is not byte-identical to data on another replicas"
2023-11-26 04:14:15 +01:00
Alexey Milovidov
f8ebe5134d
Merge pull request #55836 from azat/dist/limit-by-fix
RFC: Fix "Cannot find column X in source stream" for Distributed queries with LIMIT BY
2023-11-26 04:03:41 +01:00
Alexey Milovidov
304d6375be
Merge pull request #56225 from azat/rocksdb-compact
Allow manual compaction of rocksdb via OPTIMIZE query
2023-11-26 03:59:54 +01:00
Alexey Milovidov
fde14f0daf
Merge pull request #57191 from azat/client-log_comment-file
[RFC] Set log_comment to the file name while processing files in client
2023-11-26 03:44:40 +01:00
Alexey Milovidov
f636dea879
Merge pull request #54327 from den-crane/background_fetches_pool_size
increase background_fetches_pool_size to 16, background_schedule_pool_size to 512
2023-11-26 02:50:38 +01:00
Alexey Milovidov
9fa112af9a
Merge pull request #53721 from takakawa/possible_wrong_type_conversion_bugfix
[bugfix] possible postgresql logical replication error: wrong type conversion
2023-11-26 02:48:24 +01:00
Alexey Milovidov
d29092f8af
Merge pull request #54909 from canhld94/revert-54893-revert-54819-ch_net_interfaces
Resubmit: Avoid excessive calls to getifaddrs in isLocalAddress
2023-11-25 23:00:18 +01:00
Alexey Milovidov
92e580997c
Update IDataType.h 2023-11-26 00:57:12 +03:00
Alexey Milovidov
c50f096200
Merge pull request #57227 from azat/client-INS-cursor
Change cursor style for overwrite mode (INS) to blinking in client
2023-11-25 22:53:09 +01:00
Azat Khuzhin
ced0bbd932 Change cursor style for overwrite mode (INS) to blinking in client
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-11-25 22:00:56 +01:00
Robert Schulze
5b7d2a903d
Merge pull request #57152 from rschu1ze/fine-granular-plan-opt-settings
Fine-granular enablement/disabling of plan-level optimizations
2023-11-25 20:44:23 +01:00
flynn
9f174b1c5e Support use alias column in indices 2023-11-25 15:40:22 +00:00
Vitaly Baranov
2e7f314599
Merge pull request #50209 from ilejn/merge_row_policy
Engine Merge obeys row policy
2023-11-25 10:34:22 +01:00
Alexey Milovidov
61c9d304f0
Merge pull request #57125 from ClickHouse/try-fix-57097
Cancel executor in ~CreatingSetsTransform
2023-11-25 03:02:39 +01:00
Alexey Milovidov
8877b7ce78
Merge pull request #57198 from ClickHouse/analyzer-fuzz-6
Analyzer fuzzer 6 (arrayJoin)
2023-11-25 03:00:48 +01:00
Alexey Milovidov
8325d04313
Merge pull request #57201 from myrrc/feature/elide-functional-stacktraces
Do not demangle stack frames from __functional
2023-11-25 02:59:49 +01:00
jsc0218
55e0a825b7
Merge pull request #57106 from BetterStackHQ/ah/uniq-id-check-master
Optimize query uniqueness check in ProcessList
2023-11-24 17:04:25 -05:00
Alexey Milovidov
685ad98652
Merge pull request #57122 from ClickHouse/fuzzer-disable-checksums
Disable checksums for builds with fuzzer
2023-11-24 23:03:04 +01:00
Alexey Milovidov
289df618f4
Merge pull request #57001 from arthurpassos/aws-s3-sign-any-x-amz-header-clean
Sign all aws headers
2023-11-24 21:12:10 +01:00
Nikita Mikhaylov
1b623b0e48 Done 2023-11-24 20:03:02 +00:00
Sema Checherinda
bd36dce81b
Merge pull request #57129 from ClickHouse/fix_something
Fix something in ReplicatedMergeTree
2023-11-24 20:19:25 +01:00
Alexander Tokmakov
deda8483be
Merge pull request #56536 from ClickHouse/move-partition-inactive-replica
Fix race between REPLACE_RANGE and GET_PART (set actual part name when fetching)
2023-11-24 20:09:24 +01:00
Aleksandr Musorin
c3b617bd7b Move class functions upper 2023-11-24 19:00:00 +01:00
Nikolai Kochetov
0eb20620cd Fix type for arrayJoin(LC) 2023-11-24 16:42:59 +00:00
Alexey Milovidov
dfba02542d Merge branch 'master' of github.com:ClickHouse/ClickHouse into fuzzer-disable-checksums 2023-11-24 17:37:49 +01:00
Mike Kot
ed4bd7b4e8 do not demangle stack frames from __functional 2023-11-24 15:16:44 +00:00
Kseniia Sumarokova
13187bf4f1
Merge pull request #56959 from melvynator/master
Add experimental flag for MaterializedPostgreSQL table engine.
2023-11-24 16:16:42 +01:00
Kseniia Sumarokova
c25c6ec403
Merge pull request #57031 from aiven-sal/aiven-sal/fix_namedcoll2
NamedCollections: make exception message more informative.
2023-11-24 16:15:16 +01:00
Amos Bird
472027e948
Fix JOIN plan with normal projection 2023-11-24 21:47:00 +08:00
Azat Khuzhin
740cc3c053 Set log_comment to the file name while processing files in client
This will be useful for fuzzer, to know which file had been processed to
trigger the crash, since right now you need to find unique parts of the
query that had not been added by fuzzer to reproduce.

But I guess this will be useful not only for fuzzing, but for general
introspection as well.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-11-24 14:45:34 +01:00
Raúl Marín
037cbf3bce Merge remote-tracking branch 'blessed/master' into remove_optimize_move_functions_out_of_any 2023-11-24 14:27:44 +01:00
Raúl Marín
d4290ade61 Remove optimize_move_functions_out_of_any optimization 2023-11-24 12:20:46 +01:00
alesapin
a3c2896e9d
Merge pull request #56846 from aalexfvk/add_cancellation_point_for_moving_background_operation
Add cancellation hook for moving background operation
2023-11-24 12:12:47 +01:00
Robert Schulze
8e93ea509d
Merge pull request #57002 from slvrtrn/from-days-all-integer-types
Allow to use any integer types with `fromDaysSinceYearZero` function
2023-11-24 11:28:53 +01:00
taiyang-li
35cf4cd1dd reuse some intermediate results while executing array join 2023-11-24 15:17:39 +08:00
Alexey Milovidov
98cddf5312
Merge pull request #57153 from ClickHouse/better-server-exit-code
Better server exit code
2023-11-23 23:55:28 +01:00
Alexey Milovidov
e7d01cd0fa
Merge pull request #57142 from ClickHouse/close-interserver-connection-unathenticated
Close interserver connection on any exception before authentication
2023-11-23 23:49:17 +01:00
Alexey Milovidov
10d5ba57e8
Merge pull request #57124 from azat/build/split-HashedDictionary-CU
Split HashedDictionary CU
2023-11-23 23:14:47 +01:00
Alexey Milovidov
f138ddbdfa
Merge pull request #57102 from ClickHouse/vdimir/analyzer_to_ast_crash
Fix FunctionNode::toASTImpl
2023-11-23 23:12:30 +01:00
Alexey Milovidov
d72bc854d1
Merge pull request #57074 from ClickHouse/less-allocation-in-arenas
Avoid excessive allocation in Arena
2023-11-23 23:02:26 +01:00
Igor Nikonov
0434044a7e
Merge pull request #57054 from ClickHouse/pr-cleanup-narrow-dependency
Parallel replicas: cleanup, narrow dependency
2023-11-23 20:12:37 +01:00
Robert Schulze
e392fcab5b
Allow global and individual disabling of settings
- 'query_plan_enable_optimizations' is now a global kill switch for all
  plan-level optimizations

- even if it is true, individual optimizations can still be disabled
  individually via their respective settings
2023-11-23 18:46:48 +00:00
Robert Schulze
194e676c70
Put all query plan settings under their own settings 2023-11-23 18:45:08 +00:00
Robert Schulze
4b764b8bc9
Cosmetics 2023-11-23 18:43:10 +00:00
Robert Schulze
77d48e4d55
"optimise" --> "optimize". Sorry, friends from the UK. 2023-11-23 18:41:35 +00:00
Robert Schulze
674159857e
Merge pull request #57144 from rschu1ze/disable-reorder-functions-after-sorting
Allow to disable reorder-functions-after-sorting optimization
2023-11-23 19:38:31 +01:00
Robert Schulze
aee3c9651b
Fix ubsan bug 2023-11-23 18:35:54 +00:00
Nikolay Degterinsky
644e671e81
Merge pull request #57083 from evillique/better-metadata-path
Better metadata path
2023-11-23 19:27:55 +01:00
Sergei Trifonov
9436ae6d7d
Merge pull request #56771 from ClickHouse/dashboards-table
Load queries for dashboard page from new `system.dashboards` table
2023-11-23 19:07:52 +01:00
Alexey Milovidov
8e8fcb159a Merge branch 'master' of github.com:ClickHouse/ClickHouse into less-allocation-in-arenas 2023-11-23 19:03:19 +01:00
Alexey Milovidov
b62e9d3a1a Address review comments 2023-11-23 18:13:12 +01:00
Alexey Milovidov
87fc2a1348
Merge pull request #57107 from evillique/gix-gorilla-overflow-issue
Fix buffer overflow in Gorilla codec
2023-11-23 17:23:33 +01:00
Nikolay Degterinsky
cf717bdb62 Fix segfault after ALTER UPDATE with Nullable MATERIALIZED column 2023-11-23 14:51:36 +00:00
Aleksei Filatov
1a03f5f7f4 Merge remote-tracking branch 'upstream/master' into add_cancellation_point_for_moving_background_operation 2023-11-23 16:43:33 +03:00
Vitaly Baranov
2eca762c39
Merge pull request #57134 from vitlibar/check-dictionary-source-type-on-creation
Check dictionary source type on creation
2023-11-23 14:24:42 +01:00
Robert Schulze
4f10ad3f3c
Allow to disable reorder-functions-after-sorting optimization 2023-11-23 13:16:03 +00:00
Igor Nikonov
def4a62365 Remove DBMS_CONNECTION_POOL_WITH_FAILOVER_DEFAULT_MAX_TRIES 2023-11-23 12:22:44 +00:00
Kruglov Pavel
4ff15a01ec
Merge pull request #57104 from ClickHouse/Avogar-patch-2
Cancel PipelineExecutor properly in case of exception in spawnThreads
2023-11-23 13:22:09 +01:00
Antonio Andelic
c43b84c68d
Typo 2023-11-23 13:12:16 +01:00
vdimir
db4aa19f90
Fix FunctionNode::toASTImpl 2023-11-23 12:08:41 +00:00
Antonio Andelic
953a8d774a Close interserver connection on exception that happened before first authentication 2023-11-23 11:43:03 +00:00
serxa
663c8cd944 Merge branch 'master' into dashboards-table 2023-11-23 10:29:48 +00:00
vdimir
bbc577646f
Merge pull request #57123 from ClickHouse/vdimir/fix_logical_error_analyzer_or_optimize
Analyzer: Fix logical error in LogicalExpressionOptimizerVisitor
2023-11-23 11:24:28 +01:00
Vitaly Baranov
e0c9661115 Check dictionary source type on creation even if "dictionaries_lazy_load" is enabled. 2023-11-23 01:45:08 +01:00
Andrej Hoos
f447c5418d
Optimize query uniqueness check in ProcessList - move after cancelled_cv.wait 2023-11-23 00:21:56 +01:00
Alexander Tokmakov
a0ce9f46cf fix 2023-11-22 23:15:20 +01:00
Alexey Milovidov
2ba2f48051 Merge branch 'master' of github.com:ClickHouse/ClickHouse into less-allocation-in-arenas 2023-11-22 22:11:59 +01:00
Alexey Milovidov
96410cee6a Fix error 2023-11-22 22:09:24 +01:00
avogar
70f45c11bd Fix 2023-11-22 19:56:42 +00:00
Alexander Tokmakov
ef3e558a65 fix no such key for empty parts 2023-11-22 20:51:10 +01:00
Alexander Tokmakov
d9eb68ba35 fix unexpected outdated parts 2023-11-22 20:29:57 +01:00
Alexander Tokmakov
9f1a9826af fix replace/move partition 2023-11-22 20:04:14 +01:00
Alexander Tokmakov
86f7732c24
Update StorageReplicatedMergeTree.cpp 2023-11-22 19:41:27 +01:00
avogar
031f030102 Remove unused method 2023-11-22 18:27:32 +00:00
Kruglov Pavel
b84e3cf683
Merge branch 'master' into size-virtual-column 2023-11-22 19:25:00 +01:00
avogar
4a86f4a7b9 Fix style changes 2023-11-22 18:24:34 +00:00
avogar
007353a2dd Add _size virtual column to s3/file/hdfs/url/azureBlobStorage engines 2023-11-22 18:12:36 +00:00
Azat Khuzhin
cf3cd099a5 Split HashedDictionary CU
Before HashedDictionary.cpp exceeds 50MiB, now:

    -rw-r--r-- 1 azat azat  37M Nov 22 17:56 SparseHashedDictionary.cpp.o
    -rw-r--r-- 1 azat azat  34M Nov 22 17:56 HashedDictionary.cpp.o
    -rw-r--r-- 1 azat azat 716K Nov 22 17:56 registerHashedDictionary.cpp.o

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-11-22 19:00:40 +01:00
Julia Kartseva
753b22f64c
Merge pull request #56171 from ClibMouse/dev-seriesPeriodDetect
Implemented series period detect method using pocketfft lib
2023-11-22 09:49:58 -08:00
Alexander Tokmakov
d277bfb225 setActualPartName for executeReplaceRange 2023-11-22 18:48:25 +01:00
Nikolai Kochetov
1919ec723d Cancel executor in ~CreatingSetsTransform 2023-11-22 17:31:29 +00:00