Commit Graph

32509 Commits

Author SHA1 Message Date
Alexey Milovidov
00f9ae9924 Correct documentation for settings 2022-10-20 04:42:35 +02:00
Alexey Milovidov
fabc8f5a18 Remove support for {database} macro from the client's prompt 2022-10-19 23:27:12 +02:00
Kruglov Pavel
1b27c7ebe0
Merge pull request #42130 from azat/dist/EINTR-fix
Fix possible timeout exception for distributed queries with use_hedged_requests=0
2022-10-19 22:00:38 +02:00
Nikolai Kochetov
d85bfe6ea3
Merge pull request #42322 from ClickHouse/additional-filters-and-distributed
Fix additional_table_filters for Distributed.
2022-10-19 17:09:51 +02:00
Alexey Milovidov
898c935d31
Update GregorianDate.h 2022-10-19 17:36:49 +03:00
Alexey Milovidov
b0dd95447d
Update src/Functions/GregorianDate.h
Co-authored-by: Antonio Andelic <antonio2368@users.noreply.github.com>
2022-10-19 17:36:08 +03:00
Alexander Tokmakov
84ef32e33f Merge branch 'master' into improve_replica_recovery 2022-10-19 16:28:01 +02:00
Alexander Tokmakov
f958c155f3
Merge branch 'master' into fixes_for_replicated_merge_tree2 2022-10-19 17:25:24 +03:00
Roman Vasin
4db28d0bd6 Add toStableRelativeHourNum to gtest_DateLUTImpl.cpp 2022-10-19 14:01:26 +00:00
Robert Schulze
42f680849c
Fix bad_cast in Annoy index
- Problem originally found by data type fuzzer
  https://s3.amazonaws.com/clickhouse-test-reports/42180/2f83d8790581dce0ffeec56c137b1d13160cfa7b/fuzzer_astfuzzermsan//report.html

- This commit restricts which data types are allowed for Annoy indexes
  (similar things are done for other index types).
2022-10-19 13:40:39 +00:00
Roman Vasin
c0f18f29bb Remove toExtendedReplated; Add template argument is_extended_result 2022-10-19 13:23:21 +00:00
Nikolai Kochetov
010cdeb755
Merge pull request #42442 from ClickHouse/revert-revert-27787
Revert "Revert #27787"
2022-10-19 14:38:33 +02:00
Vitaly Baranov
f82dc5ba44
Merge pull request #42333 from vitlibar/backup-to-s3
Implement backup to S3
2022-10-19 13:32:22 +02:00
Nikolay Degterinsky
486780ba80
Merge pull request #42044 from zvonand/zvonand-csv-dates
Fix Date from CSV parsing
2022-10-19 13:10:12 +02:00
Antonio Andelic
98c34159ee Use correct type for UInt128 2022-10-19 08:05:09 +00:00
KinderRiven
ae53ac63c4 fix bypass_cache_threshold 2022-10-19 06:53:44 +00:00
Alexey Milovidov
148275ed64 Fix buffer overflow in Decimal scale 2022-10-19 04:15:26 +02:00
Alexey Milovidov
e5d1a1b293 Add a test 2022-10-19 03:34:16 +02:00
Alexey Milovidov
2e3a111c29 Fix UBSan in Modified Julian Day 2022-10-19 03:26:22 +02:00
Alexey Milovidov
dfa202a15d Merge branch 'master' into fix-race-condition-finish-cancel 2022-10-19 02:35:42 +02:00
Vitaly Baranov
1365105bc4 Implement backup to S3 2022-10-19 00:04:41 +02:00
Alexey Milovidov
46917c023c
Update AlterCommands.cpp 2022-10-19 00:25:21 +03:00
Alexander Tokmakov
1d9d753167 fix 2022-10-18 18:13:18 +02:00
Nikolai Kochetov
216d671cdf
Update AlterCommands.cpp 2022-10-18 17:56:34 +02:00
Alexander Tokmakov
ea77ff9022 Merge branch 'master' into fixes_for_replicated_merge_tree2 2022-10-18 17:25:25 +02:00
KinderRiven
de3728127c fix 2022-10-18 14:52:58 +00:00
Alexey Milovidov
7befe2825c
Update StorageReplicatedMergeTree.cpp 2022-10-18 17:36:11 +03:00
Alexey Milovidov
0623ad4e37
Update StorageReplicatedMergeTree.cpp 2022-10-18 17:35:44 +03:00
Pablo Marcos
fbfa2a9885 Fix exception message to be in sync with code 2022-10-18 16:20:18 +02:00
Pablo Marcos
79231412c9 Fix minor typos in code documentation 2022-10-18 16:20:00 +02:00
zvonand
82c7228e53 fix 2022-10-18 17:03:31 +03:00
Nikolai Kochetov
a5711fda44 Revert "Revert #27787"
This reverts commit c1cc04d44d.
2022-10-18 14:00:50 +00:00
alesapin
9769057767 Deactivate all tasks 2022-10-18 15:53:52 +02:00
alesapin
ab8da5a539 Deactivate mutationsFinalizingTask until startup 2022-10-18 15:50:02 +02:00
Kruglov Pavel
29513f6a1f
Merge pull request #41885 from Avogar/with-names-error-message
Better exception message for duplicate column names in schema inference
2022-10-18 15:26:46 +02:00
Kruglov Pavel
25e13bdd2f
Merge pull request #41107 from Avogar/improve-combinators
Support all combinators combination in WindowTransform/arratReduce*/initializeAggregation/aggregate functions versioning
2022-10-18 15:24:49 +02:00
Kruglov Pavel
8af95a6fc2
Merge pull request #41912 from Avogar/better-datetime-inference
Improve DateTime type inference for text formats
2022-10-18 15:23:59 +02:00
Nikita Mikhaylov
8755f94548
Added aggregate function analysisOfVariance (anova). Merging #37872 (#42131) 2022-10-18 14:57:56 +02:00
Anton Popov
c1e958a7d2
Merge pull request #42413 from CurtizJ/better-types-fuzzer
Replace table name in ast fuzzer more often
2022-10-18 14:54:08 +02:00
Alfred Xu
2ac5540d0e
Fixed a logical error in case of using runningDifference with Date32 type (#42143) 2022-10-18 14:33:31 +02:00
Han Shukai
acf13a7b60
Merge branch 'master' into max_cache_download_limit 2022-10-18 20:28:04 +08:00
Tian Xinhui
45c6974f7d
Use alias for std::shared_ptr<MergeMutateSelectedEntry> (#42211)
* use alias for MergeMutateSelectedEntry share ptr

* fix StorageMergeTree.cpp
2022-10-18 13:35:34 +02:00
Vladimir C
a298a5238b
Merge pull request #42217 from ClickHouse/vdimir/style-check-code-used-in-comment 2022-10-18 13:26:39 +02:00
Vladimir C
76b102024d
Merge pull request #42342 from canhld94/ch_canh_fix_aggregator_lc 2022-10-18 13:01:23 +02:00
Antonio Andelic
540728ab96 Simplify logic a bit 2022-10-18 10:58:25 +00:00
Vladimir C
155b3ad02f
Merge pull request #42407 from ClickHouse/vdimir/join_lc_issue_42380 2022-10-18 12:57:58 +02:00
alesapin
ec356972a7
Merge pull request #42392 from ClickHouse/alesapin-patch-1
Smaller threshold for multipart upload part size increase
2022-10-18 12:52:00 +02:00
alesapin
673adfbd5c
Merge pull request #42317 from ClickHouse/fix_another_trash_with_zero_cop
Fix another trash in zero-copy replication
2022-10-18 12:51:16 +02:00
Antonio Andelic
1275c464aa Fix unit test build 2022-10-18 10:44:22 +00:00
Roman Vasin
d9fcd91875 Add toStableRelativeHourNum 2022-10-18 09:07:12 +00:00
Alexander Gololobov
87d24b8f14
Merge pull request #42409 from CurtizJ/freeze-partition-formatting
Fix formatting of `ALTER FREEZE`
2022-10-18 10:39:44 +02:00
Antonio Andelic
ee2f5977d5
Merge branch 'master' into keeper-upload-snapshot-to-s3 2022-10-18 10:02:50 +02:00
Ilya Yatsishin
36b63badb3
Merge pull request #42223 from qoega/hdfs-empty-url 2022-10-18 09:34:10 +02:00
Amos Bird
6d32149fa6
Correct implementation of agg state comparison 2022-10-18 14:05:06 +08:00
Han Shukai
5f04304278
Merge branch 'master' into max_cache_download_limit 2022-10-18 13:44:52 +08:00
KinderRiven
f94f491679 impl max_cache_download_limit 2022-10-18 05:05:32 +00:00
Vitaly Baranov
eb637a6f81
Merge pull request #42232 from azat/backups/s3
Support BACKUP to S3 with as-is path/data structure
2022-10-18 02:37:07 +02:00
Anton Popov
1a9d190788 replace table name in fuzzer more often 2022-10-17 21:08:27 +00:00
Nikolai Kochetov
f67b5182ea Add test with different databases. 2022-10-17 19:05:15 +00:00
Anton Popov
d8501c7f6a fix formatting of ALTER FREEZE 2022-10-17 18:10:22 +00:00
Alexey Milovidov
e014293fe8 Fix tidy 2022-10-17 19:29:14 +02:00
Alexander Tokmakov
57f6e27300 Merge branch 'master' into improve_replica_recovery 2022-10-17 18:37:31 +02:00
vdimir
597544a15b
Fix assert cast in join on falsy condition 2022-10-17 16:12:00 +00:00
Alexander Tokmakov
fffecbb9ad better error message for unsupported delimiters in custom formats 2022-10-17 18:08:52 +02:00
Alexey Milovidov
830fda0b77
Merge branch 'master' into ch_canh_fix_aggregator_lc 2022-10-17 17:58:28 +02:00
Yakov Olkhovskiy
3ce1fa09d6
Merge pull request #41198 from ClickHouse/composable-protocol
Composable protocol
2022-10-17 11:23:12 -04:00
Antonio Andelic
8157fd0595 fix build 2022-10-17 14:16:56 +00:00
alesapin
db6524bb3b
Smaller thrashold for multipart upload part size increase 2022-10-17 15:44:17 +02:00
Nikolai Kochetov
b8eb02e239 Add a comment. 2022-10-17 12:30:10 +00:00
Duc Canh Le
9af817bb43
Fix read from buffer with read in order (#42236) 2022-10-17 14:25:31 +02:00
Anton Popov
26e8d0a93d
Merge pull request #42345 from CurtizJ/better-async-insert-logging
Better logging for asynchronous inserts
2022-10-17 13:50:38 +02:00
Antonio Andelic
238f86d892 Small refactoring 2022-10-17 11:06:33 +00:00
Antonio Andelic
7c7395575f Merge branch 'master' into keeper-upload-snapshot-to-s3 2022-10-17 11:02:36 +00:00
Ilya Yatsishin
dd0fc2435e Merge remote-tracking branch 'origin/master' into hdfs-empty-url 2022-10-17 12:48:42 +02:00
Nikolai Kochetov
c9aa6a655c
Merge pull request #42319 from ClickHouse/fix-alter-update-wrong-type
Fix an invalid type of a column after attach and alter.
2022-10-17 12:44:16 +02:00
Duc Canh Le
d95fb5ffb3
Merge branch 'master' into ch_canh_fix_aggregator_lc 2022-10-17 18:29:41 +08:00
alesapin
051e3a0db5 Fix if 2022-10-17 12:27:05 +02:00
alesapin
cf6442fa65
Merge pull request #42222 from ClickHouse/disable_concurrent_parts_removal
Disable concurrent parts removal
2022-10-17 12:17:55 +02:00
Antonio Andelic
125501b36a Merge branch 'master' into use-multiread-more 2022-10-17 07:32:30 +00:00
Antonio Andelic
f3c4d0eff2 Fix keeperMap test 2022-10-17 07:29:22 +00:00
Alexey Milovidov
d1f0c80ffe Revert "Merge pull request #40217 from zvonand/zvonand-minmax"
This reverts commit df934d8762, reversing
changes made to d3a7945b1b.
2022-10-17 04:57:15 +02:00
Alexey Milovidov
e93b8d1618 Fix trash 2022-10-17 04:44:58 +02:00
Alexey Milovidov
f88ed8195b Fix trash 2022-10-17 04:21:08 +02:00
Duc Canh Le
40ca01d099
Merge branch 'master' into ch_canh_fix_aggregator_lc 2022-10-17 09:00:13 +08:00
Duc Canh Le
c05429574d add exception 2022-10-17 08:59:39 +08:00
Alexey Milovidov
17d4862336 Fix data race in query finish/cancel 2022-10-17 02:29:54 +02:00
Alexey Milovidov
1113fe4a8d Fix data race in query finish/cancel 2022-10-17 02:27:10 +02:00
Alexey Milovidov
c6b2ee47df Fix data race in query finish/cancel 2022-10-17 02:10:36 +02:00
Alexey Milovidov
191158f93b
Merge pull request #42314 from HarryLeeIBM/hlee-s390x-t64-codec
Fix Codec T64 on s390x
2022-10-17 01:13:57 +02:00
Anton Popov
ec81d61f48 better logging for async insert 2022-10-16 12:45:02 +00:00
Kseniia Sumarokova
3338d76708
Merge pull request #42321 from ClickHouse/filimonov-request_timeout_ms
Increase request_timeout_ms for s3 disks.
2022-10-16 14:03:31 +02:00
Duc Canh Le
5526e05aac remove junk log 2022-10-16 17:19:40 +08:00
Duc Canh Le
2b82205590
Merge branch 'master' into ch_canh_fix_aggregator_lc 2022-10-16 16:59:12 +08:00
Duc Canh Le
9e9e967f1f choose correct aggregation method for lc128 and lc512 2022-10-16 16:57:15 +08:00
Ilya Yatsishin
165785f716 mErge remote-tracking branch 'origin/master' into hdfs-empty-url 2022-10-15 19:13:59 +02:00
Ilya Yatsishin
7fa7e1d822
Merge pull request #38519 from qoega/ast-fuzzer-where 2022-10-15 14:30:40 +02:00
Vitaly Baranov
91c438eebe
Merge pull request #42263 from vitlibar/refactor-udf
Refactor the implementation of user-defined functions
2022-10-15 12:33:10 +02:00
Alexey Milovidov
bfd8811a4d
Update CompressionCodecT64.cpp 2022-10-15 00:32:37 +03:00
Alexey Milovidov
4608b70dda
Update CompressionCodecT64.cpp 2022-10-15 00:31:33 +03:00
Kruglov Pavel
6fc12dd922
Merge pull request #41703 from Avogar/json-object-each-row
Add setting to obtain object name as column value in JSONObjectEachRow format
2022-10-14 20:11:04 +02:00
avogar
52427e6028 Remove code duplication 2022-10-14 18:07:02 +00:00
Kruglov Pavel
b4e327d9e0
Merge pull request #42313 from ClickHouse/Avogar-patch-2
Remove forgotten debug logging
2022-10-14 19:23:06 +02:00
nvartolomei
7d9f097d3b
Fix bad copy & paste when loading background_merges_mutations_concurrency_ratio setting (#42315) 2022-10-14 19:19:14 +02:00
Nikolai Kochetov
b98b1759c8 Fix additional_table_filters for Distributed. 2022-10-14 17:04:42 +00:00
Kruglov Pavel
ff11904850
Merge branch 'master' into improve-combinators 2022-10-14 17:19:31 +02:00
filimonov
cd9afdcb7c
Increase request_timeout_ms for s3 disks. 2022-10-14 17:19:14 +02:00
Nikolai Kochetov
b18c6fd8e6 Fix an invalid type of a column after attach and alter. 2022-10-14 14:52:26 +00:00
alesapin
e0c2518416 Fix another trash in zero-copy replication 2022-10-14 16:50:48 +02:00
HarryLeeIBM
6cdb7b5a94 Fix Codec T64 on s390x 2022-10-14 07:16:18 -07:00
Kruglov Pavel
d43b5bbcd0
Remove forgotten debug logging 2022-10-14 15:47:46 +02:00
Ilya Yatsishin
3361b27965 less 2022-10-14 14:27:52 +02:00
vdimir
ad255206f4
Exclude comments from style-check defined extern 2022-10-14 11:42:18 +00:00
alesapin
fd718c0d00 Merge branch 'master' into disable_concurrent_parts_removal 2022-10-14 13:32:11 +02:00
alesapin
4e1a10fb34 better check 2022-10-14 13:32:08 +02:00
Alexander Tokmakov
9b7edd4f13
Merge pull request #42106 from ClickHouse/fix_loading_dependencies
Fixes for loading dependencies
2022-10-14 14:31:31 +03:00
Azat Khuzhin
8830f0608d Support BACKUP to S3 with as-is path/data structure
Right now backup to S3 does not make a lot of sense, since:
- it has random names, and to decoding them
- requires metadata from local disk (/var/lib/disks/DISK/BACKUP_NAME)
- or send_metadata (but it is also tricky even with it)

So this patch adds simpler interface for S3, it is only suitable for
BACKUP/RESTORE, so don't try to use it for MergeTree engine.

It is done by adding separate disk - `s3_plain` for this, that:
- does not support any extended features, like renames/hardlinks/attrs/...
  (so basically everything that MergeTree requires)
- only write/read/unlink/list files

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-10-14 12:59:25 +02:00
Roman Vasin
040d61e047 Use {} in error message formatting 2022-10-14 08:13:04 +00:00
Alexey Milovidov
018c68b36d
Merge pull request #42198 from ClickHouse/fix-projections
Fix a bug with projections and the `aggregate_functions_null_for_empty` setting
2022-10-14 03:14:19 +02:00
Nikolay Degterinsky
509f0426a9
Merge pull request #42279 from sperlingxx/intv_op_date32
Fix Date Interval add/minus over DataTypeDate32
2022-10-13 23:50:35 +02:00
Vladimir C
cf78c70bdd
Merge pull request #41544 from lhuang09287750/master 2022-10-13 17:47:41 +02:00
Roman Vasin
14ba9fa51d Fix Date32 argument in dispatchConstForSecondColumn 2022-10-13 13:35:14 +00:00
Roman Vasin
4cf2913054 Fix message about allowed argument types 2022-10-13 12:58:22 +00:00
sperlingxx
a901faeb84 Fix add/minus Date Interval over Date32 type
Signed-off-by: sperlingxx <lovedreamf@gmail.com>
2022-10-13 18:00:54 +08:00
Ilya Yatsishin
bbf88b66a0 more 2022-10-13 11:42:35 +02:00
Vitaly Baranov
2e59d671fc Split UserDefinedSQLObjectsLoader to interface and implementation. 2022-10-13 10:32:32 +02:00
Ilya Yatsishin
e7ca30cd11 fix typo 2022-10-13 10:10:13 +02:00
Alexey Milovidov
96332d9159
Merge branch 'master' into fix-projections 2022-10-13 02:23:32 +02:00
Roman Vasin
590ed7b640 Add transforms for other arguments lke year, quarter etc 2022-10-12 15:16:09 +00:00
Vitaly Baranov
9cb2052c7f Consider Poco::Net::HostNotFoundException as ZCONNECTIONLOSS. 2022-10-12 15:52:55 +02:00
Nikolay Degterinsky
87b77094f0
Merge pull request #42187 from FArthur-cmd/add_default_support_for_settings
Add support for keyword DEFAULT in the set query
2022-10-12 15:30:30 +02:00
lhuang09287750
215acf5e5b check the result of conversion for decimal IN float 2022-10-12 15:28:27 +02:00
lhuang09287750
4b0ac268e8 delete an unusable include 2022-10-12 15:28:27 +02:00
lhuang09287750
cab0291873 for checkstyle:use a internal function to get field string ,instead of std::stringstream 2022-10-12 15:28:27 +02:00
lhuang09287750
338f41913c add a function to process floating point literal comparing with decimal type in IN opertor 2022-10-12 15:28:27 +02:00
vdimir
0178307c27 Followup for TemporaryDataOnDisk 2022-10-12 15:25:23 +02:00
xinhuitian
daaf01c344 early return 2022-10-12 12:18:17 +08:00
flynn
312afdc280 remove useless code 2022-10-12 03:48:37 +00:00
Nikolay Degterinsky
896e3c47f7
Merge pull request #42135 from ClibMouse/add-null-pointer-checks
Add null pointer checks
2022-10-12 01:22:55 +02:00
Alexey Milovidov
bbd1196a96
Update MergeTreeData.cpp 2022-10-12 00:57:02 +03:00
FArthur-cmd
b6304c46d4 move default settings to different part of ast 2022-10-11 18:25:28 +00:00
Azat Khuzhin
688edafcc6 Disks/ObjectStorages: add comments for some classes
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-10-11 17:21:26 +02:00
Azat Khuzhin
f3833e3a53 Introduce StaticDirectoryIterator
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-10-11 17:19:35 +02:00
ltrk2
15aa8a88dc Throw an exception in case of inconsistent state 2022-10-11 05:04:47 -07:00
Ilya Yatsishin
3201c08bb5 style 2022-10-11 13:54:03 +02:00
Ilya Yatsishin
28c7a22428 address review comments 2022-10-11 11:59:48 +02:00
Antonio Andelic
5e6a7c1678 Use multiread where possible 2022-10-11 09:27:46 +00:00
Kseniia Sumarokova
3819a21033
Merge pull request #42078 from azat/insert-progress
Fix progress for INSERT SELECT
2022-10-11 10:56:20 +02:00
Alexey Milovidov
56e59dd536
Merge branch 'master' into fix-projections 2022-10-11 02:24:12 +03:00
Alexander Tokmakov
4b371bd20c fix 2022-10-10 16:38:35 +02:00
Alexander Tokmakov
fa1134f299 Merge branch 'master' into fix_loading_dependencies 2022-10-10 16:30:52 +02:00