Commit Graph

14475 Commits

Author SHA1 Message Date
slvrtrn
e49ddbb678 Merge remote-tracking branch 'origin' into tableau-online-information-schema 2023-09-21 14:25:04 +02:00
Igor Nikonov
d260b7abe4
Merge pull request #54519 from ClickHouse/parallel-replicas-not-enough-replicas
Disable parallel replicas on shards with not enough nodes
2023-09-21 14:07:25 +02:00
Robert Schulze
44b7fa1030
Merge remote-tracking branch 'rschu1ze/master' into is_deterministic 2023-09-21 09:29:44 +00:00
Robert Schulze
c2a593baf9
Split tests 2023-09-21 09:17:38 +00:00
Vitaly Baranov
bf4662aca7
Merge pull request #53336 from azat/backups/s3-throttling
Fix throttling of BACKUPs from/to S3 (in case native copy was not used) and in some other places as well
2023-09-21 10:42:28 +02:00
zvonand
a05bb020d4 do all the same for HDFS + remove setting 2023-09-21 01:50:41 +02:00
pufit
4a2f7976f0 Resolve PR issues 2023-09-20 19:43:02 -04:00
zvonand
5f67788c03 update docs and comments 2023-09-21 00:16:17 +02:00
zvonand
9eccb12183 small refactor of storageFile globs 2023-09-20 23:59:10 +02:00
Robert Schulze
e95f9ee814
Merge remote-tracking branch 'rschu1ze/master' into is_deterministic 2023-09-20 21:17:57 +00:00
Alexander Tokmakov
f8062d77e1 fix rare data loss 2023-09-20 22:38:25 +02:00
Alexander Tokmakov
ec80068611 add a test for no such key 2023-09-20 22:37:24 +02:00
Alexander Tokmakov
18acc0c19d
Merge pull request #54641 from ClickHouse/followup_54550
Follow-up to #54550
2023-09-20 19:44:56 +02:00
pufit
20105958a8 add reserve 2023-09-20 13:37:06 -04:00
pufit
71c7e3c81e Add logging, fix thread name length 2023-09-20 13:33:25 -04:00
Azat Khuzhin
c706101891 Fix throttling of BACKUPs from/to S3 (in case native copy was not used)
In some cases native copy is not possible, and such requests should be
throttled.

v0: copyS3FileNativeWithFallback
v2: revert v0 and pass write_settings
v3: pass read_settings to copyFile()
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-09-20 18:28:43 +02:00
avogar
3e08800cb5 Forbid special columns for file/s3/url/... storages, fix insert into ephemeral columns from files 2023-09-20 16:25:55 +00:00
avogar
54cee196bd Move obsolete format settings to separate section 2023-09-20 16:00:28 +00:00
Robert Schulze
2c91e52da1
Merge pull request #54600 from rschu1ze/fix-annoy-crash
Annoy/Usearch index: Fix LOGICAL_ERROR during build-up with default values
2023-09-20 17:05:16 +02:00
pufit
729c8aa29f fix glob iterator estimated objects 2023-09-20 10:41:47 -04:00
kssenii
5d66189d87 Fix 2023-09-20 16:39:24 +02:00
kssenii
3ef2c37b92 Add some logging to StorageRabbitMQ 2023-09-20 15:54:11 +02:00
pufit
a1c98bc8c9 fix build 2023-09-20 09:50:35 -04:00
Igor Nikonov
2d446fc1ca Merge remote-tracking branch 'origin/master' into parallel-replicas-not-enough-replicas 2023-09-20 13:40:08 +00:00
slvrtrn
fb0ba86489 Merge remote-tracking branch 'origin' into tableau-online-information-schema 2023-09-20 15:14:40 +02:00
Azat Khuzhin
9c3fb64106 Check type of the filter expressions while filtering by virtual columns
This should fix filtering by virtual columns with non-uint8 types, i.e.
queries like:

    SELECT * FROM data WHERE 1.0

Fixes: 02346_full_text_search
Fixes: 00990_hasToken_and_tokenbf
v2: move check out from is_const to filterBlockWithQuery(), since in is_const there is no way to validate sets.
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-09-20 13:36:25 +02:00
flynn
dfa95ecc2e Merge branch 'master' of github.com:ClickHouse/ClickHouse into comment 2023-09-20 11:16:33 +00:00
Nikolai Kochetov
0bc41bab74
Merge pull request #54544 from kitaisreal/key-condition-in-function-different-types
KeyCondition IN function support different types
2023-09-20 12:54:01 +02:00
alesapin
2ff36b6e0c
Merge pull request #54768 from ClickHouse/better_exception_in_check_data_part
Better exception message in checkDataPart
2023-09-20 12:04:46 +02:00
Robert Schulze
f3bf8388b6
Incorporate feedback 2023-09-20 10:00:00 +00:00
SmitaRKulkarni
d8adf05de2
Added a new column _block_number (#47532)
Added a new virtual column _block_number which is persisted on merges when allow_experimental_block_number_column is enabled
2023-09-20 11:31:12 +02:00
Azat Khuzhin
d9a634eb0f Fix filtering parts with indexHint for non analyzer
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
(cherry picked from commit ffa82e9297)
2023-09-20 11:29:35 +02:00
pufit
34aecc0bf3 Adjusting num_streams by expected work in StorageS3 2023-09-19 23:05:48 -04:00
slvrtrn
636fc506aa Replace information_schema view columns aliases with uppercase 2023-09-19 23:42:40 +02:00
Igor Nikonov
e28f4e819c
Merge branch 'master' into parallel-replicas-not-enough-replicas 2023-09-19 23:05:24 +02:00
Azat Khuzhin
c439c4bca2
Revert "Fix filtering parts with indexHint for non analyzer" 2023-09-19 21:39:21 +02:00
Han Fei
eb86c113e5
Merge pull request #54184 from priera/fix_mv_insertion_when_duplicated_parts
Inserting only non-duplicate chunks in MV
2023-09-19 20:41:45 +02:00
Kruglov Pavel
d555fdffa5
Merge pull request #54449 from azat/parts-prune-indexHint
Fix filtering parts with indexHint for non analyzer
2023-09-19 19:15:41 +02:00
slvrtrn
e4e9727572 Update information_schema docs 2023-09-19 14:14:17 +02:00
alesapin
9dcc41cf83 Fxi 2023-09-19 13:47:32 +02:00
alesapin
28b71163b4 Merge branch 'master' into better_exception_in_check_data_part 2023-09-19 13:45:56 +02:00
alesapin
7b1cf9d912 Revert "Better check for exceptions in checkData of non replicated merge tree"
This reverts commit 363ee7cae5.
2023-09-19 13:45:34 +02:00
alesapin
363ee7cae5 Better check for exceptions in checkData of non replicated merge tree 2023-09-19 13:41:55 +02:00
priera
b92e37d2df Fixing PR comments 2023-09-19 12:15:01 +02:00
priera
94d737264c inserting non-duplicate chunks 2023-09-19 12:15:00 +02:00
serxa
311db94640 default max_burst equals to max_speed as in Throttler 2023-09-19 10:10:21 +00:00
Maksim Kita
c7ddbab9bc Updated implementation 2023-09-19 13:06:19 +03:00
flynn
c3d12ce0e1 update comment 2023-09-19 08:18:37 +00:00
Anton Popov
72f2bfd166 fix build 2023-09-19 05:35:57 +00:00
Anton Popov
624782bd8f Merge remote-tracking branch 'upstream/master' into HEAD 2023-09-18 23:13:20 +00:00
Anton Popov
d94c1b1ec9 add check for collisions in filenames 2023-09-18 22:27:04 +00:00
slvrtrn
d91a656dd4 Revert schemata.sql format 2023-09-18 22:33:16 +02:00
slvrtrn
ad7b707658 Update information_schema.tables sql and docs 2023-09-18 22:30:27 +02:00
Robert Schulze
097217628e
Merge remote-tracking branch 'rschu1ze/master' into is_deterministic 2023-09-18 20:17:17 +00:00
slvrtrn
9a0d07c682 Update information_schema docs 2023-09-18 22:14:53 +02:00
slvrtrn
54f902f0b7 Adjust information_schema for Tableau Online 2023-09-18 19:50:05 +02:00
Sema Checherinda
e7550523c8
Merge pull request #54651 from CheSema/limit_backoff_timeout
limit the delay before next try in S3
2023-09-18 19:41:26 +02:00
Robert Schulze
4373ed0f98
Added field "is_deterministic" to system.functions 2023-09-18 17:27:53 +00:00
Alexander Sapin
326eaa9bc5 Better exception message in checkDataPart 2023-09-18 18:26:53 +02:00
Igor Nikonov
047d214436 Merge remote-tracking branch 'origin/master' into parallel-replicas-not-enough-replicas 2023-09-18 15:29:56 +00:00
Alexey Milovidov
e4d47539ab
Merge pull request #54477 from azat/view-sampling
Support SAMPLE BY for VIEW
2023-09-18 14:00:52 +03:00
Kruglov Pavel
9c888ea42b
Merge pull request #53549 from Avogar/group-by-constant-keys
Optimize group by constant keys
2023-09-18 12:12:40 +02:00
Yakov Olkhovskiy
711876dfa8
Merge pull request #54696 from ClickHouse/fix-match-keycondition
Fix: avoid using regex match, possibly containing alternation, as a key condition.
2023-09-17 22:45:13 -04:00
Robert Schulze
de4f22e20a
Typo 2023-09-17 15:27:30 +00:00
Robert Schulze
9f009cccd5
Incorporate review feedback 2023-09-17 15:22:51 +00:00
Robert Schulze
f5e8028bb1
Merge pull request #54642 from rschu1ze/broken-re2st
Remove broken lockless variant of re2
2023-09-17 15:30:57 +02:00
robot-clickhouse-ci-1
a878d104d7
Merge pull request #52839 from zvonand/zvonand-globs-small-fix
Fix directory permissions for multi-directory globs. Follow-up #50559
2023-09-16 20:52:30 +02:00
robot-ch-test-poll1
a2ed5c2cae
Merge pull request #54174 from ClickHouse/vdimir/fix_hostname_const
Fix hostname and co result constness in new analyzer
2023-09-16 19:37:08 +02:00
robot-ch-test-poll4
5fb8e46967
Merge pull request #54635 from Avogar/cluster-func-names-with-spaces
Fix schema inference for *Cluster functions for column names with spaces
2023-09-15 20:36:33 +02:00
Yakov Olkhovskiy
f52e87f474 fix 2023-09-15 18:30:26 +00:00
Yakov Olkhovskiy
c2d46286e7 we can't process regex with alternation here - bypass 2023-09-15 18:21:38 +00:00
Bhavna Jindal
dc99de3c44 Log engine Mark file to read and write in little Endian for s390x compatibility 2023-09-15 08:59:40 -07:00
Maksim Kita
29e4352c17 Updated implementation 2023-09-15 17:04:24 +03:00
Maksim Kita
7a7697059c Fixed tests 2023-09-15 17:04:24 +03:00
Maksim Kita
32cad222bf KeyCondition IN function support different types 2023-09-15 17:04:24 +03:00
Kruglov Pavel
2075f9c667
Merge branch 'master' into group-by-constant-keys 2023-09-15 15:10:08 +02:00
Andrey Zvonov
ffbed02f14
Merge branch 'ClickHouse:master' into zvonand-globs-small-fix 2023-09-15 14:18:07 +03:00
avogar
e647346b36 Better 2023-09-15 11:11:04 +00:00
Kruglov Pavel
1bc29696be
Merge pull request #54576 from HarryLeeIBM/hlee-s390x-rand-gen
Fix UInt256 and IPv4 random data generation on s390x
2023-09-15 11:42:47 +02:00
Robert Schulze
945179be46
Annoy: Fix LOGICAL_ERROR with default values #52258 2023-09-14 19:23:32 +00:00
Robert Schulze
c422a8f0dc
Cosmetics 2023-09-14 18:05:20 +00:00
Robert Schulze
f0eadd4b22
Merge pull request #54103 from ClickHouse/ustweaks
Small usearch index improvements: metrics and configurable internal data type
2023-09-14 19:58:53 +02:00
Sema Checherinda
d9e15c00c9 limit the delay before next try in S3 2023-09-14 19:45:07 +02:00
vdimir
1aa18e0eb6
Analyzer: Remove constants from header in StorageDistributed 2023-09-14 16:44:18 +00:00
Robert Schulze
7b378dbad3
Remove broken lockless variant of re2 2023-09-14 16:40:42 +00:00
Alexander Tokmakov
52de64c2bd remove unneeded code 2023-09-14 18:30:12 +02:00
Mikhail f. Shiryaev
bf962a8674
Merge pull request #54517 from HarryLeeIBM/hlee-s390x-jemalloc-bins
Fix endian issue in jemalloc_bins for s390x
2023-09-14 15:43:50 +02:00
avogar
f240243c86 Fix schema inference for *Cluster functions for column names with spaces 2023-09-14 13:34:11 +00:00
Michael Kolupaev
8997464867
Small usearch index improvements: metrics and f16 2023-09-14 11:24:47 +00:00
serxa
09d4bf6930 add IO scheduling node for bandwidth throttling 2023-09-14 08:51:47 +00:00
Andrey Zvonov
ff16ddbbb3
Merge branch 'ClickHouse:master' into zvonand-globs-small-fix 2023-09-14 11:31:49 +03:00
robot-clickhouse-ci-2
e111d4abd3
Merge pull request #54610 from CurtizJ/fix-after-refactoring
Fix reading of virtual columns in reverse order
2023-09-14 03:38:27 +02:00
Anton Popov
df2d1ed638 fix reading of virtual columns in reverse order 2023-09-13 21:09:49 +00:00
Tim Windelschmidt
7979090333 use env to find bash 2023-09-13 18:57:11 +02:00
Robert Schulze
59cded9d84
Merge pull request #54563 from rschu1ze/issue-54541
Fix AST fuzzer crash in MergeTreeIndex{FullText|Inverted}
2023-09-13 16:29:06 +02:00
Alexander Tokmakov
a365557d9e
Merge pull request #54550 from ClickHouse/fix_zero_copy_garbage
Fix zero copy garbage
2023-09-13 15:02:05 +02:00
HarryLeeIBM
735039673a Fix UInt256 and IPv4 random data generation on s390x 2023-09-13 04:55:02 -07:00
alesapin
e8055ba509
Merge pull request #54549 from ClickHouse/fix_redundant_checksums_doesnt_match_error
Fix rare case of CHECKSUM_DOESNT_MATCH error
2023-09-13 13:02:50 +02:00
Robert Schulze
8c7a256632
Fix full text index fix 2023-09-13 07:57:48 +00:00
Robert Schulze
e69c1c2f9a
Fix inverted index fix 2023-09-13 07:56:35 +00:00