thevar1able/ClickHouse
1
0
Fork 0
mirror of https://github.com/ClickHouse/ClickHouse.git synced 2024-12-17 03:42:48 +00:00
Code Issues Packages Projects Releases Wiki Activity
125,683 Commits 9,315 Branches 1,783 Tags 2.1 GiB
978a535849
Commit Graph

14530 Commits

Author SHA1 Message Date
slvrtrn
2b8a263355 Change referential_constraints to an empty table 2023-09-21 16:11:08 +02:00
pufit
bd387f6d2c
Merge pull request #54815 from ClickHouse/pufit/optimal-num-streams-for-s3-storage 
Adjusting `num_streams` by expected work in StorageS3
 2023-09-21 08:41:39 -04:00
slvrtrn
e49ddbb678 Merge remote-tracking branch 'origin' into tableau-online-information-schema 2023-09-21 14:25:04 +02:00
Igor Nikonov
d260b7abe4
Merge pull request #54519 from ClickHouse/parallel-replicas-not-enough-replicas 
Disable parallel replicas on shards with not enough nodes
 2023-09-21 14:07:25 +02:00
Robert Schulze
44b7fa1030
Merge remote-tracking branch 'rschu1ze/master' into is_deterministic 2023-09-21 09:29:44 +00:00
Robert Schulze
c2a593baf9
Split tests 2023-09-21 09:17:38 +00:00
Vitaly Baranov
bf4662aca7
Merge pull request #53336 from azat/backups/s3-throttling 
Fix throttling of BACKUPs from/to S3 (in case native copy was not used) and in some other places as well
 2023-09-21 10:42:28 +02:00
zvonand
a05bb020d4 do all the same for HDFS + remove setting 2023-09-21 01:50:41 +02:00
pufit
4a2f7976f0 Resolve PR issues 2023-09-20 19:43:02 -04:00
zvonand
5f67788c03 update docs and comments 2023-09-21 00:16:17 +02:00
zvonand
9eccb12183 small refactor of storageFile globs 2023-09-20 23:59:10 +02:00
Robert Schulze
e95f9ee814
Merge remote-tracking branch 'rschu1ze/master' into is_deterministic 2023-09-20 21:17:57 +00:00
Alexander Tokmakov
f8062d77e1 fix rare data loss 2023-09-20 22:38:25 +02:00
Alexander Tokmakov
ec80068611 add a test for no such key 2023-09-20 22:37:24 +02:00
Alexander Tokmakov
18acc0c19d
Merge pull request #54641 from ClickHouse/followup_54550 
Follow-up to #54550
 2023-09-20 19:44:56 +02:00
pufit
20105958a8 add reserve 2023-09-20 13:37:06 -04:00
pufit
71c7e3c81e Add logging, fix thread name length 2023-09-20 13:33:25 -04:00
Azat Khuzhin
c706101891 Fix throttling of BACKUPs from/to S3 (in case native copy was not used) 
In some cases native copy is not possible, and such requests should be
throttled.

v0: copyS3FileNativeWithFallback
v2: revert v0 and pass write_settings
v3: pass read_settings to copyFile()
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-09-20 18:28:43 +02:00
avogar
3e08800cb5 Forbid special columns for file/s3/url/... storages, fix insert into ephemeral columns from files 2023-09-20 16:25:55 +00:00
avogar
54cee196bd Move obsolete format settings to separate section 2023-09-20 16:00:28 +00:00
Robert Schulze
2c91e52da1
Merge pull request #54600 from rschu1ze/fix-annoy-crash 
Annoy/Usearch index: Fix LOGICAL_ERROR during build-up with default values
 2023-09-20 17:05:16 +02:00
pufit
729c8aa29f fix glob iterator estimated objects 2023-09-20 10:41:47 -04:00
kssenii
5d66189d87 Fix 2023-09-20 16:39:24 +02:00
kssenii
3ef2c37b92 Add some logging to StorageRabbitMQ 2023-09-20 15:54:11 +02:00
pufit
a1c98bc8c9 fix build 2023-09-20 09:50:35 -04:00
Igor Nikonov
2d446fc1ca Merge remote-tracking branch 'origin/master' into parallel-replicas-not-enough-replicas 2023-09-20 13:40:08 +00:00
slvrtrn
fb0ba86489 Merge remote-tracking branch 'origin' into tableau-online-information-schema 2023-09-20 15:14:40 +02:00
Robert Schulze
a4eeed50b6
Mark obsolete settings in system.merge_tree_settings as is_obsolete = 1 2023-09-20 12:55:53 +00:00
Azat Khuzhin
9c3fb64106 Check type of the filter expressions while filtering by virtual columns 
This should fix filtering by virtual columns with non-uint8 types, i.e.
queries like:

    SELECT * FROM data WHERE 1.0

Fixes: 02346_full_text_search
Fixes: 00990_hasToken_and_tokenbf
v2: move check out from is_const to filterBlockWithQuery(), since in is_const there is no way to validate sets.
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-09-20 13:36:25 +02:00
flynn
dfa95ecc2e Merge branch 'master' of github.com:ClickHouse/ClickHouse into comment 2023-09-20 11:16:33 +00:00
Nikolai Kochetov
0bc41bab74
Merge pull request #54544 from kitaisreal/key-condition-in-function-different-types 
KeyCondition IN function support different types
 2023-09-20 12:54:01 +02:00
alesapin
2ff36b6e0c
Merge pull request #54768 from ClickHouse/better_exception_in_check_data_part 
Better exception message in checkDataPart
 2023-09-20 12:04:46 +02:00
Robert Schulze
f3bf8388b6
Incorporate feedback 2023-09-20 10:00:00 +00:00
SmitaRKulkarni
d8adf05de2
Added a new column _block_number (#47532) 
Added a new virtual column _block_number which is persisted on merges when allow_experimental_block_number_column is enabled
 2023-09-20 11:31:12 +02:00
Azat Khuzhin
d9a634eb0f Fix filtering parts with indexHint for non analyzer 
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
(cherry picked from commit ffa82e9297)
 2023-09-20 11:29:35 +02:00
pufit
34aecc0bf3 Adjusting num_streams by expected work in StorageS3 2023-09-19 23:05:48 -04:00
slvrtrn
636fc506aa Replace information_schema view columns aliases with uppercase 2023-09-19 23:42:40 +02:00
Igor Nikonov
e28f4e819c
Merge branch 'master' into parallel-replicas-not-enough-replicas 2023-09-19 23:05:24 +02:00
Azat Khuzhin
c439c4bca2
Revert "Fix filtering parts with indexHint for non analyzer" 2023-09-19 21:39:21 +02:00
Han Fei
eb86c113e5
Merge pull request #54184 from priera/fix_mv_insertion_when_duplicated_parts 
Inserting only non-duplicate chunks in MV
 2023-09-19 20:41:45 +02:00
Kruglov Pavel
d555fdffa5
Merge pull request #54449 from azat/parts-prune-indexHint 
Fix filtering parts with indexHint for non analyzer
 2023-09-19 19:15:41 +02:00
slvrtrn
e4e9727572 Update information_schema docs 2023-09-19 14:14:17 +02:00
alesapin
9dcc41cf83 Fxi 2023-09-19 13:47:32 +02:00
alesapin
28b71163b4 Merge branch 'master' into better_exception_in_check_data_part 2023-09-19 13:45:56 +02:00
alesapin
7b1cf9d912 Revert "Better check for exceptions in checkData of non replicated merge tree" 
This reverts commit 363ee7cae5.
 2023-09-19 13:45:34 +02:00
alesapin
363ee7cae5 Better check for exceptions in checkData of non replicated merge tree 2023-09-19 13:41:55 +02:00
priera
b92e37d2df Fixing PR comments 2023-09-19 12:15:01 +02:00
priera
94d737264c inserting non-duplicate chunks 2023-09-19 12:15:00 +02:00
serxa
311db94640 default max_burst equals to max_speed as in Throttler 2023-09-19 10:10:21 +00:00
Maksim Kita
c7ddbab9bc Updated implementation 2023-09-19 13:06:19 +03:00
flynn
c3d12ce0e1 update comment 2023-09-19 08:18:37 +00:00
Anton Popov
72f2bfd166 fix build 2023-09-19 05:35:57 +00:00
VanDarkholme7
783b48b730
Merge branch 'ClickHouse:master' into missing_subcolumns 2023-09-19 10:33:06 +08:00
Anton Popov
624782bd8f Merge remote-tracking branch 'upstream/master' into HEAD 2023-09-18 23:13:20 +00:00
Anton Popov
d94c1b1ec9 add check for collisions in filenames 2023-09-18 22:27:04 +00:00
slvrtrn
d91a656dd4 Revert schemata.sql format 2023-09-18 22:33:16 +02:00
slvrtrn
ad7b707658 Update information_schema.tables sql and docs 2023-09-18 22:30:27 +02:00
Robert Schulze
097217628e
Merge remote-tracking branch 'rschu1ze/master' into is_deterministic 2023-09-18 20:17:17 +00:00
slvrtrn
9a0d07c682 Update information_schema docs 2023-09-18 22:14:53 +02:00
slvrtrn
54f902f0b7 Adjust information_schema for Tableau Online 2023-09-18 19:50:05 +02:00
Sema Checherinda
e7550523c8
Merge pull request #54651 from CheSema/limit_backoff_timeout 
limit the delay before next try in S3
 2023-09-18 19:41:26 +02:00
Robert Schulze
4373ed0f98
Added field "is_deterministic" to system.functions 2023-09-18 17:27:53 +00:00
Alexander Sapin
326eaa9bc5 Better exception message in checkDataPart 2023-09-18 18:26:53 +02:00
Igor Nikonov
047d214436 Merge remote-tracking branch 'origin/master' into parallel-replicas-not-enough-replicas 2023-09-18 15:29:56 +00:00
Alexey Milovidov
e4d47539ab
Merge pull request #54477 from azat/view-sampling 
Support SAMPLE BY for VIEW
 2023-09-18 14:00:52 +03:00
Kruglov Pavel
9c888ea42b
Merge pull request #53549 from Avogar/group-by-constant-keys 
Optimize group by constant keys
 2023-09-18 12:12:40 +02:00
Yakov Olkhovskiy
711876dfa8
Merge pull request #54696 from ClickHouse/fix-match-keycondition 
Fix: avoid using regex match, possibly containing alternation, as a key condition.
 2023-09-17 22:45:13 -04:00
Robert Schulze
de4f22e20a
Typo 2023-09-17 15:27:30 +00:00
Robert Schulze
9f009cccd5
Incorporate review feedback 2023-09-17 15:22:51 +00:00
Robert Schulze
f5e8028bb1
Merge pull request #54642 from rschu1ze/broken-re2st 
Remove broken lockless variant of re2
 2023-09-17 15:30:57 +02:00
robot-clickhouse-ci-1
a878d104d7
Merge pull request #52839 from zvonand/zvonand-globs-small-fix 
Fix directory permissions for multi-directory globs. Follow-up #50559
 2023-09-16 20:52:30 +02:00
robot-ch-test-poll1
a2ed5c2cae
Merge pull request #54174 from ClickHouse/vdimir/fix_hostname_const 
Fix hostname and co result constness in new analyzer
 2023-09-16 19:37:08 +02:00
VanDarkholme7
cf8c614fed Fix bug on DELETE and UPDATE with json subcolumns 2023-09-16 13:04:19 +00:00
robot-ch-test-poll4
5fb8e46967
Merge pull request #54635 from Avogar/cluster-func-names-with-spaces 
Fix schema inference for *Cluster functions for column names with spaces
 2023-09-15 20:36:33 +02:00
Yakov Olkhovskiy
f52e87f474 fix 2023-09-15 18:30:26 +00:00
Yakov Olkhovskiy
c2d46286e7 we can't process regex with alternation here - bypass 2023-09-15 18:21:38 +00:00
Bhavna Jindal
dc99de3c44 Log engine Mark file to read and write in little Endian for s390x compatibility 2023-09-15 08:59:40 -07:00
Maksim Kita
29e4352c17 Updated implementation 2023-09-15 17:04:24 +03:00
Maksim Kita
7a7697059c Fixed tests 2023-09-15 17:04:24 +03:00
Maksim Kita
32cad222bf KeyCondition IN function support different types 2023-09-15 17:04:24 +03:00
Kruglov Pavel
2075f9c667
Merge branch 'master' into group-by-constant-keys 2023-09-15 15:10:08 +02:00
Andrey Zvonov
ffbed02f14
Merge branch 'ClickHouse:master' into zvonand-globs-small-fix 2023-09-15 14:18:07 +03:00
avogar
e647346b36 Better 2023-09-15 11:11:04 +00:00
Kruglov Pavel
1bc29696be
Merge pull request #54576 from HarryLeeIBM/hlee-s390x-rand-gen 
Fix UInt256 and IPv4 random data generation on s390x
 2023-09-15 11:42:47 +02:00
Robert Schulze
945179be46
Annoy: Fix LOGICAL_ERROR with default values #52258 2023-09-14 19:23:32 +00:00
Robert Schulze
c422a8f0dc
Cosmetics 2023-09-14 18:05:20 +00:00
Robert Schulze
f0eadd4b22
Merge pull request #54103 from ClickHouse/ustweaks 
Small usearch index improvements: metrics and configurable internal data type
 2023-09-14 19:58:53 +02:00
Sema Checherinda
d9e15c00c9 limit the delay before next try in S3 2023-09-14 19:45:07 +02:00
vdimir
1aa18e0eb6
Analyzer: Remove constants from header in StorageDistributed 2023-09-14 16:44:18 +00:00
Robert Schulze
7b378dbad3
Remove broken lockless variant of re2 2023-09-14 16:40:42 +00:00
Alexander Tokmakov
52de64c2bd remove unneeded code 2023-09-14 18:30:12 +02:00
Mikhail f. Shiryaev
bf962a8674
Merge pull request #54517 from HarryLeeIBM/hlee-s390x-jemalloc-bins 
Fix endian issue in jemalloc_bins for s390x
 2023-09-14 15:43:50 +02:00
avogar
f240243c86 Fix schema inference for *Cluster functions for column names with spaces 2023-09-14 13:34:11 +00:00
Michael Kolupaev
8997464867
Small usearch index improvements: metrics and f16 2023-09-14 11:24:47 +00:00
serxa
09d4bf6930 add IO scheduling node for bandwidth throttling 2023-09-14 08:51:47 +00:00
Andrey Zvonov
ff16ddbbb3
Merge branch 'ClickHouse:master' into zvonand-globs-small-fix 2023-09-14 11:31:49 +03:00
robot-clickhouse-ci-2
e111d4abd3
Merge pull request #54610 from CurtizJ/fix-after-refactoring 
Fix reading of virtual columns in reverse order
 2023-09-14 03:38:27 +02:00
Anton Popov
df2d1ed638 fix reading of virtual columns in reverse order 2023-09-13 21:09:49 +00:00
Tim Windelschmidt
7979090333 use env to find bash 2023-09-13 18:57:11 +02:00
Robert Schulze
59cded9d84
Merge pull request #54563 from rschu1ze/issue-54541 
Fix AST fuzzer crash in MergeTreeIndex{FullText|Inverted}
 2023-09-13 16:29:06 +02:00
Alexander Tokmakov
a365557d9e
Merge pull request #54550 from ClickHouse/fix_zero_copy_garbage 
Fix zero copy garbage
 2023-09-13 15:02:05 +02:00
HarryLeeIBM
735039673a Fix UInt256 and IPv4 random data generation on s390x 2023-09-13 04:55:02 -07:00
alesapin
e8055ba509
Merge pull request #54549 from ClickHouse/fix_redundant_checksums_doesnt_match_error 
Fix rare case of CHECKSUM_DOESNT_MATCH error
 2023-09-13 13:02:50 +02:00
Robert Schulze
8c7a256632
Fix full text index fix 2023-09-13 07:57:48 +00:00
Robert Schulze
e69c1c2f9a
Fix inverted index fix 2023-09-13 07:56:35 +00:00
Robert Schulze
28068f11e1
Fix #54541 2023-09-12 21:23:23 +00:00
alesapin
18ab92eb4f Fix style 2023-09-12 21:57:46 +02:00
alesapin
e17a824fec Fxi 2023-09-12 21:42:32 +02:00
alesapin
6ec65d6be7 Make function slightly more readable 2023-09-12 21:41:05 +02:00
Alexander Tokmakov
46fae52c29 fix zero copy garbage 2023-09-12 20:01:46 +02:00
alesapin
f3729da64b Fix rare case of CHECKSUM_DOESNT_MATCH error 2023-09-12 19:55:56 +02:00
Igor Nikonov
7b3f32b95a
Merge pull request #54520 from ClickHouse/pr-cleanup 
Parallel replicas: cleanup unused params
 2023-09-12 19:48:18 +02:00
robot-clickhouse
1c8ee76ba2
Merge pull request #54513 from Avogar/formats-with-names-no-header 
Fix possible parsing error in WithNames formats with disabled input_format_with_names_use_header
 2023-09-12 17:58:03 +02:00
Anton Popov
38e0689b3b
Merge pull request #54512 from CurtizJ/fix-use-after-free 
Fix use-after-free in `MergeTreePrefetchedReadPool`
 2023-09-12 16:51:12 +02:00
Dmitry Novik
7edc0a30a3
Merge pull request #54335 from arenadata/ADQM-1109 
Added peak_threads_usage to query_log table
 2023-09-12 16:03:27 +02:00
Dmitry Novik
f730a003ea
Merge pull request #54467 from ClickHouse/drop-lost-part-log 
Add a log message on replicated table drop
 2023-09-12 15:59:18 +02:00
Igor Nikonov
1287f68745 Handle clusterAllReplicas/remote cases to avoid unnecessary logging 2023-09-12 12:52:29 +00:00
Igor Nikonov
3acc26001a Merge remote-tracking branch 'origin/master' into pr-cleanup 2023-09-12 10:38:06 +00:00
Alexey Milovidov
e9daff6c2f
Merge pull request #54506 from azat/system.detached_parts-modification_time 
Add modification_time into system.detached_parts
 2023-09-12 04:53:59 +03:00
Alexey Milovidov
44a9dbd2b7
Update StorageSystemDetachedParts.cpp 2023-09-12 04:53:51 +03:00
Sema Checherinda
0ea0799118
Merge pull request #54430 from CheSema/remove-recursive-with-projection 
reproduce and fix the bug in removeSharedRecursive
 2023-09-12 00:18:55 +02:00
Igor Nikonov
d5ea047ab8 Parallel replicas: cleanup unused params 2023-09-11 21:52:40 +00:00
HarryLeeIBM
26b17f88d5 Add comment for the fix 2023-09-11 13:52:58 -07:00
HarryLeeIBM
0a81389359 Fix endian issue in jemalloc_bins for s390x 2023-09-11 12:14:01 -07:00
Azat Khuzhin
8cd6153c83 Add modification_time into system.detached_parts 
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-09-11 20:29:55 +02:00
Dmitry Novik
b12d1219f2 Merge remote-tracking branch 'origin/master' into drop-lost-part-log 2023-09-11 17:05:05 +00:00
Dmitry Novik
b69a90d61f Change log message level 2023-09-11 14:57:25 +00:00
avogar
2d8f33bfa2 Fix parsing error in WithNames formats while reading subset of columns with disabled input_format_with_names_use_header 2023-09-11 14:55:37 +00:00
Anton Popov
ec37e93461 fix use-after-free in MergeTreePrefetchedReadPool 2023-09-11 14:55:21 +00:00
Sergei Trifonov
08bad4d440
Merge pull request #47009 from ClickHouse/disks-and-io-sheduler 2023-09-11 07:22:14 +02:00
robot-ch-test-poll
6f3374d684
Merge pull request #54481 from ucasfl/hints 
Refactor IHints
 2023-09-10 15:46:36 +02:00
Azat Khuzhin
5535c7462d Support SAMPLE BY for VIEW 
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-09-10 08:24:46 +02:00
flynn
6ec783a746 Refactor IHints 2023-09-10 03:48:12 +00:00
Igor Nikonov
d5ffff93a7
Merge pull request #54468 from ClickHouse/distributed-cleanup-select-info 
Cleanup: unnecessary SelectQueryInfo usage around distributed
 2023-09-09 21:47:36 +02:00
Sema Checherinda
1298dba0c6 fix the bug, add useful logs 2023-09-09 15:54:28 +02:00
Igor Nikonov
2fdc700da2 Style 2023-09-09 13:33:18 +00:00
Igor Nikonov
a12a375a1d Style check 2023-09-09 12:51:34 +00:00
Igor Nikonov
fff2a2d81c Fix style 2023-09-09 08:29:33 +00:00
Igor Nikonov
5470a5b60f Fix style 2023-09-09 06:58:18 +00:00
Mingliang Pan
4d05b57c21
Merge branch 'ClickHouse:master' into master 2023-09-09 11:12:45 +08:00
Igor Nikonov
7a396139df Cleanup: unnecessary SelectQueryInfo usage around distributed 2023-09-08 21:53:38 +00:00
Dmitry Novik
da69a9fda0 Add a log message on replicated table drop 2023-09-08 21:41:42 +00:00
Azat Khuzhin
ffa82e9297 Fix filtering parts with indexHint for non analyzer 
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-09-08 18:17:06 +02:00
Andrey Zvonov
ff4586e663
Merge branch 'ClickHouse:master' into zvonand-globs-small-fix 2023-09-08 18:17:06 +02:00
Anton Popov
1aa34c16e3 Merge remote-tracking branch 'upstream/master' into HEAD 2023-09-08 14:00:45 +00:00
Anton Popov
67b27643ed fix creash in case of exception in prefetched pool 2023-09-07 16:56:13 +00:00
Petr Vasilev
d0884d3267 Merge branch 'master' of https://github.com/vahpetr/ClickHouse into fix-nats-high-cpu-usage 2023-09-07 18:48:01 +03:00
Petr Vasilev
cb969aa54a Remove empty line 2023-09-07 18:47:31 +03:00
Petr Vasilev
4ef241445f Remove received_mutex and received_cv 2023-09-07 18:44:18 +03:00
Antonio Andelic
fae0e13baa Properly remove added interserver endpoint 2023-09-07 14:34:36 +00:00