Yarik Briukhovetskyi
ea1cd66575
fix tidy
2024-08-12 17:32:43 +02:00
Robert Schulze
fb76cb90b1
Allow un-quoted skip index parameters
...
Previously, only this syntax to create a skip index worked:
INDEX index_name column_name TYPE vector_similarity('hnsw', 'L2Distance')
Now, this syntax will work as well:
INDEX index_name column_name TYPE vector_similarity(hnsw, L2Distance)
2024-08-12 15:32:25 +00:00
Robert Schulze
d2e79f0b92
Rework vector index parameters
...
USearch (similar to FAISS) allows to specify the distance function,
quantization, and various HNSW meta-parameters for index creation and
sarch. Some users wished for greater configurability, so let's expose
them.
Index creation now requires either
- 2 parameters (with the other 4 parameters taking on default values), or
- 6 parameters for full control
This commit also remove quantization `f64` (that would be upsampling).
2024-08-12 15:32:19 +00:00
Robert Schulze
cc5c64e1ed
Add migration helper for legacy 'annoy' and 'usearch' indexes types
...
Index types 'annoy' and 'usearch' were removed and replaced by
'vector_similarity' indexes in an earlier commit.
This means unfortuantely, that if customers have tables with these
indexes and upgrade, their database might not start anymore - the
system loads the metadata at startup, thinks something is wrong with
such tables, and halts immediately.
This commit adds support for loading and attaching such indexes back.
Data insert or use (search) return an error which recommends a migration
to 'vector_similarity' indexes. The implementation is generally similar
to what has recently been implemented for 'full_text' indexes [1, 2].
[1] https://github.com/ClickHouse/ClickHouse/pull/64656
[2] https://github.com/ClickHouse/ClickHouse/pull/64846
2024-08-12 15:31:27 +00:00
Robert Schulze
785b6637fa
Rename index type "usearch" to "vector_similarity"
...
First, index type "vector_similarity" is more speaking and user-friendly
than "usearch". Second, we should not expose the name of the library
doing the job (usearch). Of course, the docs will continue to mention
usearch (credit where credit is due).
Existing setting `allow_experimental_usearch_index` was marked obsolete.
A new settings `allow_experimental_vector_similarity_index` was added.
2024-08-12 15:30:45 +00:00
Robert Schulze
021fad920e
Cosmetics: minor stuff
2024-08-12 15:30:41 +00:00
Robert Schulze
2aa037985b
Cosmetics: simplify inheritance hierarchy
2024-08-12 15:30:38 +00:00
Robert Schulze
901906159d
Cosmetics: ApproximateNearestNeighborInformation --> Info + nest in class
2024-08-12 15:30:35 +00:00
Robert Schulze
6170aad43e
Cosmetics: ApproximateNearestNeighborIndexesCommon --> VectorSimilarityCondition
2024-08-12 15:30:30 +00:00
Robert Schulze
e20eff635e
Cosmetics: variable naming
2024-08-12 15:30:27 +00:00
Robert Schulze
1bf320a1a8
Cosmetics: metric --> distance_function (for consistent terminology)
2024-08-12 15:30:24 +00:00
Robert Schulze
3f47b42d71
Remove funny typedef
2024-08-12 15:30:21 +00:00
Robert Schulze
fb26a9e6d4
Cosmetics: whitespaces
2024-08-12 15:30:18 +00:00
Robert Schulze
0f1765a273
Cosmetics: function naming
2024-08-12 15:30:14 +00:00
Robert Schulze
a8167abca2
Cosmetics: use native types/functions
2024-08-12 15:30:10 +00:00
Robert Schulze
9ad890e399
Cosmetics: whitespaces
2024-08-12 15:30:07 +00:00
Robert Schulze
27a6931a35
Cosmetics: variable naming
2024-08-12 15:29:59 +00:00
Robert Schulze
289c27c804
Introduce version for for index files in persistence
2024-08-12 15:29:02 +00:00
Robert Schulze
74de79e52b
Addd logging of basic statistics
2024-08-12 15:28:46 +00:00
Robert Schulze
8853b3359b
Remove useless templatization
...
Makes the code cleaner, compile faster, and the binary smaller.
2024-08-12 15:27:06 +00:00
Robert Schulze
4f23f7754b
Cosmetics
2024-08-12 15:26:05 +00:00
Robert Schulze
7f611681df
Add a similar sanity check as in other skipping indexes
2024-08-12 15:26:01 +00:00
Robert Schulze
f944ef25bb
Better handling of errors during add, search, and save
2024-08-12 15:25:58 +00:00
Robert Schulze
40bed3e20f
Remove support for WHERE-type queries
...
These kind of vector search similarity queries are rather obscure and
rare in practice. They require the user to specify a maximum distance
which is not intuitive to obtain. Furthermore, these queries are not
natively supported in USearch, so the vector search index had to emulate
these queries.
Therefore simplifying the code base and restricting vector search to
ORDER-BY queries only.
2024-08-12 15:25:52 +00:00
Robert Schulze
abb8e61981
Remove support code for Lp norm in vector search
...
It is a generalization of other norms, too expensive to calculate and
not relevant in practice. Also, Usearch doesn't support it.
2024-08-12 15:25:48 +00:00
Robert Schulze
65186f0b69
Remove tuple support
...
Indexes for approximate nearest neighbourhood (ANN) search (USearch) can
be build on columns of type Array(Float32) or Tuple(Float32[, Float32[, ...]]).
In practice, Arrays(Float32) is the only relevant data type.
Arrays store high-dimensional embeddings consecutively (--> cache
locality) and the additional flexibility of different data types in a
tuple is not needed for vector search.
Therefore removing support for ANN indexes over tuple columns to
simplify the code, tests and docs.
2024-08-12 15:25:39 +00:00
Robert Schulze
218421c255
Remove Annoy indexes
...
Annoy indexes fell out of favor in the community, at least when it comes
to vector databases. Such indexes work okay-ish low dimensions but they
suffers badly from a curse of dimensionality which makes them inapt for
a high number of dimensions.
Now that Annoy is gone, issue (*) also disappears and we can drop
'no-ubsan', 'no-cpu-aarch64', and 'no-asan' from tests.
(*) spotify/annoy#456
2024-08-12 15:24:49 +00:00
Robert Schulze
d7211f9d12
Fix CMake integration of usearch and annoy
...
Registers usearch and annoy properly via configure_config.cmake and
config.h.in like all other 3rd party libs, instead of (mis)using
target_compile_definitions.
2024-08-12 15:24:18 +00:00
Robert Schulze
a39b9cf643
Un-screw usearch's build description
...
No directory 'SimSIMD-map' exists, the build only worked because SimSIMD
support in usearch was (accidentally?) disabled. This commit corrects
the build description. SimSIMD support in usearch will be enabled by a
later commit.
2024-08-12 15:24:14 +00:00
divanik
eb3ffb7184
Add supportsReplication
2024-08-12 15:09:16 +00:00
Robert Schulze
85f63b056b
Merge pull request #68135 from ClickHouse/refactor-field-get
...
Only use Field::safeGet - Field::get prone to type punning
2024-08-12 14:25:11 +00:00
Robert Schulze
037a1006fd
Merge remote-tracking branch 'ClickHouse/master' into ci-fuzzer-enable
2024-08-12 12:28:32 +00:00
Nikita Taranov
2f546fb513
Merge pull request #68098 from aiven-sal/aiven-sal/segfault
...
Fix UB in hopEnd, hopStart, tumbleEnd, and tumbleStart
2024-08-12 12:09:23 +00:00
Sema Checherinda
5e836bc20e
Merge pull request #67472 from ClickHouse/chesema-02765
...
speed up system flush logs
2024-08-12 11:51:55 +00:00
Yarik Briukhovetskyi
8bc89ac8df
Merge branch 'master' into hive_style_partitioning
2024-08-12 11:44:45 +02:00
Robert Schulze
0aa30b10d5
Merge pull request #68069 from rschu1ze/cmake-cleanup
...
Minor CMake cleanup
2024-08-12 06:43:00 +00:00
Robert Schulze
574c445be9
Refactor tests for (experimental) statistics
2024-08-12 05:56:16 +00:00
sakulali
957a0b6ea4
Add a setting query_cache_tag
2024-08-12 08:40:01 +08:00
Yakov Olkhovskiy
5c8665c660
fix system.kafka_consumers and doc, fix tidy
2024-08-11 20:40:55 +00:00
Azat Khuzhin
8a48b33344
Fix settings/current_database in system.processes for async BACKUP/RESTORE
...
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-08-11 21:27:08 +02:00
Yakov Olkhovskiy
8e706265e6
fix
2024-08-11 16:29:35 +00:00
Yakov Olkhovskiy
4fec61da55
fix wrong datatype in system.kafka_consumers
2024-08-11 12:35:27 +00:00
Yakov Olkhovskiy
e93584e741
fix Field conversion to IPv4
2024-08-10 23:02:30 +00:00
Igor Nikonov
9ce97e918b
Merge branch 'master' into patch-2
2024-08-11 00:07:46 +02:00
János Benjamin Antal
79a964bfff
Merge remote-tracking branch 'origin/master' into fix-message-queue-sink-from-http-interface
2024-08-10 21:53:57 +00:00
János Benjamin Antal
7aaa038571
Merge pull request #67922 from ClickHouse/fix_trivial_count_non_deterministic_func
...
Fix wrong `count()` result when there is non-deterministic function in predicate
2024-08-10 21:13:12 +00:00
Yakov Olkhovskiy
80e9269963
allow UInt64 <-> Int64 conversion
2024-08-10 19:39:59 +00:00
alesapin
c945209427
Merge pull request #68003 from ClickHouse/ignore_broken_projections_on_start
...
Ignore disappeared projections on start
2024-08-10 19:34:40 +00:00
Anton Popov
a925faf8f9
Merge pull request #68053 from CurtizJ/enable-optimize_functions_to_subcolumns_2
...
Enable setting `optimize_functions_to_subcolumns` by default
2024-08-10 18:32:47 +00:00
Alexey Milovidov
4c4d1e8c65
Merge pull request #67233 from ClickHouse/debug_exec_dict
...
Debug logging for #67002
2024-08-10 17:41:21 +00:00
Yakov Olkhovskiy
0a8fb05ece
fix after merge
2024-08-10 16:23:23 +00:00
Antonio Andelic
3a2be13a93
Merge pull request #67975 from ClickHouse/update-minio-statless
...
Update minio in stateless tests
2024-08-10 16:15:14 +00:00
Antonio Andelic
16e52b547b
Merge pull request #68106 from ClickHouse/fix-with-retries-data-race
...
Fix race in `WithRetries`
2024-08-10 15:43:25 +00:00
Yakov Olkhovskiy
9a45c136b8
merge master
2024-08-10 13:53:32 +00:00
Yakov Olkhovskiy
c1b5b908ba
hide Field::get in private, only use Field::safeGet
2024-08-10 13:01:55 +00:00
李扬
1e9e19bb1c
Merge branch 'ClickHouse:master' into opt_orc_writer
2024-08-10 20:28:31 +08:00
Alexey Milovidov
b4f256ac0b
Merge pull request #68008 from ClickHouse/clickhouse-local-remove-unused-command-line-option
...
Remove unused CLI option
2024-08-10 00:17:12 +00:00
Alexey Milovidov
e6bbbaadaa
Merge pull request #68107 from ClickHouse/avoid-to-string-conversion-for-cast
...
Avoid converting type to string and back in _CAST
2024-08-10 00:08:44 +00:00
Alexey Milovidov
e6e06af7bd
Merge pull request #64281 from bigo-sg/extend_inequal_join
...
`Any/Semi/Anti` join support mixed join conditions
2024-08-09 21:36:31 +00:00
Alexey Milovidov
a79eff9dcf
Merge pull request #67647 from jacobrec/multilinestring
...
Added support for reading MultiLineString WKTs
2024-08-09 21:35:55 +00:00
Sema Checherinda
99b9db9ba7
Merge branch 'master' into chesema-02765
2024-08-09 19:54:44 +02:00
Yarik Briukhovetskyi
701c787eea
Merge branch 'ClickHouse:master' into hive_style_partitioning
2024-08-09 17:53:49 +02:00
Anton Popov
c682e35b59
Merge pull request #68052 from CurtizJ/fix-mutations-analyzer
...
Fix skip of parts in mutation with analyzer
2024-08-09 14:24:31 +00:00
Nikita Taranov
b757522fc4
fix build
2024-08-09 14:20:57 +01:00
János Benjamin Antal
2900c7006e
Merge remote-tracking branch 'origin/master' into fix-message-queue-sink-from-http-interface
2024-08-09 13:06:58 +00:00
Sema Checherinda
96b54df163
fix bugprone-macro-parentheses
2024-08-09 15:04:03 +02:00
Sema Checherinda
1e67b46b57
Merge pull request #67684 from ClickHouse/chesema-rewrite-storage-policy
...
rework usage of custom table's disks
2024-08-09 12:36:29 +00:00
Salvatore Mesoraca
1875e8d9cd
Fix UB in tumbleEnd and tumbleStart
...
This was causing segfaults because of a NULL pointer dereference
2024-08-09 14:06:52 +02:00
Nikita Taranov
3d850f8ceb
fix
2024-08-09 13:58:02 +02:00
Nikolai Kochetov
e8f2f65e62
Avoid converting type to string and back in _CAST
2024-08-09 11:51:23 +00:00
Nikita Taranov
ffa1371dde
Merge branch 'master' into keep_alive_max_reqs
2024-08-09 12:24:45 +01:00
Antonio Andelic
36c0c4562b
Fix race in WithRetries
2024-08-09 13:14:30 +02:00
Anton Popov
7c409c7884
Merge pull request #66084 from morning-color/rows_before_group_by_counter
...
Add rows_before_aggregation_at_least statistic
2024-08-09 10:36:22 +00:00
taiyang-li
dccb6bdd88
fix failed uts
2024-08-09 18:33:05 +08:00
Graham Campbell
2657e2b3ef
Do not apply redundant sorting removal when there's an offset
2024-08-09 11:08:41 +01:00
Yarik Briukhovetskyi
aebb07884b
Merge branch 'master' into hive_style_partitioning
2024-08-09 11:53:14 +02:00
Antonio Andelic
34fb169aa7
Merge branch 'master' into update-minio-statless
2024-08-09 11:50:17 +02:00
Salvatore Mesoraca
a5e06c7c31
Fix UB in hopEnd and hopStart
...
This was causing segfaults because of a NULL pointer dereference
2024-08-09 11:48:02 +02:00
Robert Schulze
eec5fe087c
Fix CMake for QATlib
2024-08-09 08:50:52 +00:00
Robert Schulze
a497a23914
Fix CMake for QPL
2024-08-09 08:44:22 +00:00
taiyang-li
ba3fa8a87f
Merge branch 'master' into opt_orc_writer
2024-08-09 16:18:17 +08:00
Robert Schulze
b242a129f8
Fix referenced variable for jemalloc in system.build_options
2024-08-09 08:04:24 +00:00
Robert Schulze
30d8e40772
Fix referenced variable for vectorscan in system.build_options
2024-08-09 08:04:24 +00:00
Robert Schulze
47f429a524
Proper CMake for libfiu
2024-08-09 08:04:24 +00:00
Robert Schulze
f14112fb8a
Merge pull request #67963 from rschu1ze/fix-concurrent_threads_soft_limit_ratio
...
Fix CPU count detection for `concurrent_threads_soft_limit_ratio` in in containers
2024-08-09 07:58:29 +00:00
pufit
21f8b03789
Merge pull request #67655 from ClickHouse/pufit/fuzz-query-revert-revert
...
FuzzQuery table function (resubmit)
2024-08-09 05:57:43 +00:00
Alexey Milovidov
917920c59e
Merge pull request #67737 from azat/tests-processes-leftovers
...
Smart handling of processes leftovers in tests
2024-08-09 05:21:12 +00:00
Alexey Milovidov
89ea89ad67
Merge pull request #67885 from canhld94/drop_detached_partition_all
...
Support DROP DETACHED PARTITION ALL
2024-08-09 05:20:55 +00:00
Alexey Milovidov
d1c64b5027
Merge pull request #67952 from ClickHouse/change-log-level-clickhouse-local
...
Change log level of an insignificant message in clickhouse-local
2024-08-09 05:20:40 +00:00
lgbo-ustc
248da0341a
fixed
2024-08-09 09:51:11 +08:00
pufit
5d57155c3e
Merge pull request #67953 from ClickHouse/pufit/correct-error-for-alter-modify-definer
...
Add an explicit error for `ALTER MODIFY SQL SECURITY` on non-view tables.
2024-08-09 00:16:41 +00:00
pufit
99fbef3340
Merge branch 'master' into pufit/fuzz-query-revert-revert
2024-08-08 20:12:23 -04:00
Anton Popov
8d0c8318ea
Apply suggestions from code review
2024-08-09 00:05:26 +02:00
Nikita Taranov
e501894767
Merge pull request #66320 from waynexia/period-detect
...
Avoid unneeded calculation in SeriesPeriodDetect
2024-08-08 21:44:54 +00:00
Alexey Milovidov
24dbdace18
Merge pull request #66282 from ClickHouse/vdimir/analyzer_external_query_fix
...
Properly convert boolean literals in query tree
2024-08-08 19:55:12 +00:00
Alexey Milovidov
0a2cb386f5
Merge branch 'master' into change-log-level-clickhouse-local
2024-08-08 20:54:53 +02:00
Alexey Milovidov
63d7697115
Merge pull request #67177 from ClickHouse/vdimir/connection_reset_by_peer_spam_log
...
Do not spam logs with messages related to connection reset by peer
2024-08-08 17:42:22 +00:00
Jacob Reckhard
cd69fa5a4c
fixed typos
2024-08-08 11:20:55 -06:00
Miсhael Stetsyuk
ef294f0dab
Merge pull request #67913 from ClickHouse/add-replication-lag-and-recovery-time-metrics-resubmit
...
[resubmit] add replication lag and recovery time metrics
2024-08-08 16:37:30 +00:00
Robert Schulze
076c4a9ce9
Merge pull request #67930 from rschu1ze/fix-stat-assert
...
Fix stress test error with TDigest statistics
2024-08-08 16:34:58 +00:00
Anton Popov
f9f13a8e41
enable setting optimize_functions_to_subcolumns by default
2024-08-08 16:27:25 +00:00
Anton Popov
e264ecd201
fix skip of parts in mutation with analyzer
2024-08-08 16:22:06 +00:00
Yarik Briukhovetskyi
a5fcf85fb6
Merge branch 'master' into hive_style_partitioning
2024-08-08 17:54:53 +02:00
Duc Canh Le
fdd8d5e5d8
Merge branch 'master' into drop_detached_partition_all
...
Fix CI
2024-08-08 14:44:10 +00:00
János Benjamin Antal
c9adfe246b
Merge pull request #57625 from ClickHouse/kafka-zookeeper
...
Kafka ZooKeeper
2024-08-08 14:02:27 +00:00
Yarik Briukhovetskyi
edccd30016
Merge branch 'ClickHouse:master' into hive_style_partitioning
2024-08-08 14:52:33 +02:00
Yakov Olkhovskiy
cbfc80a184
Merge pull request #67587 from ClickHouse/fix-create-view-with-recursive
...
Fix: creation of view with recursive CTE
2024-08-08 12:16:48 +00:00
Nikita Mikhaylov
4c289aa2dc
Merge pull request #64183 from vitlibar/ts-engine
...
Add new TimeSeries table engine to handle Prometheus protocols
2024-08-08 12:03:12 +00:00
alesapin
ac3dd0a9dc
Merge pull request #67873 from ClickHouse/fix-02597_column_update_tricy_expression_and_replication
...
[CI Fest] Fix `02597_column_update_tricy_expression_and_replication`
2024-08-08 11:58:37 +00:00
Sema Checherinda
117fedd3bb
fix style
2024-08-08 12:59:32 +02:00
Sema Checherinda
0939e7f922
Merge branch 'master' into chesema-02765
2024-08-08 12:57:04 +02:00
Sema Checherinda
69ac203c9f
fix tests
2024-08-08 12:56:33 +02:00
Sema Checherinda
ec145c86f5
Update src/Disks/DiskFomAST.cpp
...
Co-authored-by: Kseniia Sumarokova <54203879+kssenii@users.noreply.github.com>
2024-08-08 12:28:52 +02:00
Sema Checherinda
df23a3456f
work with review
2024-08-08 12:28:26 +02:00
vdimir
aec4e5bd63
Merge branch 'master' into vdimir/analyzer_external_query_fix
2024-08-08 12:15:19 +02:00
vdimir
c8c4ca88d0
Merge branch 'master' into vdimir/connection_reset_by_peer_spam_log
2024-08-08 12:12:45 +02:00
Yarik Briukhovetskyi
6384488826
Merge branch 'ClickHouse:master' into hive_style_partitioning
2024-08-08 11:45:01 +02:00
Sema Checherinda
b79e701d8f
Update src/Disks/DiskFomAST.cpp
...
Co-authored-by: Kseniia Sumarokova <54203879+kssenii@users.noreply.github.com>
2024-08-08 11:33:36 +02:00
Sema Checherinda
8a93b1c7cf
Update src/Disks/DiskFomAST.cpp
...
Co-authored-by: Kseniia Sumarokova <54203879+kssenii@users.noreply.github.com>
2024-08-08 11:33:10 +02:00
Sema Checherinda
376d643e39
Update src/Disks/DiskFomAST.cpp
...
Co-authored-by: Kseniia Sumarokova <54203879+kssenii@users.noreply.github.com>
2024-08-08 11:32:55 +02:00
Sema Checherinda
dbe3035b6d
Update src/Disks/DiskFomAST.cpp
...
Co-authored-by: Kseniia Sumarokova <54203879+kssenii@users.noreply.github.com>
2024-08-08 11:32:42 +02:00
Robert Schulze
f2c8d9678c
Merge remote-tracking branch 'ClickHouse/master' into fix-concurrent_threads_soft_limit_ratio
2024-08-08 09:09:44 +00:00
Robert Schulze
37641a0b4b
Merge remote-tracking branch 'ClickHouse/master' into fix-stat-assert
2024-08-08 08:57:22 +00:00
Antonio Andelic
d0f35ce6a6
Fix setting prefix
2024-08-08 10:29:01 +02:00
Dmitry Novik
486d717e88
Merge pull request #67661 from bigo-sg/win_bug
...
Fix crash on `percent_rank`
2024-08-08 08:28:48 +00:00
Alexey Milovidov
6a2ebfc95b
Revert "Use Atomic database by default in clickhouse-local"
2024-08-08 10:07:14 +02:00
János Benjamin Antal
7579d06272
Merge remote-tracking branch 'origin/master' into fix_trivial_count_non_deterministic_func
2024-08-08 08:02:28 +00:00
János Benjamin Antal
92be2db5b6
Merge remote-tracking branch 'origin/master' into kafka-zookeeper
2024-08-08 08:01:43 +00:00
morning-color
211999fde6
Merge branch 'master' into rows_before_group_by_counter
2024-08-08 15:49:24 +08:00
pufit
6c0cc194d3
Merge branch 'master' into pufit/fuzz-query-revert-revert
2024-08-07 23:26:05 -04:00
pufit
32153d6e0d
Merge branch 'master' into pufit/correct-error-for-alter-modify-definer
2024-08-07 23:25:02 -04:00
Konstantin Bogdanov
c42725331d
Fix
2024-08-08 02:47:02 +02:00
lgbo-ustc
daf62e1682
update
2024-08-08 08:30:10 +08:00
lgbo-ustc
8426e0d5e5
fix crash
2024-08-08 08:28:20 +08:00
Yarik Briukhovetskyi
c19ee360d1
Update StorageObjectStorageSource.cpp
2024-08-08 00:44:42 +02:00
Yarik Briukhovetskyi
9e3a2931d2
Merge branch 'master' into hive_style_partitioning
2024-08-07 23:59:34 +02:00
Nikita Mikhaylov
f37e0c7fc6
Merge branch 'master' of github.com:ClickHouse/ClickHouse into ts-engine
2024-08-07 21:01:13 +00:00
Nikita Mikhaylov
b2722d8832
Disallow LowCardinality type for external tables
2024-08-07 20:54:40 +00:00
Alexey Milovidov
c5b63c5820
Merge branch 'master' into change-log-level-clickhouse-local
2024-08-07 22:13:02 +02:00
Michael Stetsyuk
f08cb90fe3
fxs
2024-08-07 19:54:55 +00:00
Alexey Milovidov
d81b5239de
Remove unused CLI option
2024-08-07 21:37:01 +02:00
Yakov Olkhovskiy
466944683b
fix for multiple WITH
2024-08-07 18:50:19 +00:00
Yakov Olkhovskiy
7706bc853d
Merge branch 'master' into fix-race-tcphandler
2024-08-07 18:13:20 +00:00
Miсhael Stetsyuk
cf8ddbc15e
Update src/Databases/DatabaseReplicated.cpp
...
Co-authored-by: Alexander Tokmakov <tavplubix@clickhouse.com>
2024-08-07 19:03:20 +01:00
János Benjamin Antal
47270449dc
Style fix
2024-08-07 17:39:09 +00:00
János Benjamin Antal
ec3a248e70
Fix clang-tidy
2024-08-07 17:37:54 +00:00
Kseniia Sumarokova
315fd5496a
Merge pull request #65386 from skyoct/feat-s3-field
...
Feat add _etag for object storage
2024-08-07 17:35:43 +00:00
alesapin
0dc4d773ed
Fxi style
2024-08-07 18:46:34 +02:00
Alexander Tokmakov
a523125411
Merge pull request #66410 from ClickHouse/reject_poco
...
Add logs and metrics about rejected connections in Poco
2024-08-07 16:40:59 +00:00
Yakov Olkhovskiy
b246f7c17c
merge master
2024-08-07 16:25:31 +00:00
vdimir
5e9c3c222b
Merge pull request #67883 from canhld94/optimize_join_engine
...
Join engine support OPTIMIZE query
2024-08-07 16:24:50 +00:00
alesapin
ad678cb5a8
Ignore disappeared projections on start
2024-08-07 18:24:03 +02:00
Alexey Milovidov
2b78b3f90a
Merge branch 'master' into change-log-level-clickhouse-local
2024-08-07 17:21:26 +02:00
János Benjamin Antal
3485e87d8a
Really handle null messages
2024-08-07 15:18:55 +00:00
Alexey Milovidov
9c2b51e3d6
Merge pull request #65860 from ClickHouse/atomic-database-in-clickhouse-local
...
Use `Atomic` database by default in `clickhouse-local`
2024-08-07 15:18:54 +00:00
János Benjamin Antal
ac5aab1758
Handle kafka null messages
2024-08-07 13:30:28 +00:00
Kruglov Pavel
e809dbed60
Merge pull request #67171 from compasses/fix-memory-leak-nullkey-distinct
...
fix memory leak when exception happend during count distinct for null key
2024-08-07 12:47:52 +00:00
Kruglov Pavel
81b0caf85c
Merge pull request #67911 from Avogar/validate-data-types-in-alter
...
Validate data types in ALTER ADD/MODIFY COLUMN
2024-08-07 12:41:10 +00:00
Sema Checherinda
4a537874ca
adjust tests
2024-08-07 14:35:05 +02:00
Nikita Taranov
04d988d31b
Merge pull request #67917 from ClickHouse/follow_up_67235
...
Follow up #67235
2024-08-07 12:13:29 +00:00
János Benjamin Antal
8b5c8e5361
Merge remote-tracking branch 'origin/master' into kafka-zookeeper
2024-08-07 11:33:21 +00:00
Sema Checherinda
272941021f
Merge pull request #66279 from ClickHouse/chesema-processor-onCancel
...
merge tree sink cancel delayed_chunk
2024-08-07 11:12:22 +00:00
Nikolai Kochetov
581594d5d0
Merge pull request #66672 from jsc0218/ProjWithSpecialMergeTree
...
Projection Merge in Special MergeTree
2024-08-07 11:09:10 +00:00
Sema Checherinda
b416764585
put description of system log table in one place
2024-08-07 13:02:38 +02:00
Raúl Marín
c9340cba32
Merge pull request #67622 from Algunenano/unit_test_asan
...
Don't run ASAN unit tests under gdb
2024-08-07 10:48:00 +00:00
Ilya Yatsishin
47111eb5af
Merge pull request #67511 from ClickHouse/revert-67507-revert-66536-external-replace-to-null
...
Revert "Revert "Add settings to replace external engines to Null during create""
2024-08-07 10:38:04 +00:00
Sema Checherinda
08f8d94856
no flush backup logs at shutdown, flush all logs
2024-08-07 12:23:28 +02:00
Sema Checherinda
e3290c7820
rework Context::getSystemLogs, add system logs flush at shutdown
2024-08-07 12:21:41 +02:00
Sema Checherinda
86267418f9
fix tests, rework recreation tables conditions, add log about ignored logs
2024-08-07 12:21:41 +02:00
Sema Checherinda
8e5577ad8f
fix includes
2024-08-07 12:21:41 +02:00
Sema Checherinda
abd5dfe1d0
fix typo
2024-08-07 12:21:41 +02:00
Sema Checherinda
aa42ccf053
move LOGICAL_IF_THEN to base/defines.h
2024-08-07 12:21:41 +02:00
Sema Checherinda
bcc5201c99
init
2024-08-07 12:21:41 +02:00
Kseniia Sumarokova
29de277e90
Merge pull request #67841 from ClickHouse/add-debug-logs-for-window-view
...
Add debug logging for window view tests
2024-08-07 10:15:31 +00:00
János Benjamin Antal
3c531d314d
Fix build
2024-08-07 10:09:35 +00:00
Robert Schulze
a9c284dd8e
Include fixes aafe498 and cfaa852
2024-08-07 10:07:27 +00:00
vdimir
53c4c51f19
Merge pull request #67015 from ClickHouse/vdimir/block_stucture_mismatch_62486
...
Fix storage Buffer over Distributed
2024-08-07 09:50:45 +00:00
vdimir
a119024be8
Merge pull request #67920 from ClickHouse/vdimir/datetime64_constant_to_ast
...
Fix DateTime64 parsing after constant folding
2024-08-07 09:41:42 +00:00
Duc Canh Le
7fa6948884
Merge branch 'master' into drop_detached_partition_all
...
Fix CI
2024-08-07 09:20:06 +00:00
Anton Popov
2c10d8c6c1
Merge pull request #66243 from CurtizJ/fix-filling-empty-subcolumns
...
Fix filling of missed subcolumns
2024-08-07 09:16:20 +00:00
Anton Popov
66f95cd073
Merge pull request #66443 from amosbird/cleanup-projections
...
Clean up projection inside storage snapshot
2024-08-07 09:02:25 +00:00
khodyrevyurii
00b62b1c0d
Minor clarifycation for method getNumberOfPhysicalCPUCores
2024-08-07 08:47:55 +00:00
lgbo-ustc
58b7ac2264
update
2024-08-07 15:15:32 +08:00
lgbo-ustc
377eed20fc
reduce the size of HashJoin.cpp.o
2024-08-07 15:15:32 +08:00
lgbo-ustc
413834d049
instance template classes
2024-08-07 15:15:32 +08:00
lgbo-ustc
deb58b4ede
any/anti/semi join support mixed join conditions
2024-08-07 15:15:32 +08:00
pufit
3b642e7f91
Merge pull request #66364 from azat/cluster-inter-server-secret-fix
...
Fix cluster() for inter-server secret (preserve initial user as before)
2024-08-07 04:58:12 +00:00
lgbo-ustc
9845aeac0f
support percent_rank in old analyzer
2024-08-07 08:57:56 +08:00
lgbo-ustc
08c48cf944
update
2024-08-07 08:57:56 +08:00
lgbo-ustc
8f5cf70aab
add some comments
2024-08-07 08:57:56 +08:00
lgbo-ustc
2e521e17ed
fixed
2024-08-07 08:57:56 +08:00
lgbo-ustc
b35dd3bc02
simplify codes
2024-08-07 08:57:56 +08:00
lgbo-ustc
6e7bffa6ea
remove unused codes
2024-08-07 08:57:56 +08:00
lgbo-ustc
632ab91bbb
revert format
2024-08-07 08:57:56 +08:00
lgbo-ustc
b35ff7e417
update test
2024-08-07 08:57:56 +08:00
lgbo-ustc
114284bdce
fixed
2024-08-07 08:57:55 +08:00
pufit
2a5a8f15f4
Add an explicit error for ALTER MODIFY SQL SECURITY on non-view tables.
2024-08-06 20:51:44 -04:00
Alexey Milovidov
25f557667a
Change log level in clickhouse-local
2024-08-07 02:47:53 +02:00
Han Fei
6fba2f19f6
Merge pull request #67928 from hanfei1991/hanfei/more-log-for-async-insert-scatter-partition
...
more logs to debug logical error from async inserts
2024-08-06 23:22:34 +00:00
Alexey Milovidov
2d998b7c7a
Merge pull request #67565 from ClickHouse/chesema-perf-matview
...
enable parallel_view_processing in perf tests
2024-08-06 22:56:34 +00:00
Alexey Milovidov
ec83156691
Merge pull request #67896 from CurtizJ/fix-azure-create-container
...
Do not try to create azure container if not needed
2024-08-06 22:56:19 +00:00
Nikita Mikhaylov
5b3692b4f0
Added some useful debug logs
2024-08-07 00:29:19 +02:00
Alexey Milovidov
d1d10a483b
Merge branch 'master' into atomic-database-in-clickhouse-local
2024-08-07 00:29:07 +02:00
Nikita Taranov
5ae5cd35b5
update
2024-08-06 21:50:31 +01:00
Nikita Taranov
053285dc1c
Merge branch 'master' into keep_alive_max_reqs
2024-08-06 20:55:48 +01:00
Ilya Yatsishin
881d57a764
Merge branch 'master' into revert-67507-revert-66536-external-replace-to-null
2024-08-06 21:04:17 +02:00
Robert Schulze
c4fda6cd4c
Fix style
2024-08-06 18:26:22 +00:00
Nikita Mikhaylov
1ce71ed96d
Merge branch 'master' of github.com:ClickHouse/ClickHouse into ts-engine
2024-08-06 20:25:20 +02:00
Nikolai Kochetov
c74460b47e
Cleanup.
2024-08-06 17:53:23 +00:00
Alexander Tokmakov
77103aa729
Merge branch 'master' into reject_poco
2024-08-06 19:52:05 +02:00
Nikolai Kochetov
9c92c26edc
Simplify code.
2024-08-06 17:51:26 +00:00
Sema Checherinda
5c4f4f8503
do not add to custom disk names
2024-08-06 18:52:29 +02:00
Nikolai Kochetov
61f9627955
Merge branch 'master' into ProjWithSpecialMergeTree
2024-08-06 15:30:03 +00:00
Robert Schulze
54ba7703b1
Fix #67742
2024-08-06 15:29:40 +00:00
Han Fei
40e763dd8b
more logs to debug logical error from async inserts
2024-08-06 17:17:02 +02:00
Anton Popov
47953da08d
fix reading of size column from missed Nested in compact parts
2024-08-06 15:08:40 +00:00
Jacob Reckhard
86e3b35f24
spelling fixes
2024-08-06 09:07:17 -06:00
Michael Stetsyuk
df2675fad0
[resubmit] add replication lag and recovery time metrics
2024-08-06 15:06:02 +00:00
Sema Checherinda
35c297dc83
Merge branch 'master' into chesema-perf-matview
2024-08-06 16:57:25 +02:00
Robert Schulze
f20cfdb54e
Cosmetics III
2024-08-06 14:53:49 +00:00
János Benjamin Antal
2074485083
Fix partial filtering in filterBlockWithPredicate
2024-08-06 14:51:38 +00:00
Alexey Milovidov
2df8d6acde
Merge pull request #67423 from ClickHouse/bff
...
Fix bloom filter index breaking some queries
2024-08-06 14:45:44 +00:00
Azat Khuzhin
a478ad24a9
tests: try to catch stacktraces from client in case of test timeouts
...
This is to catch issues like [1].
[1]: https://github.com/ClickHouse/ClickHouse/issues/67736
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-08-06 16:39:16 +02:00
Sema Checherinda
0eb6a41f57
Merge branch 'master' into chesema-processor-onCancel
2024-08-06 16:36:28 +02:00
János Benjamin Antal
815fdc43ac
Revert "Merge pull request #67800 from ClickHouse/revert-66510"
...
This reverts commit 45c4a71ccbbb71c1eea8
2024-08-06 14:36:02 +00:00
vdimir
a180bf311c
Merge pull request #67804 from ClickHouse/vdimir/fix_fliter_pushdown_no_keys
...
Fix filter pushdown for aggregation without keys
2024-08-06 14:35:50 +00:00
vdimir
5c4f2c1985
Fix DateTime64 parsing after constant folding
2024-08-06 14:33:28 +00:00
Anton Popov
b99c6c1153
fix reading of size column from missed Nested in compact parts
2024-08-06 14:02:24 +00:00
Nikita Taranov
f37fcb7768
impl
2024-08-06 14:32:20 +01:00
Anton Popov
ba3719dd09
Merge remote-tracking branch 'upstream/master' into HEAD
2024-08-06 13:25:16 +00:00
avogar
dbfba5ebc4
Validate data types in ALTER ADD/MODIFY COLUMN
2024-08-06 12:57:57 +00:00
Robert Schulze
d09c82ff76
Cosmetics II
2024-08-06 12:36:09 +00:00
Robert Schulze
2776a515ba
Cosmetics I
2024-08-06 12:29:54 +00:00
Igor Nikonov
feeb945461
Merge pull request #67389 from ClickHouse/pr-all-connection-failed
...
Try to fix: ALL_CONNECTION_TRIES_FAILED with parallel replicas
2024-08-06 11:37:23 +00:00
Anton Popov
860050eb3d
Update src/Disks/ObjectStorages/AzureBlobStorage/AzureBlobStorageCommon.cpp
...
Co-authored-by: Kseniia Sumarokova <54203879+kssenii@users.noreply.github.com>
2024-08-06 13:30:23 +02:00
Nikita Mikhaylov
80d2686013
Merge branch 'master' of github.com:ClickHouse/ClickHouse into ts-engine
2024-08-06 13:12:03 +02:00
Sema Checherinda
995187006a
rework custom table's disk usage
2024-08-06 13:05:23 +02:00
Duc Canh Le
d7803ca621
small fix in log
...
Signed-off-by: Duc Canh Le <duccanh.le@ahrefs.com>
2024-08-06 10:48:10 +00:00
Anton Popov
3656b9094a
Merge pull request #67846 from ClickHouse/revert-67392-revert-66099-better-index-calc
...
Revert "Revert "Slightly better calculation of primary index""
2024-08-06 10:36:01 +00:00
Anton Popov
7c15ad3966
do not try to create azure container if not needed
2024-08-06 10:27:15 +00:00
vdimir
40de462d37
Merge branch 'master' into vdimir/analyzer_external_query_fix
2024-08-06 12:25:39 +02:00
Kseniia Sumarokova
b2987e4f4d
Update StorageWindowView.cpp
2024-08-06 11:42:18 +02:00
Nikita Mikhaylov
b4a6f249ab
Merge pull request #66438 from ClickHouse/analyzer-beta
...
Analyzer is finally Beta
2024-08-06 09:39:29 +00:00
Robert Schulze
4d44682017
Merge pull request #66479 from rschu1ze/bump-rocksdb2
...
Bump RocksDB from v7.10.2 to v8.9.1
2024-08-06 09:31:20 +00:00
Raúl Marín
25fa63f7e6
Merge remote-tracking branch 'blessed/master' into unit_test_asan
2024-08-06 11:19:57 +02:00
Nikolai Kochetov
614b78495a
Merge pull request #67395 from ClickHouse/anoter-case-of-non-deterministic-func-in-group-by-key
...
Fix another one case of non-deterministic PK
2024-08-06 08:56:54 +00:00
Nikita Mikhaylov
22ac7ce11d
Merge branch 'master' of github.com:ClickHouse/ClickHouse into pr-all-connection-failed
2024-08-06 10:31:12 +02:00
Michael Kolupaev
dc776af565
Merge pull request #67484 from ClickHouse/nojs
...
Revert #61750 "Improve JSONEachRow reading by ignoring the keys case"
2024-08-06 08:27:02 +00:00
Michael Kolupaev
9e3bc9bc53
Merge pull request #66018 from ClickHouse/readyornot
...
Fix 'Not-ready Set is passed' in system tables
2024-08-06 08:13:03 +00:00
Duc Canh Le
11fd263be6
implement DROP DETACHED PARTITION ALL
...
Signed-off-by: Duc Canh Le <duccanh.le@ahrefs.com>
2024-08-06 07:43:25 +00:00
