Commit Graph

11399 Commits

Author SHA1 Message Date
robot-clickhouse-ci-1
97061f6806
Merge pull request #54199 from ClickHouse/fix-parallel-replicas-distributed
Fix: parallel replicas over distributed don't read from all replicas
2023-09-02 15:38:51 +02:00
Igor Nikonov
8b1653bbe8 Remove unnecessary code 2023-09-02 08:25:47 +00:00
robot-clickhouse
14478b245f
Merge pull request #53892 from ClickHouse/some_fixes
Fix some tests
2023-09-02 02:33:56 +02:00
Igor Nikonov
a59674f624 Fix: parallel replicas over distributed don't read from all replicas on shard 2023-09-01 22:33:42 +00:00
Alexander Tokmakov
782c15330b Revert "Fix: respect skip_unavailable_shards with parallel replicas (#53904)"
This reverts commit f2290d9a6f.
2023-09-01 18:01:07 +02:00
Nikolai Kochetov
46087fd3e5 Refactor. 2023-09-01 15:45:08 +00:00
Victor Krasnov
52cce27e81 Merge branch 'master' into ADQM-987 2023-09-01 18:00:20 +03:00
Alexey Milovidov
ea99576080
Merge pull request #54169 from kssenii/rename-macro-back
Rename macro
2023-09-01 17:27:40 +03:00
Alexander Tokmakov
331958041e better synchronisation of RESTART REPLICA 2023-09-01 16:27:21 +02:00
Yakov Olkhovskiy
361b21b416 fix fuzzers, cmake refactor, add target fuzzers 2023-09-01 14:20:50 +00:00
vdimir
a62ac687a9
Limit number of failures on cluster_discovery_faults 2023-09-01 13:58:14 +00:00
Igor Nikonov
f2290d9a6f
Fix: respect skip_unavailable_shards with parallel replicas (#53904)
Co-authored-by: robot-clickhouse <robot-clickhouse@users.noreply.github.com>
2023-09-01 15:57:40 +02:00
kssenii
3f20d1f578 Rename 2023-09-01 12:55:58 +02:00
vdimir
406d61f9c8
Merge pull request #53755 from ClickHouse/vdimir/join_on_nullsafe 2023-09-01 11:02:37 +02:00
alexX512
36b8932b37 Merge branch 'master' of github.com:ClickHouse/ClickHouse 2023-08-31 21:40:50 +00:00
Alexander Tokmakov
d81eae6c1b Merge branch 'master' into some_fixes 2023-08-31 19:15:54 +02:00
vdimir
df281fa41d
Fix typos 2023-08-31 15:22:27 +00:00
vdimir
d7dca71bee
Add fail point to cluster discovery initialization 2023-08-31 11:45:54 +00:00
vdimir
4fa9dcb326
Fix cluster discovery initialization 2023-08-31 11:33:01 +00:00
Alexey Milovidov
1910434174 Remove CurrentStatusInfo 2023-08-30 20:48:26 +02:00
slvrtrn
8378441248 Merge remote-tracking branch 'origin' into simplified-prepared-statements-for-mysql 2023-08-30 19:00:51 +02:00
vdimir
dbdcea30a0
fix style, add built-in documentation 2023-08-30 15:06:35 +00:00
robot-ch-test-poll4
aa3b687d4a
Merge pull request #54064 from kssenii/fix-logical-error
Fix after #52943
2023-08-30 17:06:25 +02:00
Alexander Tokmakov
4d70624ca3
Merge pull request #53907 from arenadata/ADQM-1126
Added validate_tcp_client_information server setting
2023-08-30 15:10:13 +02:00
kssenii
662f22aed0 Fix 2023-08-30 13:31:54 +02:00
serxa
9c92d413b3 Merge branch 'master' into disks-and-io-sheduler 2023-08-30 11:18:49 +00:00
Alexey Gerasimchuck
a1687e618b backward compatibility changes + fixes 2023-08-29 23:50:41 +00:00
Nikita Mikhaylov
97efd14e90
Merge pull request #54009 from ClickHouse/change-istorage-interface
Change IStorage interface by random walk, no goal in particular
2023-08-29 22:22:53 +02:00
Sergei Trifonov
802579f3f1
Merge pull request #49618 from ClickHouse/concurrency-control-controllable
Make concurrency control controllable
2023-08-29 19:44:51 +02:00
Nikita Mikhaylov
96cabcae3a Change interface 2023-08-29 16:26:48 +02:00
alexX512
2670af53df Merge branch 'master' of github.com:ClickHouse/ClickHouse 2023-08-29 13:37:58 +00:00
robot-clickhouse-ci-1
f5c0890b32
Merge pull request #53895 from ClickHouse/vdimir/write_buffer_to_file_segment_dtor
Finalize file descriptor in ~WriteBufferToFileSegment
2023-08-29 15:15:44 +02:00
alexX512
b3ba00f443 Merge branch 'master' of github.com:ClickHouse/ClickHouse 2023-08-29 10:59:29 +00:00
Raúl Marín
45e8185f9b Merge remote-tracking branch 'blessed/master' into parallel_replicas_row_estimation 2023-08-29 11:17:34 +02:00
Alexander Tokmakov
050f7500f6 fix some tests 2023-08-28 18:51:36 +02:00
vdimir
9f158d4d63
Finalize file descriptor in ~WriteBufferToFileSegment 2023-08-28 16:01:10 +00:00
Alexander Tokmakov
98e6a6b09b
Merge pull request #53849 from ClickHouse/tavplubix-patch-9
Fix segfault in `TableNameHints` (with `Lazy` database)
2023-08-28 17:51:30 +02:00
Nikolai Kochetov
a47ae631bd
Merge pull request #53589 from kitaisreal/aggregator-merge-states-in-batch
Experiment Aggregator merge and destroy states in batch
2023-08-28 15:46:49 +02:00
vdimir
bb6b939d2b
Support 'is not distinct from' in join on section 2023-08-28 11:41:36 +00:00
Igor Nikonov
a2686af496
Merge pull request #53862 from ClickHouse/cleanup-parallel-replicas-0
Remove unused parallel replicas coordinator in query info
2023-08-28 13:30:23 +02:00
vdimir
b92c436c29
Merge pull request #53699 from ClickHouse/vdimir/filter_pushdown_const_bug 2023-08-28 11:45:05 +02:00
JackyWoo
a963048e1a Merge branch 'master' into optimize_uniq_to_count 2023-08-28 11:10:05 +08:00
Igor Nikonov
7368bf65b3 Remove unused parallel replicas coordinator in query info 2023-08-27 22:12:39 +00:00
Victor Krasnov
87c90767d9 Merge branch 'master' into ADQM-987 2023-08-27 09:14:42 +03:00
Yong Wang
1c3a3debb4 Kusto-phase2: fix unit test 2023-08-26 07:40:40 -07:00
Yong Wang
828f4a67b7 Kusto-phase2: use seperated path to parse kql query 2023-08-26 07:40:40 -07:00
Yong Wang
5cc3f4708c Kusto-phase2: restore to kusto dialect only, fix some style issue 2023-08-26 07:40:39 -07:00
Larry Luo
1105ac624b Fixed style issues 2023-08-26 07:40:38 -07:00
Yong Wang
ae6e6b1c3b Kusto-phase2: Changed dialect to use enumerate, Added subquery for in operator, fixed the multi query issue 2023-08-26 07:40:25 -07:00
Yong Wang
760fd6759e Kusto-phase2: add kusto_auto dialect 2023-08-26 07:40:25 -07:00
alesapin
3723fe753e
Merge pull request #53840 from kssenii/fix-after-51622
Fix after #51622
2023-08-26 11:56:11 +02:00
alesapin
0e601b856f
Merge pull request #53751 from Algunenano/clang18
Support clang-18 (Wmissing-field-initializers)
2023-08-25 23:27:06 +02:00
slvrtrn
055d2e3c3d Merge remote-tracking branch 'origin' into simplified-prepared-statements-for-mysql 2023-08-25 21:27:47 +02:00
Kseniia Sumarokova
05858f96e2
Update Metadata.cpp 2023-08-25 20:42:28 +02:00
slvrtrn
734ffd916c WIP prepared statements 2023-08-25 20:31:21 +02:00
Victor Krasnov
921f0c8b5d Merge branch 'master' into ADQM-987 2023-08-25 21:20:23 +03:00
Alexander Tokmakov
8dd3448844
Update DatabaseCatalog.h 2023-08-25 19:29:47 +03:00
Kseniia Sumarokova
13b45196f6
Merge pull request #52943 from kssenii/parallelize-file-cache-metadata-download
Parallelize loading of fs cache metadata on startup
2023-08-25 15:32:34 +02:00
kssenii
5599b57cdd Fix 2023-08-25 14:43:40 +02:00
Kseniia Sumarokova
34ac113af6
Merge pull request #53121 from kssenii/fix-cache-logical-error
Fix possible error from cache "Read unexpected size"
2023-08-25 12:16:24 +02:00
Nikolai Kochetov
4e4620250d Fixing clang tidy. 2023-08-25 09:51:52 +00:00
kssenii
fe4e04a7ae Merge remote-tracking branch 'upstream/master' into parallelize-file-cache-metadata-download 2023-08-25 11:36:40 +02:00
Kseniia Sumarokova
8edbdb4a0c
Merge pull request #53741 from kssenii/add-some-metrics-for-cache
Add some profile events
2023-08-25 11:29:16 +02:00
Kruglov Pavel
d80be4673b
Merge pull request #53692 from Avogar/cache-count
Cache number of rows in files for count in file/s3/url/hdfs/azure functions
2023-08-25 09:08:52 +02:00
Yakov Olkhovskiy
415a993c91 fix fuzzers build 2023-08-24 23:22:39 +00:00
Alexander Tokmakov
1eff7bee5e
Merge pull request #53673 from arenadata/ADQM-1105
Added client_info validation to the query packet in TCPHandler.
2023-08-24 21:03:25 +03:00
Raúl Marín
6490213207 Merge remote-tracking branch 'blessed/master' into clang18 2023-08-24 17:35:26 +02:00
Kruglov Pavel
44db5fa992
Merge branch 'master' into cache-count 2023-08-24 17:21:18 +02:00
Maksim Kita
f0f2d416dd Aggregator merge and destroy states in batch 2023-08-24 15:34:32 +03:00
Anton Popov
19a52f19f1
Merge pull request #53547 from joelynch/shutdown-async-insert-queue-first
bugfix: Flush async insert queue first on shutdown
2023-08-24 13:59:12 +02:00
Kseniia Sumarokova
b12881b5da Fix after merge 2023-08-24 13:43:15 +02:00
Nikolai Kochetov
7136c97c09 Fixing fast tests. 2023-08-24 11:07:17 +00:00
Nikolai Kochetov
cb851fcee0 Cleanup. 2023-08-24 11:07:17 +00:00
Nikolai Kochetov
fc90a1a0bd Fix some skip_unused_shards tests. 2023-08-24 11:07:17 +00:00
Nikolai Kochetov
26e0ad8d72 Re-impl evaluateExpressionOverConstantCondition [part 1] 2023-08-24 11:07:17 +00:00
Nikolai Kochetov
c084ce52bf Update evaluateConstantExpression 2023-08-24 11:07:17 +00:00
Kseniia Sumarokova
a4f39fe134
Merge branch 'master' into fix-cache-logical-error 2023-08-24 12:00:18 +02:00
kssenii
3917e6400d Merge remote-tracking branch 'upstream/master' into add-some-metrics-for-cache 2023-08-24 11:44:16 +02:00
Kseniia Sumarokova
187706558a
Merge pull request #51622 from kssenii/system-sync-cache
Add `system sync filesystem cache` command
2023-08-24 11:42:32 +02:00
helifu
adfdba4b83 Display reloaded values of server settings 2023-08-24 12:32:30 +08:00
Vitaly Baranov
5154c1b9d0 Use same UUIDs for tables on replicas created by RESTORE ON CLUSTER. 2023-08-23 22:55:46 +02:00
avogar
59ca2374b5 Better 2023-08-23 19:39:45 +00:00
avogar
93ba73715a Merge branch 'master' of github.com:ClickHouse/ClickHouse into group-by-constant-keys 2023-08-23 18:47:42 +00:00
Yakov Olkhovskiy
407b2e3b58 require columns participating in interpolate expression 2023-08-23 14:08:34 +00:00
Raúl Marín
93dac0c880 Support clang-18 (Wmissing-field-initializers) 2023-08-23 15:53:45 +02:00
Kruglov Pavel
592fa77987
Merge branch 'master' into cache-count 2023-08-23 15:18:02 +02:00
Kruglov Pavel
7e362a2110
Merge branch 'master' into fast-count-from-files 2023-08-23 15:13:20 +02:00
Joe Lynch
192c3ddb2d
Flush async insert queue first on shutdown
Fixes bug where on graceful shutdown the database catalog is shutdown
before queries in the async insert queue run, causing all the
queries to fail and data to be lost.
2023-08-23 15:00:00 +02:00
Robert Schulze
bea651e828
Merge pull request #53657 from rschu1ze/cache-improvements
Expose more settings from caches
2023-08-23 14:58:45 +02:00
kssenii
170adaafca Merge remote-tracking branch 'upstream/master' into parallelize-file-cache-metadata-download 2023-08-23 13:16:56 +02:00
kssenii
c8a12f798e Merge remote-tracking branch 'upstream/master' into system-sync-cache 2023-08-23 13:15:47 +02:00
kssenii
e43f3290b6 Add some profile events 2023-08-23 12:25:49 +02:00
Kruglov Pavel
e193aec583
Merge branch 'master' into fast-count-from-files 2023-08-23 12:15:34 +02:00
kssenii
16bbce250f Fxi 2023-08-23 12:11:47 +02:00
kssenii
15f7df0000 Merge remote-tracking branch 'upstream/master' into parallelize-file-cache-metadata-download 2023-08-23 12:02:04 +02:00
kssenii
c47f5ebcd9 Minor change 2023-08-23 11:46:14 +02:00
kssenii
325e2d3172 Merge remote-tracking branch 'upstream/master' into system-sync-cache 2023-08-23 11:44:19 +02:00
flynn
d071ee7001 Merge branch 'master' of github.com:ClickHouse/ClickHouse into scalar 2023-08-23 06:25:42 +00:00
Robert Schulze
9d8bec4c73
Fix build, pt. II 2023-08-22 15:55:54 +00:00
Robert Schulze
e744654bae
More consistent parameter names 2023-08-22 15:48:48 +00:00
vdimir
b23773380c
Fix filter pushdown for full_sorting_merge join 2023-08-22 15:06:50 +00:00
Victor Krasnov
258f9927b4 Merge branch 'master' into ADQM-987 2023-08-22 16:49:32 +03:00
Kruglov Pavel
67c5c0203b
Merge branch 'master' into fast-count-from-files 2023-08-22 15:03:48 +02:00
Kruglov Pavel
c0bdd0e00b
Merge branch 'master' into cache-count 2023-08-22 14:42:22 +02:00
avogar
b4145aeddc Cache number of rows in files for count in file/s3/url/hdfs/azure functions 2023-08-22 11:59:59 +00:00
Alexey Milovidov
670c879f4c
Merge pull request #53621 from amosbird/consistent_cmake_file_management
Consistent cmake file management
2023-08-22 14:28:04 +03:00
Robert Schulze
f2fb7365e6
Add settings for 1. size_ratio (all caches) and 2. policy (index caches)
1. is an expert-level setting, default is 0.5, applies only to SLRU.

Also, I noticed that we expose cache policy settings for the mark and
the uncompresed cache but not for the index mark and the index
uncompressed cache. Changed that as well, it simplifies the code a bit.
2023-08-22 11:04:29 +00:00
Robert Schulze
46b4f03669
Some renamings for more consistency
weight() --> sizeInBytes()
maxSize() --> maxSizeInBytes()
setMaxSize() --> setMaxSizeInBytes()
2023-08-22 10:48:03 +00:00
Antonio Andelic
e0af6e5879
Merge pull request #53644 from ClickHouse/fix-delayed-source-with-totals
Correctly handle totals and extremes with `DelayedSource`
2023-08-22 12:24:16 +02:00
Robert Schulze
acaa2eee58
Merge pull request #53556 from ClibMouse/feature/big-endian-UUID-correction
Change Big Endian-UUID to work the same as Little Endian-UUID
2023-08-22 11:57:44 +02:00
Alexey Gerasimchuck
3140958132 Added client_info validation 2023-08-22 03:52:57 +00:00
Robert Schulze
a20ceef398
Merge pull request #53447 from davvard/master
USearch HNSW index for ANN search
2023-08-21 23:34:26 +02:00
Robert Schulze
583d9b33f0
Merge pull request #51446 from rschu1ze/recfgable-caches
Runtime-reconfigurable cache sizes
2023-08-21 23:27:21 +02:00
Alexey Milovidov
316664456f
Merge pull request #53588 from kitaisreal/aarch64-neon-memequal-wide
AARCH64 Neon memequal wide
2023-08-21 21:11:01 +03:00
Robert Schulze
8cbf626d0f
Cosmetics 2023-08-21 14:08:44 +00:00
Antonio Andelic
c4bf151d83 Correctly handle totals and extremes with DelayedSource 2023-08-21 14:07:59 +00:00
Robert Schulze
96c8b250ce
Allow to configure cache sizes at runtime 2023-08-21 13:51:10 +00:00
Kruglov Pavel
88aee95122
Merge branch 'master' into fast-count-from-files 2023-08-21 14:46:33 +02:00
avogar
47304bf7aa Optimize count from files in most input formats 2023-08-21 12:30:52 +00:00
Victor Krasnov
a7813260c0 Merge branch 'master' into ADQM-987 2023-08-21 14:45:13 +03:00
Yarik Briukhovetskyi
af1d23720b
Merge branch 'ClickHouse:master' into fixed_hints_db_name 2023-08-21 13:57:39 +03:00
Amos Bird
cb7d5a0f21
Get rid of unneeded include 2023-08-21 18:01:10 +08:00
Igor Nikonov
b074e44c1b
Merge pull request #53005 from ClickHouse/fix-parallel-replicas-multiply-result
Parallel reading from replicas over Distributed
2023-08-21 01:10:53 +02:00
Kseniia Sumarokova
404fb0588a
Merge branch 'master' into fix-cache-logical-error 2023-08-20 16:28:13 +02:00
Maksim Kita
f32effb627 AARCH64 Neon memequal wide 2023-08-20 12:45:18 +03:00
Kseniia Sumarokova
55769cd9d5
Merge branch 'master' into system-sync-cache 2023-08-20 10:39:46 +02:00
Kseniia Sumarokova
ac4f727091
Merge pull request #53273 from kssenii/impove-filecache-removal
Improve fs cache cleanup
2023-08-20 10:31:07 +02:00
Alexey Milovidov
e81fcfd23d
Merge pull request #53601 from ClickHouse/remove-unneeded-columns-from-logs
Remove unneeded columns from logs
2023-08-20 10:37:11 +03:00
Alexey Milovidov
82166f731a Add metrics about system database 2023-08-20 05:05:54 +02:00
Alexey Milovidov
5d68f7c04d Remove unneeded columns from logs 2023-08-20 04:11:39 +02:00
Igor Nikonov
a69ea02418 Merge remote-tracking branch 'origin/master' into fix-parallel-replicas-multiply-result 2023-08-19 21:43:25 +00:00
Kseniia Sumarokova
aa01333a63
Merge branch 'master' into impove-filecache-removal 2023-08-19 13:34:22 +04:00
Kseniia Sumarokova
aeebedfa0d
Merge branch 'master' into system-sync-cache 2023-08-19 13:32:48 +04:00
Kseniia Sumarokova
3d2fb2eced
Merge pull request #53124 from kssenii/allowed-caches-dir-for-dynamic-disks
Allow to restrict fs caches paths (mainly useful for dynamic disks)
2023-08-19 13:30:23 +04:00
robot-clickhouse-ci-1
75b748fc9a
Merge pull request #53572 from ClickHouse/fix-interpolate-precedence
Fix: interpolate expression takes source column instead of same name aliased from select expression.
2023-08-19 11:12:32 +02:00
kssenii
5382442da0 Merge remote-tracking branch 'upstream/master' into allowed-caches-dir-for-dynamic-disks 2023-08-19 08:44:36 +04:00
kssenii
247abe0a2a Merge remote-tracking branch 'upstream/master' into system-sync-cache 2023-08-19 08:43:53 +04:00
kssenii
1a6dce3dc4 Merge remote-tracking branch 'upstream/master' into impove-filecache-removal 2023-08-19 08:42:50 +04:00
Yakov Olkhovskiy
25316a29f3 result columns should take precedence to account same name aliasing 2023-08-19 02:01:10 +00:00
Alexey Milovidov
00e2e3184b
Merge pull request #53439 from canhld94/timeout_overflow_break_subquery
Fix timeout_overflow_mode when having subquery in the rhs of IN
2023-08-19 02:24:42 +03:00
Alexey Milovidov
40d13975fb
Merge pull request #53548 from ClickHouse/vdimir/join_on_cond_sparse_fix
Fix crash in join on sparse column
2023-08-19 02:08:21 +03:00
Igor Nikonov
aebda10f7c Merge remote-tracking branch 'origin/master' into fix-parallel-replicas-multiply-result 2023-08-18 23:00:58 +00:00
kothiga
f33c585bc5
Addressing feedback. 2023-08-18 13:50:31 -07:00
Alexey Milovidov
7ad8ea78bb
Merge pull request #48990 from incfly/partition
Add partition to the system part_log and merge table.
2023-08-18 21:38:53 +03:00
Nikolai Kochetov
c99c3112ef
Merge pull request #53550 from ClickHouse/group_array_max_element_size
Add server setting `aggregate_function_group_array_max_element_size`.
2023-08-18 19:16:24 +02:00
Alexander Tokmakov
14590305ad
Merge pull request #52975 from aalexfvk/ignore_on_cluster_for_replicated_entity_queries
Ignore ON CLUSTER clause in queries for management of replicated entities (UDF and Access)
2023-08-18 19:29:41 +03:00
Alexander Tokmakov
334e014c2c Merge branch 'master' into ignore_on_cluster_for_replicated_entity_queries 2023-08-18 17:48:37 +02:00
Austin Kothig
6b42975d33
Change BE-UUID to work the same as LE-UUID. Included high and low getters to provide cleaner code when accessing undertype. 2023-08-18 08:19:46 -07:00
vdimir
ae96d32027
Fix crash in join on sparse column 2023-08-18 14:14:54 +00:00
Nikolai Kochetov
e9d8745971
Merge branch 'master' into group_array_max_element_size 2023-08-18 15:23:01 +02:00
avogar
0da8fe2793 Add missing constexpr 2023-08-18 13:22:36 +00:00
avogar
aac5131859 Fix for no_more_keys 2023-08-18 13:21:16 +00:00
Nikolai Kochetov
88e81a31fa Add server setting group_array_max_element_size. 2023-08-18 13:15:27 +00:00
avogar
7fa72f5cdf Optimize group by constant keys 2023-08-18 12:47:26 +00:00
Duc Canh Le
506880fce3 Merge branch 'master' into timeout_overflow_break_subquery 2023-08-18 09:28:49 +00:00
Alexey Milovidov
e7d0edfce6
Merge pull request #53261 from bharatnc/ncb/truncate-db
support TRUNCATE DATABASE
2023-08-18 08:22:32 +03:00
Alexey Milovidov
a882bf1bb8
Merge pull request #53495 from ClickHouse/i_hate_materialized_views
Fix a race condition between RESTART REPLICAS and DROP DATABASE
2023-08-18 06:40:04 +03:00
Anton Popov
b9df41d5e3
Merge pull request #53129 from CurtizJ/non-deterministic-mutations
Allow to execute constant non-deterministic functions in mutations on initiator
2023-08-18 00:26:20 +02:00
Igor Nikonov
06c98956b3 Merge remote-tracking branch 'origin/master' into fix-parallel-replicas-multiply-result 2023-08-17 20:42:50 +00:00
Igor Nikonov
9f771b10e9 Cleanup 2023-08-17 20:42:22 +00:00
robot-clickhouse
81af60eeea
Merge pull request #53440 from ZhiguoZh/20230815-date-arrayjoin-fix
Fix an unexpected behavior in #53152
2023-08-17 20:56:01 +02:00
Alexander Tokmakov
89c365803f
Merge pull request #53424 from ClickHouse/exception_message_patterns6
Less exceptions with runtime format string
2023-08-17 17:58:04 +03:00
Igor Nikonov
3e9ae1751e Merge remote-tracking branch 'origin/master' into fix-parallel-replicas-multiply-result 2023-08-17 14:45:37 +00:00
Anton Popov
1805dec6ff Merge remote-tracking branch 'upstream/master' into HEAD 2023-08-17 14:09:43 +00:00
Victor Krasnov
677ffa593c Replace event_time with event_time_microseconds 2023-08-17 16:42:22 +03:00
Igor Nikonov
4af3790f34 Fix style 2023-08-17 12:12:41 +00:00
Igor Nikonov
df4ca32210 Fix: select correct number of replicas for shard on coordinator
+ more tests
2023-08-17 11:31:51 +00:00
Robert Schulze
ec7daed52f
Merge pull request #50276 from ClibMouse/feature/mergetree-checksum-big-endian-support
MergeTree & SipHash checksum big-endian support
2023-08-17 13:27:18 +02:00
Alexander Tokmakov
f83d0dabea
Merge pull request #53295 from ClickHouse/less_no_parallel
Remove no-parallel tag from some tests
2023-08-17 14:08:35 +03:00
Robert Schulze
456a02da1b
Merge remote-tracking branch 'rschu1ze/master' 2023-08-17 09:30:27 +00:00
Robert Schulze
1215a23de6
Merge pull request #53422 from rschu1ze/consistency-fixes-for-caches
Refactorings for configuration of in-memory caches
2023-08-17 11:08:32 +02:00
Robert Schulze
d250adf0a5
Merge pull request #53428 from rschu1ze/invalid-async-metrics-update-period
Protect against invalid asynchronous_metrics_update_period_s settings
2023-08-17 11:05:15 +02:00
robot-ch-test-poll3
30dadcfdcc
Merge pull request #53425 from ClickHouse/trash_for_rdb
Add trash for Replicated database
2023-08-17 04:11:40 +02:00
Michael Kolupaev
ff04660972
Merge pull request #53433 from ClickHouse/exp
Fix 'Context has expired' error properly
2023-08-16 18:40:53 -07:00
Zhiguo Zhou
9467addace
Merge branch 'ClickHouse:master' into 20230815-date-arrayjoin-fix 2023-08-17 09:17:57 +08:00
Igor Nikonov
49f7b4acd6 Merge remote-tracking branch 'origin/master' into fix-parallel-replicas-multiply-result 2023-08-16 23:31:49 +00:00
Igor Nikonov
2e4d346e44 Fixes 2023-08-16 23:31:20 +00:00
Alexander Tokmakov
d7272410bd the worst fix for a deadlock ever 2023-08-17 00:42:51 +02:00
Alexander Tokmakov
08e4e2bb0b fix 2023-08-16 22:35:45 +02:00
Alexey Milovidov
c0ac6484c3 Update PartLog.cpp 2023-08-16 17:49:28 +00:00
Jianfei Hu
565b98c39e add partition format in the partlog
Signed-off-by: Jianfei Hu <hujianfei258@gmail.com>
2023-08-16 17:49:28 +00:00
Davit Vardanyan
ef2957cb91 Add: allow_experimental_usearch_index checks 2023-08-16 17:29:50 +04:00
yariks5s
85c97f85fb Merge remote-tracking branch 'public/master' into fixed_hints_db_name 2023-08-16 10:17:55 +00:00
Alexander Tokmakov
3fc65a68c7 more parallel tests 2023-08-15 23:04:04 +02:00
Michael Kolupaev
cbe4c8adc2 Fix more functions with 'Context has expired' error 2023-08-15 20:37:10 +00:00
Igor Nikonov
49134711dc Polishing 2023-08-15 17:37:01 +00:00
Robert Schulze
1986996273
Merge remote-tracking branch 'rschu1ze/master' into invalid-async-metrics-update-period 2023-08-15 17:13:54 +00:00
Robert Schulze
f558048bea
Merge remote-tracking branch 'rschu1ze/master' into consistency-fixes-for-caches 2023-08-15 17:12:52 +00:00
Igor Nikonov
9825f8c76e Remove debug logging 2023-08-15 17:03:32 +00:00
kssenii
dadf84f37b Merge remote-tracking branch 'upstream/master' into impove-filecache-removal 2023-08-15 20:33:18 +04:00
kssenii
2d74472ffb Merge remote-tracking branch 'upstream/master' into system-sync-cache 2023-08-15 20:31:26 +04:00
kssenii
164b4f0ae3 Merge remote-tracking branch 'upstream/master' into allowed-caches-dir-for-dynamic-disks 2023-08-15 20:30:01 +04:00
Alexander Tokmakov
808bc59c49 Merge branch 'master' into less_no_parallel 2023-08-15 15:49:32 +02:00
Alexander Tokmakov
f95c859959 rename setting 2023-08-15 15:47:11 +02:00
Alexander Tokmakov
78d8557a56 fix 2023-08-15 15:37:09 +02:00
Alexander Tokmakov
83c10dad18 Merge branch 'master' into exception_message_patterns6 2023-08-15 15:20:09 +02:00
Dmitry Novik
3a8d21ddfb
Merge pull request #53343 from ClickHouse/analyzer-fix-quota-tests
Analyzer: fix quotas for system tables
2023-08-15 14:12:12 +02:00
Igor Nikonov
1678cda8b3 Merge remote-tracking branch 'origin/master' into fix-parallel-replicas-multiply-result 2023-08-15 12:03:35 +00:00
Robert Schulze
f317903073
Merge branch 'ClickHouse:master' into consistency-fixes-for-caches 2023-08-15 10:25:08 +02:00
Alexey Milovidov
1e0cab13be
Merge pull request #53419 from ClickHouse/cleanup-parallel-replicas
Parallel replicas: remove unnecessary code
2023-08-15 09:47:45 +03:00
Alexey Milovidov
b9fa29c4c8
Update OptimizeDateOrDateTimeConverterWithPreimageVisitor.cpp 2023-08-15 09:46:40 +03:00
Alexey Milovidov
edee00c5b4
Update PreparedSets.cpp 2023-08-15 09:44:13 +03:00
Zhiguo Zhou
3579039733 Fix an unexpected behavior in #53152
The problematic case happens when an array column of date/datetime
is simultaneously specified in an Array Join clause without aliases
and in a time converter, such as toYYYYMM.

After applying Array Join without aliases, the column's name refers
to the flattened array items, however, its data type is recognized
as a ColumnArray still, which leads to the unexpected exception
throws when building the preimage for the time converters.

As a quick fix, we more strictly check the data types of the time
converters and quit the preimage optimization pass early.
2023-08-15 14:34:08 +08:00
Duc Canh Le
8f01c026a6 fix timeout_overflow_mode when having subquery in the rhs of IN
Signed-off-by: Duc Canh Le <duccanh.le@ahrefs.com>
2023-08-15 04:29:34 +00:00
Igor Nikonov
c94994afcf Propagate setting cluster_for_parallel_replicas to shards 2023-08-14 22:50:46 +00:00
Alexander Tokmakov
1e3f9c8cfe
Merging #53142 (#53431)
* Added session_log events to text_log

* user error severity instead of debug for failure

* updated test expectation

* added user_id to logout message

* empty commit

---------

Co-authored-by: Alexey Gerasimchuck <a.gerasimchuck@arenadata.io>
2023-08-15 00:41:24 +03:00
Alexander Tokmakov
894ec8e0d0 less exceptions with runtime format string 2023-08-14 21:45:59 +02:00
Robert Schulze
3d8f2c335f
Protect against invalid asynchronous_metrics_update_period_s settings 2023-08-14 18:57:59 +00:00
Alexander Tokmakov
1916aec2e2 add trash for Replicated database 2023-08-14 20:49:06 +02:00
ltrk2
2846ea49b4
Merge branch 'master' into feature/mergetree-checksum-big-endian-support 2023-08-14 13:02:30 -04:00
Dmitry Novik
a366c1c532 Update src/Interpreters/executeQuery.cpp 2023-08-14 18:44:09 +02:00
Dmitry Novik
9dafc596d0 Analyzer: fix quotas for system tables 2023-08-14 18:44:09 +02:00
Robert Schulze
7ed5166c8a
Cosmetics: Make re-cfg of query cache similar to re-cfg of other caches
This doesn't change semantics, it only changes in which places the
configuration is parsed. This makes the logic more consistent across
caches.
2023-08-14 15:42:32 +00:00
Robert Schulze
9e4b4541bc
Cosmetics: More aesthetic code 2023-08-14 15:42:32 +00:00
Robert Schulze
54e54aed74
Cosmetics: Introduce constants for default cache sizes and policies 2023-08-14 15:42:32 +00:00
Robert Schulze
3472a928d8
Cosmetics: Rename dropCache() to clearCaches()
"dropCache()" is a bad name, it sounds like that the cache can no longer
be used after the call. Not true, we only "clear" the cache.
2023-08-14 15:42:32 +00:00
Robert Schulze
646c51ea40
Cosmetics: Move methods into a more logical order. 2023-08-14 15:42:32 +00:00
Robert Schulze
def9bb8d92
Exclude the query cache from dropCaches() 2023-08-14 15:42:32 +00:00
Robert Schulze
fed995734e
Cosmetics: Move prefetch threadpool stuff out of "caching" section 2023-08-14 15:42:32 +00:00
Igor Nikonov
a81c762928 Fix style 2023-08-14 14:52:26 +00:00
Robert Schulze
364b43f19e
Cosmetics: add "cache" section marker 2023-08-14 14:49:40 +00:00
Igor Nikonov
709287fbdc Merge remote-tracking branch 'origin/master' into fix-parallel-replicas-multiply-result 2023-08-14 14:37:43 +00:00
Igor Nikonov
ca2f800fa5 Remove unnecessary code 2023-08-14 14:35:01 +00:00
yariks5s
31aa9f459e minor fixes 2023-08-14 09:35:29 +00:00
Victor Krasnov
247cd63ca1 Merge branch 'master' into ADQM-987
# Conflicts:
#	src/Interpreters/Context.cpp
#	src/Interpreters/InterpreterSystemQuery.cpp
2023-08-14 10:33:56 +03:00
kssenii
c3b8bc0267 Merge remote-tracking branch 'upstream/master' into allowed-caches-dir-for-dynamic-disks 2023-08-13 21:14:42 +04:00
kssenii
7e9dcdf86a Merge remote-tracking branch 'upstream/master' into impove-filecache-removal 2023-08-13 21:11:43 +04:00
kssenii
8535e23f95 Merge remote-tracking branch 'upstream/master' into system-sync-cache 2023-08-13 21:10:42 +04:00
Kseniia Sumarokova
80201f161c
FIx clang-tidy 2023-08-12 22:46:11 +04:00
Kseniia Sumarokova
6b9329153b
Fix 2023-08-12 19:00:54 +04:00
Alexey Milovidov
d332861c6b
Merge pull request #53302 from arenadata/ADQM-1011_bug_fix
#3 Fixed inconsistency between login success and logout
2023-08-12 17:32:57 +03:00
kssenii
181be04854 Better logging 2023-08-12 15:38:33 +04:00
kssenii
a3d386452f Fix 2023-08-12 15:15:05 +04:00
kssenii
f4562d19a1 Fix 2023-08-12 15:00:32 +04:00
flynn
a900d08a5f Forbid use_structure_from_insertion_table_in_table_functions when execute scalar 2023-08-12 08:16:44 +00:00
Alexey Milovidov
3d8200914f
Merge pull request #53339 from ClickHouse/kssenii-patch-6
Fix log message
2023-08-12 03:16:30 +03:00
Alexey Milovidov
4ccf9631ed
Merge pull request #53092 from ClickHouse/fix-grammarly
Fix wording
2023-08-12 03:05:53 +03:00
Alexey Milovidov
637236a081
Merge pull request #53085 from ClickHouse/allow-creating-system-tables-at-startup
Simplify system logs creation
2023-08-12 03:04:30 +03:00
Alexey Milovidov
5b243d2990
Merge pull request #53006 from kitaisreal/explain-actions-for-join-step
EXPLAIN actions for JOIN step
2023-08-12 02:51:07 +03:00
kssenii
d3c3ddb6c5 Fix 2023-08-11 19:49:02 +02:00
Kseniia Sumarokova
c73b496da5
Fix style check 2023-08-11 19:36:16 +02:00
Kseniia Sumarokova
65fac88e7c
Update FileCache.cpp 2023-08-11 19:34:43 +02:00
kssenii
aa7136c276 Add a comment 2023-08-11 18:05:03 +02:00
kssenii
0f8e5b11f7 Extend exception message 2023-08-11 17:57:51 +02:00
Kseniia Sumarokova
2245bde85d
Fix log message 2023-08-11 17:53:06 +02:00
Sergei Trifonov
771710b377
Merge branch 'master' into concurrency-control-controllable 2023-08-11 16:50:13 +02:00
Kseniia Sumarokova
ceb74ad3cb
Merge branch 'master' into allowed-caches-dir-for-dynamic-disks 2023-08-11 16:49:02 +02:00
kssenii
b609c9b5af Fix 2023-08-11 15:58:26 +02:00
Anton Popov
8744a0269a
Merge pull request #52530 from CurtizJ/fix-alter-delete-skip-index
Fix recalculation of skip indexes and projections in `ALTER DELETE` queries
2023-08-11 15:23:05 +02:00
kssenii
df18a6e65e Add a comment 2023-08-11 14:59:21 +02:00
Alexey Milovidov
22d1ddeb71 Fix tidy 2023-08-11 14:45:12 +02:00
Alexey Milovidov
a55f9eae84 Merge branch 'master' of github.com:ClickHouse/ClickHouse into allow-creating-system-tables-at-startup 2023-08-11 14:45:03 +02:00
kssenii
934bd7245a Use shared ptr instead of reference 2023-08-11 13:56:38 +02:00
ltrk2
1dc1b54c68
Merge branch 'master' into feature/mergetree-checksum-big-endian-support 2023-08-11 07:48:49 -04:00
kssenii
26ed5f77ea Fix test 2023-08-11 13:35:48 +02:00
kssenii
eef5bb0951 Review fixes 2023-08-11 13:00:01 +02:00
Yarik Briukhovetskyi
a6f89c0546
Added suggestions for mistyped names for db and tables with different… (#49801)
* Added suggestions for mistyped names for db and tables with different scenarios commented

* fixed bugs

* fixed style check

* fixed errors

* fixed errors

* fixed error with exceptions

* fixed exceptions

* fixed exceptions

* fixed exceptions

* added test and fixed bugs

* fixed style check

* fixed style check

* fixed style check

* fixed check black

* Update test.py

* Fixed server crash

* Fixed server crash and style check

* Fixed style check

* Fixed style check

* Fixed style check

* Fixed bugs with drop_db

* fixed fast test

* added tests

* fixed style check

* fixed style check

* fixed bug with lock_db

* fixed bug with lock_db and fixed reviews

* fixed bug with lock_db and fixed reviews

* fixed style check

* fixed fast test

* fixed fast test

* revert to fd582a2

* revert to fd582a2

* Removed unused parameters

Co-authored-by: Yakov Olkhovskiy <99031427+yakov-olkhovskiy@users.noreply.github.com>

* Remove unused parameters

Co-authored-by: Yakov Olkhovskiy <99031427+yakov-olkhovskiy@users.noreply.github.com>

* resolved arguments issue in assertDatabaseExists

* fixing fast test

* fixed fast test

* fixed stateless test for default db

* Update src/Interpreters/DatabaseCatalog.cpp

Co-authored-by: Yakov Olkhovskiy <99031427+yakov-olkhovskiy@users.noreply.github.com>

* Update src/Interpreters/DatabaseCatalog.cpp

Co-authored-by: Yakov Olkhovskiy <99031427+yakov-olkhovskiy@users.noreply.github.com>

* Update src/Interpreters/DatabaseCatalog.cpp

Co-authored-by: Yakov Olkhovskiy <99031427+yakov-olkhovskiy@users.noreply.github.com>

* Fixing tests.

* resolved problem with mutex

* Fixed mutex in assertDatabaseExists

* changes about assertDatabaseExists

* fixed bugs with file types

* fixed string types

* fixed fast test

* fixed mutex

* fixed mutex

* fixed style check

* Update src/Interpreters/DatabaseCatalog.cpp

Co-authored-by: Yakov Olkhovskiy <99031427+yakov-olkhovskiy@users.noreply.github.com>

* Update src/Interpreters/DatabaseCatalog.cpp

Co-authored-by: Yakov Olkhovskiy <99031427+yakov-olkhovskiy@users.noreply.github.com>

* Update src/Interpreters/DatabaseCatalog.cpp

Co-authored-by: Yakov Olkhovskiy <99031427+yakov-olkhovskiy@users.noreply.github.com>

* Update src/Interpreters/DatabaseCatalog.cpp

Co-authored-by: Yakov Olkhovskiy <99031427+yakov-olkhovskiy@users.noreply.github.com>

* Update src/Interpreters/DatabaseCatalog.cpp

Co-authored-by: Yakov Olkhovskiy <99031427+yakov-olkhovskiy@users.noreply.github.com>

* Update src/Interpreters/DatabaseCatalog.cpp

Co-authored-by: Yakov Olkhovskiy <99031427+yakov-olkhovskiy@users.noreply.github.com>

* fixed build

* added -unlocked versions of functions

* Revert "fixed build"

This reverts commit 8ce961be21.

* Revert "fixed build"

This reverts commit 8ce961be21.

* changed usage of assertDatabaseExistsUnlocked()

* fixed style check

* style check

* style check

* Revert "style check"

This reverts commit 28a9ee85a0.

* Merge branch 'master' into hints-for-wrong-db-or-table-name

* Changed AssertDatabaseExists and unified exception output

* resolved proposed changes and modified tests

* Revert "resolved proposed changes and modified tests"

This reverts commit d45337d65c.

* resolved requested changes

* fixed tests

* fixed tests

* fixed check black

* Update include brackets

Co-authored-by: Yakov Olkhovskiy <99031427+yakov-olkhovskiy@users.noreply.github.com>

* Update suggested changes

* Update suggested changes

* Fixed style check

* Added test to analyzer_integration_broken

* Update DatabaseCatalog.cpp

* Update test.py

* fixed test

* Revert "fixed test"

This reverts commit ca6d4c17c8.

* fixed test

* Revert "fixed test"

This reverts commit fe6d0d9c86, reversing
changes made to 22f4496704.

* Update test.py

* fixed black check

* Update test.py

* fixed long_log_tinylog_deadlock_race

* Update DatabaseCatalog.cpp

* Update test.py

* style

* Update DatabaseCatalog.cpp

* Fixed test

* implemented for IDatabase

* Style check

* removed const_cast

* Update DatabaseCatalog.h

* Update DatabaseCatalog.h

* Update DatabaseCatalog.cpp

* Update DatabaseCatalog.cpp

* Added db name to hints

* Update 00002_log_and_exception_messages_formatting.sql

* Update 00002_log_and_exception_messages_formatting.sql

---------

Co-authored-by: Yakov Olkhovskiy <99031427+yakov-olkhovskiy@users.noreply.github.com>
2023-08-11 13:24:16 +03:00
Bharat Nallan Chakravarthy
65bdc20a01 fix style check 2023-08-10 21:14:47 -07:00
Bharat Nallan Chakravarthy
214c9e444b add some more comments 2023-08-10 21:14:47 -07:00
Bharat Nallan Chakravarthy
aacd53516e support truncate database 2023-08-10 21:03:45 -07:00
Alexey Gerasimchuck
0a49f45f7a Fixed inconsistency between login success and logout 2023-08-11 03:42:39 +00:00
Alexey Milovidov
aae35f3b1c
Merge pull request #53184 from ClickHouse/better-ccache
Better usage of ccache
2023-08-11 04:43:45 +03:00
Alexey Milovidov
3b9d2c7080 Simplification 2023-08-11 03:06:07 +02:00
Alexey Milovidov
736ff1c127 Merge branch 'master' into allow-creating-system-tables-at-startup 2023-08-11 01:25:49 +02:00
Alexey Milovidov
19ef25a7d2 Merge branch 'master' of github.com:ClickHouse/ClickHouse into fix-grammarly 2023-08-11 01:04:33 +02:00
Alexander Tokmakov
0d9e3ca345 remove no-parallel tag from some tests 2023-08-11 00:00:36 +02:00
Alexey Milovidov
5fa4cb9345
Revert "#2 Added new tests for session_log and fixed the inconsistency between login and logout." 2023-08-11 00:59:48 +03:00
Kseniia Sumarokova
99f7a83385
Merge branch 'master' into allowed-caches-dir-for-dynamic-disks 2023-08-10 22:26:33 +02:00
kssenii
dad9cba1b7 Catch possible exception from thread creation 2023-08-10 18:54:43 +02:00
robot-ch-test-poll3
c3c4125328
Merge pull request #53255 from arenadata/ADQM-1011
#2 Added new tests for session_log and fixed the inconsistency between login and logout.
2023-08-10 17:06:24 +02:00
Alexey Milovidov
8fcfdd2bfd
Merge branch 'master' into explain-actions-for-join-step 2023-08-10 17:33:25 +03:00
ltrk2
a2054c04dd
Merge branch 'master' into feature/mergetree-checksum-big-endian-support 2023-08-10 10:21:34 -04:00
Alexey Milovidov
1365fc91c7
Merge pull request #53081 from ClickHouse/Something
Something with tests
2023-08-10 17:02:25 +03:00
Alexey Milovidov
bb57caa83e
Merge pull request #53180 from ClickHouse/ditch-tons-of-garbage
Ditch tons of garbage
2023-08-10 16:59:51 +03:00
Alexey Milovidov
f35df23974
Merge branch 'master' into better-ccache 2023-08-10 16:52:32 +03:00
pufit
af51268da1
Merge pull request #51912 from ClickHouse/pufit/role-from-storage
Create, Drop, or Move access entities between different access storages.
2023-08-10 09:47:26 -04:00
Anton Popov
232b2c07fb
Merge branch 'master' into async_part_log 2023-08-10 14:46:31 +02:00
Victor Krasnov
9c34ef899e Add backup_log table 2023-08-10 15:46:04 +03:00
Kseniia Sumarokova
3925a1641f
Merge branch 'master' into system-sync-cache 2023-08-10 14:33:13 +02:00
kssenii
3c26d51220 Better name 2023-08-10 14:29:38 +02:00
kssenii
48fe9605a8 Better 2023-08-10 14:04:19 +02:00
Kruglov Pavel
6600f87f86
Merge branch 'master' into http-valid-json-on-exception 2023-08-10 13:53:32 +02:00
Igor Nikonov
0282b6961a Merge remote-tracking branch 'origin/master' into fix-parallel-replicas-multiply-result 2023-08-10 11:47:18 +00:00
Alexander Tokmakov
4b30900fed
Revert "Improve CHECK TABLE system query" 2023-08-10 14:44:16 +03:00
Igor Nikonov
6eb6c8a320 Fix: correct execution over cluster with multiple shards
respect shard number during parallel replicas query execution
2023-08-10 11:43:26 +00:00
Kseniia Sumarokova
aed955a331
Merge branch 'master' into system-sync-cache 2023-08-10 13:18:35 +02:00
kssenii
a470165769 Better fs cache cleanup 2023-08-10 12:48:45 +02:00
Victor Krasnov
a89d711113 Move BackupsWorker::Info to a separate file BackupOperationInfo.h 2023-08-10 13:29:20 +03:00
Kseniia Sumarokova
6448034126
Update Metadata.cpp 2023-08-10 11:49:05 +02:00
alesapin
57025eed65
Merge pull request #52745 from ClickHouse/vdimir/check_table_improvements
Improve CHECK TABLE system query
2023-08-10 11:48:00 +02:00
Victor Krasnov
cb687e2569 Remove two redundant headers from Context.cpp 2023-08-10 12:47:30 +03:00
Kseniia Sumarokova
e79f1ad724
Merge branch 'master' into allowed-caches-dir-for-dynamic-disks 2023-08-10 11:02:11 +02:00
Kseniia Sumarokova
c4c76f60a7
Merge branch 'master' into fix-cache-logical-error 2023-08-10 10:55:22 +02:00
Alexey Gerasimchuck
7b0036dee3 moved notified_session_log_about_login=true line 2023-08-10 04:23:40 +00:00
Alexey Gerasimchuck
b8be7eef04 Added new tests for session_log and bugfix 2023-08-10 03:45:59 +00:00
Alexey Milovidov
c071f6755d
Revert "Added new tests for session_log and fixed the inconsistency between login and logout." 2023-08-10 04:10:03 +03:00
Kseniia Sumarokova
408003f2bc
Merge branch 'master' into system-sync-cache 2023-08-09 18:12:22 +02:00
ltrk2
139e9433a8
Merge branch 'master' into feature/mergetree-checksum-big-endian-support 2023-08-09 09:48:00 -04:00
Raúl Marín
cbf8d1a9b0
Merge branch 'master' into async_part_log 2023-08-09 15:43:01 +02:00
Kseniia Sumarokova
944e85d4e5
Merge branch 'master' into fix-cache-logical-error 2023-08-09 12:08:53 +02:00
kssenii
2cfb4c0264 Merge remote-tracking branch 'upstream/master' into allowed-caches-dir-for-dynamic-disks 2023-08-09 11:09:34 +02:00
Alexey Milovidov
fa9abc5038 Better usage of ccache 2023-08-09 05:02:50 +02:00
Alexey Milovidov
d6d6569dc7 Fix upgrade check 2023-08-09 04:28:24 +02:00
Alexey Milovidov
afdef1a21a Merge branch 'master' into allow-creating-system-tables-at-startup 2023-08-09 04:28:04 +02:00
pufit
884ea7f592
Merge branch 'master' into pufit/role-from-storage 2023-08-08 20:20:37 -04:00
Alexey Milovidov
aa757490bd Ditch tons of garbage 2023-08-09 02:19:02 +02:00
Alexey Milovidov
f6faacd394
Merge branch 'master' into Something 2023-08-08 23:55:27 +03:00
kssenii
43ed765231 Fix 2023-08-08 18:43:01 +02:00
Nikolai Kochetov
d13941f84d
Merge pull request #45322 from ClickHouse/revert-44629-revert_flamegraph
Revert "Revert "Merge pull request #38953 from ClickHouse/add-allocation-ptr-to-trace-log"
2023-08-08 17:34:55 +02:00
vdimir
3131358f79
Merge pull request #48754 from ClickHouse/vdimir/decimal_in_precision_analyzer 2023-08-08 16:56:32 +02:00
kssenii
2c485e78db Merge remote-tracking branch 'upstream/master' into system-sync-cache 2023-08-08 16:27:21 +02:00
Anton Popov
b6ce725367 fix projection recalc 2023-08-08 14:06:42 +00:00
vdimir
3f915491f0
Merge pull request #53046 from canhld94/ch_fix_direct_hash_join 2023-08-08 11:55:17 +02:00
vdimir
358ef26385
small fixes for CHECK TABLE 2023-08-08 09:45:33 +00:00
vdimir
1aedc4e892
Build proper pipeline for CHECK TABLE 2023-08-08 09:45:32 +00:00
vdimir
a882ef295f
Query CHECK TABLE takes care about progress and cancellation 2023-08-08 09:45:31 +00:00
pufit
2f46ae850e
Merge branch 'master' into pufit/role-from-storage 2023-08-07 17:57:41 -04:00
robot-ch-test-poll
066dd8a2e8
Merge pull request #52949 from CurtizJ/fix-nested-array-lowcardinality
Fix reading of empty `Nested(Array(LowCardinality(...)))`
2023-08-07 23:32:25 +02:00
Sema Checherinda
796f874116
metrics_perf_events_enabled turn off in perf tests (#52072)
* metrics_perf_events_enabled turn off in perf tests

* turn on metrics_perf_events_enabled for heating and profile requests

* close_perf_descriptors fix the condition

* do not read opend but disabled perf event

* Revert "do not read opend but disabled perf event"

This reverts commit eeab1c9c63.
2023-08-07 23:25:16 +02:00
Igor Nikonov
fd69b18184
Merge branch 'master' into fix-parallel-replicas-multiply-result 2023-08-07 21:14:33 +02:00
Nikolai Kochetov
30075d3bc2
Merge branch 'master' into revert-44629-revert_flamegraph 2023-08-07 19:31:20 +02:00
Anton Popov
78abad7701 allow to execute constant non-deterministic functions in mutations on initiator 2023-08-07 17:16:15 +00:00
Alexey Milovidov
06f557a62b Merge branch 'master' of github.com:ClickHouse/ClickHouse into allow-creating-system-tables-at-startup 2023-08-07 18:58:18 +02:00
alexX512
520a3c6eeb Merge branch 'master' of github.com:ClickHouse/ClickHouse 2023-08-07 16:52:51 +00:00
kssenii
0c174a7ec1 Allow to restrict fs caches paths 2023-08-07 18:00:26 +02:00
alexX512
080b4badbd Support partial result for aggregating transform during query execution 2023-08-07 15:58:14 +00:00
kssenii
9cdd886fde Fix 2023-08-07 16:46:42 +02:00
Duc Canh Le
cd02980130
Merge branch 'master' into ch_fix_direct_hash_join 2023-08-07 22:20:29 +08:00
Kseniia Sumarokova
6044da4baf
Merge branch 'master' into parallelize-file-cache-metadata-download 2023-08-07 15:42:40 +02:00
Kseniia Sumarokova
0189f73ee9
Fix style check 2023-08-07 15:41:37 +02:00
Kseniia Sumarokova
55864b51a4
Merge pull request #53055 from kssenii/fix-rare-race-on-key-prefix-directory-cleanup
Fix rare race condition with empty key prefix directory deletion in fs cache
2023-08-07 15:38:46 +02:00
Kseniia Sumarokova
57d9697e21
Update FileCache.cpp 2023-08-07 14:27:38 +02:00
Kseniia Sumarokova
6f6434d50d
Update FileCache.cpp 2023-08-07 14:24:19 +02:00
Sergei Trifonov
541a77f16b
Merge branch 'master' into concurrency-control-controllable 2023-08-07 14:23:10 +02:00
Sergei Trifonov
dcac12c8f9
Merge branch 'master' into concurrency-control-controllable 2023-08-07 13:43:02 +02:00
kssenii
2d90270c17 Fix 2023-08-07 12:15:32 +02:00
Raúl Marín
d37283e9fb Fix query_id in part_log with async flush queries 2023-08-07 10:46:55 +02:00
Duc Canh Le
ed2a1d7c9b select required columns when getting join 2023-08-07 03:15:20 +00:00
Alexey Milovidov
74a4c9755c Don not produce warning if a system table was created on startup 2023-08-07 02:26:23 +02:00
Alexey Gerasimchuck
da0c013b16
Merge branch 'master' into ADQM-1011 2023-08-07 07:44:57 +10:00
Alexey Milovidov
7886e06217
Merge pull request #46051 from ucasfl/count-distinct-if
Continue of #42008, rewrite countDistinctIf with count_distinct_implementation
2023-08-06 19:31:44 +03:00
Alexey Milovidov
93a10980e9 Fix review comments 2023-08-06 16:27:45 +02:00
Alexey Milovidov
ce2fcc8f33 Fix wording 2023-08-06 14:48:20 +02:00
Igor Nikonov
cc2cf611a3 fix typo/style 2023-08-06 09:37:41 +00:00
Alexey Milovidov
3e599acdb1 Fix lock order inversion 2023-08-06 04:44:07 +02:00
Alexey Milovidov
06d45cfa81 Allow creating system logs at startup 2023-08-06 01:29:31 +02:00
Igor Nikonov
6f04dc42d3
Merge branch 'master' into fix-parallel-replicas-multiply-result 2023-08-06 01:23:38 +02:00
Igor Nikonov
a8b782ca5a Parallel reading from replicas over disributed with several shards 2023-08-05 23:19:09 +00:00
Alexey Milovidov
7e90df67a7 Remove whitespaces 2023-08-06 00:58:26 +02:00
Alexey Milovidov
afb1a55bf3 Remove whitespaces 2023-08-06 00:56:33 +02:00
Alexey Gerasimchuck
c2f94101e9
Merge branch 'master' into ADQM-1011 2023-08-05 20:35:45 +10:00
Ilya Yatsishin
390c97cdae
Merge pull request #52320 from ClickHouse/create-index-unique-noop 2023-08-05 10:45:06 +02:00
robot-ch-test-poll4
ce36a3cba0
Merge pull request #51537 from ClickHouse/vdimir/tmp_storage_cache_msg
Add info about acquired space in cache to not enough space error
2023-08-05 07:26:28 +02:00
Alexey Milovidov
447987deea
Merge branch 'master' into revert-revert-of-db-filesystem-fix 2023-08-05 03:07:44 +03:00
Kseniia Sumarokova
166ac7a8be
Merge pull request #53047 from kssenii/fix-logical-error-in-cache
Fix cache related logical error in stress tests
2023-08-04 22:27:55 +02:00
Alexey Milovidov
7f4ce7697b
Merge branch 'master' into vdimir/tmp_storage_cache_msg 2023-08-04 23:11:28 +03:00
Alexey Milovidov
6f88fc282b
Merge branch 'master' into count-distinct-if 2023-08-04 19:04:36 +03:00
Ilya Yatsishin
0f63a90206
Merge branch 'master' into create-index-unique-noop 2023-08-04 17:53:57 +02:00
kssenii
927b84a786 Fix 2023-08-04 17:02:39 +02:00
kssenii
53d9de0997 Fix rare race condition with key prefix directory cleanup 2023-08-04 16:34:05 +02:00
Alexey Milovidov
b31358933b
Merge pull request #52954 from ClickHouse/fix-error-code
Fix wrong error code "BAD_GET"
2023-08-04 16:26:33 +03:00
kssenii
12ed37e99a Fix 2023-08-04 13:08:01 +02:00
Duc Canh Le
8aaa46ca90 StorageJoin: do not create clone hash join with all columns 2023-08-04 11:07:33 +00:00
kssenii
4b8b78f220 Revert "Merge pull request #53044 from ClickHouse/revert-52155-database-filesystem-remove-catch"
This reverts commit e71f20891f, reversing
changes made to aa9ab58994.
2023-08-04 12:41:55 +02:00
Alexander Tokmakov
0b312f541a
Revert "Remove try/catch from DatabaseFilesystem" 2023-08-04 13:29:28 +03:00
kssenii
3d438ab91b Merge remote-tracking branch 'origin/parallelize-file-cache-metadata-download' into parallelize-file-cache-metadata-download 2023-08-04 11:55:50 +02:00
kssenii
fd8700168a Fix false positive lock order inversion 2023-08-04 11:54:34 +02:00
vdimir
8050edaff6
style convertFieldToTypeStrict 2023-08-04 09:45:13 +00:00
vdimir
079c6783a2
Update decimal_in tests for analyzer 2023-08-04 09:45:12 +00:00
vdimir
0032eb9ab7
Fix IN with decimal in analyzer 2023-08-04 09:45:08 +00:00
Vitaly Baranov
587877dba3
Merge branch 'master' into disable-fs-cache-for-backups 2023-08-04 01:15:23 +02:00
Vitaly Baranov
0af043459a
Merge pull request #52660 from vitlibar/remove-unnecessary-temp-context-access
Remove creation of a unnecessary temporary ContextAccess on login
2023-08-04 01:08:12 +02:00
Alexey Gerasimchuck
1e7daca85b Added new tests for session_log plus bugfix 2023-08-03 22:06:33 +00:00
Alexey Milovidov
95f5d2f37f
Merge pull request #52155 from ClickHouse/database-filesystem-remove-catch
Remove try/catch from DatabaseFilesystem
2023-08-03 23:02:01 +03:00
Alexander Tokmakov
968c79cf3f
Merge pull request #52956 from ClickHouse/fixes_for_databases
Fix some issues with databases
2023-08-03 19:13:41 +03:00
Maksim Kita
a0fa3cc73b EXPLAIN actions for JOIN step 2023-08-03 18:55:15 +03:00
ltrk2
a29b36612b
Merge branch 'master' into feature/mergetree-checksum-big-endian-support 2023-08-03 09:41:25 -04:00
Anton Popov
92cb5e9ae3
Merge pull request #52687 from alkorgun/fix-named-collections-on-cluster-23.7
Fix named collections on cluster 23.7
2023-08-03 14:50:28 +02:00
Kseniia Sumarokova
a8821d6a05
Merge branch 'master' into parallelize-file-cache-metadata-download 2023-08-03 14:47:18 +02:00
Kseniia Sumarokova
2e5fbfe9bf
Fix build check 2023-08-03 14:44:47 +02:00
Alexey Milovidov
29d386fec2
Merge branch 'master' into count-distinct-if 2023-08-03 15:36:11 +03:00
Alexey Milovidov
56660f44b1
Merge branch 'master' into database-filesystem-remove-catch 2023-08-03 15:08:07 +03:00
Vitaly Baranov
f427c779eb Disable using fs cache for backup/restore. 2023-08-03 13:52:32 +02:00
Igor Nikonov
4155b0adfd
Merge pull request #52768 from ClickHouse/fix-window-func-range-check
Fix: check correctly window frame bounds for RANGE
2023-08-03 13:48:55 +02:00
Alexey Milovidov
d417061886 Merge branch 'master' into fix-error-code 2023-08-03 13:48:23 +02:00
Vitaly Baranov
7a112459d3 Implement passing current roles to Context::setUser(). 2023-08-03 13:45:01 +02:00
Vitaly Baranov
16dfb028b6 Remove creation of a unnecessary temporary ContextAccess on login. 2023-08-03 13:44:59 +02:00
Alexander Tokmakov
7684e68008
Add system stop pulling replication log (#52881)
* add system stop pulling replication log

* add const

* fix another stupid test

* Update test.py
2023-08-03 13:34:43 +03:00
vdimir
9cdd4fe41a
Add info about aquired space in cache to not enough space error 2023-08-03 10:32:44 +00:00
Aleksei Filatov
bfc4c0ebe3 Fix style 2023-08-03 13:18:49 +03:00
Kseniia Sumarokova
0ec11a2d79
Merge branch 'master' into system-sync-cache 2023-08-03 12:02:18 +02:00
Aleksei Filatov
4734d416a5 Add settings and processing code 2023-08-03 12:44:44 +03:00
Kseniia Sumarokova
621d852289
Merge pull request #52778 from kssenii/revert-revert-drop-cache
Revert revert of system drop filesystem cache by key
2023-08-03 10:55:25 +02:00
Alexander Tokmakov
c4fb0a0cd5 fix two minor issue 2023-08-02 23:36:54 +02:00
Alexey Milovidov
dbf14b5e2d Fix wrong error code "BAD_GET" 2023-08-02 23:16:06 +02:00
Alexey Milovidov
e101f2011b
Merge branch 'master' into count-distinct-if 2023-08-03 00:09:52 +03:00
Igor Nikonov
44b9ed438f
Merge branch 'master' into fix-window-func-range-check 2023-08-02 19:24:55 +02:00
Anton Popov
d43e76b147 fix reading of empty Nested(Array(LowCardinality(...))) 2023-08-02 16:48:08 +00:00
ltrk2
27a2d4d1c7
Merge branch 'master' into feature/mergetree-checksum-big-endian-support 2023-08-02 11:36:43 -04:00
kssenii
c9f0c426e1 Fix style check, improve test 2023-08-02 17:15:50 +02:00
Alexey Milovidov
b17e93e78c Merge branch 'master' into database-filesystem-remove-catch 2023-08-02 17:13:12 +02:00
kssenii
0d0cbb44e8 Paralelize loading of cache metadata on startup 2023-08-02 16:46:16 +02:00
Nikita Taranov
2cbe79b529
Fix memory consumption when max_block_size is huge in Aggregator + more memory checks (#51566)
* impl

* remove checks from without_key methods

* maybe will improve smth

* add test

* Update 02797_aggregator_huge_mem_usage_bug.sql

* Update 02797_aggregator_huge_mem_usage_bug.sql

---------

Co-authored-by: Alexey Milovidov <milovidov@clickhouse.com>
2023-08-02 15:11:52 +02:00
Alexander Tokmakov
61977479be
Update SystemLog.cpp (#52858) 2023-08-02 15:18:57 +03:00
Mike Kot
1335d06b8f
Do not replicate ALTER TABLE t FREEZE on Replicated engine (#52064)
* fix

* do not replicate alter freeze

* fix

---------

Co-authored-by: Alexander Tokmakov <tavplubix@clickhouse.com>
2023-08-02 14:39:54 +03:00
JackyWoo
93b28903cb
Merge branch 'master' into optimize_uniq_to_count 2023-08-02 10:13:22 +08:00
Kseniia Sumarokova
eabca22909
Merge branch 'master' into revert-revert-drop-cache 2023-08-01 23:19:38 +02:00
Alexey Milovidov
7954b732fd
Merge branch 'master' into database-filesystem-remove-catch 2023-08-01 20:52:26 +03:00
Nikolai Kochetov
fa06056fa2 Merge branch 'master' into revert-44629-revert_flamegraph 2023-08-01 17:14:16 +00:00
Kseniia Sumarokova
dbc11b83fd
Merge branch 'master' into kssenii-patch-6 2023-08-01 18:40:20 +02:00
Kruglov Pavel
23aab71d7c
Merge branch 'master' into http-valid-json-on-exception 2023-08-01 16:47:31 +02:00
Vitaly Baranov
65bd8f5e81
Merge branch 'master' into backups-fix-tmp-files 2023-08-01 16:37:06 +02:00
Sergei Trifonov
01196ac41f
Merge branch 'master' into concurrency-control-controllable 2023-08-01 15:40:50 +02:00
alesapin
0ee9797fb8
Merge pull request #51141 from ClickHouse/azure_blob_storage_sas_token
Azure blob storage sas token
2023-08-01 12:27:17 +02:00
avogar
a71cd56a90 Output valid JSON/XML on excetpion during HTTP query execution 2023-08-01 10:06:56 +00:00
Kseniia Sumarokova
16851040df
Fix annoying test 2023-08-01 11:21:46 +02:00
Alexey Milovidov
8ce1b87cda Merge branch 'master' of github.com:ClickHouse/ClickHouse into database-filesystem-remove-catch 2023-08-01 07:30:57 +02:00
Igor Nikonov
81c08199a8
Merge branch 'master' into fix-window-func-range-check 2023-07-31 19:45:25 +02:00
Alexander Tokmakov
7359a8108b
Merge pull request #51724 from arenadata/ADQM-939
Added max_sessions_for_user setting
2023-07-31 15:38:58 +03:00
Alexander Tokmakov
01f05e14eb
Merge pull request #50424 from tonickkozlov/tonickkozlov/zk-session-lifetime
Introduce fallback ZooKeeper sessions
2023-07-31 15:14:44 +03:00
kssenii
812fbee72e Better 2023-07-31 13:06:35 +02:00
flynn
c23893d7c1
Merge branch 'master' into count-distinct-if 2023-07-31 18:53:06 +08:00
kssenii
7a631be885 Merge remote-tracking branch 'origin/system-sync-cache' into system-sync-cache 2023-07-31 12:45:05 +02:00
kssenii
5d167b4f03 Merge remote-tracking branch 'upstream/master' into system-sync-cache 2023-07-31 12:44:11 +02:00
kssenii
d136f18c30 Fix 2023-07-31 12:17:30 +02:00
Igor Nikonov
1868497534 Merge remote-tracking branch 'origin/master' into fix-window-func-range-check 2023-07-31 08:50:48 +00:00
Alexey Gerasimchuck
2c07607f25
Merge branch 'master' into ADQM-939 2023-07-31 13:43:45 +10:00
Igor Nikonov
3d7257cc7e Allow Floats as boundaries for RANGE is nonsense 2023-07-30 23:19:54 +00:00
Igor Nikonov
bdf47428f2 Merge remote-tracking branch 'origin/master' into fix-window-func-range-check 2023-07-30 22:40:58 +00:00
Igor Nikonov
6d971bc3a8 Specific check for NaN in window functions with RANGE 2023-07-30 22:35:19 +00:00
Alexey Gerasimchuck
e58b3cfd32 Implemented max sessions for user 2023-07-30 22:09:03 +00:00
alesapin
aba291ca68
Revert "Revert "Add an ability to specify allocations size for sampling memory profiler"" 2023-07-30 14:01:34 +02:00
kssenii
0cf93e7114 Reduce redundant logging 2023-07-30 13:51:10 +02:00
kssenii
20b76010ef Merge remote-tracking branch 'upstream/master' into kssenii-patch-6 2023-07-30 13:46:58 +02:00
kssenii
38f12f0664 Revert some commenting 2023-07-30 13:46:40 +02:00
kssenii
6ae6268ad0 Revert "Merge pull request #51917 from ClickHouse/revert-system-drop-filesystem-cache-by-key"
This reverts commit 520195f7ef, reversing
changes made to e36a638014.
2023-07-30 13:39:54 +02:00
Alexey Milovidov
91e67c105f
Merge pull request #52569 from ClickHouse/Realize_parameterized_view_as_new_storage_view
Realize parameterized view as new view with parameters substitued
2023-07-30 05:46:51 +03:00
Alexey Milovidov
a336f06f57
Update Context.cpp 2023-07-30 05:46:05 +03:00
Igor Nikonov
918571a5ee Fix: check correctly frame bounds for RANGE 2023-07-29 22:04:21 +00:00
ltrk2
6c9a1b14ef
Merge branch 'master' into feature/mergetree-checksum-big-endian-support 2023-07-28 16:18:46 -04:00
pufit
6211845ef0
Merge pull request #51303 from ClickHouse/deprecate-metadata-cache
Deprecate the `metadata_cache` feature
2023-07-28 10:31:02 -04:00
Alexander Tokmakov
39200606ec
Merge pull request #52174 from arenadata/ADQM-988
Added possibility to save logs on crash and options to configure logs buffer
2023-07-28 16:55:00 +03:00
Anton Kozlov
5dfc30528d Introduce fallback ZooKeeper sessions 2023-07-28 11:43:27 +00:00
robot-clickhouse
bba9a2cd28
Merge pull request #51961 from nickitat/exec_udf_allow_parameters
Don't throw exception when exec udf has parameters
2023-07-28 11:52:17 +02:00
Alexey Gerasimchuck
63b05da1f2 System logs improvements 2023-07-28 07:23:34 +00:00
flynn
6de5127c0d fix conflict 2023-07-28 07:11:52 +00:00
pufit
9dbb106dc1 Fix tests, docs 2023-07-27 23:37:09 -04:00
Al Korgun
ebbd662071
Merge branch 'ClickHouse:master' into fix-named-collections-on-cluster-23.7 2023-07-27 23:31:35 +03:00
Azat Khuzhin
d40dbdee62 Fix usage of temporary directories during RESTORE
Previously during RESTORE you may get the following warning in logs:

    <Warning> TemporaryFileOnDisk: Temporary path 'tmp/21672kaaaaa' does not exist in './disks/s3_common_disk/'

The reason is that it uses not disks/s3_common_disk/tmp but instead
disks/s3_common_disk/disks/s3_common_disk/tmp path.

Fix this by adding TemporaryFileOnDisk::getRelativePath() and use it
when appropriate.

And now - `find disks`, does not shows any more temporary leftovers.

v2: rename getPath to getAbsolutePath
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-07-27 19:24:54 +02:00
Robert Schulze
c2ee774350
Add query cache metrics to system.asynchronous_metrics
Cf. https://github.com/ClickHouse/ClickHouse/pull/52384#issuecomment-1653241216
2023-07-27 15:19:01 +00:00