Commit Graph

11399 Commits

Author SHA1 Message Date
avogar
0da8fe2793 Add missing constexpr 2023-08-18 13:22:36 +00:00
avogar
aac5131859 Fix for no_more_keys 2023-08-18 13:21:16 +00:00
Nikolai Kochetov
88e81a31fa Add server setting group_array_max_element_size. 2023-08-18 13:15:27 +00:00
avogar
7fa72f5cdf Optimize group by constant keys 2023-08-18 12:47:26 +00:00
Duc Canh Le
506880fce3 Merge branch 'master' into timeout_overflow_break_subquery 2023-08-18 09:28:49 +00:00
Alexey Milovidov
e7d0edfce6
Merge pull request #53261 from bharatnc/ncb/truncate-db
support TRUNCATE DATABASE
2023-08-18 08:22:32 +03:00
Alexey Milovidov
a882bf1bb8
Merge pull request #53495 from ClickHouse/i_hate_materialized_views
Fix a race condition between RESTART REPLICAS and DROP DATABASE
2023-08-18 06:40:04 +03:00
Anton Popov
b9df41d5e3
Merge pull request #53129 from CurtizJ/non-deterministic-mutations
Allow to execute constant non-deterministic functions in mutations on initiator
2023-08-18 00:26:20 +02:00
Igor Nikonov
06c98956b3 Merge remote-tracking branch 'origin/master' into fix-parallel-replicas-multiply-result 2023-08-17 20:42:50 +00:00
Igor Nikonov
9f771b10e9 Cleanup 2023-08-17 20:42:22 +00:00
robot-clickhouse
81af60eeea
Merge pull request #53440 from ZhiguoZh/20230815-date-arrayjoin-fix
Fix an unexpected behavior in #53152
2023-08-17 20:56:01 +02:00
Alexander Tokmakov
89c365803f
Merge pull request #53424 from ClickHouse/exception_message_patterns6
Less exceptions with runtime format string
2023-08-17 17:58:04 +03:00
Igor Nikonov
3e9ae1751e Merge remote-tracking branch 'origin/master' into fix-parallel-replicas-multiply-result 2023-08-17 14:45:37 +00:00
Anton Popov
1805dec6ff Merge remote-tracking branch 'upstream/master' into HEAD 2023-08-17 14:09:43 +00:00
Victor Krasnov
677ffa593c Replace event_time with event_time_microseconds 2023-08-17 16:42:22 +03:00
Igor Nikonov
4af3790f34 Fix style 2023-08-17 12:12:41 +00:00
Igor Nikonov
df4ca32210 Fix: select correct number of replicas for shard on coordinator
+ more tests
2023-08-17 11:31:51 +00:00
Robert Schulze
ec7daed52f
Merge pull request #50276 from ClibMouse/feature/mergetree-checksum-big-endian-support
MergeTree & SipHash checksum big-endian support
2023-08-17 13:27:18 +02:00
Alexander Tokmakov
f83d0dabea
Merge pull request #53295 from ClickHouse/less_no_parallel
Remove no-parallel tag from some tests
2023-08-17 14:08:35 +03:00
Robert Schulze
456a02da1b
Merge remote-tracking branch 'rschu1ze/master' 2023-08-17 09:30:27 +00:00
Robert Schulze
1215a23de6
Merge pull request #53422 from rschu1ze/consistency-fixes-for-caches
Refactorings for configuration of in-memory caches
2023-08-17 11:08:32 +02:00
Robert Schulze
d250adf0a5
Merge pull request #53428 from rschu1ze/invalid-async-metrics-update-period
Protect against invalid asynchronous_metrics_update_period_s settings
2023-08-17 11:05:15 +02:00
robot-ch-test-poll3
30dadcfdcc
Merge pull request #53425 from ClickHouse/trash_for_rdb
Add trash for Replicated database
2023-08-17 04:11:40 +02:00
Michael Kolupaev
ff04660972
Merge pull request #53433 from ClickHouse/exp
Fix 'Context has expired' error properly
2023-08-16 18:40:53 -07:00
Zhiguo Zhou
9467addace
Merge branch 'ClickHouse:master' into 20230815-date-arrayjoin-fix 2023-08-17 09:17:57 +08:00
Igor Nikonov
49f7b4acd6 Merge remote-tracking branch 'origin/master' into fix-parallel-replicas-multiply-result 2023-08-16 23:31:49 +00:00
Igor Nikonov
2e4d346e44 Fixes 2023-08-16 23:31:20 +00:00
Alexander Tokmakov
d7272410bd the worst fix for a deadlock ever 2023-08-17 00:42:51 +02:00
Alexander Tokmakov
08e4e2bb0b fix 2023-08-16 22:35:45 +02:00
Alexey Milovidov
c0ac6484c3 Update PartLog.cpp 2023-08-16 17:49:28 +00:00
Jianfei Hu
565b98c39e add partition format in the partlog
Signed-off-by: Jianfei Hu <hujianfei258@gmail.com>
2023-08-16 17:49:28 +00:00
Davit Vardanyan
ef2957cb91 Add: allow_experimental_usearch_index checks 2023-08-16 17:29:50 +04:00
yariks5s
85c97f85fb Merge remote-tracking branch 'public/master' into fixed_hints_db_name 2023-08-16 10:17:55 +00:00
Alexander Tokmakov
3fc65a68c7 more parallel tests 2023-08-15 23:04:04 +02:00
Michael Kolupaev
cbe4c8adc2 Fix more functions with 'Context has expired' error 2023-08-15 20:37:10 +00:00
Igor Nikonov
49134711dc Polishing 2023-08-15 17:37:01 +00:00
Robert Schulze
1986996273
Merge remote-tracking branch 'rschu1ze/master' into invalid-async-metrics-update-period 2023-08-15 17:13:54 +00:00
Robert Schulze
f558048bea
Merge remote-tracking branch 'rschu1ze/master' into consistency-fixes-for-caches 2023-08-15 17:12:52 +00:00
Igor Nikonov
9825f8c76e Remove debug logging 2023-08-15 17:03:32 +00:00
kssenii
dadf84f37b Merge remote-tracking branch 'upstream/master' into impove-filecache-removal 2023-08-15 20:33:18 +04:00
kssenii
2d74472ffb Merge remote-tracking branch 'upstream/master' into system-sync-cache 2023-08-15 20:31:26 +04:00
kssenii
164b4f0ae3 Merge remote-tracking branch 'upstream/master' into allowed-caches-dir-for-dynamic-disks 2023-08-15 20:30:01 +04:00
Alexander Tokmakov
808bc59c49 Merge branch 'master' into less_no_parallel 2023-08-15 15:49:32 +02:00
Alexander Tokmakov
f95c859959 rename setting 2023-08-15 15:47:11 +02:00
Alexander Tokmakov
78d8557a56 fix 2023-08-15 15:37:09 +02:00
Alexander Tokmakov
83c10dad18 Merge branch 'master' into exception_message_patterns6 2023-08-15 15:20:09 +02:00
Dmitry Novik
3a8d21ddfb
Merge pull request #53343 from ClickHouse/analyzer-fix-quota-tests
Analyzer: fix quotas for system tables
2023-08-15 14:12:12 +02:00
Igor Nikonov
1678cda8b3 Merge remote-tracking branch 'origin/master' into fix-parallel-replicas-multiply-result 2023-08-15 12:03:35 +00:00
Robert Schulze
f317903073
Merge branch 'ClickHouse:master' into consistency-fixes-for-caches 2023-08-15 10:25:08 +02:00
Alexey Milovidov
1e0cab13be
Merge pull request #53419 from ClickHouse/cleanup-parallel-replicas
Parallel replicas: remove unnecessary code
2023-08-15 09:47:45 +03:00
Alexey Milovidov
b9fa29c4c8
Update OptimizeDateOrDateTimeConverterWithPreimageVisitor.cpp 2023-08-15 09:46:40 +03:00
Alexey Milovidov
edee00c5b4
Update PreparedSets.cpp 2023-08-15 09:44:13 +03:00
Zhiguo Zhou
3579039733 Fix an unexpected behavior in #53152
The problematic case happens when an array column of date/datetime
is simultaneously specified in an Array Join clause without aliases
and in a time converter, such as toYYYYMM.

After applying Array Join without aliases, the column's name refers
to the flattened array items, however, its data type is recognized
as a ColumnArray still, which leads to the unexpected exception
throws when building the preimage for the time converters.

As a quick fix, we more strictly check the data types of the time
converters and quit the preimage optimization pass early.
2023-08-15 14:34:08 +08:00
Duc Canh Le
8f01c026a6 fix timeout_overflow_mode when having subquery in the rhs of IN
Signed-off-by: Duc Canh Le <duccanh.le@ahrefs.com>
2023-08-15 04:29:34 +00:00
Igor Nikonov
c94994afcf Propagate setting cluster_for_parallel_replicas to shards 2023-08-14 22:50:46 +00:00
Alexander Tokmakov
1e3f9c8cfe
Merging #53142 (#53431)
* Added session_log events to text_log

* user error severity instead of debug for failure

* updated test expectation

* added user_id to logout message

* empty commit

---------

Co-authored-by: Alexey Gerasimchuck <a.gerasimchuck@arenadata.io>
2023-08-15 00:41:24 +03:00
Alexander Tokmakov
894ec8e0d0 less exceptions with runtime format string 2023-08-14 21:45:59 +02:00
Robert Schulze
3d8f2c335f
Protect against invalid asynchronous_metrics_update_period_s settings 2023-08-14 18:57:59 +00:00
Alexander Tokmakov
1916aec2e2 add trash for Replicated database 2023-08-14 20:49:06 +02:00
ltrk2
2846ea49b4
Merge branch 'master' into feature/mergetree-checksum-big-endian-support 2023-08-14 13:02:30 -04:00
Dmitry Novik
a366c1c532 Update src/Interpreters/executeQuery.cpp 2023-08-14 18:44:09 +02:00
Dmitry Novik
9dafc596d0 Analyzer: fix quotas for system tables 2023-08-14 18:44:09 +02:00
Robert Schulze
7ed5166c8a
Cosmetics: Make re-cfg of query cache similar to re-cfg of other caches
This doesn't change semantics, it only changes in which places the
configuration is parsed. This makes the logic more consistent across
caches.
2023-08-14 15:42:32 +00:00
Robert Schulze
9e4b4541bc
Cosmetics: More aesthetic code 2023-08-14 15:42:32 +00:00
Robert Schulze
54e54aed74
Cosmetics: Introduce constants for default cache sizes and policies 2023-08-14 15:42:32 +00:00
Robert Schulze
3472a928d8
Cosmetics: Rename dropCache() to clearCaches()
"dropCache()" is a bad name, it sounds like that the cache can no longer
be used after the call. Not true, we only "clear" the cache.
2023-08-14 15:42:32 +00:00
Robert Schulze
646c51ea40
Cosmetics: Move methods into a more logical order. 2023-08-14 15:42:32 +00:00
Robert Schulze
def9bb8d92
Exclude the query cache from dropCaches() 2023-08-14 15:42:32 +00:00
Robert Schulze
fed995734e
Cosmetics: Move prefetch threadpool stuff out of "caching" section 2023-08-14 15:42:32 +00:00
Igor Nikonov
a81c762928 Fix style 2023-08-14 14:52:26 +00:00
Robert Schulze
364b43f19e
Cosmetics: add "cache" section marker 2023-08-14 14:49:40 +00:00
Igor Nikonov
709287fbdc Merge remote-tracking branch 'origin/master' into fix-parallel-replicas-multiply-result 2023-08-14 14:37:43 +00:00
Igor Nikonov
ca2f800fa5 Remove unnecessary code 2023-08-14 14:35:01 +00:00
yariks5s
31aa9f459e minor fixes 2023-08-14 09:35:29 +00:00
Victor Krasnov
247cd63ca1 Merge branch 'master' into ADQM-987
# Conflicts:
#	src/Interpreters/Context.cpp
#	src/Interpreters/InterpreterSystemQuery.cpp
2023-08-14 10:33:56 +03:00
kssenii
c3b8bc0267 Merge remote-tracking branch 'upstream/master' into allowed-caches-dir-for-dynamic-disks 2023-08-13 21:14:42 +04:00
kssenii
7e9dcdf86a Merge remote-tracking branch 'upstream/master' into impove-filecache-removal 2023-08-13 21:11:43 +04:00
kssenii
8535e23f95 Merge remote-tracking branch 'upstream/master' into system-sync-cache 2023-08-13 21:10:42 +04:00
Kseniia Sumarokova
80201f161c
FIx clang-tidy 2023-08-12 22:46:11 +04:00
Kseniia Sumarokova
6b9329153b
Fix 2023-08-12 19:00:54 +04:00
Alexey Milovidov
d332861c6b
Merge pull request #53302 from arenadata/ADQM-1011_bug_fix
#3 Fixed inconsistency between login success and logout
2023-08-12 17:32:57 +03:00
kssenii
181be04854 Better logging 2023-08-12 15:38:33 +04:00
kssenii
a3d386452f Fix 2023-08-12 15:15:05 +04:00
kssenii
f4562d19a1 Fix 2023-08-12 15:00:32 +04:00
flynn
a900d08a5f Forbid use_structure_from_insertion_table_in_table_functions when execute scalar 2023-08-12 08:16:44 +00:00
Alexey Milovidov
3d8200914f
Merge pull request #53339 from ClickHouse/kssenii-patch-6
Fix log message
2023-08-12 03:16:30 +03:00
Alexey Milovidov
4ccf9631ed
Merge pull request #53092 from ClickHouse/fix-grammarly
Fix wording
2023-08-12 03:05:53 +03:00
Alexey Milovidov
637236a081
Merge pull request #53085 from ClickHouse/allow-creating-system-tables-at-startup
Simplify system logs creation
2023-08-12 03:04:30 +03:00
Alexey Milovidov
5b243d2990
Merge pull request #53006 from kitaisreal/explain-actions-for-join-step
EXPLAIN actions for JOIN step
2023-08-12 02:51:07 +03:00
kssenii
d3c3ddb6c5 Fix 2023-08-11 19:49:02 +02:00
Kseniia Sumarokova
c73b496da5
Fix style check 2023-08-11 19:36:16 +02:00
Kseniia Sumarokova
65fac88e7c
Update FileCache.cpp 2023-08-11 19:34:43 +02:00
kssenii
aa7136c276 Add a comment 2023-08-11 18:05:03 +02:00
kssenii
0f8e5b11f7 Extend exception message 2023-08-11 17:57:51 +02:00
Kseniia Sumarokova
2245bde85d
Fix log message 2023-08-11 17:53:06 +02:00
Sergei Trifonov
771710b377
Merge branch 'master' into concurrency-control-controllable 2023-08-11 16:50:13 +02:00
Kseniia Sumarokova
ceb74ad3cb
Merge branch 'master' into allowed-caches-dir-for-dynamic-disks 2023-08-11 16:49:02 +02:00
kssenii
b609c9b5af Fix 2023-08-11 15:58:26 +02:00
Anton Popov
8744a0269a
Merge pull request #52530 from CurtizJ/fix-alter-delete-skip-index
Fix recalculation of skip indexes and projections in `ALTER DELETE` queries
2023-08-11 15:23:05 +02:00
kssenii
df18a6e65e Add a comment 2023-08-11 14:59:21 +02:00
Alexey Milovidov
22d1ddeb71 Fix tidy 2023-08-11 14:45:12 +02:00
Alexey Milovidov
a55f9eae84 Merge branch 'master' of github.com:ClickHouse/ClickHouse into allow-creating-system-tables-at-startup 2023-08-11 14:45:03 +02:00
kssenii
934bd7245a Use shared ptr instead of reference 2023-08-11 13:56:38 +02:00
ltrk2
1dc1b54c68
Merge branch 'master' into feature/mergetree-checksum-big-endian-support 2023-08-11 07:48:49 -04:00
kssenii
26ed5f77ea Fix test 2023-08-11 13:35:48 +02:00
kssenii
eef5bb0951 Review fixes 2023-08-11 13:00:01 +02:00
Yarik Briukhovetskyi
a6f89c0546
Added suggestions for mistyped names for db and tables with different… (#49801)
* Added suggestions for mistyped names for db and tables with different scenarios commented

* fixed bugs

* fixed style check

* fixed errors

* fixed errors

* fixed error with exceptions

* fixed exceptions

* fixed exceptions

* fixed exceptions

* added test and fixed bugs

* fixed style check

* fixed style check

* fixed style check

* fixed check black

* Update test.py

* Fixed server crash

* Fixed server crash and style check

* Fixed style check

* Fixed style check

* Fixed style check

* Fixed bugs with drop_db

* fixed fast test

* added tests

* fixed style check

* fixed style check

* fixed bug with lock_db

* fixed bug with lock_db and fixed reviews

* fixed bug with lock_db and fixed reviews

* fixed style check

* fixed fast test

* fixed fast test

* revert to fd582a2

* revert to fd582a2

* Removed unused parameters

Co-authored-by: Yakov Olkhovskiy <99031427+yakov-olkhovskiy@users.noreply.github.com>

* Remove unused parameters

Co-authored-by: Yakov Olkhovskiy <99031427+yakov-olkhovskiy@users.noreply.github.com>

* resolved arguments issue in assertDatabaseExists

* fixing fast test

* fixed fast test

* fixed stateless test for default db

* Update src/Interpreters/DatabaseCatalog.cpp

Co-authored-by: Yakov Olkhovskiy <99031427+yakov-olkhovskiy@users.noreply.github.com>

* Update src/Interpreters/DatabaseCatalog.cpp

Co-authored-by: Yakov Olkhovskiy <99031427+yakov-olkhovskiy@users.noreply.github.com>

* Update src/Interpreters/DatabaseCatalog.cpp

Co-authored-by: Yakov Olkhovskiy <99031427+yakov-olkhovskiy@users.noreply.github.com>

* Fixing tests.

* resolved problem with mutex

* Fixed mutex in assertDatabaseExists

* changes about assertDatabaseExists

* fixed bugs with file types

* fixed string types

* fixed fast test

* fixed mutex

* fixed mutex

* fixed style check

* Update src/Interpreters/DatabaseCatalog.cpp

Co-authored-by: Yakov Olkhovskiy <99031427+yakov-olkhovskiy@users.noreply.github.com>

* Update src/Interpreters/DatabaseCatalog.cpp

Co-authored-by: Yakov Olkhovskiy <99031427+yakov-olkhovskiy@users.noreply.github.com>

* Update src/Interpreters/DatabaseCatalog.cpp

Co-authored-by: Yakov Olkhovskiy <99031427+yakov-olkhovskiy@users.noreply.github.com>

* Update src/Interpreters/DatabaseCatalog.cpp

Co-authored-by: Yakov Olkhovskiy <99031427+yakov-olkhovskiy@users.noreply.github.com>

* Update src/Interpreters/DatabaseCatalog.cpp

Co-authored-by: Yakov Olkhovskiy <99031427+yakov-olkhovskiy@users.noreply.github.com>

* Update src/Interpreters/DatabaseCatalog.cpp

Co-authored-by: Yakov Olkhovskiy <99031427+yakov-olkhovskiy@users.noreply.github.com>

* fixed build

* added -unlocked versions of functions

* Revert "fixed build"

This reverts commit 8ce961be21.

* Revert "fixed build"

This reverts commit 8ce961be21.

* changed usage of assertDatabaseExistsUnlocked()

* fixed style check

* style check

* style check

* Revert "style check"

This reverts commit 28a9ee85a0.

* Merge branch 'master' into hints-for-wrong-db-or-table-name

* Changed AssertDatabaseExists and unified exception output

* resolved proposed changes and modified tests

* Revert "resolved proposed changes and modified tests"

This reverts commit d45337d65c.

* resolved requested changes

* fixed tests

* fixed tests

* fixed check black

* Update include brackets

Co-authored-by: Yakov Olkhovskiy <99031427+yakov-olkhovskiy@users.noreply.github.com>

* Update suggested changes

* Update suggested changes

* Fixed style check

* Added test to analyzer_integration_broken

* Update DatabaseCatalog.cpp

* Update test.py

* fixed test

* Revert "fixed test"

This reverts commit ca6d4c17c8.

* fixed test

* Revert "fixed test"

This reverts commit fe6d0d9c86, reversing
changes made to 22f4496704.

* Update test.py

* fixed black check

* Update test.py

* fixed long_log_tinylog_deadlock_race

* Update DatabaseCatalog.cpp

* Update test.py

* style

* Update DatabaseCatalog.cpp

* Fixed test

* implemented for IDatabase

* Style check

* removed const_cast

* Update DatabaseCatalog.h

* Update DatabaseCatalog.h

* Update DatabaseCatalog.cpp

* Update DatabaseCatalog.cpp

* Added db name to hints

* Update 00002_log_and_exception_messages_formatting.sql

* Update 00002_log_and_exception_messages_formatting.sql

---------

Co-authored-by: Yakov Olkhovskiy <99031427+yakov-olkhovskiy@users.noreply.github.com>
2023-08-11 13:24:16 +03:00
Bharat Nallan Chakravarthy
65bdc20a01 fix style check 2023-08-10 21:14:47 -07:00
Bharat Nallan Chakravarthy
214c9e444b add some more comments 2023-08-10 21:14:47 -07:00
Bharat Nallan Chakravarthy
aacd53516e support truncate database 2023-08-10 21:03:45 -07:00
Alexey Gerasimchuck
0a49f45f7a Fixed inconsistency between login success and logout 2023-08-11 03:42:39 +00:00
Alexey Milovidov
aae35f3b1c
Merge pull request #53184 from ClickHouse/better-ccache
Better usage of ccache
2023-08-11 04:43:45 +03:00
Alexey Milovidov
3b9d2c7080 Simplification 2023-08-11 03:06:07 +02:00
Alexey Milovidov
736ff1c127 Merge branch 'master' into allow-creating-system-tables-at-startup 2023-08-11 01:25:49 +02:00
Alexey Milovidov
19ef25a7d2 Merge branch 'master' of github.com:ClickHouse/ClickHouse into fix-grammarly 2023-08-11 01:04:33 +02:00
Alexander Tokmakov
0d9e3ca345 remove no-parallel tag from some tests 2023-08-11 00:00:36 +02:00
Alexey Milovidov
5fa4cb9345
Revert "#2 Added new tests for session_log and fixed the inconsistency between login and logout." 2023-08-11 00:59:48 +03:00
Kseniia Sumarokova
99f7a83385
Merge branch 'master' into allowed-caches-dir-for-dynamic-disks 2023-08-10 22:26:33 +02:00
kssenii
dad9cba1b7 Catch possible exception from thread creation 2023-08-10 18:54:43 +02:00
robot-ch-test-poll3
c3c4125328
Merge pull request #53255 from arenadata/ADQM-1011
#2 Added new tests for session_log and fixed the inconsistency between login and logout.
2023-08-10 17:06:24 +02:00
Alexey Milovidov
8fcfdd2bfd
Merge branch 'master' into explain-actions-for-join-step 2023-08-10 17:33:25 +03:00
ltrk2
a2054c04dd
Merge branch 'master' into feature/mergetree-checksum-big-endian-support 2023-08-10 10:21:34 -04:00
Alexey Milovidov
1365fc91c7
Merge pull request #53081 from ClickHouse/Something
Something with tests
2023-08-10 17:02:25 +03:00
Alexey Milovidov
bb57caa83e
Merge pull request #53180 from ClickHouse/ditch-tons-of-garbage
Ditch tons of garbage
2023-08-10 16:59:51 +03:00
Alexey Milovidov
f35df23974
Merge branch 'master' into better-ccache 2023-08-10 16:52:32 +03:00
pufit
af51268da1
Merge pull request #51912 from ClickHouse/pufit/role-from-storage
Create, Drop, or Move access entities between different access storages.
2023-08-10 09:47:26 -04:00
Anton Popov
232b2c07fb
Merge branch 'master' into async_part_log 2023-08-10 14:46:31 +02:00
Victor Krasnov
9c34ef899e Add backup_log table 2023-08-10 15:46:04 +03:00
Kseniia Sumarokova
3925a1641f
Merge branch 'master' into system-sync-cache 2023-08-10 14:33:13 +02:00
kssenii
3c26d51220 Better name 2023-08-10 14:29:38 +02:00
kssenii
48fe9605a8 Better 2023-08-10 14:04:19 +02:00
Kruglov Pavel
6600f87f86
Merge branch 'master' into http-valid-json-on-exception 2023-08-10 13:53:32 +02:00
Igor Nikonov
0282b6961a Merge remote-tracking branch 'origin/master' into fix-parallel-replicas-multiply-result 2023-08-10 11:47:18 +00:00
Alexander Tokmakov
4b30900fed
Revert "Improve CHECK TABLE system query" 2023-08-10 14:44:16 +03:00
Igor Nikonov
6eb6c8a320 Fix: correct execution over cluster with multiple shards
respect shard number during parallel replicas query execution
2023-08-10 11:43:26 +00:00
Kseniia Sumarokova
aed955a331
Merge branch 'master' into system-sync-cache 2023-08-10 13:18:35 +02:00
kssenii
a470165769 Better fs cache cleanup 2023-08-10 12:48:45 +02:00
Victor Krasnov
a89d711113 Move BackupsWorker::Info to a separate file BackupOperationInfo.h 2023-08-10 13:29:20 +03:00
Kseniia Sumarokova
6448034126
Update Metadata.cpp 2023-08-10 11:49:05 +02:00
alesapin
57025eed65
Merge pull request #52745 from ClickHouse/vdimir/check_table_improvements
Improve CHECK TABLE system query
2023-08-10 11:48:00 +02:00
Victor Krasnov
cb687e2569 Remove two redundant headers from Context.cpp 2023-08-10 12:47:30 +03:00
Kseniia Sumarokova
e79f1ad724
Merge branch 'master' into allowed-caches-dir-for-dynamic-disks 2023-08-10 11:02:11 +02:00
Kseniia Sumarokova
c4c76f60a7
Merge branch 'master' into fix-cache-logical-error 2023-08-10 10:55:22 +02:00
Alexey Gerasimchuck
7b0036dee3 moved notified_session_log_about_login=true line 2023-08-10 04:23:40 +00:00
Alexey Gerasimchuck
b8be7eef04 Added new tests for session_log and bugfix 2023-08-10 03:45:59 +00:00
Alexey Milovidov
c071f6755d
Revert "Added new tests for session_log and fixed the inconsistency between login and logout." 2023-08-10 04:10:03 +03:00
Kseniia Sumarokova
408003f2bc
Merge branch 'master' into system-sync-cache 2023-08-09 18:12:22 +02:00
ltrk2
139e9433a8
Merge branch 'master' into feature/mergetree-checksum-big-endian-support 2023-08-09 09:48:00 -04:00
Raúl Marín
cbf8d1a9b0
Merge branch 'master' into async_part_log 2023-08-09 15:43:01 +02:00
Kseniia Sumarokova
944e85d4e5
Merge branch 'master' into fix-cache-logical-error 2023-08-09 12:08:53 +02:00
kssenii
2cfb4c0264 Merge remote-tracking branch 'upstream/master' into allowed-caches-dir-for-dynamic-disks 2023-08-09 11:09:34 +02:00
Alexey Milovidov
fa9abc5038 Better usage of ccache 2023-08-09 05:02:50 +02:00
Alexey Milovidov
d6d6569dc7 Fix upgrade check 2023-08-09 04:28:24 +02:00
Alexey Milovidov
afdef1a21a Merge branch 'master' into allow-creating-system-tables-at-startup 2023-08-09 04:28:04 +02:00
pufit
884ea7f592
Merge branch 'master' into pufit/role-from-storage 2023-08-08 20:20:37 -04:00
Alexey Milovidov
aa757490bd Ditch tons of garbage 2023-08-09 02:19:02 +02:00
Alexey Milovidov
f6faacd394
Merge branch 'master' into Something 2023-08-08 23:55:27 +03:00
kssenii
43ed765231 Fix 2023-08-08 18:43:01 +02:00
Nikolai Kochetov
d13941f84d
Merge pull request #45322 from ClickHouse/revert-44629-revert_flamegraph
Revert "Revert "Merge pull request #38953 from ClickHouse/add-allocation-ptr-to-trace-log"
2023-08-08 17:34:55 +02:00
vdimir
3131358f79
Merge pull request #48754 from ClickHouse/vdimir/decimal_in_precision_analyzer 2023-08-08 16:56:32 +02:00
kssenii
2c485e78db Merge remote-tracking branch 'upstream/master' into system-sync-cache 2023-08-08 16:27:21 +02:00
Anton Popov
b6ce725367 fix projection recalc 2023-08-08 14:06:42 +00:00
vdimir
3f915491f0
Merge pull request #53046 from canhld94/ch_fix_direct_hash_join 2023-08-08 11:55:17 +02:00
vdimir
358ef26385
small fixes for CHECK TABLE 2023-08-08 09:45:33 +00:00
vdimir
1aedc4e892
Build proper pipeline for CHECK TABLE 2023-08-08 09:45:32 +00:00
vdimir
a882ef295f
Query CHECK TABLE takes care about progress and cancellation 2023-08-08 09:45:31 +00:00
pufit
2f46ae850e
Merge branch 'master' into pufit/role-from-storage 2023-08-07 17:57:41 -04:00
robot-ch-test-poll
066dd8a2e8
Merge pull request #52949 from CurtizJ/fix-nested-array-lowcardinality
Fix reading of empty `Nested(Array(LowCardinality(...)))`
2023-08-07 23:32:25 +02:00
Sema Checherinda
796f874116
metrics_perf_events_enabled turn off in perf tests (#52072)
* metrics_perf_events_enabled turn off in perf tests

* turn on metrics_perf_events_enabled for heating and profile requests

* close_perf_descriptors fix the condition

* do not read opend but disabled perf event

* Revert "do not read opend but disabled perf event"

This reverts commit eeab1c9c63.
2023-08-07 23:25:16 +02:00
Igor Nikonov
fd69b18184
Merge branch 'master' into fix-parallel-replicas-multiply-result 2023-08-07 21:14:33 +02:00
Nikolai Kochetov
30075d3bc2
Merge branch 'master' into revert-44629-revert_flamegraph 2023-08-07 19:31:20 +02:00
Anton Popov
78abad7701 allow to execute constant non-deterministic functions in mutations on initiator 2023-08-07 17:16:15 +00:00
Alexey Milovidov
06f557a62b Merge branch 'master' of github.com:ClickHouse/ClickHouse into allow-creating-system-tables-at-startup 2023-08-07 18:58:18 +02:00
alexX512
520a3c6eeb Merge branch 'master' of github.com:ClickHouse/ClickHouse 2023-08-07 16:52:51 +00:00
kssenii
0c174a7ec1 Allow to restrict fs caches paths 2023-08-07 18:00:26 +02:00
alexX512
080b4badbd Support partial result for aggregating transform during query execution 2023-08-07 15:58:14 +00:00
kssenii
9cdd886fde Fix 2023-08-07 16:46:42 +02:00
Duc Canh Le
cd02980130
Merge branch 'master' into ch_fix_direct_hash_join 2023-08-07 22:20:29 +08:00
Kseniia Sumarokova
6044da4baf
Merge branch 'master' into parallelize-file-cache-metadata-download 2023-08-07 15:42:40 +02:00
Kseniia Sumarokova
0189f73ee9
Fix style check 2023-08-07 15:41:37 +02:00
Kseniia Sumarokova
55864b51a4
Merge pull request #53055 from kssenii/fix-rare-race-on-key-prefix-directory-cleanup
Fix rare race condition with empty key prefix directory deletion in fs cache
2023-08-07 15:38:46 +02:00
Kseniia Sumarokova
57d9697e21
Update FileCache.cpp 2023-08-07 14:27:38 +02:00
Kseniia Sumarokova
6f6434d50d
Update FileCache.cpp 2023-08-07 14:24:19 +02:00
Sergei Trifonov
541a77f16b
Merge branch 'master' into concurrency-control-controllable 2023-08-07 14:23:10 +02:00
Sergei Trifonov
dcac12c8f9
Merge branch 'master' into concurrency-control-controllable 2023-08-07 13:43:02 +02:00
kssenii
2d90270c17 Fix 2023-08-07 12:15:32 +02:00
Raúl Marín
d37283e9fb Fix query_id in part_log with async flush queries 2023-08-07 10:46:55 +02:00
Duc Canh Le
ed2a1d7c9b select required columns when getting join 2023-08-07 03:15:20 +00:00
Alexey Milovidov
74a4c9755c Don not produce warning if a system table was created on startup 2023-08-07 02:26:23 +02:00
Alexey Gerasimchuck
da0c013b16
Merge branch 'master' into ADQM-1011 2023-08-07 07:44:57 +10:00
Alexey Milovidov
7886e06217
Merge pull request #46051 from ucasfl/count-distinct-if
Continue of #42008, rewrite countDistinctIf with count_distinct_implementation
2023-08-06 19:31:44 +03:00
Alexey Milovidov
93a10980e9 Fix review comments 2023-08-06 16:27:45 +02:00
Alexey Milovidov
ce2fcc8f33 Fix wording 2023-08-06 14:48:20 +02:00
Igor Nikonov
cc2cf611a3 fix typo/style 2023-08-06 09:37:41 +00:00
Alexey Milovidov
3e599acdb1 Fix lock order inversion 2023-08-06 04:44:07 +02:00
Alexey Milovidov
06d45cfa81 Allow creating system logs at startup 2023-08-06 01:29:31 +02:00
Igor Nikonov
6f04dc42d3
Merge branch 'master' into fix-parallel-replicas-multiply-result 2023-08-06 01:23:38 +02:00
Igor Nikonov
a8b782ca5a Parallel reading from replicas over disributed with several shards 2023-08-05 23:19:09 +00:00
Alexey Milovidov
7e90df67a7 Remove whitespaces 2023-08-06 00:58:26 +02:00
Alexey Milovidov
afb1a55bf3 Remove whitespaces 2023-08-06 00:56:33 +02:00
Alexey Gerasimchuck
c2f94101e9
Merge branch 'master' into ADQM-1011 2023-08-05 20:35:45 +10:00
Ilya Yatsishin
390c97cdae
Merge pull request #52320 from ClickHouse/create-index-unique-noop 2023-08-05 10:45:06 +02:00
robot-ch-test-poll4
ce36a3cba0
Merge pull request #51537 from ClickHouse/vdimir/tmp_storage_cache_msg
Add info about acquired space in cache to not enough space error
2023-08-05 07:26:28 +02:00
Alexey Milovidov
447987deea
Merge branch 'master' into revert-revert-of-db-filesystem-fix 2023-08-05 03:07:44 +03:00
Kseniia Sumarokova
166ac7a8be
Merge pull request #53047 from kssenii/fix-logical-error-in-cache
Fix cache related logical error in stress tests
2023-08-04 22:27:55 +02:00
Alexey Milovidov
7f4ce7697b
Merge branch 'master' into vdimir/tmp_storage_cache_msg 2023-08-04 23:11:28 +03:00
Alexey Milovidov
6f88fc282b
Merge branch 'master' into count-distinct-if 2023-08-04 19:04:36 +03:00
Ilya Yatsishin
0f63a90206
Merge branch 'master' into create-index-unique-noop 2023-08-04 17:53:57 +02:00
kssenii
927b84a786 Fix 2023-08-04 17:02:39 +02:00
kssenii
53d9de0997 Fix rare race condition with key prefix directory cleanup 2023-08-04 16:34:05 +02:00
Alexey Milovidov
b31358933b
Merge pull request #52954 from ClickHouse/fix-error-code
Fix wrong error code "BAD_GET"
2023-08-04 16:26:33 +03:00
kssenii
12ed37e99a Fix 2023-08-04 13:08:01 +02:00
Duc Canh Le
8aaa46ca90 StorageJoin: do not create clone hash join with all columns 2023-08-04 11:07:33 +00:00
kssenii
4b8b78f220 Revert "Merge pull request #53044 from ClickHouse/revert-52155-database-filesystem-remove-catch"
This reverts commit e71f20891f, reversing
changes made to aa9ab58994.
2023-08-04 12:41:55 +02:00
Alexander Tokmakov
0b312f541a
Revert "Remove try/catch from DatabaseFilesystem" 2023-08-04 13:29:28 +03:00
kssenii
3d438ab91b Merge remote-tracking branch 'origin/parallelize-file-cache-metadata-download' into parallelize-file-cache-metadata-download 2023-08-04 11:55:50 +02:00
kssenii
fd8700168a Fix false positive lock order inversion 2023-08-04 11:54:34 +02:00
vdimir
8050edaff6
style convertFieldToTypeStrict 2023-08-04 09:45:13 +00:00
vdimir
079c6783a2
Update decimal_in tests for analyzer 2023-08-04 09:45:12 +00:00
vdimir
0032eb9ab7
Fix IN with decimal in analyzer 2023-08-04 09:45:08 +00:00
Vitaly Baranov
587877dba3
Merge branch 'master' into disable-fs-cache-for-backups 2023-08-04 01:15:23 +02:00
Vitaly Baranov
0af043459a
Merge pull request #52660 from vitlibar/remove-unnecessary-temp-context-access
Remove creation of a unnecessary temporary ContextAccess on login
2023-08-04 01:08:12 +02:00
Alexey Gerasimchuck
1e7daca85b Added new tests for session_log plus bugfix 2023-08-03 22:06:33 +00:00
Alexey Milovidov
95f5d2f37f
Merge pull request #52155 from ClickHouse/database-filesystem-remove-catch
Remove try/catch from DatabaseFilesystem
2023-08-03 23:02:01 +03:00
Alexander Tokmakov
968c79cf3f
Merge pull request #52956 from ClickHouse/fixes_for_databases
Fix some issues with databases
2023-08-03 19:13:41 +03:00
Maksim Kita
a0fa3cc73b EXPLAIN actions for JOIN step 2023-08-03 18:55:15 +03:00
ltrk2
a29b36612b
Merge branch 'master' into feature/mergetree-checksum-big-endian-support 2023-08-03 09:41:25 -04:00
Anton Popov
92cb5e9ae3
Merge pull request #52687 from alkorgun/fix-named-collections-on-cluster-23.7
Fix named collections on cluster 23.7
2023-08-03 14:50:28 +02:00
Kseniia Sumarokova
a8821d6a05
Merge branch 'master' into parallelize-file-cache-metadata-download 2023-08-03 14:47:18 +02:00
Kseniia Sumarokova
2e5fbfe9bf
Fix build check 2023-08-03 14:44:47 +02:00
Alexey Milovidov
29d386fec2
Merge branch 'master' into count-distinct-if 2023-08-03 15:36:11 +03:00
Alexey Milovidov
56660f44b1
Merge branch 'master' into database-filesystem-remove-catch 2023-08-03 15:08:07 +03:00
Vitaly Baranov
f427c779eb Disable using fs cache for backup/restore. 2023-08-03 13:52:32 +02:00
Igor Nikonov
4155b0adfd
Merge pull request #52768 from ClickHouse/fix-window-func-range-check
Fix: check correctly window frame bounds for RANGE
2023-08-03 13:48:55 +02:00
Alexey Milovidov
d417061886 Merge branch 'master' into fix-error-code 2023-08-03 13:48:23 +02:00
Vitaly Baranov
7a112459d3 Implement passing current roles to Context::setUser(). 2023-08-03 13:45:01 +02:00
Vitaly Baranov
16dfb028b6 Remove creation of a unnecessary temporary ContextAccess on login. 2023-08-03 13:44:59 +02:00
Alexander Tokmakov
7684e68008
Add system stop pulling replication log (#52881)
* add system stop pulling replication log

* add const

* fix another stupid test

* Update test.py
2023-08-03 13:34:43 +03:00
vdimir
9cdd4fe41a
Add info about aquired space in cache to not enough space error 2023-08-03 10:32:44 +00:00
Aleksei Filatov
bfc4c0ebe3 Fix style 2023-08-03 13:18:49 +03:00
Kseniia Sumarokova
0ec11a2d79
Merge branch 'master' into system-sync-cache 2023-08-03 12:02:18 +02:00
Aleksei Filatov
4734d416a5 Add settings and processing code 2023-08-03 12:44:44 +03:00
Kseniia Sumarokova
621d852289
Merge pull request #52778 from kssenii/revert-revert-drop-cache
Revert revert of system drop filesystem cache by key
2023-08-03 10:55:25 +02:00
Alexander Tokmakov
c4fb0a0cd5 fix two minor issue 2023-08-02 23:36:54 +02:00
Alexey Milovidov
dbf14b5e2d Fix wrong error code "BAD_GET" 2023-08-02 23:16:06 +02:00
Alexey Milovidov
e101f2011b
Merge branch 'master' into count-distinct-if 2023-08-03 00:09:52 +03:00
Igor Nikonov
44b9ed438f
Merge branch 'master' into fix-window-func-range-check 2023-08-02 19:24:55 +02:00
Anton Popov
d43e76b147 fix reading of empty Nested(Array(LowCardinality(...))) 2023-08-02 16:48:08 +00:00
ltrk2
27a2d4d1c7
Merge branch 'master' into feature/mergetree-checksum-big-endian-support 2023-08-02 11:36:43 -04:00
kssenii
c9f0c426e1 Fix style check, improve test 2023-08-02 17:15:50 +02:00
Alexey Milovidov
b17e93e78c Merge branch 'master' into database-filesystem-remove-catch 2023-08-02 17:13:12 +02:00
kssenii
0d0cbb44e8 Paralelize loading of cache metadata on startup 2023-08-02 16:46:16 +02:00
Nikita Taranov
2cbe79b529
Fix memory consumption when max_block_size is huge in Aggregator + more memory checks (#51566)
* impl

* remove checks from without_key methods

* maybe will improve smth

* add test

* Update 02797_aggregator_huge_mem_usage_bug.sql

* Update 02797_aggregator_huge_mem_usage_bug.sql

---------

Co-authored-by: Alexey Milovidov <milovidov@clickhouse.com>
2023-08-02 15:11:52 +02:00
Alexander Tokmakov
61977479be
Update SystemLog.cpp (#52858) 2023-08-02 15:18:57 +03:00
Mike Kot
1335d06b8f
Do not replicate ALTER TABLE t FREEZE on Replicated engine (#52064)
* fix

* do not replicate alter freeze

* fix

---------

Co-authored-by: Alexander Tokmakov <tavplubix@clickhouse.com>
2023-08-02 14:39:54 +03:00
JackyWoo
93b28903cb
Merge branch 'master' into optimize_uniq_to_count 2023-08-02 10:13:22 +08:00
Kseniia Sumarokova
eabca22909
Merge branch 'master' into revert-revert-drop-cache 2023-08-01 23:19:38 +02:00
Alexey Milovidov
7954b732fd
Merge branch 'master' into database-filesystem-remove-catch 2023-08-01 20:52:26 +03:00
Nikolai Kochetov
fa06056fa2 Merge branch 'master' into revert-44629-revert_flamegraph 2023-08-01 17:14:16 +00:00
Kseniia Sumarokova
dbc11b83fd
Merge branch 'master' into kssenii-patch-6 2023-08-01 18:40:20 +02:00
Kruglov Pavel
23aab71d7c
Merge branch 'master' into http-valid-json-on-exception 2023-08-01 16:47:31 +02:00
Vitaly Baranov
65bd8f5e81
Merge branch 'master' into backups-fix-tmp-files 2023-08-01 16:37:06 +02:00
Sergei Trifonov
01196ac41f
Merge branch 'master' into concurrency-control-controllable 2023-08-01 15:40:50 +02:00
alesapin
0ee9797fb8
Merge pull request #51141 from ClickHouse/azure_blob_storage_sas_token
Azure blob storage sas token
2023-08-01 12:27:17 +02:00
avogar
a71cd56a90 Output valid JSON/XML on excetpion during HTTP query execution 2023-08-01 10:06:56 +00:00
Kseniia Sumarokova
16851040df
Fix annoying test 2023-08-01 11:21:46 +02:00
Alexey Milovidov
8ce1b87cda Merge branch 'master' of github.com:ClickHouse/ClickHouse into database-filesystem-remove-catch 2023-08-01 07:30:57 +02:00
Igor Nikonov
81c08199a8
Merge branch 'master' into fix-window-func-range-check 2023-07-31 19:45:25 +02:00
Alexander Tokmakov
7359a8108b
Merge pull request #51724 from arenadata/ADQM-939
Added max_sessions_for_user setting
2023-07-31 15:38:58 +03:00
Alexander Tokmakov
01f05e14eb
Merge pull request #50424 from tonickkozlov/tonickkozlov/zk-session-lifetime
Introduce fallback ZooKeeper sessions
2023-07-31 15:14:44 +03:00
kssenii
812fbee72e Better 2023-07-31 13:06:35 +02:00
flynn
c23893d7c1
Merge branch 'master' into count-distinct-if 2023-07-31 18:53:06 +08:00
kssenii
7a631be885 Merge remote-tracking branch 'origin/system-sync-cache' into system-sync-cache 2023-07-31 12:45:05 +02:00
kssenii
5d167b4f03 Merge remote-tracking branch 'upstream/master' into system-sync-cache 2023-07-31 12:44:11 +02:00
kssenii
d136f18c30 Fix 2023-07-31 12:17:30 +02:00
Igor Nikonov
1868497534 Merge remote-tracking branch 'origin/master' into fix-window-func-range-check 2023-07-31 08:50:48 +00:00
Alexey Gerasimchuck
2c07607f25
Merge branch 'master' into ADQM-939 2023-07-31 13:43:45 +10:00
Igor Nikonov
3d7257cc7e Allow Floats as boundaries for RANGE is nonsense 2023-07-30 23:19:54 +00:00
Igor Nikonov
bdf47428f2 Merge remote-tracking branch 'origin/master' into fix-window-func-range-check 2023-07-30 22:40:58 +00:00
Igor Nikonov
6d971bc3a8 Specific check for NaN in window functions with RANGE 2023-07-30 22:35:19 +00:00
Alexey Gerasimchuck
e58b3cfd32 Implemented max sessions for user 2023-07-30 22:09:03 +00:00
alesapin
aba291ca68
Revert "Revert "Add an ability to specify allocations size for sampling memory profiler"" 2023-07-30 14:01:34 +02:00
kssenii
0cf93e7114 Reduce redundant logging 2023-07-30 13:51:10 +02:00
kssenii
20b76010ef Merge remote-tracking branch 'upstream/master' into kssenii-patch-6 2023-07-30 13:46:58 +02:00
kssenii
38f12f0664 Revert some commenting 2023-07-30 13:46:40 +02:00
kssenii
6ae6268ad0 Revert "Merge pull request #51917 from ClickHouse/revert-system-drop-filesystem-cache-by-key"
This reverts commit 520195f7ef, reversing
changes made to e36a638014.
2023-07-30 13:39:54 +02:00
Alexey Milovidov
91e67c105f
Merge pull request #52569 from ClickHouse/Realize_parameterized_view_as_new_storage_view
Realize parameterized view as new view with parameters substitued
2023-07-30 05:46:51 +03:00
Alexey Milovidov
a336f06f57
Update Context.cpp 2023-07-30 05:46:05 +03:00
Igor Nikonov
918571a5ee Fix: check correctly frame bounds for RANGE 2023-07-29 22:04:21 +00:00
ltrk2
6c9a1b14ef
Merge branch 'master' into feature/mergetree-checksum-big-endian-support 2023-07-28 16:18:46 -04:00
pufit
6211845ef0
Merge pull request #51303 from ClickHouse/deprecate-metadata-cache
Deprecate the `metadata_cache` feature
2023-07-28 10:31:02 -04:00
Alexander Tokmakov
39200606ec
Merge pull request #52174 from arenadata/ADQM-988
Added possibility to save logs on crash and options to configure logs buffer
2023-07-28 16:55:00 +03:00
Anton Kozlov
5dfc30528d Introduce fallback ZooKeeper sessions 2023-07-28 11:43:27 +00:00
robot-clickhouse
bba9a2cd28
Merge pull request #51961 from nickitat/exec_udf_allow_parameters
Don't throw exception when exec udf has parameters
2023-07-28 11:52:17 +02:00
Alexey Gerasimchuck
63b05da1f2 System logs improvements 2023-07-28 07:23:34 +00:00
flynn
6de5127c0d fix conflict 2023-07-28 07:11:52 +00:00
pufit
9dbb106dc1 Fix tests, docs 2023-07-27 23:37:09 -04:00
Al Korgun
ebbd662071
Merge branch 'ClickHouse:master' into fix-named-collections-on-cluster-23.7 2023-07-27 23:31:35 +03:00
Azat Khuzhin
d40dbdee62 Fix usage of temporary directories during RESTORE
Previously during RESTORE you may get the following warning in logs:

    <Warning> TemporaryFileOnDisk: Temporary path 'tmp/21672kaaaaa' does not exist in './disks/s3_common_disk/'

The reason is that it uses not disks/s3_common_disk/tmp but instead
disks/s3_common_disk/disks/s3_common_disk/tmp path.

Fix this by adding TemporaryFileOnDisk::getRelativePath() and use it
when appropriate.

And now - `find disks`, does not shows any more temporary leftovers.

v2: rename getPath to getAbsolutePath
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-07-27 19:24:54 +02:00
Robert Schulze
c2ee774350
Add query cache metrics to system.asynchronous_metrics
Cf. https://github.com/ClickHouse/ClickHouse/pull/52384#issuecomment-1653241216
2023-07-27 15:19:01 +00:00
Robert Schulze
d48b1cadb0
Merge pull request #52384 from rschu1ze/query_cache_usage_in_query_log
Include query cache usage in SYSTEM.QUERY_LOG
2023-07-27 17:16:54 +02:00
Jiebin Sun
78f3a575f9
Convert hashSets in parallel before merge (#50748)
* Convert hashSets in parallel before merge

Before merge, if one of the lhs and rhs is singleLevelSet and the other is twoLevelSet,
then the SingleLevelSet will call convertToTwoLevel(). The convert process is not in parallel
and it will cost lots of cycle if it cosume all the singleLevelSet.

The idea of the patch is to convert all the singleLevelSets to twoLevelSets in parallel if
the hashsets are not all singleLevel or not all twoLevel.

I have tested the patch on Intel 2 x 112 vCPUs SPR server with clickbench and latest upstream
ClickHouse.
Q5 has got a big 264% performance improvement and 24 queries have got at least 5% performance
gain. The overall geomean of 43 queries has gained 7.4% more than the base code.

Signed-off-by: Jiebin Sun <jiebin.sun@intel.com>

* add resize() for the data_vec in parallelizeMergePrepare()

Signed-off-by: Jiebin Sun <jiebin.sun@intel.com>

* Add the performance test prepare_hash_before_merge.xml

Signed-off-by: Jiebin Sun <jiebin.sun@intel.com>

* Fit the CI to rename the data set from hits_v1 to test.hits.

Signed-off-by: Jiebin Sun <jiebin.sun@intel.com>

* remove the redundant branch in UniqExactSet

Co-authored-by: Nikita Taranov <nickita.taranov@gmail.com>

* Remove the empty methods and add throw exception in parallelizeMergePrepare()

Signed-off-by: Jiebin Sun <jiebin.sun@intel.com>

---------

Signed-off-by: Jiebin Sun <jiebin.sun@intel.com>
Co-authored-by: Nikita Taranov <nickita.taranov@gmail.com>
2023-07-27 15:06:34 +02:00
Yarik Briukhovetskyi
3e6444c108
Merge branch 'master' into optimize_uniq_to_count 2023-07-27 14:38:06 +02:00
Robert Schulze
043ad45ec3
Incorporate review feedback, pt. II 2023-07-27 09:18:24 +00:00
Alexey Milovidov
044eb0509f
Merge branch 'master' into database-filesystem-remove-catch 2023-07-27 12:12:24 +03:00
Robert Schulze
2b18872e86
Incorporate review feedback 2023-07-27 08:55:19 +00:00
robot-ch-test-poll1
abc48a0b73
Merge pull request #52627 from ClickHouse/fix_build_with_clang15
Fix build with clang-15
2023-07-27 09:49:29 +02:00
Al Korgun
f026ccf11e
Merge branch 'ClickHouse:master' into fix-named-collections-on-cluster-23.7 2023-07-27 10:48:25 +03:00
JackyWoo
7ade6169c4 fix clang-tidy checking
(cherry picked from commit 063eebc16b)
2023-07-27 15:41:00 +08:00
JackyWoo
fccd6e2abf rewrite uniq to count in new analyzer
(cherry picked from commit 8004f37e97)
2023-07-27 15:40:59 +08:00
JackyWoo
a33a6dafac rewrite support alias 2023-07-27 15:40:58 +08:00
JackyWoo
1d022fe593 add some comments
(cherry picked from commit 0dc1fdd67f)
2023-07-27 15:40:18 +08:00
JackyWoo
1729a7437a add settings 2023-07-27 15:40:18 +08:00
JackyWoo
0b4167cf10 rewrite uniq to count
(cherry picked from commit b2522d81c4)
2023-07-27 15:37:50 +08:00
Илья Коргун
7c1832fcfc Fix named collections related statements #51609 2023-07-27 09:41:47 +03:00
Alexey Milovidov
eae86f603c Fix the test 2023-07-27 06:34:09 +02:00
robot-ch-test-poll3
5db88e677b
Merge pull request #52328 from ClickHouse/Fix_parameterized_view_with_cte_multiple_usage
Fix parameterized view with cte and multiple usage
2023-07-27 00:06:10 +02:00
Nikolay Degterinsky
d89e2e6a27
Add SYSTEM STOP LISTEN query (#51016)
Co-authored-by: Nikita Mikhaylov <nikitamikhaylov@clickhouse.com>
Co-authored-by: Nikita Mikhaylov <mikhaylovnikitka@gmail.com>
2023-07-26 19:58:41 +02:00
Alexander Tokmakov
74f3e76b18 fix build with clang-15 2023-07-26 17:15:28 +02:00
Kruglov Pavel
3046886843
Merge branch 'master' into fix_insert_into_buffer_table 2023-07-26 15:20:24 +02:00
Nikita Taranov
04180549b0
Fix possible double-free in Aggregator (#52439) 2023-07-26 13:15:58 +02:00
Alexander Tokmakov
6bbed6262e
Merge branch 'master' into add_delay_for_replicated 2023-07-26 12:48:48 +03:00
Raúl Marín
10c008e5c7 Remove duplicated comment 2023-07-26 10:49:24 +02:00
Raúl Marín
974f72800f Merge remote-tracking branch 'blessed/master' into parallel_replicas_row_estimation 2023-07-26 10:35:40 +02:00
Sema Checherinda
83d869860e
Merge pull request #51946 from arenadata/ADQM-940
Expose Peak memory usage in query statistics.
2023-07-25 22:17:58 +03:00
Nikita Mikhaylov
1dc9ca2c24
Merge pull request #52549 from ClickHouse/whitespace-before-comma
Check for punctuation
2023-07-25 20:30:36 +02:00
Igor Nikonov
9b4357723f
Merge pull request #47135 from ClickHouse/remove-perf-test-duplicate-order-by-and-distinct
Remove duplicate_order_by_and_distinct optimization
2023-07-25 17:26:22 +02:00
Yarik Briukhovetskyi
11016d4c5f
Revert "Rewrite uniq to count" 2023-07-25 16:46:50 +02:00
Vasily Nemkov
6add283933
Merge branch 'master' into fix_insert_into_buffer_table 2023-07-25 16:06:42 +02:00
Anton Popov
4531b105ac
Merge branch 'master' into flush-async-insert-queue 2023-07-25 15:48:01 +02:00
Smita Kulkarni
22fec136c1 Create new StorageView with substituted parameters for every SELECT query of a parameterized view 2023-07-25 14:04:55 +02:00
Smita Kulkarni
94ff9a4696 Merge branch 'master' into Fix_parameterized_view_with_cte_multiple_usage 2023-07-25 12:08:38 +02:00
Yarik Briukhovetskyi
5f767b0dfa
Merge pull request #52004 from JackyWoo/rewrite_uniq_to_count
Rewrite uniq to count
2023-07-25 11:41:00 +02:00
Alexey Milovidov
21382afa2b Check for punctuation 2023-07-25 06:10:04 +02:00
Dmitry Kardymon
d4d381de7e Merge remote-tracking branch 'origin/master' into ADQM-940 2023-07-24 20:04:10 +00:00
Alexey Milovidov
3c034d563b
Merge pull request #52068 from azat/replicated-cluster-prep1
Preparations for Trivial Support For Resharding (part1)
2023-07-24 22:57:44 +03:00
Igor Nikonov
91f7185e8c
Merge branch 'master' into remove-perf-test-duplicate-order-by-and-distinct 2023-07-24 18:47:23 +02:00
Robert Schulze
c755fde3a4
Include query cache usage in SYSTEM.QUERY_LOG 2023-07-24 16:24:36 +00:00
Anton Popov
fbe9f8d0f6 fix recalculation of skip indexes and projcetion in ALTER DELETE 2023-07-24 14:14:12 +00:00
Alexander Tokmakov
faca49a905 Merge branch 'master' into add_delay_for_replicated 2023-07-24 16:07:38 +02:00
Nikita Taranov
df5ff1383c
Fix settings not applied for explain query when format provided (#51859) 2023-07-24 14:57:05 +02:00
Anton Popov
347f442f84 Merge remote-tracking branch 'upstream/master' into HEAD 2023-07-24 10:55:31 +00:00
Dmitry Kardymon
62f9a953fe Merge remote-tracking branch 'origin/master' into ADQM-940 2023-07-24 04:52:12 +00:00
Azat Khuzhin
323128df6f Remove non existing ctor of Cluster::Address
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-07-24 05:50:44 +02:00
Azat Khuzhin
83c0f03b98 Change signature of the updateSettingsForCluster() to avoid cluster requirement
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-07-24 05:50:44 +02:00
Azat Khuzhin
b222476090 Add ability to pass table for connections checks per-shard to ReadFromRemote
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-07-24 05:50:44 +02:00
Azat Khuzhin
a0070eda02 Slightly optimize code in ClusterProxy::executeQuery()
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-07-24 05:50:44 +02:00
Azat Khuzhin
d7f7f16fbc Introduce IStorage::supportsTrivialCountOptimization()
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-07-24 05:50:44 +02:00
JackyWoo
ab3376a998
Merge branch 'master' into rewrite_uniq_to_count 2023-07-24 11:04:36 +08:00
Alexey Milovidov
ffc3028438
Merge pull request #52146 from ClickHouse/more-changes
Fix ORDER BY tuple of WINDOW functions (and slightly more changes)
2023-07-24 03:00:35 +03:00
Ilya Yatsishin
7a24ed195d
Merge branch 'master' into create-index-unique-noop 2023-07-23 20:47:11 +02:00
Alexey Milovidov
5c2eb2d749
Merge pull request #52438 from ClickHouse/fix_remove_redundant_distinct_with_view
Fix: remove redundant distinct with views
2023-07-23 21:16:49 +03:00
SmitaRKulkarni
74e7ff9628
Merge branch 'master' into azure_blob_storage_sas_token 2023-07-23 18:21:06 +02:00
Kseniia Sumarokova
b6ef57d32e
Merge pull request #52378 from kgoralski/filesystemCacheSizeLimitMetric
New metric - Filesystem cache size limit
2023-07-23 18:12:11 +02:00
Alexey Milovidov
13ca31edd4
Merge pull request #52418 from ClickHouse/kssenii-patch-8
Fix flaky gtest_lru_file_cache.cpp
2023-07-23 19:02:58 +03:00
Alexey Milovidov
43bd6d1b83
Revert "Add an ability to specify allocations size for sampling memory profiler" 2023-07-23 19:00:49 +03:00
Vasily Nemkov
9bd8bdca98
Better error message in case of empty database name 2023-07-23 01:14:26 +02:00
alesapin
d1fa105d60
Merge branch 'master' into add_delay_for_replicated 2023-07-23 00:12:29 +02:00
Vasily Nemkov
12065d94c5
Update comment DatabaseCatalog.cpp 2023-07-22 23:59:02 +02:00
Vasily Nemkov
dc7c663962
Update comment in DatabaseCatalog.cpp 2023-07-22 23:44:11 +02:00
robot-ch-test-poll3
c9eb144e15
Merge pull request #50826 from ucasfl/is_obsolete
Add a column is_obsolete to system.settings and similar tables
2023-07-22 22:43:11 +02:00
Igor Nikonov
82adef03ab Merge remote-tracking branch 'origin/master' into fix_remove_redundant_distinct_with_view 2023-07-22 18:10:24 +00:00
flynn
e29c870b9c fix conlict 2023-07-22 16:42:37 +00:00
alesapin
835c36cbf3
Merge pull request #52419 from ClickHouse/implement_borders_for_sampling_memory_profiler
Add an ability to specify allocations size for sampling memory profiler
2023-07-22 18:13:26 +02:00
Alexey Milovidov
9e25c60b69
Merge branch 'master' into more-changes 2023-07-22 18:36:31 +03:00
Alexey Milovidov
04462333d2
Merge pull request #52327 from amosbird/fix_50183
Add back missing projection QueryAccessInfo.
2023-07-22 17:50:03 +03:00
Kseniia Sumarokova
6f71adcca2
Merge branch 'master' into filesystemCacheSizeLimitMetric 2023-07-22 14:47:50 +02:00
Kseniia Sumarokova
e26dc1e494
Merge pull request #52435 from Algunenano/filecache_syscalls
Reduce the number of syscalls in FileCache::loadMetadata
2023-07-22 14:47:02 +02:00
alesapin
6416fb6eed
Merge branch 'master' into add_delay_for_replicated 2023-07-22 12:11:39 +02:00
Kseniia Sumarokova
5ca6c97832
Update gtest_lru_file_cache.cpp 2023-07-22 12:03:20 +02:00
vdimir
b98dce16e2
Merge pull request #52187 from canhld94/range_dict_no_direct_join 2023-07-22 10:48:24 +02:00
Alexey Milovidov
9dc988981e
Merge branch 'master' into is_obsolete 2023-07-22 04:59:26 +03:00
Alexey Milovidov
2d89dba8d1
Merge pull request #51796 from rschu1ze/show-index-better-mysql-compat
Improve MySQL compatibility of statement `SHOW INDEX`
2023-07-22 01:22:47 +03:00
Vasily Nemkov
5ec63c782c Fixed inserting into Buffer engine
by not throwing exception from DatabaseCatalog::tryGetTable() when database name is empty
2023-07-22 00:17:57 +02:00
Igor Nikonov
687cbc57bb Fix typo 2023-07-21 22:15:02 +00:00
robot-ch-test-poll2
69b897d726
Merge pull request #52113 from arenadata/ADQM-996
Collect logs for the system.text_log table even before it is initialized, to record the server startup
2023-07-22 00:01:45 +02:00
Igor Nikonov
6c8d5ca0a5 Fix: remove redundant distinct with views 2023-07-21 21:33:51 +00:00
Igor Nikonov
8c8e097b72
Merge pull request #51013 from bigo-sg/grace_hash_join_full_right_202306
Grace hash join support full & right join
2023-07-21 22:22:06 +02:00
Nikolai Kochetov
01cb502af3
Merge pull request #52151 from amosbird/fix_52075
Fix incorrect projection analysis when aggregation expression contains monotonic functions
2023-07-21 18:30:27 +02:00
Raúl Marín
3acb6005f0 Reduce the number of syscalls in FileCache::loadMetadata 2023-07-21 17:08:01 +02:00
kssenii
2b02148e6f Fix unit test 2023-07-21 16:24:55 +02:00
Antonio Andelic
6ed97a944f
Merge pull request #49450 from myrrc/feature/keeper-dyn-reconf
`reconfig` support for CH Keeper
2023-07-21 15:59:25 +02:00
Yarik Briukhovetskyi
e7b9b42326
Merge branch 'master' into rewrite_uniq_to_count 2023-07-21 15:30:03 +02:00
Alexander Sapin
4695ec6802 Add an ability to specify allocations size for sampling memory profiler 2023-07-21 14:56:29 +02:00
Kseniia Sumarokova
8ec8388a9e
Update gtest_lru_file_cache.cpp 2023-07-21 14:53:02 +02:00
robot-clickhouse-ci-2
0db9c79886
Merge pull request #52332 from rschu1ze/better-formatsettings
Minor: Less awkward IAST::FormatSettings
2023-07-21 14:49:58 +02:00
ltrk2
90a2c460c6
Merge branch 'master' into feature/mergetree-checksum-big-endian-support 2023-07-21 08:07:18 -04:00
Kseniia Sumarokova
97c1b9d2cf
Merge branch 'master' into kssenii-patch-6 2023-07-21 13:56:28 +02:00
Antonio Andelic
10c2d5dade
Merge branch 'master' into feature/keeper-dyn-reconf 2023-07-21 13:24:18 +02:00
Kseniia Sumarokova
e638a9ecd3
Fix style check 2023-07-21 12:24:36 +02:00
Krzysztof Góralski
3412dd2259
removed unnecessary whitespace 2023-07-21 12:14:30 +02:00
Krzysztof Góralski
930d45303c
removing the metric set from LRUFileCachePriority.cpp 2023-07-21 12:13:38 +02:00
Krzysztof Góralski
5fa45bdbea
Setting the metric FilesystemCacheSizeLimit in LRUFileCachePriority.h 2023-07-21 12:12:34 +02:00
Amos Bird
8187118232
Better code 2023-07-21 16:47:23 +08:00
Amos Bird
53d77e6b13
Add back missing projection QueryAccessInfo. 2023-07-21 16:47:22 +08:00
Amos Bird
ec22337284
Fix index analysis with indexHint as well 2023-07-21 14:54:50 +08:00
SmitaRKulkarni
4854487ef7
Merge branch 'master' into Fix_parameterized_view_with_cte_multiple_usage 2023-07-21 08:29:27 +02:00
Dmitry Kardymon
5124f74fcc Merge remote-tracking branch 'origin/master' into ADQM-996 2023-07-21 05:54:36 +00:00
pufit
2a00e2aa6a Implement MOVE query for the access entities. 2023-07-20 22:20:36 -04:00
Duc Canh Le
1ae6621f56
Merge branch 'master' into range_dict_no_direct_join 2023-07-21 09:25:42 +08:00
Krzysztof Góralski
ed59870f92
Update LRUFileCachePriority.cpp 2023-07-20 18:04:58 +02:00
Nikita Mikhaylov
668062dc29
Merge branch 'master' into no-keep-context-lock-while-calculating-access 2023-07-20 14:42:13 +02:00
Nikita Mikhaylov
b14277773f
Merge pull request #52260 from ClickHouse/fix-s2
Better detecting of invalid S2 geo primitives
2023-07-20 14:25:44 +02:00
Alexander Tokmakov
f53ff5d4f2
more fair queue for drop table sync (#52276) 2023-07-20 14:51:01 +03:00
János Benjamin Antal
e74acda53e
PRQL integration (#50686)
* Added prql-lib

* Add PRQL parser

* Extend stateless tests

* Add unit tests for `ParserPRQL`

---------

Co-authored-by: Ubuntu <ubuntu@ip-172-31-37-24.eu-central-1.compute.internal>
Co-authored-by: Ubuntu <ubuntu@ip-10-10-10-195.eu-central-1.compute.internal>
Co-authored-by: Александр Нам <47687537+seshWCS@users.noreply.github.com>
2023-07-20 12:54:42 +02:00
Robert Schulze
bd761c365a
Make serializeAST() more regular 2023-07-20 10:39:26 +00:00
lgbo-ustc
91dc6a35e1 update 2023-07-20 18:22:01 +08:00
lgbo-ustc
0ba97eeea5 wip: grace hash join support full & right join 2023-07-20 18:22:01 +08:00
Robert Schulze
9933589c56
Merge pull request #52312 from rschu1ze/beautify-system-query-cache
Beautify pretty-printing of the query string in SYSTEM.QUERY_CACHE
2023-07-20 12:20:04 +02:00
Dmitry Kardymon
ff235e0f30 Turn off log in queue, fix data race 2023-07-20 05:41:39 +00:00
ltrk2
a753c3c6ad
Merge branch 'master' into feature/mergetree-checksum-big-endian-support 2023-07-19 16:22:58 -04:00
Igor Nikonov
5052b257d3 Merge remote-tracking branch 'origin/master' into remove-perf-test-duplicate-order-by-and-distinct 2023-07-19 19:37:39 +00:00
robot-ch-test-poll
0e46565968
Merge pull request #51633 from ClickHouse/vdimir/asof_join_no_syntax_pushdown
Do not apply PredicateExpressionsOptimizer for ASOF/ANTI join
2023-07-19 20:12:52 +02:00
ltrk2
ba4072f049 Adapt changes around SipHash 2023-07-19 10:01:58 -07:00
ltrk2
6b96a3943d Update further uses of SipHash 2023-07-19 10:01:58 -07:00
ltrk2
51e2c58a53 Implement endianness-independent SipHash and MergeTree checksum serialization 2023-07-19 10:01:55 -07:00
Han Fei
6bbdf702ae
Merge branch 'master' into hanfei/support-insert-token 2023-07-19 17:05:12 +02:00
Yatsishin Ilya
6ad8c450ad style 2023-07-19 15:03:48 +00:00
Smita Kulkarni
53500be941 Updated fix of multiple usage in parameterized view to support cte by not adding column which is previously added 2023-07-19 17:03:00 +02:00
Nikita Mikhaylov
4a3f5234af
Merge pull request #51038 from evillique/headers-blacklist
Add HTTP header filtering
2023-07-19 15:49:12 +02:00
Nikita Mikhaylov
c8351b15c6
Merge branch 'master' into fix-s2 2023-07-19 15:44:13 +02:00
Robert Schulze
bdaf82922a
Use formatAST() 2023-07-19 12:56:15 +00:00
Robert Schulze
3eb23d899f
Merge remote-tracking branch 'rschu1ze/master' into beautify-system-query-cache 2023-07-19 12:55:09 +00:00
Yatsishin Ilya
b9b3222c6e Add support for CREATE UNIQUE INDEX systax in parser. No UNIQUE index created. 2023-07-19 12:23:39 +00:00
alesapin
45a7134478
Merge branch 'master' into feature/keeper-dyn-reconf 2023-07-19 14:04:59 +02:00
Robert Schulze
f22452c78c
Beautify pretty-printing of the query string in SYSTEM.QUERY_CACHE.
Output of SYSTEM.QUERY_CACHE

- before this PR:

    SELECT * FROM system.query_cache

    Query id: 4989008b-b84c-4e57-bfe5-7fb551814812

    Row 1:
    ──────
    query:   	   SELECT 1 SETTINGS
    [...]

- after this PR:

    SELECT * FROM system.query_cache

    Query id: 4989008b-b84c-4e57-bfe5-7fb551814812

    Row 1:
    ──────
    query:   	   SELECT 1 SETTINGS use_query_cache = 1
    [...]
2023-07-19 09:10:26 +00:00
Dmitry Kardymon
aa888ad64a Separate thread mutex, add test 2023-07-19 08:46:57 +00:00
Han Fei
e8be6ec23f
Merge branch 'master' into hanfei/support-insert-token 2023-07-19 10:06:03 +02:00
JackyWoo
71c12bbdc4
Merge branch 'master' into rewrite_uniq_to_count 2023-07-19 15:54:23 +08:00
Dmitry Kardymon
65de310137 Return back SystemLogBase 2023-07-19 06:15:57 +00:00
Alexey Milovidov
5a89e03125
Merge branch 'master' into more-changes 2023-07-18 23:15:27 +03:00
Dmitry Kardymon
9b951e965b Restore define 2023-07-18 19:48:43 +00:00
Alexey Milovidov
482c8b5cde
Merge pull request #52158 from ClickHouse/fix-unexpected-ast-set
Fix unexpected AST Set
2023-07-18 22:17:51 +03:00
Dmitry Kardymon
68a501a14e Merge remote-tracking branch 'origin/master' into ADQM-940 2023-07-18 18:16:09 +00:00
Dmitry Kardymon
9d0391e6fb Add ifndef to fix build 2023-07-18 18:13:57 +00:00
Dmitry Kardymon
f091baaa0f Remove whitespaces 2023-07-18 14:33:26 +00:00
Igor Nikonov
90e393ecf6 Merge remote-tracking branch 'origin/master' into remove-perf-test-duplicate-order-by-and-distinct 2023-07-18 14:26:22 +00:00
Nikita Mikhaylov
a06631f0db Better detecting invalid figures 2023-07-18 16:26:10 +02:00
Dmitry Kardymon
7466ef5837 Add index 2023-07-18 13:05:20 +00:00
Ilya Yatsishin
73246b4788
Merge pull request #52056 from ClickHouse/ignore-create-index-query
Allow to ignore CREATE INDEX query for better SQL syntax compatibility
2023-07-18 14:40:38 +02:00
Dmitry Kardymon
6b00a38aa4 Remove SystemLogBase (wip) 2023-07-18 10:06:44 +00:00
Duc Canh Le
9b7df9e12e fix for analyzer 2023-07-18 05:51:55 +00:00
Vitaly Baranov
4963cfba39
Merge branch 'master' into no-keep-context-lock-while-calculating-access 2023-07-18 07:35:39 +02:00
Alexey Milovidov
3dbad00313
Merge branch 'master' into deprecate-metadata-cache 2023-07-18 05:27:15 +03:00
Alexey Milovidov
da29166f08
Merge branch 'master' into fix-unexpected-ast-set 2023-07-17 23:17:55 +03:00
Alexey Milovidov
4143779ac5
Merge branch 'master' into vdimir/asof_join_no_syntax_pushdown 2023-07-17 21:36:56 +03:00
Nikita Mikhaylov
ee0bbc0e54
Merge branch 'master' into headers-blacklist 2023-07-17 19:08:52 +02:00
Nikita Mikhaylov
11cc8b4adf
Merge branch 'master' into add_delay_for_replicated 2023-07-17 19:04:29 +02:00
Dmitry Kardymon
76abbce918 Trying to add methods to queue 2023-07-17 16:33:04 +00:00
Kruglov Pavel
2793305a71
Merge pull request #51825 from ucasfl/schema
Fix use_structure_from_insertion_table_in_table_functions does not work with materialized and alias columns
2023-07-17 18:25:54 +02:00
SmitaRKulkarni
3bb7db45c4
Merge branch 'master' into azure_blob_storage_sas_token 2023-07-17 17:23:29 +02:00
Robert Schulze
e71efe5c5c
Merge branch 'master' into show-index-better-mysql-compat 2023-07-17 16:19:51 +02:00
Vitaly Baranov
815a3857de Remove non-const function Context::getClientInfo(). 2023-07-17 15:02:07 +02:00
Nikita Mikhaylov
d5b97e4cc1
Merge branch 'master' into deprecate-metadata-cache 2023-07-17 15:00:27 +02:00
Nikita Mikhaylov
01cd7a1fd7 Better 2023-07-17 12:59:58 +00:00
Vitaly Baranov
0e4b75a282 Avoid keeping lock Context::getLock() while calculating access rights when a user logs in. 2023-07-17 14:59:14 +02:00
Vitaly Baranov
018546a57d Avoid keeping lock Context::getLock() while recalculating access rights of a connected user. 2023-07-17 14:59:14 +02:00
Han Fei
b75c4ae2e5 Merge branch 'master' into hanfei/support-insert-token 2023-07-17 14:57:48 +02:00
robot-ch-test-poll2
7f960c2379
Merge pull request #51160 from Algunenano/async_to_query_log
Log async insert flush queries into to system.query_log and system.processes
2023-07-17 13:49:22 +02:00
Antonio Andelic
61dc020b4d
Merge branch 'master' into feature/keeper-dyn-reconf 2023-07-17 12:50:17 +02:00
Sergei Trifonov
37db4a917b
Merge branch 'master' into ch_add_max_execution_time_leaf 2023-07-17 11:08:42 +02:00
Duc Canh Le
0917cf0588 disable direct join for range dictionary 2023-07-17 08:16:58 +00:00
Dmitry Kardymon
708b980d69 Fix arg name to fix build 2023-07-17 05:36:24 +00:00
Alexey Milovidov
7915ba253b Better version 2023-07-17 04:49:04 +02:00
Alexey Milovidov
18bcbe400b Remove unused headers 2023-07-16 23:26:21 +02:00
Alexey Milovidov
422881ac2c Fix logical error: cannot get name of not a column: Set 2023-07-16 23:21:30 +02:00
Alexey Milovidov
9bf114f9a3
Merge pull request #52145 from ClickHouse/fix-order-by-tuple-of-window-functions
Fix ORDER BY tuple of WINDOW functions
2023-07-16 17:43:07 +03:00
Alexey Milovidov
c620891340 Slightly more changes 2023-07-16 03:14:44 +02:00
Alexey Milovidov
9a421369d7
Merge pull request #49709 from amosbird/fix_49695
Fix projection with optimize_aggregators_of_group_by_keys
2023-07-16 04:10:54 +03:00
Alexey Milovidov
66b66db39d Fix ORDER BY tuple of WINDOW functions 2023-07-16 02:52:06 +02:00
Han Fei
7761e5ef9d support async_deduplicate_token for async insert 2023-07-15 14:42:08 +02:00
Dmitry Kardymon
fe6918a9d5 Merge remote-tracking branch 'origin/master' into ADQM-996 2023-07-14 06:56:06 +00:00
Dmitry Kardymon
4a10c7286e Add name to logger in queue 2023-07-13 12:41:17 +00:00
Dmitry Kardymon
3649f10444 Remove spaces 2023-07-13 05:19:18 +00:00
Nikita Taranov
4e70272da1 impl 2023-07-12 23:06:46 +02:00
Dmitry Kardymon
771b1f8f47 Prototype (working) 2023-07-12 15:48:09 +00:00
Yatsishin Ilya
31806d0b6c no style 2023-07-12 11:14:49 +00:00
Raúl Marín
09a6472874
Merge branch 'master' into async_to_query_log 2023-07-12 12:26:47 +02:00
Yatsishin Ilya
3bd9c57a8c allow to ignore CREATE INDEX query for better SQL syntax compatibility 2023-07-12 09:29:36 +00:00
Amos Bird
52246ab5b5
Ignore setting constraints for projection ASTs 2023-07-12 10:34:36 +08:00
Raúl Marín
b6900c8517 Add support for the analyzer 2023-07-11 13:57:51 +02:00
Raúl Marín
0d9888e183 Cleanup parallel replica adjustement 2023-07-11 13:57:51 +02:00
Raúl Marín
dd3917760f Partially cleanup the TODO 2023-07-11 13:57:51 +02:00
Raúl Marín
d5c332327d Start cleaning up things 2023-07-11 13:57:51 +02:00
Raúl Marín
dacc8cb4c9 Don't attempt to work with not mergetree tables 2023-07-11 13:57:51 +02:00
Raúl Marín
088b0527f6 Consider trivial LIMIT when deciding on parallel replicas 2023-07-11 13:57:51 +02:00
Raúl Marín
f5e0c1bd25 Interpreter: Control number of parallel replicas based on row estimation 2023-07-11 13:57:51 +02:00
Alexey Gerasimchuck
800807c8a2
Merge branch 'master' into ADQM-970 2023-07-11 16:02:31 +10:00
JackyWoo
063eebc16b fix clang-tidy checking 2023-07-11 12:59:34 +08:00
pufit
77e45e5669 Add DROP ROLE ... FROM and CREATE ROLE ... AT syntax 2023-07-10 20:23:03 -04:00
Dmitry Kardymon
09ba975ffc Merge remote-tracking branch 'origin/master' into ADQM-940 2023-07-10 13:32:29 +00:00
JackyWoo
8004f37e97 rewrite uniq to count in new analyzer 2023-07-10 17:16:41 +08:00
JackyWoo
ca6905b308 rewrite support alias 2023-07-10 17:16:41 +08:00
JackyWoo
0dc1fdd67f add some comments 2023-07-10 17:16:41 +08:00
JackyWoo
bcfc0db9f1 add settiings 2023-07-10 17:16:41 +08:00
JackyWoo
b2522d81c4 rewrite uniq to count 2023-07-10 17:16:41 +08:00
lgbo
344bc05156
wip: reserve hash table size (#50875) 2023-07-10 10:44:01 +02:00
Raúl Marín
dbdfc07790
Merge branch 'master' into async_to_query_log 2023-07-10 10:32:56 +02:00
Alexey Gerasimchuck
2c8564e45e
Merge branch 'master' into ADQM-970 2023-07-10 15:53:08 +10:00
Alexey Milovidov
dd80bdb859
Merge pull request #51993 from azat/symbol-index-cleanup
Cleanup SymbolIndex after reload got removed
2023-07-10 00:58:16 +03:00
Han Fei
4f48d92db4
Merge branch 'master' into revert-51390-revert-50951 2023-07-09 15:16:50 +02:00
Azat Khuzhin
d520413454 Cleanup SymbolIndex after reload got removed
Remove MultiVersion for SymbolIndex structure since after #51873 it is
useless.

Follow-up for: #51873
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-07-09 09:25:11 +02:00
Alexey Milovidov
4c20d482ba
Merge branch 'master' into is_obsolete 2023-07-09 08:49:00 +03:00
Alexey Milovidov
3d4800995f
Merge pull request #49732 from nickitat/impr_prefetch
Improve reading with prefetch
2023-07-09 06:10:58 +03:00
Alexey Milovidov
780a54afb4
Merge pull request #51545 from azat/dist/fix-selector-SIGSEGV
Fix SIGSEGV for clusters with zero weight across all shards (fixes INSERT INTO FUNCTION clusterAllReplicas())
2023-07-09 05:31:39 +03:00
Alexey Milovidov
0440dde315
Merge pull request #51873 from ClickHouse/remove-useless-system-query
Remove useless code
2023-07-08 21:11:41 +03:00
Alexey Milovidov
b44c582c40
Merge pull request #51951 from ClickHouse/more_logs_on_shutdown
Better logs on shutdown
2023-07-08 19:51:38 +03:00
Alexey Milovidov
b2fb5b20c8
Merge branch 'master' into dist/fix-selector-SIGSEGV 2023-07-08 19:32:59 +03:00
Alexey Milovidov
58ee566278
Merge pull request #51964 from ClickHouse/allow-parametric-udfs
Allow parametric UDFs
2023-07-08 19:12:48 +03:00
Alexey Milovidov
b958499c27
Merge pull request #51458 from ClickHouse/sunny19930321-fix-attach-table-function-name-normalizer
Merging #36384
2023-07-08 10:37:11 +03:00
Alexey Milovidov
0b0caec9c4
Update Context.cpp 2023-07-08 07:51:17 +03:00
Alexey Milovidov
0512169e19
Merge branch 'master' into remove-useless-system-query 2023-07-08 02:46:41 +03:00
Alexey Milovidov
933a92e176 Merge branch 'master' into remove-useless-system-query 2023-07-08 01:45:19 +02:00
Alexey Milovidov
25aa6fcff9
Merge pull request #51947 from ClickHouse/fix-50669
Do not remove inputs after ActionsDAG::merge
2023-07-08 02:42:14 +03:00
Alexey Milovidov
03d2606eb9
Merge pull request #49342 from ClickHouse/disks-space-improvement
Slight improvement in Disks interface
2023-07-08 02:24:57 +03:00
Alexey Milovidov
e56a5bbd8b
Merge pull request #51865 from ClickHouse/remove-useless-logs
Remove useless logs
2023-07-08 02:23:00 +03:00
Alexey Milovidov
a96874850e Revert "Merge pull request #48115 from save-my-heart/throw_non_parametric_function"
This reverts commit 5f930aeb26, reversing
changes made to 35572321a1.
2023-07-08 00:55:57 +02:00
Alexey Milovidov
520195f7ef
Merge pull request #51917 from ClickHouse/revert-system-drop-filesystem-cache-by-key
Revert system drop filesystem cache by key
2023-07-07 19:44:28 +03:00
Alexander Tokmakov
93b76c9321 better logs on shutdown 2023-07-07 18:40:43 +02:00
Alexander Tokmakov
152a4b9d4c
Merge pull request #51908 from ClickHouse/fix_deadlock_on_catalog_shutdown
Fix deadlock on DatabaseCatalog shutdown
2023-07-07 19:06:34 +03:00
Nikolai Kochetov
82cbc4e6e3
Merge branch 'master' into fix-50669 2023-07-07 16:35:50 +02:00
Nikolai Kochetov
ee33000fc2 Fixing tests. 2023-07-07 14:08:54 +00:00
Nikolai Kochetov
fa7fe5277c Better comment. 2023-07-07 12:25:13 +00:00
Nikolai Kochetov
1e0d97c282 Do not remove inputs after ActionsDAG::merge 2023-07-07 12:19:10 +00:00
Dmitry Kardymon
3fcfbb1038 Merge remote-tracking branch 'clickhouse/master' into ADQM-940 2023-07-07 15:09:41 +03:00
Alexey Milovidov
03c4a6e26c
Merge branch 'master' into sunny19930321-fix-attach-table-function-name-normalizer 2023-07-07 13:45:30 +03:00
Alexey Milovidov
7820876f2d
Merge branch 'master' into remove-useless-logs 2023-07-07 13:44:04 +03:00
Alexey Milovidov
4a6a6fc4f2
Merge branch 'master' into disks-space-improvement 2023-07-07 13:43:04 +03:00
Alexey Milovidov
b5f9a170eb
Merge pull request #51848 from ClickHouse/many-fixes-3
Many fixes [3]
2023-07-07 13:29:49 +03:00
Nikolay Degterinsky
e98d136243
Merge branch 'master' into headers-blacklist 2023-07-07 04:44:06 +02:00
Alexey Milovidov
7cece62d26 Revert "Merge pull request #51547 from kssenii/more-flexible-drop-cache"
This reverts commit 2ce7bcaa3d, reversing
changes made to e897207cd5.
2023-07-07 04:07:19 +02:00
Alexey Milovidov
f0cc90a7fb Revert "Merge pull request #51822 from kssenii/minor-changes"
This reverts commit 5ac85f4fa8, reversing
changes made to 376c903da9.
2023-07-07 04:07:03 +02:00
Alexander Tokmakov
fde44fe9f0
Merge branch 'master' into fix_deadlock_on_catalog_shutdown 2023-07-07 02:59:29 +03:00
Alexander Tokmakov
fc19e74ba9 fix deadlock on DatabaseCatalog shutdown 2023-07-07 01:12:17 +02:00
Alexander Tokmakov
fdbd59ec6c
Merge pull request #51135 from ClickHouse/fix_trash_in_disks
Try to fix some trash in Disks and part moves
2023-07-07 02:02:17 +03:00
Mike Kot
8b6376005a "reconfig" support for CH Keeper 2023-07-07 00:20:54 +03:00
robot-clickhouse-ci-2
99c64971bd
Merge pull request #51737 from ClickHouse/fix_logical_error_grace_hash_join
Fix: logical error in grace hash join
2023-07-06 19:27:03 +02:00
Igor Nikonov
83af43b8ba
Merge pull request #51852 from ClickHouse/fix-misleading-naming-in-joins
Change misleading name in joins: addJoinedBlock -> addBlockToJoin
2023-07-06 17:27:26 +02:00
Igor Nikonov
7c0e50c4d5
Merge branch 'master' into fix-misleading-naming-in-joins 2023-07-06 17:26:38 +02:00
Robert Schulze
9a295eca46
Incorporate review feedback 2023-07-06 15:03:15 +00:00
Alexey Milovidov
6d8434c702 Merge branch 'master' into many-fixes-3 2023-07-06 16:17:32 +02:00
Raúl Marín
bd779c8066
Merge branch 'master' into async_to_query_log 2023-07-06 15:46:27 +02:00
Nikita Taranov
c23e29d6aa don't account session's memory in thread/user mem tracker 2023-07-06 14:41:03 +02:00
Alexander Sapin
30bcc73c63 Merge branch 'master' into add_delay_for_replicated 2023-07-06 14:29:15 +02:00
Alexander Tokmakov
52a26a6653
Merge pull request #51708 from velavokr/velavokr-issue-51292
#51292 added default_temporary_table_engine setting
2023-07-06 15:18:14 +03:00
Kseniia Sumarokova
605e833576
Merge branch 'master' into minor-changes 2023-07-06 12:09:01 +02:00
Duc Canh Le
203a199835
Merge branch 'master' into ch_add_max_execution_time_leaf 2023-07-06 17:45:26 +08:00
Smita Kulkarni
2d3a148ffd Added option to check if container exists before attempting to read/create it, added this flag for all table functions, only used in azureBlobStorage 2023-07-06 10:56:07 +02:00
Alexey Milovidov
d59f68b600 Remove useless code 2023-07-06 04:55:46 +02:00
flynn
c9afcd781e
Merge branch 'master' into schema 2023-07-06 10:31:53 +08:00
Alexey Milovidov
2e454ef89e
Merge branch 'master' into disks-space-improvement 2023-07-06 03:58:45 +03:00
Alexey Milovidov
5452f2106f
Merge branch 'master' into sunny19930321-fix-attach-table-function-name-normalizer 2023-07-06 03:50:18 +03:00
Alexey Milovidov
db14b2c54f Remove useless logs 2023-07-06 02:16:38 +02:00
Alexey Milovidov
b75a83d32d Merge remote-tracking branch 'origin/vdimir/anti_join_logical_error_51312' into many-fixes-3 2023-07-06 01:21:38 +02:00
Igor Nikonov
023df888d3
Merge branch 'master' into fix_logical_error_grace_hash_join 2023-07-05 21:38:36 +02:00
alesapin
66484a4dd0
Merge branch 'master' into add_delay_for_replicated 2023-07-05 20:03:34 +02:00
Igor Nikonov
bf190381f5 addJoinedBlock -> addBlockToJoin 2023-07-05 17:03:18 +00:00
alesapin
baee73fd96 Make shutdown of replicated tables softer 2023-07-05 18:11:25 +02:00
Robert Schulze
e37c92ee6d
Merge branch 'master' into show-index-better-mysql-compat 2023-07-05 13:32:19 +02:00
flynn
7c3c48c8c4 Fix use_structure_from_insertion_table_in_table_functions does not work for materialized and alias columns 2023-07-05 11:24:22 +00:00
kssenii
e6422f8144 Delete comment, rename variable 2023-07-05 13:08:11 +02:00
Duc Canh Le
cccc73b8a7 ch: add max_execution_time_leaf 2023-07-05 11:01:47 +00:00
kssenii
60892438ff Update .reference for tests, fix merge 2023-07-05 12:59:45 +02:00
kssenii
80dabd1346 Merge remote-tracking branch 'upstream/master' into system-sync-cache 2023-07-05 12:58:11 +02:00
Kseniia Sumarokova
244b30d659
Merge branch 'master' into resubmit-51149 2023-07-05 12:12:21 +02:00
Han Fei
2e5643cc41 use UTC LUT 2023-07-05 11:57:18 +02:00
Kseniia Sumarokova
f2d942fbb5
Merge branch 'master' into more-flexible-drop-cache 2023-07-05 11:43:57 +02:00
Han Fei
9544c035b9 Revert "refine"
This reverts commit 7f1ee68c87.
2023-07-05 11:15:31 +02:00
Robert Schulze
e3796e3054
Update ORDER BY for more stable test results 2023-07-05 09:03:23 +00:00
Alexey Milovidov
024248ea5e
Merge branch 'master' into vdimir/anti_join_logical_error_51312 2023-07-05 02:27:03 +03:00
Alexey Milovidov
9183d073af
Merge branch 'master' into remove-perf-test-duplicate-order-by-and-distinct 2023-07-05 01:57:39 +03:00
Alexey Milovidov
90cffd7f0d
Merge branch 'master' into vdimir/asof_join_no_syntax_pushdown 2023-07-05 01:41:06 +03:00
Alexey Gerasimchuck
2b77196a47
Merge branch 'master' into ADQM-970 2023-07-05 07:44:31 +10:00
Han Fei
7f1ee68c87 refine 2023-07-04 23:08:54 +02:00
Robert Schulze
f9a3856715
Poor man's tuple parsing 2023-07-04 21:02:30 +00:00
Alexey Milovidov
31f68c2c67 Merge branch 'master' into deprecate-metadata-cache 2023-07-04 22:28:14 +02:00
Alexey Milovidov
2c96580a77
Merge branch 'master' into concurrency-control-controllable 2023-07-04 23:16:04 +03:00
Alexey Milovidov
4e8405cbda Merge branch 'master' into disks-space-improvement 2023-07-04 22:00:40 +02:00
Robert Schulze
966e93b908
Point to existing system tables for alternatives 2023-07-04 19:22:08 +00:00
Robert Schulze
82e38f7736
Merge branch 'master' into show-index-better-mysql-compat 2023-07-04 20:36:22 +02:00
Alexey Milovidov
81594cc457
Merge branch 'master' into sunny19930321-fix-attach-table-function-name-normalizer 2023-07-04 20:20:14 +03:00
Robert Schulze
b71043b2c9
Fix field 'non_unique' 2023-07-04 16:57:31 +00:00
Robert Schulze
5c463838b7
Improve compatibility of 'cardinality' field 2023-07-04 16:45:10 +00:00
Robert Schulze
e9e3f87ed2
SHOW INDEX: Make fields INDEX_TYPE more compatible with MySQL 2023-07-04 16:21:55 +00:00
Robert Schulze
047060f9a4
SHOW INDEX: Make fields COMMENT and INDEX_COMMENT more compatible with MySQL 2023-07-04 16:18:11 +00:00
Igor Nikonov
3155f58941 Merge remote-tracking branch 'origin/master' into fix_logical_error_grace_hash_join 2023-07-04 15:47:04 +00:00
Igor Nikonov
1c2233b693 Fix style check 2023-07-04 15:46:40 +00:00
Han Fei
ca6930eb11
Revert "Revert "Merge pull request #50951 from ZhiguoZh/20230607-toyear-fix"" 2023-07-04 17:38:53 +02:00
flynn
6417e3dfdf
Merge branch 'master' into is_obsolete 2023-07-04 22:42:52 +08:00
kssenii
c979113ea5 Fix 2023-07-04 16:13:33 +02:00
Raúl Marín
7262433068
Merge branch 'master' into async_to_query_log 2023-07-04 12:59:04 +02:00
Igor Nikonov
30be0ab4a8 Fix: unexpected number of buckets
Number of buckets could become inconsistent
if exception was thrown during new buckets creation
2023-07-04 09:00:53 +00:00
flynn
69d20c0458
Merge branch 'master' into is_obsolete 2023-07-04 16:46:25 +08:00
Igor Nikonov
f86c5edfc4 Remove debug tracing 2023-07-04 07:55:13 +00:00
Alexey Gerasimchuck
49907818e1 Added waiting before crash log store finish 2023-07-04 02:32:08 +00:00
Alexey Milovidov
03b8c28826
Merge branch 'master' into sunny19930321-fix-attach-table-function-name-normalizer 2023-07-04 01:28:05 +03:00
Igor Nikonov
6742432fd2 Number of bucket always increased by 2, so there is no reason provide it as parameter 2023-07-03 21:58:56 +00:00
velavokr
dcc0076ded fixed comment 2023-07-03 19:10:39 +03:00
velavokr
ae87d43f88 test fixes 2023-07-03 19:10:39 +03:00
velavokr
2f85d048ae bugfix 2023-07-03 19:10:39 +03:00