thevar1able/ClickHouse
1
0
Fork 0
mirror of https://github.com/ClickHouse/ClickHouse.git synced 2024-12-12 17:32:32 +00:00
Code Issues Packages Projects Releases Wiki Activity
135,314 Commits 9,328 Branches 1,783 Tags 2.1 GiB
94f78ac44b
Commit Graph

12432 Commits

Author SHA1 Message Date
Dmitry Novik
3d0e915088
Followup to 57853 2024-01-22 14:44:07 +01:00
Alexander Tokmakov
0f0785cf20
Merge pull request #59059 from ClickHouse/revert-58838-allow-parallel-replicas-for-join-with-analyzer 
Revert "Allow parallel replicas for JOIN with analyzer [part 1]."
 2024-01-22 14:07:26 +01:00
Dmitry Novik
a18a8d8ea3
Merge pull request #59009 from nickitat/uniq_optimisation_for_distributed 
`uniqExact` state parallel merging for distributed queries
 2024-01-22 14:05:02 +01:00
kssenii
4b4eac7c06 Fix 2024-01-22 13:55:15 +01:00
Alexander Tokmakov
4315d44517
Revert "Allow parallel replicas for JOIN with analyzer [part 1]." 2024-01-22 13:30:35 +01:00
kssenii
3faf4087e3 Fix 2024-01-22 12:07:49 +01:00
Raúl Marín
d9ab300300
Merge pull request #57853 from jiebinn/rewriteSumFunction 
Rewrite the AST/Analyzer of sum(column +/- literal) function
 2024-01-22 10:41:30 +01:00
jsc0218
6f3124acdb
Merge pull request #58402 from zhangyifan27/add_max_estimated_execution_time 
Seperate max_execution_time and max_estimated_execution_time
 2024-01-21 19:57:06 -05:00
Vitaly Baranov
01aafda27b
Merge pull request #58804 from vitlibar/allow-kill-query-for-backups 
Allow KILL QUERY for backups
 2024-01-20 23:48:18 +01:00
Igor Nikonov
4be068c73b
Merge pull request #58993 from ClickHouse/revert-58992-revert_flaky 
Revive: Parallel replicas custom key: skip unavailable replicas
 2024-01-20 19:44:56 +01:00
robot-clickhouse
273a06856a
Merge pull request #59025 from ClickHouse/cpu-scheduler 
Split resource scheduler off `IO/` into `Common/Scheduler/`
 2024-01-20 15:43:50 +01:00
Kseniia Sumarokova
f3a1a2f3ad
Fix build 2024-01-20 15:02:13 +01:00
Kseniia Sumarokova
5d67e26fc4
Merge pull request #58869 from ClickHouse/force-check-for-cached-custom-disk 
Fix for custom cached disk creation
 2024-01-20 14:47:36 +01:00
serxa
824deab761 split resource scheduler off IO/ into Common/Scheduler/ 2024-01-20 12:06:26 +00:00
Igor Nikonov
59025b2d3a Merge remote-tracking branch 'origin/master' into revert-58992-revert_flaky 2024-01-19 23:38:24 +00:00
Kruglov Pavel
20379d34d5
Merge branch 'master' into variant-data-type 2024-01-19 23:17:42 +01:00
Jiebin Sun
e9662d4d62 polish the code and adjust some code style 2024-01-20 01:43:06 +08:00
Alexey Milovidov
b249416671
Merge pull request #58968 from ClickHouse/clickhouse-local-less-threads 
Less threads in `clickhouse-local`
 2024-01-19 18:03:36 +01:00
Nikita Taranov
a47d15ab62 impl 2024-01-19 16:59:01 +01:00
Dmitry Novik
728276ab3f Fix crash when indexHint() is used 2024-01-19 14:59:33 +00:00
Kseniia Sumarokova
facbd89d48
Merge pull request #58986 from ClickHouse/fix-typo 
Fix typo
 2024-01-19 14:12:50 +01:00
Igor Nikonov
131f71b50a
Revert "Revert flaky" 2024-01-19 13:51:30 +01:00
Raúl Marín
477489a05d Revert "Merge pull request #57235 from ClickHouse/pr-custom-key-failover" 
This reverts commit 8ba9b4a7ef, reversing
changes made to 0f39245cb8.
 2024-01-19 12:46:05 +00:00
kssenii
5113b719e9 Fix typo 2024-01-19 12:48:48 +01:00
Kseniia Sumarokova
b6094ac233
Merge branch 'master' into filecache-small-optimization 2024-01-19 11:59:04 +01:00
kssenii
48e489682b Merge remote-tracking branch 'origin/master' into broken-projections-better-handling 2024-01-19 10:49:27 +01:00
Kseniia Sumarokova
1c74e7fa08
Merge pull request #58902 from ClickHouse/fs-cache-refactorings 
fs cache: minor refactoring
 2024-01-19 10:25:45 +01:00
Alexey Milovidov
0c1e92aea5 Less threads in clickhouse-local 2024-01-19 04:53:14 +01:00
Robert Schulze
15700592f7
Merge remote-tracking branch 'ClickHouse/master' into column_level_compress_block 2024-01-18 19:12:57 +00:00
Yakov Olkhovskiy
1144f60515 clenup 2024-01-18 18:17:07 +00:00
Yakov Olkhovskiy
b914938c4c clenup 2024-01-18 18:10:54 +00:00
Yakov Olkhovskiy
bb1058e2b2 fix storage replacement with insertion block for analyzer 2024-01-18 17:59:23 +00:00
Kruglov Pavel
5444cde408
Merge branch 'master' into variant-data-type 2024-01-18 18:31:27 +01:00
Kseniia Sumarokova
bfe8037653
Merge branch 'master' into fix-data-race-in-slru-2 2024-01-18 16:54:52 +01:00
kssenii
d20a33424f Fix race 2024-01-18 16:53:10 +01:00
Alexander Gololobov
e9919f47c1 Move paramaters from span name to attributes 2024-01-18 14:26:19 +01:00
Nikolai Kochetov
9db8b50753
Merge pull request #58838 from ClickHouse/allow-parallel-replicas-for-join-with-analyzer 
Allow parallel replicas for JOIN with analyzer [part 1].
 2024-01-18 14:01:08 +01:00
Vitaly Baranov
4c6d3e7efa Add server settings "shutdown_wait_backups_and_restores" (default=true) 
to set whether shutdown should wait for running backups to finish or just cancel them.
 2024-01-18 13:27:14 +01:00
kssenii
dd396b678a Fix data race 2024-01-18 12:23:40 +01:00
Jiebin Sun
206e1c87e0 revise the comments 2024-01-18 19:07:02 +08:00
Duc Canh Le
22afcd46f4 add ALTER COLUMN MODIFY/RESET SETTING 
Signed-off-by: Duc Canh Le <duccanh.le@ahrefs.com>
 2024-01-18 05:17:07 +00:00
Smita Kulkarni
d3b4dea805 Fix clang tidy build 2024-01-17 20:02:17 +01:00
Alexey Milovidov
1161dbbd54
Merge pull request #57993 from mkmkme/mkmkme/reload-config-again 
Update `query_masking_rules` when reloading the config, attempt 2
 2024-01-17 17:09:36 +01:00
Jiebin Sun
784cab638a rename some function_name and add more tests 2024-01-17 22:10:08 +08:00
kssenii
591a9f9661 Update unit tests 2024-01-17 14:52:24 +01:00
kssenii
c905937ef6 Refactoring 2024-01-17 13:22:59 +01:00
Antonio Andelic
c8a313da5a
Merge pull request #58873 from ClickHouse/fix-00089_group_by_arrays_of_fixed 
Fix `00089_group_by_arrays_of_fixed` with external aggregation
 2024-01-17 12:50:30 +01:00
Kseniia Sumarokova
0b3ebcda08
Update SLRUFileCachePriority.cpp 2024-01-17 11:13:57 +01:00
Smita Kulkarni
8d88f4cf87 Update setting is_parameterized_view & settings columns for view 2024-01-17 09:42:53 +01:00
Mikhail Koviazin
9e0414f557
fix data race in SensitiveDataMasker 
This commit fixes the data race that was introduced in 3067ca6. That commit
added scope lock for `getInstance` and `setInstance`, but `getInstance`
returned a pointer that could be invalidated between call for `getInstance` and
actual usage of the pointer.

This commit changes `SensitiveDataMasker` singleton from `unique_ptr` to
`shared_ptr`, so even if `setInstance` will be called right after
`getInstance`, the pointer returned from `getInstance` will live long enough to
call `wipeSensitiveData` on it.
 2024-01-17 08:10:50 +02:00
Mikhail Koviazin
6e6197019c
Reintroduce commit 3067ca6 
Update `query_masking_rules` when reloading the config

This reverts commit 7e55eab1c3.
 2024-01-17 08:10:49 +02:00
Vitaly Baranov
c15edebadf Use the same row in system.processes and the same query_id for both a BACKUP/RESTORE query started by user and its asynchronous execution in a separate thread. 2024-01-16 18:49:37 +01:00
Antonio Andelic
4ce6b64d62 Fix 00089_group_by_arrays_of_fixed with external aggregation 2024-01-16 15:16:13 +00:00
Vitaly Baranov
185f6cc37c Add tests for cancelling backup/restore queries. 2024-01-16 15:07:20 +01:00
Kseniia Sumarokova
f2a31db9d2
Merge branch 'master' into filecache-small-optimization 2024-01-16 15:04:02 +01:00
kssenii
8decf5039a Fix for custom cached disk 2024-01-16 14:41:12 +01:00
Smita Kulkarni
76ba60aa24 Merge branch 'master' into Support_parameterized_view_with_analyzer 2024-01-16 11:26:41 +01:00
vdimir
de3e7012d5
Merge pull request #58652 from ClickHouse/vdimir/analyzer_hash_join_duplicate_columns 
Analyzer: Fix assertion in HashJoin with duplicate columns
 2024-01-16 11:12:31 +01:00
vdimir
54a79c1f3d
Merge pull request #58123 from ClickHouse/vdimir/cluster_discovery_password 
ClusterDiscovery supports setting username and password
 2024-01-16 11:05:54 +01:00
Kseniia Sumarokova
5fcf1b216b
Merge pull request #58842 from ClickHouse/fix-data-race-in-slru 
fs cache: fix data race in slru
 2024-01-16 08:53:41 +01:00
Alexey Milovidov
ebfea07f93
Merge pull request #58832 from kitaisreal/database-catalog-background-tasks-add-log-names 
DatabaseCatalog background tasks add log names
 2024-01-16 08:42:38 +01:00
Alexey Milovidov
8973e7d873
Merge pull request #58833 from ClickHouse/fix-analyzer-remote-aggregation 
Analyzer: Resolve GROUPING function on shards
 2024-01-15 23:33:14 +01:00
kssenii
e2c5e5fa70 Fix data race in slru 2024-01-15 21:19:11 +01:00
yariks5s
3eba767805 init 2024-01-15 19:17:13 +00:00
Nikolai Kochetov
733ceaa775 Allow parallel replicas for JOIN with analyzer. 2024-01-15 18:48:12 +00:00
Dmitry Novik
0f7daeffc8 Analyzer: Resolve GROUPING function on shards 2024-01-15 16:02:37 +00:00
Maksim Kita
573fa8c375 DatabaseCatalog background tasks add log names 2024-01-15 18:59:34 +03:00
vdimir
61f2ab3ec5
Update HashJoin::getNonJoinedBlocks 2024-01-15 11:37:33 +00:00
vdimir
6a1b005d7f
Fix build 2024-01-15 11:32:23 +00:00
vdimir
4adeb249d3
Analyzer: Fix assertion in HashJoin with duplicate columns 2024-01-15 11:32:22 +00:00
vdimir
89fadd7769
Update src/Interpreters/ClusterDiscovery.cpp 
Co-authored-by: Antonio Andelic <antonio2368@users.noreply.github.com>
 2024-01-15 11:22:54 +00:00
vdimir
8dc1756532
Support <secret> in cluster discovery 2024-01-15 11:22:53 +00:00
vdimir
012713fc31
ClusterDiscovery supports setting username and password 2024-01-15 11:22:48 +00:00
Azat Khuzhin
48a700edba Support query parameters in ALTER TABLE ... PART 
But, to make this happen it is not enough to simply fix the parser, the
whole ASTs for ALTER should be fixed as well, since they store `ASTPtr`
instead of `IAST *`, and so because of `ReplaceQueryParameterVisitor`
does not work for ALTER query.

So this patch converts ASTPtr to `IAST *` for ASTAlterQuery and
ASTAlterCommand (plus it also fixes when the children for
ASTAlterCommand had not been updated sometimes).

And only after this it is possible to adjust the parser (see
places with `parser_string_and_substituion` in the parser code).

v2: also fix ASTAlterCommand::clone (add missing components) and ParserAlterCommand::parseImpl
v3: fix APPLY DELETED MASK
v4: fix mutations_execute_nondeterministic_on_initiator/mutations_execute_subqueries_on_initiator
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2024-01-15 14:16:54 +03:00
Alexander Tokmakov
5128607995
Merge pull request #58393 from jaymebrd/feat/add-from-modifier-sync-replica-lightweight 
add `from srcreplicas` modifier  for `SYSTEM SYNC REPLICA LIGHTWEIGHT`
 2024-01-14 20:53:16 +01:00
Yakov Olkhovskiy
62660e6e84
Merge pull request #58703 from ClickHouse/imp-error-message 
Add identifier name to the error INVALID_IDENTIFIER
 2024-01-14 07:46:33 -05:00
Duc Canh Le
f755e77534 move column level setting to the end of declaration 
Signed-off-by: Duc Canh Le <duccanh.le@ahrefs.com>
 2024-01-14 09:36:32 +00:00
Duc Canh Le
ac76eecb1e Merge branch 'master' into column_level_compress_block 
Resolve conflicts

Signed-off-by: Duc Canh Le <duccanh.le@ahrefs.com>
 2024-01-14 09:32:43 +00:00
Alexey Milovidov
65ac905032
Merge pull request #54366 from canhld94/final_no_copy 
Implement vertical replacing FINAL
 2024-01-14 04:21:07 +01:00
Alexey Milovidov
776ea26ce7
Update PreparedSets.h 2024-01-14 02:45:51 +03:00
Alexey Milovidov
e92e3615e3
Merge branch 'master' into non-ready-set-ttl 2024-01-13 21:11:51 +01:00
Alexey Milovidov
d46ee32e06
Merge pull request #58724 from Algunenano/promote_f32 
Do not promote float32 automatically
 2024-01-13 20:29:10 +01:00
Alexey Milovidov
d112492c56 Remove some code 2024-01-13 03:48:04 +01:00
Raúl Marín
0684cc7b76 Merge remote-tracking branch 'blessed/master' into i58727 2024-01-12 16:10:43 +00:00
Nikita Mikhaylov
8edab24189
Add comments to all columns of system tables (#58356) 2024-01-12 16:39:22 +01:00
Dmitry Novik
3b1d728683
Merge pull request #58739 from ClickHouse/fix-parallel-diff-window 
Fix stream partitioning in parallel window functions
 2024-01-12 16:36:53 +01:00
Raúl Marín
8e5cd5e6b0 Try a different approach 2024-01-12 14:04:47 +00:00
kssenii
18e31df388 One more fi 2024-01-12 13:24:59 +01:00
kssenii
caf267c6ed Merge remote-tracking branch 'origin' into filecache-small-optimization 2024-01-12 13:23:45 +01:00
kssenii
c14a0e80c6 Fxi 2024-01-12 13:23:36 +01:00
Raúl Marín
78afc52564 Fix refactor 2024-01-12 12:28:03 +01:00
Raúl Marín
e22371ad03 Fix double destroy call on exception throw in addBatchLookupTable8 2024-01-12 12:02:38 +01:00
Antonio Andelic
654fee820e
Merge pull request #58665 from ClickHouse/jemalloc-system-commands 
Add SYSTEM commands and Keeper 4LW for jemalloc
 2024-01-12 10:08:13 +01:00
Dmitry Novik
91f4b20e02
Fix comments 2024-01-12 09:42:41 +01:00
Dmitry Novik
322d9478b0 Fix stream partitioning in parallel window functions 2024-01-12 08:32:34 +00:00
Yakov Olkhovskiy
84809b36c3
Merge pull request #58475 from ClickHouse/revert-58450-revert-56064-feature-server-iface-metrics 
Second attempt: Use CH Buffer for HTTP out stream, add metrics for interfaces
 2024-01-11 12:06:59 -05:00
Robert Schulze
790f5890a0
Merge pull request #58611 from rschu1ze/qc-isolation 
Improve isolation of query cache entries under re-created users or role switches
 2024-01-11 17:30:24 +01:00
Robert Schulze
bd9e38ff47
Incorporate review feedback 2024-01-11 13:53:08 +00:00
Yakov Olkhovskiy
8db5b81359
use backQuote() 
Co-authored-by: Alexander Tokmakov <tavplubix@clickhouse.com>
 2024-01-11 07:10:43 -05:00
Nikita Mikhaylov
baf4e5e894
Added comments for system tables (#48350) 2024-01-11 12:50:00 +01:00
Antonio Andelic
d1040725b2
Adress comments 2024-01-11 12:37:24 +01:00
Igor Nikonov
8ba9b4a7ef
Merge pull request #57235 from ClickHouse/pr-custom-key-failover 
Parallel replicas custom key: skip unavailable replicas
 2024-01-11 12:22:32 +01:00
Antonio Andelic
2bfed6b8eb Add system commands and 4lw for jemalloc 2024-01-11 08:24:56 +00:00
Yakov Olkhovskiy
99c421b5be add identifier name to the error INVALID_IDENTIFIER, add test 2024-01-11 03:23:18 +00:00
Duc Canh Le
6331d8a6f2 Merge branch 'master' into final_no_copy 
Resolve conflicts

Signed-off-by: Duc Canh Le <duccanh.le@ahrefs.com>
 2024-01-11 02:55:14 +00:00
Chen768959
ac224851af
Fix the exprs order bug in group by with rollup (#57786) 
* Fix the exprs order bug in group by with rollup

* update test case

* make the code simpler

* Recalculate insert_position
 2024-01-10 22:04:23 +01:00
Alexey Milovidov
f4b1275795
Merge pull request #58624 from ClickHouse/fix-58437 
Fix possible race in ManyAggregatedData dtor.
 2024-01-10 22:02:16 +01:00
Igor Nikonov
8d4a395afa Merge remote-tracking branch 'origin/master' into pr-custom-key-failover 2024-01-10 20:28:04 +00:00
Yakov Olkhovskiy
4fc11e189c
Merge branch 'master' into revert-58450-revert-56064-feature-server-iface-metrics 2024-01-10 12:03:47 -05:00
Robert Schulze
52d75ab68f
Merge pull request #58458 from rschu1ze/replace-std_regexp-by-re2 
Replace `std::regex` by re2
 2024-01-10 17:46:54 +01:00
Kseniia Sumarokova
a6b5b7460b
Merge branch 'master' into broken-projections-better-handling 2024-01-10 16:46:18 +01:00
Yakov Olkhovskiy
2e124b19b8
Merge branch 'master' into revert-58450-revert-56064-feature-server-iface-metrics 2024-01-10 09:05:18 -05:00
vdimir
9368c074fa
Merge pull request #58596 from ClickHouse/vdimir/join_issue_57894 
Fix join using nullable in old analyzer
 2024-01-10 12:20:00 +01:00
Robert Schulze
499227b9cf
Merge remote-tracking branch 'rschu1ze/master' into replace-std_regexp-by-re2 2024-01-10 10:02:53 +00:00
Robert Schulze
36173bbb7b
Merge remote-tracking branch 'rschu1ze/master' into qc_isolation 2024-01-10 09:57:13 +00:00
Robert Schulze
ced9e93ac6
Merge remote-tracking branch 'rschu1ze/master' into qatzstd_main 2024-01-09 20:36:02 +00:00
pufit
6cf55b82f4
Merge pull request #58539 from canhld94/file_custom_compress_level 
Allow explicitly set compression level in output format
 2024-01-09 13:43:38 -05:00
Robert Schulze
c04e4eb162
Merge remote-tracking branch 'rschu1ze/master' into qc-isolation 2024-01-09 16:30:20 +00:00
Anton Popov
2fd0f7be7b
Merge pull request #55579 from CurtizJ/remove-old-projections-code 
Remove more old code of projection analysis
 2024-01-09 15:51:12 +01:00
Robert Schulze
e9b6f413b8
Get rid of QueryCache::user_name 2024-01-09 12:24:12 +00:00
vdimir
4a57fd599a
Merge pull request #58595 from ClickHouse/vdimir/concurrent_hash_max_joined_rows 
Disable max_joined_block_rows in ConcurrentHashJoin
 2024-01-09 13:02:49 +01:00
vdimir
46c43e2cce
Another fix join using nullable in old analyzer 2024-01-09 11:58:50 +00:00
vdimir
06652f9714
Fix join using nullable in old analyzer 2024-01-09 11:45:34 +00:00
Nikolai Kochetov
53d24af9ec Fix possilbe race in ManyAggregatedData dtor. 2024-01-09 11:26:54 +00:00
Igor Nikonov
f566423e19 Merge remote-tracking branch 'origin/master' into pr-custom-key-failover 2024-01-09 10:38:43 +00:00
Raúl Marín
803d8d6320
Merge pull request #58594 from Algunenano/missing_includes 
Add some missing LLVM includes
 2024-01-09 11:01:44 +01:00
Bharat Nallan
ee37f551a2
independent registration of interpreters (#58443) 
* make interpreter factory an instance

* add registerInterpreter

* register interpreters individually

* try wire everything up

* fix style

* fix test
 2024-01-08 22:33:48 -08:00
Robert Schulze
fabc06995e
Improve isolation of query results in query cache 
Fixes #58054
 2024-01-08 20:52:30 +00:00
Igor Nikonov
7fd851b4e9 Merge remote-tracking branch 'origin/master' into pr-custom-key-failover 2024-01-08 20:43:20 +00:00
Kruglov Pavel
b947609b8e
Merge branch 'master' into variant-data-type 2024-01-08 15:04:51 +01:00
flynn
e2588850f6 Fix conflict 2024-01-08 11:36:19 +00:00
vdimir
631e16d8c3
Fix off-by-one error for max_joined_block_rows 2024-01-08 11:02:17 +00:00
Raúl Marín
c1b95560db Add some missing LLVM includes 2024-01-08 11:25:57 +01:00
vdimir
0f2588334f
Disable max_joined_block_rows in ConcurrentHashJoin 2024-01-08 10:20:39 +00:00
Jayme Bird
9734934d84 review fixup: don't pass in zookeeper 2024-01-08 10:02:09 +00:00
Jayme Bird
18b7f1de5f various fixups 2024-01-08 10:02:09 +00:00
Jiebin Sun
7bbeaf461f
Merge pull request #6 from jiebinn/master 
Update to the latest upstream
 2024-01-08 15:49:50 +08:00
Jiebin Sun
dfc8e79511 Add the Analyzer implementation for the RewriteSumFunctionWithSumAndCount 
Signed-off-by: Jiebin Sun <jiebin.sun@intel.com>
 2024-01-08 23:58:13 +08:00
Robert Schulze
f553b55e3a
Merge remote-tracking branch 'rschu1ze/master' into regex-std-re2 2024-01-07 22:31:35 +00:00
Robert Schulze
8e804487f3
Some fixups 2024-01-07 22:28:08 +00:00
Smita Kulkarni
16e682e0ae Merge branch 'master' into Support_parameterized_view_with_analyzer 2024-01-07 16:38:01 +01:00
Yakov Olkhovskiy
45ac4d2b67 Merge remote-tracking branch 'origin/master' into revert-58450-revert-56064-feature-server-iface-metrics 2024-01-07 15:23:46 +00:00
Robert Schulze
53965bb9f1
Merge remote-tracking branch 'rschu1ze/master' into qatzstd_main 2024-01-07 14:11:22 +00:00
zhangyifan27
730135f933 Seperate max_execution_time and max_estimated_execution_time 2024-01-07 12:32:42 +08:00
Anton Popov
8c9cf394b3 Merge remote-tracking branch 'upstream/master' into HEAD 2024-01-06 20:58:17 +00:00
Raúl Marín
4b94b48dd2 Merge remote-tracking branch 'blessed/master' into revert-58440-kitaisreal-enable-jit-for-aggregation-without-key 2024-01-06 13:25:11 +01:00
Nikolai Kochetov
c2f00bc75a
Merge pull request #58480 from ClickHouse/try-to-remove-pk-analysis-on-ast 
Check if I can remove KeyCondition analysis on AST.
 2024-01-06 12:40:46 +01:00
Anton Popov
f252412915 Merge remote-tracking branch 'upstream/master' into HEAD 2024-01-06 03:08:52 +00:00
Yakov Olkhovskiy
9ca4be5d91 Merge remote-tracking branch 'origin/master' into revert-58450-revert-56064-feature-server-iface-metrics 2024-01-06 00:24:31 +00:00
Anton Popov
24fe5f4d53 slightly better 2024-01-05 20:41:58 +00:00
Sergei Trifonov
8d6b012223
Merge pull request #57877 from azat/merges-mutations-throttling 
Add ability to throttle merges/mutations
 2024-01-05 17:08:50 +01:00
Smita Kulkarni
4be844509e Merge branch 'master' into Support_parameterized_view_with_analyzer 2024-01-05 13:58:07 +01:00
Raúl Marín
c0a44ffce4
Revert "Merging #53757" 2024-01-05 13:46:18 +01:00
Nikolai Kochetov
eff6232418 Merge branch 'master' into try-to-remove-pk-analysis-on-ast 2024-01-05 10:54:46 +00:00
Nikolai Kochetov
15b66031bc Update prepared sets. 2024-01-05 10:53:07 +00:00
Nikolai Kochetov
85ea5c1f82 Remove more code 2024-01-04 17:46:06 +00:00
Nikolai Kochetov
085484c5f1
Merge pull request #58505 from kitaisreal/merge-tree-prefetched-read-pool-disable-for-limit-only-queries 
MergeTreePrefetchedReadPool disable for LIMIT only queries
 2024-01-04 18:39:25 +01:00
Alexander Tokmakov
d2752f4b66
Merge pull request #57603 from evillique/allow-not-resolving-hostnames 
Allow avoiding resolving hostnames in DDLWorker
 2024-01-04 15:46:28 +01:00
Alexander Tokmakov
972756486a
Merge pull request #58350 from ClickHouse/rdb_dont_wait_inactive 
An option to avoid waiting for inactive Replicated database replicas
 2024-01-04 14:50:11 +01:00
Raúl Marín
971d030ec5
Merge pull request #58271 from Algunenano/speedup_numbers 
Speed up iota (filling array with consecutive numbers)
 2024-01-04 14:17:42 +01:00
Alexander Tokmakov
74fb390444 fix build 2024-01-04 13:36:42 +01:00
Maksim Kita
8573c66b09 Fixed code review issues 2024-01-04 15:29:25 +03:00
Alexander Tokmakov
10e3ae9e68 Merge branch 'master' into allow-not-resolving-hostnames 2024-01-04 13:22:15 +01:00
Maksim Kita
b5997e6a96 MergeTreePrefetchedReadPool disable for LIMIT only queries 2024-01-04 15:06:38 +03:00
Duc Canh Le
2e14cfb526 add settings for output compression level and window size 
Signed-off-by: Duc Canh Le <duccanh.le@ahrefs.com>
 2024-01-04 08:16:00 +00:00
Nikita Taranov
66d2db5283
New parallel replicas coordinator implementation (#57968) 2024-01-04 00:27:04 +01:00
Nikolai Kochetov
7a271f09ed Check if I can remove KeyCondition analysis on AST. 2024-01-03 17:50:46 +00:00
Yakov Olkhovskiy
85f03478ef
Revert "Revert "Use CH Buffer for HTTP out stream, add metrics for interfaces"" 2024-01-03 11:47:15 -05:00
Alexander Tokmakov
b1688b1953 Merge branch 'master' into rdb_dont_wait_inactive 2024-01-03 17:03:01 +01:00
Anton Popov
ce1b978a2d Merge remote-tracking branch 'upstream/master' into HEAD 2024-01-03 16:01:44 +00:00
Anton Popov
7dd128f90f Revert "remove projection from StorageSnapshot" 
This reverts commit a01acf5d2a.
 2024-01-03 16:00:50 +00:00
Nikolai Kochetov
7834519212
Merge pull request #58255 from ClickHouse/filter-virtual-columns-storage-merge 
Refactor StorageMerge virtual columns filtering.
 2024-01-03 16:09:49 +01:00
Kruglov Pavel
4d8cf71ba7
Merge branch 'master' into variant-data-type 2024-01-03 15:21:23 +01:00
Raúl Marín
ff90f64bc1 Merge remote-tracking branch 'blessed/master' into speedup_numbers 2024-01-03 13:33:22 +00:00
Alexey Milovidov
fe97671d42
Merge pull request #58440 from ClickHouse/kitaisreal-enable-jit-for-aggregation-without-key 
Merging #53757
 2024-01-03 14:05:50 +01:00
Jiebin Sun
b6b0711238 fix a bug if first_literal and second_column 
add more alias testings
 2024-01-03 17:53:59 +08:00
Raúl Marín
d491758939
Revert "Use CH Buffer for HTTP out stream, add metrics for interfaces" 2024-01-03 10:42:15 +01:00
Alexey Milovidov
eb930efebb
Merge pull request #57732 from ClickHouse/load-metadata-threads 
Increase `load_metadata_threads` to 16
 2024-01-02 22:26:18 +01:00
Alexey Milovidov
8af3b9db2d Merge branch 'enable-jit-for-aggregation-without-key' of github.com:kitaisreal/ClickHouse into kitaisreal-enable-jit-for-aggregation-without-key 2024-01-02 22:01:59 +01:00
Yakov Olkhovskiy
5633fb8145
Merge pull request #56064 from ClickHouse/feature-server-iface-metrics 
Use CH Buffer for HTTP out stream, add metrics for interfaces
 2024-01-02 10:17:52 -05:00
Kruglov Pavel
e69bda7f08
Merge pull request #57438 from Avogar/fix-resetting-buffers 
Fix working with read buffers in StreamingFormatExecutor
 2024-01-02 15:34:35 +01:00
Alexander Tokmakov
d3d5976d3e fix 2024-01-02 15:13:25 +01:00
Duc Canh Le
d623702378 Merge branch 'master' into final_no_copy 
Resolve conflicts

Signed-off-by: Duc Canh Le <duccanh.le@ahrefs.com>
 2024-01-02 06:07:49 +00:00
Alexey Milovidov
7bded0a5e7
Merge pull request #58316 from ClickHouse/reintroduce_is_deleted 
Re-introduce `is_deleted` column for ReplacingMergeTree
 2023-12-31 00:57:19 +01:00
Alexey Milovidov
b752a1c62e
Merge pull request #58365 from bharatnc/ncb/refactor-db-factory 
independent registration of database engines
 2023-12-31 00:56:24 +01:00
Alexey Milovidov
aad63c8273 Merge branch 'master' into feature-server-iface-metrics 2023-12-30 15:44:42 +01:00
Alexey Milovidov
8365722c95
Merge pull request #58336 from amosbird/macro2constexpr 
Organize symbols from src/* into DB namespace
 2023-12-30 12:40:36 +01:00
Bharat Nallan Chakravarthy
906745feaa validation and left over fixes 2023-12-29 20:06:07 -08:00
Alexey Milovidov
aa462fa7cd
Merge branch 'master' into feature-server-iface-metrics 2023-12-29 22:37:52 +01:00
Nikolay Degterinsky
47c3696a46
Fix build 2023-12-29 20:41:33 +01:00
Raúl Marín
ed6b9703a1 More iota 2023-12-29 17:20:18 +01:00
Alexander Tokmakov
1013f6b23f
Merge branch 'master' into reintroduce_is_deleted 2023-12-29 15:46:24 +01:00
Alexander Tokmakov
bfc10bd234 an option to avoid waiting for inactive Replicated db replicas 2023-12-29 15:19:16 +01:00
Raúl Marín
bda6104f84 Replace std::iota with DB::iota where possible 2023-12-29 14:38:22 +01:00
Amos Bird
6b6e40831c
Move symbols from src/* into namespace DB 2023-12-29 14:37:08 +08:00
Bharat Nallan Chakravarthy
1dce048b58 initial refactor of db registration 2023-12-28 18:59:45 -08:00
Igor Nikonov
208a9193f6 Merge remote-tracking branch 'origin/master' into pr-custom-key-failover 2023-12-28 21:28:36 +00:00
avogar
c6085b3eb9 Fix working with read buffers in StreamingFormatExecutor 2023-12-28 18:47:57 +00:00
Michael Kolupaev
96c68e5aae Remove pausing, enable multithreading, kick off refresh on table creation unless the query says EMPTY 2023-12-28 17:56:06 +00:00
Michael Kolupaev
edd120e8be Make it experimental 2023-12-28 17:56:05 +00:00
Michael Kolupaev
0fc7535eba Fixes 2023-12-28 17:56:05 +00:00
Michael Kolupaev
dda0606f67 Things 2023-12-28 17:56:05 +00:00
Michael Kolupaev
a524e8c51e Overhaul dependencies 2023-12-28 17:56:04 +00:00
Michael Kolupaev
bd18522cad Overhaul RefreshTask 2023-12-28 17:56:04 +00:00
koloshmet
c52aa984ee refreshable materialized views 2023-12-28 17:56:04 +00:00
Nikolai Kochetov
d7a473e386 Fix some test. 2023-12-28 17:34:28 +00:00
Alexander Tokmakov
bdada351c8 Revert "Merge pull request #58274 from ClickHouse/revert-58267" 
This reverts commit 583b9637c2, reversing
changes made to 224e937620.
 2023-12-28 14:07:59 +01:00
kssenii
234e13ac7e Merge remote-tracking branch 'origin' into broken-projections-better-handling 2023-12-28 13:44:04 +01:00
kssenii
08920b1fe1 Merge remote-tracking branch 'origin' into filecache-small-optimization 2023-12-28 13:26:32 +01:00
flynn
e2f4219c12 Fix 2023-12-28 12:22:30 +00:00
Alexander Tokmakov
38fe70c68a
Revert "Refreshable materialized views (takeover)" 2023-12-28 13:12:20 +01:00
flynn
32ff152f2d Support negtive position arguments 2023-12-28 11:41:06 +00:00
Alexey Milovidov
524d53199d
Merge branch 'master' into mv 2023-12-28 04:11:48 +01:00
Alexey Milovidov
c7efd2afea Revert #58267 2023-12-28 04:09:33 +01:00
Alexey Milovidov
40a5dbdeba
Merge branch 'master' into mv 2023-12-28 03:16:27 +01:00
Alexey Milovidov
8d984df135
Merge pull request #58237 from azat/build/fwd-decl-exception 
Some code refactoring (was an attempt to improve build time, but failed)
 2023-12-28 00:21:09 +01:00
Alexey Milovidov
dcbd3b9c26
Merge pull request #58267 from ClickHouse/fix_is_deleted_compatibility 
Re-introduce `is_deleted` column for ReplacingMergeTree
 2023-12-28 00:13:01 +01:00
Alexey Milovidov
5406c79c89
Merge pull request #58264 from ClickHouse/fs-cache-better-multi-cache-configuration 
Make fs caches with the same path use the same cache objects
 2023-12-28 00:10:15 +01:00
Michael Kolupaev
b9cbecb0df Remove pausing, enable multithreading, kick off refresh on table creation unless the query says EMPTY 2023-12-27 20:24:56 +00:00
Michael Kolupaev
18cc5d1b76 Make it experimental 2023-12-27 20:24:55 +00:00
Michael Kolupaev
802961f0a2 Fixes 2023-12-27 20:24:55 +00:00
Michael Kolupaev
ef4cc5ec7f Things 2023-12-27 20:24:55 +00:00
Michael Kolupaev
01369a0a8a Overhaul dependencies 2023-12-27 20:24:54 +00:00
Michael Kolupaev
01345981e2 Overhaul RefreshTask 2023-12-27 20:24:54 +00:00
koloshmet
c762898adb refreshable materialized views 2023-12-27 20:24:54 +00:00
avogar
275fbe3e98 Support function to subcolumns optimization for Variant, better text priority for reading Bool 2023-12-27 20:04:14 +00:00
Sema Checherinda
617ee5abaf
Merge pull request #57551 from bharatnc/ncb/async-metrics-pri-key-size 
add asynchronous metrics for total primary key size in memory and allocated
 2023-12-27 20:24:20 +01:00
kssenii
041c5d4219 Make caches with the same path use the same cache objects 2023-12-27 18:37:43 +01:00
Nikolay Degterinsky
3140f869cc
Fix typo 2023-12-27 17:15:44 +01:00
Alexey Milovidov
0e678fb6c1
Merge pull request #56996 from ClickHouse/vdimir/hash_join_max_block_size 
HashJoin respects max_joined_block_size_rows
 2023-12-27 15:46:46 +01:00
Alexey Milovidov
f00337e2ba
Merge pull request #57872 from CurtizJ/optimize-aggregation-consecutive-keys 
Better optimization of consecutive keys in aggregation
 2023-12-27 15:44:22 +01:00
Azat Khuzhin
b9233f6d4f Move Allocator code into module part 
This should reduce amount of code that should be recompiled on
Exception.h changes (and everything else that had been included there).

This will actually not help a lot, because it is also included into
PODArray.h and ThreadPool.h at least... Sigh.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-12-27 15:42:08 +01:00
Alexander Tokmakov
01d042c490 Revert "Merge pull request #57932 from ClickHouse/remove-shit-cleanup" 
This reverts commit 2d58dc512c, reversing
changes made to 41873dc4a3.
 2023-12-27 13:46:06 +01:00
Alexey Milovidov
d0bc4fafdb
Merge pull request #58220 from wangtZJU/fix_AddDefaultDatabaseVisitor_bad_performance 
fix CREATE VIEW hang
 2023-12-27 13:30:37 +01:00
una
0181bab23c fix:style 
Signed-off-by: una <dengmengda@gmail.com>
 2023-12-27 19:59:23 +08:00
Duc Canh Le
476ca4246d Merge branch 'master' into final_no_copy 
Resolve conflicts + add some comments

Signed-off-by: Duc Canh Le <duccanh.le@ahrefs.com>
 2023-12-27 07:00:58 +00:00
una
fa5dde0bff feat: Add initial query event 2023-12-27 12:37:06 +08:00
Nikolay Degterinsky
547e3ed6c0 Add a check for the 'host_name' parameter 2023-12-26 22:57:31 +00:00
Igor Nikonov
bee15325fc Merge remote-tracking branch 'origin/master' into pr-custom-key-failover 2023-12-26 21:56:46 +00:00
Raúl Marín
e87b9751bd Cleanup some known short messages 2023-12-26 12:58:50 +01:00
wangtao.2077
7ad278eefb fix AddDefaultDatabaseVisitor bad performance 2023-12-26 13:31:45 +08:00
Nikolay Degterinsky
85b149395a
Merge pull request #57796 from evillique/replicated-database-forbid-create-as-select 
Forbid CREATE AS SELECT for database Replicated
 2023-12-25 19:43:28 +01:00
Azat Khuzhin
837f4ea676 Add ability to throttle merges/mutations 
Main motivation was to has an ability to throttle background tasks, to
avoid affecting queries.

To new server settings had been added for this:
- max_mutations_bandwidth_for_server
- max_merges_bandwidth_for_server

Note, that they limit only reading, since usually you will not write
more data then you read, but sometimes it is possible in case of ALTER
UPDATE.

But for now, to keep things simple, I decided to limit this with only
2 settings instead of 4.

Note, that if the write throttling will be needed, then they can use the
same settings, and just create new throttler for write.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-12-24 22:31:49 +01:00
Azat Khuzhin
3be3b0a280 Fix incorrect Exceptions 
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-12-24 21:26:32 +01:00
Nikolay Degterinsky
033fb14a2a Merge remote-tracking branch 'upstream/master' into replicated-database-forbid-create-as-select 2023-12-24 20:07:12 +00:00
Alexey Milovidov
1054118607
Merge pull request #58133 from ClickHouse/parallel-replicas-in-subquery 
Disable parallel replicas with IN (subquery)
 2023-12-24 05:03:35 +01:00
Alexey Milovidov
3f4c8e4ae8
Merge pull request #58167 from jrdi/part-log-uncompressed-bytes 
Add bytes_uncompressed to system.part_log
 2023-12-24 04:11:35 +01:00
Igor Nikonov
3c85042679 Fix typo 2023-12-23 12:05:02 +00:00
Igor Nikonov
701c8ac9ba Cleanup & comments 2023-12-23 11:44:02 +00:00
una
f780a2f838 feat:add InitialQuery event 2023-12-23 18:42:41 +08:00