Kseniia Sumarokova
c3227fd44f
Merge pull request #51161 from kssenii/more-metrics-in-cache
...
More profile events for fs cache
2023-06-20 12:44:00 +02:00
Maksim Kita
7e5017dd31
Fixed tests
2023-06-20 11:42:22 +03:00
Maksim Kita
6e26fde707
Updated tests
2023-06-20 11:42:22 +03:00
Maksim Kita
129b97c727
JIT infrastructure refactoring
2023-06-20 11:42:22 +03:00
Nikolai Kochetov
7280078bc6
Refactoring a bit more.
2023-06-19 19:01:56 +00:00
Han Fei
959f66eb8a
Merge pull request #50697 from kitaisreal/sort-block-improvements
...
Sort block improvements
2023-06-19 19:02:03 +02:00
Anton Popov
1ef19dbe4d
drop cache on check of broken part
2023-06-19 16:32:51 +00:00
kssenii
ec86028fd8
Change to microseconds
2023-06-19 17:48:56 +02:00
kssenii
0ca2916163
More metrics in cache
2023-06-19 17:22:41 +02:00
Sergei Trifonov
5867f39fc7
Merge pull request #50675 from ClickHouse/unify-priorities-pools
...
Unify priorities for connection pools
2023-06-19 17:16:15 +02:00
Nikolai Kochetov
8e7d06e0a4
Remove isReady from FutureSet iface.
2023-06-19 12:56:24 +00:00
Nikolai Kochetov
880c9aea09
Fixing style.
2023-06-19 10:47:43 +00:00
Alexander Tokmakov
caceb7c862
Revert "Added ability to implicitly use file/hdfs/s3 table functions in clickhouse-local"
2023-06-19 13:21:09 +03:00
Maksim Kita
4c72995537
Fixed build
2023-06-19 13:02:35 +03:00
Sema Checherinda
2bbfa279ec
fix gtest_lru_file_cache, fix remove from pending
2023-06-18 21:05:00 +02:00
Sema Checherinda
ce7cd67981
finalize CascadeWriteBuffer
2023-06-18 17:35:12 +02:00
Maksim Kita
977cd65cfb
Fixed build
2023-06-18 12:52:08 +03:00
Maksim Kita
2f3dce5fe6
Fixed tests
2023-06-18 12:52:08 +03:00
Maksim Kita
7d17a70d17
Fixed tests
2023-06-18 12:52:08 +03:00
Maksim Kita
8d3212363e
Fixed tests
2023-06-18 12:52:08 +03:00
Maksim Kita
ca298d66cb
Sort block improvements
2023-06-18 12:52:08 +03:00
Robert Schulze
5311ebe1d2
Make query cache work effective with nested queries.
2023-06-17 20:27:25 +00:00
Robert Schulze
24717ed908
Factorize check if query cache exists
2023-06-17 18:24:20 +00:00
Robert Schulze
69e7c1cc82
Introduce convenience ctor for Key construction during read
2023-06-17 18:22:15 +00:00
Robert Schulze
6e8af09289
Provide query cache reader with dummy block
2023-06-17 12:48:29 +00:00
Robert Schulze
0adc98865d
Add variable for access to found key components
2023-06-17 12:43:14 +00:00
Robert Schulze
840e73eb74
Update #includes
2023-06-17 12:28:18 +00:00
Robert Schulze
83e2196a17
Make is_shared const
2023-06-17 12:26:53 +00:00
Alexey Milovidov
df9abccfaa
Merge branch 'master' into localfilefunction
2023-06-17 00:45:54 +03:00
Nikolai Kochetov
afa74f697c
Refactor a bit.
2023-06-16 19:38:50 +00:00
Nikolai Kochetov
1cb7ba4895
Revert "Trying to fix a test."
...
This reverts commit d0d39c8f61
2023-06-15 16:42:38 +00:00
Nikolai Kochetov
d34b6e5f35
Try to fix analyzer tests.
2023-06-15 16:27:51 +00:00
Zhiguo Zhou
ff6629d1d1
Enhance safety of function generateOptimizedDateFilterAST
...
This commit checks the corner case where the comparator is none
of equals, notEquals, less, lessOrEquals, greater, greaterOrEquals,
and throws LOGICAL_ERROR exception if so.
2023-06-15 22:04:13 +08:00
Zhiguo Zhou
d14299eb09
The general optimization of predicates with date/datetime converters
...
As is suggested in issue #15257 , the function preimage is a general
solution to the optimization problem with predicates containing the
date and datetime converters. This commit implements the idea by
adding the new methods, hasInformationAboutPreimage and getPreimage,
to IFunction/IFunctionBase, and having the specific convert functions
define their own preimage. Moreover, we added a new pass in the
TreeOptimizer and a new AST visitor for in-place rewriting the AST
with the converters' preimage.
Specifically, the optimization is applied to toYear and toYYYYMM.
2023-06-15 21:48:02 +08:00
kssenii
b8a4a784de
Fix unit test, add check
2023-06-15 14:22:13 +02:00
Kseniia Sumarokova
31e08635bf
Merge branch 'master' into unify-priorities-pools
2023-06-15 12:51:45 +02:00
kssenii
0023bf69cb
Fix
2023-06-15 12:22:50 +02:00
kssenii
8c610275c2
Review fixes
2023-06-14 23:35:09 +02:00
kssenii
0aa363f525
Fix style check
2023-06-14 23:13:09 +02:00
Nikolai Kochetov
d0d39c8f61
Trying to fix a test.
2023-06-14 18:10:30 +00:00
kssenii
96fb7f04cb
Finish download of partially downloaded file segments in the background instead of resizing
2023-06-14 19:06:13 +02:00
Dmitry Novik
1d88b16830
Merge pull request #50584 from ClickHouse/analyzer-optimizations-on-shards
...
Analyzer: Do not apply Query Tree optimizations on shards
2023-06-14 14:31:46 +02:00
kssenii
739dc6739f
Progress
2023-06-14 13:51:13 +02:00
Antonio Andelic
4825286b0c
Merge branch 'master' into keeper-with-disks
2023-06-14 10:48:53 +02:00
Nikita Mikhaylov
52a460df67
Tests with parallel replicas are no more "always green" ( #50896 )
2023-06-13 16:43:35 +02:00
Robert Schulze
3617316026
Merge branch 'master' into non-experimental-qpl-deflate
2023-06-12 16:01:45 +02:00
Dmitry Novik
26c9bda144
Add a comment
2023-06-12 13:54:45 +00:00
Antonio Andelic
cb3ac81110
Merge branch 'master' into keeper-with-disks
2023-06-12 15:14:24 +02:00
Anton Popov
32caf87163
Merge pull request #50104 from amosbird/fix_43107_47549
...
Proper mutation of skip indices and projections
2023-06-12 15:09:18 +02:00
Robert Schulze
8222861f2e
Merge remote-tracking branch 'rschu1ze/master' into non-experimental-qpl-deflate
2023-06-11 14:39:30 +00:00
Robert Schulze
43d4544c97
Merge pull request #50810 from rschu1ze/desctructing
...
Desctructing --> Destructing
2023-06-09 21:59:26 +02:00
Nikolai Kochetov
6ce8329bda
Merge branch 'master' into refactor-subqueries-for-in
2023-06-09 20:04:27 +02:00
Nikolai Kochetov
9a4043a4b4
Fixing more tests.
2023-06-09 17:51:59 +00:00
Robert Schulze
f8dc408ccb
Desctructing --> Destructing
2023-06-09 16:23:22 +00:00
Nikolai Kochetov
e0277b071b
Merge pull request #50699 from ClickHouse/vdimir/revert_grace_join_changed
...
Revert recent grace hash join changes
2023-06-09 17:56:52 +02:00
Robert Schulze
1aa158909e
enable_qpl_deflate_codec --> enable_deflate_qpl_codec
2023-06-09 12:43:33 +00:00
jinjunzh
f1192d59af
refine patch according to comments
2023-06-09 12:43:15 +00:00
jinjunzh
056ca4f555
Add extensive testing cases for deflate qpl codec
2023-06-09 12:42:59 +00:00
Nikolai Kochetov
c73a346939
Merge pull request #50721 from ClickHouse/global-join-too-many-columns
...
Do not read all the columns from right GLOBAL JOIN table.
2023-06-09 14:33:07 +02:00
Alexander Tokmakov
8f9c74debb
Support OPTIMIZE for temporary tables ( #50710 )
...
* Update InterpreterOptimizeQuery.cpp
* Update 02525_different_engines_in_temporary_tables.sql
* Update MergeTreeData.cpp
2023-06-09 14:31:49 +03:00
alesapin
2fec796e73
Merge pull request #50604 from ClickHouse/azure_table_function
...
Azure table function
2023-06-09 11:44:04 +02:00
Kseniia Sumarokova
92de3821b5
Merge pull request #50682 from ClickHouse/kssenii-patch-7
...
Update default max_elements limit in fs cache
2023-06-09 11:18:20 +02:00
Kseniia Sumarokova
029a4fd201
Merge branch 'master' into fix-flaky-unit-test
2023-06-09 11:11:07 +02:00
Kseniia Sumarokova
62fc6cf007
Merge branch 'master' into fix-error-in-stress-test
2023-06-09 11:07:10 +02:00
Nikolai Kochetov
350becba5d
Fixing build.
2023-06-08 17:56:35 +00:00
Kseniia Sumarokova
2ea2782447
Merge branch 'master' into kssenii-patch-7
2023-06-08 19:50:57 +02:00
alesapin
37b5be60b5
Merge branch 'master' into fix-flaky-unit-test
2023-06-08 18:37:12 +02:00
Nikolai Kochetov
b6e32cd5e3
Do not read all the columns from right GLOBAL JOIN table.
2023-06-08 15:30:23 +00:00
alesapin
79edd06ee7
Merge remote-tracking branch 'origin/master' into azure_table_function
2023-06-08 17:05:19 +02:00
kssenii
9b04e85137
Fix
2023-06-08 16:43:27 +02:00
kssenii
964e0d042c
Fix
2023-06-08 16:25:24 +02:00
Nikolai Kochetov
471b0d8ad6
Merge pull request #50638 from ClickHouse/vdimir/semi_join_use_nulls_50540
...
Fix crash in anti/semi join
2023-06-08 12:43:34 +02:00
Dmitry Novik
a92ce7f696
Merge branch 'master' into analyzer-optimizations-on-shards
2023-06-08 11:55:58 +02:00
vdimir
f0a1c8afa2
Revert "Merge pull request #49483 from bigo-sg/grace_hash_full_join"
...
This reverts commit fa93c388b1a2c0a65344
2023-06-08 09:40:41 +00:00
vdimir
15b6651df6
Revert "Merge pull request #49816 from bigo-sg/grace_hash_reserve_hash_table"
...
This reverts commit 3f892ceb1232ffa2ae0b
2023-06-08 09:40:11 +00:00
Kseniia Sumarokova
9a7852c908
Merge branch 'master' into fix-cache-slow-with-insert
2023-06-08 10:49:46 +02:00
Nikolay Degterinsky
188bac414e
Merge pull request #50280 from lucas-tubi/fix-datetime64-index-scaning
...
Fixed type conversion from Date/Date32 to DateTime64 when querying with DateTime64 index
2023-06-08 07:10:55 +02:00
Kseniia Sumarokova
c2fc0713f2
Update FileCache_fwd.h
2023-06-07 21:08:48 +02:00
kssenii
129473ae74
Fix
2023-06-07 20:48:03 +02:00
Antonio Andelic
b11f744252
Correctly disable async insert with deduplication when it's not needed ( #50663 )
...
* Correctly disable async insert when it's not used
* Better
* Add comment
* Better
* Fix tests
---------
Co-authored-by: Nikita Mikhaylov <mikhaylovnikitka@gmail.com>
2023-06-07 20:33:08 +02:00
vdimir
a268250aff
Fixes for LowCardinality Nullable in HashJoin
2023-06-07 20:16:36 +02:00
vdimir
f3b5a87a66
Fixing crash in anti/semi join
2023-06-07 20:16:36 +02:00
serxa
2df0e0c669
Unify priorities for connections
2023-06-07 16:25:52 +00:00
Alexander Sapin
5d52c41689
Merge branch 'master' into azure_table_function
2023-06-07 12:33:26 +02:00
Kseniia Sumarokova
d25ea9b0cf
Merge pull request #50470 from kssenii/add-some-assertions-2
...
Add some assertions
2023-06-07 12:28:28 +02:00
Alexey Milovidov
9b49469e54
Merge pull request #50637 from Avogar/values-lc-null
...
Fix converting Null to LowCardinality(Nullable) in values table function
2023-06-07 07:38:11 +03:00
Han Fei
4130e1e9ac
Merge branch 'master' into revert_incorrect_optimizations
2023-06-06 21:44:39 +02:00
avogar
e9c267ed69
Fix converting Null to LowCardinality(Nullable) in values table function
2023-06-06 17:51:53 +00:00
Raúl Marín
473743b49f
Disable pure parallel replicas if trivial count optimization is possible ( #50594 )
2023-06-06 18:38:32 +02:00
Nikolay Degterinsky
38edd6c3e7
Update src/Interpreters/tests/gtest_convertFieldToType.cpp
2023-06-06 18:28:34 +02:00
Nikolay Degterinsky
6c82ee45e2
Fix build
2023-06-06 18:27:16 +02:00
Antonio Andelic
42798e446b
Merge branch 'master' into keeper-with-disks
2023-06-06 14:55:47 +00:00
Raúl Marín
8d2b868312
Revert "Merge pull request #50062 from ZhiguoZh/20230511-toyear"
...
This reverts commit 55c2dbcc2d23f894b995
2023-06-06 16:10:22 +02:00
Raúl Marín
68a9ea72de
Revert "Merge pull request #50307 from ZhiguoZh/20230527-toyyyymm"
...
This reverts commit 17261e52dad302eae85e
2023-06-06 16:10:01 +02:00
kssenii
c84881ac68
Merge remote-tracking branch 'origin/add-some-assertions-2' into add-some-assertions-2
2023-06-06 15:16:42 +02:00
Nikolay Degterinsky
9ae4d929ea
Update src/Interpreters/tests/gtest_convertFieldToType.cpp
2023-06-06 15:16:18 +02:00
kssenii
a96c1ea86f
Fix
2023-06-06 15:15:51 +02:00
Nikita Mikhaylov
e87348010d
Rework loading and removing of data parts for MergeTree tables. ( #49474 )
...
Co-authored-by: Sergei Trifonov <sergei@clickhouse.com>
2023-06-06 14:42:56 +02:00
Dmitry Novik
0e518d7de2
Merge branch 'master' into analyzer-optimizations-on-shards
2023-06-06 14:02:25 +02:00
Kseniia Sumarokova
175515b9ec
Merge pull request #50583 from kssenii/fix-logical-error-in-try-reserve-2
...
Fix logical error in stress test (Not enough space to add ...)
2023-06-06 12:14:46 +02:00
Michael Kolupaev
9f80900d6f
Changes related to an internal feature
2023-06-05 18:20:38 -07:00
Smita Kulkarni
dedb9067ce
WIP : Azure Table Function, added read and StorageAzureSource
2023-06-05 20:36:17 +02:00
Kseniia Sumarokova
0832cb2d7a
Update Metadata.h
2023-06-05 17:51:12 +02:00
Kseniia Sumarokova
2b3db1d33c
Update Metadata.cpp
2023-06-05 17:05:06 +02:00
Dmitry Novik
fe1354f221
Analyzer: Do not apply Query Tree optimizations on shards
2023-06-05 12:32:08 +00:00
kssenii
58932b81cc
Merge remote-tracking branch 'upstream/master' into fix-logical-error-in-try-reserve-2
2023-06-05 13:07:12 +02:00
kssenii
f3a8517a44
Fix
2023-06-05 13:07:07 +02:00
Kseniia Sumarokova
22110ac742
Fix exception message
2023-06-05 11:59:49 +02:00
Antonio Andelic
c4873027c3
Merge branch 'master' into keeper-with-disks
2023-06-05 07:08:33 +00:00
Alexey Milovidov
4ef0196a1b
Merge branch 'master' into fix-datetime64-index-scaning
2023-06-05 06:42:35 +03:00
Alexey Milovidov
4b1bb75a07
Merge pull request #50383 from bigo-sg/grace_hash_join_mismatch_right_block
...
Without applying `prepareRightBlock` will cause mismatch block structrue
2023-06-05 05:57:16 +03:00
Amos Bird
a66f68e5df
fix again
2023-06-05 01:48:13 +08:00
Amos Bird
e24c9267bc
fix
2023-06-04 20:06:27 +08:00
kssenii
24e015b961
Fix
2023-06-04 13:34:20 +02:00
kssenii
411cf84db2
Merge remote-tracking branch 'upstream/master' into add-some-assertions-2
2023-06-04 13:32:57 +02:00
Amos Bird
92b2200c55
mutation stages can be empty
2023-06-04 18:32:12 +08:00
Amos Bird
97bd3f0483
Proper mutation of skip indices and projections
2023-06-04 18:32:08 +08:00
kssenii
009fe3d25e
Add profile events for eviction
2023-06-03 21:35:27 +02:00
kssenii
05fbebbdac
Merge remote-tracking branch 'upstream/master' into add-some-assertions-2
2023-06-03 20:19:14 +02:00
Alexey Milovidov
9e938d7eec
Merge pull request #49287 from nickitat/optimize_reading2
...
Optimise hot reading from remote tables
2023-06-02 23:51:57 +03:00
Nikolai Kochetov
975e58c56d
Fix style.
2023-06-02 15:15:44 +00:00
Antonio Andelic
5f625dcdd9
Merge branch 'master' into keeper-with-disks
2023-06-02 13:35:18 +00:00
vdimir
b1f58d765a
Merge pull request #48633 from ClickHouse/vdimir/any_join_single_row
2023-06-02 15:05:13 +02:00
kssenii
8884be2439
Merge remote-tracking branch 'upstream/master' into add-some-assertions-2
2023-06-02 14:58:34 +02:00
kssenii
5cb4363e58
Remove assertion
2023-06-02 14:50:00 +02:00
Nikita Mikhaylov
73db383727
Limit the number of in-flight tasks for loading outdated parts ( #50450 )
...
* Done
* Update programs/local/LocalServer.cpp
Co-authored-by: Alexander Tokmakov <tavplubix@clickhouse.com>
* Bump
---------
Co-authored-by: Alexander Tokmakov <tavplubix@clickhouse.com>
2023-06-02 14:10:26 +02:00
kssenii
79c14c89ee
Add some assertions
2023-06-02 12:53:25 +02:00
Nikolai Kochetov
92859ebb3b
Fixing more tests.
2023-06-01 21:15:15 +00:00
vdimir
bdb192cf27
Test right join in 02725_any_join_single_row, style code changes
2023-06-01 15:43:37 +00:00
Antonio Andelic
514beb783b
Merge branch 'master' into keeper-with-disks
2023-06-01 12:19:43 +00:00
vdimir
62f950ddaf
Keep blocks with nulls for right and full join
2023-06-01 12:03:10 +00:00
vdimir
68d46c81b9
Do not store blocks in hash join if nothing is inseted
2023-06-01 12:03:09 +00:00
Zhiguo Zhou
3d0f336643
Optimize predicate with toYYYYMM converter
...
Like toYear(PR #50062 ), the predicate with toYYYYMM could also be
optimized with its preimage. For example, we could transform the
predicate "toYYYYMM(c) = 202305" to "c >= '2023-05-01' AND c <=
'2023-05-31'", so that the invocation of toYYYYMM is avoided. The
similar transformation also applies to other comparisons.
This commit extends OptimizeDateFilterInPlaceVisitor by having it
recognize the toYYYYMM converter in the WHERE/PREWHERE clauses and
replace it with the above tranformed predicate in-place at the AST
level.
2023-06-01 10:20:45 +08:00
lgbo-ustc
5dbce62ec3
fixed. without apply prepareRightBlock will cause mismatch block structure
2023-06-01 08:10:28 +08:00
Nikita Mikhaylov
3543d95980
Parallel replicas always skip unavailable ones ( #50293 )
2023-05-31 22:10:33 +02:00
kssenii
f15769ee6c
Fix
2023-05-30 21:29:08 +02:00
Nikolai Kochetov
c740328426
Fix more tests.
2023-05-30 18:51:18 +00:00
Nikolai Kochetov
8cec00dd6e
Merge branch 'master' into refactor-subqueries-for-in
2023-05-30 18:08:37 +02:00
Nikolai Kochetov
e91934bcea
Fixing style.
2023-05-30 16:02:14 +00:00
Vasily Nemkov
93cf34320c
Fixed convertFieldToType case of converting Date and Date32 to DateTime64 Field
...
Also added a unit-test that clarifies implementation
2023-05-30 16:10:52 +02:00
Sema Checherinda
84d6bfe5f6
Merge pull request #50204 from azat/InsertSelectQueries-pe
...
Add new profile events for queries with subqueries
2023-05-30 15:19:04 +02:00
Antonio Andelic
bb2acb50d2
Merge pull request #50186 from LiuYangkuan/support_fqdn_in_cluster_discovery
...
support passing fqdn to register cluster node in keeper
2023-05-30 11:54:09 +02:00
Antonio Andelic
67746bfff2
Merge branch 'master' into keeper-with-disks
2023-05-30 09:50:12 +00:00
SmitaRKulkarni
f2172ab8dd
Merge pull request #46661 from ClickHouse/42192_Lower_parallel_parsing_threads_with_globs
...
When reading from multiple files displace parallel parsing
2023-05-30 08:53:08 +02:00
Lucas Chang
954e76cb7a
use getScaleMultiplier
2023-05-30 09:38:50 +08:00
Nikita Taranov
a3652f1727
Merge branch 'master' into optimize_reading2
2023-05-29 15:26:18 +02:00
Robert Schulze
47daaad172
Merge pull request #49778 from helifu/master2
...
Support custom 'order by' expression for system log tables
2023-05-29 10:05:14 +02:00
Alexey Milovidov
9647cfa33d
Merge pull request #50291 from kitaisreal/jit-aggregation-nullable-key-fix
...
JIT aggregation nullable key fix
2023-05-29 02:08:02 +03:00
alesapin
3a3cee586a
Merge pull request #50257 from CurtizJ/useless-refactoring
...
Yet another refactoring
2023-05-28 21:42:16 +02:00
Maksim Kita
e9840bc6e1
JIT aggregation nullable key fix
2023-05-28 21:05:17 +03:00
