kssenii
f33a517d33
Merge branch 'master' of github.com:ClickHouse/ClickHouse into poco-file-to-std-fs
2021-05-14 02:58:26 +03:00
tavplubix
780b7cc8e1
Merge pull request #23863 from Algunenano/mutation_logs
...
Reduce the amount of logs that StorageMergeTree::selectPartsToMutate outputs in busy systems.
2021-05-13 19:02:23 +03:00
Maksim Kita
f3ee14d24a
Merge pull request #24066 from azat/buffer-total-lock-contention
...
Do not acquire lock for total_bytes/total_rows for Buffer engine
2021-05-13 11:15:06 +03:00
Azat Khuzhin
074b57fe82
Do not acquire lock for total_bytes/total_rows for Buffer engine
...
When Buffer() is under preassure, acquiring per-layer lock may take
significant time. And so the following query may take significant amount of time:
SELECT total_bytes, total_rows FROM system.tables WHERE engine='Buffer'
2021-05-12 23:38:00 +03:00
Azat Khuzhin
26a1277609
Fix typo for IStorage::totalRows() comment
2021-05-12 23:38:00 +03:00
Nikolai Kochetov
690410009c
Restor is_temporary flag for fetched part.
2021-05-12 19:17:01 +03:00
kssenii
0527f0ea33
Merge branch 'master' of github.com:ClickHouse/ClickHouse into poco-file-to-std-fs
2021-05-12 16:54:18 +03:00
Nikolai Kochetov
a1ba67e029
Merge pull request #20202 from amosbird/projection
...
Projections
2021-05-12 09:38:07 +03:00
Nikolai Kochetov
817bc1377c
Fix part check for projections.
2021-05-11 17:07:19 +03:00
kssenii
393b026f2e
Merge branch 'master' of github.com:ClickHouse/ClickHouse into poco-file-to-std-fs
2021-05-11 16:49:23 +03:00
Fuwang Hu
a312dd414c
Merge branch 'master' into feature/fix-session-expired-when-selecting-system-tables
2021-05-11 20:04:36 +08:00
Nikolai Kochetov
a7d717d767
Remove unused code.
2021-05-11 14:59:56 +03:00
fuwhu
bf0b0e2edc
disable select_sequential_consistency when getting total rows and bytes in TablesBlockSource::generate
2021-05-11 19:49:48 +08:00
Nikolai Kochetov
89f16014b8
fix fetch for projection.
2021-05-11 14:44:59 +03:00
Amos Bird
074c2ead9c
Fix
2021-05-11 18:22:23 +08:00
Amos Bird
5e9fab6d10
Comment debug info out
2021-05-11 18:12:29 +08:00
Amos Bird
5836e2e277
Fix issues in normal projection
2021-05-11 18:12:29 +08:00
Amos Bird
dfa5629071
Remove projection type ast
2021-05-11 18:12:29 +08:00
Amos Bird
51d685bb9c
Even more fixes
2021-05-11 18:12:29 +08:00
Amos Bird
ddd4256a15
More fixes
2021-05-11 18:12:28 +08:00
Amos Bird
718c284437
Fix more tests
2021-05-11 18:12:28 +08:00
Amos Bird
ba17acbd63
Fix tests
2021-05-11 18:12:28 +08:00
Amos Bird
a3fd0b6f2e
Fix tests
2021-05-11 18:12:28 +08:00
Amos Bird
42f161b1dc
Fix more
2021-05-11 18:12:28 +08:00
Amos Bird
012eb56e3b
fix ya make (projection only)
2021-05-11 18:12:28 +08:00
Amos Bird
ef918aeaff
Rebase and fix
2021-05-11 18:12:28 +08:00
Amos Bird
9c069ebdbf
support prewhere, row_filter, read_in_order and decent projection selection
...
TODO set index analysis in projection
2021-05-11 18:12:27 +08:00
Amos Bird
f7f949c1f9
Fix aggregation keys order
2021-05-11 18:12:27 +08:00
Amos Bird
e1e560765c
Fix missing columns
2021-05-11 18:12:27 +08:00
Amos Bird
35961c0c5d
Use ActionsDAG to rewrite projection queries
2021-05-11 18:12:27 +08:00
Nikolai Kochetov
bf95b684a7
Remove copy constructor from ProjectionDescription
2021-05-11 18:12:27 +08:00
Nikolai Kochetov
29d7038e30
Add ProjectionDescription::Type enum. Remove some checks.
2021-05-11 18:12:27 +08:00
Amos Bird
ebaf42a448
Reformat and fix some tests
2021-05-11 18:12:27 +08:00
Nikolai Kochetov
672cfedd13
Disable normal projection by the number of granules.
2021-05-11 18:12:26 +08:00
Nikolai Kochetov
95431168c2
Try to enable normal projections.
2021-05-11 18:12:26 +08:00
Amos Bird
483bd165e7
Check if pipeline is simple and add more comments
2021-05-11 18:12:26 +08:00
Nikolai Kochetov
427f444ba4
Fix prewhere.
2021-05-11 18:12:26 +08:00
Nikolai Kochetov
3d36fb57eb
Cleanup code.
2021-05-11 18:12:26 +08:00
Nikolai Kochetov
3296c9292f
Try to merge projectons faster.
2021-05-11 18:12:26 +08:00
Amos Bird
cd6414639e
add metadata_snapshot to getQueryProcessingStage
2021-05-11 18:12:26 +08:00
Amos Bird
264cff6415
Projections
...
TODO (suggested by Nikolai)
1. Build query plan fro current query (inside storage::read) up to WithMergableState
2. Check, that plan is simple enough: Aggregating - Expression - Filter - ReadFromStorage (or simplier)
3. Check, that filter is the same as filter in projection, and also expression calculates the same aggregation keys as in projection
4. Return WithMergableState if projection applies
3 will be easier to do with ActionsDAG, cause it sees all functions, and dependencies are direct (but it is possible with ExpressionActions also)
Also need to figure out how prewhere works for projections, and
row_filter_policies.
wip
2021-05-11 18:12:23 +08:00
Maksim Kita
fdaffe869d
Merge pull request #24007 from ClickHouse/fix-bad-code-2
...
Fix bad code
2021-05-11 12:03:53 +03:00
Kruglov Pavel
49e7ed6e60
Merge pull request #23673 from amosbird/partitionvalue
...
Add _partition_value virtual column
2021-05-11 11:23:00 +03:00
Alexey Milovidov
eb8a4ffe4b
Fix bad code
2021-05-11 02:43:58 +03:00
Alexey Milovidov
b2ca5cd98b
Merge branch 'master' into normalize-bigint
2021-05-11 02:05:40 +03:00
Vladimir
d02d14fa00
Merge pull request #23846 from excitoon-favorites/s3regions
2021-05-10 12:14:08 +03:00
alexey-milovidov
1ea637d996
Merge pull request #23970 from ClickHouse/pvs-studio-fixes-6
...
PVS-Studio fixes, part 6
2021-05-09 21:45:19 +03:00
Alexey Milovidov
9753ddc8a0
Merge branch 'master' of github.com:yandex/ClickHouse into normalize-bigint
2021-05-09 18:54:29 +03:00
kssenii
ab1a05a1f4
Poco::Path to fs::path, less concatination
2021-05-09 14:59:49 +03:00
kssenii
e26cb4bee0
Fix style check, fix yandex check
2021-05-09 13:45:50 +03:00