Alexander Kuzmenkov
e9b69bbd70
Merge pull request #23906 from azat/fix-distributed_group_by_no_merge
...
distributed_group_by_no_merge fixes
2021-05-19 16:16:08 +03:00
alesapin
31181095e7
Review fixes
2021-05-18 17:08:56 +03:00
alesapin
17f229857c
Merge branch 'master' into nvartolomei-parts-move
2021-05-17 13:52:48 +03:00
Azat Khuzhin
a44ddd2064
Update distributed_group_by_no_merge description
2021-05-15 15:03:13 +03:00
Alexander Kuzmenkov
5ed6a273d3
Merge pull request #24058 from ClickHouse/aku/uniq-two-level
...
lower two-level aggregation threshold for uniq test to avoid jitter
2021-05-14 15:50:48 +03:00
Alexander Kuzmenkov
6f16d92cfe
Update Settings.h
2021-05-14 15:50:30 +03:00
Alexander Kuzmenkov
220f5b512e
try even smaller value
2021-05-13 06:15:44 +03:00
Alexander Gololobov
748d1b6e9c
Generate ya.make for missing UUID.cpp
2021-05-12 20:32:29 +03:00
Alexander Kuzmenkov
f6cb9f95df
lower two-level aggregation threshold for uniq test to avoid jitter
2021-05-12 16:01:48 +03:00
alesapin
46e136b5c4
Merge branch 'master' into nv/parts-uuid-move-shard
2021-05-11 15:36:40 +03:00
Amos Bird
264cff6415
Projections
...
TODO (suggested by Nikolai)
1. Build query plan fro current query (inside storage::read) up to WithMergableState
2. Check, that plan is simple enough: Aggregating - Expression - Filter - ReadFromStorage (or simplier)
3. Check, that filter is the same as filter in projection, and also expression calculates the same aggregation keys as in projection
4. Return WithMergableState if projection applies
3 will be easier to do with ActionsDAG, cause it sees all functions, and dependencies are direct (but it is possible with ExpressionActions also)
Also need to figure out how prewhere works for projections, and
row_filter_policies.
wip
2021-05-11 18:12:23 +08:00
vdimir
905e54a0af
Merge branch 'master' into create-aggregate-func-settings
2021-05-11 11:18:24 +03:00
Alexey Milovidov
b2ca5cd98b
Merge branch 'master' into normalize-bigint
2021-05-11 02:05:40 +03:00
alexey-milovidov
066acc71b6
Merge pull request #8482 from ClickHouse/enable-compile-expressions
...
Enable "compile_expressions" by default
2021-05-10 21:09:18 +03:00
Alexey Milovidov
18b7e38994
Remove redundant template
2021-05-10 00:26:34 +03:00
Alexey Milovidov
903c306e04
Fix some PVS-Studio warnings
2021-05-09 01:10:10 +03:00
Alexey Milovidov
ab9b116310
Fix some PVS-Studio warnings
2021-05-09 01:09:16 +03:00
Alexey Milovidov
e905883c75
More fixes for PVS-Studio
2021-05-08 19:12:31 +03:00
Alexey Milovidov
8d62c42eb9
A bunch of changes for PVS-Studio
2021-05-08 19:11:50 +03:00
Alexey Milovidov
2fbecf36ca
More fixes for PVS-Studio
2021-05-08 18:20:40 +03:00
Alexey Milovidov
9e1a5f41fc
A bunch of changes for PVS-Studio
2021-05-08 17:43:03 +03:00
Maksim Kita
9daf5b8308
Updated Settings
2021-05-08 17:39:34 +03:00
Alexey Milovidov
47a4c101b9
Merge branch 'master' into normalize-bigint
2021-05-08 16:41:15 +03:00
Alexey Milovidov
04d85db385
Fix weird error in code
2021-05-08 02:42:52 +03:00
Alexey Milovidov
55f86851f1
Less strange templates
2021-05-08 02:35:11 +03:00
Alexey Milovidov
734df081da
Fix terrible exception message
2021-05-08 02:12:48 +03:00
Alexey Milovidov
7dfb7664f7
Messing with the code (removed trash)
2021-05-07 21:16:27 +03:00
kssenii
912878ad7f
Review fixes
2021-05-07 12:05:34 +00:00
kssenii
8662078b35
Review fixes
2021-05-07 09:55:18 +00:00
Alexey Milovidov
6651e5e951
Fix test
2021-05-07 04:51:35 +03:00
Alexey Milovidov
df0d6a8d24
Fix error; add a test
2021-05-07 01:37:23 +03:00
Alexey Milovidov
b461542388
If for UUID
2021-05-06 18:45:58 +03:00
fibersel
cb53bbb7b0
add experimental codecs flag, add integration test for experimental codecs
2021-05-06 14:57:22 +03:00
Alexey Milovidov
9f379918ea
Fix error in wide_integer implementation
2021-05-06 03:06:24 +03:00
Alexey Milovidov
1ec7a1f0ca
Fix NaN comparison
2021-05-06 01:02:00 +03:00
Alexey Milovidov
cb74831788
Update test
2021-05-05 02:15:35 +03:00
Alexey Milovidov
77ebbdaeda
Simplification
2021-05-05 02:09:32 +03:00
Alexey Milovidov
acd0d9b34c
Fix error (amend)
2021-05-05 02:08:42 +03:00
Alexey Milovidov
75ac3c96df
Fix error
2021-05-05 02:07:14 +03:00
Alexey Milovidov
962a7113f6
Remove code that I do not like (crazy templates)
2021-05-04 20:26:09 +03:00
Alexey Milovidov
eea47a65d2
PVS-Studio
2021-05-04 15:13:47 +03:00
Alexey Milovidov
02ce9cc725
Untangle UUID
2021-05-04 01:46:51 +03:00
Alexey Milovidov
b0bd9fd3b0
Add UInt128 where it is needed
2021-05-03 19:12:28 +03:00
Alexey Milovidov
9f74565948
PVS-Studio
2021-05-03 01:42:01 +03:00
Alexey Milovidov
eaa8f922b2
Fix errors, add a test
2021-05-03 00:52:59 +03:00
Alexey Milovidov
1fda866881
Merge branch 'master' into normalize-bigint
2021-05-02 21:24:45 +03:00
Maksim Kita
318c4bb80d
Add examples folder filter to ya.make.in
2021-04-30 11:25:52 +03:00
Maksim Kita
0d0a14a925
Poco::Timespan reference fix
2021-04-29 19:11:20 +03:00
Nikolai Kochetov
c508868570
Merge pull request #23082 from ClickHouse/explain-output
...
JSON output for EXPLAIN
2021-04-28 15:39:06 +03:00
Nikolai Kochetov
181273730d
Merge pull request #23683 from ClickHouse/enable_async_socket_for_remote
...
Enable async_socket_for_remote
2021-04-28 12:29:50 +03:00
Nicolae Vartolomei
1fa5871ff7
Fix bad rebase and introduce part_moves_between_shards_enable setting
2021-04-27 14:20:13 +01:00
Nicolae Vartolomei
53d57ffb52
Part movement between shards
...
Integrate query deduplication from #17348
2021-04-27 14:20:12 +01:00
Nikolai Kochetov
29fd51e37d
Enable async_socket_for_remote
2021-04-27 13:30:12 +03:00
Nikita Mikhaylov
9f55424250
move to examples everywhere
2021-04-27 01:51:42 +03:00
Vladimir
fd777bcd4b
Merge branch 'master' into create-aggregate-func-settings
2021-04-26 11:12:09 +03:00
Alexey Milovidov
649550c5ab
Attempt to normalize big integers
2021-04-25 12:30:43 +03:00
Alexey Milovidov
8f01af62d9
Merge branch 'master' into normalize-bigint
2021-04-25 06:57:44 +03:00
kssenii
d032651aba
Try fix
2021-04-23 17:29:22 +00:00
kssenii
8f34199538
Fixes
2021-04-23 12:36:40 +00:00
kssenii
459612c895
Use a separate setting
2021-04-22 22:14:14 +00:00
kssenii
28c4436246
Better
2021-04-22 21:30:31 +00:00
mergify[bot]
71bca99bbf
Merge branch 'master' into explain-output
2021-04-22 07:02:47 +00:00
Nikolai Kochetov
44112587d4
Merge pull request #23309 from ClickHouse/try-fix-crash-with-unknown-packet
...
Fix crash in case of unknown packet
2021-04-21 08:47:17 +03:00
Nikolai Kochetov
9ec6fd1943
Merge pull request #23359 from ClickHouse/try-fix-23029
...
Fix #23029
2021-04-21 08:46:21 +03:00
alexey-milovidov
a311a5c0b5
Merge pull request #23322 from azat/disable-min_bytes_to_use_mmap_io
...
Disable min_bytes_to_use_mmap_io by default
2021-04-20 19:27:47 +03:00
Nikolai Kochetov
ecb2a96af8
Revert "Enable async_socket_for_remote"
...
This reverts commit ff908baa06
2021-04-20 17:14:54 +03:00
Nikita Mikhaylov
f55eacee7d
Merge pull request #22988 from excitoon-favorites/s3connectionresetretries
...
Retries on HTTP connection drops during reads from S3
2021-04-20 14:59:21 +03:00
Nikolai Kochetov
5e589ca6b2
Try fix #23029
2021-04-20 14:55:23 +03:00
Kseniia Sumarokova
b43656bf89
Merge pull request #22697 from TCeason/feature/add_MaterializeMySQL_sync_bytes_judgment
...
Add MySQL read history data bytes judgment
2021-04-20 10:26:42 +03:00
Azat Khuzhin
6fba6f7ddd
Disable min_bytes_to_use_mmap_io by default
...
Reading files using mmap() does not have any significant benefits over
plain read() [1].
[1]: https://gist.github.com/azat/3d6c8d82bdd91e7a38d997fd6bcfd574
And not only it does not have significant benefits, it also has some
issues, due to max_server_memory_usage (default to 90% of available
RAM), since when you read files with mmap() eventually process RSS may
exceed max_server_memory_usage, and in this case any allocation will
fail (with "Memory limit exceeded (total)") error (yes kernel will
unload pages, but likely it will happens after queries will starting to
fail), like in this test [2].
[2]: https://gist.github.com/azat/4813489828162e6c2ce131963c6a1acb
TL;DR;
Note that there was also an idea to take those mmap()'ed regions in
memory tracking (#23211 ), but there are some drawbacks (since accounting
mmap() is tricky, first of all you need to account only once per inode
for file and plus kernel can unload some pages and those memory will not
be used by the server anymore).
And as an adddition to #23211 there was #23212 , that adds
max_bytes_to_use_mmap_io, but since mmap is not a subject for memory
accounting there is no need in it.
2021-04-20 00:25:16 +03:00
alexey-milovidov
4cef8c68f7
Merge pull request #23258 from azat/wundef
...
Add -Wundef for gcc builds
2021-04-19 22:45:22 +03:00
Nikolai Kochetov
8c2d58333a
Merge branch 'master' into explain-output
2021-04-19 17:40:27 +03:00
Nikolai Kochetov
ff908baa06
Enable async_socket_for_remote
2021-04-19 17:31:46 +03:00
Nikolai Kochetov
0c23d44b99
Add test.
2021-04-19 17:12:08 +03:00
Alexander Kuzmenkov
2a4bcb6e3f
Merge pull request #23159 from ClickHouse/aku/merge-fusecount
...
merging sumCount fusion PR #21337
2021-04-19 16:47:13 +03:00
Vladimir Chebotarev
9d4295f261
Removed infinite retries.
2021-04-19 11:02:36 +03:00
TCeason
b4bf53dfc9
add some comment and modify a parameter type
2021-04-19 15:34:27 +08:00
TCeason
63403c709c
modify settings name to external_xxx and rewrite Storage MySQL max_block_size
2021-04-19 10:51:50 +08:00
TCeason
87aa904440
Modify according to review opinion
2021-04-19 10:51:50 +08:00
TCeason
472c131420
Add MySQL read history data bytes judgment
2021-04-19 10:51:50 +08:00
Maksim Kita
1bfd4f7568
Function toDateTime decimal overflow ubsan fix
2021-04-19 02:00:33 +03:00
Azat Khuzhin
2561a67fd8
Replace !__clang__ with !defined(__clang) to fix gcc builds
...
$ gg 'if !__clang__' | cut -d: -f1 | sort -u | xargs sed -i 's/#if !__clang__/#if !defined(__clang__)/g'
2021-04-18 23:37:50 +03:00
Alexey Milovidov
21ff5d85d9
Disable hedged requests
2021-04-18 15:13:57 +03:00
alexey-milovidov
786f340256
Merge pull request #22755 from kssenii/postgresql-protocol-with-row-policy
...
Allow row policy in postgresql protocol
2021-04-17 01:55:30 +03:00
Nikolai Kochetov
1bf420cbcf
Update json description for other steps.
2021-04-16 19:36:59 +03:00
vdimir
92e813c806
Merge branch 'master' into create-aggregate-func-settings
2021-04-16 15:48:39 +03:00
Alexey Milovidov
9110a76d00
Reordered settings to avoid confusion
2021-04-16 00:14:37 +03:00
Alexander Kuzmenkov
2489b6af96
cleanup
2021-04-15 19:40:49 +03:00
Alexander Kuzmenkov
3b95b637a5
Merge remote-tracking branch 'origin/master' into HEAD
2021-04-15 18:19:53 +03:00
vdimir
33a9189151
Merge remote-tracking branch 'upstream/master' into create-aggregate-func-settings
2021-04-15 13:41:21 +03:00
Vladimir Chebotarev
10bf56e540
Attempt to add retries to S3 reads.
2021-04-15 09:47:19 +03:00
Ivan
2b78765957
Merge branch 'master' into postgresql-protocol-with-row-policy
2021-04-14 14:50:28 +03:00
Nikita Mikhaylov
024374a2ec
review fixes
2021-04-13 22:39:43 +03:00
Nikita Mikhaylov
a743442a17
build fixes
2021-04-13 22:39:43 +03:00
Nikita Mikhaylov
c333c3dedb
review fixes
2021-04-13 22:39:42 +03:00
Nikita Mikhaylov
8a4b5a586e
fixed uuid
2021-04-13 22:39:42 +03:00
Nikita Mikhaylov
4843f86329
use only one connection between initiator and worker
2021-04-13 22:39:42 +03:00
Nikita Mikhaylov
31b4f9b17f
save
2021-04-13 22:39:41 +03:00
Nikita Mikhaylov
44ca65a9a4
save
2021-04-13 22:39:41 +03:00
alexey-milovidov
1945d01719
Merge pull request #21972 from kssenii/nanodbc
...
Switch to nanodbc
2021-04-13 12:23:57 +03:00
