Commit Graph

46 Commits

Author SHA1 Message Date
vdimir
0f2588334f
Disable max_joined_block_rows in ConcurrentHashJoin 2024-01-08 10:20:39 +00:00
vdimir
9b137059a3
Better logging in hash join 2023-12-22 15:52:47 +00:00
Igor Nikonov
bf190381f5 addJoinedBlock -> addBlockToJoin 2023-07-05 17:03:18 +00:00
Nikolai Kochetov
afa74f697c Refactor a bit. 2023-06-16 19:38:50 +00:00
Alexander Tokmakov
70d1adfe4b
Better formatting for exception messages (#45449)
* save format string for NetException

* format exceptions

* format exceptions 2

* format exceptions 3

* format exceptions 4

* format exceptions 5

* format exceptions 6

* fix

* format exceptions 7

* format exceptions 8

* Update MergeTreeIndexGin.cpp

* Update AggregateFunctionMap.cpp

* Update AggregateFunctionMap.cpp

* fix
2023-01-24 00:13:58 +03:00
vdimir
506bf2d225
Merge branch 'master' into grace_hash_join 2022-10-26 12:25:50 +00:00
Azat Khuzhin
4e76629aaf Fixes for -Wshorten-64-to-32
- lots of static_cast
- add safe_cast
- types adjustments
  - config
  - IStorage::read/watch
  - ...
- some TODO's (to convert types in future)

P.S. That was quite a journey...

v2: fixes after rebase
v3: fix conflicts after #42308 merged
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-10-21 13:25:19 +02:00
vdimir
bf3f66b5b6
fix delayed blocks for grace hash join 2022-10-18 11:43:01 +00:00
vdimir
f3781be762
wip grace hash 2022-10-04 08:20:13 +00:00
vdimir
6d4b6c452a
Merge branch 'master' into grace_hash_join 2022-09-07 08:00:14 +00:00
Vladimir C
a627b00c43
Merge branch 'master' into refactor-prepared-sets 2022-08-04 13:27:38 +02:00
Robert Schulze
a7734672b9
Use std::popcount, ::countl_zero, ::countr_zero functions
- Introduced with the C++20 <bit> header

- The problem with __builtin_c(l|t)z() is that 0 as input has an
  undefined result (*) and the code did not always check. The std::
  versions do not have this issue.

- In some cases, we continue to use buildin_c(l|t)z(), (e.g. in
  src/Common/BitHelpers.h) because the std:: versions only accept
  unsigned inputs (and they also check that) and the casting would be
  ugly.

(*) https://gcc.gnu.org/onlinedocs/gcc/Other-Builtins.html
2022-07-31 15:16:51 +00:00
Maksim Kita
8fc6bad4f4 Join enums refactoring 2022-07-29 18:35:05 +02:00
vdimir
1e3fa2e01f
Refactor PreparedSets/SubqueryForSet 2022-07-26 18:39:02 +00:00
vdimir
af55f1c1e3 Update toPowerOfTwo in ConcurrentHashJoin 2022-07-12 20:22:35 +02:00
vdimir
b4176828c6 Apply intHash64 on top of WeakHash32 for parallel join 2022-07-12 20:22:35 +02:00
vdimir
218288ee6c upd ConcurrentHashJoin 2022-07-12 20:22:35 +02:00
vdimir
2ec373c6a7 Number of shards in parallel hash join is always power of two 2022-07-12 20:22:35 +02:00
vdimir
f3e84d8fc6 fix order in 01913_join_push_down_bug 00952_input_function 2022-07-12 20:22:35 +02:00
vdimir
a7ea163e3b Fix parallel hash join to lowcard keys 2022-07-12 20:22:35 +02:00
Sergey Skvortsov
7285143448 refactor: Extract common hasNonJoinedBlocks 2022-06-18 02:31:51 +03:00
Sergey Skvortsov
56861d1f05 refactor: Extract block sharding logic from ConcurrentHashJoin 2022-06-18 02:29:36 +03:00
Vladimir C
4065b83ba9
Update ConcurrentHashJoin.cpp 2022-05-10 14:14:58 +02:00
Vladimir C
43935f71f7
Update ConcurrentHashJoin.cpp 2022-05-10 14:09:49 +02:00
vdimir
d712985575
Minor style changes for ConcurrentHashJoin 2022-05-06 15:17:46 +00:00
lgbo-ustc
595ba6bd9f udpate dispatchBlock() 2022-05-05 12:04:11 +08:00
lgbo-ustc
f9f241e566 fixed fast test. remove unused header 2022-05-05 11:16:33 +08:00
lgbo-ustc
2ddccdc21c update codes 2022-05-05 10:02:50 +08:00
lgbo-ustc
5021cb707c update 2022-04-29 17:41:26 +08:00
lgbo-ustc
10b7e08319 update 2022-04-27 16:41:34 +08:00
lgbo-ustc
7505ce426a update 2022-04-27 13:11:24 +08:00
lgbo-ustc
c7841d226b udpate 2022-04-26 11:29:18 +08:00
lgbo-ustc
c68806fbff fixed typos 2022-04-25 16:16:50 +08:00
lgbo-ustc
221bc9c970 update 2022-04-24 17:14:13 +08:00
lgbo-ustc
a38b580c6f update 2022-04-24 15:19:16 +08:00
lgbo-ustc
056b4d1b61 update 2022-04-24 09:26:57 +08:00
lgbo-ustc
681d7d6799 update dispatchBlock() 2022-04-22 11:00:00 +08:00
lgbo-ustc
a9d9abb7a1 use column::scatter() 2022-04-21 16:59:30 +08:00
lgbo-ustc
e27d67ce8a update type name 2022-04-21 14:28:22 +08:00
lgbo-ustc
eac810ed85 use concatenateBlocks 2022-04-21 14:10:09 +08:00
lgbo-ustc
60964b207d update addJoinedBlock() 2022-04-21 13:19:33 +08:00
lgbo-ustc
bfd1a0e33a update codes 2022-04-21 12:14:36 +08:00
lgbo-ustc
c844415578 add new join_algorithm parallel_hash 2022-04-20 19:47:16 +08:00
lgbo-ustc
3f2fe3ff66 fixed code style 2022-04-19 18:47:29 +08:00
lgbo-ustc
9dfe2a6682 fixed header style 2022-04-19 16:53:24 +08:00
lgbo-ustc
3d7338581b Improve join
now adding joined blocks from right table can be run parallelly, speedup the join process
2022-04-19 16:07:30 +08:00