Commit Graph

35 Commits

Author SHA1 Message Date
tavplubix
0046b9f137 Wait for jobs to finish on exception (fixes rare segfaults) (#7350) 2019-10-17 17:41:27 +03:00
Alexander Kuzmenkov
f3bde19b74 Do not use iterators in find() and emplace() methods of hash tables.
Instead, these methods return a pointer to the required data as they are
stored inside the hash table. The caller uses overloaded functions to
get the key and "mapped" values from this pointer. Such an interface
avoids the need for constructing iterator-like wrapper objects, which is
especially important for compound hash tables such as the future
StringHashMap.
2019-09-24 17:44:35 +03:00
Amos Bird
26ab5dd7a7 A Proper lookup table that uses HashTable's API
This is the first step of allowing heterogeneous cells in hash tables.

performance test results are

```

1. HashMap<UInt16, UInt8, TrivialHash, HashTableFixedGrower<16>>;
2. NewLookupMap<UInt16, UInt8>

ResolutionWidth 30000 1 .................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................223550276.46
ResolutionWidth 30000 2 .................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................248772721.24
Best: 2 - 24877272124

ResolutionWidth 100000 1 ..........................................................................................................................................................................................................................................................238498413.99
ResolutionWidth 100000 2 ..........................................................................................................................................................................................................................................................261808889.98
Best: 2 - 26180888998

ResolutionWidth 300000 1 ...................................................................................239307348.81
ResolutionWidth 300000 2 ...................................................................................257592761.30
Best: 2 - 25759276130

ResolutionWidth 1000000 1 .........................240144759.26
ResolutionWidth 1000000 2 .........................257093531.91
Best: 2 - 25709353191

ResolutionWidth 5000000 1 .....241573260.35
ResolutionWidth 5000000 2 .....259314162.79
Best: 2 - 25931416279

ResolutionDepth 30000 1 .................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................217108119.84
ResolutionDepth 30000 2 .................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................249459504.41
Best: 2 - 24945950441

ResolutionDepth 100000 1 ..........................................................................................................................................................................................................................................................229065162.17
ResolutionDepth 100000 2 ..........................................................................................................................................................................................................................................................253769105.64
Best: 2 - 25376910564

ResolutionDepth 300000 1 ...................................................................................233079225.18
ResolutionDepth 300000 2 ...................................................................................256316273.78
Best: 2 - 25631627378

ResolutionDepth 1000000 1 .........................234184633.51
ResolutionDepth 1000000 2 .........................261100491.57
Best: 2 - 26110049157

ResolutionDepth 5000000 1 .....233118795.66
ResolutionDepth 5000000 2 .....252436160.41
Best: 2 - 25243616041

```
2019-03-01 16:47:13 +08:00
Alexey Milovidov
abcd5a2a49 Attempt to implemnt global thread pool #4018 2019-01-11 22:12:36 +03:00
proller
300bbdfb43 Fix cyclic lib depend ppart 2: clean 2018-12-28 21:15:26 +03:00
Alexey Milovidov
fc27be314b Avoid temporary nullptr references [#CLICKHOUSE-2] 2018-09-02 06:00:04 +03:00
Alexey Milovidov
c86fd31097 Addition to prev. revision [#CLICKHOUSE-2] 2018-02-25 05:23:04 +03:00
Alexey Milovidov
495daffa16 Miscellaneous [#CLICKHOUSE-2]. 2017-08-30 21:13:32 +03:00
proller
4db8d09de9 Reorganize includes. part 1 (#921)
* Make libunwind optional. Allow use custom libcctz

* fix

* Fix

* fix

* Update BaseDaemon.cpp

* Update CMakeLists.txt

* Reorganize includes. part 1

* Update dbms_include.cmake

* Reorganize includes. part 2

* Reorganize includes. part 3

* dbms/src/Common/ThreadPool -> libs/libcommon

* Reorganize includes. part 4

* Fix print_include_directories

* Update thread_creation_latency.cpp

* Update StringRef.h
2017-06-23 23:22:35 +03:00
Alexey Milovidov
45c76803a9 Moved table functions to separate library; fixed errors; improved testability [#CLICKHOUSE-31]. 2017-06-10 12:04:31 +03:00
Alexey Milovidov
310736cd7e Moved headers and sources to same place [#CLICKHOUSE-3]. 2017-04-01 12:22:42 +03:00
Alexey Milovidov
137ad95929 Changed tabs to spaces in code [#CLICKHOUSE-3]. 2017-04-01 11:35:09 +03:00
Alexey Milovidov
14c8003081 Normalized formatting [#CLICKHOUSE-3].
Apply in a loop:
find dbms -name '*.h' -or -name '*.cpp' | xargs grep -l -P '^(\t*)    ' | xargs sed -i -r -e 's/^(\t*)    /\1\t/'
2017-03-26 04:28:07 +03:00
f1yegor
bc0d9a2cae translate comments 2017-03-25 21:12:56 +01:00
Alexey Milovidov
9a07830dbb Removed useless code (experimental) [#METR-2944]. 2016-08-02 04:46:05 +03:00
Alexey Milovidov
4c7eb03b63 Using std::shared_ptr for data types [#METR-21503]. 2016-05-28 13:35:44 +03:00
Alexey Milovidov
86a77fbb6e Using std::shared_ptr for data types [#METR-21503]. 2016-05-28 13:29:17 +03:00
Alexey Milovidov
6863e72f3d Using std::shared_ptr for data types [#METR-21503]. 2016-05-28 13:15:36 +03:00
Vladimir Chebotarev
866c8929e2 dbms, contrib: GCC 6 build fixes [#METR-20000] 2016-05-23 03:41:26 +03:00
Alexey Milovidov
563e410b72 Moved threadpool library to contrib [#METR-17973]. 2016-02-05 08:07:39 +03:00
Alexey Milovidov
af37192e0c dbms: fixed errors on gcc-5 [#METR-18843]. 2015-11-16 07:15:53 +03:00
Alexey Milovidov
3a5032fd4a Moved files [#METR-17973]. 2015-10-05 03:52:29 +03:00
Alexey Milovidov
4a061b97cb Moved file [#METR-17973]. 2015-10-05 03:44:40 +03:00
Alexey Milovidov
86e9e77eae Fixed errors in clang (part 5, final) [#METR-2807]. 2015-01-22 04:13:13 +03:00
Alexey Milovidov
43c75bb37b dbms: more scalable aggregator: development [#METR-2944]. 2014-12-31 00:11:57 +03:00
Alexey Milovidov
3caccf278e dbms: aggregator: experiments [#METR-2944]. 2014-12-27 00:13:58 +03:00
Alexey Milovidov
50032e1da5 dbms: more scalable aggregator: experiments [#METR-2944]. 2014-12-26 23:42:35 +03:00
Alexey Milovidov
1221f2ba53 Fixed build [#METR-2944]. 2014-12-24 23:54:02 +03:00
Alexey Milovidov
8b5be77c11 dbms: updated test [#METR-2944]. 2014-05-19 11:17:15 +04:00
Alexey Milovidov
734acc10c2 dbms: experiments with hash tables: removed code of unsuccessful method of parallel aggregation [#METR-2944]. 2014-05-03 20:35:18 +04:00
Alexey Milovidov
2b13e02d3c dbms: fixed error [#METR-2944]. 2014-05-03 20:03:49 +04:00
Alexey Milovidov
2dc708e70c dbms: experiments with hash tables [#METR-2944]. 2014-05-03 05:45:34 +04:00
Alexey Milovidov
04cb4d878b dbms: experiments with hash tables [#METR-2944]. 2014-05-03 04:08:35 +04:00
Alexey Milovidov
4aa1b5963b dbms: continue [#METR-2944]. 2014-05-02 19:48:03 +04:00
Alexey Milovidov
b394bc5a61 dbms: experiments with hash tables [#METR-2944]. 2014-05-02 16:49:39 +04:00