Commit Graph

29358 Commits

Author SHA1 Message Date
akuzm
ab85d145a2
Merge pull request #6873 from yandex/aku/internal-iteration
Use internal iteration over hash tables in Aggregator.
2019-09-10 22:02:53 +03:00
Amos Bird
8f28a36c17 Use internal iteration over hash tables in Aggregator.
For compound hash tables such as the future StringHashMap, an
iterator-based API might be inefficient for iterating over a table or
for merging two tables, because:

1) the key has to be converted to a general format from a from a
   component-specific format, which may differ between the components;

2) the information about the component of the compound hash table to
   which the value belongs is lost, and has to be recalculated if the
   value is reinserted.

A more efficient approach is to use internal iteration, that is,
map-like functions, which avoids unnecessary conversions when iterating,
and allows to use an efficient component-wise approach when merging.
2019-09-10 21:52:53 +03:00
Amos Bird
a1310ffbe6 Split libdbms.so using object library
Now the linking time of incremental builds are around 1-2 seconds
2019-09-11 01:56:01 +08:00
Alexander Kuzmenkov
160e0faf77 Do not use iterator::getValue() in Aggregator.
Use separate key and "mapped" value references instead. This is
important for hash tables that do not store the key/"mapped" pair
directly, and cannot provide this interface without some runtime
overhead.
2019-09-10 20:12:30 +03:00
Alexander Kuzmenkov
8e9a8584e0 Do not provide mutable key access in hash map cells.
We don't need it anymore after we changed the hash table key memory
management to use callbacks. Removing this interface is important for
hash maps that do not store the key, such as FixedHashMap or the
prospective compound StringHashMap.
2019-09-10 20:12:30 +03:00
Nikolai Kochetov
e9e0bd82b9 Change number of aggregating streams. 2019-09-10 20:08:06 +03:00
alexey-milovidov
189058308d
Merge pull request #6888 from huangzhhui/patch-2
Use the right words
2019-09-10 17:41:01 +03:00
黄朝晖
3625769e00
Update index.md 2019-09-10 22:26:50 +08:00
Nikolai Kochetov
8734c8339e Fix race in PipelineExecutor. 2019-09-10 16:12:18 +03:00
Amos Bird
7b30835b13 Fix build error when cmake_minimum_required(3.12) 2019-09-10 20:46:39 +08:00
akazz
33f462d011 Dropped some garbage lines 2019-09-10 15:37:14 +03:00
akazz
4f71fe715c Strong exception safety guarantee:
Based on std::list<>::emplace_back() and std::unordered_map<>::emplace()
provide strong exception safety, RWLockImpl is now changed to provide
the same level of exception safety.
2019-09-10 15:33:45 +03:00
Nikolai Kochetov
7b0a6aec05 Fix raice in PipelineExecutor. 2019-09-10 15:14:47 +03:00
BayoNet
aa0e3fd0d1
Docs links fix (#6885)
* Typo fix.

* Links fix.

* Fixed links in docs.

* More fixes.
2019-09-10 14:58:26 +03:00
Nikolai Kochetov
3646124873 Fix raice in PipelineExecutor. 2019-09-10 14:17:55 +03:00
BayoNet
36c0179f54
Fix of links in docs (#6884)
* Typo fix.

* Links fix.
2019-09-10 14:07:05 +03:00
Nikolai Kochetov
a9d41d580a Fix asan crash in PipelineExecutor. 2019-09-10 12:50:38 +03:00
Nikolai Kochetov
72fea5bf97 Added ThreadsQueue to PipelineExecutor. 2019-09-10 11:50:31 +03:00
Nikolai Kochetov
73bda85998 Added ThreadsQueue to PipelineExecutor. 2019-09-10 11:45:48 +03:00
Clément Rodriguez
10be7809cd
Fix connection to early MySQL connection closure in MySQLBlockInputStream.cpp 2019-09-10 10:21:13 +02:00
BayoNet
1bd75b1e74
DOCAPI-7745: optimize_throw_if_noop docs. (#6848)
* Typo fix.

* DOCAPI-7745: The first version.

* DOCAPI-7745: More text

* DOCAPI-7745: More text.

* Update docs/en/operations/settings/settings.md

Co-Authored-By: Ivan Blinkov <github@blinkov.ru>

* Update docs/en/query_language/misc.md

Co-Authored-By: Ivan Blinkov <github@blinkov.ru>

* DOCAPI-7745: Fixes.
2019-09-10 11:06:22 +03:00
Nikolai Kochetov
5165bbd88a Fix asan crash in PipelineExecutor. 2019-09-10 11:03:02 +03:00
alexey-milovidov
ce47e707c1
Merge pull request #6849 from den-crane/patch-8
Doc change. TTL examples
2019-09-10 02:41:46 +03:00
alexey-milovidov
892959033f
Merge pull request #6857 from den-crane/patch-9
Doc change. Added some system queries (1st attempt).
2019-09-10 02:41:11 +03:00
alexey-milovidov
76459a4f57
Update system.md 2019-09-10 02:41:03 +03:00
alexey-milovidov
87ec80089a
Update system.md 2019-09-10 02:40:41 +03:00
alexey-milovidov
84eafda093
Merge pull request #6875 from den-crane/patch-10
Doc Change. Fixed rowbinary RU translation and added rowbinarywithnamesandtypes
2019-09-10 02:39:01 +03:00
proller
54a5b801b7 Build fixes (Orc, ...) (#6835)
* Fix build

* cmake: fix cpuinfo

* Fix includes after processors merge

Conflicts:
	dbms/src/Processors/Formats/Impl/CapnProtoRowInputFormat.cpp
	dbms/src/Processors/Formats/Impl/ParquetBlockOutputFormat.cpp
	dbms/src/Processors/Formats/Impl/ProtobufRowInputFormat.cpp
	dbms/src/Processors/Formats/Impl/ProtobufRowOutputFormat.cpp

* Fix build in gcc8

* fix test link

* fix test link

* Fix test link

* link fix

* Fix includes after processors merge 2

Conflicts:
	dbms/src/Processors/Formats/Impl/ParquetBlockInputFormat.cpp

* Fix includes after processors merge 3

* link fix

* Fix likely/unlikely conflict with cython

* Fix conflict with protobuf/stubs/atomicops.h

* remove unlikely.h

* Fix macos build (do not use timer_t)

* wip

* Fix build (orc, ...)

* Missing files

* Try fix

* fix hdfs

* Fix llvm 7.1 find
2019-09-10 00:40:40 +03:00
Denis Zhuravlev
282e24975b
Update formats.md 2019-09-09 15:42:12 -03:00
Denis Zhuravlev
1275ed4641
Update system.md 2019-09-09 15:35:41 -03:00
Denis Zhuravlev
8002b7d7a8
Update docs/en/query_language/system.md
Co-Authored-By: Ivan Blinkov <github@blinkov.ru>
2019-09-09 15:34:48 -03:00
Denis Zhuravlev
851daebe4c
Update docs/ru/query_language/system.md
Co-Authored-By: Ivan Blinkov <github@blinkov.ru>
2019-09-09 15:34:32 -03:00
Denis Zhuravlev
927a31f8e2
Update docs/en/query_language/system.md
Co-Authored-By: Ivan Blinkov <github@blinkov.ru>
2019-09-09 15:34:08 -03:00
Nikolai Kochetov
eeba24b238 Try to fix race in PipelineExecutor. 2019-09-09 20:56:58 +03:00
Denis Zhuravlev
0c6d583a15 Doc change. less confusing description for pointInEllipses (#6790) 2019-09-09 20:51:58 +03:00
Ivan Blinkov
9f94eb74df
Remove link to past meetup 2019-09-09 20:32:15 +03:00
Denis Zhuravlev
e8cf800c6e
Update formats.md
Fixed rowbinary RU translation and added rowbinarywithnamesandtypes
2019-09-09 14:12:43 -03:00
Nikolai Kochetov
423a5c35e8 Try to fix race in PipelineExecutor. 2019-09-09 20:12:26 +03:00
Nikolai Kochetov
da798142a5 Try to fix race in PipelineExecutor. 2019-09-09 20:10:37 +03:00
Denis Zhuravlev
4004f17b09
Update formats.md
Added RowBinaryWithNamesAndTypes toc. Fixed list formatting.
2019-09-09 14:09:42 -03:00
Denis Zhuravlev
10011d1483
Update formats.md
Fixed rowbinary translation and added rowbinarywithnamesandtypes
2019-09-09 14:05:18 -03:00
Ivan
6c32fc3fc1
Store offsets manually for each message (#6872) 2019-09-09 19:59:51 +03:00
Nikolai Kochetov
9df1235046 Pin sources to streams in PipelineExecutor. 2019-09-09 19:53:02 +03:00
Nikolai Kochetov
818696a9a7 Pin sources to streams in PipelineExecutor. 2019-09-09 19:29:11 +03:00
Nikolai Kochetov
3a849c3c5f Pin sources to streams in PipelineExecutor. 2019-09-09 18:43:19 +03:00
Nikolai Kochetov
038aa82305 Update TCPHandler 2019-09-09 17:57:12 +03:00
Nikolai Kochetov
c9cca3ba8b Merged with master 2019-09-09 16:20:30 +03:00
alexey-milovidov
abc7fbf6c8
Merge pull request #6866 from AlexMAS/patch-1
Fix formatting error
2019-09-09 15:34:56 +03:00
Nikolai Kochetov
04d2f32e17 Check thread is joinable in PipelineExecutor. 2019-09-09 15:09:48 +03:00
Yuriy Baranov
f6e1a26806
Merge pull request #6865 from yurriy/mysql
Releasing resources after query execution in MySQL compatibility server
2019-09-09 09:43:28 +03:00