alexey-milovidov
ba40858094
Merge pull request #6928 from proller/fix27
...
CLICKHOUSE-4652 Another fix for АrrayEnumerateUniqRanked with empty arrays
2019-09-13 08:57:30 +03:00
alexey-milovidov
b31c5d15b6
Merge pull request #6929 from vitlibar/better-http-server-in-test_dictionaries_all_layouts_and_sources
...
Better simulation of HTTP server for integration test
2019-09-13 08:55:38 +03:00
Mikhail Filimonov
3f9d4a5d8e
performance test for lowcardinality array, showing significant performance degradation comparing to plain array
2019-09-12 22:46:31 +02:00
Vitaly Baranov
df372ba7b3
Better simulation of HTTP server used in the integration test test_dictionaries_all_layouts_and_sources
2019-09-12 23:11:25 +03:00
proller
0d6612d424
CLICKHOUSE-4652 Simpler
2019-09-12 22:52:24 +03:00
proller
8ce32897fa
CLICKHOUSE-4652 Another fix for АrrayEnumerateUniqRanked with empty arrays
2019-09-12 22:38:34 +03:00
chertus
bb5287841f
make things wrong 2
2019-09-12 21:06:25 +03:00
Nikolai Kochetov
2e61f17991
Disable processors by default.
2019-09-12 20:51:34 +03:00
Nikolai Kochetov
eac45eaf3e
More priority to pinned tasks in PipelineExecutor.
2019-09-12 17:57:04 +03:00
Nikolai Kochetov
7a31d967d9
More priority to pinned tasks in PipelineExecutor.
2019-09-12 17:50:51 +03:00
Nikolai Kochetov
ec48361ef0
More priority to pinned tasks in PipelineExecutor.
2019-09-12 17:46:41 +03:00
chertus
f7f2cface9
better nullability flags for JOINs
2019-09-12 17:09:05 +03:00
Nikolai Kochetov
1319168a3a
Merge branch 'master' into processors-2
2019-09-12 16:28:51 +03:00
Nikolai Kochetov
9dea55c284
Do not pin sources for non MergeTree tables.
2019-09-12 16:23:24 +03:00
Nikolai Kochetov
1ff30b1621
Update PipelineExecutor.
2019-09-12 16:07:54 +03:00
chertus
441faba0e3
materializeBlockInplace function
2019-09-12 15:59:53 +03:00
chertus
61c940d5a9
better materialization logic in Join.cpp
2019-09-12 15:24:19 +03:00
Nikolai Kochetov
d7596e51b7
Removed convert_types_to_low_cardinality from NativeBlockInputStream.
2019-09-12 14:33:46 +03:00
Nikolai Kochetov
1b906bfeaf
Remove LFStack. Added ThreadsQueue as separate data structure.
2019-09-12 14:22:58 +03:00
Nikolai Kochetov
4ba0ed731f
Remove LFStack. Added ThreadsQueue as separate data structure.
2019-09-12 14:19:54 +03:00
Nikolai Kochetov
d0e84e630a
Remove LFStack. Added ThreadsQueue as separate data structure.
2019-09-12 14:13:34 +03:00
Nikolai Kochetov
7d93d70e94
Remove LFStack. Added ThreadsQueue as separate data structure.
2019-09-12 14:07:36 +03:00
Nikolai Kochetov
4115d79a30
Added test for LowCardinality conversions in Native over http.
2019-09-12 12:51:29 +03:00
Nikolai Kochetov
959744fede
Address header by name in NativeBlockInputStream.
2019-09-12 12:34:47 +03:00
Nikolai Kochetov
4722d371a1
Add test from #6862 .
2019-09-12 11:45:19 +03:00
alexey-milovidov
c5cf4fa4f4
Merge pull request #6878 from azat-archive/build--fixes
...
Trivial build fixes (mostly for -DSPLIT_SHARED_LIBRARIES=ON)
2019-09-12 03:25:19 +03:00
alexey-milovidov
a14b3c7fcb
Merge pull request #6908 from infinivision/fix_6880
...
use croaring serialization functions
2019-09-12 03:21:05 +03:00
alexey-milovidov
cb2f4ebfaf
Merge pull request #6909 from abyss7/issue-6902
...
Put delimiter only after consuming a message
2019-09-12 03:20:38 +03:00
Azat Khuzhin
02befdd8c2
Introduce distributed_directory_monitor_max_sleep_time_ms setting
...
This will replace static 30 seconds max_sleep_time for the
StorageDistributedDirectoryMonitor, since in some cases 30 seconds can
be too large.
2019-09-12 03:16:06 +03:00
alexey-milovidov
f61212cdae
Merge pull request #6906 from amosbird/bf2
...
Fix non-ssl build.
2019-09-12 03:11:14 +03:00
alexey-milovidov
e7c6943f53
Merge pull request #6915 from amosbird/bf3
...
Robust shared build
2019-09-12 03:10:20 +03:00
Azat Khuzhin
d682a271ff
Missing Poco XML for copier (fixes -DSPLIT_SHARED_LIBRARIES=OFF build)
2019-09-12 02:04:43 +03:00
alexey-milovidov
6fbf9ca7ab
Merge pull request #6911 from yandex/fix-insert-select-data-loss
...
Fix insert select data loss
2019-09-12 00:36:59 +03:00
Amos Bird
93c0880ca7
Fix non-ssl build.
2019-09-12 04:20:27 +08:00
Amos Bird
9152a832c4
Robust shared build
2019-09-12 04:01:46 +08:00
chertus
fc7ce2753d
extract more common join functions
2019-09-11 21:03:21 +03:00
Nikolai Kochetov
d913e415b8
Fix Adam::merge if right state wasn't initialized.
2019-09-11 20:48:42 +03:00
alesapin
b0fce77c3d
Fix path to data on disk
2019-09-11 20:17:10 +03:00
Nikolai Kochetov
95abc1f910
Removed dynamic_cast from PipelineExecutor.
2019-09-11 20:06:06 +03:00
Nikolai Kochetov
9916be2800
Small refactor in PipelienExecutor. Added comment in AggregatingTransform.
2019-09-11 19:31:15 +03:00
chertus
a836f0cfd6
fix columns number in MergeJoin
2019-09-11 19:19:33 +03:00
chertus
73dafaa223
better required-right-keys logic
2019-09-11 18:57:09 +03:00
Nikolai Kochetov
a2248868d8
Fix ast type checking.
2019-09-11 18:37:12 +03:00
Nikolai Kochetov
55acc72249
Added test.
2019-09-11 16:57:39 +03:00
Ivan Lezhankin
c5f1352394
Decide to put delimiter only after polled message
2019-09-11 16:16:43 +03:00
Ivan Lezhankin
622ab139ee
Add test
2019-09-11 16:13:09 +03:00
alexey-milovidov
6b1352f65c
Merge pull request #6893 from malkfilipp/client_older_than_server
...
Display warning if clickhouse-client version is older than clickhouse-server.
2019-09-11 16:02:35 +03:00
alexey-milovidov
f1f177c451
Merge pull request #6896 from amosbird/bf
...
Build fix
2019-09-11 15:41:48 +03:00
alexey-milovidov
3ca084ec57
Merge pull request #6854 from Akazz/rwlock-cumulative-update-1
...
Rwlock sanitary update 1: removed weak_ptrs from implementation + added strong exception safety guarantee
2019-09-11 15:40:28 +03:00
Zhichang Yu
6c5019ca39
use croaring serialization functions
2019-09-11 12:35:43 +00:00
Nikolai Kochetov
a59ae3826d
Do not flush output stream in copy data. Add special flushing callback to Watch query.
2019-09-11 14:38:05 +03:00
Guillaume Tassery
140883ab83
Cosmetic
2019-09-11 13:17:43 +02:00
Guillaume Tassery
5f1621faa2
Add database right for dictionaries
2019-09-11 13:14:55 +02:00
alesapin
0b8aec469f
Make absolute path on disks start from /clickhouse/data, fix freeze and rename, add tests
2019-09-11 13:57:32 +03:00
Nikolai Kochetov
172e4d76d7
Added more comments.
2019-09-11 13:46:41 +03:00
Nikolai Kochetov
96f7eb1141
Change number of aggregating streams.
2019-09-11 13:07:04 +03:00
malkfilipp
62f85c0a3a
Switch to tuples
2019-09-11 11:41:57 +03:00
Amos Bird
bf799fef92
Build fix
2019-09-11 10:53:56 +08:00
Azat Khuzhin
6c646a6978
Missing <chrono> for gtest_sensitive_data_masker
...
I guess that <chrono> had been included somewhere before in primary env.
2019-09-11 02:04:11 +03:00
alexey-milovidov
a446ec5e61
Merge pull request #6882 from clemrodriguez/issue-6825
...
Fix too early MySQL connection closure in MySQLBlockInputStreamream.cpp
2019-09-11 02:03:20 +03:00
alexey-milovidov
254102c5bd
Merge pull request #6602 from amosbird/object-library
...
Split libdbms.so using object library
2019-09-11 02:00:13 +03:00
malkfilipp
b63d2422d0
Change versions comparing from string to number
2019-09-11 01:29:21 +03:00
Akazz
7b65dfb867
Build fixed
2019-09-11 01:21:08 +03:00
alexey-milovidov
8fa72c6804
Update Client.cpp
2019-09-10 23:10:23 +03:00
Akazz
40a9495267
Some formatting + minor change
2019-09-10 22:58:04 +03:00
malkfilipp
058c04e759
Add a warning if the client is older than the server
2019-09-10 22:28:33 +03:00
akuzm
ab85d145a2
Merge pull request #6873 from yandex/aku/internal-iteration
...
Use internal iteration over hash tables in Aggregator.
2019-09-10 22:02:53 +03:00
Amos Bird
8f28a36c17
Use internal iteration over hash tables in Aggregator.
...
For compound hash tables such as the future StringHashMap, an
iterator-based API might be inefficient for iterating over a table or
for merging two tables, because:
1) the key has to be converted to a general format from a from a
component-specific format, which may differ between the components;
2) the information about the component of the compound hash table to
which the value belongs is lost, and has to be recalculated if the
value is reinserted.
A more efficient approach is to use internal iteration, that is,
map-like functions, which avoids unnecessary conversions when iterating,
and allows to use an efficient component-wise approach when merging.
2019-09-10 21:52:53 +03:00
chertus
8afa48fa42
some joins code unification
2019-09-10 21:39:10 +03:00
Amos Bird
a1310ffbe6
Split libdbms.so using object library
...
Now the linking time of incremental builds are around 1-2 seconds
2019-09-11 01:56:01 +08:00
alesapin
34a454aa62
Remove redundant code, that caused race for part object
2019-09-10 20:17:10 +03:00
Alexander Kuzmenkov
160e0faf77
Do not use iterator::getValue() in Aggregator.
...
Use separate key and "mapped" value references instead. This is
important for hash tables that do not store the key/"mapped" pair
directly, and cannot provide this interface without some runtime
overhead.
2019-09-10 20:12:30 +03:00
Alexander Kuzmenkov
8e9a8584e0
Do not provide mutable key access in hash map cells.
...
We don't need it anymore after we changed the hash table key memory
management to use callbacks. Removing this interface is important for
hash maps that do not store the key, such as FixedHashMap or the
prospective compound StringHashMap.
2019-09-10 20:12:30 +03:00
Nikolai Kochetov
e9e0bd82b9
Change number of aggregating streams.
2019-09-10 20:08:06 +03:00
Nikolai Kochetov
bcc764e2cd
Use header in native format created in InterpreterSelectQuery. Fill missed columns in Native format.
2019-09-10 19:45:53 +03:00
Nikolai Kochetov
7ddc8a6dde
Use header in native format created in InterpreterSelectQuery. Fill missed columns in Native format.
2019-09-10 19:41:05 +03:00
Nikolai Kochetov
8dd8ab7d1f
Use header in native format created in InterpreterSelectQuery. Fill missed columns in Native format.
2019-09-10 19:31:41 +03:00
chertus
02691f50ef
make things wrong
2019-09-10 17:51:28 +03:00
alesapin
5a45265344
Create global dir
2019-09-10 17:32:32 +03:00
Nikolai Kochetov
071b5dd514
Add LowCardinality conversion to Native format if types of columns are not equals.
2019-09-10 17:30:13 +03:00
Nikolai Kochetov
30394113a1
Add LowCardinality conversion to Native format if types of columns are not equals.
2019-09-10 17:16:31 +03:00
Nikolai Kochetov
8734c8339e
Fix race in PipelineExecutor.
2019-09-10 16:12:18 +03:00
alesapin
65851e27d0
Fix freeze partition
2019-09-10 16:06:26 +03:00
akazz
33f462d011
Dropped some garbage lines
2019-09-10 15:37:14 +03:00
akazz
4f71fe715c
Strong exception safety guarantee:
...
Based on std::list<>::emplace_back() and std::unordered_map<>::emplace()
provide strong exception safety, RWLockImpl is now changed to provide
the same level of exception safety.
2019-09-10 15:33:45 +03:00
alesapin
ac4ab3ca2b
Fix rename bug
2019-09-10 15:23:18 +03:00
Nikolai Kochetov
7b0a6aec05
Fix raice in PipelineExecutor.
2019-09-10 15:14:47 +03:00
alesapin
193049293a
More comments, more readable code
2019-09-10 14:21:59 +03:00
Nikolai Kochetov
3646124873
Fix raice in PipelineExecutor.
2019-09-10 14:17:55 +03:00
Nikolai Kochetov
a9d41d580a
Fix asan crash in PipelineExecutor.
2019-09-10 12:50:38 +03:00
alesapin
4702e40ed7
Fix bug with b_free and small refactoring
2019-09-10 11:56:27 +03:00
Nikolai Kochetov
72fea5bf97
Added ThreadsQueue to PipelineExecutor.
2019-09-10 11:50:31 +03:00
Nikolai Kochetov
73bda85998
Added ThreadsQueue to PipelineExecutor.
2019-09-10 11:45:48 +03:00
Clément Rodriguez
10be7809cd
Fix connection to early MySQL connection closure in MySQLBlockInputStream.cpp
2019-09-10 10:21:13 +02:00
Nikolai Kochetov
5165bbd88a
Fix asan crash in PipelineExecutor.
2019-09-10 11:03:02 +03:00
proller
54a5b801b7
Build fixes (Orc, ...) ( #6835 )
...
* Fix build
* cmake: fix cpuinfo
* Fix includes after processors merge
Conflicts:
dbms/src/Processors/Formats/Impl/CapnProtoRowInputFormat.cpp
dbms/src/Processors/Formats/Impl/ParquetBlockOutputFormat.cpp
dbms/src/Processors/Formats/Impl/ProtobufRowInputFormat.cpp
dbms/src/Processors/Formats/Impl/ProtobufRowOutputFormat.cpp
* Fix build in gcc8
* fix test link
* fix test link
* Fix test link
* link fix
* Fix includes after processors merge 2
Conflicts:
dbms/src/Processors/Formats/Impl/ParquetBlockInputFormat.cpp
* Fix includes after processors merge 3
* link fix
* Fix likely/unlikely conflict with cython
* Fix conflict with protobuf/stubs/atomicops.h
* remove unlikely.h
* Fix macos build (do not use timer_t)
* wip
* Fix build (orc, ...)
* Missing files
* Try fix
* fix hdfs
* Fix llvm 7.1 find
2019-09-10 00:40:40 +03:00
chertus
1b313eedfa
MergeJoin in progress
2019-09-09 22:43:37 +03:00
Nikolai Kochetov
eeba24b238
Try to fix race in PipelineExecutor.
2019-09-09 20:56:58 +03:00
Nikolai Kochetov
423a5c35e8
Try to fix race in PipelineExecutor.
2019-09-09 20:12:26 +03:00
Nikolai Kochetov
da798142a5
Try to fix race in PipelineExecutor.
2019-09-09 20:10:37 +03:00