thevar1able/ClickHouse
1
0
Fork 0
mirror of https://github.com/ClickHouse/ClickHouse.git synced 2024-12-18 20:32:43 +00:00
Code Issues Packages Projects Releases Wiki Activity
30,176 Commits 9,336 Branches 1,783 Tags 2.2 GiB
77ac67eba8
Commit Graph

21753 Commits

Author SHA1 Message Date
Alexey Milovidov
79a206b092 Fixed typo #6895 2019-09-14 18:41:47 +03:00
alexey-milovidov
6503369138
Merge pull request #6895 from azat-archive/distributed_directory_monitor_max_sleep_time-v2 
[RFC] Drop max_sleep_time limit from StorageDistributedDirectoryMonitor
 2019-09-14 18:39:27 +03:00
Vladimir Chebotarev
d53872c300 Tests improvement. 2019-09-14 07:44:46 +00:00
Ivan
66d6e0cbb3 Update 01009_global_array_join_names.reference 2019-09-14 01:03:44 +03:00
Ivan
8fcf490bd9
Update 01009_global_array_join_names.reference 2019-09-14 00:58:39 +03:00
Ivan
33e6681c90
Update 01009_global_array_join_names.sql 2019-09-13 23:00:28 +03:00
Dmitry Rubashkin
57eef84322 DROP 2019-09-13 22:09:00 +03:00
Dmitry Rubashkin
ea3f80460c Tests. 2019-09-13 22:07:22 +03:00
Dmitry Rubashkin
33e7e1ea93 Int64 added. 2019-09-13 21:25:53 +03:00
Dmitry Rubashkin
2705534be7 Merge branch 'enums_in_section' of github.com:dimarub2000/ClickHouse into enums_in_section 2019-09-13 20:50:53 +03:00
Dmitry Rubashkin
cd95e8e5e5 Fix inconsistent behaviour of IN with Enums 2019-09-13 20:49:53 +03:00
CurtizJ
ad986f285e fix redis with mixed keys 2019-09-13 20:38:56 +03:00
akuzm
e765733a26
Merge pull request #6925 from yandex/aku/msan 
Some MemorySanitizer fixes
 2019-09-13 20:26:48 +03:00
chertus
eb3d87032c all|any left|inner, not tested 2019-09-13 20:23:32 +03:00
alexey-milovidov
10e274213d
Merge pull request #6930 from filimonov/performance_test_lowcard_arr 
performance test for lowcardinality array
 2019-09-13 20:01:57 +03:00
dimarub2000
24d0055dc8 Typo 2019-09-13 19:24:59 +03:00
dimarub2000
26b1bc2093 all_of setting now works properly 2019-09-13 19:18:26 +03:00
chertus
bd957168d2 any left join (without use_nulls) 2019-09-13 19:17:37 +03:00
Ivan
d697f4a1d1
Update 01009_global_array_join_names.sql 2019-09-13 19:07:54 +03:00
Ivan Lezhankin
5b60053ef7 [WIP] 2019-09-13 17:56:27 +03:00
Ivan Lezhankin
e692a88196 CMake now works 
Example: -DCMAKE_SYSTEM_NAME=Darwin -DSDK_PATH=${HOME}/stuff/MacOSX10.12.sdk -DLINKER_NAME=${HOME}/.local/bin/ld64
 2019-09-13 17:56:27 +03:00
Ivan Lezhankin
1b5192706e Some fixes for OS X build. 2019-09-13 17:56:26 +03:00
Ivan
add919e922
Update 01009_global_array_join_names.sql 2019-09-13 17:44:04 +03:00
Vladimir Chebotarev
4406ad1061 Tests fix. 2019-09-13 13:53:17 +00:00
Ivan Lezhankin
dc49303baf Use existing alias as external table name 2019-09-13 16:25:24 +03:00
Vladimir Chebotarev
2cddcebc31 Moved server to clickhouse instance in test. 2019-09-13 13:17:58 +00:00
Alexander Kuzmenkov
f4da0399c0 Some MemorySanitizer fixes. 2019-09-13 14:49:29 +03:00
Ivan Lezhankin
a3944624a0 Add test 2019-09-13 14:10:41 +03:00
alesapin
02cff38fef Merge with master 2019-09-13 13:58:23 +03:00
Vladimir Chebotarev
b324261285 Minor test fix. 2019-09-13 10:18:09 +00:00
Vladimir Chebotarev
a54b43cd01 Better test, minor fix. 2019-09-13 13:04:21 +03:00
Nikolai Kochetov
86bee0b8b5
Merge pull request #6684 from yandex/processors-2 
Processors 2
 2019-09-13 11:58:04 +03:00
Guillaume Tassery
214d089bb5 Cosmetic and remove documentation 2019-09-13 10:26:04 +02:00
Guillaume Tassery
bb088fbf65 Write dictionary permission on user instead of dictionary configuration 2019-09-13 10:22:34 +02:00
alexey-milovidov
12c26e6013
Merge pull request #6891 from yandex/low_cardinality_in_native_http 
Low cardinality in native http
 2019-09-13 09:01:08 +03:00
alexey-milovidov
ba40858094
Merge pull request #6928 from proller/fix27 
CLICKHOUSE-4652 Another fix for АrrayEnumerateUniqRanked with empty arrays
 2019-09-13 08:57:30 +03:00
alexey-milovidov
b31c5d15b6
Merge pull request #6929 from vitlibar/better-http-server-in-test_dictionaries_all_layouts_and_sources 
Better simulation of HTTP server for integration test
 2019-09-13 08:55:38 +03:00
Mikhail Filimonov
3f9d4a5d8e performance test for lowcardinality array, showing significant performance degradation comparing to plain array 2019-09-12 22:46:31 +02:00
Vitaly Baranov
df372ba7b3 Better simulation of HTTP server used in the integration test test_dictionaries_all_layouts_and_sources 2019-09-12 23:11:25 +03:00
proller
0d6612d424 CLICKHOUSE-4652 Simpler 2019-09-12 22:52:24 +03:00
proller
8ce32897fa CLICKHOUSE-4652 Another fix for АrrayEnumerateUniqRanked with empty arrays 2019-09-12 22:38:34 +03:00
chertus
bb5287841f make things wrong 2 2019-09-12 21:06:25 +03:00
Nikolai Kochetov
2e61f17991 Disable processors by default. 2019-09-12 20:51:34 +03:00
Nikolai Kochetov
eac45eaf3e More priority to pinned tasks in PipelineExecutor. 2019-09-12 17:57:04 +03:00
Nikolai Kochetov
7a31d967d9 More priority to pinned tasks in PipelineExecutor. 2019-09-12 17:50:51 +03:00
CurtizJ
fa416dc941 fix Redis dictionary 2019-09-12 17:48:28 +03:00
Nikolai Kochetov
ec48361ef0 More priority to pinned tasks in PipelineExecutor. 2019-09-12 17:46:41 +03:00
Vladimir Chebotarev
1b715069fb Merge fix. 2019-09-12 14:38:53 +00:00
chertus
f7f2cface9 better nullability flags for JOINs 2019-09-12 17:09:05 +03:00
Nikolai Kochetov
1319168a3a Merge branch 'master' into processors-2 2019-09-12 16:28:51 +03:00
Nikolai Kochetov
9dea55c284 Do not pin sources for non MergeTree tables. 2019-09-12 16:23:24 +03:00
Nikolai Kochetov
1ff30b1621 Update PipelineExecutor. 2019-09-12 16:07:54 +03:00
chertus
441faba0e3 materializeBlockInplace function 2019-09-12 15:59:53 +03:00
chertus
61c940d5a9 better materialization logic in Join.cpp 2019-09-12 15:24:19 +03:00
Vladimir Chebotarev
599ff389f7 Merge fix. 2019-09-12 11:57:55 +00:00
Nikolai Kochetov
d7596e51b7 Removed convert_types_to_low_cardinality from NativeBlockInputStream. 2019-09-12 14:33:46 +03:00
Nikolai Kochetov
1b906bfeaf Remove LFStack. Added ThreadsQueue as separate data structure. 2019-09-12 14:22:58 +03:00
Nikolai Kochetov
4ba0ed731f Remove LFStack. Added ThreadsQueue as separate data structure. 2019-09-12 14:19:54 +03:00
Nikolai Kochetov
d0e84e630a Remove LFStack. Added ThreadsQueue as separate data structure. 2019-09-12 14:13:34 +03:00
Nikolai Kochetov
7d93d70e94 Remove LFStack. Added ThreadsQueue as separate data structure. 2019-09-12 14:07:36 +03:00
Nikolai Kochetov
4115d79a30 Added test for LowCardinality conversions in Native over http. 2019-09-12 12:51:29 +03:00
Nikolai Kochetov
959744fede Address header by name in NativeBlockInputStream. 2019-09-12 12:34:47 +03:00
Nikolai Kochetov
4722d371a1 Add test from #6862. 2019-09-12 11:45:19 +03:00
l
2b5a420f49 error: no newline at end of file [-Werror,-Wnewline-eof] 2019-09-12 07:41:16 +02:00
alexey-milovidov
c5cf4fa4f4
Merge pull request #6878 from azat-archive/build--fixes 
Trivial build fixes (mostly for -DSPLIT_SHARED_LIBRARIES=ON)
 2019-09-12 03:25:19 +03:00
alexey-milovidov
a14b3c7fcb
Merge pull request #6908 from infinivision/fix_6880 
use croaring serialization functions
 2019-09-12 03:21:05 +03:00
alexey-milovidov
cb2f4ebfaf
Merge pull request #6909 from abyss7/issue-6902 
Put delimiter only after consuming a message
 2019-09-12 03:20:38 +03:00
Azat Khuzhin
02befdd8c2
Introduce distributed_directory_monitor_max_sleep_time_ms setting 
This will replace static 30 seconds max_sleep_time for the
StorageDistributedDirectoryMonitor, since in some cases 30 seconds can
be too large.
 2019-09-12 03:16:06 +03:00
alexey-milovidov
f61212cdae
Merge pull request #6906 from amosbird/bf2 
Fix non-ssl build.
 2019-09-12 03:11:14 +03:00
alexey-milovidov
e7c6943f53
Merge pull request #6915 from amosbird/bf3 
Robust shared build
 2019-09-12 03:10:20 +03:00
Azat Khuzhin
d682a271ff
Missing Poco XML for copier (fixes -DSPLIT_SHARED_LIBRARIES=OFF build) 2019-09-12 02:04:43 +03:00
alexey-milovidov
6fbf9ca7ab
Merge pull request #6911 from yandex/fix-insert-select-data-loss 
Fix insert select data loss
 2019-09-12 00:36:59 +03:00
l
dda57fe0f7 Style checks 2019-09-11 23:08:54 +02:00
l
688b0d91a0 Style checks 2019-09-11 22:53:53 +02:00
Amos Bird
93c0880ca7 Fix non-ssl build. 2019-09-12 04:20:27 +08:00
l
adb4a58092 Style checks & security considerations added to setting description. 2019-09-11 22:18:22 +02:00
Amos Bird
9152a832c4 Robust shared build 2019-09-12 04:01:46 +08:00
chertus
fc7ce2753d extract more common join functions 2019-09-11 21:03:21 +03:00
Nikolai Kochetov
d913e415b8 Fix Adam::merge if right state wasn't initialized. 2019-09-11 20:48:42 +03:00
alesapin
b0fce77c3d Fix path to data on disk 2019-09-11 20:17:10 +03:00
Nikolai Kochetov
95abc1f910 Removed dynamic_cast from PipelineExecutor. 2019-09-11 20:06:06 +03:00
l
cdbcfc2c90 + Redirect 2019-09-11 18:39:30 +02:00
Nikolai Kochetov
9916be2800 Small refactor in PipelienExecutor. Added comment in AggregatingTransform. 2019-09-11 19:31:15 +03:00
chertus
a836f0cfd6 fix columns number in MergeJoin 2019-09-11 19:19:33 +03:00
chertus
73dafaa223 better required-right-keys logic 2019-09-11 18:57:09 +03:00
Nikolai Kochetov
a2248868d8 Fix ast type checking. 2019-09-11 18:37:12 +03:00
Nikolai Kochetov
55acc72249 Added test. 2019-09-11 16:57:39 +03:00
Ivan Lezhankin
c5f1352394 Decide to put delimiter only after polled message 2019-09-11 16:16:43 +03:00
Ivan Lezhankin
622ab139ee Add test 2019-09-11 16:13:09 +03:00
alexey-milovidov
6b1352f65c
Merge pull request #6893 from malkfilipp/client_older_than_server 
Display warning if clickhouse-client version is older than clickhouse-server.
 2019-09-11 16:02:35 +03:00
alexey-milovidov
f1f177c451
Merge pull request #6896 from amosbird/bf 
Build fix
 2019-09-11 15:41:48 +03:00
alexey-milovidov
3ca084ec57
Merge pull request #6854 from Akazz/rwlock-cumulative-update-1 
Rwlock sanitary update 1: removed weak_ptrs from implementation + added strong exception safety guarantee
 2019-09-11 15:40:28 +03:00
Zhichang Yu
6c5019ca39 use croaring serialization functions 2019-09-11 12:35:43 +00:00
Nikolai Kochetov
a59ae3826d Do not flush output stream in copy data. Add special flushing callback to Watch query. 2019-09-11 14:38:05 +03:00
Guillaume Tassery
140883ab83 Cosmetic 2019-09-11 13:17:43 +02:00
Guillaume Tassery
5f1621faa2 Add database right for dictionaries 2019-09-11 13:14:55 +02:00
alesapin
0b8aec469f Make absolute path on disks start from /clickhouse/data, fix freeze and rename, add tests 2019-09-11 13:57:32 +03:00
Nikolai Kochetov
172e4d76d7 Added more comments. 2019-09-11 13:46:41 +03:00
Nikolai Kochetov
96f7eb1141 Change number of aggregating streams. 2019-09-11 13:07:04 +03:00
malkfilipp
62f85c0a3a Switch to tuples 2019-09-11 11:41:57 +03:00
Amos Bird
bf799fef92 Build fix 2019-09-11 10:53:56 +08:00
Azat Khuzhin
6c646a6978
Missing <chrono> for gtest_sensitive_data_masker 
I guess that <chrono> had been included somewhere before in primary env.
 2019-09-11 02:04:11 +03:00
alexey-milovidov
a446ec5e61
Merge pull request #6882 from clemrodriguez/issue-6825 
Fix too early MySQL connection closure in MySQLBlockInputStreamream.cpp
 2019-09-11 02:03:20 +03:00
alexey-milovidov
254102c5bd
Merge pull request #6602 from amosbird/object-library 
Split libdbms.so using object library
 2019-09-11 02:00:13 +03:00
malkfilipp
b63d2422d0 Change versions comparing from string to number 2019-09-11 01:29:21 +03:00
Akazz
7b65dfb867 Build fixed 2019-09-11 01:21:08 +03:00
alexey-milovidov
8fa72c6804
Update Client.cpp 2019-09-10 23:10:23 +03:00
Akazz
40a9495267 Some formatting + minor change 2019-09-10 22:58:04 +03:00
malkfilipp
058c04e759 Add a warning if the client is older than the server 2019-09-10 22:28:33 +03:00
akuzm
ab85d145a2
Merge pull request #6873 from yandex/aku/internal-iteration 
Use internal iteration over hash tables in Aggregator.
 2019-09-10 22:02:53 +03:00
Amos Bird
8f28a36c17 Use internal iteration over hash tables in Aggregator. 
For compound hash tables such as the future StringHashMap, an
iterator-based API might be inefficient for iterating over a table or
for merging two tables, because:

1) the key has to be converted to a general format from a from a
   component-specific format, which may differ between the components;

2) the information about the component of the compound hash table to
   which the value belongs is lost, and has to be recalculated if the
   value is reinserted.

A more efficient approach is to use internal iteration, that is,
map-like functions, which avoids unnecessary conversions when iterating,
and allows to use an efficient component-wise approach when merging.
 2019-09-10 21:52:53 +03:00
chertus
8afa48fa42 some joins code unification 2019-09-10 21:39:10 +03:00
Amos Bird
a1310ffbe6 Split libdbms.so using object library 
Now the linking time of incremental builds are around 1-2 seconds
 2019-09-11 01:56:01 +08:00
alesapin
34a454aa62 Remove redundant code, that caused race for part object 2019-09-10 20:17:10 +03:00
Alexander Kuzmenkov
160e0faf77 Do not use iterator::getValue() in Aggregator. 
Use separate key and "mapped" value references instead. This is
important for hash tables that do not store the key/"mapped" pair
directly, and cannot provide this interface without some runtime
overhead.
 2019-09-10 20:12:30 +03:00
Alexander Kuzmenkov
8e9a8584e0 Do not provide mutable key access in hash map cells. 
We don't need it anymore after we changed the hash table key memory
management to use callbacks. Removing this interface is important for
hash maps that do not store the key, such as FixedHashMap or the
prospective compound StringHashMap.
 2019-09-10 20:12:30 +03:00
Nikolai Kochetov
e9e0bd82b9 Change number of aggregating streams. 2019-09-10 20:08:06 +03:00
Nikolai Kochetov
bcc764e2cd Use header in native format created in InterpreterSelectQuery. Fill missed columns in Native format. 2019-09-10 19:45:53 +03:00
Nikolai Kochetov
7ddc8a6dde Use header in native format created in InterpreterSelectQuery. Fill missed columns in Native format. 2019-09-10 19:41:05 +03:00
Nikolai Kochetov
8dd8ab7d1f Use header in native format created in InterpreterSelectQuery. Fill missed columns in Native format. 2019-09-10 19:31:41 +03:00
chertus
02691f50ef make things wrong 2019-09-10 17:51:28 +03:00
alesapin
5a45265344 Create global dir 2019-09-10 17:32:32 +03:00
Nikolai Kochetov
071b5dd514 Add LowCardinality conversion to Native format if types of columns are not equals. 2019-09-10 17:30:13 +03:00
Nikolai Kochetov
30394113a1 Add LowCardinality conversion to Native format if types of columns are not equals. 2019-09-10 17:16:31 +03:00
Nikolai Kochetov
8734c8339e Fix race in PipelineExecutor. 2019-09-10 16:12:18 +03:00
alesapin
65851e27d0 Fix freeze partition 2019-09-10 16:06:26 +03:00
akazz
33f462d011 Dropped some garbage lines 2019-09-10 15:37:14 +03:00
akazz
4f71fe715c Strong exception safety guarantee: 
Based on std::list<>::emplace_back() and std::unordered_map<>::emplace()
provide strong exception safety, RWLockImpl is now changed to provide
the same level of exception safety.
 2019-09-10 15:33:45 +03:00
alesapin
ac4ab3ca2b Fix rename bug 2019-09-10 15:23:18 +03:00
Nikolai Kochetov
7b0a6aec05 Fix raice in PipelineExecutor. 2019-09-10 15:14:47 +03:00
alesapin
193049293a More comments, more readable code 2019-09-10 14:21:59 +03:00
Nikolai Kochetov
3646124873 Fix raice in PipelineExecutor. 2019-09-10 14:17:55 +03:00
Nikolai Kochetov
a9d41d580a Fix asan crash in PipelineExecutor. 2019-09-10 12:50:38 +03:00
alesapin
4702e40ed7 Fix bug with b_free and small refactoring 2019-09-10 11:56:27 +03:00
Nikolai Kochetov
72fea5bf97 Added ThreadsQueue to PipelineExecutor. 2019-09-10 11:50:31 +03:00
Nikolai Kochetov
73bda85998 Added ThreadsQueue to PipelineExecutor. 2019-09-10 11:45:48 +03:00
Clément Rodriguez
10be7809cd
Fix connection to early MySQL connection closure in MySQLBlockInputStream.cpp 2019-09-10 10:21:13 +02:00
Nikolai Kochetov
5165bbd88a Fix asan crash in PipelineExecutor. 2019-09-10 11:03:02 +03:00
proller
54a5b801b7 Build fixes (Orc, ...) (#6835) 
* Fix build

* cmake: fix cpuinfo

* Fix includes after processors merge

Conflicts:
	dbms/src/Processors/Formats/Impl/CapnProtoRowInputFormat.cpp
	dbms/src/Processors/Formats/Impl/ParquetBlockOutputFormat.cpp
	dbms/src/Processors/Formats/Impl/ProtobufRowInputFormat.cpp
	dbms/src/Processors/Formats/Impl/ProtobufRowOutputFormat.cpp

* Fix build in gcc8

* fix test link

* fix test link

* Fix test link

* link fix

* Fix includes after processors merge 2

Conflicts:
	dbms/src/Processors/Formats/Impl/ParquetBlockInputFormat.cpp

* Fix includes after processors merge 3

* link fix

* Fix likely/unlikely conflict with cython

* Fix conflict with protobuf/stubs/atomicops.h

* remove unlikely.h

* Fix macos build (do not use timer_t)

* wip

* Fix build (orc, ...)

* Missing files

* Try fix

* fix hdfs

* Fix llvm 7.1 find
 2019-09-10 00:40:40 +03:00
chertus
1b313eedfa MergeJoin in progress 2019-09-09 22:43:37 +03:00
Nikolai Kochetov
eeba24b238 Try to fix race in PipelineExecutor. 2019-09-09 20:56:58 +03:00
Nikolai Kochetov
423a5c35e8 Try to fix race in PipelineExecutor. 2019-09-09 20:12:26 +03:00
Nikolai Kochetov
da798142a5 Try to fix race in PipelineExecutor. 2019-09-09 20:10:37 +03:00
alesapin
23f2cb5016 Remove double space 2019-09-09 20:02:52 +03:00
alesapin
189644e743 Better logging 2019-09-09 20:01:19 +03:00
Ivan
6c32fc3fc1
Store offsets manually for each message (#6872) 2019-09-09 19:59:51 +03:00
Nikolai Kochetov
9df1235046 Pin sources to streams in PipelineExecutor. 2019-09-09 19:53:02 +03:00
Nikolai Kochetov
818696a9a7 Pin sources to streams in PipelineExecutor. 2019-09-09 19:29:11 +03:00
Nikolai Kochetov
3a849c3c5f Pin sources to streams in PipelineExecutor. 2019-09-09 18:43:19 +03:00
Nikolai Kochetov
038aa82305 Update TCPHandler 2019-09-09 17:57:12 +03:00
alesapin
1bc0aaeb35 Less code, more comments 2019-09-09 17:20:07 +03:00
alesapin
9f88baebb9 More constants, better tests 2019-09-09 16:50:19 +03:00
Nikolai Kochetov
c9cca3ba8b Merged with master 2019-09-09 16:20:30 +03:00
Vasily Nemkov
1b0410cee7 Merge commit '50928323ebabe0663e26601c3929ee94b9a5127d' into DateTime64 2019-09-09 16:18:22 +03:00
alesapin
2288d25972 Add parser test 2019-09-09 15:41:46 +03:00
alesapin
ef08d6f10b More tests 2019-09-09 15:28:28 +03:00
Nikolai Kochetov
04d2f32e17 Check thread is joinable in PipelineExecutor. 2019-09-09 15:09:48 +03:00
alesapin
27419c965e Merge with master 2019-09-09 14:13:36 +03:00
CurtizJ
3b3657ff1e Merge branch 'add-ext-dict-redis' of https://github.com/comunodi/ClickHouse into merging_redis 2019-09-09 13:51:50 +03:00
Yuriy
6700314ce5 destroying context after executeQuery 2019-09-09 04:04:37 +03:00
alexey-milovidov
8389200229
Merge pull request #6832 from CurtizJ/merging_input_function 
Merging #5450 (table function input).
 2019-09-07 20:16:45 +03:00
Vasily Nemkov
2185531f70 DateTime64 tests 2019-09-07 17:22:22 +03:00
alexey-milovidov
25de2e12a2
Merge pull request #6399 from Enmk/replica_recovery_interval 
Improvements for failover of Distributed queries
 2019-09-07 03:21:30 +03:00
alexey-milovidov
b7cbd33886
Merge pull request #6729 from yandex/aku/key-holder 
Key memory management for compound hash tables.
 2019-09-07 03:09:18 +03:00
alexey-milovidov
b3e30d51c3
Update HashTableKeyHolder.h 2019-09-07 03:09:07 +03:00
alexey-milovidov
46e7b4f925
Merge pull request #6853 from yandex/pipe-capacity-very-old-kernels 
Returned support for very old Linux kernels (that lack of F_GETPIPE_SZ fcntl)
 2019-09-07 03:01:42 +03:00
Olga Khvostikova
e8d8dbc40b
Merge pull request #6855 from yandex/code-cleanup-storagefile 
Minor code cleanup in StorageFile
 2019-09-07 01:34:27 +03:00
alexey-milovidov
be8341d174
Merge pull request #6851 from Akazz/minor_fixes_in_tests-1 
Fixing a few things in stateless tests
 2019-09-06 22:00:54 +03:00
stavrolia
f533485d19 Minor code cleanup 2019-09-06 21:29:41 +03:00
alexey-milovidov
00edf4fac3
Update HashTable.h 2019-09-06 21:19:50 +03:00
alexey-milovidov
805bd31641
Update dbms/src/Common/HashTable/HashTable.h 
Co-Authored-By: akuzm <36882414+akuzm@users.noreply.github.com>
 2019-09-06 21:12:31 +03:00
filimonov
526afd44ed Make SensitiveDataMasker a singleton. (#6810) 
Among other things, it is used to filter logs, which are being written even after the global server context is deinitialized, so we can't keep masker there.
 2019-09-06 20:48:27 +03:00
alexey-milovidov
2ffc99b893
Merge pull request #6846 from yandex/aku/fixed-hash-table 
Cosmetic change: remove redundant functions from FixedHashTable
 2019-09-06 20:20:26 +03:00
alexey-milovidov
71ed9477dc
Update FixedHashTable.h 2019-09-06 20:20:19 +03:00
alexey-milovidov
c90dfc1e48
Merge pull request #6837 from filimonov/fix_some_pvs_reported_issues 
Fix some pvs reported issues
 2019-09-06 20:15:14 +03:00
Alexey Milovidov
1c3fab8f2c Returned support for very old Linux kernels (that lack of F_GETPIPE_SZ fcntl) 2019-09-06 20:10:28 +03:00
Nikolai Kochetov
3bd5d84ecc Update PipelineExecutor. 2019-09-06 19:04:18 +03:00
akazz
f511337028 Fixing minor things 2019-09-06 18:54:33 +03:00
akazz
0f9b91a663 Cosmetic stuff 2019-09-06 18:45:49 +03:00
akazz
e7235cdcfd Minor changes 2019-09-06 18:13:22 +03:00
alesapin
cfd753a1f3 Add test and found bugs 2019-09-06 18:09:20 +03:00
Alexander Kuzmenkov
cacf6d3282 Key memory management for compound hash tables. 
Some aggregation methods initially emplace a temporary StringRef key
into a hash table. Then, if the key was not seen before, they make a
persistent copy of the key and update the hash table with it. This
approach is not suitable for compound hash tables, because the logic of
when the persistent key is needed is more complex, and is contained
within the hash table itself.

In this commit, we switch to managing key memory with callbacks passed
to the hash table, that allow it to request a persistent copy of the key
if it is needed. This should be more appropriate for compound hash
tables.

This commit prepares for StringHashMap PR #5417.
 2019-09-06 18:05:28 +03:00
robot-clickhouse
04d2bb9cfd Auto version update to [19.15.1.1] [54426] 2019-09-06 17:58:33 +03:00
robot-clickhouse
f2b775b02e Auto version update to [19.14.1.1274] [54425] 2019-09-06 17:58:04 +03:00
Alexander Kuzmenkov
05095111a1 Cosmetic change: remove redundant functions from FixedHashTable 2019-09-06 17:47:32 +03:00
akazz
13631d2da3 Removed some garbage 2019-09-06 16:58:37 +03:00
Nikolai Kochetov
32cc3a4bee Revert enumerate streams. 2019-09-06 16:28:49 +03:00
Anton Popov
69da4f30b3
Merge branch 'master' into merging_input_function 2019-09-06 16:20:00 +03:00
filimonov
f505549b43
changed wrong pvs suppression code 2019-09-06 14:46:42 +02:00
Nikolai Kochetov
52305cefbc Merge branch 'merging-aggregated-processors' into processors-2 2019-09-06 15:21:17 +03:00
Nikolai Kochetov
d10b7d7a2b Added ConvertingAggregatedToChunksTransform. 2019-09-06 15:19:59 +03:00
alesapin
ea8e543b1a Add protocol version to cookies 2019-09-06 15:18:56 +03:00
alesapin
571ed1bb25
Merge pull request #6840 from filimonov/history_file_from_env 
Ability to change history path by changing env
 2019-09-06 13:22:49 +03:00
alesapin
0c9a9dee1c Merge with master 2019-09-06 11:53:32 +03:00
alexey-milovidov
3d8ec8fb33
Merge pull request #6823 from yandex/fancyqlx-master 
Merge #6167
 2019-09-06 03:18:26 +03:00
alexey-milovidov
05a1a7ac71
Update InterpreterSelectQuery.cpp 2019-09-06 03:18:06 +03:00
alexey-milovidov
18dcb3753d
Merge pull request #6824 from 4ertus2/mjoin 
Refactoring (ExpressionAnalyzer & SubqueryForSet)
 2019-09-06 03:17:16 +03:00
Mikhail Filimonov
34f393c17e Ability to change history path by changing env 2019-09-06 01:35:25 +02:00
Denis Zhuravlev
50c32490be
Update arrayElement.cpp 
Typo in error message ( is -> are )
 2019-09-05 19:41:27 -03:00
Olga Khvostikova
4129d8cf60
Merge pull request #6092 from yandex/globs-in-file-one-more-attempt 
Globs in storage file and HDFS
 2019-09-05 23:05:37 +03:00
Olga Khvostikova
f90642ce23
Merge pull request #6610 from CurtizJ/merging_with_ties_and_with_fill 
WITH TIES modifier for LIMIT and WITH FILL modifier for ORDER BY. (continuation of #5069)
 2019-09-05 22:45:48 +03:00
akazz
32c77cd933 Dropped weak_ptrs! 2019-09-05 21:09:33 +03:00
stavrolia
5e37510aae Better 2019-09-05 21:09:19 +03:00
Mikhail Filimonov
b40204a360 PVS https://clickhouse-test-reports.s3.yandex.net/0/2cda8f1563e9b2d11f75c68db817c3f68ace1160/pvs_studio_report/pvs-studio-html-report/sources/InterpreterSelectQuery.cpp_24.html#ln430 2019-09-05 19:23:36 +02:00
Mikhail Filimonov
622ea38b21 PVS false positive https://clickhouse-test-reports.s3.yandex.net/0/2cda8f1563e9b2d11f75c68db817c3f68ace1160/pvs_studio_report/pvs-studio-html-report/sources/Context.cpp_21.html#ln1226 2019-09-05 18:59:15 +02:00
Mikhail Filimonov
cfb0431994 PVS https://clickhouse-test-reports.s3.yandex.net/0/2cda8f1563e9b2d11f75c68db817c3f68ace1160/pvs_studio_report/pvs-studio-html-report/sources/executeQuery.cpp_26.html#ln33 2019-09-05 18:57:13 +02:00
alesapin
ab518d7787 Split code to parts 2019-09-05 18:53:23 +03:00
akazz
9b55e66755 WIP - About to give up storing weak_ptrs! 2019-09-05 18:19:36 +03:00
akazz
ab6ae7c82b Refactored Clients -> Referers 2019-09-05 18:14:17 +03:00
stavrolia
587a780ba2 Better 2019-09-05 17:42:17 +03:00
CurtizJ
b04cea7463 minor fixes of table function input 2019-09-05 16:17:01 +03:00
alesapin
f576cbb8a4 Simplify code 2019-09-05 16:12:29 +03:00
akazz
d374a6fb58 Better 2019-09-05 15:49:20 +03:00
akazz
838957f0e2 Cosmetics 2019-09-05 15:45:44 +03:00
akazz
54b4db36eb Changed FastPath + better diagnostics 2019-09-05 15:20:10 +03:00
Vasily Nemkov
c2fc71b5e5 Post-PR fixes 
Renamed settings, updated docs.
 2019-09-05 13:35:36 +03:00
alesapin
b71faee8cd Merge branch 'master' into ObjatieGroba-feature_multiple_disks 2019-09-05 13:19:05 +03:00
Nikolai Kochetov
e1e600b8b3 Update test with sample and prewhere. 2019-09-05 10:42:14 +03:00
Alexey Milovidov
a4c1d64aba Allowed to run test with the server run from source tree 2019-09-05 07:50:08 +03:00
Ivan
ab7df6b6dd
Fix kafka tests (#6805) 
* Commit offsets more precisely
* Get rid of DelimitedReadBuffer since read buffers don't line up well
* Increase timeouts
 2019-09-05 00:25:33 +03:00
stavrolia
5d6959173c Improvement 2019-09-04 22:55:56 +03:00
alesapin
66362cedbc Refactoring 2019-09-04 21:26:18 +03:00
alesapin
c003f443f9 Refactor 2019-09-04 20:26:53 +03:00
alexey-milovidov
b310d755fe
Merge pull request #6819 from infinivision/fix_6761_bitmap_mem_leak 
fix bitmapSubsetInRange memory leak
 2019-09-04 19:58:49 +03:00
Nikolai Kochetov
0d1846baab Update test create table if not exists sample_prewhere 2019-09-04 19:46:10 +03:00
chertus
a395be3e91 minor changes 2019-09-04 19:37:05 +03:00
chertus
b854c945ad some more ExpressionAnalyzer refactoring 2019-09-04 19:20:02 +03:00
Alexey Milovidov
f2c2a2a9ea Fixed unit test 2019-09-04 19:13:05 +03:00
Vladimir Chebotarev
fa01cc162c Merge fix. 2019-09-04 16:10:25 +00:00
alesapin
13bbae5860 Remove trash 2019-09-04 19:00:20 +03:00
Nikolai Kochetov
3bd453985b Merge branch 'master' of https://github.com/fancyqlx/ClickHouse into fancyqlx-master 2019-09-04 18:48:12 +03:00
alesapin
544dd33b9a
Merge pull request #6816 from yandex/fix_mutations_granularity_bug 
Fix bug with mutations after granularity change
 2019-09-04 17:49:52 +03:00
Nikolai Kochetov
30155f92bf Try to enumerate streams again. 2019-09-04 17:16:32 +03:00
Nikolai Kochetov
b98676836e Try to enumerate streams again. 2019-09-04 17:06:41 +03:00
Zhichang Yu
cfac445144 fix bitmapSubsetInRange memory leak 2019-09-04 22:05:32 +08:00
Vladimir Chebotarev
81f49d97bd Minor fix. 2019-09-04 13:39:54 +00:00
Vladimir Chebotarev
e9300ffbb5 Tests finally works! 2019-09-04 13:39:54 +00:00
Vladimir Chebotarev
8c4eb13be6 Fixed unavailable test servers issue in test_storage_s3. 2019-09-04 13:39:54 +00:00
Vladimir Chebotarev
3e4af7b844 Attempt to make integration tests. 2019-09-04 13:39:54 +00:00
Vladimir Chebotarev
c891590709 Added even better warning. 2019-09-04 13:39:54 +00:00
Vladimir Chebotarev
ab456262d9 Fixed multipart mechanism and added a warning about 10k parts. 2019-09-04 13:39:54 +00:00
Vladimir Chebotarev
97b7635c8a Minimum block size to configuration. 2019-09-04 13:39:54 +00:00
Vladimir Chebotarev
395560df1b Fixed multipart uploads and 100-continue. 2019-09-04 13:39:54 +00:00
Vladimir Chebotarev
c6136c2b16 Test improvement. 2019-09-04 13:39:54 +00:00
Vladimir Chebotarev
fa0de006d0 More style fixes. 2019-09-04 13:39:54 +00:00
Vladimir Chebotarev
a9153b2fb3 Style fixes. 2019-09-04 13:39:54 +00:00
Vladimir Chebotarev
af45849ce0 Minor test fixes. 2019-09-04 13:39:53 +00:00
Vladimir Chebotarev
96d093f9ad Clang compatibility fixes. 2019-09-04 13:39:53 +00:00
Vladimir Chebotarev
248e26d59f Attempt to make multipart uploads. 2019-09-04 13:39:53 +00:00
Vladimir Chebotarev
10a7f80af1 Stubs for multipart uploads. 2019-09-04 13:39:53 +00:00
Vladimir Chebotarev
dd32c92f2a Minor fixes. 2019-09-04 13:39:53 +00:00
Vladimir Chebotarev
6b9397e805 Tests fixes. 2019-09-04 13:39:53 +00:00
alexey-milovidov
d3db5a3890 Update TableFunctionS3.h 2019-09-04 13:39:53 +00:00
Vladimir Chebotarev
63164db019 Fixed S3 PUT redirects. 2019-09-04 13:39:53 +00:00
Vladimir Chebotarev
634f82d0ad Minor fix. 2019-09-04 13:39:53 +00:00
Vladimir Chebotarev
ff69112919 Attempt to make S3 PUT redirects (wip). 2019-09-04 13:39:53 +00:00
Vladimir Chebotarev
cca3a9acc7 Added test for PUT redirect. 2019-09-04 13:39:53 +00:00
Vladimir Chebotarev
ae40d68eb0 Updated tests. 2019-09-04 13:39:53 +00:00
Vladimir Chebotarev
7236ae0d8d Fixed 411 error when putting to S3. 2019-09-04 13:39:53 +00:00
Vladimir Chebotarev
0504eb58be Correct S3 PUT requests in WriteBufferFromS3. 2019-09-04 13:39:53 +00:00
Vladimir Chebotarev
19642cf822 Tests update. 2019-09-04 13:39:53 +00:00
Vladimir Chebotarev
efade38d7b Fixed test, so it does not pass now. 2019-09-04 13:39:53 +00:00
Vladimir Chebotarev
1944ff1a48 POST to PUT, refactoring. 2019-09-04 13:39:53 +00:00
Vladimir Chebotarev
52f242daf0 tests (WIP) 2019-09-04 13:39:53 +00:00
Vladimir Chebotarev
062db0ec14 Removed templateness of ReadWriteBufferFromS3. 2019-09-04 13:39:53 +00:00
Vladimir Chebotarev
531460396d POST S3 requests. 2019-09-04 13:39:53 +00:00
Vladimir Chebotarev
caeacafb76 Fixed GET redirects. 2019-09-04 13:39:53 +00:00
Vladimir Chebotarev
78f57c5f2a First attempt to make redirects. 2019-09-04 13:39:53 +00:00
Vladimir Chebotarev
ff09934219 Table function and storage. 2019-09-04 13:39:53 +00:00
Vladimir Chebotarev
47985cf8a7 Wrong commit. 2019-09-04 13:39:53 +00:00
Vladimir Chebotarev
ce69683673 Copy-paste from StorageFile. 2019-09-04 13:39:53 +00:00
alesapin
a4c3937153 Small refactoring 2019-09-04 16:24:55 +03:00
Nikolai Kochetov
b9e26d15de Try to enumerate streams again. 2019-09-04 16:17:50 +03:00
alesapin
3ffa9fa972 Resolve conflict 2019-09-04 15:44:12 +03:00
alesapin
8b6abab486 Merge branch 'master' into ObjatieGroba-feature_multiple_disks 2019-09-04 15:41:27 +03:00
Nikolai Kochetov
3a7e7287c0 Update PipelineExecutor. 2019-09-04 15:34:15 +03:00
CurtizJ
7accc09066 Merge branch 'palasonic-add-input-function' of https://github.com/palasonic1/ClickHouse into merging_input_function 2019-09-04 15:25:20 +03:00
alesapin
18ef235a3f Fix indices mrk file extension 2019-09-04 15:22:20 +03:00
alesapin
16a544f300 Fix bug with mutations after granularity change 2019-09-04 15:19:42 +03:00
stavrolia
32bf915610 More docs 2019-09-04 14:11:30 +03:00
chertus
904cfed046 better includes 2019-09-04 13:15:34 +03:00
Nikolai Kochetov
5246be8a17 Update PipelineExecutor. 2019-09-04 12:37:56 +03:00
Alexey Milovidov
6176041935 Fixed style 2019-09-04 02:08:46 +03:00
Alexey Milovidov
ece7a05cec Added an example of query masking rules for developers 2019-09-04 02:07:08 +03:00
CurtizJ
9cfcbd6649 fix bug in FillingBlockInputStream 2019-09-04 01:01:09 +03:00
Alexey Milovidov
843f8303b0 Minor modifications 2019-09-03 23:27:46 +03:00
Alexey Milovidov
9959e8d3e1 Fixed build 2019-09-03 23:07:27 +03:00
alexey-milovidov
b2e80b0cd9
Merge branch 'master' into query_masking 2019-09-03 22:58:15 +03:00
alexey-milovidov
1ae8150f28
Update Context.cpp 2019-09-03 22:53:59 +03:00
alexey-milovidov
4f7d472cb7
Merge pull request #6048 from Akazz/ternary-logic-light 
Correct implementation of ternary logic for AND/OR
 2019-09-03 22:09:56 +03:00
alexey-milovidov
5f33fd946f
Merge pull request #6711 from dimarub2000/exception_while_insert 
Exception check added in client when sending insertion data.
 2019-09-03 21:47:48 +03:00
akuzm
357f59cc48
Merge pull request #6667 from yandex/aku/mmap-populate 
Pre-fault pages when allocating memory with mmap().
 2019-09-03 21:41:53 +03:00
alexey-milovidov
152dba1b2e
Merge pull request #6796 from CurtizJ/fix-flappy-ttl-test 
Fix column TTL with user defaults.
 2019-09-03 21:35:00 +03:00
Alexey Milovidov
9cf0c780fb Better code 2019-09-03 21:23:13 +03:00
alexey-milovidov
845a612b95
Merge pull request #6773 from infinivision/fix_issue_6575 
fix DataTypeAggregateFunction deserialization
 2019-09-03 21:19:41 +03:00
Nikolai Kochetov
73c052f576 Revert PipelineExecutor changes. 2019-09-03 21:05:44 +03:00
alesapin
94fe4e6521 better test 2019-09-03 20:16:01 +03:00
alesapin
e6e6c11ba3 Better test and NOTHING_TO_DO 2019-09-03 20:06:36 +03:00
Artem Zuikov
0a998fddce
Merge pull request #6801 from 4ertus2/mjoin 
Refactoring: wrap Join logic via AnalyzedJoin iface
 2019-09-03 19:53:49 +03:00
Zhichang Yu
fd0947899d fix 00980_shard_aggregation_state_deserialization.sql 2019-09-03 23:47:09 +08:00