thevar1able/ClickHouse
1
0
Fork 0
mirror of https://github.com/ClickHouse/ClickHouse.git synced 2024-11-19 14:11:58 +00:00
Code Issues Packages Projects Releases Wiki Activity
31,014 Commits 9,138 Branches 1,778 Tags 2 GiB
582364f63a
Commit Graph

22332 Commits

Author SHA1 Message Date
Nikolai Kochetov
9c5ae5f536 Merge branch 'master' into processors-and-storages 2019-10-09 14:12:47 +03:00
Alexander Kuzmenkov
89ebd4885f Fix test filtering in clickhouse-test. 2019-10-09 13:51:59 +03:00
alesapin
ef0b2f5936
Merge pull request #7209 from ClickHouse/dictionaries_ddl_parser 
Dictionaries ddl parser
 2019-10-09 12:51:08 +03:00
Nikolai Kochetov
eb2677c94e Try fix progressbar. 2019-10-09 12:44:24 +03:00
Nikolai Kochetov
ea27918de8 Try fix progressbar. 2019-10-09 12:40:30 +03:00
Nikolai Kochetov
c7bb83262e Fix progress callback for processors pipeline. 2019-10-09 12:33:16 +03:00
Azat Khuzhin
0ff823b574 Return SparseHashed name (system.dictionaries:type) for the sparse_hashed layout 
Due to tons of rebasing this bit had been forgotten.

Refs: 420089c301 ("Add new dictionary layout (sparse_hashed) that is more memory efficient")
 2019-10-09 11:11:41 +03:00
alexey-milovidov
9b2e025918
Merge pull request #7234 from ClickHouse/aku/null-field-serialization 
Serialize Null Fields correctly in DataTypeNullable.
 2019-10-09 04:30:37 +03:00
Alexey Milovidov
6d2a79e832 Added a test 2019-10-09 04:18:12 +03:00
Alexey Milovidov
552e4b4be2 Added example config with macros for tests 2019-10-09 04:16:34 +03:00
Alexey Milovidov
a19f6513ce Added example config with macros 2019-10-09 04:15:23 +03:00
Alexey Milovidov
9f8d562543 Add function "getMacro" #7239 2019-10-09 04:14:57 +03:00
Azat Khuzhin
e373862c83 Do not use more then 98K of memory for uniqCombined* 
uniqCombined() uses hashtable for medium cardinality, and since
HashTable resize by the power of 2 (well actually HashTableGrower grows
double by the power of 2, hence HashTableGrower::increaseSize() should
be overwritten to change this), with 1<<13 (default for uniqCombined)
and UInt64 HashValueType, the HashTable will takes:

  getBufferSizeInBytes() == 131072

While it should be not greater then sizeof(HLL) ~= 98K, so reduce the
maximum cardinality for hashtable to 1<<12 with UInt64 HashValueType and
to 1<13 with UInt32, overwrite HashTableGrower::increaseSize() and cover
this using max_memory_usage.

Refs: https://github.com/ClickHouse/ClickHouse/pull/7221#issuecomment-539672742

v2: cover uniqCombined() with non-default K
 2019-10-09 02:39:23 +03:00
alexey-milovidov
4c1f0177b6
Merge pull request #7109 from infinivision/aggBitmapAnd 
added groupBitmapAnd, groupBitmapOr, groupBitmapXor
 2019-10-08 22:51:46 +03:00
alexey-milovidov
5c2d478543
Merge pull request #7212 from ClickHouse/aku/field-includes 
Include Field.h and FieldVisitor.h into fewer files.
 2019-10-08 22:40:30 +03:00
alesapin
5296be18f3 Fix desc table query 2019-10-08 22:39:20 +03:00
alexey-milovidov
b9aa5d812d
Merge pull request #7171 from nikvas0/nikvas0/lazy_db 
Lazy Database
 2019-10-08 22:15:55 +03:00
Azat Khuzhin
f46c5a47c0 Introduce uniqCombined64() to get sane results for cardinality > UINT_MAX 
By default uniqCombined() uses 32-bit hash for all types except String,
so this means that you cannot use uniqCombined() with i.e UInt64 and
cardinality > UINT_MAX, although you can use uniqCombined(toString())
and this will lead to 64-bit hash, but will not have good performance.

So uniqCombined64() had been introduced to fix this.

Requires: #7213
 2019-10-08 21:59:35 +03:00
alexey-milovidov
ddc2299901
Update 01016_null_part_minmax.sql 2019-10-08 21:52:48 +03:00
alexey-milovidov
d8b3db65f7
Merge pull request #7213 from azat/fix-uniqCombined-approximation 
Fix uniqCombined() result for >UINT_MAX values (return UInt64 to avoid overflow)
 2019-10-08 21:45:23 +03:00
alexey-milovidov
e619304b2c
Merge pull request #7216 from ClickHouse/nicelulu-issue-6615 
Merging "Optimize empty IN subquery and empty INNER/RIGHT JOIN"
 2019-10-08 21:36:57 +03:00
Alexander Kuzmenkov
a5b1496fe9 Serialize Null Fields correctly in DataTypeNullable. 2019-10-08 21:21:24 +03:00
alesapin
5ea1a12c05 Refactoring and comments 2019-10-08 16:26:15 +03:00
Alexander Kuzmenkov
2b30f2696c Include Field.h in less files. 2019-10-08 16:23:24 +03:00
alesapin
7b545f9b18 Fix style 2019-10-08 15:35:17 +03:00
alesapin
cd05564b17 Add show create dictionary 2019-10-08 15:34:04 +03:00
Alexander Kuzmenkov
46f5115601 Accept many test name regexes in clickhouse-test. 
Sometimes it is more convenient to supply space-separated test names
without having to concatenate them into one regex with pipes.
 2019-10-08 14:32:03 +03:00
alesapin
0883b3f8a9 Parser for drop dictionary query 2019-10-08 14:10:29 +03:00
alesapin
db20681207 Better declaration and lifetime parser 2019-10-08 13:50:57 +03:00
alesapin
5f81f47637 Add recursive parsing of pairs 2019-10-08 12:47:17 +03:00
Vasilyev Nikita
21b2b20729 Merge branch 'nikvas0/lazy_db' of https://github.com/nikvas0/ClickHouse into nikvas0/lazy_db 2019-10-08 11:15:12 +03:00
Vasilyev Nikita
030aa1cf10 fix 2019-10-08 11:10:55 +03:00
alexey-milovidov
3bd59edc3c
Update StorageSystemTables.cpp 2019-10-08 03:31:50 +03:00
alexey-milovidov
c92fc70f66
Update StorageSystemTables.cpp 2019-10-08 03:29:41 +03:00
alexey-milovidov
704529801e
Update StorageSystemColumns.cpp 2019-10-08 03:27:57 +03:00
alexey-milovidov
20f5b27b8b
Update DatabaseOnDisk.h 2019-10-08 03:24:26 +03:00
Alexey Milovidov
15bba8b498 Updated test 2019-10-07 22:16:45 +03:00
alexey-milovidov
bcc4e3f0ba
Merge branch 'master' into issue-6615 2019-10-07 22:12:25 +03:00
Alexander Tokmakov
1c5ee018df update docs 2019-10-07 21:55:12 +03:00
Azat Khuzhin
92c88248a1 Fix uniqCombined() result for >UINT_MAX values (return UInt64 to avoid overflow) 
uniqCombined() return type is UInt64, but uniqCombined() uses
CombinedCardinalityEstimator, and CombinedCardinalityEstimator::size()
return type is UInt32, while the underlying HyperLogLog::size() is
UInt64.

So after this patch uniqCombined() can be used for >UINT_MAX values, the
outcome is not ideal (#2073) but at least sane.
 2019-10-07 21:38:58 +03:00
Alexander Kuzmenkov
56b065881a Include FieldVisitors.h in less files. 2019-10-07 20:23:05 +03:00
Alexander Kuzmenkov
367c537106 Do not include Field.h everywhere through SettingsCommon.h. 
Move the methods of SettingsCollection<> that are dependent on Field to
a separate file, and include it once for each instantiation. This allows
to work on Field without always recompiling the entire project.
 2019-10-07 20:23:05 +03:00
Alexander Tokmakov
73aa1d1518 diagnostic info for bad csv delimiters 2019-10-07 19:47:25 +03:00
alesapin
0e664807e9 Additional test 2019-10-07 19:46:35 +03:00
Alexander Tokmakov
a2c83ac82e add tests 2019-10-07 19:31:30 +03:00
alesapin
cec3af45e5 First working version of parser 2019-10-07 19:23:16 +03:00
Alexander Tokmakov
32b0b8272c setup csv delimiter in Template format 2019-10-07 19:03:01 +03:00
Alexander Tokmakov
b4d9dc2a90 query parameters in evaluateConstantExpression 2019-10-07 18:46:50 +03:00
alesapin
369a7d262c Merge branch 'master' into dictionaries_ddl_parser 2019-10-07 12:46:08 +03:00
millb
c5ba58f243 Fixed tests 2019-10-06 18:49:51 +03:00
millb
7ab1804ebb Fixed codestyle and changed Error message. 2019-10-06 18:33:25 +03:00
millb
31a422fdff Fixed test codestyle 2019-10-06 18:01:05 +03:00
millb
5c272df15f Add integration tests. 2019-10-06 17:52:41 +03:00
alexey-milovidov
d096119529
Merge pull request #7156 from ClickHouse/fix-header-for-now 
Fix header for function 'now'
 2019-10-05 22:35:23 +03:00
alexey-milovidov
ce12fb6b3c
Update ExpressionAnalyzer.cpp 2019-10-05 22:34:57 +03:00
alexey-milovidov
40b22061f0
Update InterpreterSelectQuery.cpp 2019-10-05 22:34:25 +03:00
proller
594c535bd4 Build fixes (#7063) 
* Build fixes

*            fix

* Fix

* fix

* Fix install(export..

* Freebsd fixes

* Freebsd fixes

* Fix warning

* fix

* More PRIVATE linking

* Fix review

* Timmy

* fix

* fix
 2019-10-05 22:25:31 +03:00
alexey-milovidov
acbadfefbf
Merge pull request #7200 from azat-archive/unbundled-build-fix 
Add missing linking with PocoXML for clickhouse_common_io
 2019-10-05 21:54:24 +03:00
alexey-milovidov
bb8414bdeb
Merge pull request #7201 from vzakaznikov/enabling_again_live_view_tests 
A quick fix to resolve crash in LIVE VIEW table and re-enabling all LIVE VIEW tests.
 2019-10-05 20:47:34 +03:00
Vitaliy Zakaznikov
6b8e61737a * Fixing crash in LIVE VIEW 
* Re-enabling all LIVE VIEW tests
 2019-10-05 08:05:24 -04:00
Vasilyev Nikita
5fb84b55a6 fix nl 2019-10-05 13:21:47 +03:00
Vasilyev Nikita
b8647f49b5 fix 2019-10-05 13:21:04 +03:00
Alexander Tokmakov
a90d126b93 support defaults_for_omitted_fields in TSV 2019-10-04 22:44:48 +03:00
Alexander Tokmakov
d936cee836 support null_as_default in most text formats 2019-10-04 22:42:35 +03:00
Nikolai Kochetov
95ec0f7c2d Merged with master. 2019-10-04 20:53:21 +03:00
Nikolai Kochetov
d4f11af817 Update QueryPipeline. 2019-10-04 20:49:14 +03:00
Nikolai Kochetov
23069ca6d0 Progress for MergeTreeSelectProcessor. 2019-10-04 20:50:07 +03:00
Nikolai Kochetov
627d48c19a Added ExecutionSpeedLimits. 2019-10-04 20:49:57 +03:00
Nikolai Kochetov
e48f7faebc Fix MergeTreeRangeReader. 
Fix MergeTreeReader.

Fix MergeTreeBaseSelectProcessor.

Better exception message for TreeExecutor.

Added header_without_virtual_columns to MergeTreeBaseSelectProcessor.

Fix MergeTreeReverseSelectProcessor.

Fix MergeTreeDataSelectExecutor.
 2019-10-04 20:49:29 +03:00
Nikolai Kochetov
54d32da5a1 Update TreeExecutor. 2019-10-04 20:49:24 +03:00
Nikolai Kochetov
1689576770 Update MergeTreeDataSelectExecutor. 2019-10-04 20:49:14 +03:00
Alexander Tokmakov
ec79e5aa5b refactor null_as_default 2019-10-04 20:19:49 +03:00
Azat Khuzhin
4b9d711f07 Add missing linking with PocoXML for clickhouse_common_io 
Otherwise unbundled build fail with:
  FAILED: dbms/libclickhouse_common_iod.so
  ...
  ../dbms/src/IO/WriteBufferFromS3.cpp:143: error: undefined reference to 'Poco::XML::InputSource::InputSource(std::istream&)'
  ../dbms/src/IO/WriteBufferFromS3.cpp:144: error: undefined reference to 'Poco::XML::DOMParser::DOMParser(Poco::XML::NamePool*)'
  ../dbms/src/IO/WriteBufferFromS3.cpp:145: error: undefined reference to 'Poco::XML::DOMParser::parse(Poco::XML::InputSource*)'
  ../dbms/src/IO/WriteBufferFromS3.cpp:146: error: undefined reference to 'Poco::XML::Document::getElementsByTagName(std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&) const'
  ../dbms/src/IO/WriteBufferFromS3.cpp:144: error: undefined reference to 'Poco::XML::DOMParser::~DOMParser()'
  ../dbms/src/IO/WriteBufferFromS3.cpp:143: error: undefined reference to 'Poco::XML::InputSource::~InputSource()'
  ../dbms/src/IO/WriteBufferFromS3.cpp:144: error: undefined reference to 'Poco::XML::DOMParser::~DOMParser()'
  ../dbms/src/IO/WriteBufferFromS3.cpp:143: error: undefined reference to 'Poco::XML::InputSource::~InputSource()'
  collect2: error: ld returned 1 exit status
 2019-10-04 19:48:10 +03:00
alexey-milovidov
9c2f3ba41a
Merge pull request #6984 from achimbab/pr_bf 
Made bloom_filter type of index supporting arrays
 2019-10-04 18:08:42 +03:00
tavplubix
d73db7f779
Merge pull request #6781 from ClickHouse/merging_values_with_expressions 
Merging Values with expressions
 2019-10-04 12:51:22 +03:00
Nikolai Kochetov
90472293fd Added test with function randConstant. 2019-10-04 12:22:07 +03:00
alexey-milovidov
fadd003f5b
Merge pull request #7185 from ClickHouse/fix_bug_with_alter_attach_part 
Fix bug with segmentation fault in ATTACH PART query
 2019-10-04 01:18:42 +03:00
alesapin
4e83f65089 Fix bug with segmentation fault in ATTACH PART query 2019-10-03 21:07:47 +03:00
alesapin
cf094cd62b
Merge pull request #7155 from ClickHouse/dictionaries_ddl 
Preparation of ExternalLoader for Dictionaries DDL
 2019-10-03 20:12:19 +03:00
Nikolai Kochetov
76d1412953 Fix actions for distributed. 2019-10-03 18:47:42 +03:00
Vasilyev Nikita
d6490892a7 fix metadata time 2019-10-03 17:18:17 +03:00
Vasilyev Nikita
66506e26d0 fix 2019-10-03 16:40:53 +03:00
Vasilyev Nikita
6b1a1b5b5f fix 2019-10-03 15:49:22 +03:00
Nikolai Kochetov
e5c1df010f Remove allow_different_constant_values from InterpreterSelectQuery. 2019-10-03 15:02:30 +03:00
Nikolai Kochetov
a706cc47cf Remove setting allow_different_constant_values from ConvertingTransform and ConvertingBlockInputStream. 2019-10-03 14:59:45 +03:00
Nikolai Kochetov
3142955e6c InterpreterSelectQuery: reuse actions from getSampleBlock in readImpl. 2019-10-03 14:58:52 +03:00
Vasilyev Nikita
f0f5134759 fixed includes 2019-10-03 12:31:59 +03:00
Vasilyev Nikita
c27ce44d19 set -> list 2019-10-03 12:20:21 +03:00
Vasilyev Nikita
2f4e7bbe7f get rid of copy-paste 2019-10-03 11:35:58 +03:00
Vasilyev Nikita
7ac9fadc0d reduce copy-paste 2019-10-03 11:27:43 +03:00
Vasilyev Nikita
080815833f refactor 2019-10-03 10:59:48 +03:00
Alexander Kuzmenkov
8e245d4e8c
Merge pull request #7135 from ClickHouse/aku/msan-field 
Fix some MemorySanitizer warnings for Fields.
 2019-10-03 10:33:44 +03:00
Ivan
05b17976d1
Commit to Kafka explicitly after the writing is finalized (#7175) 2019-10-03 00:17:19 +03:00
alexey-milovidov
255a57d02e
Merge pull request #7172 from excitoon/patch-1 
Fixed time calculation in `MergeTreeData`.
 2019-10-03 00:15:16 +03:00
Alexander Tokmakov
a58996817f allow query parameters in Values 2019-10-02 22:54:40 +03:00
Alexander Tokmakov
565c273eaa Merge branch 'master' into merging_values_with_expressions 2019-10-02 20:51:44 +03:00
Alexander Tokmakov
80e5976d10 fixes after review 2019-10-02 20:51:00 +03:00
millb
7caae87e74 Fixed StorageURL.cpp 2019-10-02 20:17:09 +03:00
millb
16645bfe53 Fixed StorageUrl.cpp 2019-10-02 19:33:50 +03:00
Artem Zuikov
d23b7ae8ef
Merge pull request #7166 from 4ertus2/some 
Refactoring: remove copy-paste
 2019-10-02 17:28:38 +03:00
Alexander Kuzmenkov
4af8e76bdd Use proper types for Field. 
When a Field is inserted into a column, its type should be the same as
the column data type to avoid implicit reinterpret_cast. Change a
couple of usages where these types were different.
 2019-10-02 16:48:26 +03:00
Vasilyev Nikita
136b1665a3 test rename 2019-10-02 16:06:57 +03:00
Vasilyev Nikita
de3deb9e85 fix 2019-10-02 15:58:13 +03:00
chertus
3b0d870804 rename function 2019-10-02 15:06:34 +03:00
Vitaliy Zakaznikov
ffe8931cda Revert "Merge pull request #6770 from yandex/temporary-remove-live-view-tests" 
This reverts commit 6cf5327269, reversing
changes made to 4155771106.
 2019-10-02 06:52:40 -04:00
Vasilyev Nikita
ff405865f7 db on disk 2019-10-02 13:10:45 +03:00
Vasilyev Nikita
54237e3f27 name, data, metadata -> functions 2019-10-02 11:58:28 +03:00
Vladimir Chebotarev
e79a15c39c
Fixed time calculation in MergeTreeData. 2019-10-02 10:46:53 +03:00
Vasilyev Nikita
dab68e796e removed unused consts 2019-10-02 09:47:12 +03:00
Vasilyev Nikita
f515e9465b fix 2019-10-02 09:45:27 +03:00
Vasilyev Nikita
657d200d42 better logs 2019-10-02 09:40:51 +03:00
Vasilyev Nikita
45ecff99a1 upd test 2019-10-02 09:31:23 +03:00
alexey-milovidov
96ca241fba
Merge pull request #7158 from azat-archive/MetricsTransmitter-use-of-uninitialized-value 
Avoid use of uninitialized values in MetricsTransmitter
 2019-10-02 01:01:00 +03:00
chertus
c46cc3ff1a refactoring: remove copy-paste 2019-10-01 21:51:33 +03:00
alesapin
3fe7d84233 Add ASTs for dictionaries 2019-10-01 17:54:28 +03:00
Artem Zuikov
48ab9afce6
Merge pull request #7122 from 4ertus2/mjoin 
Squash left-hand blocks in partial merge join (optimization)
 2019-10-01 17:23:10 +03:00
Vasilyev Nikita
71a2002417 test with sleep 2019-10-01 16:57:58 +03:00
Vasilyev Nikita
c5087219c4 test 2019-10-01 16:53:55 +03:00
Vasilyev Nikita
c630d9457b opt system tables 2019-10-01 16:07:00 +03:00
chertus
038428bccf do not affect other SquashingBlockInputStream instances 2019-10-01 16:01:08 +03:00
Vasilyev Nikita
5793a02ef9 impr Lazy database 2019-10-01 15:44:17 +03:00
Nikolai Kochetov
9e74b8a6fe Disable check for constants in Converting stream while converting to header. 2019-10-01 13:58:39 +03:00
Vasilyev Nikita
69677d19e4 fix iterations 2019-10-01 13:48:19 +03:00
Alexander Tokmakov
605046761e fix build 2019-10-01 13:44:28 +03:00
Vasilyev Nikita
5ef295eeff fixes 2019-10-01 13:24:09 +03:00
Nikolai Kochetov
58a432be62 Updated functions today, yestarday, randConstant. 2019-10-01 13:15:20 +03:00
Nikolai Kochetov
b9b2ca342d Updated functions today, yestarday, randConstant. 2019-10-01 13:11:16 +03:00
Nikolai Kochetov
92ba6081a4 Updated functions today, yestarday, randConstant. 2019-10-01 13:10:07 +03:00
Nikolai Kochetov
0d94bdb6a1 Updated functions today, yestarday, randConstant. 2019-10-01 13:03:55 +03:00
alesapin
8429f46f3c Return getUpdateTime method to interface 2019-10-01 11:58:47 +03:00
Azat Khuzhin
740e4c5851
Avoid use of uninitialized values in MetricsTransmitter 
Defer thread creation after values had been initialized correctly.
 2019-10-01 10:16:39 +03:00
alesapin
709783a1bc Add missed header 2019-09-30 22:42:31 +03:00
Alexander Tokmakov
e267081389 better PeekableReadBuffer interface 2019-09-30 21:21:58 +03:00
Nikolai Kochetov
486deee1f1 Use new iface for now function. Use current time value from function builder. 2019-09-30 20:36:03 +03:00
Nikolai Kochetov
393bfdcd9f Use new iface for now function. Use current time value from function builder. 2019-09-30 20:31:36 +03:00
alesapin
0e6331e892 Add comments 2019-09-30 19:54:50 +03:00
alesapin
08681ac210 Preparation for AST configurations for external dictionaries 2019-09-30 19:12:08 +03:00
chertus
5df8f870c4 try remove some PVS errors 2019-09-30 18:45:53 +03:00
millb
9246f258e8 Created ability to configure allowed URL in config.xml without tests. 2019-09-30 18:29:05 +03:00
Alexander Tokmakov
979f235e38 Merge branch 'master' into merging_values_with_expressions 2019-09-30 18:06:58 +03:00
Nikolai Kochetov
963acff1d2 Use new iface for now function. Use current time value from function builder. 2019-09-30 17:59:04 +03:00
chertus
5212d43ae4 simplify pmj settings 2019-09-30 17:36:45 +03:00
Alexander Kuzmenkov
6960b893fd Initialize full storage type of Field, and not just the nominal type. 
Field can return the value of storage type with a suitable get<>, and
this value should not be partly undefined.

Found with MemorySanitizer.
 2019-09-30 15:49:58 +03:00
Alexander Kuzmenkov
ec2d9a083c Remove excessive includes. 2019-09-30 15:31:14 +03:00
alexey-milovidov
e50a874537
Merge pull request #7118 from ClickHouse/improve_template_format 
Minor improvements of Template format
 2019-09-30 15:00:27 +03:00
Amos Bird
dadc613072 Get rid of malloc symbols in libcommon (#7134) 2019-09-30 14:58:32 +03:00
alesapin
bc6caba4db Remove redundant argument 2019-09-30 14:18:01 +03:00
alexey-milovidov
42c9ea9aa3
Merge pull request #7092 from PerformanceVision/acl_file_storage 
Let the choice to write credential for HTTP source on external dictionaries
 2019-09-30 13:20:33 +03:00
alexey-milovidov
24b3145144
Update evaluateConstantExpression.cpp 2019-09-29 01:12:29 +03:00
alexey-milovidov
34498db394
Merge pull request #7132 from Akazz/fixes_in_tests-system_parts_race_condition 
Corrections to tests 00992/00993: changed "ALTER DELETE ..." mutations to be deterministic
 2019-09-27 22:20:35 +03:00
alexey-milovidov
102b5a7dd4
Merge pull request #7111 from ClickHouse/dictionaries_ddl 
Small dictionaries refactoring
 2019-09-27 22:05:14 +03:00
root
f54f55bbdc Add const. 2019-09-28 00:38:13 +08:00
root
bcc24d3cbc Fix code Style. 2019-09-27 22:56:40 +08:00
root
bc13482eea Add globalIn. 2019-09-27 22:24:48 +08:00
Alexander Kazakov
2f355d716a Corrections to tests 00992/00993:mutations to be deterministic 2019-09-27 16:38:40 +03:00
chertus
c6f0fd09bd Merge branch 'master' into mjoin 2019-09-27 16:33:07 +03:00
Ivan
e5a5091556
Revert "Get rid of malloc symbols in libcommon (#7065)" (#7131) 
This reverts commit 4cb53093a0.
 2019-09-27 16:16:53 +03:00
alesapin
9ee031413c Remove a lot of unused code 2019-09-27 15:36:54 +03:00
chertus
baaf0a7c5b partial_merge_join_optimisations -> partial_merge_join_optimizations 2019-09-27 15:25:02 +03:00
Amos Bird
4cb53093a0 Get rid of malloc symbols in libcommon (#7065) 2019-09-27 15:19:26 +03:00
root
0189945ad8 Optimize empty IN subquery and empty INNER/RIGHT JOIN. 2019-09-27 19:06:20 +08:00
alesapin
506dbd49cb Add missed row 2019-09-27 12:02:06 +03:00
chertus
0bfabc8cb2 rename partial_merge_join_optimizations in test 2019-09-27 10:49:20 +03:00
Guillaume Tassery
b1182cdc3d uupdate tests 2019-09-27 05:15:03 +02:00
Zhichang Yu
8945714c27 added groupBitmapAnd, groupBitmapOr, groupBitmapXor 2019-09-27 10:21:07 +08:00
Alexander Tokmakov
004455a029 fixes 2019-09-27 00:40:14 +03:00
chertus
10eaef1adc squash left-hand blocks in pmj (phase 2) 2019-09-26 21:51:17 +03:00
alexey-milovidov
a2fc7e2e9e
Merge pull request #7093 from millb/merges_counter_metric 
Add merge metric
 2019-09-26 21:49:43 +03:00
alexey-milovidov
87a6d3b222
Update ProfileEvents.cpp 2019-09-26 21:49:30 +03:00
Nikolai Kochetov
b65fe57319 Update MergeTreeRangeReader. 2019-09-26 20:29:41 +03:00
alesapin
bba3a96ff4 Remove redundant argument 2019-09-26 20:24:55 +03:00
tavplubix
c3ed1f38a6
Merge branch 'master' into improve_template_format 2019-09-26 19:19:11 +03:00
alesapin
0e28dc4e51 Remove redundant classes 2019-09-26 19:12:15 +03:00
millb
ea013cf1a2 Fixed test 2019-09-26 17:44:04 +03:00
Vasilyev Nikita
eb1dcbf183 factory 2019-09-26 16:43:08 +03:00
Vasilyev Nikita
29cf5d85ab add expiration 2019-09-26 15:39:37 +03:00
Vasilyev Nikita
ef2af243ee expiration queue 2019-09-26 15:34:58 +03:00
millb
259be751ee Fixed metric name. 
Add metric description.
Add test.
 2019-09-26 15:06:52 +03:00
alesapin
089e3146c9 Add missed files 2019-09-26 14:19:10 +03:00
Vasilyev Nikita
1bdba790b5 fix 2019-09-26 14:09:26 +03:00
Alexander Tokmakov
51ac870540 fix build 2019-09-26 13:49:22 +03:00
alesapin
4fdb5a61e5 Rename ExternalDictionaries to ExternalDictionariesLoader 2019-09-26 13:41:33 +03:00
Guillaume Tassery
7c93ef1706 Add integration tests for auth on HTTP external dictionaries 2019-09-26 12:28:56 +02:00
alesapin
5668f55ab7 Rename ExternalModels to ExternalModelsLoader 2019-09-26 13:23:14 +03:00
alesapin
903f826640 Remove runtime factory and remove one redundant object 2019-09-26 13:08:38 +03:00
Vasilyev Nikita
5298a748c4 fix 2019-09-26 12:23:04 +03:00
Vasilyev Nikita
dcad7e3567 some improvements 2019-09-26 12:20:46 +03:00
Vasilyev Nikita
9107f0fad1 can compile 2019-09-26 10:16:31 +03:00
Guillaume Tassery
647568a6f6 cosmetic 2019-09-26 05:34:22 +02:00
chertus
dd08f06c81 squash left-hand blocks in partial merge join 2019-09-25 22:17:32 +03:00
Alexander Tokmakov
c31f9c6f9a force inline small functions 2019-09-25 19:08:58 +03:00
Vasilyev Nikita
5213dba2e0 fixed 2019-09-25 15:08:41 +03:00
millb
4e893eb949 Fixed codestyle 2019-09-25 13:46:24 +03:00
millb
97a2ae176b Add CountOfMerges metric 2019-09-25 13:37:43 +03:00
Guillaume Tassery
367a0dcdb4 cosmetic 2019-09-25 11:46:48 +02:00
Guillaume Tassery
8b4e789847 Rename key to name 2019-09-25 11:42:08 +02:00
Vasilyev Nikita
b9a5952921 lazydb start 2019-09-25 12:35:56 +03:00
Guillaume Tassery
77f2dfee6a Add the positibility to add an header on an HTTP source 2019-09-25 10:08:46 +02:00
Guillaume Tassery
2435e9a12c Add simple HTTP right credentials 2019-09-25 06:33:54 +02:00
Alexey Milovidov
ff07ffbbae Merge branch 'merging_redis' of https://github.com/CurtizJ/ClickHouse into CurtizJ-merging_redis 2019-09-25 02:27:05 +03:00
alexey-milovidov
64e889d872
Merge pull request #7070 from 4ertus2/mjoin 
PartialMergeJoin optimisation (skip not intersected blocks)
 2019-09-25 02:24:42 +03:00
alexey-milovidov
60d74a5e55
Merge pull request #7086 from nikvas0/nikvas0/little_odb_impr 
little improvement in DatabaseOrdinary code
 2019-09-25 02:04:34 +03:00
alexey-milovidov
7cfa52ef73
Merge pull request #7026 from ClickHouse/aku/lookup-result 
Do not use iterators in find() and emplace() methods of hash tables.
 2019-09-25 02:03:43 +03:00
Alexander Tokmakov
d642304b1d add CustomSeparated format 2019-09-24 22:56:45 +03:00
Alexander Kuzmenkov
b949cc232b Mark lookupResultGetKey/Mapped functions ALWAYS_INLINE. 
They only do pointer arithmetics, so it makes sense to always inline
them.
 2019-09-24 22:03:10 +03:00
chertus
0467229eff fix all left partial merge join on block borders 2019-09-24 21:21:57 +03:00
alexey-milovidov
bc9667d881
Merge pull request #7085 from ClickHouse/merge-s3 
Merge s3
 2019-09-24 17:51:57 +03:00
Vasilyev Nikita
def500f591 some impr 2019-09-24 17:49:30 +03:00
Alexander Tokmakov
e197cc8a49 read settings from file 2019-09-24 17:45:04 +03:00
Alexander Kuzmenkov
f3bde19b74 Do not use iterators in find() and emplace() methods of hash tables. 
Instead, these methods return a pointer to the required data as they are
stored inside the hash table. The caller uses overloaded functions to
get the key and "mapped" values from this pointer. Such an interface
avoids the need for constructing iterator-like wrapper objects, which is
especially important for compound hash tables such as the future
StringHashMap.
 2019-09-24 17:44:35 +03:00
chertus
80d902a401 fix case with duplicated right keys 2019-09-24 16:45:59 +03:00
robot-clickhouse
06e1a9d78e Auto version update to [19.16.1.1] [54427] 2019-09-24 14:47:32 +03:00
robot-clickhouse
ec86a9b933 Auto version update to [19.15.1.1398] [54426] 2019-09-24 14:46:58 +03:00
Vladimir Chebotarev
c051f42384 Fixes. 2019-09-24 10:58:42 +00:00
alexey-milovidov
a62866918f
Merge pull request #7075 from ClickHouse/revert-index-analysis-slowdown 
Revert "CHYT-142: extend KeyCondition interface so that it returns BoolMask"
 2019-09-24 05:18:15 +03:00
Alexey Milovidov
7384e04430 Revert "CHYT-142: extend KeyCondition interface so that it returns BoolMask." 
This reverts commit 2cacc3cfd2.
 2019-09-24 04:29:26 +03:00
Alexey Milovidov
dcd40d1d07 Better log messages about disks 2019-09-24 03:45:40 +03:00
alexey-milovidov
56bd02cf3a
Merge pull request #7016 from ClickHouse/yet-another-minor-changes-and-docs-for-hdfs 
Cleanup hdfs docs (instead of #6876 for  #5371)
 2019-09-24 02:23:59 +03:00
alexey-milovidov
2f195ddb03
Merge pull request #7028 from abyss7/issue-6459 
Implement cross-compilation support Linux → Darwin
 2019-09-24 02:20:17 +03:00
alexey-milovidov
575ddefa6c
Merge pull request #7069 from ClickHouse/compatibility-settings-19.14 
Fixed compatibility for distributed queries between 19.14 and earlier versions
 2019-09-24 02:11:33 +03:00
alexey-milovidov
a314a36feb
Merge pull request #7062 from ClickHouse/fix-msan-for-low-cardinality 
Fix msan for LowCardinality
 2019-09-24 02:11:15 +03:00
alexey-milovidov
e9bfe99dd8
Merge pull request #7072 from silviucpp/silviu-osx-stack 
Get proper stack address on osx
 2019-09-24 02:09:24 +03:00
alexey-milovidov
e2cc551b22
Merge pull request #6914 from maqroll/master 
+ Redirect URL Storage
 2019-09-24 02:07:06 +03:00
alexey-milovidov
c4c936c685
Merge pull request #7049 from ClickHouse/ucasFL-master 
Merging function "repeat"
 2019-09-23 22:52:38 +03:00
alexey-milovidov
e24d882326
Merge pull request #7024 from millb/master 
Fixed Function Hex for Float32 and Float64
 2019-09-23 22:52:19 +03:00
Silviu Caragea
d187b5ed42 Get proper stack address on osx 2019-09-23 22:47:12 +03:00
chertus
1f9b8418e0 pmj skip not intersected optimisation 2019-09-23 22:36:47 +03:00
Nikolai Kochetov
630872837e Skip null columns while checknig num rows. 2019-09-23 22:26:04 +03:00
Alexey Milovidov
11e7ea51e9 Fixed compatibility for distributed queries between 19.14 and earlier versions #7068 2019-09-23 22:22:28 +03:00
Nikolai Kochetov
5108ebeece Remove Block from RangeReader. 2019-09-23 22:22:02 +03:00
alexey-milovidov
faf6e06f56
Update ReadWriteBufferFromHTTP.h 2019-09-23 21:16:34 +03:00
alexey-milovidov
e7b675a301
Update ReadWriteBufferFromHTTP.cpp 2019-09-23 21:15:21 +03:00
Alexey Milovidov
8407ee17c6 Reverted unrelated modification 2019-09-23 21:06:32 +03:00
Alexey Milovidov
89f27de705 Merge branch 'master' into ucasFL-master 2019-09-23 21:05:29 +03:00
Alexey Milovidov
8579c26efb Changed repository URL 2019-09-23 19:18:19 +03:00
millb
bd29efdbbe New hex function release 
Bugs and tests fixed
 2019-09-23 18:47:34 +03:00
Olga Khvostikova
a6296b2eb0
Merge branch 'master' into yet-another-minor-changes-and-docs-for-hdfs 2019-09-23 18:16:01 +03:00
Alexander Tokmakov
769d33848b allow specifying column idx in format string 2019-09-23 18:10:48 +03:00
stavrolia
fbe3270dfb need to mention... 2019-09-23 17:50:33 +03:00
Ivan Lezhankin
ce2fb6d3d1 Fix build 2019-09-23 17:46:01 +03:00
chertus
016f3b0a45 fix partial merge join with totals 2019-09-23 17:37:42 +03:00
Nikolai Kochetov
61b583ccb9 Fix size of constant columns in case of execution function over LowCardinality without allowed defaults. 2019-09-23 17:19:02 +03:00
chertus
9261d9d970 stabilize tests (add order by) 2019-09-23 16:55:04 +03:00
alexey-milovidov
3ae715cafb
Merge pull request #7048 from ClickHouse/merge-s3 
Merging s3: minor changes after #5596
 2019-09-23 16:38:18 +03:00
Nikolai Kochetov
f15bc77778 Fix size of constant columns in case of execution function over LowCardinality without allowed defaults. 2019-09-23 16:36:20 +03:00
Ivan Lezhankin
4b143c3e0f Merge remote-tracking branch 'upstream/master' into issue-6459 2019-09-23 16:07:19 +03:00
Vladimir Chebotarev
f8c0fef919 Attempt to make table-level setting s3_min_upload_part_size. 2019-09-23 12:41:59 +00:00
Alexander Tokmakov
447d59bd37 remove unused field 2019-09-23 15:32:49 +03:00
Alexander Tokmakov
89280c0ca8 fix tests 2019-09-23 13:45:26 +03:00
maqroll
e99a87b5b7 update assertResponseIsOk 2019-09-23 08:53:09 +00:00
maqroll
a6e7519f9d Merge remote-tracking branch 'upstream/master' 2019-09-23 07:55:07 +00:00
Vladimir Chebotarev
c45e7dc747 Many parts warning and a comment about that. 2019-09-23 07:42:02 +00:00
maqroll
e1613d0704 + integration test 2019-09-23 07:27:49 +00:00
philip.han
3c40bb86ae Clean up a test table in bloom_filter_test 2019-09-23 15:45:57 +09:00
philip.han
833b188b88 Fix a result of bloom_filter_test 2019-09-23 15:24:53 +09:00
philip.han
315fcc6ef6 Add a testcase that checks nested array type of bloom_filter 2019-09-23 12:41:23 +09:00
philip.han
613927c36c Removed useless code and improve type checking for bloom_filter index 2019-09-23 12:40:48 +09:00
Alexey Milovidov
7948b0bb7e Minor modifications 2019-09-23 02:56:44 +03:00
Alexey Milovidov
e6f1fdc011 Added another test 2019-09-23 02:56:27 +03:00
Alexey Milovidov
80849e0fd7 Fixed bad log messages 2019-09-23 02:49:26 +03:00
Alexey Milovidov
2585cde3d0 Added safety threshold 2019-09-23 02:49:15 +03:00
Alexey Milovidov
48f28bce6a Fixed bad error message 2019-09-23 02:37:13 +03:00
Alexey Milovidov
69c79c31bb Merging function 'repeat': improved test 2019-09-23 02:31:33 +03:00
Alexey Milovidov
454b83fcd3 Merging function 'repeat' 2019-09-23 02:30:13 +03:00
Alexey Milovidov
52272eeea9 Merge branch 'master' of https://github.com/ucasFL/ClickHouse into ucasFL-master 2019-09-23 02:04:18 +03:00
alexey-milovidov
61b02598d7
Update repeat.cpp 2019-09-23 02:02:03 +03:00
Alexey Milovidov
70bc89557f Updates for #6969 2019-09-23 01:57:06 +03:00
alexey-milovidov
ef61e3e27d
Merge pull request #6969 from azat-archive/graphite-events-send-absolute-values 
Add ability to send events with absolute values to graphite
 2019-09-23 01:51:48 +03:00
alexey-milovidov
0dc4b1793d
Merge pull request #7036 from infinivision/fix_bitmapMax_doc 
fix bitmapMin and bitmapMax doc
 2019-09-23 01:49:04 +03:00
Alexey Milovidov
bdea16e308 Merging S3: Moved S3 settings to <s3> in config to correspond to <merge_tree> and <kafka> 2019-09-23 01:44:10 +03:00
alexey-milovidov
fac04ea640
Merge pull request #7042 from kyprizel/master 
Initial fuzzing support with libfuzzer
 2019-09-23 01:31:44 +03:00
Alexey Milovidov
c03857b2ae Merging S3: part 2 2019-09-23 01:13:42 +03:00
Alexey Milovidov
6fb9565091 Merging S3: removed useless headers 2019-09-23 01:06:22 +03:00
alexey-milovidov
2054f80623
Merge pull request #5596 from excitoon-favorites/table_function_s3 
s3 table function and storage
 2019-09-23 00:53:06 +03:00
alexey-milovidov
3270ad439a
Update compressed_buffer_fuzz.cpp 2019-09-23 00:18:14 +03:00
alexey-milovidov
6fa234cea4
Merge pull request #6894 from azat-archive/hashed-dict-memory-usage-v2 
[RFC] Add sparsehash support for hashed dictionary (to reduce memory usage)
 2019-09-22 15:55:36 +03:00
alexey-milovidov
8fd66ac4fd
Update compressed_buffer_fuzz.cpp 2019-09-22 15:52:33 +03:00
Vladimir Chebotarev
4608da1344 Minor tests improvement. 2019-09-22 11:03:02 +00:00
Vladimir Chebotarev
64d49e4565 Minor review fixes. 2019-09-22 10:42:47 +00:00
Eldar Zaitov
b174833bdf Initial fuzzing support with libfuzzer 2019-09-22 13:34:09 +03:00
Azat Khuzhin
52f14c1ead
Update HashedDictionary.cpp (fixed rename in return type for SFINAE) 2019-09-22 10:39:50 +03:00
fenglv
4465fdb8bf Add test 
fix

fix

fix
 2019-09-22 14:25:43 +08:00
alexey-milovidov
5970aafd9a
Merge pull request #7032 from azat-archive/distributed-directory-monitor-SIGSEGV 
Avoid SIGSEGV on batch send failure (file with index XX is absent)
 2019-09-22 05:12:55 +03:00
alexey-milovidov
a12cffee91
Update HashedDictionary.h 2019-09-22 05:11:08 +03:00
alexey-milovidov
ab9a7be45a
Comments are the must. 2019-09-22 05:09:40 +03:00
alexey-milovidov
9afea6f0b3
Update HashedDictionary.cpp 2019-09-22 05:04:49 +03:00
alexey-milovidov
67e02b4ea0
Merge pull request #6957 from infinivision/add_bitmapSubsetLimit 
added bitmapSubsetLimit
 2019-09-22 04:58:44 +03:00
alexey-milovidov
6020ba187e
Update AggregateFunctionGroupBitmapData.h 2019-09-22 04:58:21 +03:00
alexey-milovidov
816ac1ca8d
Merge pull request #7037 from silviucpp/silviu-fix-osx 
Fix osx build
 2019-09-22 04:53:36 +03:00
alexey-milovidov
d446205eec
Update QueryProfiler.cpp 2019-09-22 04:53:19 +03:00
Silviu Caragea
5a14d97587 Fix linking when __ELF__ is not defined 2019-09-22 01:04:17 +03:00
Silviu Caragea
1fbd2fb6a8 Fix osx build 2019-09-21 21:30:01 +03:00
Zhichang Yu
ab7ecd84a1 fix bitmapMin and bitmapMax doc 2019-09-21 23:34:44 +08:00
alesapin
4575b6e4ff
Merge pull request #7031 from yandex/rename-storage-policy-name 
Renamed "storage_policy_name" to "storage_policy"
 2019-09-21 17:03:19 +03:00
Azat Khuzhin
59763cbb3a
Add ability to send events with absolute values to graphite 
<events> sends only deltas for events, while sometimes it is more
convenient to get absolute values (for example to calculate rate).

This patch introduces another directive -- <events_absolute> that will handle
this.

v0: use <events> as bool/string
v2: use <events_absolute>true</events_absolute> over <events>absolute</events>
 2019-09-21 02:46:47 +03:00
Azat Khuzhin
420089c301
Add new dictionary layout (sparse_hashed) that is more memory efficient 
With this new layout, sparsehash will be used over default HashMap,
sparsehash is more memory efficient but it is also slower.

So in a nutshell:
- HashMap uses ~2x more memory then sparse_hash_map
- HashMap ~2-2.5x faster then sparse_hash_map
(tested on lots of input, and the most close to production was
dictionary with 600KK hashes and UInt16 as value)

TODO:
- fix allocated memory calculation
- getBufferSizeInBytes/getBufferSizeInCells interface
- benchmarks

v0: replace HashMap with google::sparse_hash_map
v2: use google::sparse_hash_map only when <sparse> isset to true
v3: replace attributes with different layout
v4: use ch hash over std::hash
 2019-09-21 02:22:40 +03:00
Azat Khuzhin
b22b65dd29
Avoid SIGSEGV on batch send failure (file with index XX is absent) 
In case of the following error:
  Failed to send batch: file with index 23742 is absent

NULL dereference will occur for the "remote".
 2019-09-21 02:22:25 +03:00
alexey-milovidov
f8d19f6bf3
Merge pull request #6968 from azat-archive/create_as_skip_indices 
[RFC] Introduce create_as_skip_indices
 2019-09-20 23:53:49 +03:00
alexey-milovidov
1dc58dcb15
Update InterpreterCreateQuery.cpp 2019-09-20 23:53:14 +03:00
alexey-milovidov
c3e0f1c9d3
Merge pull request #7020 from amosbird/check_settings 
Outline methods to get needed instantiations.
 2019-09-20 23:46:45 +03:00
alexey-milovidov
2432a68009
Merge pull request #7022 from 4ertus2/bugs 
Fix "Unknown identifier" in ORDER BY and GROUP BY with Multiple Joins
 2019-09-20 23:45:51 +03:00
alexey-milovidov
3f500aad4b
Merge pull request #6976 from sfod/issue-3571 
Throw exceptions if WITH TOTALS/ROLLUP/CUBE are specified without agg…
 2019-09-20 23:39:00 +03:00
Alexey Milovidov
42b739550b Renamed "storage_policy_name" to "storage_policy" 2019-09-20 23:35:50 +03:00
alexey-milovidov
5314088648
Merge pull request #6980 from filimonov/huge_pk_performance_test 
Adding performance test for huge pk (issue #6924)
 2019-09-20 23:29:56 +03:00
Alexander Tokmakov
0080639f79 Merge branch 'master' into merging_values_with_expressions 2019-09-20 23:26:01 +03:00
Alexander Tokmakov
2c7384ff39 add performance test 2019-09-20 22:45:26 +03:00
Alexander Tokmakov
d353746f2b minor fixes 2019-09-20 22:44:52 +03:00
Ivan Lezhankin
9e46118edd Merge remote-tracking branch 'upstream/master' into issue-6459 2019-09-20 21:25:55 +03:00
Ivan Lezhankin
8cb0e58bc7 Fix build for all targets 2019-09-20 21:13:51 +03:00
alexey-milovidov
123b8cb43c
Merge pull request #6990 from Akazz/timeout_for_sync_replica_cmd 
Fixed timeout mechanism for SYNC REPLICA command + simplified related code
 2019-09-20 20:32:51 +03:00
alexey-milovidov
aabd6906f2
Merge pull request #6982 from 4ertus2/mjoin 
PartialMergeJoin bugfixes
 2019-09-20 20:19:00 +03:00
Ivan Lezhankin
967e00a8da It works! 
if compiled with:

CC=clang CXX=clang++ cmake -Wno-dev . -Bbuild -GNinja -DCMAKE_AR:FILEPATH=x86_64-apple-darwin-ar -DCMAKE_RANLIB:FILEPATH=x86_64-apple-darwin-ranlib -DCMAKE_SYSTEM_NAME=Darwin -DSDK_PATH=MacOSX10.14.sdk -DLINKER_NAME=x86_64-apple-darwin-ld -DUSE_SNAPPY=OFF -DENABLE_SSL=OFF -DENABLE_PROTOBUF=OFF -DENABLE_PARQUET=OFF -DENABLE_READLINE=OFF -DENABLE_ICU=OFF -DENABLE_FASTOPS=OFF
 2019-09-20 20:09:22 +03:00
millb
4f24512ba4 Test added. 2019-09-20 19:40:06 +03:00
millb
88adbb72d9 Fixed Function Hex for Float32 and Float64 2019-09-20 19:21:05 +03:00
chertus
7726130303 fix multiple joins aliasing for order by and group by 2019-09-20 19:01:19 +03:00
Amos Bird
b64bab29ed Outline methods to get needed instantiations. 2019-09-20 22:45:25 +08:00
sfod
bc9bcfdb7e Fix tests which use WITH TOTALS without aggregation 2019-09-20 17:42:30 +03:00
sfod
bf2654e093 Use sql file to test changes 2019-09-20 17:39:26 +03:00
maqroll
ca36e3f861 Attach error to force ip refresh 2019-09-20 12:36:09 +00:00
Ivan
cffc254922
Always read and insert Kafka messages as a whole (#6950) 
* Always read and insert Kafka messages as a whole.
 2019-09-20 15:12:32 +03:00
stavrolia
7309e813bc cleanup hdfs docs 2019-09-20 14:26:00 +03:00
Alexander Kazakov
2d807368e1 Adjusted timings in test + more verbose diagnostics 2019-09-20 00:20:58 +03:00
Azat Khuzhin
b2a3db1048
Ignore indices for CREATE TABLE .. AS .. if storage do not support them 2019-09-19 23:55:38 +03:00
chertus
0bc345fdc0 MergeJoin compare nullables 2019-09-19 20:09:59 +03:00
fenglv
2062bedaf0 Add repeat function 2019-09-20 00:46:41 +08:00
chertus
da14951ecd implement MergeJoin.joinTotals() 2019-09-19 17:53:03 +03:00
Alexander Kazakov
90c9d83fa5 Added missing newline at the EOF 2019-09-19 17:48:08 +03:00
alesapin
b289d7e6a5 Fix system contributors generating script 2019-09-19 17:41:49 +03:00
Alexander Kazakov
7a0f7a57e2 Chmod +x for test!!! 2019-09-19 15:48:18 +03:00
Akazz
4ae3db45c6 Fixed timeout reading in SYNC REPLICA 2019-09-19 14:04:57 +03:00
Vladimir Chebotarev
0ee6f6231a Added comments about redirecting requests and got rid of magic values. 2019-09-19 10:33:34 +00:00
Vladimir Chebotarev
12f7361095 Removed unused headers from ReadBufferFromS3.h 2019-09-19 10:25:31 +00:00
Vladimir Chebotarev
a5d6bd9e01 Proper passing of query parameters in initiate multipart upload. 2019-09-19 10:16:39 +00:00
Vladimir Chebotarev
a88d795f0f Proper passing of query parameters in initiate multipart upload. 2019-09-19 10:15:59 +00:00
Vladimir Chebotarev
283e09d2a5 Removed trash logging and fixed query parameters in multipart uploads. 2019-09-19 10:02:45 +00:00
Akazz
787a646680 Added a test to challenge timeout mechanism in SYNC REPLICA command 2019-09-19 13:00:44 +03:00
Vladimir Chebotarev
bd1ce56797 Tests decomposition. 2019-09-19 09:34:33 +00:00
philip.han
365f61c896 Fix code-style 2019-09-19 18:24:07 +09:00
maqroll
3765084358 Proper ReadWriteBufferFromHTTP constructor args 2019-09-19 07:33:54 +00:00
Zhichang Yu
0dc3866c36 added bitmapSubsetLimit 2019-09-19 10:15:36 +08:00
alexey-milovidov
1fe79ad43c
Merge pull request #6941 from dimarub2000/enums_in_section 
IN with Enums numeric values
 2019-09-19 02:24:34 +03:00
alexey-milovidov
9c675e50bb
Merge pull request #6963 from nicelulu/issue_6616 
optimize limit 1,0 and test.
 2019-09-19 02:23:56 +03:00
alexey-milovidov
01a1920e9b
Merge pull request #6970 from infinivision/add_bitmapMin_bitmapMax 
added bitmapMin and bitmapMax
 2019-09-19 02:01:16 +03:00
alexey-milovidov
1327e71d80
Changed C-style cast to constructor-style cast. 2019-09-19 02:01:06 +03:00
alexey-milovidov
7325f4a77b
Merge pull request #6974 from yandex/aku/mmap-linux 
Use MAP_POPULATE only on Linux.
 2019-09-19 01:58:40 +03:00
alexey-milovidov
bc1ecb0be5
Merge pull request #6951 from yandex/aku/alloc-continue 
Make the quadratic Arena::allocContinue less bad.
 2019-09-19 01:57:26 +03:00
alexey-milovidov
d7681d0239
Merge pull request #6977 from Akazz/minor_fixes_in_tests-2 
Reworked flapping test - 00715_fetch_merged_or_mutated_part_zookeeper
 2019-09-19 01:54:27 +03:00
alexey-milovidov
0bdb48ed65
Merge pull request #6966 from azat-archive/build--fixes 
Add missing linking with jemalloc
 2019-09-19 01:52:22 +03:00
alexey-milovidov
db470be077
Update merge_tree_huge_pk.xml 2019-09-18 23:07:23 +03:00
chertus
b8b6197288 partial_merge_join settings affects LEFT and INNER JOINs only 2019-09-18 22:12:53 +03:00
chertus
08a28d2dc2 fix pm join bug (wrong right equal range copy) 2019-09-18 21:44:44 +03:00
Azat Khuzhin
6cb5d0046b
Add missing linking with jemalloc for clickhouse_common_io 
clickhouse_common_io incudes new_delete.cpp, that uses memory.h, which
uses sdallocx (jemalloc).

And since there is -Wl,--no-undefined every undefined symbols are not
allowed, hence clickhouse_common_io must know about sdallocx symbol.

For the default build (-DUNBUNDLED=OFF) everything is good, because
jemalloc is static, and clickhouse_common_io linked with libcommon
(which is linked with jemalloc)

But if jemalloc will be shared, and clickhouse_common_io and libcommon
is different shared libraries then clickhouse_common_io should be linked
with jemalloc, otherwise you will undefined reference to sdallocx error.

This can be reproduced using the following build configuration:
   -DUSE_STATIC_LIBRARIES=OFF -DCLICKHOUSE_SPLIT_BINARY=ON -DSPLIT_SHARED_LIBRARIES=ON -DUNBUNDLED=ON
Provided that you have systemd-wide jemalloc>=4 (see memory.h).

Refs: https://github.com/yandex/ClickHouse/pull/6878#discussion_r324902295
v2: do not link jemalloc if it is static
 2019-09-18 21:26:23 +03:00
chertus
38a73fb551 add simple perf test for partial merge join 2019-09-18 20:04:10 +03:00
chertus
194e49e751 fix UB in MergeJoinCursor 2019-09-18 19:46:00 +03:00
Mikhail Filimonov
67e1cf9b73 Adding performance test for huge pk (issue #6924) 2019-09-18 17:35:45 +02:00
maqroll
952d9449a2 typo 2019-09-18 14:53:45 +00:00
root
8175d4c2d1 style checks 
Committer: maqroll <loteroc@gmail.com>
 2019-09-18 13:38:17 +00:00
Artem Zuikov
aae82eed5a
Merge pull request #6940 from 4ertus2/mjoin 
PartialMergeJoin
 2019-09-18 16:16:10 +03:00
Akazz
aa8ef05955 Reworked test 00715_fetch_merged_or_mutated_part_zookeeper 2019-09-18 16:14:56 +03:00
root
ea5480fd72 merge 
Committer: maqroll <loteroc@gmail.com>
 2019-09-18 13:13:40 +00:00
sfod
0bad4b4a05 Throw exceptions if WITH TOTALS/ROLLUP/CUBE are specified without aggregate functions 2019-09-18 16:08:51 +03:00
chertus
dd46c08e90 move JoinCommon funcs out of IJoin.h/cpp 2019-09-18 15:46:57 +03:00
Alexander Kuzmenkov
e3a9863260 Use MAP_POPULATE only on Linux. 2019-09-18 15:32:23 +03:00
chertus
0cf5bfdf44 fix typo 2019-09-18 15:24:35 +03:00
Alexander Kuzmenkov
e1898ca89a Make the quadratic Arena::allocContinue less bad. 
Scenarios that use Arena::allocContinue may waste quadratically many
memory and perform quadratically many copying, when the memory range
size reaches Arena's linear allocation threshold. To alleviate this,
make sure that the next memory chunk allocated by allocContinue is at
least linear_growth_threshold bytes bigger than the previous one, so
that we don't reallocate and copy that often.
 2019-09-18 15:04:56 +03:00
root
ee311ff03c style checks 
Committer: maqroll <jluisoc@gmail.com>
 2019-09-18 10:38:00 +00:00
CurtizJ
651f5b0e9f merging with master 2019-09-18 13:21:10 +03:00
CurtizJ
79a08ef8ea Merge remote-tracking branch 'upstream/master' into merging_redis 2019-09-18 12:58:22 +03:00
alexey-milovidov
fe9e110a6a
Merge pull request #6965 from azat-archive/sparsehash-c11 
Replace libsparsehash with sparsehash-c11
 2019-09-18 12:46:13 +03:00
philip.han
ff30f4d890 Add testcases for Arrays in bloom_filter index 2019-09-18 18:32:46 +09:00
philip.han
b25151b61b Make bloom_filter-index support some types of Arrays. 2019-09-18 18:32:44 +09:00
Zhichang Yu
460ccb04a2 added bitmapMin and bitmapMax 2019-09-18 16:56:12 +08:00
root
392bdd6008 +UpdatableSessionBase 
Committer: maqroll <jluisoc@gmail.com>
 2019-09-18 08:49:46 +00:00
alexey-milovidov
03014fe920
Merge pull request #6944 from malkfilipp/add-limit-clause-to-show-queries 
Add LIMIT clause to SHOW queries
 2019-09-18 02:07:45 +03:00
alexey-milovidov
d8cd375c8b
Merge pull request #6958 from proller/fix25 
Build fixes
 2019-09-18 01:48:46 +03:00
Azat Khuzhin
780341060f
Replace libsparsehash with sparsehash-c11 
- use sparsehash-c11 over libsparsehash
- fix typos in find_sparsehash and users of the vars (s/SPARCE/SPARSE/)
- drop libsparsehash-dev from docker images (but keep for unbunlded build)
- use ::google over GOOGLE_NAMESPACE
 2019-09-18 00:08:20 +03:00
root
f4b7cae998 optimize limit 1,0 and test. 2019-09-18 02:55:59 +08:00
chertus
2b3a4b0650 support const and LC columns in partial merge-join 2019-09-17 21:53:52 +03:00
CurtizJ
7ccf04440a better code in Redis external dictionary 2019-09-17 20:57:48 +03:00
chertus
58fad78980 support MergeJoin nullable convertion (right side) 2019-09-17 19:55:11 +03:00
alesapin
110568f980
Merge pull request #6947 from yandex/add_gdb_index 
Add gdb index to builds with debug info
 2019-09-17 17:59:27 +03:00
CurtizJ
df82e4bde8 fix build 2019-09-17 17:55:09 +03:00
CurtizJ
4480e97f9f fix build 2019-09-17 17:16:07 +03:00
CurtizJ
4df1f1bb9a better integration test for redis dictionary (but still bad) 2019-09-17 16:35:19 +03:00
malkfilipp
aab95fd517 Bump the test number 2019-09-17 15:41:25 +03:00
proller
e7f069c78c fixes 2019-09-17 12:33:46 +00:00
akuzm
75dc7d331e
Merge pull request #6937 from amosbird/ubmemfix 
In hash tables, properly initialize zero key cell.
 2019-09-17 14:57:38 +03:00
alesapin
33c3f7a6a2 Add gdb-index for gold linker with gdb-add-index tool 2019-09-17 12:49:27 +03:00
Dmitry Rubashkin
2252ee5a90 Branch refactoring. 2019-09-17 11:17:46 +03:00
chertus
da5d35b34e partial merge join (minimal tested version) 2019-09-16 22:31:22 +03:00
root
5ec0005400 +UpdatableSessionBase 
Committer: maqroll <loteroc@gmail.com>
 2019-09-16 17:28:41 +00:00
CurtizJ
e9336c9166 improvements of redis external dictionary 2019-09-16 19:17:56 +03:00
Dmitry Rubashkin
6fa925c263 Typo. 2019-09-16 18:47:13 +03:00
Dmitry Rubashkin
6f68cfc45c Removed (most probably) redundant if branch. Fixed VALUES table funtion. 2019-09-16 18:44:12 +03:00
Amos Bird
1cf47da60d ubsan/memsan fix. 2019-09-16 21:20:17 +08:00
chertus
cbd96af079 fix use after free (change Join <-> AnalyzedJoin ownership) 2019-09-16 15:37:46 +03:00
alesapin
719854b49b
Merge pull request #6939 from dimarub2000/perfomance_test_all_of 
all_of setting in performance-test now works properly
 2019-09-16 13:04:23 +03:00
Vitaly Baranov
fae612c3e7
Merge pull request #6907 from PerformanceVision/dict_allow_databases 
Whitelist for dictionary from the current connected database
 2019-09-16 11:52:25 +03:00
malkfilipp
ed42b94af7 Add tests 2019-09-15 19:08:26 +03:00
malkfilipp
98050c108f Add LIMIT clause to SHOW queries 2019-09-15 19:07:27 +03:00
Ivan Lezhankin
8c356a3830 WIP 2019-09-15 18:20:31 +03:00
Ivan Lezhankin
787c2b8d83 WIP 2019-09-15 13:35:19 +03:00
Ivan Lezhankin
01fdb802d4 Useful changes 2019-09-15 13:35:12 +03:00
alexey-milovidov
831eebe4dc
Merge pull request #6934 from abyss7/CLICKHOUSE-4643 
Name temporary external table with existing subquery alias
 2019-09-15 09:46:10 +03:00
Vitaly Baranov
a2c9bec468
Fix typo 2019-09-15 01:56:37 +03:00
Vitaly Baranov
c17071caf0
Fix typo 2019-09-15 01:55:22 +03:00
Vitaly Baranov
0fb234c63e
Merge branch 'master' into dict_allow_databases 2019-09-15 01:51:44 +03:00
Alexey Milovidov
79a206b092 Fixed typo #6895 2019-09-14 18:41:47 +03:00
alexey-milovidov
6503369138
Merge pull request #6895 from azat-archive/distributed_directory_monitor_max_sleep_time-v2 
[RFC] Drop max_sleep_time limit from StorageDistributedDirectoryMonitor
 2019-09-14 18:39:27 +03:00
Vladimir Chebotarev
d53872c300 Tests improvement. 2019-09-14 07:44:46 +00:00
Ivan
66d6e0cbb3 Update 01009_global_array_join_names.reference 2019-09-14 01:03:44 +03:00
Ivan
8fcf490bd9
Update 01009_global_array_join_names.reference 2019-09-14 00:58:39 +03:00
Ivan
33e6681c90
Update 01009_global_array_join_names.sql 2019-09-13 23:00:28 +03:00
Dmitry Rubashkin
57eef84322 DROP 2019-09-13 22:09:00 +03:00
Dmitry Rubashkin
ea3f80460c Tests. 2019-09-13 22:07:22 +03:00
Dmitry Rubashkin
33e7e1ea93 Int64 added. 2019-09-13 21:25:53 +03:00
Alexander Tokmakov
aa10bc99cc improvements 2019-09-13 21:19:14 +03:00
Dmitry Rubashkin
2705534be7 Merge branch 'enums_in_section' of github.com:dimarub2000/ClickHouse into enums_in_section 2019-09-13 20:50:53 +03:00
Dmitry Rubashkin
cd95e8e5e5 Fix inconsistent behaviour of IN with Enums 2019-09-13 20:49:53 +03:00
CurtizJ
ad986f285e fix redis with mixed keys 2019-09-13 20:38:56 +03:00
akuzm
e765733a26
Merge pull request #6925 from yandex/aku/msan 
Some MemorySanitizer fixes
 2019-09-13 20:26:48 +03:00
chertus
eb3d87032c all|any left|inner, not tested 2019-09-13 20:23:32 +03:00
alexey-milovidov
10e274213d
Merge pull request #6930 from filimonov/performance_test_lowcard_arr 
performance test for lowcardinality array
 2019-09-13 20:01:57 +03:00
dimarub2000
24d0055dc8 Typo 2019-09-13 19:24:59 +03:00
dimarub2000
26b1bc2093 all_of setting now works properly 2019-09-13 19:18:26 +03:00
chertus
bd957168d2 any left join (without use_nulls) 2019-09-13 19:17:37 +03:00
Ivan
d697f4a1d1
Update 01009_global_array_join_names.sql 2019-09-13 19:07:54 +03:00
Nikolai Kochetov
3c53dfd227 Add processors to StorageMergeTree [WIP]. 2019-09-13 18:41:09 +03:00
Ivan Lezhankin
5b60053ef7 [WIP] 2019-09-13 17:56:27 +03:00
Ivan Lezhankin
e692a88196 CMake now works 
Example: -DCMAKE_SYSTEM_NAME=Darwin -DSDK_PATH=${HOME}/stuff/MacOSX10.12.sdk -DLINKER_NAME=${HOME}/.local/bin/ld64
 2019-09-13 17:56:27 +03:00
Ivan Lezhankin
1b5192706e Some fixes for OS X build. 2019-09-13 17:56:26 +03:00
Ivan
add919e922
Update 01009_global_array_join_names.sql 2019-09-13 17:44:04 +03:00
Vladimir Chebotarev
4406ad1061 Tests fix. 2019-09-13 13:53:17 +00:00
Ivan Lezhankin
dc49303baf Use existing alias as external table name 2019-09-13 16:25:24 +03:00
Vladimir Chebotarev
2cddcebc31 Moved server to clickhouse instance in test. 2019-09-13 13:17:58 +00:00
Nikolai Kochetov
1f5e62d741 Added IStorage::readWithProcessors. 2019-09-13 15:59:48 +03:00
Nikolai Kochetov
1335aa75d7 Added TreeExecutor. 2019-09-13 15:34:05 +03:00
Alexander Kuzmenkov
f4da0399c0 Some MemorySanitizer fixes. 2019-09-13 14:49:29 +03:00
Ivan Lezhankin
a3944624a0 Add test 2019-09-13 14:10:41 +03:00
alesapin
02cff38fef Merge with master 2019-09-13 13:58:23 +03:00
Vladimir Chebotarev
b324261285 Minor test fix. 2019-09-13 10:18:09 +00:00
Vladimir Chebotarev
a54b43cd01 Better test, minor fix. 2019-09-13 13:04:21 +03:00
Nikolai Kochetov
4576e1f4b2 Enable Processors by default. 2019-09-13 11:59:46 +03:00
Nikolai Kochetov
86bee0b8b5
Merge pull request #6684 from yandex/processors-2 
Processors 2
 2019-09-13 11:58:04 +03:00
Guillaume Tassery
214d089bb5 Cosmetic and remove documentation 2019-09-13 10:26:04 +02:00
Guillaume Tassery
bb088fbf65 Write dictionary permission on user instead of dictionary configuration 2019-09-13 10:22:34 +02:00
alexey-milovidov
12c26e6013
Merge pull request #6891 from yandex/low_cardinality_in_native_http 
Low cardinality in native http
 2019-09-13 09:01:08 +03:00
alexey-milovidov
ba40858094
Merge pull request #6928 from proller/fix27 
CLICKHOUSE-4652 Another fix for АrrayEnumerateUniqRanked with empty arrays
 2019-09-13 08:57:30 +03:00
alexey-milovidov
b31c5d15b6
Merge pull request #6929 from vitlibar/better-http-server-in-test_dictionaries_all_layouts_and_sources 
Better simulation of HTTP server for integration test
 2019-09-13 08:55:38 +03:00
Mikhail Filimonov
3f9d4a5d8e performance test for lowcardinality array, showing significant performance degradation comparing to plain array 2019-09-12 22:46:31 +02:00