Commit Graph

24787 Commits

Author SHA1 Message Date
philip.han
16ea323fff Removed undefined behavior of signed integer overflow. 2019-11-07 00:00:59 +09:00
Mikhail Korotov
4326a35cc4 Merge branch 'decimal_hex_function' of https://github.com/millb/ClickHouse into decimal_hex_function 2019-11-06 17:49:30 +03:00
millb
7d46d359ea Working commit 2019-11-06 17:48:23 +03:00
Nikita Mikhaylov
5a399c78dc better 2019-11-06 17:18:28 +03:00
philip.han
300062e91a Fixed type conversions in javaHashUTF16LE 2019-11-06 23:17:38 +09:00
Mikhail Korotov
29747b5511 Merge branch 'decimal_hex_function' of https://github.com/millb/ClickHouse into decimal_hex_function 2019-11-06 16:11:27 +03:00
millb
7863b7f3c9 Working commit 2019-11-06 16:08:02 +03:00
Alexey Milovidov
3f0476b522 Disabled "trap" function back 2019-11-06 15:36:56 +03:00
Nikolai Kochetov
3bde663681 Wailt for AsynchronousBlockInputStream inner thread before getting totals to avoid possible race. 2019-11-06 15:34:51 +03:00
Nikolai Kochetov
ec8f160859 Wailt for AsynchronousBlockInputStream inner thread before getting totals to avoid possible race. 2019-11-06 15:26:51 +03:00
Azat Khuzhin
81aeff2d2a Add _shard_num virtual column for the Distributed engine
With JOIN from system.clusters one can figure out from which server data
came.

TODO:
- optimization to avoid communicating with unrelated shards (for queries
  like "AND _shard_num = n")
- fix aliases (see tests with serverError expected)

v0: AddingConstColumnBlockInputStream
v2: VirtualColumnUtils::rewriteEntityInAst
v3: fix remote(Distributed) by appending _shard_num only if has been requested
2019-11-06 15:26:12 +03:00
Vasily Nemkov
9c62209978 Added missing support of formatDateTime() for DateTime64 2019-11-06 15:01:39 +03:00
millb
4f6197c370 Working commit 2019-11-06 14:48:17 +03:00
Nikolai Kochetov
a34023192d Fix limits for pipe. 2019-11-06 14:36:33 +03:00
alexey-milovidov
a120fba929
Update FunctionsHashing.h 2019-11-06 14:20:31 +03:00
Alexey Milovidov
83c63171ad Added another mode for function "trap" #7601 2019-11-06 14:17:12 +03:00
Alexander Kuzmenkov
233212ac68
Merge pull request #7531 from amosbird/getkeymapped
Unify hash tables interface (separated for review)
2019-11-06 13:49:39 +03:00
philip.han
68a82f78b4 Implemented javaHashUTF16LE() 2019-11-06 19:46:37 +09:00
sundy-li
76b75dc0e8 args to supertype 2019-11-06 18:19:08 +08:00
Nikolai Kochetov
86a9c2b98e Try to fix tests. 2019-11-06 12:45:47 +03:00
Mikhail Korotov
cc96c511c3 Merge branch 'master' into url_engine_problem 2019-11-06 12:35:30 +03:00
Mikhail Korotov
281b0062bc
Working commit 2019-11-06 11:48:51 +03:00
Mikhail Korotov
556f6fbdc5
Working commit 2019-11-06 11:47:25 +03:00
millb
043ca0d470 Working commit 2019-11-06 11:42:34 +03:00
millb
9308ea5d33 Merge branch 'decimal_hex_function' of github.com:millb/ClickHouse into decimal_hex_function 2019-11-06 11:29:43 +03:00
millb
695f3c58cc Working Commmit 2019-11-06 11:29:18 +03:00
alexey-milovidov
33edb0929b
Merge pull request #7641 from 4ertus2/joins
Support RIGHT | FULL JOIN with expressions in ON section
2019-11-06 11:17:52 +03:00
Mikhail Korotov
0168620fad
Fixed style commit 2019-11-06 11:17:31 +03:00
alexey-milovidov
78f7826a09
Update InterpreterSelectQuery.cpp 2019-11-06 11:17:26 +03:00
millb
0226ba406c Functions tryExecuteFloat and tryExecuteDecimal are combined 2019-11-06 10:42:10 +03:00
millb
5c478dfe02 Merge branch 'master' into decimal_hex_function 2019-11-06 09:43:30 +03:00
Vladimir Chebotarev
9446edb42a
Fixed bug with keep_free_space_ratio not being read from disks configuration. 2019-11-06 07:59:35 +03:00
alexey-milovidov
687be5f7af
Merge pull request #7618 from excitoon-favorites/looks-like-wrong-copy-paste
Fixed exception in case of using 1 argument while defining S3, URL and HDFS storages
2019-11-06 02:11:38 +03:00
alexey-milovidov
678d88ed45
Merge pull request #7640 from nvartolomei/nv/docs-on-cluster-alter-replicated-variant-b
Remove note about unsupported ON CLUSTER alter for replicated tables and enable tests
2019-11-06 02:08:55 +03:00
chertus
950e95c178 support JOIN ON expression 2019-11-05 23:22:20 +03:00
alexey-milovidov
56c89349d3
Merge pull request #7639 from CurtizJ/final_mark_without_primary_key
Fix final mark with empty primary key.
2019-11-05 22:53:52 +03:00
Alexey Milovidov
9ac4e4c7fb Little better #7600 2019-11-05 22:31:07 +03:00
alexey-milovidov
1bfade54c2
Merge pull request #7600 from azat/DirectoryMonitor-current_batch.txt-corruption
Write current batch for distributed send atomically (using .tmp + rename)
2019-11-05 22:24:15 +03:00
Nicolae Vartolomei
ffa69441ae Remove duplication between distributed_ddl and distributed_ddl_secure tests 2019-11-05 19:06:52 +00:00
alexey-milovidov
8fc84e93ff
Merge pull request #7635 from ClickHouse/fix_concat_return_data_type
Now concat always return string column
2019-11-05 21:39:48 +03:00
alexey-milovidov
40a8216294
Merge pull request #7625 from ClickHouse/array-compact-improve
Improvement of arrayCompact function.
2019-11-05 21:39:06 +03:00
alexey-milovidov
eb6add45ea
Merge pull request #7626 from ClickHouse/char-test-utf8
Added a test for function "char" that proves that it's applicable for non-ASCII.
2019-11-05 21:38:37 +03:00
Alexey Milovidov
c6ac30e450 Added another test case by Sundy-Li request 2019-11-05 21:38:16 +03:00
CurtizJ
c958662c6e add test for empty primaty key 2019-11-05 21:21:49 +03:00
CurtizJ
3d968b0259 fix final mark with empty primary key 2019-11-05 20:42:35 +03:00
Nikita Mikhaylov
424d2234c8 test 2019-11-05 20:38:06 +03:00
Nikolai Kochetov
055f21c9b7 Less wrappers for procesors pipeline. 2019-11-05 20:33:03 +03:00
Amos Bird
fbfbe161ec
Unify hash tables interface. 2019-11-06 00:08:04 +08:00
alexey-milovidov
a44d08bea9
Merge pull request #7634 from ClickHouse/aku/macros-verbose-error
More verbose error message in macros.
2019-11-05 19:02:34 +03:00
Mikhail Korotov
b0875c75c8 Merge branch 'url_engine_problem' of https://github.com/millb/ClickHouse into url_engine_problem 2019-11-05 18:58:17 +03:00
millb
582364f63a Working commit 2019-11-05 18:57:06 +03:00
Nikita Mikhaylov
c5b4707e92 exception 2019-11-05 18:49:13 +03:00
Mikhail Korotov
1bbf9b2ef9 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into url_engine_problem 2019-11-05 18:47:05 +03:00
Mikhail Korotov
4bf4cfbab5 Created test for HDFS Storage and hdfs table function
Deleted extra tests
2019-11-05 18:30:35 +03:00
Vladimir Chebotarev
7b93641a10
Fixed comment in configuration. 2019-11-05 18:08:37 +03:00
Alexander Kuzmenkov
36a9ac86b8 More verbose error message in macros. 2019-11-05 17:02:38 +03:00
Vasily Nemkov
e924ae6d15 Better parsing of DateTime64
Fractional part is optional, correctly scaling fractional part to match
the scale.
2019-11-05 16:41:15 +03:00
Vasily Nemkov
5150a3e586 Simplified and renamed basic DateTime64 test. 2019-11-05 16:40:23 +03:00
Nikita Mikhaylov
5416914862 remove logging 2019-11-05 16:26:11 +03:00
alesapin
2d7ae27232 Now concat always return string column 2019-11-05 16:23:09 +03:00
Nikita Mikhaylov
0d3a05ce3b remove logging + fix for PrettySpace + overrided readSuffix and readPrefix 2019-11-05 15:58:32 +03:00
Nikolai Kochetov
a0e9f9fdcf Skip empty totals in SourceFromInputStream. 2019-11-05 15:50:47 +03:00
Mikhail Korotov
3687ccfa1e Merge branch 'url_engine_problem' of https://github.com/millb/ClickHouse into url_engine_problem 2019-11-05 15:46:03 +03:00
Mikhail Korotov
82d09a8df0 working commit 2019-11-05 15:45:43 +03:00
millb
a03f8145bb Created check for HDFS and S3 storages
:
2019-11-05 15:40:49 +03:00
Nicolae Vartolomei
d9d73fe783 Simplify integration test for distributed alter 2019-11-05 12:29:30 +00:00
Vasily Nemkov
61ad74bc58 Fixed parsing DateTime and/or DateTime64 with parseXXXOrNull 2019-11-05 14:59:46 +03:00
millb
d62cd6efa8 Merge branch 'master' into url_engine_problem 2019-11-05 14:42:53 +03:00
hcz
e0e5e812a7
Allow relative user_files_path 2019-11-05 17:48:49 +08:00
Nikita Mikhaylov
817b52314e Merge branch 'master' of github.com:ClickHouse/ClickHouse into parallel_parsing 2019-11-05 12:32:26 +03:00
Nikolai Kochetov
abccddb6b9 Check number of rows in OneBlockInputStream. 2019-11-05 12:26:23 +03:00
Vasily Nemkov
9d3c819897 Fixed compilation of unit-tests and utility binaries
By removing extern template declarations for Decimal<T> and explicit instantiations in Types.cpp
2019-11-05 12:02:27 +03:00
sundy-li
71ec49cc2f add range performance tests 2019-11-05 15:07:25 +08:00
alexey-milovidov
6a871f579f
Merge pull request #7598 from infinivision/bitmap_replace
added bitmapTransform
2019-11-05 02:23:50 +03:00
alexey-milovidov
2fe5f23025
Update FunctionsBitmap.h 2019-11-05 02:21:22 +03:00
alexey-milovidov
0c1510d3e3
Update FunctionsBitmap.h 2019-11-05 02:20:16 +03:00
alexey-milovidov
f9d14f78c0
Update FunctionsBitmap.h 2019-11-05 02:09:28 +03:00
alexey-milovidov
3ee7de2d52
Merge pull request #7620 from millb/integration_test_for_part_log_table
Integration test for part_log table
2019-11-05 02:05:33 +03:00
alexey-milovidov
c081c8aacb
Update AggregateFunctionGroupBitmapData.h 2019-11-05 01:59:02 +03:00
Alexey Milovidov
4f83b56c14 Added another test case 2019-11-05 01:47:46 +03:00
Vladimir Chebotarev
8556b2cee3 Added tests to check that ClickHouse don't crash on insufficient arguments of S3, URL and HDFS storages. 2019-11-05 01:47:26 +03:00
Alexey Milovidov
0a3b7068fd Added a test for function "char" 2019-11-05 01:45:51 +03:00
alexey-milovidov
7d2a16ee39
Merge pull request #7486 from sundy-li/char_function
functions: add char function
2019-11-05 01:40:18 +03:00
Alexey Milovidov
92824e14e7 Added a test 2019-11-05 01:18:59 +03:00
Alexey Milovidov
979db8c965 Improve "arrayCompact" function 2019-11-05 01:13:10 +03:00
alexey-milovidov
fbed472018
Update 00076_ip_coding_functions.sql 2019-11-05 00:53:35 +03:00
Azat Khuzhin
4dfffdd24a Write current batch for distributed send atomically (using .tmp + rename)
Otherwise the following can happen after reboot:

    2019.11.01 11:46:12.217143 [ 187 ] {} <Error> dist.Distributed.DirectoryMonitor: Code: 27, e.displayText() = DB::Exception: Cannot parse input: expected \n before: S\'^A\0^]\0\0<BE>4^A\0r<87>\0\0<A2><D7>^D^Y\0<F2>{^E<CD>\0\0Hy\0\0<F2>^_^C\0^_&\0\0<FF><D3>\0\0
    <8D><91>\0\0<C0>9\0\0<C0><B0>^A\0^G<AA>\0\0<B5><FE>^A\0<BF><A7>^A\0<9B><CB>^A\0I^R^A\0<B7><AB>^A\0<BC><8F>\0\0˲^B\0Zy\0\0<94><AA>\0\0<98>
    <8F>\0\0\f<A5>\0\0^QN\0\0<E3><C6>\0\0<B1>6^B\0ɳ\0\0W<99>\0\0<B9><A2>\0\0:<BB>\0\0)<B1>\0\0#<8B>\0\0aW\0\0<ED>#\0\0<F1>@\0\0ˀ^B\0<D7><FC>\0\0<DF>, Stack trace:

    0. 0x559e27222e60 StackTrace::StackTrace() /usr/bin/clickhouse
    1. 0x559e27222c45 DB::Exception::Exception(std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, int) /usr/bin/clickhouse
    2. 0x559e26de4473 ? /usr/bin/clickhouse
    3. 0x559e272494b5 DB::assertString(char const*, DB::ReadBuffer&) /usr/bin/clickhouse
    4. 0x559e2a5dab45 DB::StorageDistributedDirectoryMonitor::processFilesWithBatching(std::map<unsigned long, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> >, std::less<unsigned long>, std::allocator<std::pair<unsigned long const, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > > > > const&) /usr/bin/clickhouse
    5. 0x559e2a5db5fa DB::StorageDistributedDirectoryMonitor::processFiles() /usr/bin/clickhouse
    6. 0x559e2a5dba78 DB::StorageDistributedDirectoryMonitor::run() /usr/bin/clickhouse
    7. 0x559e2a5ddbbc ThreadFromGlobalPool::ThreadFromGlobalPool<void (DB::StorageDistributedDirectoryMonitor::*)(), DB::StorageDistributedDirectoryMonitor*>(void (DB::StorageDistributedDirectoryMonitor::*&&)(), DB::StorageDistributedDirectoryMonitor*&&)::{lambda()#1}::operator()() const /usr/bin/clickhouse
    8. 0x559e2726b07c ThreadPoolImpl<std::thread>::worker(std::_List_iterator<std::thread>) /usr/bin/clickhouse
    9. 0x559e2bbc3640 ? /usr/bin/clickhouse
    10. 0x7fbd62b3cfb7 start_thread /lib/x86_64-linux-gnu/libpthread-2.29.so
    11. 0x7fbd62a692ef __clone /lib/x86_64-linux-gnu/libc-2.29.so
     (version 19.17.1.1)

v2: remove fsync, to avoid possible stalls (https://github.com/ClickHouse/ClickHouse/pull/7600#discussion_r342010874)
2019-11-05 00:24:38 +03:00
alexey-milovidov
5aceca9e17
Merge pull request #7615 from amosbird/fix21
Global context should be unique.
2019-11-05 00:16:37 +03:00
Mikhail Korotov
0781065bd8 improved changes 2019-11-04 22:10:02 +03:00
Nicolae Vartolomei
ac6472b03f Try and enable test_replicated_alters 2019-11-04 17:15:28 +00:00
Mikhail Korotov
dd99468e7b Created integration test for part_log table 2019-11-04 20:13:49 +03:00
Vladimir Chebotarev
9869ee141c Fixed exception in case of using 1 argument while defining S3, URL and HDFS storages. 2019-11-04 20:11:50 +03:00
Amos Bird
e2cfc3ecab
Global context should be unique. 2019-11-04 23:43:13 +08:00
Vasily Nemkov
c6eb0fcff7 Merge remote-tracking branch 'upstream/master' into DateTime64 2019-11-04 17:06:22 +03:00
Vasily Nemkov
1237976021 Minor: style fix and removed debug output. 2019-11-04 14:54:17 +03:00
alexey-milovidov
81e33ca817
Merge pull request #7586 from 4ertus2/joins
Rewrite NonJoinedBlockInputStream
2019-11-04 14:49:47 +03:00
alexey-milovidov
b261e6033a
Merge pull request #7602 from excitoon-favorites/cloneAndLoadDataPartOnSameDisk
Made `MergeTreeData::cloneAndLoadDataPart` only work for the same disk.
2019-11-04 14:42:30 +03:00
alexey-milovidov
1354d1079a
Merge pull request #7605 from zhang2014/fix/is_local_show
fix cluster system is_local
2019-11-04 14:35:37 +03:00
alexey-milovidov
782e2f6c13
Merge pull request #7606 from amosbird/nullformat
Better Null format for tcp handler.
2019-11-04 14:27:27 +03:00
Zhichang Yu
da2d05802c added bitmapTransform 2019-11-04 14:55:31 +08:00
Amos Bird
8f902dc2a9
Better null format for tcp handler. 2019-11-04 11:53:26 +08:00
zhang2014
08894484ee fix cluster system is_local 2019-11-04 10:56:12 +08:00
alexey-milovidov
a8d6843723
Merge pull request #7599 from azat/__getScalar-fix
Check column for __getScalar() (avoids assertion)
2019-11-04 02:28:42 +03:00
Vladimir Chebotarev
e76bbfc5ad Made MergeTreeData::cloneAndLoadDataPart only work for the same disk. 2019-11-04 01:27:05 +03:00
Azat Khuzhin
920572915e Add regression test for the __getScalar() 2019-11-04 00:31:10 +03:00
alexey-milovidov
d9c02b652f
Merge pull request #7594 from amosbird/fix20
early constant folding improvement
2019-11-04 00:30:16 +03:00
chertus
b7b664845d return right x in RIGHT|FULL JOIN .. USING(x) from NonJoinedBlockInputStream if not qualified 2019-11-03 23:30:49 +03:00
chertus
d4e1468022 fix Join.saved_block_sample columns' nullability 2019-11-03 22:33:59 +03:00
Azat Khuzhin
842f4e2ca0 Check column for __getScalar() (avoids assertion)
Can be triggered using the following query:
  CREATE TABLE foo (key String, macro String MATERIALIZED __getScalar(key)) Engine=Null();

Trace:
    3. 0x00007ffff6d5d526 __assert_fail (libc.so.6)
    4. 0x00007ffff41fd931 boost::intrusive_ptr<DB::IColumn const>::operator*() const (libclickhouse_functionsd.so)
    5. 0x00007ffff41fcd64 COW<DB::IColumn>::IntrusivePtr<DB::IColumn const>::operator*() const & (libclickhouse_functionsd.so)
    6. 0x00007ffff4dc5944 DB::FunctionGetScalar::getReturnTypeImpl() const (libclickhouse_functionsd.so)

(Even though it is internal I guess it is better to fix it)

Refs: #7392
Cc: @amosbird
2019-11-03 21:44:56 +03:00
Amos Bird
f0b3c1f7c7
early constant folding improvement 2019-11-03 21:17:46 +08:00
Vasily Nemkov
98235e9202 Fixed now64 2019-11-03 08:42:48 +03:00
Vasily Nemkov
f437ae4822 Fixed zero-subsecond part 2019-11-03 08:38:45 +03:00
Vasily Nemkov
1fc28c08e6 Fixed toDateTime64 bug
Of unable to deduce timezone in function execution phase.
2019-11-03 08:10:11 +03:00
alexey-milovidov
d08bfbd3e1
Merge pull request #7328 from Joeywzr/arrayCompact
implement arrayCompact
2019-11-03 01:07:19 +03:00
alexey-milovidov
fa0274e223
Merge pull request #7380 from hczhcz/patch-1018
Add function arrayFill and arrayReverseFill
2019-11-03 01:06:41 +03:00
alexey-milovidov
ada6ee4137
Merge pull request #7591 from ClickHouse/one-more-attempt-djvu-bugfix
One more attempt of bugfix of infinite loop in pretty space format
2019-11-02 23:40:53 +03:00
alexey-milovidov
15c4a19bb1
Merge pull request #7585 from ernestp/macos_catalina_2019_11_01
Fixed compile errors on macOS Catalina
2019-11-02 15:46:17 +03:00
alexey-milovidov
f5531fb436
Merge pull request #7590 from amosbird/typetrait
ubsan fix
2019-11-02 13:22:39 +03:00
proller
6a573b4092 Allow to use mysql format without ssl - try2 with mysql interface split (#7524)
* Allow use mysql format without ssl

* fix

* fix

*  fix

* Also disable poco's optional libraries

* clean

* fix

* fix

* Requested changes

* clean

* Requested fixes

* Update MySQLHandler.cpp
2019-11-02 13:20:46 +03:00
alexey-milovidov
6e4d63e394
Merge pull request #7575 from Alex-Burmak/escaping_fix
Fixed missing file name escaping in FREEZE command
2019-11-02 13:20:28 +03:00
Amos Bird
ad12099642
ubsan fix 2019-11-02 17:00:03 +08:00
stavrolia
e58aa4e579 One more attempt of bugfix of infinite loop in pretty space format 2019-11-02 11:53:35 +03:00
stavrolia
d503c38cac Revert "Merge pull request #7587 from ClickHouse/fix-nonsignificant-djvu-bug"
This reverts commit 102a76ab47, reversing
changes made to dea9220e3c.
2019-11-02 03:23:27 +03:00
Olga Khvostikova
102a76ab47
Merge pull request #7587 from ClickHouse/fix-nonsignificant-djvu-bug
Find and retrieve lost bug fix in pretty spaces
2019-11-02 02:46:24 +03:00
stavrolia
89d8e6de93 Fix 2019-11-02 02:39:43 +03:00
alexey-milovidov
dea9220e3c
Merge pull request #7542 from hczhcz/patch-1030
Fix "create as select" parsing
2019-11-02 00:58:09 +03:00
alexey-milovidov
ad01f7b1ac
Merge pull request #7552 from azat/do-not-account-memory-for-Buffer-in-max_memory_usage
[RFC] Do not account memory for Buffer engine in max_memory_usage limit
2019-11-02 00:57:24 +03:00
alexey-milovidov
dda93e2275
Merge pull request #7561 from ClickHouse/achimbab-master
Merge for #7363
2019-11-02 00:57:13 +03:00
alexey-milovidov
7de9fdc183
Merge pull request #7579 from amosbird/countperftest
Add perf test for early constant folding
2019-11-02 00:51:45 +03:00
alesapin
d388565d04
Add create database query in test. 2019-11-01 22:35:50 +03:00
Nikita Mikhaylov
3c57b8e9c2 test 2019-11-01 21:59:54 +03:00
chertus
334b91f351 revrite NonJoinedBlockInputStream (in progress) 2019-11-01 20:41:07 +03:00
Ernest Poletaev
de1e5d0e53 Fixed compile errors on macOS Catalina 2019-11-01 23:33:43 +07:00
Nikolai Kochetov
239d92a94c Code cleanup. 2019-11-01 18:31:02 +03:00
Amos Bird
9626e24206
Add perf test for early constant folding 2019-11-01 22:33:03 +08:00
Nikolai Kochetov
575eabd4ff Add flag to set that set is created. 2019-11-01 16:56:33 +03:00
alexey-milovidov
4081b0be90
Merge pull request #7497 from amosbird/countopt
Early constant folding.
2019-11-01 16:54:02 +03:00
Alexander Burmak
9b8fc9a899 Fixed missing file name escaping in FREEZE command 2019-11-01 16:17:08 +03:00
Nikita Mikhaylov
0e04d14b7d cancel 2019-11-01 15:31:48 +03:00
Ivan
21db9157f7
Don't initialize some constant blocks in a loop (#7475) 2019-11-01 14:34:29 +03:00
Nikolai Kochetov
388bbb950b Add flag to set that set is created. 2019-11-01 14:03:35 +03:00
Nikolai Kochetov
1f7a798c97 Add flag to set that set is created. 2019-11-01 13:58:29 +03:00
alesapin
6ef0a92535
Merge pull request #7558 from excitoon/patch-1
Made mutation to choose the same disk in `ReplicatedMergeTree`.
2019-11-01 13:52:45 +03:00
alexey-milovidov
b1fe128109
Merge pull request #7562 from amosbird/parser3
Complement to #7501
2019-11-01 13:15:36 +03:00
Nikolai Kochetov
ddcbc2f9d3 Enable processors by default. 2019-11-01 12:45:33 +03:00
Nikolai Kochetov
d31cac33b2 Small fixes. 2019-11-01 12:41:20 +03:00
Nikolai Kochetov
5bb47e2484
Merge pull request #7181 from ClickHouse/processors-and-storages
Processors and storages
2019-11-01 12:04:49 +03:00
Nikolai Kochetov
c0fccd5b87 Simplified code. 2019-11-01 11:32:41 +03:00
Amos Bird
5333258e7e
Complement to tuple parser 2019-11-01 10:48:15 +08:00
alexey-milovidov
30b2d85fb0
Merge pull request #7501 from amosbird/parser2
Some parser improvements.
2019-10-31 23:48:14 +03:00
Azat Khuzhin
dbe45800d9 Do not account memory for Buffer engine in max_memory_usage limit
Since background flush will not be accounted there, and it can be too
tricky to calclulate this limit, in case you have multiple materialized
views with Buffer engine.

v2: test adjustment
2019-10-31 22:26:50 +03:00
Nikolai Kochetov
9a5a0a2a3b Fix types for set elements. 2019-10-31 19:14:06 +03:00
Vitaly Baranov
56011d4649
Merge pull request #7553 from vitlibar/add-constraints-columns-to-table-system-settings
Add constraints columns to table system.settings
2019-10-31 19:06:46 +03:00
Amos Bird
e04cdd4ebb
Early constant folding. 2019-10-31 23:54:32 +08:00
Amos Bird
4aff9a20c6
Better parser 2019-10-31 23:22:48 +08:00
Nikita Mikhaylov
9d8bbeb473 bad fix for PrettyCompact 2019-10-31 17:31:19 +03:00
Vladimir Chebotarev
faf1b070ac
Typo was fixed. 2019-10-31 16:26:11 +03:00
Vladimir Chebotarev
0dea6f5458
Added comment for selecting disk for mutation. 2019-10-31 16:19:38 +03:00
Nikolai Kochetov
be1ccaa890 Fix clang build. 2019-10-31 16:18:21 +03:00
Vladimir Chebotarev
f44cee623a
Made mutation to choose the same disk in ReplicatedMergeTree. 2019-10-31 15:22:25 +03:00
Nikolai Kochetov
18378417df Fix build. 2019-10-31 14:48:35 +03:00
Nikolai Kochetov
a80338e066 Merged with master 2019-10-31 14:41:29 +03:00
Nikolai Kochetov
a38124c68e Review fixes. 2019-10-31 14:32:24 +03:00
Vitaly Baranov
272608762e Fix comment. 2019-10-31 11:45:14 +03:00
alexey-milovidov
417c008700
Update 01021_create_as_select.sql 2019-10-31 11:29:30 +03:00
Vasily Nemkov
947cfa6056 Simplified formatDateTime test case: removed format directives that produce '\n' and '\t' chars. 2019-10-31 11:27:48 +03:00
Vasily Nemkov
a6ba05e5d9 Fixed converting DateTime64 to DateTime and Date. 2019-10-31 11:27:15 +03:00
hcz
134bc80940
Create array_fill.xml 2019-10-31 14:30:11 +08:00
sundy-li
17212afabb fix virtual call 2019-10-31 13:19:28 +08:00
sundy-li
d2a785f759 fix style 2019-10-31 12:59:50 +08:00
hcz
4c7a54113d Add tests 2019-10-31 11:33:23 +08:00
Vitaly Baranov
5601d6ae66 Add constraints columns to table system.settings 2019-10-31 01:45:57 +03:00
alexey-milovidov
194fd85f5c
Update arrayCompact.cpp 2019-10-31 00:29:15 +03:00
alexey-milovidov
0d2a2c332f
Merge pull request #7366 from achimbab/fixbug_inop
Made IN operator support Array(LowCardinality(Nullable(String)))
2019-10-31 00:26:22 +03:00
alexey-milovidov
88d43488e1
Merge pull request #7412 from 4ertus2/strange
merge_max_block_size in settings
2019-10-31 00:24:43 +03:00
alexey-milovidov
883c868b36
Merge pull request #7523 from ClickHouse/fix-thread-context-attach
Disable context replacement for internal queries
2019-10-31 00:07:13 +03:00
alexey-milovidov
8cfc70aad0
Merge pull request #7551 from ClickHouse/merge-fast-count
Improvements for fast count() after #7510
2019-10-30 23:55:58 +03:00
Nikita Mikhaylov
cb48ee42a3 enable feature 2019-10-30 23:51:23 +03:00
alexey-milovidov
1ec7cb3546
Update range.cpp 2019-10-30 23:39:29 +03:00
alexey-milovidov
bb75c7469a
Merge pull request #7545 from ClickHouse/fix_only_tuple_columns
Fix only tuple columns in table.
2019-10-30 23:34:23 +03:00
proller
0006f2a370 Fix build without submodules (#7295)
* Build fixes

*            fix

* Fix

* fix

* Fix install(export..

* Freebsd fixes

* Freebsd fixes

* Fix warning

* fix

* More PRIVATE linking

* Fix review

* Timmy

* Timmy

* fix

* Try fix jemalloc link

* style
2019-10-30 23:34:06 +03:00
Alexey Milovidov
fe73354320 Improvements after #7510 2019-10-30 22:15:55 +03:00
Amos Bird
4609ca3189
Enable bracketed paste if possible 2019-10-31 02:33:45 +08:00
alexey-milovidov
ddb58eeb8b
Merge pull request #7510 from amosbird/smartcount
Instant count() for MergeTree
2019-10-30 20:42:00 +03:00
alesapin
e2424bda4c Fix style 2019-10-30 19:00:40 +03:00
Nikita Mikhaylov
874f88e5a5 disable feature to test 2019-10-30 18:54:02 +03:00
Nikita Mikhaylov
b691cc744c comments and checks 2019-10-30 18:49:10 +03:00
alesapin
7f4e982d13 Add tests 2019-10-30 17:51:30 +03:00
alesapin
2b5ef8bdef Fix bug when table contains only tuple columns 2019-10-30 17:50:59 +03:00
Vasily Nemkov
be683588a5 Fixed CASTing Date and DateTime to DateTime64 2019-10-30 16:59:38 +03:00
hcz
4dca99fa65 Fix create as select parsing 2019-10-30 21:06:23 +08:00
Artem Zuikov
0f68c5a12a
Merge pull request #7530 from 4ertus2/joins
Fix right table key nullability (join_use_keys = 0)
2019-10-30 13:30:27 +03:00
Vasily Nemkov
bb04fd8e54 Type-support fixes 2019-10-30 13:10:51 +03:00
Ivan
4f2f5cca84
Add support for cross-compiling to the CPU architecture AARCH64 (#7370) 2019-10-30 10:01:53 +03:00
sundy-li
7292748012 fix docs 2019-10-30 10:06:30 +08:00
sundy-li
be9da37720 fix zero divide 2019-10-30 09:36:50 +08:00
chertus
deb2406b30 fix JOIN right table keys nullability 2019-10-29 22:39:42 +03:00
Nikita Mikhaylov
5bcfee117a empty + master 2019-10-29 20:05:10 +03:00
Nikita Mikhaylov
08f1930e76 Merge branch 'master' of github.com:ClickHouse/ClickHouse into parallel_parsing 2019-10-29 20:04:32 +03:00
Olga Khvostikova
ff4d90f602
Add test for greatCircleDist 2019-10-29 19:49:37 +03:00
alexey-milovidov
6e837e86e6
Merge pull request #7500 from amosbird/parsernit
Fix DUMP debug.
2019-10-29 19:25:20 +03:00
Amos Bird
1eb44c6837
Add missing tests 2019-10-29 22:26:43 +08:00
chertus
12b57aedf0 remove error prone code 2019-10-29 16:52:05 +03:00
Alexander Kuzmenkov
55ec00977b
Update dbms/src/Functions/greatCircleDistance.cpp 2019-10-29 16:31:53 +03:00
sundy-li
6f2cce37d7 fix move 2019-10-29 19:22:00 +08:00
sundy-li
718fb99939 fix move 2019-10-29 19:20:35 +08:00
millb
c154675a17 fixed_merge_conflict:wq 2019-10-29 13:30:47 +03:00
Mikhail Korotov
57f6780136
Update ErrorCodes.cpp 2019-10-29 14:39:57 +03:00
alesapin
cde07dd620 Disable context replacement for internal queries 2019-10-29 13:27:19 +03:00
Amos Bird
2c75a51d4f
Instant count() for MergeTree
Use (Replicated)MergeTree's metadata to do trivial count()
2019-10-29 17:45:47 +08:00
sundy-li
00389a67a0 add more tests 2019-10-29 14:55:59 +08:00
sundy-li
66ffec32f7 improve range to support start,step args 2019-10-29 14:33:03 +08:00
sundy-li
9eb77a59e3 fix index 2019-10-29 13:20:18 +08:00
sundy-li
a653f50432 remove logs 2019-10-29 13:01:45 +08:00
sundy-li
dbd3227e5a fixup partial const column 2019-10-29 11:51:27 +08:00
sundy-li
3f1651fa29 improve range 2019-10-29 11:03:47 +08:00
memo
3449e8d107 fix 2019-10-29 10:27:54 +08:00
Nikita Mikhaylov
c5085b86aa max_threads limit 2019-10-29 02:43:22 +03:00
Nikita Mikhaylov
2bd79325d7 test kafka limit 2019-10-28 17:41:24 +03:00
Alexander Kuzmenkov
6e2af3db41
Merge pull request #7480 from azat/crc-v3
Add CRC32IEEE()/CRC64() support
2019-10-28 16:16:37 +03:00
Amos Bird
15d12db16a
Fix DUMP debug. 2019-10-28 19:39:51 +08:00
Nikita Mikhaylov
756a10707d Merge branch 'master' of github.com:ClickHouse/ClickHouse into parallel_parsing 2019-10-28 13:51:52 +03:00
Nikita Mikhaylov
206800b8fc add stderr configs to kafka test 2019-10-28 13:51:43 +03:00
Alexander Kuzmenkov
c3ea94209b
Merge pull request #7491 from traceon/odbc-bridge-type-mapping-fix
Add handling of SQL_TINYINT and SQL_BIGINT, fix SQL_FLOAT in ODBC Bridge
2019-10-28 13:30:18 +03:00
memo
3064e716db add line 2019-10-28 14:48:25 +08:00
memo
0f572e5d7d add line 2019-10-28 12:51:59 +08:00
memo
90333ac9aa modified getReturnType 2019-10-28 11:15:52 +08:00
sundy-li
538b77c123 functions: add char function as mysql behavior 2019-10-28 10:44:56 +08:00
Nikolai Kochetov
43c8d13de6
Merge pull request #7496 from amosbird/fix15
Fix HAVING without GROUP BY
2019-10-28 02:44:24 +03:00
Amos Bird
77bdfb3350
Fix HAVING without GROUP BY 2019-10-27 22:10:54 +08:00
Vasily Nemkov
38e2897b49 Casting DateTime64 to DateTime64 of different scale or to/from Date/DateTime 2019-10-26 09:22:55 +03:00
Azat Khuzhin
04f1e6b2cc Use crc32_z() over crc32(), since it size_t for length 2019-10-25 23:32:29 +03:00
Nikita Mikhaylov
4fe0dda453 add cancel test 2019-10-25 21:03:38 +03:00
Denis Glazachev
8e48430159 Add handling of SQL_TINYINT and SQL_BIGINT
Fix handling of SQL_FLOAT
2019-10-25 21:49:49 +04:00
Nikita Mikhaylov
980528ed75 docs 2019-10-25 17:32:57 +03:00
Azat Khuzhin
2d2e738085 Add CRC32IEEE()/CRC64() support
zlib's implementation uses CRC-32-IEEE 802.3 polynomial (0xedb88320) but
with starting value 0xffffffff, so introduce another crc32
implementation - CRC32IEEE that has starting value - 0

Also add CRC64 with ECMA polynomial.

v2: s/crc*_data./crc*_data./ to avoid conflicts with other crc32.h in contrib
v3: join with existing CRC32()
2019-10-25 15:52:41 +03:00
Nikita Mikhaylov
60ee52cb8d remove unrelated changes in tests 2019-10-25 15:28:52 +03:00
Nikita Mikhaylov
682b9df17f remove SharedReadBuffer + remove lambdas 2019-10-25 15:28:24 +03:00
alesapin
04ca163518 Merge branch 'master' into dictionaries_ddl_loader 2019-10-25 10:58:04 +03:00
Guillaume Tassery
6986fe2ec1 remove id columns 2019-10-25 06:15:25 +02:00
hcz
3767cb76de Improve style 2019-10-25 11:25:02 +08:00
Nikita Mikhaylov
78b6322797 empty commit 2 2019-10-25 00:17:00 +03:00
alesapin
8755f5ffa9 Add missed config 2019-10-24 23:08:36 +03:00
Nikita Mikhaylov
76e64d1c1b empty commit 2019-10-24 21:06:45 +03:00
Artem Zuikov
df32d92ee5
Merge pull request #7358 from 4ertus2/ast
Better ambiguous column detection
2019-10-24 20:56:23 +03:00
Nikita Mikhaylov
342f259a1c comments 2019-10-24 19:52:55 +03:00
alesapin
5d8d1df802
Merge pull request #7434 from excitoon-favorites/fix-7424
Allowed to have some parts on destination disk or volume in MOVE PARTITION
2019-10-24 19:45:22 +03:00
alexey-milovidov
e865136b2c
Merge pull request #7450 from excitoon-favorites/test-7414
Added integration test for #7414 (validation of `max_data_part_size_bytes`).
2019-10-24 19:23:21 +03:00
Nikita Mikhaylov
c7084ff5dc better 2019-10-24 17:00:51 +03:00
chertus
f2028e901d review related changes 2019-10-24 16:04:50 +03:00
chertus
12cd21f3c3 Merge branch 'master' into ast 2019-10-24 15:20:09 +03:00
Artem Zuikov
39b64dff87
Merge pull request #7454 from 4ertus2/refactoring
Refactoring: extract non aliases logic out of QueryNormalizer
2019-10-24 14:34:53 +03:00
Vladimir Chebotarev
64f158ff28 Fixed message for ALTER MOVE PART. 2019-10-24 13:56:32 +03:00
Vasily Nemkov
17263bc7b1 Better reporting of unmatching function argument types. 2019-10-24 13:49:00 +03:00
Vasily Nemkov
adc28a5aed CLI args to the test to filter what functions and types are checked
with minor simplification to the test code
2019-10-24 13:48:42 +03:00
Alexander Kuzmenkov
29052b6a37
Merge pull request #7377 from azat/INSERT-Distributed-MATERIALIZED-cols
* Fix INSERT into Distributed non local node with MATERIALIZED columns

Previous patch e527def18a ("Fix INSERT
into Distributed() table with MATERIALIZED column") fixes it only for
cases when the node is local, i.e. direct insert.

This patch address the problem when the node is not local
(`is_local == false`), by erasing materialized columns on INSERT into
Distributed.

And this patch fixes two cases, depends on `insert_distributed_sync`
setting:

- `insert_distributed_sync=0`

    ```
    Not found column value in block. There are only columns: date. Stack trace:

    2. 0x7ffff7be92e0 DB::Exception::Exception() dbms/src/Common/Exception.h:27
    3. 0x7fffec5d6cf6 DB::Block::getByName(...) dbms/src/Core/Block.cpp:187
    4. 0x7fffec2fe067 DB::NativeBlockInputStream::readImpl() dbms/src/DataStreams/NativeBlockInputStream.cpp:159
    5. 0x7fffec2d223f DB::IBlockInputStream::read() dbms/src/DataStreams/IBlockInputStream.cpp:61
    6. 0x7ffff7c6d40d DB::TCPHandler::receiveData() dbms/programs/server/TCPHandler.cpp:971
    7. 0x7ffff7c6cc1d DB::TCPHandler::receivePacket() dbms/programs/server/TCPHandler.cpp:855
    8. 0x7ffff7c6a1ef DB::TCPHandler::readDataNext(unsigned long const&, int const&) dbms/programs/server/TCPHandler.cpp:406
    9. 0x7ffff7c6a41b DB::TCPHandler::readData(DB::Settings const&) dbms/programs/server/TCPHandler.cpp:437
    10. 0x7ffff7c6a5d9 DB::TCPHandler::processInsertQuery(DB::Settings const&) dbms/programs/server/TCPHandler.cpp:464
    11. 0x7ffff7c687b5 DB::TCPHandler::runImpl() dbms/programs/server/TCPHandler.cpp:257
    ```

- `insert_distributed_sync=1`

    ```
    2019.10.18 13:23:22.114578 [ 44 ] {a78f669f-0b08-4337-abf8-d31e958f6d12} <Error> executeQuery: Code: 171, e.displayText() = DB::Exception: Block structure mismatch in RemoteBlockOutputStream stream: different number of columns:
    date Date UInt16(size = 1), value Date UInt16(size = 1)
    date Date UInt16(size = 0): Insertion status:
    Wrote 1 blocks and 0 rows on shard 0 replica 0, 127.0.0.1:59000 (average 0 ms per block)
    Wrote 0 blocks and 0 rows on shard 1 replica 0, 127.0.0.2:59000 (average 2 ms per block)
     (version 19.16.1.1) (from [::1]:3624) (in query: INSERT INTO distributed_00952 VALUES ), Stack trace:

    2. 0x7ffff7be92e0 DB::Exception::Exception() dbms/src/Common/Exception.h:27
    3. 0x7fffec5da4e9 DB::checkBlockStructure<void>(...)::{...}::operator()(...) const dbms/src/Core/Block.cpp:460
    4. 0x7fffec5da671 void DB::checkBlockStructure<void>(...) dbms/src/Core/Block.cpp:467
    5. 0x7fffec5d8d58 DB::assertBlocksHaveEqualStructure(...) dbms/src/Core/Block.cpp:515
    6. 0x7fffec326630 DB::RemoteBlockOutputStream::write(DB::Block const&) dbms/src/DataStreams/RemoteBlockOutputStream.cpp:68
    7. 0x7fffe98bd154 DB::DistributedBlockOutputStream::runWritingJob(DB::DistributedBlockOutputStream::JobReplica&, DB::Block const&)::{lambda()#1}::operator()() const dbms/src/Storages/Distributed/DistributedBlockOutputStream.cpp:280
    <snip>
    ````

Fixes: #7365
Fixes: #5429
Refs: #6891

* Cover INSERT into Distributed with MATERIALIZED columns and !is_local node

I guess that adding new cluster into server-test.xml is not required,
but it won't harm.

* Update DistributedBlockOutputStream.cpp
2019-10-24 12:35:09 +03:00
Alexander Kuzmenkov
050de71ef4
Update DistributedBlockOutputStream.cpp 2019-10-24 12:33:45 +03:00
alesapin
a6199b7e69 Merge with master 2019-10-24 12:33:40 +03:00
alesapin
7edd80c9b7 Add test for existing dictionary 2019-10-24 12:25:28 +03:00
Vladimir Chebotarev
255da8f5e0 Fixed style. 2019-10-24 12:11:06 +03:00
Vladimir Chebotarev
3debdc2119 Added integration tests for ALTER MOVE PARTITION and fixed minor things. 2019-10-24 11:52:33 +03:00
Guillaume Tassery
44a69b0556 Change create database query 2019-10-24 08:23:28 +02:00
Vladimir Chebotarev
e8e5cefc35 Fixed integration test for #7414. 2019-10-24 08:59:33 +03:00
Vasily Nemkov
d6ff36c760 Merge remote-tracking branch 'upstream/master' into DateTime64 2019-10-24 07:52:50 +03:00
chertus
9818eada69 rename: merge_max_block_size 2019-10-24 02:18:21 +03:00
Artem Zuikov
18a72fa91a
Merge pull request #7392 from amosbird/scalar
better scalar query
2019-10-23 22:54:30 +03:00
Azat Khuzhin
80cf86f100 Cover INSERT into Distributed with MATERIALIZED columns and !is_local node
I guess that adding new cluster into server-test.xml is not required,
but it won't harm.
2019-10-23 21:55:08 +03:00
Azat Khuzhin
ab9d9f8997 Fix INSERT into Distributed non local node with MATERIALIZED columns
Previous patch e527def18a ("Fix INSERT
into Distributed() table with MATERIALIZED column") fixes it only for
cases when the node is local, i.e. direct insert.

This patch address the problem when the node is not local
(`is_local == false`), by erasing materialized columns on INSERT into
Distributed.

And this patch fixes two cases, depends on `insert_distributed_sync`
setting:

- `insert_distributed_sync=0`

    ```
    Not found column value in block. There are only columns: date. Stack trace:

    2. 0x7ffff7be92e0 DB::Exception::Exception() dbms/src/Common/Exception.h:27
    3. 0x7fffec5d6cf6 DB::Block::getByName(...) dbms/src/Core/Block.cpp:187
    4. 0x7fffec2fe067 DB::NativeBlockInputStream::readImpl() dbms/src/DataStreams/NativeBlockInputStream.cpp:159
    5. 0x7fffec2d223f DB::IBlockInputStream::read() dbms/src/DataStreams/IBlockInputStream.cpp:61
    6. 0x7ffff7c6d40d DB::TCPHandler::receiveData() dbms/programs/server/TCPHandler.cpp:971
    7. 0x7ffff7c6cc1d DB::TCPHandler::receivePacket() dbms/programs/server/TCPHandler.cpp:855
    8. 0x7ffff7c6a1ef DB::TCPHandler::readDataNext(unsigned long const&, int const&) dbms/programs/server/TCPHandler.cpp:406
    9. 0x7ffff7c6a41b DB::TCPHandler::readData(DB::Settings const&) dbms/programs/server/TCPHandler.cpp:437
    10. 0x7ffff7c6a5d9 DB::TCPHandler::processInsertQuery(DB::Settings const&) dbms/programs/server/TCPHandler.cpp:464
    11. 0x7ffff7c687b5 DB::TCPHandler::runImpl() dbms/programs/server/TCPHandler.cpp:257
    ```

- `insert_distributed_sync=1`

    ```
    2019.10.18 13:23:22.114578 [ 44 ] {a78f669f-0b08-4337-abf8-d31e958f6d12} <Error> executeQuery: Code: 171, e.displayText() = DB::Exception: Block structure mismatch in RemoteBlockOutputStream stream: different number of columns:
    date Date UInt16(size = 1), value Date UInt16(size = 1)
    date Date UInt16(size = 0): Insertion status:
    Wrote 1 blocks and 0 rows on shard 0 replica 0, 127.0.0.1:59000 (average 0 ms per block)
    Wrote 0 blocks and 0 rows on shard 1 replica 0, 127.0.0.2:59000 (average 2 ms per block)
     (version 19.16.1.1) (from [::1]:3624) (in query: INSERT INTO distributed_00952 VALUES ), Stack trace:

    2. 0x7ffff7be92e0 DB::Exception::Exception() dbms/src/Common/Exception.h:27
    3. 0x7fffec5da4e9 DB::checkBlockStructure<void>(...)::{...}::operator()(...) const dbms/src/Core/Block.cpp:460
    4. 0x7fffec5da671 void DB::checkBlockStructure<void>(...) dbms/src/Core/Block.cpp:467
    5. 0x7fffec5d8d58 DB::assertBlocksHaveEqualStructure(...) dbms/src/Core/Block.cpp:515
    6. 0x7fffec326630 DB::RemoteBlockOutputStream::write(DB::Block const&) dbms/src/DataStreams/RemoteBlockOutputStream.cpp:68
    7. 0x7fffe98bd154 DB::DistributedBlockOutputStream::runWritingJob(DB::DistributedBlockOutputStream::JobReplica&, DB::Block const&)::{lambda()#1}::operator()() const dbms/src/Storages/Distributed/DistributedBlockOutputStream.cpp:280
    <snip>
    ````

Fixes: #7365
Fixes: #5429
Refs: #6891
2019-10-23 21:54:27 +03:00
Artem Zuikov
bb1c1d0ed9
Merge pull request #7431 from arenadata/master
fix aggregation (avg and quantiles) over empty decimal columns.
2019-10-23 20:28:35 +03:00
chertus
20093fa065 extract more logic out of QueryNormalizer 2019-10-23 16:59:03 +03:00
Amos Bird
295864e6e0
better scalar query 2019-10-23 21:37:54 +08:00
Nikita Mikhaylov
8b17ce492f remove unused mutex 2019-10-23 16:23:42 +03:00
Nikita Mikhaylov
c867d7a306 fix max_insert_block_size 2019-10-23 16:15:03 +03:00
alesapin
c3519ff376 Better check of dictionary lifetime for updates 2019-10-23 16:02:40 +03:00
Vasily Nemkov
1a0011853e Fixed toWeek, toYearWeek, toStartOfWeek with DateTime64 2019-10-23 15:27:36 +03:00
Mikhail Korotov
09847b21f2
Update config_without_allowed_hosts.xml 2019-10-23 15:05:53 +03:00
Mikhail Korotov
868407d83f
Update config_with_only_regexp_hosts.xml 2019-10-23 15:05:32 +03:00
Mikhail Korotov
bdd505acbd
Update config_with_hosts.xml 2019-10-23 15:05:00 +03:00
Mikhail Korotov
3e53a9e78b
Update config_with_hosts.xml 2019-10-23 15:04:17 +03:00
Mikhail Korotov
895392668a
Update config_without_allowed_hosts.xml 2019-10-23 15:03:10 +03:00
Mikhail Korotov
b8763763f7
Update config_with_only_regexp_hosts.xml 2019-10-23 15:02:50 +03:00
Mikhail Korotov
c8220b7876
Update config_with_only_primary_hosts.xml 2019-10-23 15:02:19 +03:00
Mikhail Korotov
20caa8724c
Delete ReadWriteBufferFromHTTPWithHostFilter.h 2019-10-23 15:00:43 +03:00
Mikhail Korotov
717d88df45
Delete ReadWriteBufferFromHTTPWithHostFilter.cpp 2019-10-23 15:00:04 +03:00
millb
eca81dc32e Fixed bugs 2019-10-23 14:58:35 +03:00
Vladimir Chebotarev
7546c315a6 Added integration test for #7414. 2019-10-23 14:25:51 +03:00
stavrolia
22e960dbff Move initialisation of constants 2019-10-23 13:55:44 +03:00
Nikita Mikhaylov
31b69285fa fix data race on vector<bool> 2019-10-23 13:39:33 +03:00
Alexander Kuzmenkov
1a609c27bd
Merge pull request #6243 from ClickHouse/aku/hashtables
Introduce String Hash Map to speed up aggregation over short string keys.
2019-10-23 12:52:50 +03:00
alesapin
6a0246f58e Fix if 2019-10-23 12:40:09 +03:00
alesapin
0abb2e538b Remove strange logic 2019-10-23 12:36:20 +03:00
alesapin
fb349757ba Fix ubsan error 2019-10-23 12:27:34 +03:00
akonyaev
7426542b8b up precision for avg result to max of type 2019-10-23 11:22:51 +03:00
Guillaume Tassery
c33d55f00b add clickhouse db 2019-10-23 09:36:11 +02:00
Guillaume Tassery
2f99065377 syntax error 2019-10-23 08:14:44 +02:00
Guillaume Tassery
c42d8a4c23 fix syntax error 2019-10-23 06:39:44 +02:00
alexey-milovidov
5c73a75843
Merge pull request #7439 from volfco/master
Fixed spelling error in error message
2019-10-23 07:33:56 +03:00
alexey-milovidov
ffc2e4e149
Merge pull request #7396 from nvartolomei/nv/mv-extra-columns
Test materialized view pushing extra columns
2019-10-23 07:30:53 +03:00
alexey-milovidov
bd31ed3a20
Merge pull request #7418 from amosbird/addglob
Better add_globs
2019-10-23 07:28:13 +03:00
alexey-milovidov
44d2e1d27c
Merge pull request #7419 from amosbird/dump2
Resolve DUMP overload resolution ambiguity.
2019-10-23 07:19:38 +03:00
alexey-milovidov
f8d408e8f4
Merge pull request #7423 from excitoon/patch-1
Fixed erroneous warning `max_data_part_size is too low`
2019-10-23 07:17:33 +03:00
Nikolai Kochetov
9abab40512 Added more comments. 2019-10-23 06:45:43 +03:00
Nikita Mikhaylov
905a65b3d0 some changes after review 2019-10-22 21:01:44 +03:00
Colum
a413770a97 Fixed spelling error in error message 2019-10-22 10:02:51 -07:00
alesapin
c12014ca15 Fix shared build 2019-10-22 19:47:11 +03:00
alesapin
dfa9b0c149 Remove complex logic with lazy load 2019-10-22 19:26:15 +03:00
Nikolai Kochetov
e22b43c669
Merge pull request #7436 from amosbird/scalarperf
add perf test for subqueries with large scalars
2019-10-22 19:06:20 +03:00
Amos Bird
dd72f62f17
add perf test for subqueries with large scalars 2019-10-22 23:55:11 +08:00
akonyaev
6d0dbf7e95 add test returned datatype from quantile and median result for empty decimal data 2019-10-22 18:51:34 +03:00
Vasily Nemkov
f8170e8973 Reverted modifications of now.cpp 2019-10-22 18:37:43 +03:00
akonyaev
71dd3a303e fix result type for avg aggregation 2019-10-22 18:31:56 +03:00
Vladimir Chebotarev
9446fd2c4d Allowed to have some parts on destination disk or volume in MOVE PARTITION. #7424 2019-10-22 17:45:01 +03:00
Nikolai Kochetov
bcc4c2f0af Disable processors by default. 2019-10-22 17:11:29 +03:00
Nikolai Kochetov
640da3f512 Try to fix AggregateFunctionGroupBitmap. 2019-10-22 16:59:13 +03:00
alesapin
dc6090a2ac More readable code in external loader 2019-10-22 16:41:17 +03:00
alesapin
ae42dd1cea Better doLoading locking logic 2019-10-22 15:57:58 +03:00
Nikita Mikhaylov
34d8ade4a0 Merge branch 'master' of github.com:ClickHouse/ClickHouse into parallel_parsing 2019-10-22 15:56:51 +03:00
akonyaev
6655eb6358 fix 2019-10-22 15:34:36 +03:00
akonyaev
dc7c4c1b9a add tests for aggregation over empty decimal table 2019-10-22 15:30:00 +03:00
Guillaume Tassery
5600af3391 Add move partition consistency tests 2019-10-22 13:45:11 +02:00
alesapin
d3461f9d46 TODO comments 2019-10-22 14:03:16 +03:00
alesapin
99fac92b1d Fix comment 2019-10-22 13:49:11 +03:00
alesapin
4c5d150d7a Review fixes 2019-10-22 13:47:43 +03:00
Alexander Kuzmenkov
dfd9f26652 Port the latest dispatch() improvements. 2019-10-22 13:44:08 +03:00
Ivan
7ba4e36e73
Don't push to MVs when inserting into Kafka table (#7265)
* Do not insert values into MV when inserting directly to Kafka
* Add method noPushingToViews() to IStorage interface
  To separate InterpreterInsertQuery and StorageKafka
2019-10-22 13:31:28 +03:00
Vladimir Chebotarev
395e63ddf1
Fixed erroneous warning max_data_part_size is too low #7414 2019-10-22 12:24:30 +03:00
Alexander Kuzmenkov
be4618dd05
Merge pull request #7339 from amosbird/f10
Fix preciseExp10
2019-10-22 12:00:53 +03:00
Vasily Nemkov
aa0de4a0c8 Minor non-functional test fixes. 2019-10-22 10:45:00 +03:00
Vasily Nemkov
06255a9b9f DateTime64 toStartOfInterval fix 2019-10-22 10:43:14 +03:00
Guillaume Tassery
3dee295f9a Set neutral lock 2019-10-22 09:15:58 +02:00
Amos Bird
88834bd75a
Resolve DUMP overload resolution ambiguity. 2019-10-22 15:10:59 +08:00
Amos Bird
82d0dfa629
Better add_globs 2019-10-22 15:09:49 +08:00
Guillaume Tassery
d38bc27c05 put back lock 2019-10-22 08:30:51 +02:00
Guillaume Tassery
552e3b8400 update 2019-10-22 08:03:49 +02:00
hcz
d877ef6098 Merge remote-tracking branch 'hcz/patch-1018' into patch-1018 2019-10-22 11:31:23 +08:00
memo
645bcdacae add docs and simplify the code 2019-10-22 10:23:07 +08:00
Nikolai Kochetov
dad1e397e2 Fix build. 2019-10-22 02:51:36 +03:00
Nikolai Kochetov
e7ba48ee84 Fix build. 2019-10-22 02:49:44 +03:00
Artem Zuikov
21e4535fbd
Merge pull request #7411 from 4ertus2/some
Minor Visitors Improvement
2019-10-21 23:17:05 +03:00
Vitaly Baranov
f611fd4dfa
Merge pull request #7293 from Vdimir/feature/isvalidjson-5910
Add function isValidJSON
2019-10-21 21:24:18 +03:00
chertus
f024b007a2 default_merge_block_size setting 2019-10-21 20:57:26 +03:00
alesapin
83dbfe9634 New tests and fixes for them 2019-10-21 20:09:41 +03:00
Nikolai Kochetov
2b334a4adb Review fixes. 2019-10-21 19:26:29 +03:00
Mikhail Korotov
5d195ad233
Update ReadWriteBufferFromHTTPWithHostFilter.cpp 2019-10-21 19:24:39 +03:00
chertus
851b00c99f minor visitors improvement 2019-10-21 19:22:54 +03:00
Alexander Kuzmenkov
9c1f8109c7
Merge pull request #7402 from Enmk/odbc_bridge_nullable_fix
Fixed NULL-values in nullable columns through ODBC-bridge
2019-10-21 19:09:27 +03:00
Amos Bird
a860ee7891
Fix preciseExp10 2019-10-22 00:05:57 +08:00
alesapin
10f69eef03 Add tests for non standart dictionaries and fix bugs 2019-10-21 19:05:45 +03:00
Nikolai Kochetov
2893c35930 Merged with master. 2019-10-21 18:33:44 +03:00
Nikolai Kochetov
4ca83a8eb5 Disable processors by default. 2019-10-21 18:24:15 +03:00
Nikolai Kochetov
f7d2e1b758 Added Pipe class. Updated MergeTreeDataSelectExecutor. 2019-10-21 18:16:08 +03:00
alesapin
ff7850cfbd Remove strange code in favor of less strange code 2019-10-21 17:59:35 +03:00
Alexander Kuzmenkov
d865aeba9b Review fixes. 2019-10-21 17:54:53 +03:00
millb
8b8ca9a141 Support redirect improvement 2019-10-21 17:45:57 +03:00
alesapin
307f711500 Fix db mysql dictionaries iterator 2019-10-21 17:25:21 +03:00
alesapin
f7043c38bd Less diff 2019-10-21 17:20:42 +03:00
alesapin
fc05110d66 Better naming 2019-10-21 17:07:47 +03:00
Vasily Nemkov
426e65f0fa C-tors to copy TimeZone from another instance of DateTime or DateTime64 2019-10-21 17:05:52 +03:00
Vasily Nemkov
aa6ea037f4 Minor fixes to the tests 2019-10-21 17:04:01 +03:00
alesapin
17c2f301e2 Remove accident cerr 2019-10-21 17:00:18 +03:00
alesapin
e4a936cf41 Fix add and reload 2019-10-21 16:54:23 +03:00
Vitaly Baranov
a0ca932035
Fix build and add comments. 2019-10-21 16:39:55 +03:00
Amos Bird
a864447802 Introduce String Hash Map.
It speeds up aggregation over short string keys. Use it as a default
aggregation method for string keys.
2019-10-21 16:27:35 +03:00
akonyaev
f6bb52637d return for empty avg result over decimal 0 in ResultT type 2019-10-21 16:05:32 +03:00
robot-clickhouse
7381489d5d Auto version update to [19.17.1.1] [54428] 2019-10-21 15:48:00 +03:00
robot-clickhouse
c70cd3dd17 Auto version update to [19.16.1.1532] [54427] 2019-10-21 15:47:27 +03:00
akonyaev
28710b7e42 unexpected behaviour for avg and quantile functions over empty decimal column without group by 2019-10-21 15:46:47 +03:00
chertus
4f0859a5fa Merge branch 'master' into ast 2019-10-21 15:08:05 +03:00
Vasily Nemkov
f1a438ca63 Tests for DateTime64 2019-10-21 14:46:38 +03:00
chertus
0d708569e3 fix test result (disabled push down) 2019-10-21 14:31:16 +03:00
chertus
5ef7376cbf fix distributed join on 2019-10-21 14:22:22 +03:00
millb
e6d0c2a66c Redirect support added 2019-10-21 12:42:28 +03:00
stavrolia
fdaacb5645 Fix test 2019-10-21 12:37:50 +03:00
Vasily Nemkov
e080324fd0 Fixed NULL-values in nullable columns through ODBC-bridge 2019-10-21 12:13:33 +03:00
alesapin
26c87e46c9 Merge branch 'master' into dictionaries_ddl_loader 2019-10-21 11:46:49 +03:00
alesapin
35e66d6696 Merge with master 2019-10-21 11:46:11 +03:00
millb
f64f6658ce Merge branch 'master' into url_engine_problem 2019-10-21 11:44:31 +03:00
millb
2a183c3d07 Merge branch 'master' into decimal_hex_function 2019-10-21 11:13:51 +03:00
hcz
79a27ece1a Flip the condition column in arrayFill 2019-10-21 11:19:11 +08:00
stavrolia
40688294b0 another attempt to fix clang warning 2019-10-21 01:56:22 +03:00
alexey-milovidov
61125e536b
Update 01019_materialized_view_select_extra_columns.sql 2019-10-20 17:59:26 +03:00
alexey-milovidov
8b8cc67873
Merge pull request #7390 from azat/processlist-log-queue_max_wait_ms
Add a message in case of queue_wait_max_ms wait takes place
2019-10-20 17:55:36 +03:00
Nicolae Vartolomei
b0f2f23a38 Test materialized view pushing extra columns
This test exists to prevent unintended changes to existing behaviour.

Although this behaviour might not be ideal it is can be exploited for 0-downtime changes to materialized views.

Step 1: Add new column to source table.
Step 2: Create new view reading source column.
Step 3: Swap views using `RENAME TABLE`.
Step 4: Add new column to destination table as well.
2019-10-20 10:26:44 +01:00
Aleksey Akulovich
a019e45093 fix typos in docs and comment (#7385) 2019-10-20 12:43:54 +08:00
philip.han
5e32bf1ae7 Removed unchecked type-casting 2019-10-19 21:42:08 +09:00
VDimir
797f76a187 Separate class for IsValidJSONImpl 2019-10-19 07:26:19 +00:00
alexey-milovidov
52bfa9927c
Merge pull request #7384 from ClickHouse/fix_ub_in_system_parts
Fix UB in StoragesInfoStream
2019-10-19 09:59:39 +03:00
VDimir
f1630b4e2e Merge branch 'master' into feature/isvalidjson-5910 2019-10-19 06:21:21 +00:00
Azat Khuzhin
260a9fba2b StorageDistributed: Drop extra inclusion of materializeBlock.h 2019-10-18 23:38:33 +03:00
Azat Khuzhin
94948c2579 Add a message in case of queue_wait_max_ms wait takes place
Since there no information about this, while this can be interesting,
for example to tune max_concurrent_queries in some cases.
2019-10-18 23:36:12 +03:00
chertus
c5a850240c better ambiguous column detection in multiple join rewriter 2019-10-18 20:09:17 +03:00
chertus
37f07213ee better test 2019-10-18 19:45:59 +03:00
chertus
1bb8174285 disable push down for CROSS JOIN tests 2019-10-18 19:34:06 +03:00
chertus
2533652847 columns match priority: table alias > table name> aliased table name 2019-10-18 19:16:57 +03:00
alesapin
a014924c19 Remove wrong tests 2019-10-18 19:04:12 +03:00
alesapin
cdc195727e Fix some races from lazy load and add ugly interface to loader (need to be refactored) 2019-10-18 19:04:09 +03:00
Alexander Kuzmenkov
5e2cc37381
Distinguish Array and Tuple field types when creating from array of Fields. (#7179) 2019-10-18 18:57:05 +03:00
stavrolia
1397a90324 Fix test and clang warning 2019-10-18 18:03:15 +03:00
hcz
2be06255b1
Update arrayFill.cpp 2019-10-18 21:31:18 +08:00
Alexander Tokmakov
06b28f9fe3 fix uninitialized offset for Lazy db 2019-10-18 16:09:24 +03:00
Alexander Kuzmenkov
3143fa37d7
Merge pull request #7371 from CurtizJ/fix-optimize-read-in-order
Fix optimize_read_in_order with IN and a subquery.
2019-10-18 15:55:53 +03:00
philip.han
5f1b14e313 Remove a dynamically sized array in BloomFilterHash.h 2019-10-18 19:39:10 +09:00
hcz
502672c973 Add aggregate function combinators: -OrNull & -OrDefault (#7331) 2019-10-18 12:25:39 +03:00
alesapin
71cbe878fc
Merge pull request #7374 from millb/fixed_getMultipleValuesFromConfig
Fixed function getMultipleValuesFromConfig
2019-10-18 11:55:41 +03:00
hcz
b87fe27cd6 Add tests 2019-10-18 16:45:56 +08:00
hcz
124ea9699a Add arrayFill 2019-10-18 16:45:39 +08:00
hcz
decd555317 Cleanup, keep function names consistent 2019-10-18 15:30:41 +08:00
alexey-milovidov
3803d94db6
Merge pull request #7376 from amosbird/helpakuzm
Fix ubsan introduced by Field refactoring.
2019-10-18 06:29:27 +03:00
philip.han
1d423fad73 Blocked "nested-array-type" for the bloom_filter 2019-10-18 11:55:01 +09:00
chertus
0f6176cc2d throw on ambiguous qualified column 2019-10-18 00:08:28 +03:00
Mikhail Korotov
a1f417a537
Update gtest_getMultipleValuesFromConfig.cpp 2019-10-18 00:07:27 +03:00
Amos Bird
16d1b4472e Fix ubsan introduced by Field refactoring. 2019-10-18 04:30:33 +08:00
alesapin
b222ec1209 Fix segmentation fault 2019-10-17 20:53:08 +03:00
alesapin
c29b39002d Fix race condition, add test 2019-10-17 20:36:53 +03:00
alesapin
05392fd882 Fix deadlock, add test and refactoring 2019-10-17 20:18:54 +03:00
millb
26d9ee3ae5 Fixed bug with function getMultipleValuesFromConfig and added test which confirms this. 2019-10-17 19:52:47 +03:00
vzakaznikov
66675edf2d Fixing data race with no_users_thread. (#7353) 2019-10-17 17:47:36 +03:00
vzakaznikov
ee1a2ce027 Fixing AddressSanitizer error in the LIVE VIEW getHeader() method. (#7271) 2019-10-17 17:43:11 +03:00
tavplubix
0046b9f137 Wait for jobs to finish on exception (fixes rare segfaults) (#7350) 2019-10-17 17:41:27 +03:00
Alexander Kuzmenkov
b62c9e729d
Merge pull request #7215 from ClickHouse/formats_improvements
Miscellaneous formats improvements
2019-10-17 17:37:38 +03:00
Alexander Kuzmenkov
3e662da6f4
Merge pull request #7351 from Enmk/http_keep_alive_timeout
Fixed issue of using HTTP timeout as TCP timeout value.
2019-10-17 16:14:29 +03:00
CurtizJ
546414c015 fix optimize_read_in_order with in subquery 2019-10-17 16:11:27 +03:00
akonyaev
22429a699e unexpected behaviour for avg over empty decimal column without group by 2019-10-17 16:08:04 +03:00
alesapin
6dfe5c7142 Better introspection 2019-10-17 16:05:12 +03:00
Ivan
e595df05d9
Fix CREATE TABLE AS from table with virtual columns (#7183)
* Disable undefined instrumentation for rdkafka
2019-10-17 14:12:35 +03:00
philip.han
8aac4d04de Fixed weird type-casting for IN-operator in bloom_filter 2019-10-17 19:53:41 +09:00
Alexander Kuzmenkov
e9d7da3dd4
Merge pull request #7359 from amosbird/joingetconst
Constness-aware JoinGet.
2019-10-17 13:35:37 +03:00
philip.han
08a348fbd1 Made IN operator support Array(LowCardinality(Nullable(String))) 2019-10-17 19:08:36 +09:00
alesapin
3987a45ea2 Fix build and style 2019-10-17 12:05:48 +03:00
stavrolia
688ec20de1 Fix style from clang warnings 2019-10-17 09:28:26 +03:00
memo
ef09cedbb8 fix test bug 2019-10-17 11:38:49 +08:00
Amos Bird
89247deb64 Constness-aware JoinGet. 2019-10-17 08:52:28 +08:00
tavplubix
c4b46e113e
Merge branch 'master' into formats_improvements 2019-10-16 23:00:17 +03:00
Alexander Tokmakov
e9e8d055af null_as_default for Values 2019-10-16 22:55:24 +03:00
stavrolia
65efaf7ac7 Delete macros 2019-10-16 22:52:35 +03:00
Alexander Tokmakov
102cbfd25a fix old bug with default values 2019-10-16 22:27:33 +03:00
Vladimir Chebotarev
512e97ddb3
Improved readability a little bit (MergeTreeData::getActiveContainingPart). 2019-10-16 22:01:50 +03:00
Vasily Nemkov
1f196a52c4 SImplified code, updated tests. 2019-10-16 22:01:21 +03:00
alesapin
842a31be8b More tests 2019-10-16 20:59:10 +03:00
alesapin
a19a699bef Fix confused variables 2019-10-16 20:52:56 +03:00
stavrolia
fdad33fcd0 Fix style 2019-10-16 20:43:44 +03:00
chertus
483108f46f column to table matching refactoring 2019-10-16 20:33:53 +03:00
stavrolia
ae2f5ad7d2 Speedup 2019-10-16 20:25:46 +03:00
alesapin
51de7a1cd1 Better tests 2019-10-16 20:12:53 +03:00
alesapin
fa557ab80d Better tests 2019-10-16 20:11:19 +03:00
alesapin
01e23f0a22 Better load of dictionaries 2019-10-16 20:06:52 +03:00
Alexander Tokmakov
5f6703130e fixes 2019-10-16 18:28:48 +03:00
millb
19a54a59bb Created: function hex for Decimal32, Decimal64, Decimal128 2019-10-16 18:28:10 +03:00
alesapin
b4e0ded048 Almost working 2019-10-16 17:59:52 +03:00
chertus
e6e88241fc SyntaxAnalyzer refactoring: better getTablesWithColumns() 2019-10-16 17:47:58 +03:00
Alexander Tokmakov
aa9d29d6ae Merge branch 'master' into formats_improvements 2019-10-16 17:15:13 +03:00
Alexander Kuzmenkov
91b995212f
Merge pull request #7343 from amosbird/bf10
Build fix
2019-10-16 16:59:46 +03:00
Vasily Nemkov
de1dfd7418 tests for getLeastSupertype and getMostSubtype 2019-10-16 16:57:10 +03:00
Vasily Nemkov
94095fcb92 Fixed issue of using HTTP timeout as TCP timeout value. 2019-10-16 16:04:26 +03:00
Alexander Kuzmenkov
16f252dce9
Merge pull request #7332 from Enmk/More_Date_and_DateTime_performance_tests
More performance test for Date and DateTime
2019-10-16 16:03:54 +03:00
Artem Zuikov
b70ca30447
Merge pull request #7335 from 4ertus2/ast
Remove asterisk_left_columns_only setting
2019-10-16 13:57:17 +03:00
Artem Zuikov
3ceeb95145
Merge pull request #7282 from 4ertus2/asof
ASOF JOIN inequalities
2019-10-16 13:46:52 +03:00
Vasily Nemkov
6280ea086f Enabled toDateTime64 2019-10-16 10:26:28 +03:00
Vasily Nemkov
237591d7d9 Fixed comparison of DateTime64 and Date 2019-10-16 10:24:48 +03:00
philip.han
a2bf848e12 Made bloom_filter type of index supporting LowCardinality and Nullable 2019-10-16 15:22:56 +09:00
memo
947c345eda style: Normalize the format 2019-10-16 14:05:43 +08:00
Amos Bird
dd128e9e1d Build fix 2019-10-16 10:49:29 +08:00
alesapin
e690a3ca32 Half working code 2019-10-15 21:04:17 +03:00
chertus
ccc8c1ad2a restore logic for array join (it's probably a hidden error) 2019-10-15 20:39:23 +03:00
Artem Zuikov
cf99f88bc4 PartialMergeJoin flush data on disk (#7186) 2019-10-15 19:31:49 +03:00
chertus
c727777a9c resolve some for review sentences 2019-10-15 18:49:00 +03:00
chertus
9667e54201 remove asterisk_left_columns_only setting 2019-10-15 17:42:57 +03:00
alesapin
3e068b81de Add loading of external dictionaries 2019-10-15 17:09:57 +03:00
Vasily Nemkov
48b3c21aaa More performance test for Date and DateTime
Added cases for:
 * binary operations: -,+,>,>=,<,<=,==,!=
 * previously-missing functions: timeSlot, toRelativeQuarterNum, toStartOfTenMinutes, toUnixTimestamp, addYears (and alike).
2019-10-15 15:20:54 +03:00
alesapin
f850408ae4 Convert AST to Abstract configuration 2019-10-15 15:16:19 +03:00
memo
8b1b7f2a5f add arrayCompact test 2019-10-15 16:09:10 +08:00
memo
d1fb238820 implement arrayCompact 2019-10-15 15:50:10 +08:00
alexey-milovidov
6a44336b86
Merge pull request #7304 from sundy-li/ttl_check
Check TTL in StorageFactory
2019-10-14 20:11:37 +03:00
Alexander Kuzmenkov
831fb2cbfd
Merge pull request #7283 from ClickHouse/aku/in-unconvertible
Ignore non-convertible values at any depth on the right side of the IN operator
2019-10-14 18:32:22 +03:00
Nikolai Kochetov
5364f76625 Fix build. 2019-10-14 16:50:16 +03:00
Vasily Nemkov
9f9fcb1add Simplified argument type validation for conversion functions. 2019-10-14 16:28:52 +03:00
Alexander Kuzmenkov
160d8a6416 Ignore non-convertible values at any depth on the right side of IN
operator.

The values that are not convertible to the left argument type can't
match anyway, so it is safe to discard them.
2019-10-14 14:25:03 +03:00
stavrolia
5c15594672 Add performance test 2019-10-14 13:13:32 +03:00
alesapin
1ce0eb6e63 Appropriate error codes numbers 2019-10-14 13:04:10 +03:00
alesapin
ecde224692 More tests 2019-10-14 12:52:43 +03:00
alexey-milovidov
f0409348a1
Merge pull request #7294 from hczhcz/patch-1013
Add arraySplit
2019-10-14 12:32:09 +03:00
alesapin
67ea66604f Fix segmentation fault in database factory 2019-10-14 12:21:29 +03:00
sundy-li
b2109e4ece Check TTL in StorageFactory 2019-10-14 17:03:39 +08:00
Danila Kutenin
19ecc3e6cf
Merge pull request #7299 from ClickHouse/multi_match_all_indices
Add multi{Fuzzy}MatchAllIndices functions
2019-10-14 10:58:27 +02:00
Danila Kutenin
60d273a65d Get better message for non hyperscan supported platforms 2019-10-14 10:58:05 +02:00
alesapin
155731a676 Merge branch 'master' into dictionaries_ddl_interpreter 2019-10-14 11:49:18 +03:00
Vasily Nemkov
db166af95a Moved DataTypeDateTime64 and now64() to separate source files. 2019-10-14 11:38:03 +03:00
alexey-milovidov
323a756115
Merge pull request #7298 from Vdimir/feature/count-arity-validation-7095
Add missing arity validation for count/counIf
2019-10-14 08:52:58 +03:00
Danila Kutenin
7527896f1a Unused variables 2019-10-13 21:40:07 +02:00
VDimir
7adad4251f Remove AggregateFunctionCountNotNullVariadic 2019-10-13 18:42:39 +00:00
VDimir
99f531c58f Fix spelling require -> requires 2019-10-13 18:37:01 +00:00
Danila Kutenin
57f20ba17e All multi{Fuzzy}MatchAllIndices functions 2019-10-13 15:22:09 +02:00
hcz
c8c40e159d Add arraySplit 2019-10-13 16:06:57 +08:00
Nikolai Kochetov
7c2575542b Fix build. 2019-10-12 21:52:20 +03:00
Nikolai Kochetov
22dfc611c9 Remove comments from test. 2019-10-12 21:49:25 +03:00
alexey-milovidov
4dffc67434
Merge pull request #7291 from sundy-li/FQDN
Function FQDN, fullHostName
2019-10-12 20:02:22 +03:00
alexey-milovidov
62c7c50aba
Update FunctionsJSON.h 2019-10-12 20:00:32 +03:00
Nikolai Kochetov
757488369f Merge branch 'master' into processors-3 2019-10-12 19:24:02 +03:00
Nikolai Kochetov
51bce40d5e
Merge pull request #7284 from ClickHouse/fix-7216
Fix for #7216
2019-10-12 19:20:33 +03:00
VDimir
0230aca903 Remove tests with count accepting 2 args 2019-10-12 15:44:14 +00:00
VDimir
853322503f Allow count function arity at most one 2019-10-12 15:15:16 +00:00
Nikolai Kochetov
6f758babf6
Merge pull request #7289 from infinivision/fix_pull_7109
Fixed #7109 groupBitmapOr(31) segfault
2019-10-12 16:42:11 +03:00
Alexander Kuzmenkov
31bd359100
Merge pull request #7231 from ClickHouse/aku/podarray-includes
Include PODArray.h into fewer files.
2019-10-12 15:08:41 +03:00
VDimir
1174fc346b Add isValidJSON function 2019-10-12 11:42:43 +00:00
Nikolai Kochetov
25510e3d38 Try to fix perftests. 2019-10-12 13:06:07 +03:00
sundy-li
4e48992397 fullHostName by function getFQDNOrHostName 2019-10-12 17:21:30 +08:00
sundy-li
59d2989826 Function FQDN,fullHostName 2019-10-12 15:17:30 +08:00
Vasily Nemkov
8648ebf75c Initial implementation of DateTime64 parsing functions; 2019-10-12 10:03:38 +03:00
Zhichang Yu
679db35ed3 Fixed #7109 groupBitmapOr(31) segfault 2019-10-12 10:36:52 +08:00
alesapin
aeb7504570
Merge pull request #7277 from ClickHouse/client-params-for-tests
Client parameters for clickhouse-test
2019-10-11 22:33:32 +03:00
Nikolai Kochetov
8186644562 Update test. 2019-10-11 21:04:58 +03:00
Nikolai Kochetov
4967bcdbd0 Fix test. 2019-10-11 21:02:34 +03:00
chertus
91c7ae83a3 asof join inequalities 2019-10-11 20:56:26 +03:00
Nikolai Kochetov
217eab0cfa Fix test. 2019-10-11 20:55:33 +03:00
Nikolai Kochetov
2684bd0d5e Fixes for 7216 2019-10-11 20:27:54 +03:00
Nikolai Kochetov
e5c8a62142 Fix tests. 2019-10-11 20:24:18 +03:00
Nikolai Kochetov
bf794a8260 Fix tests. 2019-10-11 18:59:27 +03:00
alesapin
653aa7c005 Fix unit tests and segfault 2019-10-11 18:41:52 +03:00
alesapin
967fe64793 Add simpliest tests 2019-10-11 18:22:30 +03:00
Vitaly Baranov
8c24d5e66a
Merge pull request #7235 from vitlibar/RBAC-1
RBAC-1
2019-10-11 17:16:32 +03:00
alesapin
dca0798d4d Compilable code 2019-10-11 16:51:31 +03:00
Nikolai Kochetov
10366f79ae Update url params in shell_config and tests.] 2019-10-11 16:34:26 +03:00
alesapin
ae42dc0d4c Attach detach and introspection queries for dictionaries 2019-10-11 16:21:52 +03:00
Nikolai Kochetov
2ecf7abf6c Update url params in shell_config. 2019-10-11 15:08:11 +03:00
Alexander Kuzmenkov
57b5592236 Work around garbage in roaring.h to fix Mac OS build. 2019-10-11 14:28:16 +03:00
Alexander Kuzmenkov
8a1d57bddb Include PODArray.h into fewer files. 2019-10-11 14:28:16 +03:00
Guillaume Tassery
88491abd7b add tests 2019-10-11 12:42:25 +02:00
Nikolai Kochetov
48bfcab428 Add ability to specify arguments to client in functional tests. 2019-10-11 13:30:32 +03:00
Vitaly Baranov
9e3815ccef Fix ubsan issue. 2019-10-11 12:53:10 +03:00
alesapin
3dfe961291 Merge branch 'master' into dictionaries_ddl_interpreter 2019-10-11 12:14:07 +03:00
alesapin
7159cde160 Remove accident change 2019-10-11 12:07:44 +03:00
alesapin
77c6d4d48f Changes 2019-10-11 12:05:12 +03:00
Nikolai Kochetov
89dfe7882d Enable processors by default. 2019-10-11 11:55:00 +03:00
Guillaume Tassery
c91f5fbd6d sync 2019-10-11 10:42:43 +02:00
Vasily Nemkov
b6b080745b TMP: stashing tmp changes on test environment 2019-10-11 11:12:45 +03:00
Guillaume Tassery
145df0bb65 Fix lock 2019-10-11 08:11:53 +02:00
Vitaly Baranov
060257c8c5 Remove Authentication::setType() function and fix comments. 2019-10-11 00:48:36 +03:00
Nikolai Kochetov
e48755d045 Merge branch 'master' into processors-and-storages 2019-10-11 00:46:37 +03:00
Nikolai Kochetov
9a89ee8eab
Merge pull request #7264 from ClickHouse/disable-memory-tracker-for-stack-trace
Disable memory tracker for exception stack.
2019-10-11 00:45:36 +03:00
Vitaly Baranov
18ccb4d64d Move backQuote() and quoteString() to a separate file, use StringRefs. 2019-10-11 00:18:52 +03:00
Vitaly Baranov
9f6d9d6130 Move the code which checks client host to a separate class. 2019-10-11 00:18:52 +03:00
Vitaly Baranov
12d1d87d64 Move authentication code to a separate class. 2019-10-11 00:18:52 +03:00
Nikolai Kochetov
a15d8f36d5
Merge pull request #7270 from azat/uniqCombined-memory-usage-tests-fixes
uniqCombined memory usage tests fixes
2019-10-10 23:53:55 +03:00
alesapin
2a5713e6e4 Compilable code 2019-10-10 23:47:47 +03:00
Nikolai Kochetov
0ce86e1f8f Disable memory tracker for exception stack. 2019-10-10 21:55:16 +03:00
Azat Khuzhin
e25bdc8d25 tests/00212_shard_aggregate_function_uniq: adjust values for uniqCombined(12)(String)
In e373862c83 the maxium size for HashTable in
CombinedCardinalityEstimator had been reduced for power of 2 for String
(since otherwise the size of the hashtable becames bigger then the
sizeof HLL).

Refs: https://github.com/ClickHouse/ClickHouse/pull/7236#issuecomment-540496270
Fixes: e373862c83 ("Do not use more then 98K of memory for uniqCombined*")
2019-10-10 21:47:51 +03:00
Azat Khuzhin
eb7d4797e3 tests/00212_shard_aggregate_function_uniq: break into sections 2019-10-10 21:47:51 +03:00
Azat Khuzhin
495d1de46f clickhouse-test: introduce -U/--unified option (pass to diff(1)) 2019-10-10 21:47:51 +03:00
alexey-milovidov
9c1c596146
Merge pull request #7252 from ClickHouse/fix-bad-code-in-transform-query-for-external-database
Fix bad code in transforming query for external database.
2019-10-10 21:10:36 +03:00
Nikolai Kochetov
f011c1020e Disable memory tracker for exception stack. 2019-10-10 20:37:34 +03:00
alesapin
67fc3347c2 Preparing databases for dictionaries 2019-10-10 20:33:01 +03:00
Vasily Nemkov
a6b20e8ca3 Minor simplification on FunctionDateOrDateTimeAddInterval::TransformResultDataType and FunctionDateOrDateTimeAddInterval::resolveReturnType 2019-10-10 20:05:29 +03:00
Nikolai Kochetov
742b948156 Disable memory tracker for exception stack. 2019-10-10 19:30:33 +03:00
Alexander Kazakov
03c7b7ff8d
Prevent from using non-deterministic functions in mutations of replicated tables (#7247)
* Added isDeterministic() to IFunctionBuilder i-face
* A test for non-deterministic mutations
* In MutationsInterpreter::validate() ensure deterministic functions
* Adjusted nondeterministic mutation tests
* Moved around some code in MutationsInterpreter::validate()
* Dropped unnecessary check in findFirstNonDeterministicFuncName()
* Corrections to IFunction{Base,Builder} interface
2019-10-10 17:38:08 +03:00
Nikolai Kochetov
ef14df4632 Added more comments. 2019-10-10 17:16:15 +03:00
Mikhail Korotov
7b62fc68cf
Update RemoteHostFilter.cpp 2019-10-10 16:53:52 +03:00
Mikhail Korotov
375866936d
Update RemoteHostFilter.h 2019-10-10 16:53:26 +03:00
Vasily Nemkov
fb4dbf94e9 Simplified customizing add/substract-Interval functions for DateTime64 2019-10-10 16:49:40 +03:00
millb
350f0b8a1c Merge remote-tracking branch 'origin/url_engine_problem' into url_engine_problem 2019-10-10 16:47:17 +03:00
Mikhail Korotov
70234975d1
Delete StorageOfAllowedURL.h 2019-10-10 16:13:44 +03:00
Mikhail Korotov
7f73af0cc9
Delete StorageOfAllowedURL.cpp 2019-10-10 16:13:33 +03:00
millb
a00089f0b4 Renamed StorageOfAllowedURL -> RemoteHostFilter 2019-10-10 15:58:06 +03:00
Nikolai Kochetov
378052743d Fix MergeTreeSequentialBlockInputStream. 2019-10-10 14:24:29 +03:00
Nikolai Kochetov
4728bdfccd Fix MergeTreeSequentialBlockInputStream. 2019-10-10 14:20:25 +03:00
alesapin
51c8188903
Merge pull request #7253 from ClickHouse/dictionaries_ddl_parser
Refactor parser create query
2019-10-10 11:34:21 +03:00
Mikhail Korotov
8d675ad2b4
Update TableFunctionRemote.cpp 2019-10-10 01:25:39 +03:00
Mikhail Korotov
b1c6fb571e
Update TableFunctionRemote.cpp 2019-10-10 01:25:17 +03:00
Mikhail Korotov
4710d2184c
Update Context.cpp 2019-10-10 01:24:27 +03:00
Mikhail Korotov
af8b20f0af
Update StorageOfAllowedURL.h 2019-10-10 01:23:31 +03:00
Mikhail Korotov
56cdc03b0b
Update StorageOfAllowedURL.cpp 2019-10-10 01:23:12 +03:00
Mikhail Korotov
769ec9ea6c
Update config.xml 2019-10-10 01:22:05 +03:00
alesapin
777ba2e47e Remove some code 2019-10-10 00:31:29 +03:00
millb
a97739f67f Created class StorageOfAllowedURL
Created test for table function remote and remoteSecure
Created check allowed url in remote and remoteSecure
Fixed tests
2019-10-09 23:29:41 +03:00
Alexey Milovidov
3fbac60328 Added a test 2019-10-09 23:16:17 +03:00
Alexey Milovidov
e65b57369e transformQueryForExternalDatabase: fixed constant folding for Date and DateTime 2019-10-09 23:13:34 +03:00
alesapin
fae3f85a0f Refactor parser create query 2019-10-09 23:09:10 +03:00
Vasily Nemkov
7afff3d661 Style fixes 2019-10-09 23:02:50 +03:00
Alexey Milovidov
b302fec362 Fixed bad code in transformQueryForExternalDatabase 2019-10-09 22:58:50 +03:00
Vasily Nemkov
c1f9fcc3d5 Fixed getting function default timezone value from DateTime64-argument 2019-10-09 22:53:57 +03:00
Vasily Nemkov
3e3de2adf8 add/substract-XXX family of functions now can take DateTime64 as argument 2019-10-09 22:52:59 +03:00
alexey-milovidov
689411abe0
Merge pull request #7222 from azat/uniqCombined64
[RFC] Introduce uniqCombined64() to get sane results for cardinality > UINT_MAX
2019-10-09 20:29:56 +03:00
alexey-milovidov
6cd3e9a458
Update AggregateFunctionUniqCombined.h 2019-10-09 20:26:01 +03:00
alexey-milovidov
81a9c81ba7
Merge pull request #7236 from azat/uniqCombined-memory-usage
Do not use more then 98K of memory for uniqCombined*
2019-10-09 20:19:30 +03:00
alexey-milovidov
e3861e0e88
Merge pull request #7242 from azat/sparse_hashed-name
Return SparseHashed name (system.dictionaries:type) for the sparse_hashed layout
2019-10-09 20:12:24 +03:00
Nikolai Kochetov
dea89cfc11 Disable processors by default. 2019-10-09 19:42:13 +03:00
alexey-milovidov
01e08a23c2
Merge pull request #7240 from ClickHouse/function-get-macro
Added function `getMacro`
2019-10-09 15:28:54 +03:00
Alexander Kuzmenkov
1965c612ab Fix sorting in clickhouse-test. 2019-10-09 14:56:51 +03:00
millb
fec1c6deba Fixed Error message and error code 2019-10-09 14:16:14 +03:00
Nikolai Kochetov
9c5ae5f536 Merge branch 'master' into processors-and-storages 2019-10-09 14:12:47 +03:00
Alexander Kuzmenkov
89ebd4885f Fix test filtering in clickhouse-test. 2019-10-09 13:51:59 +03:00
alesapin
ef0b2f5936
Merge pull request #7209 from ClickHouse/dictionaries_ddl_parser
Dictionaries ddl parser
2019-10-09 12:51:08 +03:00
Nikolai Kochetov
eb2677c94e Try fix progressbar. 2019-10-09 12:44:24 +03:00
Nikolai Kochetov
ea27918de8 Try fix progressbar. 2019-10-09 12:40:30 +03:00
Nikolai Kochetov
c7bb83262e Fix progress callback for processors pipeline. 2019-10-09 12:33:16 +03:00
Azat Khuzhin
0ff823b574 Return SparseHashed name (system.dictionaries:type) for the sparse_hashed layout
Due to tons of rebasing this bit had been forgotten.

Refs: 420089c301 ("Add new dictionary layout (sparse_hashed) that is more memory efficient")
2019-10-09 11:11:41 +03:00
alexey-milovidov
9b2e025918
Merge pull request #7234 from ClickHouse/aku/null-field-serialization
Serialize Null Fields correctly in DataTypeNullable.
2019-10-09 04:30:37 +03:00
Alexey Milovidov
6d2a79e832 Added a test 2019-10-09 04:18:12 +03:00
Alexey Milovidov
552e4b4be2 Added example config with macros for tests 2019-10-09 04:16:34 +03:00
Alexey Milovidov
a19f6513ce Added example config with macros 2019-10-09 04:15:23 +03:00
Alexey Milovidov
9f8d562543 Add function "getMacro" #7239 2019-10-09 04:14:57 +03:00
Azat Khuzhin
e373862c83 Do not use more then 98K of memory for uniqCombined*
uniqCombined() uses hashtable for medium cardinality, and since
HashTable resize by the power of 2 (well actually HashTableGrower grows
double by the power of 2, hence HashTableGrower::increaseSize() should
be overwritten to change this), with 1<<13 (default for uniqCombined)
and UInt64 HashValueType, the HashTable will takes:

  getBufferSizeInBytes() == 131072

While it should be not greater then sizeof(HLL) ~= 98K, so reduce the
maximum cardinality for hashtable to 1<<12 with UInt64 HashValueType and
to 1<13 with UInt32, overwrite HashTableGrower::increaseSize() and cover
this using max_memory_usage.

Refs: https://github.com/ClickHouse/ClickHouse/pull/7221#issuecomment-539672742

v2: cover uniqCombined() with non-default K
2019-10-09 02:39:23 +03:00
alexey-milovidov
4c1f0177b6
Merge pull request #7109 from infinivision/aggBitmapAnd
added groupBitmapAnd, groupBitmapOr, groupBitmapXor
2019-10-08 22:51:46 +03:00
alexey-milovidov
5c2d478543
Merge pull request #7212 from ClickHouse/aku/field-includes
Include Field.h and FieldVisitor.h into fewer files.
2019-10-08 22:40:30 +03:00
alesapin
5296be18f3 Fix desc table query 2019-10-08 22:39:20 +03:00
alexey-milovidov
b9aa5d812d
Merge pull request #7171 from nikvas0/nikvas0/lazy_db
Lazy Database
2019-10-08 22:15:55 +03:00
Azat Khuzhin
f46c5a47c0 Introduce uniqCombined64() to get sane results for cardinality > UINT_MAX
By default uniqCombined() uses 32-bit hash for all types except String,
so this means that you cannot use uniqCombined() with i.e UInt64 and
cardinality > UINT_MAX, although you can use uniqCombined(toString())
and this will lead to 64-bit hash, but will not have good performance.

So uniqCombined64() had been introduced to fix this.

Requires: #7213
2019-10-08 21:59:35 +03:00
alexey-milovidov
ddc2299901
Update 01016_null_part_minmax.sql 2019-10-08 21:52:48 +03:00
alexey-milovidov
d8b3db65f7
Merge pull request #7213 from azat/fix-uniqCombined-approximation
Fix uniqCombined() result for >UINT_MAX values (return UInt64 to avoid overflow)
2019-10-08 21:45:23 +03:00
alexey-milovidov
e619304b2c
Merge pull request #7216 from ClickHouse/nicelulu-issue-6615
Merging "Optimize empty IN subquery and empty INNER/RIGHT JOIN"
2019-10-08 21:36:57 +03:00
Alexander Kuzmenkov
a5b1496fe9 Serialize Null Fields correctly in DataTypeNullable. 2019-10-08 21:21:24 +03:00
alesapin
5ea1a12c05 Refactoring and comments 2019-10-08 16:26:15 +03:00
Alexander Kuzmenkov
2b30f2696c Include Field.h in less files. 2019-10-08 16:23:24 +03:00
alesapin
7b545f9b18 Fix style 2019-10-08 15:35:17 +03:00
alesapin
cd05564b17 Add show create dictionary 2019-10-08 15:34:04 +03:00
Alexander Kuzmenkov
46f5115601 Accept many test name regexes in clickhouse-test.
Sometimes it is more convenient to supply space-separated test names
without having to concatenate them into one regex with pipes.
2019-10-08 14:32:03 +03:00
alesapin
0883b3f8a9 Parser for drop dictionary query 2019-10-08 14:10:29 +03:00
alesapin
db20681207 Better declaration and lifetime parser 2019-10-08 13:50:57 +03:00
alesapin
5f81f47637 Add recursive parsing of pairs 2019-10-08 12:47:17 +03:00
Vasilyev Nikita
21b2b20729 Merge branch 'nikvas0/lazy_db' of https://github.com/nikvas0/ClickHouse into nikvas0/lazy_db 2019-10-08 11:15:12 +03:00
Vasilyev Nikita
030aa1cf10 fix 2019-10-08 11:10:55 +03:00
Vasily Nemkov
8792738944 Prohibit implicit conversion of UInt64-Field to DateTime64 2019-10-08 10:01:17 +03:00
Vasily Nemkov
1a84580005 Scaffold for toDateTime64(scale, [timezone]) 2019-10-08 07:59:38 +03:00
Vasily Nemkov
6fe59aea14 Fixed GCC-9 build error
-Werror=format-overflow
2019-10-08 07:58:10 +03:00
Vasily Nemkov
f1afc98e0c Updated the tests for better debugging. 2019-10-08 07:57:31 +03:00
Vasily Nemkov
77ac67eba8 Fixed toTimeZone implementation 2019-10-08 07:50:13 +03:00
Vasily Nemkov
d136843d8f DataTypeDateTime64::doGetName() now reports timezone 2019-10-08 07:40:18 +03:00
alexey-milovidov
3bd59edc3c
Update StorageSystemTables.cpp 2019-10-08 03:31:50 +03:00
alexey-milovidov
c92fc70f66
Update StorageSystemTables.cpp 2019-10-08 03:29:41 +03:00
alexey-milovidov
704529801e
Update StorageSystemColumns.cpp 2019-10-08 03:27:57 +03:00
alexey-milovidov
20f5b27b8b
Update DatabaseOnDisk.h 2019-10-08 03:24:26 +03:00
Alexey Milovidov
15bba8b498 Updated test 2019-10-07 22:16:45 +03:00
alexey-milovidov
bcc4e3f0ba
Merge branch 'master' into issue-6615 2019-10-07 22:12:25 +03:00
Alexander Tokmakov
1c5ee018df update docs 2019-10-07 21:55:12 +03:00
Azat Khuzhin
92c88248a1 Fix uniqCombined() result for >UINT_MAX values (return UInt64 to avoid overflow)
uniqCombined() return type is UInt64, but uniqCombined() uses
CombinedCardinalityEstimator, and CombinedCardinalityEstimator::size()
return type is UInt32, while the underlying HyperLogLog::size() is
UInt64.

So after this patch uniqCombined() can be used for >UINT_MAX values, the
outcome is not ideal (#2073) but at least sane.
2019-10-07 21:38:58 +03:00
Alexander Kuzmenkov
56b065881a Include FieldVisitors.h in less files. 2019-10-07 20:23:05 +03:00
Alexander Kuzmenkov
367c537106 Do not include Field.h everywhere through SettingsCommon.h.
Move the methods of SettingsCollection<> that are dependent on Field to
a separate file, and include it once for each instantiation. This allows
to work on Field without always recompiling the entire project.
2019-10-07 20:23:05 +03:00
Alexander Tokmakov
73aa1d1518 diagnostic info for bad csv delimiters 2019-10-07 19:47:25 +03:00
alesapin
0e664807e9 Additional test 2019-10-07 19:46:35 +03:00
Alexander Tokmakov
a2c83ac82e add tests 2019-10-07 19:31:30 +03:00
alesapin
cec3af45e5 First working version of parser 2019-10-07 19:23:16 +03:00
Alexander Tokmakov
32b0b8272c setup csv delimiter in Template format 2019-10-07 19:03:01 +03:00
Alexander Tokmakov
b4d9dc2a90 query parameters in evaluateConstantExpression 2019-10-07 18:46:50 +03:00
Vasily Nemkov
46e5171952 Fixed comparing values of DateTime64 to DateTime and Int/UInt 2019-10-07 18:19:18 +03:00
alesapin
369a7d262c Merge branch 'master' into dictionaries_ddl_parser 2019-10-07 12:46:08 +03:00
Vasily Nemkov
46174e92b3 attempt to fix toTimeZone. 2019-10-07 10:45:59 +03:00
millb
c5ba58f243 Fixed tests 2019-10-06 18:49:51 +03:00
millb
7ab1804ebb Fixed codestyle and changed Error message. 2019-10-06 18:33:25 +03:00
millb
31a422fdff Fixed test codestyle 2019-10-06 18:01:05 +03:00
millb
5c272df15f Add integration tests. 2019-10-06 17:52:41 +03:00
alexey-milovidov
d096119529
Merge pull request #7156 from ClickHouse/fix-header-for-now
Fix header for function 'now'
2019-10-05 22:35:23 +03:00
alexey-milovidov
ce12fb6b3c
Update ExpressionAnalyzer.cpp 2019-10-05 22:34:57 +03:00
alexey-milovidov
40b22061f0
Update InterpreterSelectQuery.cpp 2019-10-05 22:34:25 +03:00
proller
594c535bd4 Build fixes (#7063)
* Build fixes

*            fix

* Fix

* fix

* Fix install(export..

* Freebsd fixes

* Freebsd fixes

* Fix warning

* fix

* More PRIVATE linking

* Fix review

* Timmy

* fix

* fix
2019-10-05 22:25:31 +03:00
alexey-milovidov
acbadfefbf
Merge pull request #7200 from azat-archive/unbundled-build-fix
Add missing linking with PocoXML for clickhouse_common_io
2019-10-05 21:54:24 +03:00
alexey-milovidov
bb8414bdeb
Merge pull request #7201 from vzakaznikov/enabling_again_live_view_tests
A quick fix to resolve crash in LIVE VIEW table and re-enabling all LIVE VIEW tests.
2019-10-05 20:47:34 +03:00
Vitaliy Zakaznikov
6b8e61737a * Fixing crash in LIVE VIEW
* Re-enabling all LIVE VIEW tests
2019-10-05 08:05:24 -04:00
Vasilyev Nikita
5fb84b55a6 fix nl 2019-10-05 13:21:47 +03:00
Vasilyev Nikita
b8647f49b5 fix 2019-10-05 13:21:04 +03:00
Alexander Tokmakov
a90d126b93 support defaults_for_omitted_fields in TSV 2019-10-04 22:44:48 +03:00
Alexander Tokmakov
d936cee836 support null_as_default in most text formats 2019-10-04 22:42:35 +03:00
Nikolai Kochetov
95ec0f7c2d Merged with master. 2019-10-04 20:53:21 +03:00
Nikolai Kochetov
d4f11af817 Update QueryPipeline. 2019-10-04 20:49:14 +03:00
Nikolai Kochetov
23069ca6d0 Progress for MergeTreeSelectProcessor. 2019-10-04 20:50:07 +03:00
Nikolai Kochetov
627d48c19a Added ExecutionSpeedLimits. 2019-10-04 20:49:57 +03:00
Nikolai Kochetov
e48f7faebc Fix MergeTreeRangeReader.
Fix MergeTreeReader.

Fix MergeTreeBaseSelectProcessor.

Better exception message for TreeExecutor.

Added header_without_virtual_columns to MergeTreeBaseSelectProcessor.

Fix MergeTreeReverseSelectProcessor.

Fix MergeTreeDataSelectExecutor.
2019-10-04 20:49:29 +03:00
Nikolai Kochetov
54d32da5a1 Update TreeExecutor. 2019-10-04 20:49:24 +03:00
Nikolai Kochetov
1689576770 Update MergeTreeDataSelectExecutor. 2019-10-04 20:49:14 +03:00
Alexander Tokmakov
ec79e5aa5b refactor null_as_default 2019-10-04 20:19:49 +03:00
Azat Khuzhin
4b9d711f07 Add missing linking with PocoXML for clickhouse_common_io
Otherwise unbundled build fail with:
  FAILED: dbms/libclickhouse_common_iod.so
  ...
  ../dbms/src/IO/WriteBufferFromS3.cpp:143: error: undefined reference to 'Poco::XML::InputSource::InputSource(std::istream&)'
  ../dbms/src/IO/WriteBufferFromS3.cpp:144: error: undefined reference to 'Poco::XML::DOMParser::DOMParser(Poco::XML::NamePool*)'
  ../dbms/src/IO/WriteBufferFromS3.cpp:145: error: undefined reference to 'Poco::XML::DOMParser::parse(Poco::XML::InputSource*)'
  ../dbms/src/IO/WriteBufferFromS3.cpp:146: error: undefined reference to 'Poco::XML::Document::getElementsByTagName(std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&) const'
  ../dbms/src/IO/WriteBufferFromS3.cpp:144: error: undefined reference to 'Poco::XML::DOMParser::~DOMParser()'
  ../dbms/src/IO/WriteBufferFromS3.cpp:143: error: undefined reference to 'Poco::XML::InputSource::~InputSource()'
  ../dbms/src/IO/WriteBufferFromS3.cpp:144: error: undefined reference to 'Poco::XML::DOMParser::~DOMParser()'
  ../dbms/src/IO/WriteBufferFromS3.cpp:143: error: undefined reference to 'Poco::XML::InputSource::~InputSource()'
  collect2: error: ld returned 1 exit status
2019-10-04 19:48:10 +03:00
alexey-milovidov
9c2f3ba41a
Merge pull request #6984 from achimbab/pr_bf
Made bloom_filter type of index supporting arrays
2019-10-04 18:08:42 +03:00
Vasily Nemkov
f6a997d1e1 Minor: using UInt32 DateTime64-related scale instead of UInt64. 2019-10-04 17:05:39 +03:00
Vasily Nemkov
1069812d88 Fixed converting DateTime64-Field on client into DataTypeDateTime64-field type.
Since DateTime64 is just a typedef, and there is no explicit Field-type
for it, we have to solely rely on type_hint provided by origin column.
If the hint is missing, there is no way of distinguishing DateTime64
from Decimal64.

Alternative could be having explicit converting code, (and it looks like
it has to be added at some point).
2019-10-04 17:04:17 +03:00
Vasily Nemkov
a3548b08a9 More test 2019-10-04 16:49:34 +03:00
tavplubix
d73db7f779
Merge pull request #6781 from ClickHouse/merging_values_with_expressions
Merging Values with expressions
2019-10-04 12:51:22 +03:00
Nikolai Kochetov
90472293fd Added test with function randConstant. 2019-10-04 12:22:07 +03:00
Guillaume Tassery
0f66da0e91 Resolve lock issue after review 2019-10-04 06:37:19 +02:00
alexey-milovidov
fadd003f5b
Merge pull request #7185 from ClickHouse/fix_bug_with_alter_attach_part
Fix bug with segmentation fault in ATTACH PART query
2019-10-04 01:18:42 +03:00
alesapin
4e83f65089 Fix bug with segmentation fault in ATTACH PART query 2019-10-03 21:07:47 +03:00
alesapin
cf094cd62b
Merge pull request #7155 from ClickHouse/dictionaries_ddl
Preparation of ExternalLoader for Dictionaries DDL
2019-10-03 20:12:19 +03:00
Nikolai Kochetov
76d1412953 Fix actions for distributed. 2019-10-03 18:47:42 +03:00
Vasilyev Nikita
d6490892a7 fix metadata time 2019-10-03 17:18:17 +03:00
Vasilyev Nikita
66506e26d0 fix 2019-10-03 16:40:53 +03:00
Vasilyev Nikita
6b1a1b5b5f fix 2019-10-03 15:49:22 +03:00
Nikolai Kochetov
e5c1df010f Remove allow_different_constant_values from InterpreterSelectQuery. 2019-10-03 15:02:30 +03:00
Nikolai Kochetov
a706cc47cf Remove setting allow_different_constant_values from ConvertingTransform and ConvertingBlockInputStream. 2019-10-03 14:59:45 +03:00
Nikolai Kochetov
3142955e6c InterpreterSelectQuery: reuse actions from getSampleBlock in readImpl. 2019-10-03 14:58:52 +03:00
Guillaume Tassery
4f26f3fcfa Fix style 2019-10-03 12:52:32 +02:00
Vasilyev Nikita
f0f5134759 fixed includes 2019-10-03 12:31:59 +03:00
Vasilyev Nikita
c27ce44d19 set -> list 2019-10-03 12:20:21 +03:00
Vasilyev Nikita
2f4e7bbe7f get rid of copy-paste 2019-10-03 11:35:58 +03:00
Vasilyev Nikita
7ac9fadc0d reduce copy-paste 2019-10-03 11:27:43 +03:00
Guillaume Tassery
f54c90ccce Merge branch 'master' of github.com:PerformanceVision/ClickHouse into move_partition 2019-10-03 10:24:39 +02:00
Vasily Nemkov
bda2179dc3 Fixed now64() to be variadic 2019-10-03 11:10:52 +03:00
Vasilyev Nikita
080815833f refactor 2019-10-03 10:59:48 +03:00
Alexander Kuzmenkov
8e245d4e8c
Merge pull request #7135 from ClickHouse/aku/msan-field
Fix some MemorySanitizer warnings for Fields.
2019-10-03 10:33:44 +03:00
Vasily Nemkov
180b986972 Extern templates + minor simplifications 2019-10-03 10:27:28 +03:00
Vasily Nemkov
655ec351ba Fixed DateTime64 creation, and optional scale parameter for now64()
Added more tests for casting and inserting values.
2019-10-03 05:07:36 +03:00
Ivan
05b17976d1
Commit to Kafka explicitly after the writing is finalized (#7175) 2019-10-03 00:17:19 +03:00
alexey-milovidov
255a57d02e
Merge pull request #7172 from excitoon/patch-1
Fixed time calculation in `MergeTreeData`.
2019-10-03 00:15:16 +03:00
Alexander Tokmakov
a58996817f allow query parameters in Values 2019-10-02 22:54:40 +03:00
Alexander Tokmakov
565c273eaa Merge branch 'master' into merging_values_with_expressions 2019-10-02 20:51:44 +03:00
Alexander Tokmakov
80e5976d10 fixes after review 2019-10-02 20:51:00 +03:00
millb
7caae87e74 Fixed StorageURL.cpp 2019-10-02 20:17:09 +03:00
millb
16645bfe53 Fixed StorageUrl.cpp 2019-10-02 19:33:50 +03:00
Artem Zuikov
d23b7ae8ef
Merge pull request #7166 from 4ertus2/some
Refactoring: remove copy-paste
2019-10-02 17:28:38 +03:00
Nikita Mikhaylov
5a34e39286 small changes after review 2019-10-02 17:26:15 +03:00
Alexander Kuzmenkov
4af8e76bdd Use proper types for Field.
When a Field is inserted into a column, its type should be the same as
the column data type to avoid implicit reinterpret_cast. Change a
couple of usages where these types were different.
2019-10-02 16:48:26 +03:00
Vasilyev Nikita
136b1665a3 test rename 2019-10-02 16:06:57 +03:00
Vasilyev Nikita
de3deb9e85 fix 2019-10-02 15:58:13 +03:00
chertus
3b0d870804 rename function 2019-10-02 15:06:34 +03:00
Vasily Nemkov
31d5730513 Merge remote-tracking branch 'upstream/master' into DateTime64 2019-10-02 13:54:59 +03:00
Vitaliy Zakaznikov
ffe8931cda Revert "Merge pull request #6770 from yandex/temporary-remove-live-view-tests"
This reverts commit 6cf5327269, reversing
changes made to 4155771106.
2019-10-02 06:52:40 -04:00
Vasilyev Nikita
ff405865f7 db on disk 2019-10-02 13:10:45 +03:00
Nikita Mikhaylov
13e2034084
fix possible dataraces in ReplicatedMergeTree 2019-10-02 12:59:44 +03:00
Vasilyev Nikita
54237e3f27 name, data, metadata -> functions 2019-10-02 11:58:28 +03:00
Vladimir Chebotarev
e79a15c39c
Fixed time calculation in MergeTreeData. 2019-10-02 10:46:53 +03:00
Vasilyev Nikita
dab68e796e removed unused consts 2019-10-02 09:47:12 +03:00
Vasilyev Nikita
f515e9465b fix 2019-10-02 09:45:27 +03:00
Vasilyev Nikita
657d200d42 better logs 2019-10-02 09:40:51 +03:00
Vasilyev Nikita
45ecff99a1 upd test 2019-10-02 09:31:23 +03:00
Vasily Nemkov
6e813002d5 Proper serialization of DateTime64 also updated functions support. 2019-10-02 08:53:38 +03:00
alexey-milovidov
96ca241fba
Merge pull request #7158 from azat-archive/MetricsTransmitter-use-of-uninitialized-value
Avoid use of uninitialized values in MetricsTransmitter
2019-10-02 01:01:00 +03:00
chertus
c46cc3ff1a refactoring: remove copy-paste 2019-10-01 21:51:33 +03:00
Nikita Mikhaylov
0e9cad2276
fix datarace in stress test in storagemergetree 2019-10-01 21:04:42 +03:00
Nikita Mikhaylov
fe5df2c1ed
Update ASTAlterQuery.cpp 2019-10-01 20:48:22 +03:00
Nikita Mikhaylov
f6985028db
Update ASTAlterQuery.cpp 2019-10-01 20:47:25 +03:00
alesapin
3fe7d84233 Add ASTs for dictionaries 2019-10-01 17:54:28 +03:00
Artem Zuikov
48ab9afce6
Merge pull request #7122 from 4ertus2/mjoin
Squash left-hand blocks in partial merge join (optimization)
2019-10-01 17:23:10 +03:00
Vasilyev Nikita
71a2002417 test with sleep 2019-10-01 16:57:58 +03:00
Vasilyev Nikita
c5087219c4 test 2019-10-01 16:53:55 +03:00
Vasilyev Nikita
c630d9457b opt system tables 2019-10-01 16:07:00 +03:00
chertus
038428bccf do not affect other SquashingBlockInputStream instances 2019-10-01 16:01:08 +03:00
Vasilyev Nikita
5793a02ef9 impr Lazy database 2019-10-01 15:44:17 +03:00
Nikolai Kochetov
9e74b8a6fe Disable check for constants in Converting stream while converting to header. 2019-10-01 13:58:39 +03:00
Nikita Mikhaylov
d9c12f7f96 lost files 2019-10-01 13:51:17 +03:00
Nikita Mikhaylov
d47d4cd6c1 parallel parsing 2019-10-01 13:48:46 +03:00
Vasilyev Nikita
69677d19e4 fix iterations 2019-10-01 13:48:19 +03:00
Alexander Tokmakov
605046761e fix build 2019-10-01 13:44:28 +03:00
Vasilyev Nikita
5ef295eeff fixes 2019-10-01 13:24:09 +03:00
Nikolai Kochetov
58a432be62 Updated functions today, yestarday, randConstant. 2019-10-01 13:15:20 +03:00
Nikolai Kochetov
b9b2ca342d Updated functions today, yestarday, randConstant. 2019-10-01 13:11:16 +03:00
Nikolai Kochetov
92ba6081a4 Updated functions today, yestarday, randConstant. 2019-10-01 13:10:07 +03:00
Nikolai Kochetov
0d94bdb6a1 Updated functions today, yestarday, randConstant. 2019-10-01 13:03:55 +03:00
alesapin
8429f46f3c Return getUpdateTime method to interface 2019-10-01 11:58:47 +03:00
Azat Khuzhin
740e4c5851
Avoid use of uninitialized values in MetricsTransmitter
Defer thread creation after values had been initialized correctly.
2019-10-01 10:16:39 +03:00
alesapin
709783a1bc Add missed header 2019-09-30 22:42:31 +03:00
Alexander Tokmakov
e267081389 better PeekableReadBuffer interface 2019-09-30 21:21:58 +03:00
Nikolai Kochetov
486deee1f1 Use new iface for now function. Use current time value from function builder. 2019-09-30 20:36:03 +03:00
Nikolai Kochetov
393bfdcd9f Use new iface for now function. Use current time value from function builder. 2019-09-30 20:31:36 +03:00
alesapin
0e6331e892 Add comments 2019-09-30 19:54:50 +03:00
alesapin
08681ac210 Preparation for AST configurations for external dictionaries 2019-09-30 19:12:08 +03:00
chertus
5df8f870c4 try remove some PVS errors 2019-09-30 18:45:53 +03:00
millb
9246f258e8 Created ability to configure allowed URL in config.xml without tests. 2019-09-30 18:29:05 +03:00
Alexander Tokmakov
979f235e38 Merge branch 'master' into merging_values_with_expressions 2019-09-30 18:06:58 +03:00
Nikolai Kochetov
963acff1d2 Use new iface for now function. Use current time value from function builder. 2019-09-30 17:59:04 +03:00
chertus
5212d43ae4 simplify pmj settings 2019-09-30 17:36:45 +03:00
Alexander Kuzmenkov
6960b893fd Initialize full storage type of Field, and not just the nominal type.
Field can return the value of storage type with a suitable get<>, and
this value should not be partly undefined.

Found with MemorySanitizer.
2019-09-30 15:49:58 +03:00
Alexander Kuzmenkov
ec2d9a083c Remove excessive includes. 2019-09-30 15:31:14 +03:00
alexey-milovidov
e50a874537
Merge pull request #7118 from ClickHouse/improve_template_format
Minor improvements of Template format
2019-09-30 15:00:27 +03:00
Amos Bird
dadc613072 Get rid of malloc symbols in libcommon (#7134) 2019-09-30 14:58:32 +03:00
alesapin
bc6caba4db Remove redundant argument 2019-09-30 14:18:01 +03:00
alexey-milovidov
42c9ea9aa3
Merge pull request #7092 from PerformanceVision/acl_file_storage
Let the choice to write credential for HTTP source on external dictionaries
2019-09-30 13:20:33 +03:00
alexey-milovidov
24b3145144
Update evaluateConstantExpression.cpp 2019-09-29 01:12:29 +03:00
alexey-milovidov
34498db394
Merge pull request #7132 from Akazz/fixes_in_tests-system_parts_race_condition
Corrections to tests 00992/00993: changed "ALTER DELETE ..." mutations to be deterministic
2019-09-27 22:20:35 +03:00
alexey-milovidov
102b5a7dd4
Merge pull request #7111 from ClickHouse/dictionaries_ddl
Small dictionaries refactoring
2019-09-27 22:05:14 +03:00
root
f54f55bbdc Add const. 2019-09-28 00:38:13 +08:00
root
bcc24d3cbc Fix code Style. 2019-09-27 22:56:40 +08:00
root
bc13482eea Add globalIn. 2019-09-27 22:24:48 +08:00
Alexander Kazakov
2f355d716a Corrections to tests 00992/00993:mutations to be deterministic 2019-09-27 16:38:40 +03:00
chertus
c6f0fd09bd Merge branch 'master' into mjoin 2019-09-27 16:33:07 +03:00
Ivan
e5a5091556
Revert "Get rid of malloc symbols in libcommon (#7065)" (#7131)
This reverts commit 4cb53093a0.
2019-09-27 16:16:53 +03:00
alesapin
9ee031413c Remove a lot of unused code 2019-09-27 15:36:54 +03:00
chertus
baaf0a7c5b partial_merge_join_optimisations -> partial_merge_join_optimizations 2019-09-27 15:25:02 +03:00
Amos Bird
4cb53093a0 Get rid of malloc symbols in libcommon (#7065) 2019-09-27 15:19:26 +03:00
root
0189945ad8 Optimize empty IN subquery and empty INNER/RIGHT JOIN. 2019-09-27 19:06:20 +08:00
alesapin
506dbd49cb Add missed row 2019-09-27 12:02:06 +03:00
chertus
0bfabc8cb2 rename partial_merge_join_optimizations in test 2019-09-27 10:49:20 +03:00
Guillaume Tassery
b1182cdc3d uupdate tests 2019-09-27 05:15:03 +02:00
Zhichang Yu
8945714c27 added groupBitmapAnd, groupBitmapOr, groupBitmapXor 2019-09-27 10:21:07 +08:00
Alexander Tokmakov
004455a029 fixes 2019-09-27 00:40:14 +03:00
chertus
10eaef1adc squash left-hand blocks in pmj (phase 2) 2019-09-26 21:51:17 +03:00
alexey-milovidov
a2fc7e2e9e
Merge pull request #7093 from millb/merges_counter_metric
Add merge metric
2019-09-26 21:49:43 +03:00
alexey-milovidov
87a6d3b222
Update ProfileEvents.cpp 2019-09-26 21:49:30 +03:00
Nikolai Kochetov
b65fe57319 Update MergeTreeRangeReader. 2019-09-26 20:29:41 +03:00
alesapin
bba3a96ff4 Remove redundant argument 2019-09-26 20:24:55 +03:00
tavplubix
c3ed1f38a6
Merge branch 'master' into improve_template_format 2019-09-26 19:19:11 +03:00
alesapin
0e28dc4e51 Remove redundant classes 2019-09-26 19:12:15 +03:00
Vasily Nemkov
9cc2baf05c DataType64 as decimal
compiles
2019-09-26 18:12:40 +03:00
millb
ea013cf1a2 Fixed test 2019-09-26 17:44:04 +03:00
Vasilyev Nikita
eb1dcbf183 factory 2019-09-26 16:43:08 +03:00
Vasilyev Nikita
29cf5d85ab add expiration 2019-09-26 15:39:37 +03:00
Vasilyev Nikita
ef2af243ee expiration queue 2019-09-26 15:34:58 +03:00
millb
259be751ee Fixed metric name.
Add metric description.
Add test.
2019-09-26 15:06:52 +03:00
alesapin
089e3146c9 Add missed files 2019-09-26 14:19:10 +03:00
Vasilyev Nikita
1bdba790b5 fix 2019-09-26 14:09:26 +03:00
Alexander Tokmakov
51ac870540 fix build 2019-09-26 13:49:22 +03:00
alesapin
4fdb5a61e5 Rename ExternalDictionaries to ExternalDictionariesLoader 2019-09-26 13:41:33 +03:00
Guillaume Tassery
7c93ef1706 Add integration tests for auth on HTTP external dictionaries 2019-09-26 12:28:56 +02:00
alesapin
5668f55ab7 Rename ExternalModels to ExternalModelsLoader 2019-09-26 13:23:14 +03:00
alesapin
903f826640 Remove runtime factory and remove one redundant object 2019-09-26 13:08:38 +03:00
Vasilyev Nikita
5298a748c4 fix 2019-09-26 12:23:04 +03:00
Vasilyev Nikita
dcad7e3567 some improvements 2019-09-26 12:20:46 +03:00
Vasilyev Nikita
9107f0fad1 can compile 2019-09-26 10:16:31 +03:00
Guillaume Tassery
647568a6f6 cosmetic 2019-09-26 05:34:22 +02:00
chertus
dd08f06c81 squash left-hand blocks in partial merge join 2019-09-25 22:17:32 +03:00
Alexander Tokmakov
c31f9c6f9a force inline small functions 2019-09-25 19:08:58 +03:00
Vasilyev Nikita
5213dba2e0 fixed 2019-09-25 15:08:41 +03:00
millb
4e893eb949 Fixed codestyle 2019-09-25 13:46:24 +03:00
millb
97a2ae176b Add CountOfMerges metric 2019-09-25 13:37:43 +03:00
Guillaume Tassery
367a0dcdb4 cosmetic 2019-09-25 11:46:48 +02:00
Guillaume Tassery
8b4e789847 Rename key to name 2019-09-25 11:42:08 +02:00
Vasilyev Nikita
b9a5952921 lazydb start 2019-09-25 12:35:56 +03:00
Guillaume Tassery
77f2dfee6a Add the positibility to add an header on an HTTP source 2019-09-25 10:08:46 +02:00
Guillaume Tassery
2435e9a12c Add simple HTTP right credentials 2019-09-25 06:33:54 +02:00
Alexey Milovidov
ff07ffbbae Merge branch 'merging_redis' of https://github.com/CurtizJ/ClickHouse into CurtizJ-merging_redis 2019-09-25 02:27:05 +03:00
alexey-milovidov
64e889d872
Merge pull request #7070 from 4ertus2/mjoin
PartialMergeJoin optimisation (skip not intersected blocks)
2019-09-25 02:24:42 +03:00
alexey-milovidov
60d74a5e55
Merge pull request #7086 from nikvas0/nikvas0/little_odb_impr
little improvement in DatabaseOrdinary code
2019-09-25 02:04:34 +03:00
alexey-milovidov
7cfa52ef73
Merge pull request #7026 from ClickHouse/aku/lookup-result
Do not use iterators in find() and emplace() methods of hash tables.
2019-09-25 02:03:43 +03:00
Alexander Tokmakov
d642304b1d add CustomSeparated format 2019-09-24 22:56:45 +03:00
Alexander Kuzmenkov
b949cc232b Mark lookupResultGetKey/Mapped functions ALWAYS_INLINE.
They only do pointer arithmetics, so it makes sense to always inline
them.
2019-09-24 22:03:10 +03:00
chertus
0467229eff fix all left partial merge join on block borders 2019-09-24 21:21:57 +03:00
alexey-milovidov
bc9667d881
Merge pull request #7085 from ClickHouse/merge-s3
Merge s3
2019-09-24 17:51:57 +03:00
Vasilyev Nikita
def500f591 some impr 2019-09-24 17:49:30 +03:00
Alexander Tokmakov
e197cc8a49 read settings from file 2019-09-24 17:45:04 +03:00
Alexander Kuzmenkov
f3bde19b74 Do not use iterators in find() and emplace() methods of hash tables.
Instead, these methods return a pointer to the required data as they are
stored inside the hash table. The caller uses overloaded functions to
get the key and "mapped" values from this pointer. Such an interface
avoids the need for constructing iterator-like wrapper objects, which is
especially important for compound hash tables such as the future
StringHashMap.
2019-09-24 17:44:35 +03:00
chertus
80d902a401 fix case with duplicated right keys 2019-09-24 16:45:59 +03:00
robot-clickhouse
06e1a9d78e Auto version update to [19.16.1.1] [54427] 2019-09-24 14:47:32 +03:00
robot-clickhouse
ec86a9b933 Auto version update to [19.15.1.1398] [54426] 2019-09-24 14:46:58 +03:00
Vladimir Chebotarev
c051f42384 Fixes. 2019-09-24 10:58:42 +00:00
alexey-milovidov
a62866918f
Merge pull request #7075 from ClickHouse/revert-index-analysis-slowdown
Revert "CHYT-142: extend KeyCondition interface so that it returns BoolMask"
2019-09-24 05:18:15 +03:00
Alexey Milovidov
7384e04430 Revert "CHYT-142: extend KeyCondition interface so that it returns BoolMask."
This reverts commit 2cacc3cfd2.
2019-09-24 04:29:26 +03:00
Alexey Milovidov
dcd40d1d07 Better log messages about disks 2019-09-24 03:45:40 +03:00
alexey-milovidov
56bd02cf3a
Merge pull request #7016 from ClickHouse/yet-another-minor-changes-and-docs-for-hdfs
Cleanup hdfs docs (instead of #6876 for  #5371)
2019-09-24 02:23:59 +03:00
alexey-milovidov
2f195ddb03
Merge pull request #7028 from abyss7/issue-6459
Implement cross-compilation support Linux → Darwin
2019-09-24 02:20:17 +03:00
alexey-milovidov
575ddefa6c
Merge pull request #7069 from ClickHouse/compatibility-settings-19.14
Fixed compatibility for distributed queries between 19.14 and earlier versions
2019-09-24 02:11:33 +03:00
alexey-milovidov
a314a36feb
Merge pull request #7062 from ClickHouse/fix-msan-for-low-cardinality
Fix msan for LowCardinality
2019-09-24 02:11:15 +03:00
alexey-milovidov
e9bfe99dd8
Merge pull request #7072 from silviucpp/silviu-osx-stack
Get proper stack address on osx
2019-09-24 02:09:24 +03:00
alexey-milovidov
e2cc551b22
Merge pull request #6914 from maqroll/master
+ Redirect URL Storage
2019-09-24 02:07:06 +03:00
alexey-milovidov
c4c936c685
Merge pull request #7049 from ClickHouse/ucasFL-master
Merging function "repeat"
2019-09-23 22:52:38 +03:00
alexey-milovidov
e24d882326
Merge pull request #7024 from millb/master
Fixed Function Hex for Float32 and Float64
2019-09-23 22:52:19 +03:00
Silviu Caragea
d187b5ed42 Get proper stack address on osx 2019-09-23 22:47:12 +03:00
chertus
1f9b8418e0 pmj skip not intersected optimisation 2019-09-23 22:36:47 +03:00
Alexey Milovidov
1744e9a13f Merge branch 'master' into enable_use_minimalistic_part_header_in_zookeeper 2019-09-23 22:26:54 +03:00
Nikolai Kochetov
630872837e Skip null columns while checknig num rows. 2019-09-23 22:26:04 +03:00
Alexey Milovidov
11e7ea51e9 Fixed compatibility for distributed queries between 19.14 and earlier versions #7068 2019-09-23 22:22:28 +03:00
Nikolai Kochetov
5108ebeece Remove Block from RangeReader. 2019-09-23 22:22:02 +03:00
alexey-milovidov
faf6e06f56
Update ReadWriteBufferFromHTTP.h 2019-09-23 21:16:34 +03:00
alexey-milovidov
e7b675a301
Update ReadWriteBufferFromHTTP.cpp 2019-09-23 21:15:21 +03:00
Alexey Milovidov
8407ee17c6 Reverted unrelated modification 2019-09-23 21:06:32 +03:00
Alexey Milovidov
89f27de705 Merge branch 'master' into ucasFL-master 2019-09-23 21:05:29 +03:00
Alexey Milovidov
8579c26efb Changed repository URL 2019-09-23 19:18:19 +03:00
millb
bd29efdbbe New hex function release
Bugs and tests fixed
2019-09-23 18:47:34 +03:00
Olga Khvostikova
a6296b2eb0
Merge branch 'master' into yet-another-minor-changes-and-docs-for-hdfs 2019-09-23 18:16:01 +03:00
Alexander Tokmakov
769d33848b allow specifying column idx in format string 2019-09-23 18:10:48 +03:00
stavrolia
fbe3270dfb need to mention... 2019-09-23 17:50:33 +03:00
Ivan Lezhankin
ce2fb6d3d1 Fix build 2019-09-23 17:46:01 +03:00
chertus
016f3b0a45 fix partial merge join with totals 2019-09-23 17:37:42 +03:00
Nikolai Kochetov
61b583ccb9 Fix size of constant columns in case of execution function over LowCardinality without allowed defaults. 2019-09-23 17:19:02 +03:00
chertus
9261d9d970 stabilize tests (add order by) 2019-09-23 16:55:04 +03:00
alexey-milovidov
3ae715cafb
Merge pull request #7048 from ClickHouse/merge-s3
Merging s3: minor changes after #5596
2019-09-23 16:38:18 +03:00
Nikolai Kochetov
f15bc77778 Fix size of constant columns in case of execution function over LowCardinality without allowed defaults. 2019-09-23 16:36:20 +03:00
Ivan Lezhankin
4b143c3e0f Merge remote-tracking branch 'upstream/master' into issue-6459 2019-09-23 16:07:19 +03:00
Vladimir Chebotarev
f8c0fef919 Attempt to make table-level setting s3_min_upload_part_size. 2019-09-23 12:41:59 +00:00
Alexander Tokmakov
447d59bd37 remove unused field 2019-09-23 15:32:49 +03:00
Alexander Tokmakov
89280c0ca8 fix tests 2019-09-23 13:45:26 +03:00
maqroll
e99a87b5b7 update assertResponseIsOk 2019-09-23 08:53:09 +00:00
maqroll
a6e7519f9d Merge remote-tracking branch 'upstream/master' 2019-09-23 07:55:07 +00:00
Vladimir Chebotarev
c45e7dc747 Many parts warning and a comment about that. 2019-09-23 07:42:02 +00:00
maqroll
e1613d0704 + integration test 2019-09-23 07:27:49 +00:00
philip.han
3c40bb86ae Clean up a test table in bloom_filter_test 2019-09-23 15:45:57 +09:00
philip.han
833b188b88 Fix a result of bloom_filter_test 2019-09-23 15:24:53 +09:00
philip.han
315fcc6ef6 Add a testcase that checks nested array type of bloom_filter 2019-09-23 12:41:23 +09:00
philip.han
613927c36c Removed useless code and improve type checking for bloom_filter index 2019-09-23 12:40:48 +09:00
Alexey Milovidov
7948b0bb7e Minor modifications 2019-09-23 02:56:44 +03:00
Alexey Milovidov
e6f1fdc011 Added another test 2019-09-23 02:56:27 +03:00
Alexey Milovidov
80849e0fd7 Fixed bad log messages 2019-09-23 02:49:26 +03:00
Alexey Milovidov
2585cde3d0 Added safety threshold 2019-09-23 02:49:15 +03:00
Alexey Milovidov
48f28bce6a Fixed bad error message 2019-09-23 02:37:13 +03:00
Alexey Milovidov
69c79c31bb Merging function 'repeat': improved test 2019-09-23 02:31:33 +03:00
Alexey Milovidov
454b83fcd3 Merging function 'repeat' 2019-09-23 02:30:13 +03:00
Alexey Milovidov
52272eeea9 Merge branch 'master' of https://github.com/ucasFL/ClickHouse into ucasFL-master 2019-09-23 02:04:18 +03:00
alexey-milovidov
61b02598d7
Update repeat.cpp 2019-09-23 02:02:03 +03:00
Alexey Milovidov
70bc89557f Updates for #6969 2019-09-23 01:57:06 +03:00
alexey-milovidov
ef61e3e27d
Merge pull request #6969 from azat-archive/graphite-events-send-absolute-values
Add ability to send events with absolute values to graphite
2019-09-23 01:51:48 +03:00
alexey-milovidov
0dc4b1793d
Merge pull request #7036 from infinivision/fix_bitmapMax_doc
fix bitmapMin and bitmapMax doc
2019-09-23 01:49:04 +03:00
Alexey Milovidov
bdea16e308 Merging S3: Moved S3 settings to <s3> in config to correspond to <merge_tree> and <kafka> 2019-09-23 01:44:10 +03:00
alexey-milovidov
fac04ea640
Merge pull request #7042 from kyprizel/master
Initial fuzzing support with libfuzzer
2019-09-23 01:31:44 +03:00
Alexey Milovidov
c03857b2ae Merging S3: part 2 2019-09-23 01:13:42 +03:00
Alexey Milovidov
6fb9565091 Merging S3: removed useless headers 2019-09-23 01:06:22 +03:00
alexey-milovidov
2054f80623
Merge pull request #5596 from excitoon-favorites/table_function_s3
s3 table function and storage
2019-09-23 00:53:06 +03:00
alexey-milovidov
3270ad439a
Update compressed_buffer_fuzz.cpp 2019-09-23 00:18:14 +03:00
alexey-milovidov
6fa234cea4
Merge pull request #6894 from azat-archive/hashed-dict-memory-usage-v2
[RFC] Add sparsehash support for hashed dictionary (to reduce memory usage)
2019-09-22 15:55:36 +03:00
alexey-milovidov
8fd66ac4fd
Update compressed_buffer_fuzz.cpp 2019-09-22 15:52:33 +03:00
Vladimir Chebotarev
4608da1344 Minor tests improvement. 2019-09-22 11:03:02 +00:00
Vladimir Chebotarev
64d49e4565 Minor review fixes. 2019-09-22 10:42:47 +00:00
Eldar Zaitov
b174833bdf Initial fuzzing support with libfuzzer 2019-09-22 13:34:09 +03:00
Azat Khuzhin
52f14c1ead
Update HashedDictionary.cpp (fixed rename in return type for SFINAE) 2019-09-22 10:39:50 +03:00
fenglv
4465fdb8bf Add test
fix

fix

fix
2019-09-22 14:25:43 +08:00
alexey-milovidov
5970aafd9a
Merge pull request #7032 from azat-archive/distributed-directory-monitor-SIGSEGV
Avoid SIGSEGV on batch send failure (file with index XX is absent)
2019-09-22 05:12:55 +03:00
alexey-milovidov
a12cffee91
Update HashedDictionary.h 2019-09-22 05:11:08 +03:00
alexey-milovidov
ab9a7be45a
Comments are the must. 2019-09-22 05:09:40 +03:00
alexey-milovidov
9afea6f0b3
Update HashedDictionary.cpp 2019-09-22 05:04:49 +03:00
alexey-milovidov
67e02b4ea0
Merge pull request #6957 from infinivision/add_bitmapSubsetLimit
added bitmapSubsetLimit
2019-09-22 04:58:44 +03:00
alexey-milovidov
6020ba187e
Update AggregateFunctionGroupBitmapData.h 2019-09-22 04:58:21 +03:00
alexey-milovidov
816ac1ca8d
Merge pull request #7037 from silviucpp/silviu-fix-osx
Fix osx build
2019-09-22 04:53:36 +03:00
alexey-milovidov
d446205eec
Update QueryProfiler.cpp 2019-09-22 04:53:19 +03:00
Silviu Caragea
5a14d97587 Fix linking when __ELF__ is not defined 2019-09-22 01:04:17 +03:00
Silviu Caragea
1fbd2fb6a8 Fix osx build 2019-09-21 21:30:01 +03:00
Zhichang Yu
ab7ecd84a1 fix bitmapMin and bitmapMax doc 2019-09-21 23:34:44 +08:00
alesapin
4575b6e4ff
Merge pull request #7031 from yandex/rename-storage-policy-name
Renamed "storage_policy_name" to "storage_policy"
2019-09-21 17:03:19 +03:00
Azat Khuzhin
59763cbb3a
Add ability to send events with absolute values to graphite
<events> sends only deltas for events, while sometimes it is more
convenient to get absolute values (for example to calculate rate).

This patch introduces another directive -- <events_absolute> that will handle
this.

v0: use <events> as bool/string
v2: use <events_absolute>true</events_absolute> over <events>absolute</events>
2019-09-21 02:46:47 +03:00
Azat Khuzhin
420089c301
Add new dictionary layout (sparse_hashed) that is more memory efficient
With this new layout, sparsehash will be used over default HashMap,
sparsehash is more memory efficient but it is also slower.

So in a nutshell:
- HashMap uses ~2x more memory then sparse_hash_map
- HashMap ~2-2.5x faster then sparse_hash_map
(tested on lots of input, and the most close to production was
dictionary with 600KK hashes and UInt16 as value)

TODO:
- fix allocated memory calculation
- getBufferSizeInBytes/getBufferSizeInCells interface
- benchmarks

v0: replace HashMap with google::sparse_hash_map
v2: use google::sparse_hash_map only when <sparse> isset to true
v3: replace attributes with different layout
v4: use ch hash over std::hash
2019-09-21 02:22:40 +03:00
Azat Khuzhin
b22b65dd29
Avoid SIGSEGV on batch send failure (file with index XX is absent)
In case of the following error:
  Failed to send batch: file with index 23742 is absent

NULL dereference will occur for the "remote".
2019-09-21 02:22:25 +03:00
alexey-milovidov
f8d19f6bf3
Merge pull request #6968 from azat-archive/create_as_skip_indices
[RFC] Introduce create_as_skip_indices
2019-09-20 23:53:49 +03:00
alexey-milovidov
1dc58dcb15
Update InterpreterCreateQuery.cpp 2019-09-20 23:53:14 +03:00
alexey-milovidov
c3e0f1c9d3
Merge pull request #7020 from amosbird/check_settings
Outline methods to get needed instantiations.
2019-09-20 23:46:45 +03:00
alexey-milovidov
2432a68009
Merge pull request #7022 from 4ertus2/bugs
Fix "Unknown identifier" in ORDER BY and GROUP BY with Multiple Joins
2019-09-20 23:45:51 +03:00
alexey-milovidov
3f500aad4b
Merge pull request #6976 from sfod/issue-3571
Throw exceptions if WITH TOTALS/ROLLUP/CUBE are specified without agg…
2019-09-20 23:39:00 +03:00
Alexey Milovidov
42b739550b Renamed "storage_policy_name" to "storage_policy" 2019-09-20 23:35:50 +03:00
alexey-milovidov
5314088648
Merge pull request #6980 from filimonov/huge_pk_performance_test
Adding performance test for huge pk (issue #6924)
2019-09-20 23:29:56 +03:00
Alexander Tokmakov
0080639f79 Merge branch 'master' into merging_values_with_expressions 2019-09-20 23:26:01 +03:00
Alexander Tokmakov
2c7384ff39 add performance test 2019-09-20 22:45:26 +03:00
Alexander Tokmakov
d353746f2b minor fixes 2019-09-20 22:44:52 +03:00
Ivan Lezhankin
9e46118edd Merge remote-tracking branch 'upstream/master' into issue-6459 2019-09-20 21:25:55 +03:00
Ivan Lezhankin
8cb0e58bc7 Fix build for all targets 2019-09-20 21:13:51 +03:00
alexey-milovidov
123b8cb43c
Merge pull request #6990 from Akazz/timeout_for_sync_replica_cmd
Fixed timeout mechanism for SYNC REPLICA command + simplified related code
2019-09-20 20:32:51 +03:00
alexey-milovidov
aabd6906f2
Merge pull request #6982 from 4ertus2/mjoin
PartialMergeJoin bugfixes
2019-09-20 20:19:00 +03:00
Ivan Lezhankin
967e00a8da It works!
if compiled with:

CC=clang CXX=clang++ cmake -Wno-dev . -Bbuild -GNinja -DCMAKE_AR:FILEPATH=x86_64-apple-darwin-ar -DCMAKE_RANLIB:FILEPATH=x86_64-apple-darwin-ranlib -DCMAKE_SYSTEM_NAME=Darwin -DSDK_PATH=MacOSX10.14.sdk -DLINKER_NAME=x86_64-apple-darwin-ld -DUSE_SNAPPY=OFF -DENABLE_SSL=OFF -DENABLE_PROTOBUF=OFF -DENABLE_PARQUET=OFF -DENABLE_READLINE=OFF -DENABLE_ICU=OFF -DENABLE_FASTOPS=OFF
2019-09-20 20:09:22 +03:00
millb
4f24512ba4 Test added. 2019-09-20 19:40:06 +03:00
millb
88adbb72d9 Fixed Function Hex for Float32 and Float64 2019-09-20 19:21:05 +03:00
chertus
7726130303 fix multiple joins aliasing for order by and group by 2019-09-20 19:01:19 +03:00
Amos Bird
b64bab29ed Outline methods to get needed instantiations. 2019-09-20 22:45:25 +08:00
sfod
bc9bcfdb7e Fix tests which use WITH TOTALS without aggregation 2019-09-20 17:42:30 +03:00
sfod
bf2654e093 Use sql file to test changes 2019-09-20 17:39:26 +03:00
maqroll
ca36e3f861 Attach error to force ip refresh 2019-09-20 12:36:09 +00:00
Ivan
cffc254922
Always read and insert Kafka messages as a whole (#6950)
* Always read and insert Kafka messages as a whole.
2019-09-20 15:12:32 +03:00
stavrolia
7309e813bc cleanup hdfs docs 2019-09-20 14:26:00 +03:00
Alexander Kazakov
2d807368e1 Adjusted timings in test + more verbose diagnostics 2019-09-20 00:20:58 +03:00
Azat Khuzhin
b2a3db1048
Ignore indices for CREATE TABLE .. AS .. if storage do not support them 2019-09-19 23:55:38 +03:00
chertus
0bc345fdc0 MergeJoin compare nullables 2019-09-19 20:09:59 +03:00
fenglv
2062bedaf0 Add repeat function 2019-09-20 00:46:41 +08:00
chertus
da14951ecd implement MergeJoin.joinTotals() 2019-09-19 17:53:03 +03:00
Alexander Kazakov
90c9d83fa5 Added missing newline at the EOF 2019-09-19 17:48:08 +03:00
alesapin
b289d7e6a5 Fix system contributors generating script 2019-09-19 17:41:49 +03:00
Alexander Kazakov
7a0f7a57e2 Chmod +x for test!!! 2019-09-19 15:48:18 +03:00
Akazz
4ae3db45c6 Fixed timeout reading in SYNC REPLICA 2019-09-19 14:04:57 +03:00
Vladimir Chebotarev
0ee6f6231a Added comments about redirecting requests and got rid of magic values. 2019-09-19 10:33:34 +00:00
Vladimir Chebotarev
12f7361095 Removed unused headers from ReadBufferFromS3.h 2019-09-19 10:25:31 +00:00
Vladimir Chebotarev
a5d6bd9e01 Proper passing of query parameters in initiate multipart upload. 2019-09-19 10:16:39 +00:00
Vladimir Chebotarev
a88d795f0f Proper passing of query parameters in initiate multipart upload. 2019-09-19 10:15:59 +00:00
Vladimir Chebotarev
283e09d2a5 Removed trash logging and fixed query parameters in multipart uploads. 2019-09-19 10:02:45 +00:00
Akazz
787a646680 Added a test to challenge timeout mechanism in SYNC REPLICA command 2019-09-19 13:00:44 +03:00
Vladimir Chebotarev
bd1ce56797 Tests decomposition. 2019-09-19 09:34:33 +00:00
philip.han
365f61c896 Fix code-style 2019-09-19 18:24:07 +09:00
maqroll
3765084358 Proper ReadWriteBufferFromHTTP constructor args 2019-09-19 07:33:54 +00:00
Zhichang Yu
0dc3866c36 added bitmapSubsetLimit 2019-09-19 10:15:36 +08:00
alexey-milovidov
1fe79ad43c
Merge pull request #6941 from dimarub2000/enums_in_section
IN with Enums numeric values
2019-09-19 02:24:34 +03:00
alexey-milovidov
9c675e50bb
Merge pull request #6963 from nicelulu/issue_6616
optimize limit 1,0 and test.
2019-09-19 02:23:56 +03:00
alexey-milovidov
01a1920e9b
Merge pull request #6970 from infinivision/add_bitmapMin_bitmapMax
added bitmapMin and bitmapMax
2019-09-19 02:01:16 +03:00
alexey-milovidov
1327e71d80
Changed C-style cast to constructor-style cast. 2019-09-19 02:01:06 +03:00
alexey-milovidov
7325f4a77b
Merge pull request #6974 from yandex/aku/mmap-linux
Use MAP_POPULATE only on Linux.
2019-09-19 01:58:40 +03:00
alexey-milovidov
bc1ecb0be5
Merge pull request #6951 from yandex/aku/alloc-continue
Make the quadratic Arena::allocContinue less bad.
2019-09-19 01:57:26 +03:00
alexey-milovidov
d7681d0239
Merge pull request #6977 from Akazz/minor_fixes_in_tests-2
Reworked flapping test - 00715_fetch_merged_or_mutated_part_zookeeper
2019-09-19 01:54:27 +03:00
alexey-milovidov
0bdb48ed65
Merge pull request #6966 from azat-archive/build--fixes
Add missing linking with jemalloc
2019-09-19 01:52:22 +03:00
alexey-milovidov
db470be077
Update merge_tree_huge_pk.xml 2019-09-18 23:07:23 +03:00
chertus
b8b6197288 partial_merge_join settings affects LEFT and INNER JOINs only 2019-09-18 22:12:53 +03:00
chertus
08a28d2dc2 fix pm join bug (wrong right equal range copy) 2019-09-18 21:44:44 +03:00
Azat Khuzhin
6cb5d0046b
Add missing linking with jemalloc for clickhouse_common_io
clickhouse_common_io incudes new_delete.cpp, that uses memory.h, which
uses sdallocx (jemalloc).

And since there is -Wl,--no-undefined every undefined symbols are not
allowed, hence clickhouse_common_io must know about sdallocx symbol.

For the default build (-DUNBUNDLED=OFF) everything is good, because
jemalloc is static, and clickhouse_common_io linked with libcommon
(which is linked with jemalloc)

But if jemalloc will be shared, and clickhouse_common_io and libcommon
is different shared libraries then clickhouse_common_io should be linked
with jemalloc, otherwise you will undefined reference to sdallocx error.

This can be reproduced using the following build configuration:
   -DUSE_STATIC_LIBRARIES=OFF -DCLICKHOUSE_SPLIT_BINARY=ON -DSPLIT_SHARED_LIBRARIES=ON -DUNBUNDLED=ON
Provided that you have systemd-wide jemalloc>=4 (see memory.h).

Refs: https://github.com/yandex/ClickHouse/pull/6878#discussion_r324902295
v2: do not link jemalloc if it is static
2019-09-18 21:26:23 +03:00
chertus
38a73fb551 add simple perf test for partial merge join 2019-09-18 20:04:10 +03:00
chertus
194e49e751 fix UB in MergeJoinCursor 2019-09-18 19:46:00 +03:00
Mikhail Filimonov
67e1cf9b73 Adding performance test for huge pk (issue #6924) 2019-09-18 17:35:45 +02:00
maqroll
952d9449a2 typo 2019-09-18 14:53:45 +00:00
root
8175d4c2d1 style checks
Committer: maqroll <loteroc@gmail.com>
2019-09-18 13:38:17 +00:00
Artem Zuikov
aae82eed5a
Merge pull request #6940 from 4ertus2/mjoin
PartialMergeJoin
2019-09-18 16:16:10 +03:00
Akazz
aa8ef05955 Reworked test 00715_fetch_merged_or_mutated_part_zookeeper 2019-09-18 16:14:56 +03:00
root
ea5480fd72 merge
Committer: maqroll <loteroc@gmail.com>
2019-09-18 13:13:40 +00:00
sfod
0bad4b4a05 Throw exceptions if WITH TOTALS/ROLLUP/CUBE are specified without aggregate functions 2019-09-18 16:08:51 +03:00
chertus
dd46c08e90 move JoinCommon funcs out of IJoin.h/cpp 2019-09-18 15:46:57 +03:00
Alexander Kuzmenkov
e3a9863260 Use MAP_POPULATE only on Linux. 2019-09-18 15:32:23 +03:00
chertus
0cf5bfdf44 fix typo 2019-09-18 15:24:35 +03:00
Alexander Kuzmenkov
e1898ca89a Make the quadratic Arena::allocContinue less bad.
Scenarios that use Arena::allocContinue may waste quadratically many
memory and perform quadratically many copying, when the memory range
size reaches Arena's linear allocation threshold. To alleviate this,
make sure that the next memory chunk allocated by allocContinue is at
least linear_growth_threshold bytes bigger than the previous one, so
that we don't reallocate and copy that often.
2019-09-18 15:04:56 +03:00
root
ee311ff03c style checks
Committer: maqroll <jluisoc@gmail.com>
2019-09-18 10:38:00 +00:00
CurtizJ
651f5b0e9f merging with master 2019-09-18 13:21:10 +03:00
CurtizJ
79a08ef8ea Merge remote-tracking branch 'upstream/master' into merging_redis 2019-09-18 12:58:22 +03:00
alexey-milovidov
fe9e110a6a
Merge pull request #6965 from azat-archive/sparsehash-c11
Replace libsparsehash with sparsehash-c11
2019-09-18 12:46:13 +03:00
philip.han
ff30f4d890 Add testcases for Arrays in bloom_filter index 2019-09-18 18:32:46 +09:00
philip.han
b25151b61b Make bloom_filter-index support some types of Arrays. 2019-09-18 18:32:44 +09:00
Zhichang Yu
460ccb04a2 added bitmapMin and bitmapMax 2019-09-18 16:56:12 +08:00
root
392bdd6008 +UpdatableSessionBase
Committer: maqroll <jluisoc@gmail.com>
2019-09-18 08:49:46 +00:00
alexey-milovidov
03014fe920
Merge pull request #6944 from malkfilipp/add-limit-clause-to-show-queries
Add LIMIT clause to SHOW queries
2019-09-18 02:07:45 +03:00
alexey-milovidov
d8cd375c8b
Merge pull request #6958 from proller/fix25
Build fixes
2019-09-18 01:48:46 +03:00
Azat Khuzhin
780341060f
Replace libsparsehash with sparsehash-c11
- use sparsehash-c11 over libsparsehash
- fix typos in find_sparsehash and users of the vars (s/SPARCE/SPARSE/)
- drop libsparsehash-dev from docker images (but keep for unbunlded build)
- use ::google over GOOGLE_NAMESPACE
2019-09-18 00:08:20 +03:00
root
f4b7cae998 optimize limit 1,0 and test. 2019-09-18 02:55:59 +08:00
chertus
2b3a4b0650 support const and LC columns in partial merge-join 2019-09-17 21:53:52 +03:00
CurtizJ
7ccf04440a better code in Redis external dictionary 2019-09-17 20:57:48 +03:00
chertus
58fad78980 support MergeJoin nullable convertion (right side) 2019-09-17 19:55:11 +03:00
alesapin
110568f980
Merge pull request #6947 from yandex/add_gdb_index
Add gdb index to builds with debug info
2019-09-17 17:59:27 +03:00
CurtizJ
df82e4bde8 fix build 2019-09-17 17:55:09 +03:00
CurtizJ
4480e97f9f fix build 2019-09-17 17:16:07 +03:00
CurtizJ
4df1f1bb9a better integration test for redis dictionary (but still bad) 2019-09-17 16:35:19 +03:00
malkfilipp
aab95fd517 Bump the test number 2019-09-17 15:41:25 +03:00
proller
e7f069c78c fixes 2019-09-17 12:33:46 +00:00
Guillaume Tassery
acaa9cdbad Rename move partition to partition_expr to move partition to table partition_expr 2019-09-17 13:59:09 +02:00
akuzm
75dc7d331e
Merge pull request #6937 from amosbird/ubmemfix
In hash tables, properly initialize zero key cell.
2019-09-17 14:57:38 +03:00
Guillaume Tassery
3308902c03 Reset replace partition 2019-09-17 12:43:58 +02:00
alesapin
33c3f7a6a2 Add gdb-index for gold linker with gdb-add-index tool 2019-09-17 12:49:27 +03:00
Guillaume Tassery
713cc6c825 Add lock before every function call 2019-09-17 11:00:20 +02:00
Dmitry Rubashkin
2252ee5a90 Branch refactoring. 2019-09-17 11:17:46 +03:00
Guillaume Tassery
53e8db43af Merge branch 'master' of https://github.com/yandex/ClickHouse into move_partition 2019-09-17 09:25:25 +02:00
Guillaume Tassery
3ac8f52dd8 call CloneAndLoadDataPart on database dest 2019-09-17 08:12:27 +02:00
chertus
da5d35b34e partial merge join (minimal tested version) 2019-09-16 22:31:22 +03:00
root
5ec0005400 +UpdatableSessionBase
Committer: maqroll <loteroc@gmail.com>
2019-09-16 17:28:41 +00:00
CurtizJ
e9336c9166 improvements of redis external dictionary 2019-09-16 19:17:56 +03:00
Dmitry Rubashkin
6fa925c263 Typo. 2019-09-16 18:47:13 +03:00
Dmitry Rubashkin
6f68cfc45c Removed (most probably) redundant if branch. Fixed VALUES table funtion. 2019-09-16 18:44:12 +03:00
Amos Bird
1cf47da60d ubsan/memsan fix. 2019-09-16 21:20:17 +08:00
chertus
cbd96af079 fix use after free (change Join <-> AnalyzedJoin ownership) 2019-09-16 15:37:46 +03:00
alesapin
719854b49b
Merge pull request #6939 from dimarub2000/perfomance_test_all_of
all_of setting in performance-test now works properly
2019-09-16 13:04:23 +03:00
Guillaume Tassery
a47f0b1a60 cleanup partition after moving it 2019-09-16 10:56:30 +02:00
Vitaly Baranov
fae612c3e7
Merge pull request #6907 from PerformanceVision/dict_allow_databases
Whitelist for dictionary from the current connected database
2019-09-16 11:52:25 +03:00
Guillaume Tassery
8920f36d96 merge master 2019-09-16 09:27:38 +02:00
Guillaume Tassery
ae8db96415 Fix move partition for storage merge tree 2019-09-16 06:17:37 +02:00
malkfilipp
ed42b94af7 Add tests 2019-09-15 19:08:26 +03:00
malkfilipp
98050c108f Add LIMIT clause to SHOW queries 2019-09-15 19:07:27 +03:00
Ivan Lezhankin
8c356a3830 WIP 2019-09-15 18:20:31 +03:00
Ivan Lezhankin
787c2b8d83 WIP 2019-09-15 13:35:19 +03:00
Ivan Lezhankin
01fdb802d4 Useful changes 2019-09-15 13:35:12 +03:00
alexey-milovidov
831eebe4dc
Merge pull request #6934 from abyss7/CLICKHOUSE-4643
Name temporary external table with existing subquery alias
2019-09-15 09:46:10 +03:00
Vitaly Baranov
a2c9bec468
Fix typo 2019-09-15 01:56:37 +03:00
Vitaly Baranov
c17071caf0
Fix typo 2019-09-15 01:55:22 +03:00
Vitaly Baranov
0fb234c63e
Merge branch 'master' into dict_allow_databases 2019-09-15 01:51:44 +03:00
Alexey Milovidov
79a206b092 Fixed typo #6895 2019-09-14 18:41:47 +03:00
alexey-milovidov
6503369138
Merge pull request #6895 from azat-archive/distributed_directory_monitor_max_sleep_time-v2
[RFC] Drop max_sleep_time limit from StorageDistributedDirectoryMonitor
2019-09-14 18:39:27 +03:00
Vladimir Chebotarev
d53872c300 Tests improvement. 2019-09-14 07:44:46 +00:00
Ivan
66d6e0cbb3 Update 01009_global_array_join_names.reference 2019-09-14 01:03:44 +03:00
Ivan
8fcf490bd9
Update 01009_global_array_join_names.reference 2019-09-14 00:58:39 +03:00
Ivan
33e6681c90
Update 01009_global_array_join_names.sql 2019-09-13 23:00:28 +03:00
Dmitry Rubashkin
57eef84322 DROP 2019-09-13 22:09:00 +03:00
Dmitry Rubashkin
ea3f80460c Tests. 2019-09-13 22:07:22 +03:00
Dmitry Rubashkin
33e7e1ea93 Int64 added. 2019-09-13 21:25:53 +03:00
Alexander Tokmakov
aa10bc99cc improvements 2019-09-13 21:19:14 +03:00
Dmitry Rubashkin
2705534be7 Merge branch 'enums_in_section' of github.com:dimarub2000/ClickHouse into enums_in_section 2019-09-13 20:50:53 +03:00
Dmitry Rubashkin
cd95e8e5e5 Fix inconsistent behaviour of IN with Enums 2019-09-13 20:49:53 +03:00
CurtizJ
ad986f285e fix redis with mixed keys 2019-09-13 20:38:56 +03:00
akuzm
e765733a26
Merge pull request #6925 from yandex/aku/msan
Some MemorySanitizer fixes
2019-09-13 20:26:48 +03:00
chertus
eb3d87032c all|any left|inner, not tested 2019-09-13 20:23:32 +03:00
alexey-milovidov
10e274213d
Merge pull request #6930 from filimonov/performance_test_lowcard_arr
performance test for lowcardinality array
2019-09-13 20:01:57 +03:00
dimarub2000
24d0055dc8 Typo 2019-09-13 19:24:59 +03:00
dimarub2000
26b1bc2093 all_of setting now works properly 2019-09-13 19:18:26 +03:00
chertus
bd957168d2 any left join (without use_nulls) 2019-09-13 19:17:37 +03:00
Ivan
d697f4a1d1
Update 01009_global_array_join_names.sql 2019-09-13 19:07:54 +03:00
Nikolai Kochetov
3c53dfd227 Add processors to StorageMergeTree [WIP]. 2019-09-13 18:41:09 +03:00
Ivan Lezhankin
5b60053ef7 [WIP] 2019-09-13 17:56:27 +03:00
Ivan Lezhankin
e692a88196 CMake now works
Example: -DCMAKE_SYSTEM_NAME=Darwin -DSDK_PATH=${HOME}/stuff/MacOSX10.12.sdk -DLINKER_NAME=${HOME}/.local/bin/ld64
2019-09-13 17:56:27 +03:00
Ivan Lezhankin
1b5192706e Some fixes for OS X build. 2019-09-13 17:56:26 +03:00
Ivan
add919e922
Update 01009_global_array_join_names.sql 2019-09-13 17:44:04 +03:00
Vladimir Chebotarev
4406ad1061 Tests fix. 2019-09-13 13:53:17 +00:00
Ivan Lezhankin
dc49303baf Use existing alias as external table name 2019-09-13 16:25:24 +03:00
Vladimir Chebotarev
2cddcebc31 Moved server to clickhouse instance in test. 2019-09-13 13:17:58 +00:00
Nikolai Kochetov
1f5e62d741 Added IStorage::readWithProcessors. 2019-09-13 15:59:48 +03:00
Nikolai Kochetov
1335aa75d7 Added TreeExecutor. 2019-09-13 15:34:05 +03:00
Guillaume Tassery
9cca599749 Add to database argument when we send to the server 2019-09-13 14:27:59 +02:00
Alexander Kuzmenkov
f4da0399c0 Some MemorySanitizer fixes. 2019-09-13 14:49:29 +03:00
Ivan Lezhankin
a3944624a0 Add test 2019-09-13 14:10:41 +03:00
alesapin
02cff38fef Merge with master 2019-09-13 13:58:23 +03:00
Vladimir Chebotarev
b324261285 Minor test fix. 2019-09-13 10:18:09 +00:00
Vladimir Chebotarev
a54b43cd01 Better test, minor fix. 2019-09-13 13:04:21 +03:00
Guillaume Tassery
2402e84bfc Merge branch 'master' of github.com:PerformanceVision/ClickHouse into move_partition 2019-09-13 11:20:40 +02:00
Nikolai Kochetov
4576e1f4b2 Enable Processors by default. 2019-09-13 11:59:46 +03:00
Nikolai Kochetov
86bee0b8b5
Merge pull request #6684 from yandex/processors-2
Processors 2
2019-09-13 11:58:04 +03:00
Guillaume Tassery
214d089bb5 Cosmetic and remove documentation 2019-09-13 10:26:04 +02:00
Guillaume Tassery
bb088fbf65 Write dictionary permission on user instead of dictionary configuration 2019-09-13 10:22:34 +02:00
alexey-milovidov
12c26e6013
Merge pull request #6891 from yandex/low_cardinality_in_native_http
Low cardinality in native http
2019-09-13 09:01:08 +03:00
alexey-milovidov
ba40858094
Merge pull request #6928 from proller/fix27
CLICKHOUSE-4652 Another fix for АrrayEnumerateUniqRanked with empty arrays
2019-09-13 08:57:30 +03:00
alexey-milovidov
b31c5d15b6
Merge pull request #6929 from vitlibar/better-http-server-in-test_dictionaries_all_layouts_and_sources
Better simulation of HTTP server for integration test
2019-09-13 08:55:38 +03:00
Mikhail Filimonov
3f9d4a5d8e performance test for lowcardinality array, showing significant performance degradation comparing to plain array 2019-09-12 22:46:31 +02:00
Alexander Tokmakov
2b9a1d6a60 optimize parsing numbers with type check 2019-09-12 23:23:20 +03:00
Vitaly Baranov
df372ba7b3 Better simulation of HTTP server used in the integration test test_dictionaries_all_layouts_and_sources 2019-09-12 23:11:25 +03:00
proller
0d6612d424 CLICKHOUSE-4652 Simpler 2019-09-12 22:52:24 +03:00
proller
8ce32897fa CLICKHOUSE-4652 Another fix for АrrayEnumerateUniqRanked with empty arrays 2019-09-12 22:38:34 +03:00
chertus
bb5287841f make things wrong 2 2019-09-12 21:06:25 +03:00
Nikolai Kochetov
2e61f17991 Disable processors by default. 2019-09-12 20:51:34 +03:00
Nikolai Kochetov
eac45eaf3e More priority to pinned tasks in PipelineExecutor. 2019-09-12 17:57:04 +03:00
Nikolai Kochetov
7a31d967d9 More priority to pinned tasks in PipelineExecutor. 2019-09-12 17:50:51 +03:00
CurtizJ
fa416dc941 fix Redis dictionary 2019-09-12 17:48:28 +03:00
Nikolai Kochetov
ec48361ef0 More priority to pinned tasks in PipelineExecutor. 2019-09-12 17:46:41 +03:00
Vladimir Chebotarev
1b715069fb Merge fix. 2019-09-12 14:38:53 +00:00
chertus
f7f2cface9 better nullability flags for JOINs 2019-09-12 17:09:05 +03:00
Nikolai Kochetov
1319168a3a Merge branch 'master' into processors-2 2019-09-12 16:28:51 +03:00
Nikolai Kochetov
9dea55c284 Do not pin sources for non MergeTree tables. 2019-09-12 16:23:24 +03:00
Nikolai Kochetov
1ff30b1621 Update PipelineExecutor. 2019-09-12 16:07:54 +03:00
chertus
441faba0e3 materializeBlockInplace function 2019-09-12 15:59:53 +03:00
chertus
61c940d5a9 better materialization logic in Join.cpp 2019-09-12 15:24:19 +03:00
Vladimir Chebotarev
599ff389f7 Merge fix. 2019-09-12 11:57:55 +00:00
Nikolai Kochetov
d7596e51b7 Removed convert_types_to_low_cardinality from NativeBlockInputStream. 2019-09-12 14:33:46 +03:00
Nikolai Kochetov
1b906bfeaf Remove LFStack. Added ThreadsQueue as separate data structure. 2019-09-12 14:22:58 +03:00
Nikolai Kochetov
4ba0ed731f Remove LFStack. Added ThreadsQueue as separate data structure. 2019-09-12 14:19:54 +03:00
Nikolai Kochetov
d0e84e630a Remove LFStack. Added ThreadsQueue as separate data structure. 2019-09-12 14:13:34 +03:00
Nikolai Kochetov
7d93d70e94 Remove LFStack. Added ThreadsQueue as separate data structure. 2019-09-12 14:07:36 +03:00
Nikolai Kochetov
4115d79a30 Added test for LowCardinality conversions in Native over http. 2019-09-12 12:51:29 +03:00
Nikolai Kochetov
959744fede Address header by name in NativeBlockInputStream. 2019-09-12 12:34:47 +03:00
Nikolai Kochetov
4722d371a1 Add test from #6862. 2019-09-12 11:45:19 +03:00
l
2b5a420f49 error: no newline at end of file [-Werror,-Wnewline-eof] 2019-09-12 07:41:16 +02:00
alexey-milovidov
c5cf4fa4f4
Merge pull request #6878 from azat-archive/build--fixes
Trivial build fixes (mostly for -DSPLIT_SHARED_LIBRARIES=ON)
2019-09-12 03:25:19 +03:00
alexey-milovidov
a14b3c7fcb
Merge pull request #6908 from infinivision/fix_6880
use croaring serialization functions
2019-09-12 03:21:05 +03:00
alexey-milovidov
cb2f4ebfaf
Merge pull request #6909 from abyss7/issue-6902
Put delimiter only after consuming a message
2019-09-12 03:20:38 +03:00
Azat Khuzhin
02befdd8c2
Introduce distributed_directory_monitor_max_sleep_time_ms setting
This will replace static 30 seconds max_sleep_time for the
StorageDistributedDirectoryMonitor, since in some cases 30 seconds can
be too large.
2019-09-12 03:16:06 +03:00
alexey-milovidov
f61212cdae
Merge pull request #6906 from amosbird/bf2
Fix non-ssl build.
2019-09-12 03:11:14 +03:00
alexey-milovidov
e7c6943f53
Merge pull request #6915 from amosbird/bf3
Robust shared build
2019-09-12 03:10:20 +03:00
Azat Khuzhin
d682a271ff
Missing Poco XML for copier (fixes -DSPLIT_SHARED_LIBRARIES=OFF build) 2019-09-12 02:04:43 +03:00
alexey-milovidov
6fbf9ca7ab
Merge pull request #6911 from yandex/fix-insert-select-data-loss
Fix insert select data loss
2019-09-12 00:36:59 +03:00
l
dda57fe0f7 Style checks 2019-09-11 23:08:54 +02:00
l
688b0d91a0 Style checks 2019-09-11 22:53:53 +02:00
Alexander Tokmakov
f323476111 Merge branch 'master' into merging_values_with_expressions 2019-09-11 23:31:37 +03:00
Amos Bird
93c0880ca7 Fix non-ssl build. 2019-09-12 04:20:27 +08:00
l
adb4a58092 Style checks & security considerations added to setting description. 2019-09-11 22:18:22 +02:00
Amos Bird
9152a832c4 Robust shared build 2019-09-12 04:01:46 +08:00
Alexander Tokmakov
29fe481b06 optimize expression template deduction 2019-09-11 22:55:28 +03:00
chertus
fc7ce2753d extract more common join functions 2019-09-11 21:03:21 +03:00
Nikolai Kochetov
d913e415b8 Fix Adam::merge if right state wasn't initialized. 2019-09-11 20:48:42 +03:00
alesapin
b0fce77c3d Fix path to data on disk 2019-09-11 20:17:10 +03:00
Nikolai Kochetov
95abc1f910 Removed dynamic_cast from PipelineExecutor. 2019-09-11 20:06:06 +03:00
l
cdbcfc2c90 + Redirect 2019-09-11 18:39:30 +02:00
Nikolai Kochetov
9916be2800 Small refactor in PipelienExecutor. Added comment in AggregatingTransform. 2019-09-11 19:31:15 +03:00
chertus
a836f0cfd6 fix columns number in MergeJoin 2019-09-11 19:19:33 +03:00
chertus
73dafaa223 better required-right-keys logic 2019-09-11 18:57:09 +03:00
Nikolai Kochetov
a2248868d8 Fix ast type checking. 2019-09-11 18:37:12 +03:00
Nikolai Kochetov
55acc72249 Added test. 2019-09-11 16:57:39 +03:00
Ivan Lezhankin
c5f1352394 Decide to put delimiter only after polled message 2019-09-11 16:16:43 +03:00
Ivan Lezhankin
622ab139ee Add test 2019-09-11 16:13:09 +03:00
alexey-milovidov
6b1352f65c
Merge pull request #6893 from malkfilipp/client_older_than_server
Display warning if clickhouse-client version is older than clickhouse-server.
2019-09-11 16:02:35 +03:00
alexey-milovidov
f1f177c451
Merge pull request #6896 from amosbird/bf
Build fix
2019-09-11 15:41:48 +03:00
alexey-milovidov
3ca084ec57
Merge pull request #6854 from Akazz/rwlock-cumulative-update-1
Rwlock sanitary update 1: removed weak_ptrs from implementation + added strong exception safety guarantee
2019-09-11 15:40:28 +03:00
Zhichang Yu
6c5019ca39 use croaring serialization functions 2019-09-11 12:35:43 +00:00
Nikolai Kochetov
a59ae3826d Do not flush output stream in copy data. Add special flushing callback to Watch query. 2019-09-11 14:38:05 +03:00
Guillaume Tassery
140883ab83 Cosmetic 2019-09-11 13:17:43 +02:00
Guillaume Tassery
5f1621faa2 Add database right for dictionaries 2019-09-11 13:14:55 +02:00
alesapin
0b8aec469f Make absolute path on disks start from /clickhouse/data, fix freeze and rename, add tests 2019-09-11 13:57:32 +03:00
Nikolai Kochetov
172e4d76d7 Added more comments. 2019-09-11 13:46:41 +03:00
Nikolai Kochetov
96f7eb1141 Change number of aggregating streams. 2019-09-11 13:07:04 +03:00
malkfilipp
62f85c0a3a Switch to tuples 2019-09-11 11:41:57 +03:00
Amos Bird
bf799fef92 Build fix 2019-09-11 10:53:56 +08:00
Azat Khuzhin
6c646a6978
Missing <chrono> for gtest_sensitive_data_masker
I guess that <chrono> had been included somewhere before in primary env.
2019-09-11 02:04:11 +03:00
alexey-milovidov
a446ec5e61
Merge pull request #6882 from clemrodriguez/issue-6825
Fix too early MySQL connection closure in MySQLBlockInputStreamream.cpp
2019-09-11 02:03:20 +03:00
alexey-milovidov
254102c5bd
Merge pull request #6602 from amosbird/object-library
Split libdbms.so using object library
2019-09-11 02:00:13 +03:00
malkfilipp
b63d2422d0 Change versions comparing from string to number 2019-09-11 01:29:21 +03:00
Akazz
7b65dfb867 Build fixed 2019-09-11 01:21:08 +03:00
alexey-milovidov
8fa72c6804
Update Client.cpp 2019-09-10 23:10:23 +03:00
Akazz
40a9495267 Some formatting + minor change 2019-09-10 22:58:04 +03:00
malkfilipp
058c04e759 Add a warning if the client is older than the server 2019-09-10 22:28:33 +03:00
akuzm
ab85d145a2
Merge pull request #6873 from yandex/aku/internal-iteration
Use internal iteration over hash tables in Aggregator.
2019-09-10 22:02:53 +03:00
Amos Bird
8f28a36c17 Use internal iteration over hash tables in Aggregator.
For compound hash tables such as the future StringHashMap, an
iterator-based API might be inefficient for iterating over a table or
for merging two tables, because:

1) the key has to be converted to a general format from a from a
   component-specific format, which may differ between the components;

2) the information about the component of the compound hash table to
   which the value belongs is lost, and has to be recalculated if the
   value is reinserted.

A more efficient approach is to use internal iteration, that is,
map-like functions, which avoids unnecessary conversions when iterating,
and allows to use an efficient component-wise approach when merging.
2019-09-10 21:52:53 +03:00
chertus
8afa48fa42 some joins code unification 2019-09-10 21:39:10 +03:00
Amos Bird
a1310ffbe6 Split libdbms.so using object library
Now the linking time of incremental builds are around 1-2 seconds
2019-09-11 01:56:01 +08:00
alesapin
34a454aa62 Remove redundant code, that caused race for part object 2019-09-10 20:17:10 +03:00
Alexander Kuzmenkov
160e0faf77 Do not use iterator::getValue() in Aggregator.
Use separate key and "mapped" value references instead. This is
important for hash tables that do not store the key/"mapped" pair
directly, and cannot provide this interface without some runtime
overhead.
2019-09-10 20:12:30 +03:00
Alexander Kuzmenkov
8e9a8584e0 Do not provide mutable key access in hash map cells.
We don't need it anymore after we changed the hash table key memory
management to use callbacks. Removing this interface is important for
hash maps that do not store the key, such as FixedHashMap or the
prospective compound StringHashMap.
2019-09-10 20:12:30 +03:00
Nikolai Kochetov
e9e0bd82b9 Change number of aggregating streams. 2019-09-10 20:08:06 +03:00
Nikolai Kochetov
bcc764e2cd Use header in native format created in InterpreterSelectQuery. Fill missed columns in Native format. 2019-09-10 19:45:53 +03:00
Nikolai Kochetov
7ddc8a6dde Use header in native format created in InterpreterSelectQuery. Fill missed columns in Native format. 2019-09-10 19:41:05 +03:00
Nikolai Kochetov
8dd8ab7d1f Use header in native format created in InterpreterSelectQuery. Fill missed columns in Native format. 2019-09-10 19:31:41 +03:00
chertus
02691f50ef make things wrong 2019-09-10 17:51:28 +03:00
alesapin
5a45265344 Create global dir 2019-09-10 17:32:32 +03:00
Nikolai Kochetov
071b5dd514 Add LowCardinality conversion to Native format if types of columns are not equals. 2019-09-10 17:30:13 +03:00
Nikolai Kochetov
30394113a1 Add LowCardinality conversion to Native format if types of columns are not equals. 2019-09-10 17:16:31 +03:00
Nikolai Kochetov
8734c8339e Fix race in PipelineExecutor. 2019-09-10 16:12:18 +03:00
alesapin
65851e27d0 Fix freeze partition 2019-09-10 16:06:26 +03:00
akazz
33f462d011 Dropped some garbage lines 2019-09-10 15:37:14 +03:00
akazz
4f71fe715c Strong exception safety guarantee:
Based on std::list<>::emplace_back() and std::unordered_map<>::emplace()
provide strong exception safety, RWLockImpl is now changed to provide
the same level of exception safety.
2019-09-10 15:33:45 +03:00
alesapin
ac4ab3ca2b Fix rename bug 2019-09-10 15:23:18 +03:00
Nikolai Kochetov
7b0a6aec05 Fix raice in PipelineExecutor. 2019-09-10 15:14:47 +03:00
alesapin
193049293a More comments, more readable code 2019-09-10 14:21:59 +03:00
Nikolai Kochetov
3646124873 Fix raice in PipelineExecutor. 2019-09-10 14:17:55 +03:00
Nikolai Kochetov
a9d41d580a Fix asan crash in PipelineExecutor. 2019-09-10 12:50:38 +03:00
alesapin
4702e40ed7 Fix bug with b_free and small refactoring 2019-09-10 11:56:27 +03:00
Nikolai Kochetov
72fea5bf97 Added ThreadsQueue to PipelineExecutor. 2019-09-10 11:50:31 +03:00
Nikolai Kochetov
73bda85998 Added ThreadsQueue to PipelineExecutor. 2019-09-10 11:45:48 +03:00
Clément Rodriguez
10be7809cd
Fix connection to early MySQL connection closure in MySQLBlockInputStream.cpp 2019-09-10 10:21:13 +02:00
Nikolai Kochetov
5165bbd88a Fix asan crash in PipelineExecutor. 2019-09-10 11:03:02 +03:00
proller
54a5b801b7 Build fixes (Orc, ...) (#6835)
* Fix build

* cmake: fix cpuinfo

* Fix includes after processors merge

Conflicts:
	dbms/src/Processors/Formats/Impl/CapnProtoRowInputFormat.cpp
	dbms/src/Processors/Formats/Impl/ParquetBlockOutputFormat.cpp
	dbms/src/Processors/Formats/Impl/ProtobufRowInputFormat.cpp
	dbms/src/Processors/Formats/Impl/ProtobufRowOutputFormat.cpp

* Fix build in gcc8

* fix test link

* fix test link

* Fix test link

* link fix

* Fix includes after processors merge 2

Conflicts:
	dbms/src/Processors/Formats/Impl/ParquetBlockInputFormat.cpp

* Fix includes after processors merge 3

* link fix

* Fix likely/unlikely conflict with cython

* Fix conflict with protobuf/stubs/atomicops.h

* remove unlikely.h

* Fix macos build (do not use timer_t)

* wip

* Fix build (orc, ...)

* Missing files

* Try fix

* fix hdfs

* Fix llvm 7.1 find
2019-09-10 00:40:40 +03:00
chertus
1b313eedfa MergeJoin in progress 2019-09-09 22:43:37 +03:00
Nikolai Kochetov
eeba24b238 Try to fix race in PipelineExecutor. 2019-09-09 20:56:58 +03:00
Nikolai Kochetov
423a5c35e8 Try to fix race in PipelineExecutor. 2019-09-09 20:12:26 +03:00
Nikolai Kochetov
da798142a5 Try to fix race in PipelineExecutor. 2019-09-09 20:10:37 +03:00
Alexander Tokmakov
3643ecc9cd parse expressions near the end of buffer correctly 2019-09-09 20:06:22 +03:00
alesapin
23f2cb5016 Remove double space 2019-09-09 20:02:52 +03:00
alesapin
189644e743 Better logging 2019-09-09 20:01:19 +03:00
Ivan
6c32fc3fc1
Store offsets manually for each message (#6872) 2019-09-09 19:59:51 +03:00
Nikolai Kochetov
9df1235046 Pin sources to streams in PipelineExecutor. 2019-09-09 19:53:02 +03:00
Nikolai Kochetov
818696a9a7 Pin sources to streams in PipelineExecutor. 2019-09-09 19:29:11 +03:00
Nikolai Kochetov
3a849c3c5f Pin sources to streams in PipelineExecutor. 2019-09-09 18:43:19 +03:00
Nikolai Kochetov
038aa82305 Update TCPHandler 2019-09-09 17:57:12 +03:00
alesapin
1bc0aaeb35 Less code, more comments 2019-09-09 17:20:07 +03:00
alesapin
9f88baebb9 More constants, better tests 2019-09-09 16:50:19 +03:00
Nikolai Kochetov
c9cca3ba8b Merged with master 2019-09-09 16:20:30 +03:00
Vasily Nemkov
1b0410cee7 Merge commit '50928323ebabe0663e26601c3929ee94b9a5127d' into DateTime64 2019-09-09 16:18:22 +03:00
alesapin
2288d25972 Add parser test 2019-09-09 15:41:46 +03:00
alesapin
ef08d6f10b More tests 2019-09-09 15:28:28 +03:00
Nikolai Kochetov
04d2f32e17 Check thread is joinable in PipelineExecutor. 2019-09-09 15:09:48 +03:00
alesapin
27419c965e Merge with master 2019-09-09 14:13:36 +03:00
CurtizJ
3b3657ff1e Merge branch 'add-ext-dict-redis' of https://github.com/comunodi/ClickHouse into merging_redis 2019-09-09 13:51:50 +03:00
Yuriy
6700314ce5 destroying context after executeQuery 2019-09-09 04:04:37 +03:00
alexey-milovidov
8389200229
Merge pull request #6832 from CurtizJ/merging_input_function
Merging #5450 (table function input).
2019-09-07 20:16:45 +03:00
Vasily Nemkov
2185531f70 DateTime64 tests 2019-09-07 17:22:22 +03:00
alexey-milovidov
25de2e12a2
Merge pull request #6399 from Enmk/replica_recovery_interval
Improvements for failover of Distributed queries
2019-09-07 03:21:30 +03:00
alexey-milovidov
b7cbd33886
Merge pull request #6729 from yandex/aku/key-holder
Key memory management for compound hash tables.
2019-09-07 03:09:18 +03:00
alexey-milovidov
b3e30d51c3
Update HashTableKeyHolder.h 2019-09-07 03:09:07 +03:00
alexey-milovidov
46e7b4f925
Merge pull request #6853 from yandex/pipe-capacity-very-old-kernels
Returned support for very old Linux kernels (that lack of F_GETPIPE_SZ fcntl)
2019-09-07 03:01:42 +03:00
Olga Khvostikova
e8d8dbc40b
Merge pull request #6855 from yandex/code-cleanup-storagefile
Minor code cleanup in StorageFile
2019-09-07 01:34:27 +03:00
Alexander Tokmakov
d78c82a8ae fixes 2019-09-06 22:01:44 +03:00
alexey-milovidov
be8341d174
Merge pull request #6851 from Akazz/minor_fixes_in_tests-1
Fixing a few things in stateless tests
2019-09-06 22:00:54 +03:00
stavrolia
f533485d19 Minor code cleanup 2019-09-06 21:29:41 +03:00
alexey-milovidov
00edf4fac3
Update HashTable.h 2019-09-06 21:19:50 +03:00
alexey-milovidov
805bd31641
Update dbms/src/Common/HashTable/HashTable.h
Co-Authored-By: akuzm <36882414+akuzm@users.noreply.github.com>
2019-09-06 21:12:31 +03:00
filimonov
526afd44ed Make SensitiveDataMasker a singleton. (#6810)
Among other things, it is used to filter logs, which are being written even after the global server context is deinitialized, so we can't keep masker there.
2019-09-06 20:48:27 +03:00
alexey-milovidov
2ffc99b893
Merge pull request #6846 from yandex/aku/fixed-hash-table
Cosmetic change: remove redundant functions from FixedHashTable
2019-09-06 20:20:26 +03:00
alexey-milovidov
71ed9477dc
Update FixedHashTable.h 2019-09-06 20:20:19 +03:00
alexey-milovidov
c90dfc1e48
Merge pull request #6837 from filimonov/fix_some_pvs_reported_issues
Fix some pvs reported issues
2019-09-06 20:15:14 +03:00
Alexey Milovidov
1c3fab8f2c Returned support for very old Linux kernels (that lack of F_GETPIPE_SZ fcntl) 2019-09-06 20:10:28 +03:00
Nikolai Kochetov
3bd5d84ecc Update PipelineExecutor. 2019-09-06 19:04:18 +03:00
akazz
f511337028 Fixing minor things 2019-09-06 18:54:33 +03:00
akazz
0f9b91a663 Cosmetic stuff 2019-09-06 18:45:49 +03:00
Alexey Milovidov
f2d077f248 Enable "use_minimalistic_part_header_in_zookeeper" by default 2019-09-06 18:30:54 +03:00
akazz
e7235cdcfd Minor changes 2019-09-06 18:13:22 +03:00
alesapin
cfd753a1f3 Add test and found bugs 2019-09-06 18:09:20 +03:00
Alexander Kuzmenkov
cacf6d3282 Key memory management for compound hash tables.
Some aggregation methods initially emplace a temporary StringRef key
into a hash table. Then, if the key was not seen before, they make a
persistent copy of the key and update the hash table with it. This
approach is not suitable for compound hash tables, because the logic of
when the persistent key is needed is more complex, and is contained
within the hash table itself.

In this commit, we switch to managing key memory with callbacks passed
to the hash table, that allow it to request a persistent copy of the key
if it is needed. This should be more appropriate for compound hash
tables.

This commit prepares for StringHashMap PR #5417.
2019-09-06 18:05:28 +03:00
robot-clickhouse
04d2bb9cfd Auto version update to [19.15.1.1] [54426] 2019-09-06 17:58:33 +03:00
robot-clickhouse
f2b775b02e Auto version update to [19.14.1.1274] [54425] 2019-09-06 17:58:04 +03:00
Alexander Kuzmenkov
05095111a1 Cosmetic change: remove redundant functions from FixedHashTable 2019-09-06 17:47:32 +03:00
akazz
13631d2da3 Removed some garbage 2019-09-06 16:58:37 +03:00
Nikolai Kochetov
32cc3a4bee Revert enumerate streams. 2019-09-06 16:28:49 +03:00
Anton Popov
69da4f30b3
Merge branch 'master' into merging_input_function 2019-09-06 16:20:00 +03:00
filimonov
f505549b43
changed wrong pvs suppression code 2019-09-06 14:46:42 +02:00
Nikolai Kochetov
52305cefbc Merge branch 'merging-aggregated-processors' into processors-2 2019-09-06 15:21:17 +03:00
Nikolai Kochetov
d10b7d7a2b Added ConvertingAggregatedToChunksTransform. 2019-09-06 15:19:59 +03:00
alesapin
ea8e543b1a Add protocol version to cookies 2019-09-06 15:18:56 +03:00
alesapin
571ed1bb25
Merge pull request #6840 from filimonov/history_file_from_env
Ability to change history path by changing env
2019-09-06 13:22:49 +03:00
alesapin
0c9a9dee1c Merge with master 2019-09-06 11:53:32 +03:00
alexey-milovidov
3d8ec8fb33
Merge pull request #6823 from yandex/fancyqlx-master
Merge #6167
2019-09-06 03:18:26 +03:00
alexey-milovidov
05a1a7ac71
Update InterpreterSelectQuery.cpp 2019-09-06 03:18:06 +03:00
alexey-milovidov
18dcb3753d
Merge pull request #6824 from 4ertus2/mjoin
Refactoring (ExpressionAnalyzer & SubqueryForSet)
2019-09-06 03:17:16 +03:00
Mikhail Filimonov
34f393c17e Ability to change history path by changing env 2019-09-06 01:35:25 +02:00
Denis Zhuravlev
50c32490be
Update arrayElement.cpp
Typo in error message ( is -> are )
2019-09-05 19:41:27 -03:00
Olga Khvostikova
4129d8cf60
Merge pull request #6092 from yandex/globs-in-file-one-more-attempt
Globs in storage file and HDFS
2019-09-05 23:05:37 +03:00
Olga Khvostikova
f90642ce23
Merge pull request #6610 from CurtizJ/merging_with_ties_and_with_fill
WITH TIES modifier for LIMIT and WITH FILL modifier for ORDER BY. (continuation of #5069)
2019-09-05 22:45:48 +03:00
akazz
32c77cd933 Dropped weak_ptrs! 2019-09-05 21:09:33 +03:00
stavrolia
5e37510aae Better 2019-09-05 21:09:19 +03:00
Mikhail Filimonov
b40204a360 PVS https://clickhouse-test-reports.s3.yandex.net/0/2cda8f1563e9b2d11f75c68db817c3f68ace1160/pvs_studio_report/pvs-studio-html-report/sources/InterpreterSelectQuery.cpp_24.html#ln430 2019-09-05 19:23:36 +02:00
Mikhail Filimonov
622ea38b21 PVS false positive https://clickhouse-test-reports.s3.yandex.net/0/2cda8f1563e9b2d11f75c68db817c3f68ace1160/pvs_studio_report/pvs-studio-html-report/sources/Context.cpp_21.html#ln1226 2019-09-05 18:59:15 +02:00
Mikhail Filimonov
cfb0431994 PVS https://clickhouse-test-reports.s3.yandex.net/0/2cda8f1563e9b2d11f75c68db817c3f68ace1160/pvs_studio_report/pvs-studio-html-report/sources/executeQuery.cpp_26.html#ln33 2019-09-05 18:57:13 +02:00
alesapin
ab518d7787 Split code to parts 2019-09-05 18:53:23 +03:00
akazz
9b55e66755 WIP - About to give up storing weak_ptrs! 2019-09-05 18:19:36 +03:00
akazz
ab6ae7c82b Refactored Clients -> Referers 2019-09-05 18:14:17 +03:00
stavrolia
587a780ba2 Better 2019-09-05 17:42:17 +03:00
Alexander Tokmakov
196e357250 revert parsing expression near the end of buffer 2019-09-05 16:55:51 +03:00
CurtizJ
b04cea7463 minor fixes of table function input 2019-09-05 16:17:01 +03:00
alesapin
f576cbb8a4 Simplify code 2019-09-05 16:12:29 +03:00
akazz
d374a6fb58 Better 2019-09-05 15:49:20 +03:00
akazz
838957f0e2 Cosmetics 2019-09-05 15:45:44 +03:00
akazz
54b4db36eb Changed FastPath + better diagnostics 2019-09-05 15:20:10 +03:00
Vasily Nemkov
c2fc71b5e5 Post-PR fixes
Renamed settings, updated docs.
2019-09-05 13:35:36 +03:00
alesapin
b71faee8cd Merge branch 'master' into ObjatieGroba-feature_multiple_disks 2019-09-05 13:19:05 +03:00
Nikolai Kochetov
e1e600b8b3 Update test with sample and prewhere. 2019-09-05 10:42:14 +03:00
Alexey Milovidov
a4c1d64aba Allowed to run test with the server run from source tree 2019-09-05 07:50:08 +03:00
Ivan
ab7df6b6dd
Fix kafka tests (#6805)
* Commit offsets more precisely
* Get rid of DelimitedReadBuffer since read buffers don't line up well
* Increase timeouts
2019-09-05 00:25:33 +03:00
Alexander Tokmakov
20770a9745 check if some tests fail 2019-09-04 23:27:13 +03:00
Alexander Tokmakov
52fb9585d4 improvements 2019-09-04 22:59:08 +03:00
stavrolia
5d6959173c Improvement 2019-09-04 22:55:56 +03:00
alesapin
66362cedbc Refactoring 2019-09-04 21:26:18 +03:00
alesapin
c003f443f9 Refactor 2019-09-04 20:26:53 +03:00
alexey-milovidov
b310d755fe
Merge pull request #6819 from infinivision/fix_6761_bitmap_mem_leak
fix bitmapSubsetInRange memory leak
2019-09-04 19:58:49 +03:00
Alexander Tokmakov
8936f854be better checking of types of literals 2019-09-04 19:54:20 +03:00
Nikolai Kochetov
0d1846baab Update test create table if not exists sample_prewhere 2019-09-04 19:46:10 +03:00
chertus
a395be3e91 minor changes 2019-09-04 19:37:05 +03:00
chertus
b854c945ad some more ExpressionAnalyzer refactoring 2019-09-04 19:20:02 +03:00
Alexey Milovidov
f2c2a2a9ea Fixed unit test 2019-09-04 19:13:05 +03:00
Vladimir Chebotarev
fa01cc162c Merge fix. 2019-09-04 16:10:25 +00:00
alesapin
13bbae5860 Remove trash 2019-09-04 19:00:20 +03:00
Nikolai Kochetov
3bd453985b Merge branch 'master' of https://github.com/fancyqlx/ClickHouse into fancyqlx-master 2019-09-04 18:48:12 +03:00
alesapin
544dd33b9a
Merge pull request #6816 from yandex/fix_mutations_granularity_bug
Fix bug with mutations after granularity change
2019-09-04 17:49:52 +03:00
Nikolai Kochetov
30155f92bf Try to enumerate streams again. 2019-09-04 17:16:32 +03:00
Nikolai Kochetov
b98676836e Try to enumerate streams again. 2019-09-04 17:06:41 +03:00
Zhichang Yu
cfac445144 fix bitmapSubsetInRange memory leak 2019-09-04 22:05:32 +08:00
Vladimir Chebotarev
81f49d97bd Minor fix. 2019-09-04 13:39:54 +00:00
Vladimir Chebotarev
e9300ffbb5 Tests finally works! 2019-09-04 13:39:54 +00:00
Vladimir Chebotarev
8c4eb13be6 Fixed unavailable test servers issue in test_storage_s3. 2019-09-04 13:39:54 +00:00
Vladimir Chebotarev
3e4af7b844 Attempt to make integration tests. 2019-09-04 13:39:54 +00:00
Vladimir Chebotarev
c891590709 Added even better warning. 2019-09-04 13:39:54 +00:00
Vladimir Chebotarev
ab456262d9 Fixed multipart mechanism and added a warning about 10k parts. 2019-09-04 13:39:54 +00:00
Vladimir Chebotarev
97b7635c8a Minimum block size to configuration. 2019-09-04 13:39:54 +00:00
Vladimir Chebotarev
395560df1b Fixed multipart uploads and 100-continue. 2019-09-04 13:39:54 +00:00
Vladimir Chebotarev
c6136c2b16 Test improvement. 2019-09-04 13:39:54 +00:00
Vladimir Chebotarev
fa0de006d0 More style fixes. 2019-09-04 13:39:54 +00:00
Vladimir Chebotarev
a9153b2fb3 Style fixes. 2019-09-04 13:39:54 +00:00
Vladimir Chebotarev
af45849ce0 Minor test fixes. 2019-09-04 13:39:53 +00:00
Vladimir Chebotarev
96d093f9ad Clang compatibility fixes. 2019-09-04 13:39:53 +00:00
Vladimir Chebotarev
248e26d59f Attempt to make multipart uploads. 2019-09-04 13:39:53 +00:00
Vladimir Chebotarev
10a7f80af1 Stubs for multipart uploads. 2019-09-04 13:39:53 +00:00
Vladimir Chebotarev
dd32c92f2a Minor fixes. 2019-09-04 13:39:53 +00:00
Vladimir Chebotarev
6b9397e805 Tests fixes. 2019-09-04 13:39:53 +00:00
alexey-milovidov
d3db5a3890 Update TableFunctionS3.h 2019-09-04 13:39:53 +00:00
Vladimir Chebotarev
63164db019 Fixed S3 PUT redirects. 2019-09-04 13:39:53 +00:00
Vladimir Chebotarev
634f82d0ad Minor fix. 2019-09-04 13:39:53 +00:00
Vladimir Chebotarev
ff69112919 Attempt to make S3 PUT redirects (wip). 2019-09-04 13:39:53 +00:00
Vladimir Chebotarev
cca3a9acc7 Added test for PUT redirect. 2019-09-04 13:39:53 +00:00
Vladimir Chebotarev
ae40d68eb0 Updated tests. 2019-09-04 13:39:53 +00:00
Vladimir Chebotarev
7236ae0d8d Fixed 411 error when putting to S3. 2019-09-04 13:39:53 +00:00
Vladimir Chebotarev
0504eb58be Correct S3 PUT requests in WriteBufferFromS3. 2019-09-04 13:39:53 +00:00
Vladimir Chebotarev
19642cf822 Tests update. 2019-09-04 13:39:53 +00:00
Vladimir Chebotarev
efade38d7b Fixed test, so it does not pass now. 2019-09-04 13:39:53 +00:00
Vladimir Chebotarev
1944ff1a48 POST to PUT, refactoring. 2019-09-04 13:39:53 +00:00
Vladimir Chebotarev
52f242daf0 tests (WIP) 2019-09-04 13:39:53 +00:00
Vladimir Chebotarev
062db0ec14 Removed templateness of ReadWriteBufferFromS3. 2019-09-04 13:39:53 +00:00
Vladimir Chebotarev
531460396d POST S3 requests. 2019-09-04 13:39:53 +00:00
Vladimir Chebotarev
caeacafb76 Fixed GET redirects. 2019-09-04 13:39:53 +00:00
Vladimir Chebotarev
78f57c5f2a First attempt to make redirects. 2019-09-04 13:39:53 +00:00
Vladimir Chebotarev
ff09934219 Table function and storage. 2019-09-04 13:39:53 +00:00
Vladimir Chebotarev
47985cf8a7 Wrong commit. 2019-09-04 13:39:53 +00:00
Vladimir Chebotarev
ce69683673 Copy-paste from StorageFile. 2019-09-04 13:39:53 +00:00
alesapin
a4c3937153 Small refactoring 2019-09-04 16:24:55 +03:00
Nikolai Kochetov
b9e26d15de Try to enumerate streams again. 2019-09-04 16:17:50 +03:00
alesapin
3ffa9fa972 Resolve conflict 2019-09-04 15:44:12 +03:00
alesapin
8b6abab486 Merge branch 'master' into ObjatieGroba-feature_multiple_disks 2019-09-04 15:41:27 +03:00
Nikolai Kochetov
3a7e7287c0 Update PipelineExecutor. 2019-09-04 15:34:15 +03:00
CurtizJ
7accc09066 Merge branch 'palasonic-add-input-function' of https://github.com/palasonic1/ClickHouse into merging_input_function 2019-09-04 15:25:20 +03:00
alesapin
18ef235a3f Fix indices mrk file extension 2019-09-04 15:22:20 +03:00
alesapin
16a544f300 Fix bug with mutations after granularity change 2019-09-04 15:19:42 +03:00
stavrolia
32bf915610 More docs 2019-09-04 14:11:30 +03:00
chertus
904cfed046 better includes 2019-09-04 13:15:34 +03:00
Nikolai Kochetov
5246be8a17 Update PipelineExecutor. 2019-09-04 12:37:56 +03:00
Alexey Milovidov
6176041935 Fixed style 2019-09-04 02:08:46 +03:00
Alexey Milovidov
ece7a05cec Added an example of query masking rules for developers 2019-09-04 02:07:08 +03:00
CurtizJ
9cfcbd6649 fix bug in FillingBlockInputStream 2019-09-04 01:01:09 +03:00
Alexey Milovidov
843f8303b0 Minor modifications 2019-09-03 23:27:46 +03:00
Alexey Milovidov
9959e8d3e1 Fixed build 2019-09-03 23:07:27 +03:00
alexey-milovidov
b2e80b0cd9
Merge branch 'master' into query_masking 2019-09-03 22:58:15 +03:00
alexey-milovidov
1ae8150f28
Update Context.cpp 2019-09-03 22:53:59 +03:00
alexey-milovidov
4f7d472cb7
Merge pull request #6048 from Akazz/ternary-logic-light
Correct implementation of ternary logic for AND/OR
2019-09-03 22:09:56 +03:00
alexey-milovidov
5f33fd946f
Merge pull request #6711 from dimarub2000/exception_while_insert
Exception check added in client when sending insertion data.
2019-09-03 21:47:48 +03:00
akuzm
357f59cc48
Merge pull request #6667 from yandex/aku/mmap-populate
Pre-fault pages when allocating memory with mmap().
2019-09-03 21:41:53 +03:00
alexey-milovidov
152dba1b2e
Merge pull request #6796 from CurtizJ/fix-flappy-ttl-test
Fix column TTL with user defaults.
2019-09-03 21:35:00 +03:00
Alexey Milovidov
9cf0c780fb Better code 2019-09-03 21:23:13 +03:00
alexey-milovidov
845a612b95
Merge pull request #6773 from infinivision/fix_issue_6575
fix DataTypeAggregateFunction deserialization
2019-09-03 21:19:41 +03:00
Nikolai Kochetov
73c052f576 Revert PipelineExecutor changes. 2019-09-03 21:05:44 +03:00
alesapin
94fe4e6521 better test 2019-09-03 20:16:01 +03:00
alesapin
e6e6c11ba3 Better test and NOTHING_TO_DO 2019-09-03 20:06:36 +03:00
Artem Zuikov
0a998fddce
Merge pull request #6801 from 4ertus2/mjoin
Refactoring: wrap Join logic via AnalyzedJoin iface
2019-09-03 19:53:49 +03:00
Zhichang Yu
fd0947899d fix 00980_shard_aggregation_state_deserialization.sql 2019-09-03 23:47:09 +08:00
alesapin
52442cf549 Add system stop moves query 2019-09-03 17:50:49 +03:00
chertus
bb3dedf1dc move Join object from ExpressionAction into AnalyzedJoin 2019-09-03 17:36:02 +03:00
stavrolia
97ac979645 Add docs for hdfs and fix some review comments 2019-09-03 17:23:51 +03:00
Dmitry Rubashkin
40a056c79b Better naming. 2019-09-03 16:55:26 +03:00
alex-zaitsev
9032d8a196
Fixed tcp_keep_alive_timeout description 2019-09-03 16:30:15 +03:00
Nikolai Kochetov
16284b98b5 Disable 00963_achimbab for processors pipeline. 2019-09-03 15:42:24 +03:00
alesapin
48004e9b7b Style fixes 2019-09-03 15:25:58 +03:00
Nikolai Kochetov
5113bd3650 Add task stilling to PipelineExecutor. 2019-09-03 15:06:45 +03:00
alexey-milovidov
87e061d0e1
Merge pull request #6733 from 4ertus2/some
Add subquery_requires_alias setting (disabled by default)
2019-09-03 14:34:28 +03:00
alexey-milovidov
ab75e8c26d
Merge pull request #6205 from zhang2014/fix/some_mutation
fix some mutation bug
2019-09-03 14:33:20 +03:00
alesapin
8d76febe02 Add moves to part log 2019-09-03 14:32:25 +03:00
Nikolai Kochetov
aa9481e76e Add task stilling to PipelineExecutor. 2019-09-03 14:22:34 +03:00
alexey-milovidov
7847de1947
Merge pull request #6629 from CurtizJ/read-in-order-2
Implement 'read in order' optimization with processors.
2019-09-03 14:21:19 +03:00
Nikolai Kochetov
99476d0039 Add task stilling to PipelineExecutor. 2019-09-03 14:15:37 +03:00
CurtizJ
22badef1a2 Merge remote-tracking branch 'upstream/master' into merging_with_ties_and_with_fill 2019-09-03 13:47:18 +03:00
Anton Popov
aeb1860e62
Update 01006_ttl_with_default_2.sql 2019-09-03 13:31:52 +03:00
CurtizJ
ba98c038ab fix column ttl with user defaults 2019-09-03 13:27:02 +03:00
Nikolai Kochetov
e55647eee9 Force add resize befor aggregating transform. 2019-09-03 13:14:13 +03:00
CurtizJ
6d821c4877 fix build 2019-09-03 13:07:31 +03:00
Zhichang Yu
fb5c11146a added functional test for shard bitmap deserialization 2019-09-03 17:39:15 +08:00
Dmitry Rubashkin
ede0077df6 fix 2019-09-03 12:38:50 +03:00
Dmitry Rubashkin
d2b9990a2a Unexpected packets received in a better way now. 2019-09-03 12:36:16 +03:00
alesapin
0e47bbca4d Fix style check 2019-09-03 12:18:02 +03:00
alesapin
a7606d063b Better test 2019-09-03 12:16:35 +03:00
alesapin
d08d99954f Ugly working code 2019-09-03 11:48:43 +03:00
Nikolai Kochetov
702c1b03da Revert to LFStack. 2019-09-03 11:42:26 +03:00
alesapin
27b0a06005 Fix stupid bug 2019-09-03 11:30:59 +03:00
alesapin
e7308c1f21 Merge branch 'master' into ObjatieGroba-feature_multiple_disks 2019-09-03 11:02:32 +03:00
zhang2014
9c50c7c718 fix crash when touches all rows alter 2019-09-03 13:48:02 +08:00
alexey-milovidov
cda9ac7385
Merge pull request #6780 from yandex/fix_mergex_column_only_stream
Move initialization of MergedColumnOnlyStream to constructor
2019-09-03 01:37:51 +03:00
alexey-milovidov
a52874b203
Merge pull request #6709 from yandex/time-zone-configuration
Fixed error with processing "timezone" in server configuration file.
2019-09-03 01:37:26 +03:00
alexey-milovidov
7447d89f1f
Merge pull request #6785 from 4ertus2/mjoin
More JOINs refactoring
2019-09-03 01:36:59 +03:00
CurtizJ
973b533377 Merge remote-tracking branch 'upstream/master' into read-in-order-2 2019-09-03 00:59:51 +03:00
Alexey Milovidov
1903053aa1 Fixed error in test 2019-09-02 22:58:48 +03:00
chertus
fce1b47250 more JOIN refactoring: move logic out of ExpressionAnalyzer/ExpressionAction 2019-09-02 22:58:45 +03:00
Alexey Milovidov
89e86e1d41 Slightly better config management in integration tests 2019-09-02 22:57:09 +03:00
alesapin
04a3db5857 Better test 2019-09-02 22:32:08 +03:00
Alexey Milovidov
5dbafdefdb Merge branch 'master' into time-zone-configuration 2019-09-02 22:15:52 +03:00
Alexey Milovidov
457bc541ee Merge branch 'master' of github.com:yandex/ClickHouse 2019-09-02 22:13:22 +03:00
Alexey Milovidov
2b0af524cb Added a test #2282 2019-09-02 22:13:12 +03:00
alexey-milovidov
5042780423
Merge pull request #6776 from vitlibar/split-test-dictionaries
Split the integration test `test_dictionaries` into 4 separate tests.
2019-09-02 22:07:46 +03:00
alexey-milovidov
f180f7dd3d
Merge pull request #6779 from proller/fix27
CLICKHOUSE-4644 function arrayEnumerateUniqRanked: fix for empty arrays
2019-09-02 21:40:35 +03:00
CurtizJ
257df66b02 fix flappy ttl test 2019-09-02 21:29:56 +03:00
alesapin
f0c5ee5877 Merge with master 2019-09-02 20:34:18 +03:00
CurtizJ
4fea3e9688 style fixes 2019-09-02 20:18:44 +03:00
Nikolai Kochetov
52ca3f2b4c Add stream enumeration to Processors. 2019-09-02 20:01:03 +03:00
Nikolai Kochetov
cfbb3ce6f9 Add stream enumeration to Processors. 2019-09-02 19:58:24 +03:00
Nikolai Kochetov
5352ac9145 Add stream enumeration to Processors. 2019-09-02 19:57:06 +03:00
Nikolai Kochetov
1f70aee2e6 Add stream enumeration to Processors. 2019-09-02 19:55:01 +03:00
Alexander Tokmakov
b9eb992320 Merge branch 'master' into merging_values_with_expressions 2019-09-02 19:54:56 +03:00
Alexander Tokmakov
ec5fbf525d remove ValuesRowInputFormat 2019-09-02 19:33:58 +03:00
alesapin
5af8c196bd Move initialization of MergedColumnOnlyStream to constructor 2019-09-02 19:31:09 +03:00
Alexander Tokmakov
d31358a280 change ValuesBlockInputStream to ValuesBlockInputFormat 2019-09-02 19:26:22 +03:00
proller
184e2ef9ab CLICKHOUSE-4644 arrayEnumerateUniqRanked: fix for empty arrays 2019-09-02 18:49:25 +03:00
Nikolai Kochetov
88044fdc16 Add stream enumeration to Processors. 2019-09-02 18:49:18 +03:00
Alexander Kuzmenkov
fd00889981 Pre-fault mmapped buffers for hash tables.
Mmaped pages are copy-on-write references to the zero page, and are
faulted in on the first write. Hash table resize touches most of the
newly allocated buffer, so it's faster to pre-fault all pages after
allocation, instead of having the resize loop interrupted by page
faults.
2019-09-02 18:38:29 +03:00
Alexander Kuzmenkov
ce120ebc0d Cosmetic change: Remove unused template parameters from Allocator. 2019-09-02 18:38:29 +03:00
CurtizJ
e122d54dcb update comments 2019-09-02 18:22:27 +03:00
Nikolai Kochetov
464595a548 Add allow_processors flag to executeQuery. 2019-09-02 18:19:01 +03:00
Alexey Milovidov
402599a38c Merge branch 'master' into time-zone-configuration 2019-09-02 18:13:54 +03:00
Alexey Milovidov
7bf411548f Merge branch 'master' of github.com:yandex/ClickHouse into add-test-for-deadlock-system-tables 2019-09-02 18:04:15 +03:00
Nikolai Kochetov
52eae3a242 Add stream enumeration to Processors. 2019-09-02 17:55:43 +03:00
alexey-milovidov
a71a1693f0
Merge pull request #6777 from yandex/fix-pvs-warning-in-pipeline-executor
Fix PVS warning in PipelineExecutor.
2019-09-02 17:53:28 +03:00
alexey-milovidov
3f5d0ef2a8
Merge pull request #6775 from yandex/aku/pvs-warning
Remove a redundant condition (found by PVS Studio).
2019-09-02 17:52:25 +03:00
Vitaly Baranov
d64d75eb6d Split the integration test test_dictionaries into 4 separate tests. 2019-09-02 17:50:57 +03:00
Nikolai Kochetov
0016d99f5e Add stream enumeration to Processors. 2019-09-02 17:49:05 +03:00
CurtizJ
de5e2b4d6b Merge remote-tracking branch 'upstream/master' into merging_with_ties_and_with_fill 2019-09-02 17:34:49 +03:00
Alexander Tokmakov
8adf13047b fix build 2019-09-02 17:33:10 +03:00
Alexander Tokmakov
3b6a038604 Tests 2019-09-02 17:33:10 +03:00
Alexander Tokmakov
d42a4323f6 Fixes 2019-09-02 17:33:10 +03:00
Alexander Tokmakov
e32ed075c8 Force disable interpreting expressions without template to check if some tests fail 2019-09-02 17:33:10 +03:00
Alexander Tokmakov
46effbd7f6 Template for functions with constant arguments 2019-09-02 17:33:10 +03:00
Alexander Tokmakov
00fc04d852 Fix 2019-09-02 17:33:10 +03:00
Alexander Tokmakov
1629f0a166 Simple heuristic to generate new template in case of failure 2019-09-02 17:33:10 +03:00
Alexander Tokmakov
a5f194cae9 Add setting to enable/disable template deduction for Values 2019-09-02 17:33:10 +03:00
Alexander Tokmakov
dd45f3c2bd Check types of numeric literals 2019-09-02 17:33:10 +03:00
Alexander Tokmakov
c7e311bac8 Use AST to generate template 2019-09-02 17:33:10 +03:00
Alexander Tokmakov
2322a88ef0 Store TokenIterators in ASTLiteral 2019-09-02 17:33:10 +03:00
Alexander Tokmakov
dfebedfb70 Fix expression with Array and ColumnConst 2019-09-02 17:33:10 +03:00
Alexander Tokmakov
41166f0618 Fix 2019-09-02 17:33:10 +03:00
Alexander Tokmakov
6e06658363 Improvements 2019-09-02 17:33:10 +03:00
Alexander Tokmakov
6fd1319bba Fixes 2019-09-02 17:33:10 +03:00
Alexander Tokmakov
3e214ced62 PeekableReadBuffer 2019-09-02 17:33:10 +03:00
Alexander Tokmakov
d3ee3a693c Batch insert Values with expressions (draft) 2019-09-02 17:33:09 +03:00
Alexander Tokmakov
804c911d3f ValuesRowInputStream changed to ValuesBlockInputStream 2019-09-02 17:33:09 +03:00
CurtizJ
da11fb86b7 implement 'with fill' modifier with processors 2019-09-02 17:29:51 +03:00
Vasily Nemkov
f98c488834 Post-review fixes
* Actually using the replica recovery settings for cluster
* A bit of doc on DBMS_CONNECTION_POOL_WITH_FAILOVER_MAX_ERROR_COUNT
* StorageDistributedDirectoryMonitor using settings for ConnectionPoolWithFailover
* Using SettingSeconds instead of SettingUInt64 for replica_error_decrease_period
2019-09-02 17:26:25 +03:00
Vasily Nemkov
84fc4ba4c8 Replica recovery fixes
* Added a limit on how many errors can replica accumulate
* Decreased default error halving time to 60 seconds
* Made both configurable via settings
* Showing errors count and estimated recovery time for each replica in system.clusters
2019-09-02 17:26:25 +03:00
alexey-milovidov
0967ecf03b
Merge pull request #6727 from yandex/merging_template_format
Merging Template format
2019-09-02 17:25:43 +03:00
Alexey Milovidov
dcdd8c6e3c Merge branch 'master' into add-test-for-deadlock-system-tables 2019-09-02 16:39:26 +03:00
Nikolai Kochetov
2eecd35d27 Fix PVS warning in PipelineExecutor. 2019-09-02 16:30:51 +03:00
Alexander Kuzmenkov
ab2bd54022 Remove a redundant condition (found by PVS-Studio). 2019-09-02 16:17:14 +03:00
Nikolai Kochetov
bf0c0ed4f1 Merge branch 'master' into processors-2 2019-09-02 16:02:09 +03:00
chertus
bc95027cee better setting name: joined_subquery_requires_alias 2019-09-02 15:53:31 +03:00
Nikolai Kochetov
278e33cfa3 Try add LFStack. 2019-09-02 15:48:58 +03:00
Nikolai Kochetov
5005c0006c Try add LFStack. 2019-09-02 15:34:18 +03:00
chertus
2c0d569fa8 Merge branch 'master' into some 2019-09-02 15:32:24 +03:00
Zhichang Yu
9e587fb139 fix DataTypeAggregateFunction deserialization 2019-09-02 20:09:40 +08:00
Guillaume Tassery
b07d4a2fec Add test reference 2019-09-02 13:49:17 +02:00
alesapin
198031f787 Refactoring 2019-09-02 14:35:53 +03:00
Guillaume Tassery
6f4e0b9557 Add tests 2019-09-02 13:15:57 +02:00
Nikolai Kochetov
6221a42fcc Comment out all stopwatchs in PipelineExecutor. 2019-09-02 14:02:08 +03:00
Alexander Tokmakov
3da233ef42 fix build 2019-09-02 13:47:06 +03:00
Alexander Tokmakov
e2928481a3 Merge branch 'master' into merging_template_format 2019-09-02 12:41:34 +03:00
alesapin
e7ee9b7a67 Merge master 2019-09-02 11:46:00 +03:00
Guillaume Tassery
fcb9a31f7b Fix build 2019-09-02 09:50:48 +02:00
Guillaume Tassery
f727580483 Merge branch 'master' of https://github.com/yandex/ClickHouse into move_partition 2019-09-02 08:45:52 +02:00
Alexey Milovidov
85f45747a5 Fixed test 2019-09-02 04:04:41 +03:00
Alexey Milovidov
951079c457 Updated test 2019-09-02 04:00:58 +03:00
Alexey Milovidov
32adf456d8 Remove support for recursive-by-thread RWLocks because it makes no sense 2019-09-02 03:59:27 +03:00
Alexey Milovidov
e5ad85ba26 Fixed test 2019-09-02 03:21:42 +03:00
Alexey Milovidov
2d331fb992 Fixed possible deadlock in RWLock 2019-09-02 03:12:01 +03:00
Alexey Milovidov
de2586cd15 Merge branch 'master' into add-test-for-deadlock-system-tables 2019-09-02 00:59:25 +03:00
Alexey Milovidov
7d1b1de895 Temporarily remove all LIVE VIEW tests 2019-09-02 00:49:11 +03:00
Alexey Milovidov
ba1c70add0 Merge branch 'add-test-for-deadlock-system-tables' of github.com:yandex/ClickHouse into add-test-for-deadlock-system-tables 2019-09-01 22:21:22 +03:00
Alexey Milovidov
de44330cfa Updated exception message 2019-09-01 22:21:00 +03:00
Alexey Milovidov
45a9b4e184 Merge branch 'master' into add-test-for-deadlock-system-tables 2019-09-01 22:20:04 +03:00
Alexey Milovidov
4ebf610808 Disable query profiler with sanitizers 2019-09-01 19:21:54 +03:00
Alexey Milovidov
8917572087 Speed up another test in cases when query_log is large (such as on production servers) 2019-09-01 18:28:43 +03:00
Alexey Milovidov
55f11b3675 Speed up test for "text_log" in cases when text_log is large (such as on production servers) 2019-09-01 18:25:46 +03:00
Ivan
4d21f97d6a
Increase test timeout 2019-09-01 16:03:38 +03:00
Alexey Milovidov
6940395c5d Fixed tests 2019-09-01 15:40:06 +03:00
Alexey Milovidov
2b6d27d587 Merge branch 'add-test-for-deadlock-system-tables' of github.com:yandex/ClickHouse into add-test-for-deadlock-system-tables 2019-09-01 15:16:54 +03:00
Alexey Milovidov
27d753eab7 Fixed error 2019-09-01 15:16:31 +03:00
alexey-milovidov
7ababf2644
Merge branch 'master' into add-test-for-deadlock-system-tables 2019-09-01 04:35:10 +03:00
Alexey Milovidov
6f02cd145f Added a kludge (experimental) 2019-09-01 04:32:44 +03:00
alexey-milovidov
2e86aece86
Merge pull request #6763 from yandex/add-os-thread-ids-in-system-tables
Add "os_thread_ids" column to system tables
2019-09-01 04:30:16 +03:00
alexey-milovidov
1dd28867b0
Merge pull request #6689 from yandex/merge_tree_settings_alter
Refactoring of immutable settings
2019-09-01 04:29:47 +03:00
Alexey Milovidov
23b28e6cdc Added another test for deadlock 2019-09-01 02:35:33 +03:00
Alexey Milovidov
cb79e2371e Add "os_thread_ids" column to system tables 2019-09-01 00:47:15 +03:00
Alexey Milovidov
dcc6163d32 Added function "trap" 2019-09-01 00:39:17 +03:00
alesapin
7382a9f3c3 Rename method for settings check 2019-09-01 00:15:40 +03:00
alexey-milovidov
d8d2b623d2
Merge pull request #6759 from yandex/add-test-rwr-shard-deadlock
Added a test for possible deadlock in distributed queries
2019-08-31 18:51:48 +03:00
alexey-milovidov
fcfc807bb3
Merge pull request #6756 from yandex/add-test-deadlock-rename-table
Added a test for deadlock in RENAME TABLE
2019-08-31 16:01:59 +03:00
Alexey Milovidov
aac0b27daa Fixed possible deadlock in distributed queries 2019-08-31 15:18:14 +03:00
Alexey Milovidov
783df7a5c5 Added a test that prooves that our locking model is non-viable 2019-08-31 14:32:14 +03:00
Alexey Milovidov
c0e465f9f0 Stress test: more beautiful 2019-08-31 14:20:09 +03:00
Alexey Milovidov
01035a9e78 Merge branch 'master' of github.com:yandex/ClickHouse into add-test-deadlock-rename-table 2019-08-31 13:46:24 +03:00
alexey-milovidov
ddbb1abbaf
Merge pull request #6752 from yandex/added-test-rename-merge-race-condition
Added a test for RENAME / Merge table race condition
2019-08-31 13:45:41 +03:00
alexey-milovidov
3767979295
Merge pull request #6753 from yandex/avoid-race-condition-processors
Avoid data race on Settings in KILL QUERY.
2019-08-31 13:45:14 +03:00
alexey-milovidov
d90518dadf
Merge pull request #6755 from vitlibar/add-test-reload-after-fail-in-cache-dictionary
Add integration test for handling errors by a cache dictionary.
2019-08-31 13:44:40 +03:00
Alexey Milovidov
3568d3d890 Updated test 2019-08-31 13:38:20 +03:00
Alexey Milovidov
202673e3bd Avoid deadlock in multiple tables RENAME 2019-08-31 13:37:28 +03:00
Nikolai Kochetov
300dc80194 Update Aggregator interface. 2019-08-31 11:58:16 +03:00
Alexey Milovidov
d879bcb010 Added a test for deadlock in RENAME TABLE 2019-08-31 05:32:42 +03:00
Alexey Milovidov
e4376a3f6f Addition to prev. revision 2019-08-31 04:21:10 +03:00
Vitaly Baranov
fbd616b6a4 Add integration test for handling errors by a cache dictionary. 2019-08-31 03:39:38 +03:00
Alexey Milovidov
57c8091e5b Better stress test script 2019-08-31 03:30:12 +03:00
Alexey Milovidov
5fcdd6f20b Added stress test variant that is as simple to run as ./stress 2019-08-31 03:19:10 +03:00
Alexey Milovidov
bb0ca310ab Allow to ATTACH live views 2019-08-31 02:38:03 +03:00
Alexey Milovidov
fd85a862f0 Added a test just in case 2019-08-31 02:19:05 +03:00
Alexey Milovidov
2fd8f5c324 Removed code that I don't understand and that has no comments 2019-08-31 02:09:08 +03:00
Alexey Milovidov
cc118b3fed Added a test for RENAME / Merge table race condition 2019-08-31 01:43:15 +03:00
alesapin
2647d4ca15 Rename immutable to readonly 2019-08-30 23:12:26 +03:00
Alexander Tokmakov
cd5d733f75 rewrite unit test with gtest 2019-08-30 22:08:23 +03:00
alesapin
6f30338c08 Fixes 2019-08-30 21:31:35 +03:00
Ivan
cd5c0fc9ac
Fix build issues (#6744)
* libcxxabi uses exception handling library as public
* Don't set -stdlib for internal libc++ - it poisons the checks.
* Enable capnproto in unbundled build back
2019-08-30 20:40:27 +03:00
alexey-milovidov
6352c57afb
Merge pull request #6748 from yandex/fix_bad_size_of_marks
Fix bad size of marks with skip indices
2019-08-30 20:26:59 +03:00
Alexander Tokmakov
4c744af113 minor style fixes 2019-08-30 20:25:35 +03:00
alesapin
808f4d0b8a Intermediate refactoring 2019-08-30 19:50:59 +03:00
Alexey Milovidov
ace08fa344 Merge branch 'master' into time-zone-configuration 2019-08-30 19:27:08 +03:00
Alexey Milovidov
83c75ca2ad Added a test (but it doesn't reproduce the issue #6746) 2019-08-30 19:21:05 +03:00
stavrolia
974789d379 add const 2019-08-30 18:19:05 +03:00
alesapin
d4ea6a5234 Fix comment 2019-08-30 17:30:28 +03:00
alesapin
f6120558df Fix bad size of marks 2019-08-30 17:29:08 +03:00
Nikolai Kochetov
18fff141d1 Update max_threads for processors. 2019-08-30 17:21:22 +03:00
Alexey Milovidov
4cb640717b Fixed test 2019-08-30 16:28:27 +03:00
stavrolia
f51901bb3f fix comment 2019-08-30 16:27:05 +03:00
Alexey Milovidov
da5e7f31c4 Updated README 2019-08-30 16:25:34 +03:00
Alexey Milovidov
48bf4abdf0 Fixed function name 2019-08-30 16:14:47 +03:00
Alexey Milovidov
3fdcc4ab30 Fixed typo in README.md 2019-08-30 16:14:20 +03:00
alexey-milovidov
ce73e17ff6
Merge pull request #6730 from yandex/fallback_o_direct
Fallback from O_DIRECT.
2019-08-30 16:08:19 +03:00
alexey-milovidov
e5a7f451f0
Merge pull request #6737 from vitlibar/improve-error-handling-in-cache-dictionary
Improve error handling in cache dictionaries
2019-08-30 16:06:07 +03:00
alexey-milovidov
b27f5a7390
Merge pull request #6740 from Enmk/reduced_locking_in_IBlockInputStream
Reduced children_mutex lock scope in IBlockInputStream
2019-08-30 16:02:22 +03:00
chertus
e9c4f36586 Merge branch 'master' into some 2019-08-30 15:49:55 +03:00
alesapin
d7e54d3c14 Merge branch 'master' of github.com:yandex/ClickHouse into ObjatieGroba-feature_multiple_disks 2019-08-30 12:53:24 +03:00
Vitaly Baranov
da8f67123f Improve error handling in cache dictionaries:
allow using expired values while the source of a cache dictionary doesn't respond;
clone the source after an error to reset connections;
don't ask the source for a little time after error;
show the last exception in system.dictionaries for a cache dictionary too.
2019-08-30 12:50:38 +03:00
Vasily Nemkov
b66485a1d2 Reduced children_mutex lock scope in IBlockInputStream
This is to fix TSan warning 'lock-order-inversion'.
Thread locks IBlockInputStream::children_mutex (A) and then subsequently locks
MergeTreeDataPart::columns_lock mutex (B), holding it for extended period of
time, surviving the unlock of the A. Then, while B is still locked, A
is locked again, causing a TSan warning.
2019-08-30 11:24:00 +03:00
Guillaume Tassery
87b8f89600 cosmetic 2019-08-30 06:36:01 +02:00
Guillaume Tassery
d752b1c143 Fix synchronisation bug 2019-08-30 06:24:05 +02:00
CurtizJ
048d3da9ab better types comparison and conversion in FillingBlockInputStream 2019-08-30 01:24:33 +03:00
Alexander Tokmakov
e3982704ea try to fix build 2019-08-30 00:46:36 +03:00
alexey-milovidov
358ad13930
Merge pull request #6715 from yandex/remove-mimalloc
Remove mimalloc
2019-08-30 00:41:33 +03:00
Alexander Tokmakov
d95d53b4e4 better error messages 2019-08-29 22:35:59 +03:00
Alexey Milovidov
0bca68e50b Style 2019-08-29 21:55:20 +03:00
chertus
3ad43daae3 Merge branch 'master' into some 2019-08-29 21:50:47 +03:00
chertus
d5cfbcf6e1 subquery_requires_alias setting (disabled by default) 2019-08-29 21:45:34 +03:00
Dmitry Rubashkin
876847f3f7 Now stacked logs are received in appropriate way. 2019-08-29 20:30:16 +03:00
CurtizJ
a6e43c4119 merging with master 2019-08-29 19:48:02 +03:00
alesapin
1813b96f82 Finally build, possible trash. 2019-08-29 19:17:47 +03:00
Alexey Milovidov
a894288fa0 Fallback from O_DIRECT. 2019-08-29 18:48:00 +03:00
stavrolia
011c752ed7 Add unit test 2019-08-29 18:38:33 +03:00
Ivan
5851316742
Don't interrupt copyData() used inside Kafka materialized views (#6597)
* Print better offsets on commit
* Stop consumption on the read buffer level
* Don't use cancellation in the middle of copyData()
* Add test
* Disable squashing stream for Kafka materialized views
* Commit last read message, since rdkafka auto-modifies offset
2019-08-29 18:36:07 +03:00
alexey-milovidov
c19e5faf4c
Merge pull request #6717 from yandex/fix-data-race-in-storage-merge
Fix for data race in StorageMerge
2019-08-29 18:25:48 +03:00
CurtizJ
d7a712e7ae update logic of 'with fill' modifier 2019-08-29 18:19:12 +03:00
alexey-milovidov
2b124c5af8
Merge pull request #6718 from vitlibar/fix-extract-tuple-from-json
Fix extracting a Tuple from JSON
2019-08-29 17:40:26 +03:00
Alexander Tokmakov
03c83169bd Merge branch 'master' into merging_template_format 2019-08-29 16:34:25 +03:00
Alexander Tokmakov
d6ca9fee63 unit test for PeekableReadBuffer 2019-08-29 16:30:43 +03:00
alesapin
549c61cad9
Update MarkInCompressedFile.h 2019-08-29 15:38:20 +03:00
Dmitry Rubashkin
4bd79c47dc Now send_logs_level won't affect catching exception. Test added. 2019-08-29 15:36:06 +03:00
alesapin
dac55278ad Better comments 2019-08-29 14:15:56 +03:00
alesapin
702b47ae5b Remove redundant changes 2019-08-29 13:56:43 +03:00
alesapin
0899b3818d Remove redundant changes 2019-08-29 13:49:26 +03:00
alesapin
67f9753775 Merge branch 'master' into bad_size_of_marks_skip_idx_bug 2019-08-29 11:07:56 +03:00
alesapin
d3b378ea10 Fix flappy test (descrease number of iterations) 2019-08-29 11:02:50 +03:00
zhang2014
275c0d88b3 fix build failure 2019-08-29 12:54:09 +08:00
zhang2014
74c9eea657 fix test failure 2019-08-29 11:34:00 +08:00
zhang2014
3c7405bdb0 move test to integration & refer max_expanded_ast_elements 2019-08-29 11:31:22 +08:00
zhang2014
92740212b5 fix build failure 2019-08-29 11:15:15 +08:00
zhang2014
7432845f60 add test case 2019-08-29 11:14:40 +08:00
zhang2014
6c3626b629 truncate should remove mutations 2019-08-29 11:14:40 +08:00
zhang2014
54b65bac50 fix max_ast_elements settings with merge mutation 2019-08-29 11:06:35 +08:00
Vitaly Baranov
4ec12c3d24 Add more tests for JSON functions. 2019-08-29 01:55:35 +03:00
Vitaly Baranov
6cbb52128b Fix extracting tuple from JSON. 2019-08-29 01:55:35 +03:00
Alexey Milovidov
d1a980fcdd Fix for data race in StorageMerge 2019-08-29 01:18:26 +03:00
Ivan
b4339f266d
Make a better build scheme (#6500)
* Fix shared build
* Major default libs refactor
* Fix build with gcc_eh
* Link all libraries as a big group.
* Use global interface library as a group
* Build capnproto using our cmake
* Use only internal libunwind
2019-08-28 23:49:37 +03:00
Alexey Milovidov
06ea75f9fd Merge branch 'master' of github.com:yandex/ClickHouse 2019-08-28 23:15:28 +03:00
Alexey Milovidov
e9875950a4 Make test timeout to be more significant 2019-08-28 22:36:04 +03:00
Alexey Milovidov
39d50b5144 Remove mimalloc 2019-08-28 22:01:52 +03:00
Artem Zuikov
405f060f4f
Merge pull request #6708 from 4ertus2/some
Test for #4858
2019-08-28 21:57:46 +03:00
Alexey Milovidov
48dce81e61 Minor modifications after #6413 2019-08-28 21:54:30 +03:00
alexey-milovidov
33311a9bf1
Merge branch 'master' into atomic_zookeeper2 2019-08-28 21:34:42 +03:00
alesapin
b4d98f6e13 Trying to fix vertical merge 2019-08-28 21:23:20 +03:00
alexey-milovidov
44dd3bd792
Merge pull request #6692 from yandex/remove-queue_max_wait_ms
Set default value of "queue_max_wait_ms" to zero, because current value makes no sense
2019-08-28 21:06:09 +03:00
alexey-milovidov
7b9b67fd71
Merge pull request #6695 from yandex/improve-table-locks
Avoid possible deadlock in TRUNCATE of Replicated table.
2019-08-28 21:05:26 +03:00
alexey-milovidov
6d2dca3242
Merge pull request #6705 from 4ertus2/bugs
JOINs with not nullable types and join_use_nulls=1
2019-08-28 21:05:16 +03:00
alexey-milovidov
c72dffc591
Merge pull request #6706 from yandex/client-do-not-substitute-inside-query
Disable Poco::AbstractConfiguration substitutions in query in clickhouse-client
2019-08-28 21:04:56 +03:00
Alexey Milovidov
eb15c9416a Fixed style 2019-08-28 21:00:40 +03:00
Dmitry Rubashkin
4b7f5f20c1 Exception check added when sending data by parts. 2019-08-28 20:52:17 +03:00
Nikolai Kochetov
d6e13cbb92 Update max_threads for processors. 2019-08-28 20:48:41 +03:00
Nikolai Kochetov
ca232cebfb Update max_threads for processors. 2019-08-28 20:30:48 +03:00
Alexey Milovidov
509717dea7 Added integration test 2019-08-28 20:18:19 +03:00
Alexey Milovidov
cf57a88495 Added a way to forbid static initialization of a class 2019-08-28 20:13:29 +03:00
Alexey Milovidov
30cc569845 Avoid initializing DateLUT in static constructors 2019-08-28 20:11:40 +03:00
chertus
91bc0eca11 add test for #4858 2019-08-28 20:00:20 +03:00
Alexander Tokmakov
c8096542bf more tests and fixes 2019-08-28 19:46:54 +03:00
chertus
5e27937227 fix RIGHT JOIN for Tuples 2019-08-28 18:44:18 +03:00
alexey-milovidov
e2b05f6f9c
Merge pull request #6700 from yandex/aku/shm-5417-formatting
Formatting changes for StringHashMap PR #5417.
2019-08-28 18:30:59 +03:00
alexey-milovidov
819f1f2aa6
Merge pull request #6701 from yandex/aku/no-cache-low-cardinality
Disable consecutive key optimization for UInt8/16 LowCardinality columns.
2019-08-28 18:30:24 +03:00
Alexey Milovidov
b6a0dba2df Added a setting "connection_pool_max_wait_ms" 2019-08-28 18:27:26 +03:00
Alexey Milovidov
cced091881 Addition to prev. revision 2019-08-28 18:24:35 +03:00
Alexey Milovidov
d1c268c2ed Added setting "kafka_max_wait_ms" 2019-08-28 18:24:23 +03:00
Alexey Milovidov
06c0e35e46 Added setting "replace_running_query_max_wait_ms" 2019-08-28 18:21:57 +03:00
Alexey Milovidov
d06e350312 Added setting "replace_running_query_max_wait_ms" 2019-08-28 18:20:22 +03:00
Alexey Milovidov
a9702aa6f2 Merge branch 'master' into remove-queue_max_wait_ms 2019-08-28 18:16:53 +03:00
alexey-milovidov
24c8ee9fcd
Merge pull request #6703 from arenadata/ADQM-40
test for orc input format
2019-08-28 18:14:40 +03:00
Alexey Milovidov
f519234908 Added a test 2019-08-28 18:13:19 +03:00
Alexey Milovidov
10b878b30b Disable Poco::AbstractConfiguration substitutions in query in clickhouse-client 2019-08-28 18:06:30 +03:00
chertus
90d5410aaa join_use_nulls with not nullable types 2019-08-28 17:14:09 +03:00
dimarub2000
6fe40a0d90
Merge branch 'master' into perfomance_test_help_size 2019-08-28 16:38:54 +03:00
alexey-milovidov
696d505a1a
Merge pull request #6656 from vzakaznikov/fix_live_view_no_users_thread
Fix live view no users thread
2019-08-28 16:33:36 +03:00
akonyaev
9d0e5b925b ADQM-40 test for orc input format 2019-08-28 16:26:38 +03:00
Alexey Milovidov
a1101e5278 Fixed build 2019-08-28 16:21:19 +03:00
Alexey Milovidov
8b973fd9f2 Merge branch 'improve-table-locks' of github.com:yandex/ClickHouse into improve-table-locks 2019-08-28 15:59:23 +03:00
Alexey Milovidov
625e128770 Merge branch 'master' into improve-table-locks 2019-08-28 15:41:30 +03:00
Alexey Milovidov
99d62efb4d Added a test 2019-08-28 15:26:13 +03:00
Alexander Kuzmenkov
0b5a7f5f4a Disable consecutive key optimization for UInt8/16 LowCardinality
columns.

A follow-up to #6298, this is as well a part of StringHashMap PR #5417
by Amos Bird.
2019-08-28 14:05:52 +03:00
Alexander Kuzmenkov
24a8755b82 Formatting changes for StringHashMap PR #5417. 2019-08-28 13:52:14 +03:00
Alexey Milovidov
32c7f9688a Removed extra quoting from Settings 2019-08-28 13:13:22 +03:00
Guillaume Tassery
62e302d689 Implement ReplicatedMergeTree move to operation 2019-08-28 10:24:17 +02:00
Artem Zuikov
8fa4575a88
Merge pull request #6693 from 4ertus2/mjoin
Minor refactoring
2019-08-28 10:12:37 +03:00
Alexey Milovidov
f2d081a785 Addition to prev. revision 2019-08-28 03:42:45 +03:00
Alexey Milovidov
3db38c690e Changes to Benchmark after merge 2019-08-28 03:15:08 +03:00
Alexey Milovidov
c8798b2ffa Slightly improve table locks 2019-08-28 02:47:30 +03:00
alexey-milovidov
44424651b0
Merge pull request #6343 from dimarub2000/benchmark_comparison_mode
[WIP] Clickhouse-benchmark comparison mode
2019-08-28 02:38:07 +03:00
alexey-milovidov
4782c1170c
Merge pull request #6691 from yandex/weiqxu-master
Merging "check free space when use external sort/aggerator"
2019-08-28 01:55:18 +03:00
Alexey Milovidov
e7cbd34a29 Improve table locks (incomplete) 2019-08-27 23:43:35 +03:00
Alexey Milovidov
285d66cee1 Improve table locks (incomplete) 2019-08-27 23:43:08 +03:00
Vitaliy Zakaznikov
e80ff65a0f Removing allow_experimental_live_view option from clickhouse-client.xml. 2019-08-27 16:23:12 -04:00
alexey-milovidov
c736d6b495
Merge pull request #6676 from dimarub2000/right_left_problem_#6381
Query transformation for external database fixed.
2019-08-27 23:11:39 +03:00
chertus
5208a70203 one less place with changed nullability columns 2019-08-27 22:41:51 +03:00
Alexey Milovidov
63c0070cd5 Fixed flacky test 2019-08-27 22:32:33 +03:00
Alexey Milovidov
0add95b7d8 Set default value of "queue_max_wait_ms" to zero, because current value makes no sense 2019-08-27 22:21:53 +03:00
Alexey Milovidov
25c53ccd9e Rename setting 2019-08-27 22:05:35 +03:00
Alexey Milovidov
b21fdff77e Merging #6678 2019-08-27 21:59:21 +03:00
Alexey Milovidov
5ca8f8d695 Merge branch 'master' of https://github.com/weiqxu/ClickHouse into weiqxu-master 2019-08-27 21:52:09 +03:00
Nikolai Kochetov
4cb52cebea Update max_threads for processors. 2019-08-27 21:37:28 +03:00
Alexander Tokmakov
93c672aa0b delete BlockInputStreamFromRowInputStream 2019-08-27 21:29:56 +03:00
CurtizJ
a169213691 test for limit with ties 2019-08-27 21:11:02 +03:00
CurtizJ
50d870705c limit with ties for processors 2019-08-27 20:48:42 +03:00
Alexander Tokmakov
cf3a8b993b allow skipping fields in TemplateRowInputFormat 2019-08-27 19:53:26 +03:00
stavrolia
f4e0dceddb some changes 2019-08-27 18:20:31 +03:00
Alexey Milovidov
8ca00a26f6 Fixed build 2019-08-27 17:31:34 +03:00
Alexey Milovidov
c385c950ba Merge branch 'master' into replicate-merge-tree-minor-lock-improvement 2019-08-27 17:30:48 +03:00
CurtizJ
42633c801b Merge remote-tracking branch 'upstream/master' into merging_with_ties_and_with_fill 2019-08-27 17:11:57 +03:00
alexey-milovidov
d12ced8099
Merge pull request #6191 from svladykin/ttldropparts
TTL: Only drop altogether the expired parts and not partially prune them.
2019-08-27 16:54:56 +03:00
alesapin
106b9717cd Refactoring of immutable settings 2019-08-27 16:14:19 +03:00
Dmitry Rubashkin
17f18e42c0 new line 2019-08-27 16:13:40 +03:00
Dmitry Rubashkin
f1f85a5a24 Fixed case with single subquery and added tests. 2019-08-27 16:09:58 +03:00
alexey-milovidov
8db93d392b
Merge pull request #6685 from yandex/merge_tree_settings_alter
Alter merge tree settings with other types of alter
2019-08-27 16:07:28 +03:00
alesapin
36472b14f9 Defend kafka storage from alters 2019-08-27 12:48:20 +03:00
alesapin
7851d8fe0a Add ability to alter settings with other types of alter 2019-08-27 12:34:53 +03:00
Guillaume Tassery
6f5969e1b5
Merge branch 'master' into move_partition 2019-08-27 15:54:21 +07:00
Nikolai Kochetov
d958316e58 Enable processors by default. Do not check block srtucture in SourceFromInutStream if not debug. 2019-08-27 11:17:42 +03:00
Weiqing Xu
2fbcd607f3 check free space when use external sort/aggerator 2019-08-27 08:23:07 +08:00
Vitaliy Zakaznikov
5fb5c8dffc Updating all live view tests to set the allow_experimental_live_view option. 2019-08-26 19:50:37 -04:00
Alexey Milovidov
66203973f2 Merge branch 'master' of github.com:yandex/ClickHouse 2019-08-27 00:41:18 +03:00
Alexey Milovidov
7985270624 Disable processors by default 2019-08-27 00:41:10 +03:00
Alexey Milovidov
d654f2507e Fixed typo in test 2019-08-27 00:40:56 +03:00
Alexey Milovidov
57fa4e1dd7 Minor lock improvement for ReplicatedMergeTree 2019-08-27 00:40:29 +03:00
alexey-milovidov
16ba2fa85a
Merge pull request #6662 from Enmk/hasTokenCaseInsensitive
Implemented hasTokenCaseInsensitive function
2019-08-27 00:39:04 +03:00
alexey-milovidov
9fa5ee758d
Merge pull request #6670 from 4ertus2/bugs
Fix two vulnerabilities in Codecs
2019-08-27 00:38:09 +03:00
alexey-milovidov
9cdc434319
Merge pull request #6672 from yandex/aku/reverse-index
Separate the hash table interface for ReverseIndex.
2019-08-27 00:38:00 +03:00
alexey-milovidov
561b173ddc
Merge pull request #6675 from yandex/simplify-shared-ptr-helper
Simplify shared_ptr_helper
2019-08-27 00:36:52 +03:00
CurtizJ
5470db34e7 add test for limit with fill 2019-08-27 00:00:16 +03:00
CurtizJ
5f25c2d7b4 merging with master 2019-08-26 22:49:52 +03:00
CurtizJ
1774ac4b9e Merge remote-tracking branch 'upstream/master' into HEAD 2019-08-26 22:29:12 +03:00
Dmitry Rubashkin
5989b19684 Final 2019-08-26 22:16:28 +03:00
Alexey Milovidov
0eec226c9a Simplify shared_ptr_helper 2019-08-26 22:07:29 +03:00
Dmitry Rubashkin
0c75d5f42b Function transformQueryForExternalDatabase() fixed 2019-08-26 22:03:47 +03:00
alesapin
cf31187254 Resolve conflicts 2019-08-26 21:08:58 +03:00
Alexander Kuzmenkov
c0bb52ca6d Separate the hash table interface for ReverseIndex.
It is significantly different from other uses of hash tables, and poses
the main obstacle to changing the hash table interface to the one that
can be easily supported by compound hash tables.

Make it explicitly separate, implement it only for a particular kind of
HashTable, and move this implementation to the ReverseIndex module.
2019-08-26 21:00:44 +03:00
Anton Popov
4cd376f587
fix table ttl after bad merge with master 2019-08-26 21:00:13 +03:00
CurtizJ
fa5aeb757f fix clang build 2019-08-26 20:37:40 +03:00
chertus
12084270de fix build 2019-08-26 19:58:40 +03:00
Dmitry Rubashkin
34fefcfa2f Merge branch 'perfomance_test_help_size' of github.com:dimarub2000/ClickHouse into perfomance_test_help_size 2019-08-26 19:46:28 +03:00
Dmitry Rubashkin
1da261576e Try fix2 2019-08-26 19:42:20 +03:00
CurtizJ
4a7459f3b3 cleanup and update comments 2019-08-26 18:25:18 +03:00
CurtizJ
c63eeb8933 add FinishSortingTransform, refactor MergeSortingTransform 2019-08-26 17:54:29 +03:00
alesapin
0d0ebf885f Remove two redundant arguments from alter 2019-08-26 17:50:34 +03:00
chertus
d17a64c28d fix vulnerabilities 2019-08-26 17:39:49 +03:00
alesapin
dff0cc1e1c Remove COW and add MultiVersion 2019-08-26 17:24:29 +03:00
Alexey Milovidov
479b4d81f3 Fixed error 2019-08-26 16:46:07 +03:00
alexey-milovidov
2f5e6158e7
Update TerminalSize.cpp 2019-08-26 16:27:12 +03:00
Alexey Milovidov
60d660e263 Merge branch 'master' into merge-constraints 2019-08-26 16:13:44 +03:00
Alexander Tokmakov
f9445626d1 better parsing of format string 2019-08-26 16:02:15 +03:00
Dmitry Rubashkin
4f89dcc80d Try to fix 2019-08-26 15:47:19 +03:00
alexey-milovidov
c2b6cffabc
Update IStorage.cpp 2019-08-26 15:39:35 +03:00
alesapin
8047aab684 Add const 2019-08-26 13:13:56 +03:00
alesapin
062034dfd8 Eventually merged with master 2019-08-26 13:07:32 +03:00
Vasily Nemkov
d0d63d769e Implemented hasTokenCaseInsensitive function
And tests;
2019-08-26 11:00:48 +03:00
Alexey Milovidov
6e8b7b9c3b Fixed error 2019-08-26 05:53:42 +03:00
Alexey Milovidov
25635d1ab0 Fixed build of tests 2019-08-26 05:46:21 +03:00
Vitaliy Zakaznikov
c70f656d5d Another attempt to enable allow_experimental_live_view options during tests. 2019-08-25 21:57:32 -04:00
Alexey Milovidov
2a3e0eb1f1 Merge branch 'master' into merge-constraints 2019-08-26 04:30:31 +03:00
Vitaliy Zakaznikov
12cb72175b Updating test server config to enable live views using the allow_experimental_live_view option. 2019-08-25 20:44:03 -04:00
Vitaliy Zakaznikov
7fb13b12f9 Reverting to previous no users thread functionality to avoid
keeping no users thread always alive for each live view.
2019-08-25 08:27:47 -04:00
Vitaliy Zakaznikov
2342d64d1b * Updating no users thread to sleep 3 times longer when users are present
to reduce the number of times thread wakes up.
* Updating startNoUsersThread to return if the thread is already running.
2019-08-25 07:36:08 -04:00
alexey-milovidov
d0555d8eab
Merge pull request #6653 from yandex/speed-up-memory-tracker
Speed up MemoryTracker by function inlining
2019-08-25 04:55:46 +03:00
Vitaliy Zakaznikov
62988800e6 Rewriting implementation of LIVE VIEW no users thread. 2019-08-24 21:40:24 -04:00
Vitaliy Zakaznikov
f959c29be6 Revert "Temporarily disable all LIVE VIEW tests because this feature has subtle bugs that manifestate under TSan"
This reverts commit 96869d405f.
2019-08-24 21:38:50 -04:00
Alexey Milovidov
d798cbde2f Fixed double whitespaces 2019-08-25 01:28:06 +03:00
Alexey Milovidov
6d3250867c Fixed build of tests 2019-08-25 01:08:45 +03:00
Alexey Milovidov
32a44936e0 Merge branch 'master' into remove-compiler 2019-08-25 01:07:19 +03:00
Alexey Milovidov
7144a3f827 Speed up MemoryTracker by function inlining 2019-08-25 01:06:13 +03:00
Alexey Milovidov
ffbbb173c5 Addition to prev. revision 2019-08-25 01:04:58 +03:00
Alexey Milovidov
17a1938f0f Addition to prev. revision 2019-08-25 01:04:36 +03:00
Nikita Vasilev
2dbfabd08c fix Set index check useless (#6651)
* fixed useless detection

* fixed useless detection

* fix

* fix

* fix
2019-08-25 01:01:36 +03:00
Alexey Milovidov
2fc177830c Added a test 2019-08-25 01:01:01 +03:00
Alexey Milovidov
9660a4db80 Better exception message 2019-08-25 00:35:07 +03:00
Alexey Milovidov
3fef8e92ad Merging CONSTRAINTS support 2019-08-25 00:20:20 +03:00
alexey-milovidov
11effc8576
Merge pull request #6645 from nikvas0/nikvas0/fix_index_mutation_test
Fixed indices mutations tests
2019-08-24 21:04:43 +03:00
alexey-milovidov
9a51e5e386
Merge pull request #6650 from weiqxu/master
fix HDFS HA can't work on DEBUG mode
2019-08-24 21:02:55 +03:00
alexey-milovidov
03deb642d5
Merge pull request #6647 from yandex/fix-trim
Fixed "trim" functions
2019-08-24 17:36:38 +03:00
Alexey Milovidov
a6997aa83f Modifications after merging constraints support 2019-08-24 16:00:04 +03:00
Alexey Milovidov
f10cf3b082 Merge branch 'master' of github.com:yandex/ClickHouse 2019-08-24 15:18:13 +03:00
Alexey Milovidov
cd620d2de5 Fixed race condition in test (once again) 2019-08-24 15:18:03 +03:00
alexey-milovidov
95da4505f4
Merge pull request #6644 from 4ertus2/bugs
Fix crash in OptimizedRegularExpression
2019-08-24 15:09:04 +03:00
Weiqing Xu
b7fdfcc797 fix HDFS HA can't work on DEBUG mode
The Describe the bug
when the using HDFS HA nameserivce as the uri, the port will be 0.
hdfsBuilderSetNameNodePort will be called to set the port.
hdfsBuilderSetNameNodePort call asset to check if the port is greater
than 0.
So in Release mode, it works OK. In the Debug mode, the asset will fail.

How to reproduce
when compiler the Clickhouse, use DEBUG mode, it will throw error when
using HDFS HA nameservice url
2019-08-24 17:27:36 +08:00
Nikita Vasilev
2464dd0b9f fix 2019-08-24 11:51:02 +03:00
Alexey Milovidov
cc0157b293 Added a test 2019-08-24 02:07:05 +03:00
Alexey Milovidov
cdd6dca517 Remove Compiler 2019-08-24 00:10:26 +03:00
alexey-milovidov
44d3e1e837
Update Client.cpp 2019-08-23 23:35:36 +03:00
Alexey Milovidov
d38e9ee229 Fixed "trim" functions (in progress) 2019-08-23 23:32:31 +03:00
alexey-milovidov
13f59d3f6c
Update Client.cpp 2019-08-23 23:13:08 +03:00
alexey-milovidov
eeeaf8fbee
Merge pull request #6643 from yandex/double-whitespaces
Added a check for double whitespaces
2019-08-23 23:10:12 +03:00
Alexander Tokmakov
0136ef9a5f move formats to processors 2019-08-23 22:47:22 +03:00
Nikita Vasilev
ba2d17c12a fix 2019-08-23 22:36:17 +03:00
Nikita Vasilev
94df978223 Merge remote-tracking branch 'upstream/master' into nikvas0/fix_index_mutation_test 2019-08-23 22:26:23 +03:00
Nikita Vasilev
7dffa0fe9f added wait for mutation to indices tests 2019-08-23 22:19:36 +03:00
alexey-milovidov
012a5f8911
Merge pull request #6596 from Enmk/hasToken
hasToken function implementation
2019-08-23 21:41:33 +03:00
chertus
a21b43913f fix crash in OptimizedRegularExpression 2019-08-23 21:40:42 +03:00
Alexey Milovidov
b42f85e16b Added a check for double whitespaces 2019-08-23 21:30:04 +03:00
Alexander Tokmakov
1572d0c5b6 Merge branch 'master' into merging_template_format 2019-08-23 20:34:14 +03:00
alexey-milovidov
c781e1c6a7
Update StringSearcher.h 2019-08-23 19:09:24 +03:00
alexey-milovidov
50b927a9d7
Update StringSearcher.h 2019-08-23 19:08:27 +03:00
dimarub2000
859d97e8fd Renaming 2019-08-23 18:47:27 +03:00
Alexey Milovidov
016b1ee2f7 Increase timeout for "stack overflow" test because it may take a long time in debug build 2019-08-23 18:42:45 +03:00
Dmitry Rubashkin
9e6c629134 Style fixed 2019-08-23 17:54:10 +03:00
dimarub2000
6e098eb953 New line added :) 2019-08-23 16:25:46 +03:00
dimarub2000
a367f94923 Fix after review 2019-08-23 16:19:12 +03:00
Alexander Tokmakov
734a0f23a9 Merge branch 'master' into merging_template_format 2019-08-23 15:32:35 +03:00
CurtizJ
dae5c650df 'read in order' optimization for processor 2019-08-23 14:39:22 +03:00
CurtizJ
1e1d4eb7c1 temporarily make a dummy for 'with fill' with processors 2019-08-23 14:20:53 +03:00
CurtizJ
5e6ea650eb update comments 2019-08-23 14:13:57 +03:00
CurtizJ
811dab72a8 fix limit with offset 2019-08-23 14:11:50 +03:00
Alexey Milovidov
dae2aa6138 Removed useless code 2019-08-23 08:11:11 +03:00
Alexey Milovidov
84b0f709aa Removed useless code 2019-08-23 08:08:06 +03:00
Alexey Milovidov
4366791b63 Merge branch 'table-constraints' of https://github.com/NanoBjorn/ClickHouse into NanoBjorn-table-constraints 2019-08-23 07:49:10 +03:00
Alexey Milovidov
3d8613f8df More tests 2019-08-23 07:36:01 +03:00
Alexey Milovidov
20b9af29f5 More tests 2019-08-23 07:34:59 +03:00
Alexey Milovidov
6685365ab8 Added optimized case 2019-08-23 07:25:32 +03:00
Alexey Milovidov
341e2e4587 Step 1: make it correct. 2019-08-23 06:00:06 +03:00
Alexey Milovidov
ff9e92eab9 Renamed function in test 2019-08-23 05:53:09 +03:00
alexey-milovidov
7012a421c6
Merge branch 'master' into alter_table_drop_detached_part 2019-08-23 05:22:07 +03:00
Alexey Milovidov
1222973cb3 Function "neighbor": merging #5925 2019-08-23 05:02:14 +03:00
Alexey Milovidov
99f4c9c813 Moved settings that were in a wrong place 2019-08-23 05:01:24 +03:00
Alexey Milovidov
e3bd572fc7 Removed unused settings 2019-08-23 05:00:35 +03:00
Alexey Milovidov
cff8ec43f9 Rename neighbour -> neighbor 2019-08-23 04:31:04 +03:00
alexey-milovidov
49aa9384af
Merge pull request #5925 from alex-krash/function_next_prev_in_block
Implement neighbour() function
2019-08-23 04:28:36 +03:00
alexey-milovidov
3a237b4375
Merge pull request #6617 from yandex/fix_too_many_parts_while_mutation_6502
Fix too many parts while mutation
2019-08-23 04:27:43 +03:00
alexey-milovidov
66ff7cd43e
Merge pull request #6619 from yandex/live-view-code-quality
Basic code quality of LiveView
2019-08-23 04:27:12 +03:00
alexey-milovidov
5c99780b08
Merge pull request #6606 from yandex/processors-2
Enable processors by default.
2019-08-23 02:50:11 +03:00
Alexey Milovidov
96869d405f Temporarily disable all LIVE VIEW tests because this feature has subtle bugs that manifestate under TSan 2019-08-23 02:48:52 +03:00
CurtizJ
659d3857ab fix build for clang 2019-08-23 02:48:20 +03:00
Alexey Milovidov
78c3be175c Added experimental setting for LIVE VIEWs 2019-08-23 02:46:40 +03:00
Alexey Milovidov
c4712f1e6e Make the code less bad 2019-08-23 02:22:57 +03:00
CurtizJ
5c2309132d Merge remote-tracking branch 'upstream/master' into merging_with_ties_and_with_fill 2019-08-23 02:18:45 +03:00
CurtizJ
e069fc495d fix limit with ties 2019-08-23 02:16:00 +03:00
Alexey Milovidov
859736d935 Basic code quality of Live View 2019-08-23 01:41:30 +03:00
Alexey Milovidov
e8bc218984 Rewrite flappy test 2019-08-23 00:35:16 +03:00
Alexander Tokmakov
81022bb3e9 Merge branch 'master' into alter_table_drop_detached_part 2019-08-22 23:38:58 +03:00
Alexander Tokmakov
9c05441932 better test 2019-08-22 22:54:42 +03:00
alexey-milovidov
70a61cc7be
Merge pull request #6609 from dimarub2000/clickhouse_obfuscator_symlink
Clickhouse obfuscator symlink
2019-08-22 22:53:45 +03:00
Alexander Tokmakov
acce56095f limit number of background threads for mutations 2019-08-22 22:35:46 +03:00
Nikolai Kochetov
b6c8a49244 Update 00284_external_aggregation 2019-08-22 20:08:10 +03:00
Nikolai Kochetov
a50d6e7132 Update 00416_pocopatch_progress_in_http_headers. 2019-08-22 18:07:07 +03:00
Vasily Nemkov
6d78e3be94 hasToken function implementation
* Function to check if given token is present in a string;
* Special case for hasToken to 'tokenbf_v1' index;
* Test cases for hasToken()
* Test case for hasToken() + 'tokenbf_v1' integration
2019-08-22 18:00:35 +03:00
Nikolai Kochetov
b3f91a717c Use ThreadFromGlobalPool in PipelineExecutor instead of ThreadPool. 2019-08-22 17:38:44 +03:00
Dmitry Rubashkin
e9d813bff7 Minor fixes 2019-08-22 17:30:18 +03:00
CurtizJ
2aa4243c25 add test for modifier 'with fill' 2019-08-22 17:09:56 +03:00
CurtizJ
9a29c218ff improvents and fixes of modifier 'with fill' for 'order by' clause 2019-08-22 17:08:14 +03:00
Dmitry Rubashkin
095124dcba setOptionsDescription() function added 2019-08-22 17:03:37 +03:00
Nikolai Kochetov
63411b4d4a Try to fix 00093_union_race_conditions_4. 2019-08-22 15:51:33 +03:00
Nikolai Kochetov
1f9087dbb2 Increase memory limit in 00284_external_aggregation. 2019-08-22 13:46:23 +03:00
Nikolai Kochetov
b93ffdd038 Fix MergingSortedTransform. 2019-08-22 13:16:56 +03:00
Nikolai Kochetov
11f8ec76df Fix CubeTransform. 2019-08-22 12:28:23 +03:00
Nikolai Kochetov
4f38b08481 Fix RollupTransform. 2019-08-22 11:53:34 +03:00
Nikolai Kochetov
8228871821 Fix RollupTransform. 2019-08-22 11:29:29 +03:00
akonyaev
705e2c7437 ADQM-34 fix parquet tests 2019-08-22 11:28:32 +03:00
Nikolai Kochetov
c3aaf583a0 Fix RollupTransform. 2019-08-22 11:26:50 +03:00
akonyaev
1683547b2d ADQM-34 fix style 2019-08-22 10:24:04 +03:00
akonyaev
01216e45b6 Merge branch 'master' of https://github.com/yandex/ClickHouse into ADQM-34
# Conflicts:
#	dbms/src/Processors/Formats/Impl/ParquetBlockInputFormat.cpp
2019-08-22 09:40:51 +03:00
alexey-milovidov
83104b3d5e
Merge pull request #6603 from amosbird/fix-dt-hash
Fix segfault when decoding symbol table.
2019-08-22 07:35:32 +03:00
alexey-milovidov
903601d3e3
Merge pull request #6600 from yandex/distributed-files-to-send-metric
Added a metric for the number of files to send in Distributed tables.
2019-08-22 07:34:09 +03:00
Amos Bird
78af6d793d Fix segfault when decoding symbol table. 2019-08-22 12:34:06 +08:00
Alexey Milovidov
c38a8cb755 Merge branch 'master' of github.com:yandex/ClickHouse 2019-08-22 05:32:00 +03:00
Alexey Milovidov
85d3ba099f Added a comment 2019-08-22 05:31:49 +03:00
alexey-milovidov
2ff8f3a5de
Merge pull request #6599 from CurtizJ/fix-order-by-optimization
Disable "read in order" optimization for aggregation without keys.
2019-08-22 05:10:14 +03:00
alexey-milovidov
f0e0793cdd
Merge pull request #6581 from yandex/assert_cast
Added checks to static_cast of columns.
2019-08-22 05:09:34 +03:00
Alexey Milovidov
6bbf3bd634 Added a metric for the number of files to send in Distributed tables 2019-08-22 04:30:49 +03:00
Alexey Milovidov
a7fa71aaf1 Fixed flappy test 2019-08-22 00:28:05 +03:00
Alexey Milovidov
e573b06373 Updated comment 2019-08-21 23:33:38 +03:00
Alexey Milovidov
93d380ddaa Fixed test 2019-08-21 23:32:58 +03:00
alexey-milovidov
4a54f3d7b6
Merge pull request #6583 from yandex/fix-false-race-condition-on-frozen-field
Fixed false data race in "MergeTreeDataPart::is_frozen" field
2019-08-21 23:12:34 +03:00
CurtizJ
d573c4ec3e fix wrong check for disabling "read in order" optimization 2019-08-21 20:42:44 +03:00
Nikolai Kochetov
6d81087bdc Remove _dummy column if it is not needed. 2019-08-21 19:53:40 +03:00
akonyaev
321233ddaa ADQM-34 fix hardcode for,at name in ArrowColumnToCHColumn class 2019-08-21 19:39:20 +03:00
Nikolai Kochetov
2e03ac09ec Fix MergingSortedTransform. 2019-08-21 19:38:27 +03:00
alesapin
b9d3d04c57 Move tasks in schedule pool 2019-08-21 19:02:13 +03:00
Nikolai Kochetov
e68775e3d0 Fix TotalsHavingTransform. 2019-08-21 17:51:32 +03:00
akonyaev
caf0d30a5f ADQM-34 add orc input format 2019-08-21 17:19:47 +03:00
Nikolai Kochetov
fe3221d0e4 Fix SortingAggregatedTransform. 2019-08-21 17:19:18 +03:00
alesapin
be5dd3b994 Remove stupid logic 2019-08-21 16:15:44 +03:00
Nikolai Kochetov
c27cada229 Fix ExpressionTransform. 2019-08-21 16:14:23 +03:00
alesapin
6b85834ae3 Remove excessive logging 2019-08-21 16:11:08 +03:00
Alexander Tokmakov
5cb8605f61 limit number of mutations in the queue 2019-08-21 16:10:33 +03:00
alesapin
323d741038 More concurrent tests 2019-08-21 16:06:01 +03:00
CurtizJ
9fdb9e5805 implement modifier 'with fill' for 'order by' clause 2019-08-21 15:59:03 +03:00
alesapin
d2fe947535 Add test for race condition, found it and fix it 2019-08-21 15:32:48 +03:00
Nikolai Kochetov
2a0a051090 Enable processors by default. 2019-08-21 14:34:40 +03:00
dimarub2000
b5e08fa929 Tried to fix 2019-08-21 14:12:58 +03:00
Dmitry Rubashkin
bd5dabb15c --help size fixed 2019-08-21 13:32:20 +03:00
alesapin
eb5e052855 merge and fixes 2019-08-21 13:09:29 +03:00
alesapin
70ca7f4156 Merge with master 2019-08-21 11:57:35 +03:00
dimarub2000
086dd815ac T_test.h added, some fixes 2019-08-21 11:53:41 +03:00
Alexey Milovidov
3c3ca97218 Addition to prev. revision 2019-08-21 08:47:09 +03:00
alexey-milovidov
f77c8cd79c
Merge pull request #6582 from yandex/fix-fuzz-test
Fixed timeouts in fuzz test
2019-08-21 08:45:01 +03:00
alexey-milovidov
e6fd885c68
Merge pull request #6580 from yandex/fix-nullif
Fix nullIf function.
2019-08-21 06:36:47 +03:00
alexey-milovidov
308baa182e
Merge branch 'master' into table-constraints 2019-08-21 06:33:08 +03:00
Alexey Milovidov
d848009827 Fixed false data race in "MergeTreeDataPart::is_frozen" field 2019-08-21 06:16:59 +03:00
Alexey Milovidov
6e8389bff5 Fixed fuzz test 2019-08-21 06:07:53 +03:00
Alexey Milovidov
c7850d6537 Removed obsolete trash from fuzz test 2019-08-21 06:06:43 +03:00
alexey-milovidov
0e896fb341
Merge pull request #6578 from yandex/disable-elf-on-macos
Disable ELF on Mac OS
2019-08-21 06:01:49 +03:00
Alexey Milovidov
40454aa7a0 Addition to prev. revision 2019-08-21 05:46:54 +03:00
Alexey Milovidov
6e26d8ccdf Addition to prev. revision 2019-08-21 05:42:50 +03:00
Alexey Milovidov
8966520801 Added "assert_cast" function as a replacement for static_cast for columns 2019-08-21 05:28:04 +03:00
Alexey Milovidov
b768bef4e3 Fixed nullIf function 2019-08-21 04:43:19 +03:00
Alexey Milovidov
69be2c4658 Fixed nullIf function 2019-08-21 04:28:55 +03:00
Alexey Milovidov
449dc4757a Fixed nullIf function 2019-08-21 04:20:06 +03:00
Alexey Milovidov
562bffb337 Fixed nullIf function 2019-08-21 04:14:25 +03:00
alexey-milovidov
2b31409332
Merge pull request #6579 from yandex/parquet-bool-fix
Parquet: Fix reading boolean columns
2019-08-21 04:01:28 +03:00
Alexey Milovidov
a6b64d6ba0 Parquet: Fix reading boolean columns 2019-08-21 04:00:13 +03:00
alexey-milovidov
3f607b21fe
Merge pull request #6375 from yandex/try-to-remove-dry-run
Try to remove dry run
2019-08-21 03:52:41 +03:00
Alexey Milovidov
17e93b8f2d Disable ELF on Mac OS #6429 2019-08-21 03:48:34 +03:00
Alexey Milovidov
f277d0ebbf Style 2019-08-21 03:37:55 +03:00
alex-zaitsev
1e6437e4ee WIP: Fix MacOS build (#6429)
* Fix broken MacOS build

* Fix MacOS build

* Update ReadBufferFromFile.cpp

* Update WriteBufferFromFile.cpp

* Update Elf.h

* Update Elf.h
2019-08-21 03:35:41 +03:00
alexey-milovidov
58358ec856
Merge pull request #6514 from yandex/added-test-for-race-conditions
Added a test for race conditions.
2019-08-21 01:33:34 +03:00
alexey-milovidov
a691bf3c91
Merge pull request #6577 from proller/fix27
CLICKHOUSE-3885 copier: use partition_key in check query
2019-08-21 00:33:40 +03:00
Alexey Milovidov
c1de51dc5b Better code 2019-08-20 22:53:27 +03:00
Alexey Milovidov
db55780d21 Added a test 2019-08-20 22:53:03 +03:00
alexey-milovidov
f9968fbcfc
Merge pull request #6554 from yandex/add-table-finctions-number-mt
Add table function numbers_mt
2019-08-20 22:42:27 +03:00
alexey-milovidov
31a4b816fe
Merge pull request #6566 from yandex/filimonov-remove-duplicated-const
remove doubled const TABLE_IS_READ_ONLY
2019-08-20 22:24:40 +03:00
alesapin
469d07ac0f One more 2019-08-20 22:06:03 +03:00
alesapin
e44ab4f4cd Add tests for partitions alter 2019-08-20 22:04:58 +03:00
Alexey Milovidov
3fa67f4b72 Checkpoint 2019-08-20 21:55:05 +03:00
alesapin
8417eb9d95 Remove old tests 2019-08-20 21:35:35 +03:00
Alexey Milovidov
295aafb13f Parallel ALTER modify: don't use ThreadPool if the number of threads is one 2019-08-20 21:18:37 +03:00
Alexey Milovidov
593487c170 Merge branch 'master' into added-test-for-race-conditions 2019-08-20 21:12:03 +03:00
Alexey Milovidov
074853ac0e Fixed flappy test 2019-08-20 21:11:39 +03:00
Alexey Milovidov
c8859febcb Merge branch 'master' into added-test-for-race-conditions 2019-08-20 21:05:25 +03:00
Alexey Milovidov
d8683a33c8 Lowered test scale because it is too slow in debug build 2019-08-20 21:05:05 +03:00
proller
4f1c9ee197 CLICKHOUSE-3885 copier: use partition_key in check query 2019-08-20 21:05:01 +03:00
alesapin
120e27a385 Lock parts with dirty hack 2019-08-20 21:00:48 +03:00
Alexey Milovidov
182708e4b1 Fixed typo 2019-08-20 20:58:31 +03:00
alesapin
9c8ec6e4fc Fixes for replicated merge tree 2019-08-20 20:16:32 +03:00
Nikolai Kochetov
822fe63f3b Added comment. 2019-08-20 19:13:18 +03:00
Nikolai Kochetov
06bb0af386 Fix build. 2019-08-20 18:03:35 +03:00
Nikolai Kochetov
aef03fd9bf
Merge pull request #6425 from yandex/vzakaznikov-liveview
Merge LIVE VIEW
2019-08-20 17:13:42 +03:00
Nikolai Kochetov
7bd748c969 Renamed NumbersMtBlockInputStream to NumbersMultiThreadedBlockInputStream. 2019-08-20 17:13:06 +03:00
Nikolai Kochetov
eecc8b0121 Update tests. 2019-08-20 16:33:25 +03:00
Nikolai Kochetov
0ab886ce9d Materialize constant in arrayWithConstant function. 2019-08-20 15:28:36 +03:00
BayoNet
e986d6ba53
DOCAPI-7459: skip_unavailable_shards docs (#6361)
* Link fix.

* DOCAPI-7459: skip_unavailable_shards docs

* Update dbms/src/Core/Settings.h

Co-Authored-By: Ivan Blinkov <github@blinkov.ru>

* Update docs/en/operations/settings/settings.md

Co-Authored-By: Ivan Blinkov <github@blinkov.ru>

* Update docs/en/operations/settings/settings.md

Co-Authored-By: Ivan Blinkov <github@blinkov.ru>

* Update docs/en/operations/settings/settings.md

Co-Authored-By: Ivan Blinkov <github@blinkov.ru>

* DOCAPI-7459: Markup fixes.
2019-08-20 15:06:52 +03:00
filimonov
8d0c2eacfd
remove doubled const TABLE_IS_READ_ONLY 2019-08-20 13:18:08 +02:00
Ivan
a502424c33
Implement support for insertion into Kafka tables (#6012)
* Add write-callback on each row for RowOutputStream
* Fix build of new rdkafka library
* Poll messages if Kafka outgoing queue is full
* Add test
* Add test producer-consumer
* Truncate delimiter from last row in message
2019-08-20 14:17:57 +03:00
Nikolai Kochetov
0c0e5010dc Added NumbersMtBlockInputStream. 2019-08-20 13:29:04 +03:00
Nikolai Kochetov
7f31b8bf9c Added NumbersMtBlockInputStream. 2019-08-20 13:28:20 +03:00
alesapin
00bdd6c680 Support move partition 2019-08-20 12:59:19 +03:00
Gleb Novikov
86fecc7501 Merge branch 'master' into table-constraints 2019-08-20 12:17:56 +03:00
Nikolai Kochetov
1cebcd3e73 Fixed test. 2019-08-20 12:15:08 +03:00
alesapin
5690498424 Remove excessive logging 2019-08-20 11:44:09 +03:00
alesapin
8408ffbfa6 Almost working replicated MT 2019-08-20 11:38:02 +03:00
Nikolai Kochetov
bfd0505d99 Fix tests. 2019-08-20 11:36:10 +03:00
Nikolai Kochetov
cdf1ce3171 Merge branch 'master' into vzakaznikov-liveview 2019-08-20 10:41:31 +03:00
alexey-milovidov
c870cbce73
Merge pull request #6548 from achimbab/master
Added 'strict' parameter in windowFunnel() and added testcases.
2019-08-20 05:05:49 +03:00
Alexey Milovidov
b7cb55a06e Added a comment 2019-08-20 04:46:48 +03:00
Alexey Milovidov
818ceec220 Merge branch 'added-test-for-race-conditions' of github.com:yandex/ClickHouse into added-test-for-race-conditions 2019-08-20 04:25:21 +03:00
Alexey Milovidov
a574727269 Attempt to fix deadlock 2019-08-20 04:24:53 +03:00
Alexey Milovidov
ebbcd26981 Improved test 2019-08-20 03:53:12 +03:00
Alexey Milovidov
666029db6e Merge branch 'added-test-for-race-conditions' of github.com:yandex/ClickHouse into added-test-for-race-conditions 2019-08-20 03:50:40 +03:00
Alexey Milovidov
99aa5cce38 Fixed idiotic error in system.parts 2019-08-20 03:49:58 +03:00
Alexey Milovidov
f1fef3f169 Merge branch 'master' of github.com:yandex/ClickHouse 2019-08-20 03:48:24 +03:00
Alexey Milovidov
e594c344f5 Fixed idiotic error in system.parts 2019-08-20 03:48:08 +03:00
Alexey Milovidov
6d8161e644 Merge branch 'added-test-for-race-conditions' of github.com:yandex/ClickHouse into added-test-for-race-conditions 2019-08-20 03:10:59 +03:00
Alexey Milovidov
48867580e6 Added another test that produce segfault under ASan easily 2019-08-20 03:10:32 +03:00
alexey-milovidov
3a909c54c5
Merge pull request #6523 from yandex/fix_inconsistent_parts_after_clone_replica
Fix inconsistent parts after clone replica
2019-08-20 02:25:00 +03:00
tavplubix
fa40dfb257
Merge pull request #6559 from yandex/fix_csv_6426
Fix csv input
2019-08-20 02:24:33 +03:00
Alexander Tokmakov
bca580653d fix csv input 2019-08-20 02:09:02 +03:00
philip.han
a2fe2fb7b1 Fixed the test for 00632_aggregation_window_funnel. 2019-08-20 07:55:02 +09:00
alexey-milovidov
dfa6385eb3
Merge pull request #6538 from orivej/odbc-bridge
DEVTOOLS-5755 Remove odbc-bridge.cpp from clickhouse-lib
2019-08-20 01:39:48 +03:00
alexey-milovidov
fe634d69fe
Merge pull request #6550 from yandex/fix_6125
Fix NPE when using IN clause with a subquery with a tuple
2019-08-20 01:39:02 +03:00
Alexander Kazakov
fe5cd47068
Process prewhere clause in "skip unused shards" optimization (#6521)
* Process prewhere clause in optimize_skip_unused_shards

* Better diagnostics and logging
2019-08-19 23:28:24 +03:00
Alexey Milovidov
5d17e0e0e0 Updated test 2019-08-19 22:51:53 +03:00
Alexey Milovidov
5575be034d Whitespaces 2019-08-19 22:32:02 +03:00
Alexey Milovidov
4809586ed6 Updated instruction 2019-08-19 22:07:13 +03:00
Alexey Milovidov
22a11343e8 Attempt to fix race condition 2019-08-19 22:02:20 +03:00
Nikolai Kochetov
19a303f498 Update perf tests with hash functions. 2019-08-19 21:55:42 +03:00
Nikolai Kochetov
d359ff3d4a Fix build. 2019-08-19 21:34:12 +03:00
Nikolai Kochetov
56a9c3920f Fix build. 2019-08-19 21:28:48 +03:00
Nikolai Kochetov
8535ba9e47 Review fixes. 2019-08-19 21:23:37 +03:00
stavrolia
1190e866aa Fix 2019-08-19 21:12:50 +03:00
stavrolia
b3fd5bc141 Add tests, comments and fix 2019-08-19 21:12:50 +03:00
stavrolia
2bfd398107 fix test 2019-08-19 21:12:50 +03:00
stavrolia
2f2bf953eb fix and add test for storage file version 2019-08-19 21:12:50 +03:00
stavrolia
32fad1e961 fix 2019-08-19 21:12:50 +03:00
stavrolia
229dd7c2b6 wip 2019-08-19 21:12:50 +03:00
stavrolia
f9037fee2c Fix File version 2019-08-19 21:12:50 +03:00
stavrolia
b386b3090c Impove HDFS version 2019-08-19 21:12:50 +03:00
stavrolia
95cb95105d Add recursive version for storage file 2019-08-19 21:12:50 +03:00
stavrolia
7addd50c16 recursive version for StorageHDFS and some tests for it 2019-08-19 21:12:50 +03:00
stavrolia
a3b35d5569 WIP 2019-08-19 21:12:50 +03:00
stavrolia
e6d85de79a wip small change 2019-08-19 21:12:50 +03:00
stavrolia
6055c61e7f wip hdfs 2019-08-19 21:12:50 +03:00
stavrolia
dbf1417bd6 Globs in storage file 2019-08-19 21:12:50 +03:00
Alexey Milovidov
d2e5789f82 Fixed strange code in mutations that may lead to memory corruption 2019-08-19 21:12:22 +03:00
Nikolai Kochetov
04c17c56c2 Review fixes. 2019-08-19 21:10:40 +03:00
alesapin
e9e67a2688 Almost compilable 2019-08-19 20:59:16 +03:00
Nikolai Kochetov
3277f9e3de Add patch to Live View tests. 2019-08-19 20:56:00 +03:00
Nikolai Kochetov
d4363768e6 Added IFunctonBase::getResultIfAlwaysReturnsConstantAndHasArguments 2019-08-19 20:48:19 +03:00
Alexey Milovidov
481b9d36dd Merge branch 'master' into added-test-for-race-conditions 2019-08-19 20:43:35 +03:00
alexey-milovidov
a116fd7a69
Merge pull request #6477 from dimarub2000/quantileExact_improvement
QuantileExactExclusive & Inclusive function added.
2019-08-19 20:39:37 +03:00
Alexander Tokmakov
9e2537a7d0 add test 2019-08-19 19:52:05 +03:00
Alexander Tokmakov
c62eb7a3ae check columns count and types 2019-08-19 19:51:50 +03:00
dimarub2000
bb4136f7b0 virtual functions deleted 2019-08-19 19:03:25 +03:00
Nikolai Kochetov
a4e2fcdd49 Remove recursiveMaterializeConstants. 2019-08-19 18:41:42 +03:00
philip.han
61769865d8 Added 'strict' parameter in windowFunnel() and added testcases. 2019-08-19 23:52:42 +09:00
alesapin
4ccdb8f92e Better code 2019-08-19 17:40:12 +03:00
Nikolai Kochetov
a466040201 Added 00991_temporary_live_view_watch_events_heartbeat. 2019-08-19 17:39:35 +03:00
Alexander Tokmakov
be5df60c7a Merge branch 'master' into fix_inconsistent_parts_after_clone_replica 2019-08-19 17:34:22 +03:00
Nikolai Kochetov
e188ae40ce Added 00991_temporary_live_view_watch_live. 2019-08-19 16:35:00 +03:00
Nikolai Kochetov
619ee4489e Added 00991_live_view_watch_event_live. 2019-08-19 16:26:37 +03:00
Nikolai Kochetov
61432b83d8 Added table function numbers_mt. 2019-08-19 15:27:51 +03:00
Alexander Tokmakov
6991683a5f remove local parts which source replica doesnt have 2019-08-19 15:08:45 +03:00
alesapin
f2a8c18c1f Simplify lock 2019-08-19 14:18:58 +03:00
alesapin
69015f292e Fix wrong merge 2019-08-19 14:18:39 +03:00
Nikolai Kochetov
a33c59d83b Update Live View test. 2019-08-19 14:08:10 +03:00
alesapin
6d29ed99d9 Fix bug with enable_mixed_granularity_parts and mutations 2019-08-19 13:37:04 +03:00
Nikolai Kochetov
4c45ce3038 Apply patches to Live View tests. 2019-08-19 12:47:08 +03:00
alesapin
a85cdc91a6 Merge branch 'master' into ObjatieGroba-feature_multiple_disks 2019-08-19 11:34:02 +03:00
alesapin
99e85ff753 Fix build 2019-08-19 11:25:07 +03:00
alesapin
e7542810bb Merge with master 2019-08-19 11:20:48 +03:00
Nikolai Kochetov
b8a5e107df Merge branch 'master' into try-to-remove-dry-run 2019-08-19 09:09:22 +03:00
Георгий Кондратьев
c70d585169 DEVTOOLS-5755 Remove odbc-bridge.cpp from clickhouse-lib
odbc-bridge.cpp defines main() so it should not be included in clickhouse-lib.
2019-08-19 05:13:39 +00:00
Nikolai Kochetov
28f4346fca Updated json perftest to loop. 2019-08-19 00:50:51 +03:00
Nikolai Kochetov
b85c50e7c3 Fix tests. 2019-08-18 17:55:20 +03:00
Alexey Milovidov
d7d11b85ca Update version manually 2019-08-18 16:53:25 +03:00
alexey-milovidov
f36d20915b
Merge pull request #6529 from yandex/better-signals
Better debug-ability of fault signals.
2019-08-18 16:44:54 +03:00
alexey-milovidov
1c9fedb77b
Merge pull request #6530 from yandex/metric-log-rectification
Metric log rectification
2019-08-18 16:44:21 +03:00
alexey-milovidov
29cc99ad58
Merge pull request #6194 from yurriy/mysql
Compatibility with more MySQL clients.
2019-08-18 16:28:13 +03:00
Nikolai Kochetov
cb848159e1 Merged with master. 2019-08-18 14:52:49 +03:00
Alexey Milovidov
9b48906f16 Rectification of MetricLog: simplified code 2019-08-18 03:34:23 +03:00
Alexey Milovidov
968cbda666 Rectification of MetricLog 2019-08-18 03:25:58 +03:00
Alexey Milovidov
16495bab5b Rectification of MetricLog 2019-08-18 03:04:58 +03:00
alexey-milovidov
1b3f19abab
Update StackTrace.h 2019-08-18 03:03:19 +03:00
proller
d09c5c871b Build fixes (#6491)
* Fix build

* cmake: fix cpuinfo

* Fix includes after processors merge

Conflicts:
	dbms/src/Processors/Formats/Impl/CapnProtoRowInputFormat.cpp
	dbms/src/Processors/Formats/Impl/ParquetBlockOutputFormat.cpp
	dbms/src/Processors/Formats/Impl/ProtobufRowInputFormat.cpp
	dbms/src/Processors/Formats/Impl/ProtobufRowOutputFormat.cpp

* Fix build in gcc8

* fix test link

* fix test link

* Fix test link

* link fix

* Fix includes after processors merge 2

Conflicts:
	dbms/src/Processors/Formats/Impl/ParquetBlockInputFormat.cpp

* Fix includes after processors merge 3

* link fix

* Fix likely/unlikely conflict with cython

* Fix conflict with protobuf/stubs/atomicops.h

* remove unlikely.h

* Fix macos build (do not use timer_t)
2019-08-18 01:53:46 +03:00
alexey-milovidov
97a7d78fb3
Merge pull request #6524 from 4ertus2/refactoring
More ExpressionAnalyzer refactoring  for JOINs
2019-08-18 01:46:02 +03:00
Alexey Milovidov
306878c7a0 Write symbolized stack trace on failure one line at a time and uncached 2019-08-18 01:39:26 +03:00
Alexey Milovidov
833256f310 Don't try to get delay of readonly replicas for AsynchronousMetrics 2019-08-18 00:18:22 +03:00
Alexey Milovidov
081f1bedc2 Allowed to use SIGPROF to print stack traces for debugging purposes 2019-08-18 00:13:38 +03:00
Alexey Milovidov
2cd669fa1d Minor improvement 2019-08-17 23:33:50 +03:00
alexey-milovidov
e2687fc2d5
Merge pull request #6513 from yandex/parts-race-condition
Fix race condition in system.parts vs. ALTER
2019-08-17 22:30:16 +03:00
Nikolai Kochetov
86bba711c4 Merge branch 'master' into try-to-remove-dry-run 2019-08-17 13:43:14 +03:00
Nikolai Kochetov
5c10bff9c2 Try to rewrite live view test. 2019-08-16 21:52:29 +03:00
Vitaly Baranov
e7a2565290
Merge pull request #6479 from vitlibar/no-allocation-in-simdjson-iterator
Get rid of dynamic allocation in ParsedJson::Iterator.
2019-08-16 20:58:16 +03:00
Nikolai Kochetov
ab4018e98e Fix test. 2019-08-16 19:56:34 +03:00
chertus
133bd92807 ExpressionAnalyzer.appendJoin() refactoring 2019-08-16 19:50:30 +03:00
alexey-milovidov
3c6db12efa
Merge pull request #6511 from nikvas0/nikvas0/set_index_bit_func_checks
typechecks for set index functions
2019-08-16 19:29:14 +03:00
Nikolai Kochetov
e9070ede0a Try to rewrite live view test. 2019-08-16 19:28:25 +03:00
Alexander Tokmakov
8bbcecf3b1 add test 2019-08-16 19:15:36 +03:00
alesapin
defc1e30ca Some improvements 2019-08-16 18:57:19 +03:00
alesapin
af2a947ba1
Update StorageSystemParts.cpp 2019-08-16 18:06:02 +03:00
alesapin
ebdc0eb338
Update 00991_system_parts_race_condition.sh 2019-08-16 17:56:42 +03:00
Nikolai Kochetov
29f4f83c39 Fix build. 2019-08-16 15:54:50 +03:00
Nikolai Kochetov
7da72261a2 Merge branch 'master' into try-to-remove-dry-run 2019-08-16 15:50:48 +03:00
Vitaly Baranov
69ed5279b5 Get rid of dynamic allocation in ParsedJson::Iterator. 2019-08-16 15:48:48 +03:00
Vitaly Baranov
fa5f802adb
Merge pull request #6486 from Vxider/master
build fix
2019-08-16 15:20:33 +03:00
Nikolai Kochetov
688cc4976a Moved NOTICE to dbms/src 2019-08-16 14:03:23 +03:00
Nikolai Kochetov
18ad0e7e6b Merged with master. 2019-08-16 13:55:40 +03:00
Nikolai Kochetov
670c8a3e50 Add alwaysReturnsConstant for IFunctionBase. 2019-08-16 13:41:17 +03:00
Nikolai Kochetov
0eb1a931b4 Add alwaysReturnsConstant for IFunctionBase. 2019-08-16 13:29:33 +03:00
Nikolai Kochetov
08021fe125 Add alwaysReturnsConstant for IFunctionBase. 2019-08-16 12:38:12 +03:00
alesapin
6333f4b074 Better 2019-08-16 12:20:44 +03:00
alesapin
b808f2e2e8 Add metric log 2019-08-16 11:19:13 +03:00
Alexey Milovidov
8d3ede98e2 Added another test 2019-08-16 05:21:01 +03:00
Alexey Milovidov
ab827ca6f3 Added failing test 2019-08-16 04:28:41 +03:00
Alexey Milovidov
b66719725f Fix race condition in system.parts vs. ALTER 2019-08-16 03:49:33 +03:00
alexey-milovidov
01a046e8ca
Merge pull request #5053 from nikvas0/nikvas0/index_mutate
indices and mutations
2019-08-16 02:44:48 +03:00
alexey-milovidov
a466c7aebd
Merge pull request #6299 from CurtizJ/order-by-efficient
Optimizations of ranges selection while reading with enabled optimize_read_in_order.
2019-08-16 02:39:53 +03:00
Alexey Milovidov
cf9b41549d MetricLog: code cleanups; comments 2019-08-16 02:35:54 +03:00
alexey-milovidov
a70bfa13d4
Merge pull request #6467 from nikitamikhaylov/system_metric_log
system.metric_log table
2019-08-16 02:28:53 +03:00
alexey-milovidov
bd2c5e14cd
Merge pull request #6499 from 4ertus2/refactoring
ExpressionAnalyzer and ActionsVisitor refactoring
2019-08-16 01:41:59 +03:00
alexey-milovidov
3a43512d2f
Merge pull request #6507 from yandex/fix-external-dictionaries-test-for-non-root
Fix test_external_dictionaries for non root user.
2019-08-16 01:40:53 +03:00
Yuriy
25c882e3cc fixed unbundled build 2019-08-16 00:22:54 +03:00
Nikolai Kochetov
2ef878d7ce Add alwaysReturnsConstant for IFunctionBase. Set alwaysReturnsConstant=true for ignore. 2019-08-15 22:31:43 +03:00
Nikita Vasilev
a051009d28 add it's a bug mes 2019-08-15 21:48:48 +03:00
Nikita Vasilev
f59fa67050 added type checks for set index functions 2019-08-15 21:46:16 +03:00
Nikita Vasilev
053f0ee78d fix compilation 2019-08-15 20:46:35 +03:00
alesapin
f988ff538b Less code 2019-08-15 20:02:04 +03:00
Nikita Vasilev
00a5fe7836 Merge remote-tracking branch 'upstream/master' into nikvas0/index_mutate 2019-08-15 19:48:57 +03:00
Yuriy
c5b6d1f9bf merged origin/master 2019-08-15 19:48:10 +03:00
Nikita Mikhaylov
2cfbd1e194 reused prev_timepoint 2019-08-15 19:39:18 +03:00
Nikita Mikhaylov
854da3b6a2 ms column added 2019-08-15 19:09:43 +03:00
chertus
47a9424190 Merge branch 'master' into refactoring 2019-08-15 18:32:56 +03:00
chertus
e895251bc6 minor changes 2019-08-15 17:22:33 +03:00
Ivan Lezhankin
c52a34fd15 Add test for multiple mat. views 2019-08-15 17:19:12 +03:00
Nikolai Kochetov
24e5b95b98 Fix test_external_dictionaries for non root user. 2019-08-15 17:00:36 +03:00
chertus
994f9f3cc6 unify ActionsVisitor: rewrite as InDepthNodeVisitor 2019-08-15 16:54:59 +03:00
chertus
1b500ade45 remove duplicated include 2019-08-15 14:22:19 +03:00
Nikolai Kochetov
67f6129284 Temporarily disabled 00963_temporary_live_view_watch_live_timeout. 2019-08-15 14:18:41 +03:00
Nikolai Kochetov
e2171a038b Temporarily disabled 00963_temporary_live_view_watch_live_timeout. 2019-08-15 14:10:33 +03:00
CurtizJ
00d98c51c3 fix limit without order 2019-08-15 14:09:41 +03:00
CurtizJ
6ef3b5f9c7 fix usage of global syntax_result in optimizeReadInOrder 2019-08-15 13:15:04 +03:00
Nikolai Kochetov
90cb316457 Added more comments. Fix operator== in ExpressionActions. 2019-08-15 12:51:53 +03:00
alesapin
d81961c4ca Fix strange code 2019-08-15 12:43:31 +03:00
Nikolai Kochetov
333746b910 Update 00459_group_array_insert_at.sql 2019-08-15 12:12:52 +03:00
Alexandr Krasheninnikov
27b079bd6a Tests added, fix wrong behaviour 2019-08-15 11:59:20 +03:00
Nikolai Kochetov
09dfc26087 Remove _dummy column at InterpreterSelectQuery::unifyStreams. 2019-08-15 11:50:17 +03:00
Nikolai Kochetov
abfaa9620d Fix style. 2019-08-15 11:09:18 +03:00
Nikolai Kochetov
a4be4da9b4 Added recursiveMaterializeConstants. 2019-08-15 10:55:59 +03:00
Nikolai Kochetov
6586f059b5 Added recursiveMaterializeConstants. 2019-08-15 10:54:39 +03:00
Nikolai Kochetov
807bc5205a Update 00818_inner_join_bug_3567.reference 2019-08-15 10:39:00 +03:00
Nikolai Kochetov
867a7461dc Make randConstant const again. 2019-08-15 10:32:06 +03:00
Nikolai Kochetov
37a88e1407 Added recursiveMaterializeConstants. 2019-08-15 10:28:33 +03:00
Nikolai Kochetov
720fe61a14
Merge pull request #6494 from yandex/fix-pipeline-executor-types
Fix arg type forPipelineExecutor::prepareProcessor
2019-08-15 09:54:18 +03:00
Nikolai Kochetov
551d04c01f
Merge pull request #6495 from yandex/fix-format-factory-default-streams
Fix FormatFactory default formats.
2019-08-15 09:53:51 +03:00
Gleb Novikov
f69ceec04c Removed redundant include of Interpreters/ActionsVisitor.h 2019-08-15 08:40:08 +03:00
Gleb Novikov
5ee4238538 small change to run CI 2019-08-15 03:53:16 +03:00
alexey-milovidov
64f676504d
Merge pull request #6493 from yandex/request-splitting-test
Added a test for bad URIs
2019-08-14 23:55:34 +03:00
Gleb Novikov
d41bb1fc19 Reverted server config.xml 2019-08-14 22:52:39 +03:00
Gleb Novikov
ab1c4139de Added ReplicatedMergeTree support and test for constraints, also added VIOLATED_CONSTRAINT error 2019-08-14 22:51:03 +03:00
chertus
7c566f317c refactoring: extract SelectQueryExpressionAnalyzer from ExpressionAnalyzer 2019-08-14 22:30:30 +03:00
CurtizJ
0b3d7d8032 Merge remote-tracking branch 'upstream/master' into order-by-efficient 2019-08-14 21:26:25 +03:00
CurtizJ
a785d4a435 Merge branch 'master' of https://github.com/yandex/ClickHouse into merging_with_ties_and_with_fill 2019-08-14 20:24:47 +03:00
Nikita Mikhaylov
e83482b512 metric_log.xml 2019-08-14 20:21:45 +03:00
alexey-milovidov
7a439e269f
Merge pull request #6470 from alex-krash/function_user
Function currentUser()
2019-08-14 20:09:54 +03:00
alexey-milovidov
a9d48ad503
Merge pull request #6482 from yandex/allow-library-dictionary-with-asan
Allow to use library dictionary source with ASan.
2019-08-14 20:05:13 +03:00
CurtizJ
72b80fe1f7 merging with master 2019-08-14 20:01:47 +03:00
chertus
047a14a189 one more minor refactoring 2019-08-14 19:53:30 +03:00
CurtizJ
eb3a3f44d0 better avoiding of array join in optimizeReadInOrder 2019-08-14 19:15:03 +03:00
Nikolai Kochetov
be009d971d Fix FormatFactory default formats. 2019-08-14 18:54:51 +03:00
chertus
97d6f2218c minor refactoring 2019-08-14 18:34:32 +03:00
alesapin
1d22d98365 Less auto code 2019-08-14 18:31:19 +03:00
Nikolai Kochetov
e51c48501b Fix arg type forPipelineExecutor::prepareProcessor 2019-08-14 18:28:33 +03:00
alesapin
bccf62100f Revert check 2019-08-14 18:25:57 +03:00
Nikolai Kochetov
b323f08907 Fix build. 2019-08-14 18:23:57 +03:00
Alexey Milovidov
cab85b30b9 Added a test for bad URIs 2019-08-14 18:23:22 +03:00
alesapin
e391ce813d refactoring 2019-08-14 18:20:52 +03:00
Nikolai Kochetov
287eb633b8 Merged with master 2019-08-14 18:16:52 +03:00
Nikolai Kochetov
5131b6af4b Fix header for joins. Make function randConstant not constant. 2019-08-14 18:14:32 +03:00
Nikolai Kochetov
8f55fdbd15 Wrap const columns in RemoteBlockInputStream. 2019-08-14 18:14:37 +03:00
Nikolai Kochetov
b5c9be75c4 Materialize constant keys in header. 2019-08-14 18:14:32 +03:00
Nikolai Kochetov
0635188104 Allow constants for RemoteBlockInputStream. 2019-08-14 18:14:32 +03:00
Nikolai Kochetov
16918c7dba Added more comments. 2019-08-14 18:14:32 +03:00
Nikolai Kochetov
de93b759c9 Return non-const column in ignoreExceptNull. 2019-08-14 18:14:32 +03:00
Nikolai Kochetov
e10f198d72 Fix build. 2019-08-14 18:14:32 +03:00
chertus
ddde50c542 minor fixes in includes 2019-08-14 17:06:16 +03:00
Dmitry Rubashkin
4090e89410 Tests fixed 2019-08-14 16:47:48 +03:00
Dmitry Rubashkin
e56f626430 Tests 2019-08-14 16:45:04 +03:00
CurtizJ
22d9bd06cc Merge branch 'dmitriiut-WITH_TIES_and_WITH_FILL' of https://github.com/dmitriiut/ClickHouse into merging_with_ties_and_with_fill 2019-08-14 16:40:07 +03:00
alexey-milovidov
5b25c30f52
Update 00990_function_current_user.sql 2019-08-14 16:25:42 +03:00
alexey-milovidov
e5a40eb493
Merge pull request #6458 from 4ertus2/refactoring
More ExpressionAnalyzer refactoring
2019-08-14 16:10:36 +03:00
Nikita Mikhaylov
d1e5fcd281 std::move 2019-08-14 16:08:07 +03:00
Nikita Mikhaylov
15bbf080f3 changes after review 2019-08-14 15:54:41 +03:00
CurtizJ
d44d2d1731 rewrite trash code in optimizeReadInOrder and disable read in order optimization with joins 2019-08-14 15:29:21 +03:00
Alexandr Krasheninnikov
d9234a64c4 Make function return initial user 2019-08-14 15:18:11 +03:00
Alexandr Krasheninnikov
2126196c89 Nullable correct handling 2019-08-14 15:09:51 +03:00
alesapin
6a283b6bde Remove segfault 2019-08-14 14:59:45 +03:00
Alexandr Krasheninnikov
986d56ba0c Fix casting style, work with Nullable 2019-08-14 14:32:03 +03:00
dimarub2000
73e208917c Fixed comment 2019-08-14 14:18:46 +03:00
dimarub2000
6b6e477c76 Added QuantileExactInclusive function. Deleted redundant virtuals. 2019-08-14 14:13:04 +03:00
akuzm
6bcfe51edf
In performance test, do not read query log for queries we didn't run. (#6427) 2019-08-14 14:04:11 +03:00
alesapin
a2ca18d287 Fix test 2019-08-14 13:30:36 +03:00
Alexandr Krasheninnikov
bc4177f64c Make alias case-insenstitive 2019-08-14 13:20:15 +03:00
alesapin
949890ee90 Merged 2019-08-14 12:46:30 +03:00
Vxider
09a67981b7 build fix 2019-08-14 14:56:43 +08:00
Alexey Milovidov
09ecd865fc Allow to use library dictionary source with ASan. May impose troubles. 2019-08-14 03:26:38 +03:00
CurtizJ
94bca8315d Merge remote-tracking branch 'upstream/master' into order-by-efficient 2019-08-14 01:41:38 +03:00
Vitaly Baranov
75aa1d7858
Merge pull request #6320 from yandex/simdjson-sse42
Enabled SIMDJSON for SSE 4.2 with PCLMUL instruction set
2019-08-13 23:12:40 +03:00
dimarub2000
43ee50e512 QuantileExactExclusive function added. 2019-08-13 22:12:31 +03:00
CurtizJ
c3e0ceecde wait for finish calculations at underlying streams while cancelling AsynchronousBlockInputStream 2019-08-13 21:28:18 +03:00
Nikita Mikhaylov
a3d4fbd07d simple test added 2019-08-13 20:02:17 +03:00
Nikita Mikhaylov
eed8dd7138 better 2019-08-13 19:48:23 +03:00
Nikita Mikhaylov
e07f3d9d10 refactor 2019-08-13 19:47:12 +03:00
alesapin
96f62fefcc Add mutex for settings 2019-08-13 19:34:52 +03:00
Nikita Mikhaylov
7dba25ff9d const 2019-08-13 19:17:18 +03:00
Alexandr Krasheninnikov
e227611f01 New function currentUser() implemented 2019-08-13 19:05:13 +03:00
Vitaly Baranov
9632c4102a Change test to pass the exceeding of memory limit in ParsedJson::Iterator::Iterator when UBSan is used. 2019-08-13 18:26:31 +03:00
Nikita Mikhaylov
c8970ea6d5 nothing 2019-08-13 17:52:35 +03:00
Nikita Mikhaylov
e9fcccff59 conflict resolved 2019-08-13 17:47:19 +03:00
alesapin
031bfc7bf3 Remove reference 2019-08-13 17:46:18 +03:00
Nikita Mikhaylov
c69684e807 better 2019-08-13 17:40:19 +03:00
Nikita Mikhaylov
875d7aef8b better 2019-08-13 17:32:32 +03:00
Nikita Mikhaylov
bbe20b3f9f done 2019-08-13 17:31:46 +03:00
CurtizJ
7ae73befd6 wait for finish calculations at underlying streams while cancelling AsynchronousBlockInputStream 2019-08-13 17:07:36 +03:00
chertus
87fbc2a5cb minor improvements 2019-08-13 16:48:09 +03:00
Alexandr Krasheninnikov
6bf3902ce5 Format file 2019-08-13 16:20:32 +03:00
Alexandr Krasheninnikov
ea9cf3a62f Done 2019-08-13 16:11:24 +03:00
chertus
10a1991855 move getAggregates() into SyntaxAnalyzer 2019-08-13 15:39:03 +03:00
alesapin
f988090111 Remove redundant move 2019-08-13 15:10:58 +03:00
alesapin
b00903330f Remove empty block 2019-08-13 15:03:42 +03:00
alesapin
5b85373c56 Fix stupid bug 2019-08-13 14:58:59 +03:00
alesapin
bf5ec73582 Fix clang build 2019-08-13 14:40:45 +03:00
alesapin
7b1039568c Revert old changed 2019-08-13 14:24:18 +03:00
alesapin
1b68d79c59 Revert immutable settings 2019-08-13 13:56:58 +03:00
chertus
3d00e4b374 remove wrong logic 2019-08-13 13:56:12 +03:00
alesapin
9e78781378 Fix tests 2019-08-13 13:39:06 +03:00
alesapin
ad81c743c1 Buildable code 2019-08-13 13:29:31 +03:00
Alexandr Krasheninnikov
9fa0b867f1 Merge branch 'master' of https://github.com/yandex/ClickHouse into function_next_prev_in_block 2019-08-13 11:45:00 +03:00
alesapin
428c753ed7 Merge with master 2019-08-13 11:37:47 +03:00
alesapin
8e72d4c2ec Tryin COW settings 2019-08-13 11:35:49 +03:00
Nikita Mikhaylov
9650da43ec wMerge branch 'master' of github.com:yandex/ClickHouse into atomic_zookeeper2 2019-08-13 11:03:42 +03:00
Nikita Mikhaylov
313f72e41a remove try catch + submodule update 2019-08-13 11:03:31 +03:00
chertus
f2a03d9d51 several fixes 2019-08-13 03:25:51 +03:00
Alexey Milovidov
60504bc2c8 Change logger_name column in text_log to LowCardinality #6037 2019-08-13 02:47:15 +03:00
Alexey Milovidov
67a20342cc Merge branch 'master' of github.com:yandex/ClickHouse 2019-08-13 01:53:28 +03:00
Alexey Milovidov
c96fa2c080 Fixed build 2019-08-13 01:53:19 +03:00
alexey-milovidov
39ef3e3a27
Merge pull request #6446 from PerformanceVision/null_if
nullIf return now the correct result when both arguments are constants
2019-08-13 01:20:27 +03:00
Alexey Milovidov
6ebd002926 Fixed build 2019-08-13 01:19:20 +03:00
Nikita Mikhaylov
4be51007c5 empty commit 2019-08-13 00:45:59 +03:00
alexey-milovidov
470c371635
Merge pull request #6444 from Enmk/gorilla_fixes
Fixed Gorilla encoding error on small sequences.
2019-08-12 23:03:13 +03:00
Vasily Nemkov
95a38b9e19 Fixed builds on GCC-9 and Clang-8 2019-08-12 22:43:03 +03:00
alexey-milovidov
f992df8cc2
Merge pull request #6447 from yandex/fix_complex_key_cached_string_dict
Fix bug with memory allocation for string fields in complex key cache dictionary
2019-08-12 22:30:39 +03:00
alexey-milovidov
ed0411a414
Merge pull request #6456 from nikitamikhaylov/current_thread_init
CurrentThread initialization bug
2019-08-12 22:29:23 +03:00
alexey-milovidov
fbcb5f5d31
Merge pull request #6450 from 4ertus2/some
Fix memory tracking under sanitizers
2019-08-12 22:28:34 +03:00
chertus
15d2561ac8 more ExpressionAnalyzer refactoring 2019-08-12 22:27:09 +03:00
Nikolai Kochetov
292758a321
Update CurrentThread.cpp 2019-08-12 19:33:21 +03:00
Nikita Mikhaylov
8328a06eec update renaming metadata files 2019-08-12 19:20:31 +03:00
Nikolai Kochetov
ae18a6e438
Update CurrentThread.h 2019-08-12 19:07:53 +03:00
Nikolai Kochetov
1cab72450b
Update CurrentThread.cpp 2019-08-12 19:06:34 +03:00
Alexandr Krasheninnikov
31fdc99efc In progress 2019-08-12 18:44:28 +03:00
Nikita Mikhaylov
ad5c7c0b65 done 2019-08-12 18:16:23 +03:00
Alexandr Krasheninnikov
1b54a52488 Temp 2019-08-12 17:10:29 +03:00
alesapin
34b96c19de Better test 2019-08-12 17:06:17 +03:00
alesapin
98d38e041f Fix recreation of replicated table with fixed granularity 2019-08-12 16:30:29 +03:00
Nikita Mikhaylov
fafbd2b188 fix drop with memory engine 2019-08-12 15:56:10 +03:00
chertus
2b47839a98 fix memory tracking under sanitizers 2019-08-12 15:21:07 +03:00
Nikolai Kochetov
43e5cbe35c Fix build/ 2019-08-12 14:06:28 +03:00
Nikolai Kochetov
545420963d Fix build/ 2019-08-12 14:04:30 +03:00
Nikolai Kochetov
18939a5776 Fix build/ 2019-08-12 13:59:45 +03:00
Nikolai Kochetov
631bbde420 Merged with master. 2019-08-12 13:19:13 +03:00
Nikita Mikhaylov
fd4638aa64 drop materialized view fixed 2019-08-12 13:13:03 +03:00
Alexandr Krasheninnikov
2e79158b5c Merge branch 'master' of https://github.com/yandex/ClickHouse into function_next_prev_in_block 2019-08-12 12:59:11 +03:00
alesapin
2ca6c0b1bf Fix bug with memory allocation for string fields in complex key cache dictionary 2019-08-12 12:37:48 +03:00
Guillaume Tassery
3f572a45b7 Fix nullIf when we have a null constant on the right argument 2019-08-12 10:46:58 +02:00
Vasily Nemkov
923c6889e8 Fixed Gorilla encoding error on small sequences.
Added test cases for small sequences;
Refurbished test cases for codecs;
2019-08-12 07:59:20 +03:00
Alexey Milovidov
8cd759565d Updated test (the previous test was a wrong reference) 2019-08-12 06:06:44 +03:00
Alexey Milovidov
3604d8f961 Merge branch 'master' into fix-array-enumerate-uniq-ranked 2019-08-12 05:26:48 +03:00
alexey-milovidov
775cd0e315
Merge pull request #6441 from yandex/better-log-messages
Slightly better information messages
2019-08-12 04:53:20 +03:00
alexey-milovidov
938aa8db02
Merge pull request #6442 from yandex/add-test-for-expansion-of-aliases
Added a test for the limit on expansion of aliases just in case
2019-08-12 04:53:12 +03:00
alexey-milovidov
27c46be554
Merge pull request #6435 from yandex/batch-aggregator
Batch aggregator (experimental)
2019-08-12 04:52:22 +03:00
Alexey Milovidov
2570907f44 Removed useless parameter 2019-08-12 00:45:18 +03:00
Alexey Milovidov
e5ff049b91 Added a test just in case 2019-08-12 00:03:49 +03:00
Alexey Milovidov
5830526fa1 Slightly better information messages 2019-08-11 23:37:53 +03:00
Alexey Milovidov
28e0e64638 Added a test 2019-08-11 23:04:14 +03:00
Alexey Milovidov
fbaf6b9a4b Parallel loading of data parts #6074 2019-08-11 23:02:51 +03:00
Alexey Milovidov
0b1a4420cb More simple 2019-08-11 22:30:39 +03:00
Alexey Milovidov
006a5e51b7 Merge branch 'master' into speed-up-parts-removal 2019-08-11 22:26:24 +03:00
Alexey Milovidov
1cd87078c2 Merge branch 'master' of github.com:yandex/ClickHouse 2019-08-11 22:24:53 +03:00
Alexey Milovidov
2f73b72007 Style 2019-08-11 22:24:42 +03:00
Alexey Milovidov
ed7db76c94 Speed-up parts removal #6372 2019-08-11 22:14:42 +03:00
Gleb Novikov
3b9e1f9bf7 Fixed getIdentifierName call in AlterCommand::parse 2019-08-11 13:39:17 +03:00
Gleb Novikov
381ea6cb6e Merge branch 'master' into table-constraints 2019-08-11 12:38:34 +03:00
Gleb Novikov
0233f32f9b Fixed AddresSanitizer error 2019-08-11 12:28:15 +03:00
alexey-milovidov
25e97b0b87
Merge pull request #6400 from abyss7/issue-5286
Add more virtual columns to Kafka engine
2019-08-11 05:17:27 +03:00
alexey-milovidov
8520288044
Merge pull request #6416 from 4ertus2/some
Refactoring: move collectUsedColumns() to SyntaxAnalyzer
2019-08-11 05:16:22 +03:00
alexey-milovidov
7c3632635d
Merge pull request #6404 from CurtizJ/fix-topk
Fix topK and topKWeighted functions.
2019-08-11 05:15:51 +03:00
Alexey Milovidov
cc5b34d778 Addition to prev. revision 2019-08-11 04:00:54 +03:00
Alexey Milovidov
f00fa640ba Removed old optimization that is now dominated by the new optimization 2019-08-11 02:40:15 +03:00
Alexey Milovidov
011e50cae6 Removed useless function arguments 2019-08-11 02:27:25 +03:00
Alexey Milovidov
3885cc20b8 Improved performance of aggregation without key 2019-08-11 02:22:23 +03:00
Alexey Milovidov
c98d2fe6e1 Addition to prev. revision 2019-08-11 01:54:33 +03:00
Alexey Milovidov
efa51a6cd9 Batch aggregation (experimental) 2019-08-11 01:36:55 +03:00
Alexey Milovidov
45b88adedc Merge branch 'master' into fix-array-enumerate-uniq-ranked 2019-08-11 00:35:37 +03:00
Ivan Lezhankin
fd27ac9e9e Merge remote-tracking branch 'upstream/master' into issue-5286 2019-08-11 00:11:44 +03:00
Ivan
cce3ab08bb
Do not convert columns by position when pushing to materialized views (#6415)
* Do not convert columns by position
* Update 00984_materialized_view_to_columns.reference
2019-08-11 00:00:13 +03:00
alexey-milovidov
838c5e535f
Merge pull request #6433 from yandex/prevent-stack-overflow-in-parser
Fixed possible stack overflow in parser
2019-08-10 23:58:54 +03:00
Nikita Vasilev
75e381bde4 Merge remote-tracking branch 'upstream/master' into nikvas0/index_mutate 2019-08-10 23:07:50 +03:00
Alexey Milovidov
692ce0f6c5 Added two more tests 2019-08-10 21:01:35 +03:00
Alexey Milovidov
afef5c6c70 Added stack protection; added a test 2019-08-10 20:51:47 +03:00
Alexey Milovidov
c80aeb0ef1 Fixed another case; added a test 2019-08-10 20:08:14 +03:00
Alexey Milovidov
b133ea85b4 More tests 2019-08-10 19:51:09 +03:00
Alexey Milovidov
e11ba9ded9 One more test 2019-08-10 19:47:59 +03:00
Alexey Milovidov
02a6b2c1ab Added a test 2019-08-10 19:40:57 +03:00
Alexey Milovidov
0a9787c7f3 Fixed possible stack overflow in parser 2019-08-10 19:38:25 +03:00
Olga Khvostikova
dd6f48342d
Merge pull request #6428 from yandex/low-cardinality-setting-in-cast
Fix behavior low cardinality setting in creating materialized view (Fix #6293)
2019-08-10 18:26:59 +03:00
alexey-milovidov
30f8529e04
Merge pull request #6325 from kreuzerkrieg/Shadow4GCC
adding -Wshadow for GCC
2019-08-10 17:29:10 +03:00
alexey-milovidov
c8a810ef58
Merge branch 'master' into fix25 2019-08-10 01:21:54 +03:00
Alexey Milovidov
7e6b1333a1 Renamed Yandex CTO just in case 2019-08-10 00:58:17 +03:00
kreuzerkrieg
112fc71276 adding -Wshadow for GCC 2019-08-09 23:58:16 +03:00
stavrolia
626b75b6a5 Fix behavior low cardinality setting in creating materialized view 2019-08-09 22:17:19 +03:00
Alexey Milovidov
7b375032b5 Added a test 2019-08-09 20:26:25 +03:00
Alexey Milovidov
f636a4c2c1 Fixed arrayEnumerateUniqRanked function (TODO: simplify code as much as possible) 2019-08-09 20:25:19 +03:00
Nikolai Kochetov
40cc399037 Fix PushingToViewsBlockOutputStream. 2019-08-09 20:15:01 +03:00
chertus
6491de7edd forget to remove field in last patch 2019-08-09 19:17:01 +03:00
Nikolai Kochetov
ed11432f68 Added JSONEachRowWithProgressRowOutputFormat. 2019-08-09 19:10:47 +03:00
proller
9a438d9f7d Fix build without protobuf 2019-08-09 19:09:24 +03:00
Nikolai Kochetov
f4aef770ff Added JSONEachRowWithProgressRowOutputFormat. 2019-08-09 19:01:29 +03:00
Nikolai Kochetov
23e2d17d9d Added JSONEachRowWithProgressRowOutputFormat. 2019-08-09 18:58:07 +03:00
alexey-milovidov
4e98a5b177
Merge pull request #6410 from yandex/more-safe-parsing-names-types-list
Slightly more safe parsing of NamesAndTypesList
2019-08-09 18:34:29 +03:00
Nikolai Kochetov
2ae3db7920 Merged with master. 2019-08-09 18:32:44 +03:00
Alexey Milovidov
98ea652ad6 Whitespaces 2019-08-09 18:30:39 +03:00
dimarub2000
9caa69ce88 Minor fixes 2019-08-09 18:18:21 +03:00
dimarub2000
2ce2bba496 Minor fixes 2019-08-09 18:08:10 +03:00
Nikolai Kochetov
9bd949fff5 Convert streams structure to sample block in InterpreterSelectQuery. 2019-08-09 17:57:15 +03:00
chertus
e06c994b0e refactoring: move collectUsedColumns from ExpressionAnalyzer to SyntaxAnalyzer 2019-08-09 17:50:04 +03:00
Nikolai Kochetov
78516083ac Remove dry_run flag from InterpreterSelectQuery::executeImpl. 2019-08-09 16:42:58 +03:00
Nikolai Kochetov
a1023bebff Fix tests. 2019-08-09 16:37:42 +03:00
Nikita Mikhaylov
aec386f60e better comment 2019-08-09 16:15:23 +03:00
alesapin
2803fcc2ba Make atomic settings 2019-08-09 16:07:19 +03:00
dimarub2000
9d2c9c8c2a Minor style and logic fixes 2019-08-09 16:00:47 +03:00
Nikita Mikhaylov
e3579f215f comment to test 2019-08-09 15:58:46 +03:00
Nikita Mikhaylov
636793fd89 better 2019-08-09 15:56:19 +03:00
Nikita Mikhaylov
596a3fe1a8 better 2019-08-09 15:54:47 +03:00
Nikita Mikhaylov
4c85e9f481 atomic drop table 2019-08-09 14:17:33 +03:00
dimarub2000
b2cbc1a747 Fixed some const's and added --confidence option. 2019-08-09 13:46:57 +03:00
CurtizJ
ead6336d2c function topK: fix merge stage and fix memory leaks 2019-08-09 13:11:50 +03:00
Alexey Milovidov
f609e8a785 Slightly more safe parsing of NamesAndTypesList 2019-08-09 03:00:32 +03:00
Alexey Milovidov
86f321a7cd Whitespaces 2019-08-09 02:55:08 +03:00
alexey-milovidov
28e87cc430
Merge pull request #6409 from yandex/get-identifier-name-fixed-unpleasant-code
Fixed unsafe code around "getIdentifier" function.
2019-08-09 02:31:49 +03:00
Alexey Milovidov
b3ab21e7a0 Addition to prev. revision 2019-08-08 23:27:12 +03:00
Alexey Milovidov
724b4b0293 Addition to prev. revision 2019-08-08 23:26:42 +03:00
Alexey Milovidov
2ba185b4aa Addition to prev. revision 2019-08-08 23:10:58 +03:00
alexey-milovidov
62a6248ca9
Merge pull request #6406 from yandex/no_virtual_columns_in_system_columns
No virtual columns in system.columns
2019-08-08 23:04:38 +03:00
Alexey Milovidov
2248c32f9c Added a test #6401 2019-08-08 23:04:16 +03:00
Alexey Milovidov
a6e4b34ab4 Fixed unpleasant code #6401 2019-08-08 23:02:30 +03:00
Alexey Milovidov
e40854d7fb Merge branch 'master' of github.com:yandex/ClickHouse 2019-08-08 22:42:47 +03:00
Alexey Milovidov
1437065c70 Fixed tests and error messages #6351 2019-08-08 22:42:34 +03:00
alexey-milovidov
b579692fe9
Merge pull request #6378 from 4ertus2/bugs
Fix crash in median over Nullable(Decimal128)
2019-08-08 22:32:11 +03:00
alexey-milovidov
8316c83cc4
Merge pull request #6392 from yandex/fix-performance-test
Attempt to fix performance test
2019-08-08 22:31:47 +03:00
Alexander Tokmakov
ae6efb23b4 Merge branch 'master' into alter_table_drop_detached_part 2019-08-08 22:31:31 +03:00
alesapin
50cabe4ab0 Comment 2019-08-08 22:30:32 +03:00
alesapin
a03fcd9f12 Make settings values atomic to avoid race conditions 2019-08-08 22:29:56 +03:00
dimarub2000
b780072a9d raw data relative_analize 2019-08-08 21:49:29 +03:00
alexey-milovidov
35f4e7cf33
Merge pull request #6351 from 4ertus2/some
Disable ANY RIGHT and ANY FULL JOINs by default
2019-08-08 19:16:49 +03:00
alexey-milovidov
80e68a803b
Merge pull request #6374 from dimarub2000/fix_toFloat_monotonicity
toFloat() monotonicity fixed
2019-08-08 19:11:38 +03:00
Alexander Tokmakov
b5eee531a9 fix setting name 2019-08-08 19:08:43 +03:00
alexey-milovidov
0ece3708e7
Update PODArray.h 2019-08-08 19:07:58 +03:00
Alexander Tokmakov
2f36d80705 move tests with sudo to integration tests 2019-08-08 19:03:31 +03:00
Alexey Milovidov
40a3f77917 Removed duplicate include 2019-08-08 19:01:42 +03:00
Alexey Milovidov
cf0fd481d3 Added a test 2019-08-08 18:51:33 +03:00
Alexey Milovidov
e7c7694377 Removed virtual columns from system.columns for backward compatibility 2019-08-08 18:48:32 +03:00
Nikolai Kochetov
3df0d66058 Merge branch 'master' into try-to-remove-dry-run 2019-08-08 18:19:51 +03:00
Nikolai Kochetov
9ac401573f Added InterpreterSelectQuery::getSampleBlockImpl. Disable dry_run. 2019-08-08 18:18:28 +03:00
alesapin
e0d18c0fe8 Merge branch 'master' into merge_tree_settings_alter 2019-08-08 18:16:22 +03:00
Nikolai Kochetov
804a6fad8a Do not return extremes and totals for insert select. 2019-08-08 17:46:30 +03:00
chertus
391574f361 rename setting + disable ANY INNER JOIN too 2019-08-08 17:20:25 +03:00
CurtizJ
a56d897c2c better performance in topK function 2019-08-08 16:06:27 +03:00
CurtizJ
61a8abb813 add more tests for functions topK and topKWeighted 2019-08-08 15:42:48 +03:00
chertus
d67abcf691 better alignment 2019-08-08 15:11:54 +03:00
CurtizJ
3c227dce13 fix topK and topKWeighted functions 2019-08-08 14:27:15 +03:00
Ivan Lezhankin
e90bf74ce8 Merge branch 'master' into issue-5286 2019-08-08 12:57:00 +03:00
dimarub2000
90010c4040 Changed to a more suitable name 2019-08-08 11:41:38 +03:00