thevar1able/ClickHouse
1
0
Fork 0
mirror of https://github.com/ClickHouse/ClickHouse.git synced 2024-11-18 21:51:57 +00:00
Code Issues Packages Projects Releases Wiki Activity
50,383 Commits 9,131 Branches 1,778 Tags 2 GiB
3e012265d3
Commit Graph

6508 Commits

Author SHA1 Message Date
nikitamikhaylov
f33ae7f167 style 2020-10-20 16:34:57 +03:00
Nikolai Kochetov
a1d5adf8d5 Merge branch 'master' into new-block-for-functions-4 2020-10-20 16:16:08 +03:00
Nikolai Kochetov
295e612343 Fix build and tests. 2020-10-20 16:11:57 +03:00
nikitamikhaylov
4ce2670ab1 Merge branch 'master' of github.com:ClickHouse/ClickHouse into welch-t-test 2020-10-20 15:59:24 +03:00
Alexander Tokmakov
62a0ee8255 fix assertion in table function file() 2020-10-20 15:29:46 +03:00
vladimir golovchenko
a64bc6c586 Fixed IPv4CIDRToRange/IPv6CIDRToRange functions to pass Const IP address. 2020-10-20 15:06:22 +03:00
Alexander Kuzmenkov
84908df6d8 fix setting parent from HTTP traceparent 2020-10-20 14:35:13 +03:00
Nicolae Vartolomei
65013fcbd1 Explain why max_concurrent_queries_for_all_users exists 2020-10-20 12:00:04 +01:00
alexey-milovidov
b4f0e08369
Merge pull request #16158 from ClickHouse/minimal-ui 
Added minimal web UI
 2020-10-20 11:57:56 +03:00
Alexander Kuzmenkov
f3abb76e57 disable traceparent header in Arcadia 
it interferes with the test_clickhouse.TestTracing.test_tracing_via_http_proxy[traceparent] test
 2020-10-20 11:13:21 +03:00
Alexey Milovidov
448c87363c Style 2020-10-20 04:29:34 +03:00
Alexey Milovidov
94592819ad Add comment 2020-10-20 04:29:13 +03:00
alexey-milovidov
5e46e7c670
Merge pull request #15723 from Jokser/idempotent-part-move 
Possibility to move part to another disk/volume if first attempt was failed
 2020-10-20 04:26:50 +03:00
alexey-milovidov
124379cccc
Update IMergeTreeDataPart.h 2020-10-20 04:24:30 +03:00
alexey-milovidov
26517ff08d
Update IMergeTreeDataPart.h 2020-10-20 04:23:23 +03:00
alexey-milovidov
14d9586735
Update AggregateFunctionRankCorrelation.h 2020-10-20 04:18:12 +03:00
Alexey Milovidov
a79460b644 Modify comment 2020-10-20 04:03:03 +03:00
Alexey Milovidov
a091892a13 Fix Arcadia 2020-10-20 04:01:47 +03:00
Alexey Milovidov
a554ca5e62 Added /play handler; added a test 2020-10-20 03:28:33 +03:00
Alexander Kuzmenkov
41ac15a71c fix initial query id 2020-10-20 00:26:10 +03:00
Nikolai Kochetov
9fe51524cc Part 9. 2020-10-20 00:21:10 +03:00
Vitaly Baranov
235a493a25
Merge pull request #12736 from traceon/ldap-any-user-authentication 
Add LDAP user directory support for locally non-existent users
 2020-10-19 23:58:35 +03:00
Nikolai Kochetov
bc58637ec2 Fixing build. 2020-10-19 21:37:44 +03:00
Alexander Kuzmenkov
6dcfd26b29 Merge remote-tracking branch 'origin/master' into tmp 2020-10-19 21:36:30 +03:00
alexey-milovidov
be7776608d
Merge pull request #15933 from ClickHouse/fix-global-in-result 
Fix wrong result in case of GLOBAL IN and PREWHERE
 2020-10-19 21:21:57 +03:00
nikitamikhaylov
7a97329209 Merge branch 'master' of github.com:ClickHouse/ClickHouse into welch-t-test 2020-10-19 18:54:26 +03:00
Nikolai Kochetov
384718e6c3 Part 8. 2020-10-19 18:27:41 +03:00
Nicolae Vartolomei
5a665d1d42 Add max_concurrent_queries_for_all_users setting 
Closes #6636.
 2020-10-19 15:51:28 +01:00
alesapin
e853af9b4f
Merge pull request #15823 from kitaisreal/parser-allow-specify-primary-key-in-column-list 
Parser allow specify primary key in column list
 2020-10-19 17:09:12 +03:00
Nikolai Kochetov
df1af1bd94 Part 7. 2020-10-19 16:42:14 +03:00
Alexander Kuzmenkov
defcd29b31
Merge pull request #16036 from ClickHouse/stress_test_improvemets 
Minor improvements of stress test
 2020-10-19 16:12:30 +03:00
Nicolae Vartolomei
af76ff1dbf RFC: Add metadata section to MergeTreeWriteAheadLog 
Current WAL format doesn't seem to be extendable without breaking
reverse compatibility.

This PR proposes to introduces a metadata section
for each action in the WAL to which optional fields can be added.

Adding new fields is trivial and doesn't have to break backwards
compatibility if these are not critical for correctness.

Metadata contains the minimum version of the reader allowed
to interpret it.

Removing fields is not supported.
 2020-10-19 12:16:31 +01:00
alesapin
76a501d7c5 Merge branch 'master' into simplify-init-script 2020-10-19 10:56:40 +03:00
alesapin
963bc57835
Merge pull request #16011 from ClickHouse/fix_alter_add_and_modify_order_by 
Fix alter sorting key for ReplicatedVersionedCollapsingMergeTree
 2020-10-19 10:31:13 +03:00
hexiaoting
6ed6f4f7a2 Fix inconsistent behaviour of rankCorr function 2020-10-19 15:17:33 +08:00
Azat Khuzhin
6200783629 database_atomic_wait_for_drop_and_detach_synchronously/NO DELAY/SYNC for DROP DATABASE 2020-10-19 00:21:39 +03:00
Azat Khuzhin
32c449c34f Add IDatabaseTablesIterator::reset() interface 2020-10-19 00:16:10 +03:00
Nikolai Kochetov
740fad66f3 Part 6. 2020-10-18 22:00:13 +03:00
Nikolai Kochetov
50dcba6df4 Part 5. 2020-10-18 17:49:19 +03:00
alexey-milovidov
6dc5cb166f
Merge pull request #16082 from CurtizJ/fix-bad-aggregation 
Fix segfault with wrong aggregation in lambdas
 2020-10-18 04:36:29 +03:00
Nikolai Kochetov
ce2f6a0560 Part 4. 2020-10-18 00:41:50 +03:00
Vasily Nemkov
4124538b56 Merge remote-tracking branch 'upstream/master' into AES_encrypt_decrypt 2020-10-18 00:00:13 +03:00
Vasily Nemkov
f0d5ade1c1 Fixed argument checks and updated tests accordingly 2020-10-17 19:50:58 +03:00
Nikolai Kochetov
142ce5ece0 Part 3. 2020-10-17 19:48:53 +03:00
Nikolai Kochetov
21c1a2e44d Part 2. 2020-10-17 18:22:42 +03:00
Nikolai Kochetov
139487a1a0 Part 1. 2020-10-17 17:23:37 +03:00
Azat Khuzhin
082f30a3a1 Introduce ThreadStatus::applyQuerySettings() to reduce copy-paste 2020-10-17 15:01:53 +03:00
Azat Khuzhin
c694bbe822 Read memory/thread related settings in ThreadStatus::attachQueryContext() 
Previous it was read only ThreadStatus::initializeQuery() but there is
no context there yet.
Plus executeQueryImpl() calls only attachQueryContext() and nothing
more.

This is an issue only for queries via HTTP, since via TCP there is
PullingAsyncPipelineExecutor which calls attachTo() by itself.
 2020-10-17 15:01:53 +03:00
Azat Khuzhin
fea788480f Fix QueryScope initialization for HTTPHandler 
This will fix incorrect query_id for the per-thread memory tracker (but
later there will be child tracker, so it is not a big deal).
 2020-10-17 08:55:02 +03:00
zhang2014
d084e05aba ISSUES-15883 support zero length argument with string type 2020-10-17 13:15:00 +08:00
zhang2014
5207be9b32 ISSUES-15883 try fix test failure 2020-10-17 12:36:08 +08:00
Azat Khuzhin
9b8abd44ab Add allow_nondeterministic_optimize_skip_unused_shards 2020-10-17 01:07:02 +03:00
Alexander Tokmakov
c19d2efd88 add more holders 2020-10-16 20:16:58 +03:00
Anton Popov
0de364ec94 fix segfault with wrong aggregation in lambdas 2020-10-16 16:12:30 +03:00
Alexander Tokmakov
026896835c fixes 2020-10-16 15:20:30 +03:00
alesapin
dc1a5abea9 Remove cluster type check during alter 2020-10-16 14:59:58 +03:00
Pavel Kovalenko
a474bdcabf Merge remote-tracking branch 'origin/master' into idempotent-part-move 2020-10-16 13:02:40 +03:00
hcz
d95229317d
Change error message in function if & ifNull 2020-10-16 17:50:47 +08:00
Mike
e89a3b5d09
Fixing arrayIndex functions when right operand is LC but left is not (#16038) 2020-10-16 12:08:44 +03:00
vivarum
1d9df13b47
Merge branch 'master' into enable-parsing-of-input-enum-values-by-id-10682 2020-10-16 11:07:01 +03:00
Vasily Kozhukhovskiy
bffa1ed28c small refactoring of parsing enum values by numeric enum ids 
(for CSV, TSV, JSON formats)
 2020-10-16 10:50:20 +03:00
alesapin
0bb4480fee
Merge pull request #16031 from ClickHouse/database_atomic_patch 
Minor fix for DatabaseAtomic
 2020-10-16 10:08:04 +03:00
alesapin
07c12116e2
Merge pull request #16007 from CurtizJ/fix-complex-key-direct 
Allow to use direct layout for dictionaries with complex keys
 2020-10-16 10:03:10 +03:00
zhang2014
4e285168df ISSUES-15883 try fix test failure 2020-10-16 09:11:05 +08:00
Maksim Kita
9bd30b041a Parser allow specify primary key in column list 2020-10-15 23:33:00 +03:00
Nikita Mikhaylov
6512d84b31
Merge pull request #15985 from CurtizJ/redis-cached-dict 
Add support of cache layout for Redis dictionaries with complex key
 2020-10-15 22:35:36 +03:00
Kruglov Pavel
5aba639430 Update test 2020-10-15 22:01:18 +03:00
sundy-li
153be93544 sub ReadonlyReplica when detach readonly tables 2020-10-15 22:01:18 +03:00
Alexander Tokmakov
95ad45a3b0 minor improvements of stress test 2020-10-15 21:14:04 +03:00
Alexander Kuzmenkov
41f1fd8fa0
Merge pull request #15822 from abyss7/fix-build 
Fix build without libraries
 2020-10-15 20:48:53 +03:00
Nikolai Kochetov
571a5fbff3 Update functions interface. 2020-10-15 19:52:25 +03:00
Alexander Tokmakov
2f9611f1ae fix logical error with explicit UUIDs 2020-10-15 19:01:23 +03:00
Pavel Kruglov
ee8a9d2cf1 Don't touch MySQL database if it's unnecessary 2020-10-15 18:57:17 +03:00
Anton Popov
9c9ad2cc85
Merge branch 'master' into fix-complex-key-direct 2020-10-15 18:53:59 +03:00
Nikolai Kochetov
939d8edf33
Merge pull request #15999 from ClickHouse/fix-after-15437 
Continuation of 15437
 2020-10-15 18:20:48 +03:00
Alexander Kuzmenkov
bc7b5f6bb4 Merge remote-tracking branch 'origin/master' into tmp 2020-10-15 17:15:05 +03:00
Vitaly Baranov
5f261cec3c
Merge pull request #15199 from filimonov/non_delimited_protobuf 
ProtobufSingle format
 2020-10-15 16:58:39 +03:00
Nikolai Kochetov
388f69b109
Merge pull request #15976 from ClickHouse/new-block-for-functions-3 
Use `ColumnsWithTypeAndName` instead of `Block` for function calls [part 3]
 2020-10-15 16:56:09 +03:00
Pavel Kovalenko
ed61c5681b Use 'moving' directory instead of 'detached' when move part to another disk/volume. 2020-10-15 16:55:13 +03:00
Alexander Kuzmenkov
f7f59ca23f
Merge pull request #15982 from vitlibar/fix-ambiguity-in-parsing-of-settings-profiles 
Fix ambiguity in parsing of settings profiles.
 2020-10-15 16:23:32 +03:00
Alexander Kuzmenkov
f366b366ae
Merge pull request #15987 from filimonov/background-pool-count_no_work_done-bug 
Fix the bug when NOTHING_TO_DO events wrongly increment count_no_work_done
 2020-10-15 16:11:57 +03:00
alesapin
2002289003 Fix bug in alter primary key for replicated versioned collapsing merge tree 2020-10-15 16:02:39 +03:00
Alexander Kuzmenkov
b4378b004f Merge remote-tracking branch 'origin/master' into tmp 2020-10-15 16:01:41 +03:00
zhang2014
c8aa007a45 ISSUES-15883 modify comment 2020-10-15 20:42:10 +08:00
zhang2014
80f3de1359 ISSUES-15883 try fix collate name 2020-10-15 20:39:04 +08:00
Pavel Kruglov
f5fac575f4 don't postprocess single parts 2020-10-15 15:22:41 +03:00
feng lv
fabe86c6d3 fix 
fix
 2020-10-15 20:16:36 +08:00
tavplubix
1003de75ed
Update StorageMaterializedView.cpp 2020-10-15 15:06:44 +03:00
Nikolai Kochetov
963ce315b2
Merge pull request #15454 from azat/dict-prealloc 
Speedup hashed/sparse_hashed dictionary loading by preallocating the hash table
 2020-10-15 15:03:53 +03:00
Anton Popov
424dd3147c allow to use direct layout for dictionaries with complex keys 2020-10-15 14:59:41 +03:00
Nikolai Kochetov
ee7b32c283 Fix tests and build. 2020-10-15 14:52:25 +03:00
tavplubix
6dc2f00347
Update StorageMaterializedView.cpp 2020-10-15 13:57:47 +03:00
alexey-milovidov
af7d70c9bb
Merge pull request #15646 from excitoon-favorites/betters3storageinitialization 
Better initialization of S3 storage
 2020-10-15 13:31:43 +03:00
Nikolai Kochetov
40f62719ff Move event to stack. 2020-10-15 13:24:18 +03:00
feng lv
b931a3c9da fix 
update test

fix
 2020-10-15 16:14:28 +08:00
Nikolai Kochetov
e8038ae84f
Merge pull request #15857 from amosbird/e2 
Refactor processors.
 2020-10-15 10:45:00 +03:00
Mikhail Filimonov
ace2e99cb3
Fix the bug when NOTHING_TO_DO events wrongly increment count_no_work_done 2020-10-14 23:08:47 +02:00
tavplubix
04206db7da
Merge pull request #15974 from ClickHouse/merging_14295 
Merging #14295
 2020-10-14 23:51:42 +03:00
Nikolai Kochetov
d0112c5dc4 Merge branch 'master' into new-block-for-functions-3 2020-10-14 23:37:10 +03:00
Nikolai Kochetov
04476c533e Fix ya.make 2020-10-14 23:33:25 +03:00
Anton Popov
3050b2e67b add support of cache layout for redis dictionaries with complex key 2020-10-14 22:57:07 +03:00
nikitamikhaylov
b1e1553061 style + docker + tests 2020-10-14 22:43:08 +03:00
Alexander Kuzmenkov
1cbb26e6e4 Merge remote-tracking branch 'origin/master' into HEAD 2020-10-14 22:41:25 +03:00
Nikolai Kochetov
26158ebc94 Fix tests 2020-10-14 22:25:36 +03:00
Alexander Tokmakov
de06a79738 fix possibly dangling reference when inserting into mv 2020-10-14 22:25:31 +03:00
nikitamikhaylov
ff7601a52c add python test and fix build 2020-10-14 21:41:35 +03:00
Vitaly Baranov
2f13fcb4b7 Fix ambiguity in parsing of settings profiles. 2020-10-14 20:30:24 +03:00
Denis Glazachev
bf14cb58e2 Use count() 2020-10-14 20:54:09 +04:00
feng lv
7b69592e49 add test 
fix

fix
 2020-10-14 23:15:46 +08:00
feng lv
eb8d8f6ba4 interval op support string literal 2020-10-14 23:02:51 +08:00
Nikolai Kochetov
e2f826c22d Rename block to columns. 2020-10-14 17:44:22 +03:00
Nikolai Kochetov
1f49d83622 Rename block to columns. 2020-10-14 17:32:43 +03:00
Nikolai Kochetov
e64eba88da Rename block to columns. 2020-10-14 17:19:39 +03:00
Nikolai Kochetov
7108a0423f Rename block to columns. 2020-10-14 17:15:57 +03:00
Nikolai Kochetov
31898fc5ce Rename block to columns. 2020-10-14 17:14:13 +03:00
Nikolai Kochetov
77323962ec Rename block to columns. 2020-10-14 17:07:54 +03:00
Nikolai Kochetov
959424f28a Rename block to columns. 2020-10-14 17:04:50 +03:00
Alexey Milovidov
ac670d6868 Merge with master 2020-10-14 16:52:59 +03:00
Nikolai Kochetov
f81af6c958 Rename Block to ColumnsWithTypeAndName. 2020-10-14 16:50:18 +03:00
Vasily Nemkov
8984f4b8c2 Empty string optimization for encryption 2020-10-14 16:33:07 +03:00
Alexey Milovidov
5e502c52b3 Merge branch 'master' into AES_encrypt_decrypt 2020-10-14 16:30:23 +03:00
Vitaly Baranov
997570780d
Merge branch 'master' into non_delimited_protobuf 2020-10-14 16:26:57 +03:00
Alexander Tokmakov
7d58992ea8 fix select count() 2020-10-14 16:15:15 +03:00
Nikolai Kochetov
966b1d6cf5 Rename Block to ColumnsWithTypeAndName. 2020-10-14 16:09:11 +03:00
Amos Bird
1bcacde8d5
Eagerly move data out of sink 2020-10-14 21:05:20 +08:00
Denis Glazachev
f26b7573a2 Fix pre-C++20 compiler builds 2020-10-14 16:58:54 +04:00
Alexey Milovidov
298b321f4a Merge with master 2020-10-14 15:51:53 +03:00
Denis Glazachev
6eec447a64 Merge branch 'master' into ldap-any-user-authentication 
* master: (189 commits)
  Fix ugly links in docs
  Update Internals.cpp
  Whitespace
  Fix ugliness in docs
  better
  better backticks
  Try fix tests.
  Fetch helper image before run
  Fetch helper image before run
  Fetch helper image before run
  Update version_date.tsv after release 20.7.4.11
  Update version_date.tsv after release 20.8.4.11
  Update 01515_with_global_and_with_propagation.sql
  fix compilation error
  Supress pvs
  Update version_date.tsv after release 20.9.3.45
  Add missed file
  fix thread restart for parallel quorum inserts
  Update openssl
  Fix race in openssl
  ...
 2020-10-14 16:46:37 +04:00
Alexey Milovidov
87fe8f2a00 Merge branch 'master' into filipecaixeta-master 2020-10-14 15:27:58 +03:00
Anton Popov
7470ac98bb
Merge pull request #15855 from hexiaoting/dev_fetch 
Add Support for OFFSET_FETCH_CLAUSE
 2020-10-14 15:21:28 +03:00
Alexander Tokmakov
72b1339656 Revert "Revert "Write structure of table functions to metadata"" 
This reverts commit c65d1e5c70.
 2020-10-14 15:19:29 +03:00
tavplubix
c65d1e5c70
Revert "Write structure of table functions to metadata" 2020-10-14 13:59:29 +03:00
hexiaoting
2c72cdef44 Fix error for offset_fetch without only/with ties 2020-10-14 15:05:02 +08:00
zhang2014
a00bcbb8ba ISSUES-15265 try fix crash when create failure 2020-10-14 13:26:28 +08:00
Denis Glazachev
e3ef8bbc48 GCC 9/10 compilation fix 2020-10-14 05:29:25 +04:00
alexey-milovidov
56e7e6ed62
Merge pull request #15886 from zhang2014/fix/ISSUES-12513 
ISSUES-12513 fix difference expressions with same alias when analyze queries again
 2020-10-14 00:55:11 +03:00
alexey-milovidov
f60ccb4edf
Merge pull request #14295 from ClickHouse/write_structure_of_table_functions 
Write structure of table functions to metadata
 2020-10-13 23:56:09 +03:00
alexey-milovidov
fc83bd1088
Merge branch 'master' into setting-date-time-output-format 2020-10-13 23:48:27 +03:00
alexey-milovidov
173ee78122
Merge pull request #15876 from azat/connections_with_failover_max_tries-endless-loop 
Fix query hang with connections_with_failover_max_tries = 0 (endless loop)
 2020-10-13 23:47:34 +03:00
Alexey Milovidov
dbd4366aa4 Merge branch 'master' of github.com:filipecaixeta/ClickHouse into filipecaixeta-master 2020-10-13 23:45:43 +03:00
Alexey Milovidov
da4e4c5cdb Merge branch 'master' into filipecaixeta-master 2020-10-13 23:44:48 +03:00
Pavel Kruglov
44c2b138f3 Fix style 2020-10-13 22:53:36 +03:00
Pavel Kruglov
be0cb31d21 Add tests and comments 2020-10-13 21:55:03 +03:00
nikitamikhaylov
744013d4b8 test in comparison with scipy 2020-10-13 21:46:15 +03:00
Alexander Tokmakov
8a64b65e51 fix 2020-10-13 20:45:59 +03:00
Alexander Tokmakov
0ca51ed266 Merge branch 'master' into ddl_queries_fixes 2020-10-13 19:52:56 +03:00
Nikolai Kochetov
534b60e242 Fix build. 2020-10-13 18:10:30 +03:00
Alexander Tokmakov
cb8d132cca fix deadlock with DDLGuard 2020-10-13 18:00:36 +03:00
Nikolai Kochetov
23afd74e1c Update InterpreterSelectQuery. 2020-10-13 17:55:22 +03:00
Pavel Kruglov
8200bab859 Add setting do_not_merge_across_partitions 2020-10-13 17:54:52 +03:00
Nikolai Kochetov
1af0792f67 Update InterpreterSelectQuery. 2020-10-13 17:33:34 +03:00
Nikolai Kochetov
2bbdfc77ea Update creating sets. 2020-10-13 16:48:00 +03:00
Alexander Tokmakov
b3fc6d9b33 fix IF [NOT] EXISTS failure 2020-10-13 16:31:02 +03:00
alexey-milovidov
37c2a57202
Update WriteHelpers.h 2020-10-13 15:23:50 +03:00
alexey-milovidov
3e001e7ef1
Update Settings.h 2020-10-13 15:19:38 +03:00
Maksim Kita
adaae8a12c Added OutputFormat setting date_time_output_format 2020-10-13 13:59:43 +03:00
Vitaly Baranov
13896cf4c9
Merge pull request #15875 from vitlibar/rbac-fix-deadlock 
Fix possible deadlocks in RBAC
 2020-10-13 12:58:57 +03:00
Nikita Mikhaylov
835c480056
Merge pull request #15858 from ClickHouse/fix_alter_default_validation 
Fix alter default validation
 2020-10-13 12:47:18 +03:00
tavplubix
6c1d59cd49
Merge pull request #15743 from azat/Atomic-DROP-TABLE-hang-fix 
Fix DROP TABLE hangs with Atomic engine
 2020-10-13 12:40:36 +03:00
Nikolai Kochetov
07c2730169 Refactor ExpressionActions. 2020-10-13 11:16:47 +03:00
alesapin
321a7ae6bf
Merge pull request #15852 from ClickHouse/fix_reverse_processor 
Fix block structure mismatch after ALTER
 2020-10-13 09:49:26 +03:00
zhang2014
72f8153f01 ISSUES-12513 add stateless test 2020-10-13 13:48:16 +08:00
zhang2014
d79d0127ad ISSUES-12513 try fix difference expressions with same alias 2020-10-13 13:30:56 +08:00
hexiaoting
dea965832a Fix error for previous offset test 2020-10-13 11:32:43 +08:00
Amos Bird
1c3fe943e0
Fix DelayedSource 2020-10-13 10:18:30 +08:00
Amos Bird
ca7a5ccd0d
More resize 2020-10-13 09:56:35 +08:00
Vitaly Baranov
eddd26cf3a Fix deadlock in InterpreterGrantQuery. 2020-10-13 01:03:47 +03:00
Azat Khuzhin
2947eff878 Fix query hang with connections_with_failover_max_tries = 0 (endless loop) 2020-10-12 22:07:26 +03:00
Azat Khuzhin
bba44d0f0e Add IF EXISTS for removing inner table of the materialized view 
Instead of playing with has_inner_table flag, which looks a bit icky.
 2020-10-12 21:46:07 +03:00
Azat Khuzhin
d16adddb41 Fix drop of materialized view with inner table in Atomic database 
Materialized view drop the inner table (if any) drop the drop() method,
and this will lead to essure recursive drop() from the drop worker
thread, which will hang:

    3  std::__1::condition_variable::wait<> ()
    4  DB::DatabaseCatalog::waitTableFinallyDropped (this=0x7ffff7831500, uuid=...) at ../src/Interpreters/DatabaseCatalog.cpp:828
    5  DB::InterpreterDropQuery::executeToTable (this=this@entry=0x7fff16ff88a0, table_id_=..., query=...) at ../src/Interpreters/InterpreterDropQuery.cpp:135
    6  DB::InterpreterDropQuery::execute (this=this@entry=0x7fff16ff88a0) at ../contrib/libcxx/include/string:1474
    7  DB::executeDropQuery (kind=kind@entry=DB::ASTDropQuery::Drop, global_context=..., target_table_id=...) at ../src/Storages/StorageMaterializedView.cpp:156
    8  DB::StorageMaterializedView::drop (this=0x7ffefc348f40) at ../src/Storages/StorageMaterializedView.cpp:169
    9  DB::DatabaseCatalog::dropTableFinally (this=this@entry=0x7ffff7831500, table=...) at ../src/Interpreters/DatabaseCatalog.cpp:775
    10 DB::DatabaseCatalog::dropTableDataTask (this=0x7ffff7831500) at ../src/Interpreters/DatabaseCatalog.cpp:745

Fix this by dropping the inner table just before scheduling job the the
drop worker thread.
 2020-10-12 21:46:07 +03:00
Vitaly Baranov
b8019f2bc7 Fix deadlocks in RoleCache. 2020-10-12 21:40:05 +03:00
Alexander Kuzmenkov
6200433e12 Merge origin/master into tmp (using imerge) 2020-10-12 21:15:31 +03:00
nikitamikhaylov
e65a2a1cbd add student t test 2020-10-12 21:10:01 +03:00
nikitamikhaylov
20ebd4fd5b better 2020-10-12 19:37:04 +03:00
Nikita Mikhaylov
ad42e610cb
Merge branch 'master' into welch 2020-10-12 16:23:09 +03:00
Mikhail Filimonov
87a8ba63f7
Few more CR fixes 2020-10-12 15:05:40 +02:00
tavplubix
748b75ab1b
Merge pull request #15767 from ClickHouse/fix_materialize_mysql_count_v2 
Try fix select count() for MaterializeMySQL (another way)
 2020-10-12 14:41:38 +03:00
Nikolai Kochetov
fa8ed65c4d Merge branch 'master' into actions-dag 2020-10-12 14:18:25 +03:00
Nikolai Kochetov
2a62a91af4
Merge pull request #15662 from ClickHouse/fix-15529 
Fix read from Buffer table with empty nested table with different types.
 2020-10-12 14:12:11 +03:00
alesapin
6732e5c217 Fix alter default validation 2020-10-12 14:02:35 +03:00
Amos Bird
47fcd8bffb
Fix some problems introduced by refactoring. 2020-10-12 17:58:09 +08:00
Amos Bird
d2dcfc3f0d
Refactor processors. 2020-10-12 17:30:05 +08:00
hexiaoting
39367be57a Add Support for OFFSET_FETCH_CLAUSE 2020-10-12 16:46:49 +08:00
alesapin
5b5dd4fb28 Fix order by desc after alter 2020-10-12 11:28:47 +03:00
Mikhail Filimonov
7fb329713a
Avoid shadowing class member, set first_row flag after write 2020-10-12 07:52:38 +02:00
Mikhail Filimonov
f6b00f2cb6
After CR fixes 2020-10-12 07:52:09 +02:00
Mikhail Filimonov
c37a456c49
Refactoring WriteCallback->RowOutputFormatParams 2020-10-12 07:52:06 +02:00
Mikhail Filimonov
e17d4e1eeb
Tests and some docs 2020-10-12 07:51:46 +02:00
Mikhail Filimonov
6df42c580b
ProtobufSingle output format 2020-10-12 07:51:45 +02:00
Mikhail Filimonov
b602d18dd8
ProtobufSingle input format 
Allows to read Single protobuf message at once (w/o length-delemeters).
 2020-10-12 07:51:36 +02:00
Nikolai Kochetov
190fd88af9
Merge pull request #15785 from amosbird/e1 
Code refactor.
 2020-10-12 00:36:36 +03:00
Nikolai Kochetov
9b42bfdc36
Merge pull request #15817 from ClickHouse/new-block-for-functions-2 
Use `ColumnsWithTypeAndName` instead of `Block` for function calls [part 2]
 2020-10-12 00:32:58 +03:00
Nikolai Kochetov
23aec1f954 Fix build. 2020-10-11 22:44:20 +03:00
alexey-milovidov
760e2ca29c
Update formatReadableTimeDelta.cpp 2020-10-11 22:43:04 +03:00
Nikolai Kochetov
3a17c2a7ac Rename FunctionArguments to ColumnsWithTypeAndName 2020-10-11 22:20:20 +03:00
Nikolai Kochetov
0df08dcb36 Rename columns() to size(). 2020-10-11 21:11:39 +03:00
Alexey Milovidov
c8ae1d097a Add comments 2020-10-11 18:24:20 +03:00
Alexey Milovidov
8a252ebef8 Merge remote-tracking branch 'origin/master' into filipecaixeta-master 2020-10-11 17:29:50 +03:00
alexey-milovidov
a8708338f2
Merge pull request #15809 from amosbird/c1 
add print_query_id support for native client
 2020-10-11 13:29:35 +03:00
alexey-milovidov
10e9d14466
Merge pull request #15818 from ClickHouse/style-pragma-once 
Check for #pragma once in headers
 2020-10-11 13:14:09 +03:00
alexey-milovidov
e16c1c781e
Merge pull request #15816 from ClickHouse/change-level-of-some-log-messages 
Change level of some log messages
 2020-10-11 13:13:13 +03:00
Amos Bird
ff665c362f
Add print query id support to client 2020-10-11 10:09:08 +08:00
alexey-milovidov
39e58128cd
Merge pull request #15812 from ClickHouse/bigint-hash 
Minor changes in BigInt hash
 2020-10-11 01:11:30 +03:00
alexey-milovidov
1187903b44
Merge pull request #15813 from ClickHouse/remove-useless-metrics 
Remove useless metrics to avoid confusion
 2020-10-11 01:11:17 +03:00
alexey-milovidov
717c48cbf3
Merge pull request #15814 from ClickHouse/cleanups 
Cleanups
 2020-10-11 01:11:03 +03:00
Alexey Milovidov
452a1b5218 Simplifications 2020-10-11 01:03:03 +03:00
Ivan Lezhankin
7ea393ada8 Fix build without libraries 2020-10-10 23:41:27 +03:00
Alexey Milovidov
7541be86cd Fix "Arcadia" 2020-10-10 23:26:36 +03:00
Nikolai Kochetov
3f446b9713 Fix build. 2020-10-10 22:19:46 +03:00
Nikolai Kochetov
780bd424ad Fix build. 2020-10-10 22:11:39 +03:00
Nikolai Kochetov
3099d44a96 Merge branch 'master' into new-block-for-functions-2 2020-10-10 22:09:50 +03:00
Nikolai Kochetov
6d8dc1f8ed Fix style. 2020-10-10 21:44:51 +03:00
Alexey Milovidov
269b6383f5 Check for #pragma once in headers 2020-10-10 21:37:02 +03:00
Nikolai Kochetov
d28325a353 Replace getByPosition to [] 2020-10-10 21:24:57 +03:00
Alexey Milovidov
f42b471de8 Moved functions to separate files; remove copy-paste 2020-10-10 21:23:54 +03:00
Alexey Milovidov
9ca9855f96 Merge branch 'master' into filipecaixeta-master 2020-10-10 20:52:34 +03:00
Alexey Milovidov
7502fad77c Change level of some log messages 2020-10-10 20:47:34 +03:00
alexey-milovidov
1f6c2c8efc
Merge pull request #15803 from ucasFL/tid-function 
Add `tid` and `logTrace` function
 2020-10-10 19:37:04 +03:00
Alexey Milovidov
5b482f4191 Cleanups 2020-10-10 19:31:10 +03:00
Alexey Milovidov
06fcf437fe Addition to prev. revision 2020-10-10 19:02:13 +03:00
Alexey Milovidov
09a31e01e4 Addition to prev. revision 2020-10-10 18:55:42 +03:00
Alexey Milovidov
9f15daf45c Remove useless metrics to avoid confusion 2020-10-10 18:52:44 +03:00
Alexey Milovidov
a2ef0f6cba Minor changes in BigInt hash 2020-10-10 18:46:41 +03:00
robot-clickhouse
554fa482e6 Auto version update to [20.11.1.1] [54442] 2020-10-10 18:39:58 +03:00
Amos Bird
8e0862a0c3
BlockIO can be empty. 2020-10-10 23:25:50 +08:00
feng lv
9438f2f4d2 fix 
fix

fix
 2020-10-10 19:21:11 +08:00
Alexey Milovidov
4f2d4988c6 Fix build on Mac OS 2020-10-10 13:51:57 +03:00
Amos Bird
dbc14655fc
Code refactoring. 2020-10-10 18:22:33 +08:00
Alexey Milovidov
2c71327ff5 Fix build on Mac OS 2020-10-10 11:02:02 +03:00
alexey-milovidov
59cfb87a96
Merge pull request #15799 from ClickHouse/fix-links-in-docs 
Fix ugliness in docs
 2020-10-10 10:48:11 +03:00
Nikolai Kochetov
76a04fb4b4
Merge pull request #15762 from ClickHouse/new-block-for-functions 
Use `ColumnsWithTypeAndName` instead of `Block` for function calls
 2020-10-10 08:50:38 +03:00
feng lv
45925f60c7 fix 2020-10-10 11:20:45 +08:00
feng lv
d39868b853 fix 2020-10-10 10:56:21 +08:00
feng lv
ec87254abe add test 2020-10-10 10:48:15 +08:00
Nikita Mikhaylov
6ac5431804
Merge pull request #15783 from nikitamikhaylov/copier-backquotes 
Merging  #14939
 2020-10-10 02:32:27 +03:00
alexey-milovidov
9d02347e2e
Update FunctionsFormatting.h 2020-10-09 22:55:02 +03:00
alexey-milovidov
0fd007ad9e
Merge pull request #15601 from alexelex/alexelex-master 
Improvement of Quorum Inserts in ClickHouse
 2020-10-09 22:43:53 +03:00
Alexey Milovidov
bd805300bb Whitespace 2020-10-09 22:33:23 +03:00
Azat Khuzhin
064f901ea8 Add ability to preallocate hashtables for hashed/sparsehashed dictionaries 
preallocation can be used only when we know number of rows, and for this
we need:
- source clickhouse
- no filtering (i.e. lack of <where>), since filtering can filter
  too much rows and eventually it may allocate memory that will
  never be used.

For sparse_hash the difference is quite significant, preallocated
sparse_hash hashtable allocates ~33% faster (7.5 seconds vs 5 seconds
for insert, and the difference is more significant for higher number of
elements):

    $ ninja bench-sparse_hash-run
    [1/1] cd /src/ch/hashtable-bench/.cmake && ...ch/hashtable-bench/.cmake/bench-sparse_hash
    sparse_hash/insert: 7.574 <!--
    sparse_hash/find  : 2.14426
    sparse_hash/maxrss: 174MiB
    sparse_hash/time:   9710.51 msec (user+sys)

    $ time ninja bench-sparse_hash-preallocate-run
    [1/1] cd /src/ch/hashtable-bench/.cmake && ...-bench/.cmake/bench-sparse_hash-preallocate
    sparse_hash/insert: 5.0522 <!--
    sparse_hash/find  : 2.14024
    sparse_hash/maxrss: 174MiB
    sparse_hash/time:   7192.06 msec (user+sys)

P.S. the difference for sparse_hashed dictionary with 4e9 elements
(uint64, uint16) is ~18% (4975.905 vs 4103.569 sec)

v2: do not reallocate the dictionary from the progress callback
    Since this will access hashtable in parallel.
v3: drop PREALLOCATE() and do this only for source=clickhouse and empty
    <where>
 2020-10-09 22:28:14 +03:00
Nikolai Kochetov
ef3640c3f7
Merge pull request #15451 from amosbird/scopewith 
Global WITH and WITH propagation.
 2020-10-09 22:16:45 +03:00
Azat Khuzhin
f4f79aa84a Add HashTable::reserve() (for preallocated hashed/sparse_hashed dictionaries) 2020-10-09 21:53:57 +03:00
filipe
09b5e1dbc3 fix FunctionsFormatting error for ARM 2020-10-09 13:46:59 -03:00
Nikolai Kochetov
3898a8ac5f Try fix tests. 2020-10-09 19:05:11 +03:00
feng lv
8a1a41f77b add tid function 2020-10-09 23:49:14 +08:00
alesapin
35165c8ea4
Merge pull request #15756 from CurtizJ/fix-prewhere-with-virtuals 
Fix prewhere with virtual columns
 2020-10-09 18:07:41 +03:00
nikitamikhaylov
88a5302759 Merge branch 'master' of github.com:ClickHouse/ClickHouse into copier-backquotes 2020-10-09 16:26:31 +03:00
Alexandra Latysheva
f6f33168aa fix compilation error 2020-10-09 12:11:21 +00:00
Nikolai Kochetov
9328cea4f1 Supress pvs 2020-10-09 14:35:58 +03:00
Alexandra Latysheva
0594a77b57 fix thread restart for parallel quorum inserts 2020-10-09 11:20:20 +00:00
Nikolai Kochetov
a7fb2e38a5 Use ColumnWithTypeAndName as function argument instead of Block. 2020-10-09 10:41:28 +03:00
filipe
3861a03927 fix pvs check 2020-10-08 20:14:54 -03:00
Denis Glazachev
e348ec17b2 Refactor role handling 2020-10-09 00:57:23 +04:00
Alexander Tokmakov
a6178cc876 try fix select count() for MaterializeMySQL 2020-10-08 23:39:24 +03:00
tavplubix
7b5f2b2bb0
Merge pull request #15701 from ClickHouse/better_clone_replica 
Improvements in lost replica recovery
 2020-10-08 23:19:23 +03:00
alexey-milovidov
c693c653a5
Merge pull request #15639 from GrigoryPervakov/tmp-s3-merge 
Use tmp disk for vertical merge files
 2020-10-08 20:58:07 +03:00
Alexandra Latysheva
6877f4aa9c for parallel and non-parallel quorum insertion at the same time 2020-10-08 15:35:41 +00:00
tavplubix
6065a5b65c
Update StorageReplicatedMergeTree.cpp 2020-10-08 16:37:32 +03:00
alexey-milovidov
8ae2bc06a1
Merge pull request #15378 from amosbird/realfix 
Fix multiple column transformers.
 2020-10-08 16:26:48 +03:00
Anton Popov
4bc40421e2
Merge pull request #15731 from CurtizJ/fix-tranform-null-in 
Fix assertion with setting transform_null_in
 2020-10-08 16:12:56 +03:00
Anton Popov
1a6d2bc538 fix prewhere with virtuals columns 2020-10-08 15:59:47 +03:00
Pervakov Grigorii
3a2068f19d Use tmp disk for vertical merge files 2020-10-08 13:49:41 +03:00
alexey-milovidov
9b9a5d9dc8
Merge pull request #15643 from azat/remove-obsolete-settings 
Remove obsolete settings
 2020-10-08 13:30:36 +03:00
alexey-milovidov
342f3b07dc
Merge pull request #15737 from azat/profile-events-fixes 
Fix RealTimeMicroseconds ProfileEvents
 2020-10-08 13:14:15 +03:00
alexey-milovidov
c0cb18b445
Merge pull request #15740 from azat/kafka-memory-accounting 
Take memory allocations from librdkafka threads into account
 2020-10-08 13:12:54 +03:00
Amos Bird
867216103f
Extend trivial count optimization. 2020-10-08 18:08:17 +08:00
Amos Bird
c9ab87ed17
Fix explain syntax 2020-10-08 17:06:04 +08:00
Amos Bird
ac102540d0
Global WITH and WITH propagation. 2020-10-08 15:03:34 +08:00
Azat Khuzhin
1f51de362f Take memory allocations from librdkafka threads into account 2020-10-07 23:18:20 +03:00
alexey-milovidov
e465ce3d49
Merge pull request #15642 from azat/force_data_skipping_indices 
Implement force_data_skipping_indices setting
 2020-10-07 23:14:51 +03:00
Alexander Tokmakov
ffb19fa4bc fix 2020-10-07 22:47:31 +03:00
Azat Khuzhin
3cd71f3357 Cleanup interceptors for librdkafka in StorageKafka 
Wrap them into StorageKafkaInterceptors to allow access to private
fields and add logging inside interceptors if something fails.

This is also preparation for ThreadStatus interceptor.
 2020-10-07 21:42:13 +03:00
Nikolai Kochetov
11e86ed64f Refactor ExpressionActions [Part 1]. 2020-10-07 21:37:27 +03:00
Azat Khuzhin
c0e15ba348 Fix RealTimeMicroseconds ProfileEvents 
RUsageCounters::real_time (RealTimeMicroseconds) was constructed from
CLOCK_REALTIME (or similar) in the ThreadStatus::initPerformanceCounters()
(ThreadStatusExt.cpp), while the intention is to store CLOCK_MONOTONIC
(time from boot, i.e. /proc/uptime) values there (in ThreadProfileEvents.h)
 2020-10-07 21:32:36 +03:00
Azat Khuzhin
553f6aa4cd Remove unused functions 2020-10-07 21:30:53 +03:00
alesapin
d093d4c535
Merge pull request #15675 from ClickHouse/fix_races_in_hdfs 
Fix races in libhdfs
 2020-10-07 20:39:40 +03:00
Artem Zuikov
eb1cb506c9
minor code improvement (#15668) 2020-10-07 20:20:07 +03:00
Nikolai Kochetov
54e77e906e
Merge pull request #15717 from ClickHouse/fix-array-join-optimisation-for-mv 
Fix array join optimisation for MV
 2020-10-07 20:19:35 +03:00
Anton Popov
cc451e41f5 fix assertion with transform_null_in 2020-10-07 18:36:34 +03:00
Latysheva Alexandra
f43ad338ed
Merge pull request #12 from alexelex/quorum_inserts_2 
style check
 2020-10-07 18:56:14 +06:00
Alexandra Latysheva
8f8872dc42 style check 2020-10-07 12:24:46 +00:00
Latysheva Alexandra
6c26f77380
Merge pull request #11 from alexelex/quorum_inserts_2 
changing the condition for updateQuorum, specialized it and reduced t…
 2020-10-07 17:49:20 +06:00
Pavel Kovalenko
69c126f1f1 Possibility to move part to another disk/volume if first attempt was failed. 2020-10-07 14:35:28 +03:00
Artem Zuikov
403a5320f5
enable bigint float division (#15691) 2020-10-07 14:32:57 +03:00
Alexandra Latysheva
a43cac2c1a changing the condition for updateQuorum, specialized it and reduced the number of calls to the zk 2020-10-07 11:28:48 +00:00
tavplubix
041015545c
Merge pull request #15537 from ClickHouse/mutation_hangs_after_replace_partition 
Fix mutation may hang after REPLACE/DROP PARTITION
 2020-10-07 14:25:29 +03:00
Nikolai Kochetov
df02573c92 Fix ARRAY JOIN optimisation when reading from MV. 2020-10-07 13:11:58 +03:00
Nikolai Kochetov
5f7aeddfe5
Merge pull request #15682 from ClickHouse/akz/storage_memory_less_locks 
Less locking in StorageMemory: totalRows + totalBytes
 2020-10-07 12:59:20 +03:00
Vasily Kozhukhovskiy
b8aa440912 style fixes 2020-10-07 12:24:54 +03:00
alexey-milovidov
e00961f882
Merge pull request #15657 from Jokser/disk-s3-write-error-handling 
Proper error handling during insert into MergeTree with S3
 2020-10-07 11:17:32 +03:00
Alexander Tokmakov
47e9fe9ff1 fix 2020-10-07 03:05:48 +03:00
Alexander Tokmakov
ea16370024 improvements in lost replica recovery 2020-10-07 02:29:33 +03:00
Azat Khuzhin
75e612fc16 Use full featured parser for force_data_skipping_indices 2020-10-07 01:44:14 +03:00
Azat Khuzhin
ef6d12967f Implement force_data_skipping_indices setting 2020-10-07 01:42:31 +03:00
Latysheva Alexandra
991e51a80e
Merge pull request #10 from alexelex/quorum_inserts_2 
style check fix
 2020-10-07 04:38:30 +06:00
Alexandra Latysheva
9077c92862 style check fix 2020-10-06 22:36:42 +00:00
Latysheva Alexandra
85bcc07c0b
Merge pull request #9 from alexelex/quorum_inserts_2 
Quorum inserts [version 3]
 2020-10-07 04:04:41 +06:00
Alexandra Latysheva
644091459f style fixes and remove small changes 2020-10-06 22:01:30 +00:00
Azat Khuzhin
675c70acbc Remove obsolete settings 
Came to this when looking at allow_experimental_data_skipping_indices,
for implementing force_data_skipping_indices
 2020-10-07 00:56:22 +03:00
Alexandra Latysheva
f549ecf9d1 insert_quorum_parallel: status nodes in /quorum/parallel and allow merges 2020-10-06 21:49:48 +00:00
Denis Glazachev
555f056a4c Revert "user not found" detection in loginImpl() and getIDOfLoggedUserImpl() 2020-10-06 20:32:06 +04:00