Commit Graph

24984 Commits

Author SHA1 Message Date
Maxim Akhmedov
2d3321e003 Extend KeyCondition interface so that it returns BoolMask. 2020-01-30 00:40:22 +03:00
Alexander Kuzmenkov
09b8f34370
Merge pull request #8896 from ClickHouse/aku/enum-wrong-value
Report BAD_ARGUMENTS for a wrong user-supplied enum value.
2020-01-30 00:25:17 +03:00
Ubuntu
bc0fbd688a Make sumMap accept String keys
Adapt sumMap to accept an array of strings as the key column. This is useful when we do not want or cannot make the keys be numbers.

Signed-off-by: Baudouin Giard <bgiard@bloomberg.net>
2020-01-29 19:38:41 +00:00
achulkov2
0bece0c43e Fix error with consecutive detach and attach 2020-01-29 21:45:03 +03:00
Nikolai Kochetov
d1bc3513a2 Fix build. 2020-01-29 21:22:09 +03:00
Nikolai Kochetov
0c4f6eaca9 Fix build. 2020-01-29 21:18:12 +03:00
Nikolai Kochetov
84a392402f Processors reading for StorageBuffer. 2020-01-29 21:14:40 +03:00
Nikolai Kochetov
bded6e5cff Added holded contexts and storages to Pipe. 2020-01-29 19:59:11 +03:00
alexey-milovidov
b567907431
Merge pull request #8868 from amosbird/countoptfix
Fix `MakeSet` in Group By
2020-01-29 19:53:41 +03:00
Nikolai Kochetov
e7a29b24e5 Added table locks to Pipe. 2020-01-29 18:55:13 +03:00
Nikolai Kochetov
6cb86cef24 Added AddingMissedTransform. 2020-01-29 18:35:43 +03:00
Nikolai Kochetov
81d4fd9579 Add prepared pipe to InterpreterSelectQuery. 2020-01-29 18:04:46 +03:00
achulkov2
cdfffd343d Fix unreachable check 2020-01-29 17:57:22 +03:00
Nikolai Kochetov
162a2cb2f4 update SourceFromSingleChunk 2020-01-29 17:32:38 +03:00
Alexander Kuzmenkov
975f042dc0 Report BAD_ARGUMENTS for a wrong user-supplied enum value.
Before we reported LOGICAL_ERROR that is incorrect.
2020-01-29 17:17:34 +03:00
achulkov2
61ff06be70 Experimenting 2020-01-29 16:12:11 +03:00
alexey-milovidov
f65b75ce5a
Merge pull request #8874 from abyss7/issue-6964
Initialize query profiler for all threads in a group
2020-01-29 15:41:59 +03:00
Nikolai Kochetov
74d1eb90df Automatically call progress for SourceWithProgress. 2020-01-29 13:26:08 +03:00
Nikolai Kochetov
57100fc962 Merge branch 'master' into storage-system-processors 2020-01-29 13:17:18 +03:00
Nikolai Kochetov
8ce6040306
Merge pull request #7796 from ClickHouse/processors-4.3
Processors and system.numbers
2020-01-29 13:11:13 +03:00
alesapin
9b822e926a
Merge pull request #8882 from CurtizJ/fix-integration-test
Fix integration test 'prefer_localhost_replica'.
2020-01-29 11:34:39 +03:00
alesapin
abe9ce8774
Merge pull request #8884 from azat/client-suggest-merge_tree_settings
Add system.merge_tree_settings into clickhouse-client suggest
2020-01-29 11:26:24 +03:00
alexey-milovidov
2f9dd8e80f
Merge pull request #8877 from ClickHouse/aku/trace-readability
Reformat stack traces for readability.
2020-01-29 02:19:18 +03:00
alexey-milovidov
bcab6e7ac1
Merge pull request #8880 from ClickHouse/Akazz-clickhouse-test-patch-1
A followup to #8858: fixed awk invokation in hung queries check
2020-01-29 02:14:43 +03:00
Amos Bird
b650f1563a
Fix MakeSet in Group By 2020-01-29 04:49:39 +08:00
Azat Khuzhin
60d63081da Fix min_marks_for_seek for the data skipping indexes 2020-01-28 23:10:06 +03:00
Azat Khuzhin
3aeea41369 Add system.merge_tree_settings into clickhouse-client suggest 2020-01-28 22:25:43 +03:00
alexey-milovidov
e2860f8525
Merge pull request #8883 from ClickHouse/fix-storage-file-too-many-open-files
Updated internal testing script.
2020-01-28 22:21:58 +03:00
Alexey Milovidov
569e1ff666 Update testing script 2020-01-28 22:17:30 +03:00
alexey-milovidov
30c11474c8
Merge pull request #8834 from zlobober/comparable_nulls
Make NULLs comparable to everything.
2020-01-28 21:58:59 +03:00
CurtizJ
3144e81cb5 fix test prefer_localhost_replica 2020-01-28 21:54:25 +03:00
Alexander Kazakov
cebeae0055 Fixed awk invokation in hung queries check 2020-01-28 20:21:57 +03:00
Alexey Milovidov
3a5de8b874 Update script for CHYT 2020-01-28 19:59:32 +03:00
Nikolai Kochetov
196bb81a6e Update TreeExecutor. 2020-01-28 19:59:28 +03:00
Pavel Kovalenko
e0cd6b1073 Formatting issues. 2020-01-28 19:09:24 +03:00
Pavel Kovalenko
efeb9e92be StorageLog Gtest 2020-01-28 19:08:30 +03:00
Alexander Kuzmenkov
37daed2830 Reformat stack traces for readability. 2020-01-28 17:42:58 +03:00
Mikhail Filimonov
dc43728dea Test showing the problem with partial commit of polled batch + fix 2020-01-28 15:21:36 +01:00
Ding Xiang Fei
55b81c97e6 Set signal before rethrowing exception (#8736)
* set signal before rethrowing exception
* Add comment
2020-01-28 16:47:47 +03:00
Pavel Kovalenko
856592e26b Comments fixed. 2020-01-28 16:46:02 +03:00
Pavel Kovalenko
a12c318f35 Optimize includes. 2020-01-28 16:38:46 +03:00
Mikhail Filimonov
5dafccf410 Test for flushing by time and by block size (+fix), one extra test for virual columns 2020-01-28 14:24:37 +01:00
Nikolai Kochetov
fea33f8b60 Add processlist to PipelineExecutor. Throw exception if query was killed. 2020-01-28 16:16:02 +03:00
Pavel Kovalenko
0572f96656 Formatting issues. 2020-01-28 16:15:47 +03:00
Pavel Kovalenko
baa3c8e55b Formatting issues. 2020-01-28 16:05:37 +03:00
Pavel Kovalenko
3eb59d1ed3 Formatting issues. 2020-01-28 16:01:08 +03:00
Nikolai Kochetov
5a8a367228 Add processlist to PipelineExecutor. Throw exception if query was killed. 2020-01-28 15:59:34 +03:00
Pavel Kovalenko
d4707ca911 Seek reworking. 2020-01-28 15:48:01 +03:00
Pavel Kovalenko
861ddbcadd DiskS3 Metadata refactoring. 2020-01-28 15:46:39 +03:00
Maxim Akhmedov
65356ea893 And one more fix. 2020-01-28 15:33:25 +03:00
Maxim Akhmedov
ead37dc294 Fix comparison between decimal field and null. 2020-01-28 15:31:17 +03:00
Ivan Lezhankin
27986b6658 Revert "Merge pull request #8831 from ClickHouse/revert-8820-issue-6964"
This reverts commit a21d3712eb, reversing
changes made to 667e9ed6d4.
2020-01-28 15:01:45 +03:00
Ivan Lezhankin
a592049ca3 Merge remote-tracking branch 'upstream/master' into issue-6964 2020-01-28 15:01:33 +03:00
Ivan Lezhankin
06f5a274ec Fix initialization of QueryProfiler with regard to query context. 2020-01-28 14:59:06 +03:00
Nikolai Kochetov
a19c8b3d37 Update LimitTransform. 2020-01-28 14:50:22 +03:00
alesapin
e27a3170bc Less flaps in tests 2020-01-28 13:58:37 +03:00
alexey-milovidov
1f90d2f078
Merge pull request #8866 from achulkov2/issue-8865_unnamed_tuples_should_not_be_flattened
Issue 8865 unnamed tuples should not be flattened
2020-01-28 12:32:58 +03:00
alexey-milovidov
45dce57a8c
Merge pull request #8830 from zlobober/storage_properties
Explicitly specify storage features
2020-01-28 01:49:53 +03:00
alexey-milovidov
74786e3584
Merge pull request #8858 from ClickHouse/Akazz-clickhouse-test-patch-1
In clickhouse-test: Updated check for hung queries
2020-01-28 01:45:32 +03:00
alexey-milovidov
acc5fad41a
Merge pull request #8848 from ClickHouse/fix-pipeline-dump
Do not dump pipeline in exception message.
2020-01-28 01:44:23 +03:00
alexey-milovidov
7795c9c889
Merge pull request #8861 from ClickHouse/fix-storage-file-too-many-open-files
Fix StorageFile too many open files error
2020-01-28 01:35:39 +03:00
Vladimir Chebotarev
f98de4e098 Added tests for _file and _path in S3 storage. 2020-01-28 01:09:21 +03:00
Vladimir Chebotarev
11a5cab7bd Added some tests. 2020-01-28 00:44:18 +03:00
Andrei Chulkov
7395c0eadc Rename columns to avoid ambiguity with sql 2020-01-28 00:09:38 +03:00
Andrei Chulkov
d8f7383fd7 Add test 2020-01-28 00:04:46 +03:00
achulkov2
b7c9075e53 Stop flattening unnamed nested tuples 2020-01-27 23:26:39 +03:00
Vladimir Chebotarev
533011a5f5 Minor review and style fixes. 2020-01-27 23:08:43 +03:00
Pavel Kovalenko
cb3693f071 Formatting issues. 2020-01-27 22:51:48 +03:00
alexey-milovidov
75ebebde4f
Merge pull request #8845 from ClickHouse/client-vertical-fix
Fixed ugly error with vertical format in Client
2020-01-27 22:36:12 +03:00
Pavel Kovalenko
699a031c7f Code style issues. 2020-01-27 22:27:52 +03:00
Pavel Kovalenko
47e7c8d474 Formatting issues. 2020-01-27 22:17:22 +03:00
Pavel Kovalenko
0df5f89a47 Minor formatting. 2020-01-27 22:01:18 +03:00
Pavel Kovalenko
6501ca735b Minor formatting. 2020-01-27 21:59:52 +03:00
Pavel Kovalenko
07755ec8f7 Merge branch 'master' into idisk-seekable-readbuffer
# Conflicts:
#	dbms/programs/server/config.xml
2020-01-27 21:45:53 +03:00
Pavel Kovalenko
abfacdaadc SeekableReadBuffer refactoring.
Store size and multiple references for S3 metadata file.
Log engine support for S3.
2020-01-27 21:44:30 +03:00
Maxim Akhmedov
2e9538f768 Another fix for tests. Better handling of MV. 2020-01-27 21:28:37 +03:00
Alexey Milovidov
390745cc81 Fixed the issue with too many open files when using StorageFile with globs 2020-01-27 21:26:58 +03:00
Alexey Milovidov
1ce32211cf Fixed the issue with too many open files when using StorageFile with globs 2020-01-27 21:25:54 +03:00
Alexey Milovidov
59ef3c8034 Fixed the issue with too many open files when using StorageFile with globs 2020-01-27 21:13:02 +03:00
Nikolai Kochetov
d34cf8a5bb Fix build. 2020-01-27 21:12:27 +03:00
Avogar
e8dc8bc0ec Allow data in square brackets in JSONEachRowFormat. 2020-01-27 21:09:36 +03:00
Nikolai Kochetov
f94eb7a0ff Update ISource. 2020-01-27 21:09:20 +03:00
Alexander Kazakov
6b355aa273 Moved around some logic of hung_check detector 2020-01-27 21:04:12 +03:00
Alexander Kazakov
c6c3c4347b Keep stderr when collecting stacktraces 2020-01-27 20:47:05 +03:00
Nikolai Kochetov
733df795a3 Fix IBlockInputStream 2020-01-27 20:12:55 +03:00
Alexey Milovidov
a1f05d3a56 Fixed the issue with too many open files when using StorageFile with globs 2020-01-27 20:06:32 +03:00
Nikolai Kochetov
43455d79b4 Add time limit to SourceWithProgress. 2020-01-27 19:58:25 +03:00
Alexander Kazakov
0106040a2f
In clickhouse-test: Updated check for hung queries 2020-01-27 19:51:48 +03:00
Nikolai Kochetov
45741eb03a Add cancell to SourceFromInputStream. 2020-01-27 19:16:06 +03:00
Nikolai Kochetov
6a656e8ee8 Add cancell to SourceFromInputStream. 2020-01-27 19:03:55 +03:00
proller
936c357e05 Merge remote-tracking branch 'upstream/master' into fix27 2020-01-27 17:54:43 +03:00
Nikolai Kochetov
902b977d9d Add cancell to SourceFromInputStream. 2020-01-27 17:39:14 +03:00
Nikolai Kochetov
73ee23c1d8 Add cancell to SourceFromInputStream. 2020-01-27 17:31:40 +03:00
Maxim Akhmedov
af7e66f0da Make NULLs comparable to everything. 2020-01-27 17:28:57 +03:00
Maxim Akhmedov
675d0f549f Add replication and deduplication properties. 2020-01-27 17:14:49 +03:00
Maxim Akhmedov
419f2c2c2b Fix segmentation fault. 2020-01-27 16:04:01 +03:00
Nikolai Kochetov
ef268d7016 Fix TablesBlockSource. 2020-01-27 16:00:18 +03:00
Alexey Milovidov
205c0f7fbb Added comment 2020-01-27 15:43:28 +03:00
alexey-milovidov
4613615b4a
Merge pull request #8850 from excitoon-favorites/fixcolumns
Fixed `StorageInput::StorageInput` a little bit
2020-01-27 15:26:10 +03:00
Nikolai Kochetov
a9c09b88c3 Update ISource 2020-01-27 13:59:54 +03:00
chertus
0886bfb9bc fix test 2020-01-27 13:57:31 +03:00
Vladimir Chebotarev
18804407aa Properly added _file and _path columns. 2020-01-27 13:22:49 +03:00
Vladimir Chebotarev
3d0d31f62a Fixed StorageInput::StorageInput a little bit. 2020-01-27 13:19:14 +03:00
Nikolai Kochetov
2c025a8bd1 Add progress. 2020-01-27 13:05:57 +03:00
Nikolai Kochetov
77cefbbd42 Do not dump pipeline in exception message. 2020-01-27 12:14:01 +03:00
alexey-milovidov
9ba383cf46
Merge pull request #8843 from ClickHouse/remove-useless-files
Remove useless files
2020-01-26 22:06:27 +03:00
alexey-milovidov
581b20748e
Trigger CI 2020-01-26 21:55:12 +03:00
Alexey Milovidov
47178f1413 Update test 2020-01-26 21:53:24 +03:00
alexey-milovidov
2787960ba2
Merge pull request #8793 from ClickHouse/fix-null-format-for-processors
Update ConvertingAggregatedToChunksTransform.
2020-01-26 21:51:00 +03:00
alexey-milovidov
994192080d
Merge pull request #8837 from ClickHouse/query-profiler-workaround-google-cloud-runner
Added workaround for Google Cloud Run
2020-01-26 21:46:16 +03:00
Alexey Milovidov
87ee9ac099 Fixed ugly error in Client 2020-01-26 21:43:44 +03:00
Alexey Milovidov
5d52261266 Remove useless files 2020-01-26 18:25:58 +03:00
Vladimir Chebotarev
a7d05211c5 Added _file and _path columns. 2020-01-26 17:05:51 +03:00
Alexey Milovidov
4d13f020cd Removed obsolete setting from test 2020-01-26 16:36:37 +03:00
Vladimir Chebotarev
61e80e4872 Attempt to add S3 globbing to StorageS3::read. 2020-01-26 16:12:15 +03:00
Vladimir Chebotarev
d2ccbcfb32 Attempt to add S3 globbing function. 2020-01-26 16:03:47 +03:00
alexey-milovidov
056aba49ff
Update QueryProfiler.cpp 2020-01-26 14:27:12 +03:00
alexey-milovidov
9602e67050
Update QueryProfiler.cpp 2020-01-26 14:25:28 +03:00
Alexey Milovidov
2acb71337f Added workaround for Google Cloud Runner 2020-01-26 14:19:04 +03:00
Nikolai Kochetov
679e38e336 Added comments. 2020-01-26 10:52:34 +03:00
alexey-milovidov
066b4e745c
Merge pull request #8402 from excitoon-favorites/atomicdelete
"Atomically" remove parts on destroy.
2020-01-26 04:08:13 +03:00
alexey-milovidov
97a75dd8c9
Merge pull request #8786 from millb/X-ClickHouse-Exception-Code
X-ClickHouse-Exception-Code in HTTP Header
2020-01-26 03:43:38 +03:00
Alexey Milovidov
940804ee6d Don't allow strange expressions in ALTER ... PARTITION query 2020-01-26 03:22:34 +03:00
alexey-milovidov
2df93a6d21
Merge pull request #8756 from azat/distributed_storage_configuration
Multiple disks/volumes for storing data for send in Distributed engine
2020-01-26 02:19:28 +03:00
Maxim Akhmedov
382eed249f Fix style issue. 2020-01-26 00:33:32 +03:00
Vladimir Chebotarev
ca2d381743 Prettier removal of part data on destroy. 2020-01-26 00:27:46 +03:00
Vladimir Chebotarev
b35a6d1ce3 Got rid of ugly relative paths while deleting on destroy. 2020-01-26 00:27:46 +03:00
Vladimir Chebotarev
fdef1d6935 Increased some timeouts in test_multiple_disks and test_ttl_move. 2020-01-26 00:27:46 +03:00
Vladimir Chebotarev
2d749630b7 Fixed temporary path for part being erased. 2020-01-26 00:27:46 +03:00
Vladimir Chebotarev
3f11569d94 "Atomically" remove parts on destroy. 2020-01-26 00:27:46 +03:00
alexey-milovidov
49c77c65f2
Update Settings.h 2020-01-26 00:04:34 +03:00
alexey-milovidov
196ed889b9
Merge branch 'master' into joins 2020-01-26 00:03:56 +03:00
alexey-milovidov
9814831c8f
Merge pull request #8827 from zlobober/disable_mmap
Allow disabling mmapping
2020-01-25 23:42:04 +03:00
Maxim Akhmedov
338bd3e919 Remove commented line. 2020-01-25 23:39:53 +03:00
alexey-milovidov
9f3bbea6eb
Merge pull request #8806 from ClickHouse/vzakaznikov-issue_7878_3
Reworking fix for issue 7878 (version 4)
2020-01-25 23:39:49 +03:00
alexey-milovidov
aff87dbd82
Update AggregatingTransform.cpp 2020-01-25 23:36:25 +03:00
alexey-milovidov
328dc523c5
Update AggregatingTransform.cpp 2020-01-25 23:36:12 +03:00
alexey-milovidov
ab172eb0bd
Revert "Initialize query profiler for all threads in a group" 2020-01-25 23:34:22 +03:00
Maxim Akhmedov
d6f72dc2ce Specify supported features for each storage engine, expose them via system.table_engines table, properly check feature support in storage factory. 2020-01-25 22:44:52 +03:00
Maxim Akhmedov
2f12866bc2 Introduce macro for disabling allocator mmapping. 2020-01-25 22:17:18 +03:00
Alexey Milovidov
667e9ed6d4 Added example to config.xml and fixed formatting after previous committers #8794 2020-01-25 21:47:02 +03:00
alexey-milovidov
1bf614b3a2
Trigger tests. 2020-01-25 21:39:50 +03:00
alexey-milovidov
1630e88c81
Merge pull request #8820 from abyss7/issue-6964
Initialize query profiler for all threads in a group
2020-01-25 21:33:46 +03:00
Azat Khuzhin
5c641b7485 Cover storage_configuration for Distributed engine 2020-01-25 20:52:31 +03:00
Azat Khuzhin
e5a43d2751 Add ability to use multiple disks/volumes for Distributed engine
Now Distributed() has gain the 5-th argument -- policy name (for storing
data to send):

  CREATE TABLE foo (key Int) Engine=Distributed(test_shard_localhost, currentDatabase(), some_table, key%2, 'default');
2020-01-25 20:52:31 +03:00
alexey-milovidov
dc90d42e1e
Merge pull request #8305 from ClickHouse/Vxider-parallel-insert
Vxider parallel insert
2020-01-25 20:30:50 +03:00
alexey-milovidov
2a6b628db9
Merge pull request #8794 from zlobober/custom_query_log_engine
Make system log engine customizable via config.
2020-01-25 17:38:50 +03:00
alexey-milovidov
df4f0c7379
Merge pull request #8805 from azat/force_optimize_skip_unused_shards
force_optimize_skip_unused_shards setting to throw if skipping is not possible
2020-01-25 17:37:59 +03:00
alexey-milovidov
cf2cd05906
Merge pull request #8824 from ClickHouse/fix_loading_live_view
Fix LiveView dependencies
2020-01-25 17:37:29 +03:00
alexey-milovidov
43230c9e5a
Merge pull request #8809 from azat/text_log.level
Add text_log.level to limit entries that goes to system.text_log table
2020-01-25 17:28:35 +03:00