thevar1able/ClickHouse
1
0
Fork 0
mirror of https://github.com/ClickHouse/ClickHouse.git synced 2024-09-24 10:40:49 +00:00
Code Issues Packages Projects Releases Wiki Activity
38,029 Commits 8,941 Branches 1,766 Tags 2 GiB
7a96984dd8
Commit Graph

27167 Commits

Author SHA1 Message Date
Nikolai Kochetov
08a9486cfc Update weak hash. 2020-03-24 14:38:05 +03:00
Nikolai Kochetov
07b29453cc Update weak hash. 2020-03-24 14:29:55 +03:00
Nikolai Kochetov
20d3e34fb0 Update weak hash. 2020-03-24 14:02:16 +03:00
Nikolai Kochetov
488b21cd82 Update weak hash. 2020-03-24 14:01:15 +03:00
Nikolai Kochetov
67ed4d4cc3 Update weak hash. 2020-03-24 13:02:09 +03:00
Azat Khuzhin
b8614de64a Fix DISTINCT for Distributed and optimize_skip_unused_shards 
In case of optimize_skip_unused_shards the getQueryProcessingStage() can
return QueryProcessingStage::WithMergeableState because the whole
cluster has multiple nodes, but optimize_skip_unused_shards can trim it
to 1 and in this case we need final merge that won't be done with
QueryProcessingStage::WithMergeableState only with
QueryProcessingStage::Complete.
 2020-03-24 11:07:09 +03:00
Azat Khuzhin
0e925ff7ad Cover DISTINCT for Distributed with one shard (test from #9046) 
v2: cover case when getQueryProcessingStage() returns Complete when it
should not (pointed by @alexey-milovidov in
https://github.com/ClickHouse/ClickHouse/pull/9808#issuecomment-602291996)
 2020-03-24 11:07:09 +03:00
Vitaly Baranov
4576cf198e Fix calculating grants for introspection functions from the setting 'allow_introspection_functions'. 2020-03-24 11:03:09 +03:00
Azat Khuzhin
4707dd827a StorageDistributed: cleanup skipping unused shards 2020-03-24 10:58:34 +03:00
Azat Khuzhin
66ccbf5d11 Pass query to the IStorage::getQueryProcessingStage() 
Will be used to return correct stage with optimize_skip_unused_shards.
 2020-03-24 10:58:16 +03:00
alexey-milovidov
df19d6aac1
Merge pull request #9622 from PerformanceVision/dictionary_status 
Bring dictionary status on native prometheus exporter
 2020-03-24 09:44:01 +03:00
alexey-milovidov
c762a42f4b
Merge pull request #9815 from ClickHouse/taiyang-li-pr_add_auc 
Merging arrayAUC
 2020-03-24 09:36:13 +03:00
alexey-milovidov
25cf827365
Merge pull request #9759 from Vxider/distributed_insert_select 
Distributed INSERT SELECT
 2020-03-24 09:34:44 +03:00
alexey-milovidov
9f72c28035
Update InterpreterInsertQuery.cpp 2020-03-24 09:34:01 +03:00
alexey-milovidov
9a2760d914
Merge pull request #9673 from azat/processors-max_distributed_connections 
Fix max_distributed_connections
 2020-03-24 08:32:15 +03:00
Alexey Milovidov
9a41113bf4 Renamed tests 2020-03-24 08:25:17 +03:00
Alexey Milovidov
691d98ff34 Added another test 2020-03-24 08:14:48 +03:00
Alexey Milovidov
5a89fd0abc Added performance test 2020-03-24 08:06:35 +03:00
Alexey Milovidov
ff59a06298 Remove memory allocation in inner loop 2020-03-24 07:57:50 +03:00
Alexey Milovidov
df3159d8a8 Fix comment 2020-03-24 07:52:45 +03:00
Alexey Milovidov
ed18a6f0bc A fix in appreciation of UBSan 2020-03-24 07:51:58 +03:00
Alexey Milovidov
27f0b93237 Finally I managed to understand the code 2020-03-24 07:48:44 +03:00
Alexey Milovidov
77e5eb2864 Attempt to understand the code 2020-03-24 07:18:39 +03:00
Alexey Milovidov
4d55952d2e Remove useless code 2020-03-24 03:18:08 +03:00
alexey-milovidov
10b4b05379
Merge pull request #9812 from azat/force_optimize_skip_unused_shards-nested 
Add force_optimize_skip_unused_shards_no_nested
 2020-03-24 03:11:33 +03:00
alexey-milovidov
83aaba7e36
Merge pull request #9834 from ClickHouse/better_traces_in_clickhouse_test 
Collect stack traces from system.stack_trace table
 2020-03-24 03:10:42 +03:00
alexey-milovidov
bae9db10f3
Merge pull request #9823 from ClickHouse/fix-expression-transform-for-empty-totals 
Fix Expression transform for empty totals.
 2020-03-24 03:10:20 +03:00
alexey-milovidov
43b5519101
Merge pull request #9829 from amosbird/ci 
more aggregation methods
 2020-03-24 03:09:51 +03:00
alexey-milovidov
ebddd4f0ba
Merge pull request #9832 from ClickHouse/fix-tsan-report-system-stack-trace 
Fix tsan report in system.stack_trace
 2020-03-24 03:08:09 +03:00
alexey-milovidov
db55ad5309
Merge pull request #9827 from ClickHouse/remove_redundant_code_merge_tree 
Remove redundant code from merge tree
 2020-03-24 03:07:59 +03:00
alexey-milovidov
28aa3119a4
Merge pull request #8846 from azat/distributed-const-expr-eval 
Evaluate constant expressions for optimize_skip_unused_shards
 2020-03-24 03:07:42 +03:00
Alexey Milovidov
0d5ed94398 Fixed style 2020-03-24 03:05:05 +03:00
Alexey Milovidov
c59c52d81a Merge branch 'master' into taiyang-li-pr_add_auc 2020-03-24 03:04:34 +03:00
Artem Zuikov
0b6fdde9fc
minor test fix (#9835) 2020-03-24 01:44:29 +03:00
Amos Bird
0744606fc3
DROP VIEW support. (#9831) 2020-03-24 01:28:30 +03:00
Artem Zuikov
38cbf3e6f7
Fix JOIN rewriters inconsistency (#9830) 
* fix join rewrites: inconsistent visitors
 2020-03-24 01:23:31 +03:00
Nikolai Kochetov
c4370886b0 Update weak hash. 2020-03-23 23:59:36 +03:00
Nikolai Kochetov
6d63d4bc88 Update weak hash. 2020-03-23 23:48:46 +03:00
Nikolai Kochetov
ee907da84d Update weak hash. 2020-03-23 23:45:12 +03:00
Nikolai Kochetov
ad56da8961 Added comments. 2020-03-23 23:03:52 +03:00
Nikolai Kochetov
4cfdef4403 Fix style and suppress pvs varnings.] 2020-03-23 22:38:53 +03:00
Nikolai Kochetov
c0dea7b1b3 Fix test. 2020-03-23 22:33:36 +03:00
Azat Khuzhin
d019c4e3b3 Add force_optimize_skip_unused_shards_no_nested 
force_optimize_skip_unused_shards_no_nested will disable
force_optimize_skip_unused_shards for nested Distributed tables.

Can be useful for multi-layred/bi-level sharding.
 2020-03-23 22:30:54 +03:00
Nikolai Kochetov
9e105b877c Update intHash. 2020-03-23 22:21:15 +03:00
Nikolai Kochetov
3c31139db8 More tests. 2020-03-23 22:18:35 +03:00
alesapin
9c9ce0aa37
Update clickhouse-test 2020-03-23 21:17:07 +03:00
Nikolai Kochetov
0bd502f2a6 Update unit test. 2020-03-23 20:42:26 +03:00
Nikolai Kochetov
2e2272785a Update unit test. 2020-03-23 20:39:34 +03:00
Nikolai Kochetov
7582f6628c Update unit test. 2020-03-23 20:32:08 +03:00
alesapin
ebf3e7b9e4 Collect stack traces from system.stack_trace table 2020-03-23 20:30:52 +03:00
alexey-milovidov
1ee26193f0
Update StorageDistributed.cpp 2020-03-23 20:28:38 +03:00
Nikolai Kochetov
9ab6f6a0ff Update unit test. 2020-03-23 20:20:09 +03:00
Nikolai Kochetov
05fb1760a7 Update unit test. 2020-03-23 20:17:34 +03:00
Nikolai Kochetov
7f6dda4994 Update unit test. 2020-03-23 20:15:32 +03:00
Alexey Milovidov
e06b9d4c2f Fix tsan report in system.stack_trace 2020-03-23 19:25:21 +03:00
Nikolai Kochetov
1d94b8bfbd Merge branch 'master' into weak-hash 2020-03-23 19:22:46 +03:00
alexey-milovidov
857c39fe48
Merge pull request #9825 from ClickHouse/remove-garbage-system-tables 
Remove some garbage from code of system.tables
 2020-03-23 19:00:24 +03:00
alesapin
772c210184 Better name 2020-03-23 18:43:20 +03:00
Pavel Kovalenko
5375683f24
DiskS3 hardlinks optimal implementation (#9760) 
* Optimal DiskS3 hardlinks implementation and new tests.

* Code style fixes.

* Minor fixed.

* Minor fixes.
 2020-03-23 17:45:48 +03:00
Amos Bird
0f15dd2fab
more aggregation methods 2020-03-23 21:44:21 +08:00
alesapin
048a61695c Add comment 2020-03-23 16:40:14 +03:00
alesapin
b0578d3faa Remove accident change 2020-03-23 16:35:18 +03:00
alesapin
3a1e375b8a Remove atomic from bytes_size 2020-03-23 16:32:02 +03:00
Alexey Milovidov
a331f2c616 Remove some garbage from code of system.tables, part 1 2020-03-23 16:03:15 +03:00
Alexey Milovidov
ca1bb2fbde Fix flacky test #9813 2020-03-23 15:52:20 +03:00
Nikolai Kochetov
0b9c53ac7d Added test. 2020-03-23 15:48:10 +03:00
Nikolai Kochetov
d0067afa1f Fix Expression transform for empty totals. 2020-03-23 15:23:54 +03:00
alesapin
9cd283266e Better size calculation 2020-03-23 15:19:43 +03:00
Alexey Milovidov
958b695618 Merge branch 'master' into taiyang-li-pr_add_auc 2020-03-23 15:06:23 +03:00
alesapin
fd7be934bb Remove useless method and it's usages 2020-03-23 12:50:54 +03:00
Vxider
231e679710 update code style 2020-03-23 17:42:59 +08:00
alesapin
cfb098cca9 Fix bulk of flaky tests 2020-03-23 12:28:14 +03:00
alesapin
7fc1ce6ec7 Fix flacky 00806_alter_update test 2020-03-23 12:05:51 +03:00
Alexey Milovidov
98db9ee074 Merging arrayAUC 2020-03-23 07:44:49 +03:00
Vxider
a13b10a31c Merge branch 'master' of https://github.com/yandex/ClickHouse into distributed_insert_select 2020-03-23 12:15:30 +08:00
alexey-milovidov
c7863e1ac6
Clang Tidy, part 7 (#9799) 
* Attempt to enable identifier naming check

* Attempt to enable identifier naming check, continue

* Progress on identifier names

* Adopt identifier names check

* Fixed error

* Merge with master

* Fixed build

* Fixed build

* Fixed build

* Fixed build

* Fixed build

* Fixed error

* Fixed error

* Fixed error
 2020-03-23 05:12:31 +03:00
Alexey Milovidov
786ecbfeb8 Merge branch 'master' into taiyang-li-pr_add_auc 2020-03-23 04:44:39 +03:00
alexey-milovidov
3550f401ec
Merge pull request #9804 from azat/optimize_skip_unused_shards_type_mismatch 
Fix SIGSEGV with optimize_skip_unused_shards when type cannot be converted
 2020-03-23 02:06:58 +03:00
Vitaly Baranov
73d72fd1e2
Merge pull request #9517 from vitlibar/RBAC-7 
RBAC-7
 2020-03-23 00:03:53 +03:00
alexey-milovidov
06a8a421a2
Merge pull request #9739 from 4ertus2/ast 
Rewrite multiple JOINs v2
 2020-03-22 19:54:38 +03:00
Azat Khuzhin
7caf8c006d Fix SIGSEGV with optimize_skip_unused_shards when type cannot be converted 2020-03-22 19:45:36 +03:00
Azat Khuzhin
0204c3f9c7 Cover optimize_skip_unused_shards for types mismatch 2020-03-22 19:32:16 +03:00
Azat Khuzhin
b89de69345 Evaluate constant expressions for optimize_skip_unused_shards 2020-03-22 19:30:36 +03:00
Azat Khuzhin
622131fc85 Cover constant expression evaluation for optimize_skip_unused_shards 
v2: remove key=xxHash64() that is covered by #9804
 2020-03-22 14:55:43 +03:00
Vitaly Baranov
6839e15b67 Add tests for settings profiles. 2020-03-22 11:08:08 +03:00
Vitaly Baranov
9ca6af32ea Implement SQL to manage settings profiles. 2020-03-22 11:08:08 +03:00
Vitaly Baranov
49bf4ae375 Introduce SettingsProfile as a new access entity type. 2020-03-22 11:08:08 +03:00
Vitaly Baranov
18d5f63b31 Mass rename: AccessRightsContext -> ContextAccess, QuotaContext -> EnabledQuota, RoleContext -> EnabledRoles, and so on. 2020-03-22 11:08:08 +03:00
Vitaly Baranov
f1e9e3dec0 Improve access rights: KILL_MUTATION deleted, rights for corresponding ALTER commands are checked instead. 2020-03-22 11:08:08 +03:00
Vitaly Baranov
c1f5f8bc89 Improve access rights: SHOW splitted into SHOW_DATABASES, SHOW_TABLES, SHOW_COLUMNS, SHOW_DICTIONARIES, EXISTS deleted. 2020-03-22 11:08:08 +03:00
Vitaly Baranov
66172cc2eb Improve access rights: CREATE TABLE now implicitly enables CREATE VIEW, the same thing for DROP TABLE, ALTER TABLE, TRUNCATE_TABLE. 2020-03-22 11:08:08 +03:00
Vitaly Baranov
c7a10665d7 Remove non-partial revoke. 2020-03-22 11:08:08 +03:00
Vitaly Baranov
4af36ee5a4 Fix updating of the access rights after changing of the readonly setting. Remove non-const function Context::getSettingsRef(). 2020-03-22 11:08:08 +03:00
Vitaly Baranov
5eb79c2303 Cast "const char *" to StringRef is now implicit and constexpr. 2020-03-22 11:05:42 +03:00
alexey-milovidov
2fd4439e5f
Merge pull request #9761 from ClickHouse/remove-unused-code-thread-pool 
Remove unused (obsolete) code from ThreadPool
 2020-03-22 06:34:40 +03:00
Alexey Milovidov
75bf22e1f3 Fixed style 2020-03-22 05:52:44 +03:00
alexey-milovidov
3b7dc4d378
Merge pull request #9773 from achimbab/pr_funnel_strict_order 
Add 'strict_order' option to windowFunnel()
 2020-03-22 04:01:46 +03:00
alexey-milovidov
939e702bc6
Merge pull request #9606 from ClickHouse/alter_on_top_of_mutations_merge_tree 
Non-blocking alter for vanilla merge tree
 2020-03-22 03:56:25 +03:00
alexey-milovidov
03aa8d4cfd
Update AlterCommands.cpp 2020-03-22 03:56:10 +03:00
alexey-milovidov
46829a63f3
Update StorageMergeTree.cpp 2020-03-22 03:53:40 +03:00
alexey-milovidov
7a92428046
Update MutationCommands.h 2020-03-22 03:50:06 +03:00
Ivan Lezhankin
362aca365f Merge branch 'master' into jemalloc 2020-03-21 22:50:48 +03:00
Ivan Lezhankin
86cb4811b5 Build shared jemalloc in splitted mode 2020-03-21 22:49:26 +03:00
Alexey Milovidov
1bfe312834 Removed leftovers 2020-03-21 19:43:31 +03:00
Artem Zuikov
d3b5620ad6 multiple_joins_rewriter_version = 1 2020-03-21 19:13:06 +03:00
Alexey Milovidov
59976318e4 Remove old performance-test tool 2020-03-21 16:23:17 +03:00
alexey-milovidov
5645c202e6
Merge pull request #9790 from amosbird/cg 
Better cli client
 2020-03-21 16:05:20 +03:00
alexey-milovidov
7a6e70c705
Merge pull request #9765 from ClickHouse/clang-tidy-5 
Clang Tidy, part 5
 2020-03-21 15:50:48 +03:00
alesapin
fbf73012d2 Fix integration test 2020-03-21 11:10:44 +03:00
philip.han
bf1aa44d19 Skip AggregateFunctionWindowFunnelData::merge() if other.events_list is empty. 2020-03-21 14:47:06 +09:00
Amos Bird
6fe1839f9e
Better cli client 2020-03-21 13:17:12 +08:00
Alexey Milovidov
a13f3f6d6e Fixed build 2020-03-21 08:00:53 +03:00
Alexey Milovidov
fea3ceca05 Fixed error; added a test 2020-03-21 05:52:37 +03:00
alexey-milovidov
6520b45588
Merge pull request #9784 from zlobober/expose_process_list_for_user_info 
Expose ProcessListForUserInfo structure from ProcessList.
 2020-03-21 01:36:22 +03:00
Artem Zuikov
27f59c73a2 enable new setting for CI and improve test 2020-03-20 22:18:42 +03:00
alesapin
20970f0ba7 Remove files from part correctly 2020-03-20 22:07:09 +03:00
Alexey Milovidov
8255547656 Added one more check 2020-03-20 21:53:35 +03:00
Alexey Milovidov
de5f559304 Fixed strange whitespaces 2020-03-20 21:53:35 +03:00
Alexey Milovidov
a0f2940cb1 Fixed error 2020-03-20 21:53:35 +03:00
Alexey Milovidov
a5e3d4efb7 Added most of clang-static-analyzer checks 2020-03-20 21:53:35 +03:00
Alexey Milovidov
3f13464e3d clang-tidy, part 5 2020-03-20 21:53:35 +03:00
alexey-milovidov
44cb1b8305
Merge pull request #9774 from ClickHouse/better_test 
Fix 01045 test
 2020-03-20 21:40:04 +03:00
alexey-milovidov
f624bed408
Merge branch 'master' into patch-0320 2020-03-20 21:36:14 +03:00
Azat Khuzhin
550cfef2ba Fix max_distributed_connections w/o Processors 2020-03-20 20:51:37 +03:00
Azat Khuzhin
b40eac426f Fix max_distributed_connections w/ Processors 
With Processors max_distributed_connections does not used anymore, since
it always uses not more then max_threads (see
TCPHandler::processOrdinaryQueryWithProcessors()/
QueryPipeline::execute()/PipelineExecutor::execute())

So just use QueryPipeline::getNumThreads(), that takes
max_distributed_connections into account.
 2020-03-20 20:51:37 +03:00
Azat Khuzhin
977849df5a Test for max_distributed_connections via HTTP 2020-03-20 20:51:37 +03:00
Azat Khuzhin
391054039e Test for max_distributed_connections (via TCP) 2020-03-20 20:51:37 +03:00
Azat Khuzhin
62b60a09a4 Add missing space in StorageDistributed logging (sharding key) 2020-03-20 20:51:37 +03:00
Nikolai Kochetov
46f63c1dd8 Fix weakHash 2020-03-20 20:31:05 +03:00
Nikolai Kochetov
0344978634 Fix weakHash 2020-03-20 20:28:45 +03:00
Maxim Akhmedov
f1e1934390 Expose ProcessListForUserInfo structure from ProcessList. 2020-03-20 20:27:17 +03:00
Artem Zuikov
ad8b579f3a fix clang-8 warning 2020-03-20 20:16:36 +03:00
Nikolai Kochetov
75192d44aa Fix weakHash 2020-03-20 20:05:04 +03:00
alesapin
2a533264e7 Correct merge with master (try 2) 2020-03-20 19:32:16 +03:00
alesapin
62f39b6f52 Correct merge with master 2020-03-20 19:28:41 +03:00
Nikolai Kochetov
ebba6a6100 Fix weakHash 2020-03-20 18:57:05 +03:00
Nikolai Kochetov
33db7f3988 Fix weakHash 2020-03-20 18:48:09 +03:00
Nikolai Kochetov
c4e73c10c9 Fix weakHash 2020-03-20 16:54:43 +03:00
Nikolai Kochetov
c9d808e509 Fix weakHash 2020-03-20 16:03:51 +03:00
alesapin
90c436f940 Fix style 2020-03-20 15:45:05 +03:00
Artem Zuikov
61dee9ffaa fix clang-8 warning 2020-03-20 15:36:35 +03:00
alesapin
ba3ac3df32 Fix alter drop column for compact parts 2020-03-20 15:25:24 +03:00
Artem Zuikov
b0d54e474b update comment 2020-03-20 15:21:02 +03:00
nikitamikhaylov
74327e7f47 remove settings from query 2020-03-20 16:18:26 +04:00
Artem Zuikov
b6d2895511 add test 2020-03-20 15:16:00 +03:00
Artem Zuikov
ae69a53f2b update tests 2020-03-20 15:09:53 +03:00
Artem Zuikov
b3c7d2f184 fix pubclshed columns 2020-03-20 14:31:16 +03:00
alesapin
1e041b8791 Fix argument 2020-03-20 14:24:17 +03:00
alesapin
dcb505b993 Fix 01045 test 2020-03-20 14:22:25 +03:00
alesapin
5a3216b26f Merge with master 2020-03-20 13:45:36 +03:00
philip.han
7549c575b1 Add 'strict_order' option to windowFunnel() 2020-03-20 19:31:47 +09:00
hcz
ae2c60d224 Update tests and docs related to splitByString 2020-03-20 13:37:46 +08:00
hcz
3c5670c0e2 Fix empty string handling in splitByString 2020-03-20 13:37:25 +08:00
Vxider
a8c8466ffb fix clang build 2020-03-20 12:48:20 +08:00
Alexander Kuzmenkov
d5822e7ebe
Merge pull request #6892 from ClickHouse/aku/poco-1.9.3 
Update Poco to 1.9.3.
 2020-03-20 06:03:48 +03:00
Alexey Milovidov
344ad7afd5 Extra initialization for MSan 2020-03-20 05:32:28 +03:00
Alexey Milovidov
a31514baa9 Fix ugly indentation 2020-03-20 05:32:28 +03:00
Artem Zuikov
c45002a2ee multiple join rewriter v2 (in progress) 2020-03-20 03:58:20 +03:00
Nikolai Kochetov
0fa45c3838
Merge pull request #9757 from ClickHouse/fix-rows-before-limit 
Fix rows before limit
 2020-03-20 00:36:36 +03:00
Alexey Milovidov
93daa16271 Better test 2020-03-19 22:55:16 +03:00
Alexey Milovidov
8f71c74345 Added a test that checks that read from MergeTree with single thread is performed in order 2020-03-19 22:54:36 +03:00
alesapin
610a727b92 Fix tidy error 2020-03-19 22:12:38 +03:00
Nikolai Kochetov
dcd8321c7d Add some tests. 2020-03-19 22:02:54 +03:00
alexey-milovidov
791dddc184
Merge pull request #9754 from ClickHouse/fix_mutations_memory_consumption 
Fix mutations huge memory consumption
 2020-03-19 21:56:50 +03:00
Alexey Milovidov
64a45e32d8 Remove unused (obsolete) code from ThreadPool #9154 2020-03-19 21:45:28 +03:00
Alexey Milovidov
8d9aba4fc3 Merge branch 'ParallelInputsProcessor-GlobalThreadPool-shutdown-fix' of https://github.com/azat/ClickHouse into azat-ParallelInputsProcessor-GlobalThreadPool-shutdown-fix 2020-03-19 21:29:17 +03:00
Nikolai Kochetov
fe36c27152 Fix style. 2020-03-19 20:35:08 +03:00
Alexey Milovidov
1a3e5cfcc5 Fixed a test that may taint other tests if timed out 2020-03-19 20:31:49 +03:00
Nikolai Kochetov
175c95675b Try fix tests. 2020-03-19 20:18:33 +03:00
alesapin
72ba032348
Merge pull request #9734 from ClickHouse/fix_quoting_in_dictionary_ddl 
Fix backquoting in dictionary ddl
 2020-03-19 20:10:26 +03:00
Vxider
404fbc275e undo code format 2020-03-20 01:07:58 +08:00
Vxider
706eeb67a8 update setting name 2020-03-20 01:04:59 +08:00
Vxider
28dd543973 Enable parallel distributed INSERT SELECT 2020-03-20 00:51:09 +08:00
Pavel Kovalenko
f2dca656f9
MergeTree full support for S3 (#9646) 
* IMergeDataPart full S3 support.

* MergeTreeData full S3 support.

* Compilation fixes.

* Mutations and merges S3 support.

* Fixed removing data part.

* MergeTree for S3 integration tests and fixes.

* Code style issues.

* Enable AWS logging.

* Fixed hardlink creation for DiskLocal.

* Fixed localBackup.cpp compilation.

* Fixed attaching partition.

* Get rid of extra methods in IDisk.

* Fixed storage config reloading.

* More tests with table manipulations.

* Remove unused error codes.

* Move localBackup to MergeTree folder.

* Minor fixes.
 2020-03-19 19:37:55 +03:00
Alexander Kuzmenkov
9d9ae00956 Relax a test due to Poco regression. 
Poco 1.9.3 has one second precision for mtime, because of this we can
miss an update of a dictionary file if it happens in the same second
we've read the file.

Should probably be fixed by switching to std::filesystem.

Also add some logs because finding out what's going on with dictionary
reloading is borderline impossible.
 2020-03-19 19:05:41 +03:00
Alexander Kuzmenkov
e38f70de65 Doesn't look like I'll ever complete this. 2020-03-19 19:05:41 +03:00
Alexander Kuzmenkov
2b0b7efa8c Use the appropriate Int64 variant. 
Our Int64 is int64_t, and Poco's is long long, which are distinct for
the purposes of template specialization on MacOS.
 2020-03-19 19:05:41 +03:00
Alexander Kuzmenkov
10019b4cc6 Check order values in clickhouse-test 2020-03-19 19:05:41 +03:00
Alexander Kuzmenkov
486c061d34 Remove global scope from sigprocmask etc. 
These functions may be macros on some platforms e.g. Mac OS
 2020-03-19 19:05:41 +03:00
Alexander Kuzmenkov
8b754fdcde Straighten the ODBC integration test somewhat. 2020-03-19 19:05:41 +03:00
Alexander Kuzmenkov
dac83d2f9a Reset signal mask before calling exec(). 
It might be non-empty and the child process might not expect this. For
example, in one case we started clickhouse-odbc-bridge with blocked
SIGTERM and then it didn't shutdown properly along with the server.
 2020-03-19 19:05:41 +03:00
Alexander Kuzmenkov
fbfa74e5c4 test 2020-03-19 19:05:41 +03:00
Alexander Kuzmenkov
42c59af127 Remove trailing whitespace. 2020-03-19 19:05:41 +03:00
alexey-milovidov
47738615e6 Update ShellCommand.h 2020-03-19 19:05:41 +03:00
alexey-milovidov
f716fb66f9 Update ShellCommand.cpp 2020-03-19 19:05:41 +03:00
Alexander Kuzmenkov
e864b6f338 More logs + build fix. 2020-03-19 19:05:41 +03:00
Alexander Kuzmenkov
2918324807 More logs to catch the ODBC bridge shutdown error. 
Also increase a potentially flappy timeout in another test.
 2020-03-19 19:05:41 +03:00
Alexander Kuzmenkov
3eac794fab Register Poco ODBC Connector on clickhouse-odbc-bridge startup 2020-03-19 19:05:41 +03:00
alesapin
c6d10e32fc Revert accident changes 2020-03-19 18:12:22 +03:00
Nikolai Kochetov
b6d7cb45dd Added comment. 2020-03-19 17:30:43 +03:00
Nikolai Kochetov
b4a93c092d Fix build. 2020-03-19 17:16:49 +03:00
alesapin
204d0ac955 Fix bugs after method split 2020-03-19 17:11:37 +03:00
Nikolai Kochetov
db9ad40db5 Fix build. 2020-03-19 16:53:25 +03:00
Nikolai Kochetov
100fe4c93c Fix build. 2020-03-19 16:45:19 +03:00
Nikolai Kochetov
f7c17435b8 Fix build 2020-03-19 16:29:59 +03:00
Avogar
783a898b9d Add MsgPackRowOutputFormat. 2020-03-19 16:27:05 +03:00
alesapin
ce8eb9293a Merge branch 'master' into alter_on_top_of_mutations_merge_tree 2020-03-19 16:05:17 +03:00
alexey-milovidov
77b26f6a93
Update PartLog.cpp 2020-03-19 16:00:34 +03:00
alesapin
9982f548f5 Remove redundant header 2020-03-19 14:48:11 +03:00
Nikolai Kochetov
5d763dead0 Change the way how rows_before_limit_at_least is calculated for processors pipeline. 2020-03-19 14:45:52 +03:00
alesapin
5818dfeb45 Simplier string get 2020-03-19 14:45:04 +03:00
alesapin
72baec8523 Better includes 2020-03-19 14:34:54 +03:00
alesapin
2b41cb2f5c Rename part_log table 2020-03-19 14:34:02 +03:00
alesapin
fbad7cb23b Remove new lines 2020-03-19 14:32:06 +03:00
alesapin
d27cd773cc Fix mutations huge memory consumption 2020-03-19 14:31:21 +03:00
Ivan
571d0d541c
Improve CCTZ contrib (#9687) 
* common/Types.h → common/types.h
  Also split Core/Defines.h and merge with common/likely.h
* Improve cctz contrib
* Fix ALWAYS_INLINE and unbundled build
* Update Dockerfile from master
* Fix test for unbundled library
 2020-03-19 13:38:34 +03:00
alexey-milovidov
b91bb18886
Merge pull request #9716 from ClickHouse/aku/more-stable-perf-tests 
More stable perf tests
 2020-03-19 12:50:33 +03:00
alexey-milovidov
a3e78a3b86
Merge pull request #9721 from amosbird/cc 
Always prefer case insensitive suggestions
 2020-03-19 12:34:16 +03:00
alexey-milovidov
4b943cd044
Merge pull request #9723 from amosbird/cd 
random seed by default in groupArraySample
 2020-03-19 12:33:40 +03:00
alexey-milovidov
36773b661c
Merge pull request #9742 from hczhcz/patch-0319 
Extend splitByString for empty separators
 2020-03-19 12:28:24 +03:00
Artem Zuikov
67d711e78c Merge branch 'master' into ast 2020-03-19 12:28:11 +03:00
alesapin
c4553f2f7b Reuse correct function 2020-03-19 11:36:37 +03:00
hcz
c115757e79 Update tests and docs for string splitting functions 2020-03-19 10:35:18 +08:00
hcz
08f9413e64 Extend splitByString for empty separators 2020-03-19 10:26:40 +08:00
Anton Popov
f08771e563 parse tuple as literal if possible 2020-03-19 04:15:01 +03:00
nikitamikhaylov
b623e3425b fix build 2020-03-19 02:01:43 +04:00
Artem Zuikov
88782b4dce Rewrite multiple JOINs v2 (set multiple_joins_rewriter_version = 2) 2020-03-19 00:38:27 +03:00
alesapin
d060b7111d Also unescape backslashes 2020-03-18 23:23:48 +03:00
Nikita Mikhaylov
0a7f4e08cf style check fix 2020-03-18 23:18:01 +03:00
Nikita Mikhaylov
fdd12bb8d7 remote TODO 2020-03-18 22:19:37 +03:00
Alexey Milovidov
a7956013f3 Fixed clang-tidy check 2020-03-18 22:17:35 +03:00
Alexey Milovidov
9cc463b1af Merge branch 'master' of github.com:yandex/ClickHouse into clang-tidy-4 2020-03-18 22:16:07 +03:00
Alexander Kuzmenkov
a5e078736d
Merge pull request #9698 from ClickHouse/aku/faster-perf-test 
Faster performance test
 2020-03-18 22:04:51 +03:00
Nikita Mikhaylov
eed5ee4ec7 Merge branch 'master' of github.com:ClickHouse/ClickHouse into clickhouse-copier 2020-03-18 22:04:42 +03:00
Ivan
38b2dec354
Arcadia (#9729) 
* Move getFQDNOrHostName to base/common/
* Add argsToConfig to ya.make
* Add coverage.cpp to ya.make
  Also remove WITH_COVERAGE from config file
 2020-03-18 21:54:27 +03:00
Nikita Mikhaylov
c33771105f partition deletion added 2020-03-18 21:35:58 +03:00
Nikolai Kochetov
7246f819cd Fix build. 2020-03-18 20:08:27 +03:00
alesapin
37cc49efad Fix clang-tidy 2020-03-18 20:06:48 +03:00
alesapin
04494c6ec2 Merge with master after strange conflict 2020-03-18 19:59:22 +03:00
Alexey Milovidov
5e72202b51 Fixed clang-tidy check 2020-03-18 19:51:20 +03:00
Alexey Milovidov
1ced2550d0 Fixed clang-tidy check 2020-03-18 19:51:20 +03:00
Alexey Milovidov
4514f89fb3 Fixed style 2020-03-18 19:51:20 +03:00
Alexey Milovidov
93466ce097 Added even more clang-tidy checks 2020-03-18 19:51:20 +03:00
Alexey Milovidov
c20853eecc Added most of bugprone checks 2020-03-18 19:51:20 +03:00
alesapin
20211451ae Fix backquoting in dictionary ddl 2020-03-18 19:47:33 +03:00
Nikolai Kochetov
e6f518154b Fix build. 2020-03-18 19:46:07 +03:00
Nikolai Kochetov
6d1640643a Fix build. 2020-03-18 19:40:23 +03:00
Nikolai Kochetov
9f82f43fdd Fix build. 2020-03-18 19:36:21 +03:00
Nikolai Kochetov
e94f572c95 Fix build. 2020-03-18 19:28:50 +03:00
Nikolai Kochetov
e76877c5ed Fix build. 2020-03-18 19:18:37 +03:00
Nikolai Kochetov
e26eac4649 Implement updateWeakHash32 for other columns. 2020-03-18 19:03:55 +03:00
Alexander Kuzmenkov
f04c2da180
Update arithmetic.xml 2020-03-18 18:31:03 +03:00
Alexander Kuzmenkov
83c8581e5a
Update synthetic_hardware_benchmark.xml 2020-03-18 18:22:29 +03:00
alesapin
baec35a18b Better locking in alter 2020-03-18 17:43:16 +03:00
Nikita Mikhaylov
23f027e6da typo 2020-03-18 17:40:24 +03:00
Nikolai Kochetov
a19937a0a4 Refactor weakHash for ColumnString. 2020-03-18 16:44:46 +03:00
Nikita Mikhaylov
6f526db293 also better code 2020-03-18 16:25:49 +03:00
alesapin
f64c005e70 Split merger mutator 2020-03-18 16:16:59 +03:00
Ivan Lezhankin
40095f4ba5 Return jemalloc to system.build_options 2020-03-18 15:29:51 +03:00
Ivan Lezhankin
528e42bc4c Improve jemalloc contrib 2020-03-18 15:29:51 +03:00
Alexey Milovidov
cf1a8bc36e Fixed error 2020-03-18 15:14:10 +03:00
alesapin
d00406294c Splitting mutate part to temporarty part 2020-03-18 14:36:18 +03:00
alesapin
eb938f66e4 Better mutations interface 2020-03-18 13:02:57 +03:00
alesapin
3babac10f5 Fix query hang 2020-03-18 12:48:29 +03:00
alesapin
13a0151cf3 Remove garbage 2020-03-18 12:34:05 +03:00
alesapin
e6acfd4e8b Return new test 2020-03-18 12:12:35 +03:00
alesapin
b3d52cfb33 Merge branch 'master' into alter_on_top_of_mutations_merge_tree 2020-03-18 11:54:19 +03:00
alesapin
87e9a84ef7 Unblock waiting mutations 2020-03-18 11:53:55 +03:00
Nikita Mikhaylov
134ac8c9b4 tune tests 2020-03-18 11:49:05 +03:00
Amos Bird
045f5ae348
random seed by default 2020-03-18 16:12:15 +08:00
Amos Bird
adf4ad6ce3
Always prefer case insensitive suggestions 2020-03-18 13:27:56 +08:00
Alexander Kuzmenkov
f19c34d36d Merge remote-tracking branch 'origin/master' into HEAD 2020-03-18 06:26:29 +03:00
Guillaume Tassery
b3e37a0890 add example 2020-03-18 04:09:19 +01:00
Alexey Milovidov
1bd7e594b0 clang-tidy, part 2 2020-03-18 03:57:00 +03:00
Alexander Kuzmenkov
2510aed7b5 More stable perf tests 2020-03-18 03:33:32 +03:00
Alexander Kuzmenkov
3ec3732d99
Update synthetic_hardware_benchmark.xml 2020-03-18 03:15:05 +03:00
alexey-milovidov
a800fa7986
Merge pull request #9693 from den-crane/patch-2 
extended test for deduplicate_blocks_in_dependent_materialized_views
 2020-03-18 01:33:18 +03:00
alexey-milovidov
52f51ba5dc
Merge pull request #9696 from ClickHouse/aku/trace-timestamp 
Add high-precision timestamp to trace_log
 2020-03-18 01:32:49 +03:00
Artem Zuikov
dbc08d7644
Add DATE and TIMESTAMP operators (#9691) 
* DATE and TIMESTAMP operators
 2020-03-18 00:56:47 +03:00
Alexander Kuzmenkov
458b724600 fixpu 2020-03-17 23:27:42 +03:00
Nikita Mikhaylov
1798bbedec style issues 2020-03-17 21:07:54 +03:00
alesapin
17e505da0f Fix build errors 2020-03-17 20:22:41 +03:00
Nikita Mikhaylov
6a991783f4 simplify code 2020-03-17 19:50:22 +03:00
Nikita Mikhaylov
784ac0059f better 2020-03-17 19:23:47 +03:00
alesapin
347d2a328f Remove columns lock!!! 2020-03-17 18:10:56 +03:00
Alexander Kuzmenkov
81631e4e6a fixup 2020-03-17 17:36:24 +03:00
alesapin
d5636fb76b Fix style check 2020-03-17 17:31:24 +03:00
alesapin
8d0cb42ef3 Remove more code 2020-03-17 17:07:27 +03:00
alesapin
5877a5af42 Remove alter transaction!!! 2020-03-17 16:49:50 +03:00
Guillaume Tassery
751a574274 remove double quoted string 2020-03-17 14:27:05 +01:00
Guillaume Tassery
cb7bbed849 run build 2020-03-17 12:36:41 +01:00
alesapin
b0b81bec89 Merge with master and fix 2020-03-17 14:03:29 +03:00
Guillaume Tassery
df3976c9b2 set code on cpp file 2020-03-17 11:43:57 +01:00
Guillaume Tassery
57fc1b1a9b test 2020-03-17 10:24:24 +01:00
alesapin
5a152f8d09
Merge pull request #9689 from ClickHouse/better_logging_on_part_remove 
More verbose error text
 2020-03-17 12:13:42 +03:00
Alexander Kuzmenkov
1b7954cbae Faster performance test 2020-03-17 05:56:44 +03:00
Alexander Kuzmenkov
04bed5f032 Add high-precision timestamp to trace_log 2020-03-17 05:16:04 +03:00
Nikita Mikhaylov
d217933948 add more tests 2020-03-17 00:05:38 +03:00
Denis Zhuravlev
d6e843d1f4
Update test.py 2020-03-16 17:03:52 -03:00
Denis Zhuravlev
f1f1c1c591
extended test for deduplicate_blocks_in_dependent_materialized_views 2020-03-16 16:49:51 -03:00
alesapin
9c4f21eb54
Merge pull request #9680 from ClickHouse/fix_mutations_test 
Simplify kill mutation test
 2020-03-16 22:06:15 +03:00
alesapin
18dcb193fd More verbose message about error in case of exception during recursive remove 2020-03-16 21:57:01 +03:00
Guillaume Tassery
e350baf58f test 2020-03-16 16:26:23 +01:00
alesapin
1c98210b71 Fix bug in integration test 2020-03-16 18:09:20 +03:00
alesapin
5b54ef5bfd Split long dictionaries test 2020-03-16 17:59:11 +03:00
alesapin
718903f140 Simplify test and fix order of messages 2020-03-16 17:05:11 +03:00
Guillaume Tassery
bbd6ff8466 test 2020-03-16 14:35:22 +01:00
Guillaume Tassery
b3c1115bc2 an another test 2020-03-16 13:40:34 +01:00
Alexey Milovidov
32b3e7946c Fix flacky test, take two 2020-03-16 15:32:07 +03:00
alesapin
4547e1a25b Simplify kill mutation test 2020-03-16 14:54:07 +03:00