Commit Graph

26785 Commits

Author SHA1 Message Date
Vxider
a13b10a31c Merge branch 'master' of https://github.com/yandex/ClickHouse into distributed_insert_select 2020-03-23 12:15:30 +08:00
alexey-milovidov
c7863e1ac6
Clang Tidy, part 7 (#9799)
* Attempt to enable identifier naming check

* Attempt to enable identifier naming check, continue

* Progress on identifier names

* Adopt identifier names check

* Fixed error

* Merge with master

* Fixed build

* Fixed build

* Fixed build

* Fixed build

* Fixed build

* Fixed error

* Fixed error

* Fixed error
2020-03-23 05:12:31 +03:00
Alexey Milovidov
786ecbfeb8 Merge branch 'master' into taiyang-li-pr_add_auc 2020-03-23 04:44:39 +03:00
alexey-milovidov
3550f401ec
Merge pull request #9804 from azat/optimize_skip_unused_shards_type_mismatch
Fix SIGSEGV with optimize_skip_unused_shards when type cannot be converted
2020-03-23 02:06:58 +03:00
Vitaly Baranov
73d72fd1e2
Merge pull request #9517 from vitlibar/RBAC-7
RBAC-7
2020-03-23 00:03:53 +03:00
alexey-milovidov
06a8a421a2
Merge pull request #9739 from 4ertus2/ast
Rewrite multiple JOINs v2
2020-03-22 19:54:38 +03:00
Azat Khuzhin
7caf8c006d Fix SIGSEGV with optimize_skip_unused_shards when type cannot be converted 2020-03-22 19:45:36 +03:00
Azat Khuzhin
0204c3f9c7 Cover optimize_skip_unused_shards for types mismatch 2020-03-22 19:32:16 +03:00
Azat Khuzhin
b89de69345 Evaluate constant expressions for optimize_skip_unused_shards 2020-03-22 19:30:36 +03:00
Azat Khuzhin
622131fc85 Cover constant expression evaluation for optimize_skip_unused_shards
v2: remove key=xxHash64() that is covered by #9804
2020-03-22 14:55:43 +03:00
Vitaly Baranov
6839e15b67 Add tests for settings profiles. 2020-03-22 11:08:08 +03:00
Vitaly Baranov
9ca6af32ea Implement SQL to manage settings profiles. 2020-03-22 11:08:08 +03:00
Vitaly Baranov
49bf4ae375 Introduce SettingsProfile as a new access entity type. 2020-03-22 11:08:08 +03:00
Vitaly Baranov
18d5f63b31 Mass rename: AccessRightsContext -> ContextAccess, QuotaContext -> EnabledQuota, RoleContext -> EnabledRoles, and so on. 2020-03-22 11:08:08 +03:00
Vitaly Baranov
f1e9e3dec0 Improve access rights: KILL_MUTATION deleted, rights for corresponding ALTER commands are checked instead. 2020-03-22 11:08:08 +03:00
Vitaly Baranov
c1f5f8bc89 Improve access rights: SHOW splitted into SHOW_DATABASES, SHOW_TABLES, SHOW_COLUMNS, SHOW_DICTIONARIES, EXISTS deleted. 2020-03-22 11:08:08 +03:00
Vitaly Baranov
66172cc2eb Improve access rights: CREATE TABLE now implicitly enables CREATE VIEW, the same thing for DROP TABLE, ALTER TABLE, TRUNCATE_TABLE. 2020-03-22 11:08:08 +03:00
Vitaly Baranov
c7a10665d7 Remove non-partial revoke. 2020-03-22 11:08:08 +03:00
Vitaly Baranov
4af36ee5a4 Fix updating of the access rights after changing of the readonly setting. Remove non-const function Context::getSettingsRef(). 2020-03-22 11:08:08 +03:00
Vitaly Baranov
5eb79c2303 Cast "const char *" to StringRef is now implicit and constexpr. 2020-03-22 11:05:42 +03:00
alexey-milovidov
2fd4439e5f
Merge pull request #9761 from ClickHouse/remove-unused-code-thread-pool
Remove unused (obsolete) code from ThreadPool
2020-03-22 06:34:40 +03:00
Alexey Milovidov
75bf22e1f3 Fixed style 2020-03-22 05:52:44 +03:00
alexey-milovidov
3b7dc4d378
Merge pull request #9773 from achimbab/pr_funnel_strict_order
Add 'strict_order' option to windowFunnel()
2020-03-22 04:01:46 +03:00
alexey-milovidov
939e702bc6
Merge pull request #9606 from ClickHouse/alter_on_top_of_mutations_merge_tree
Non-blocking alter for vanilla merge tree
2020-03-22 03:56:25 +03:00
alexey-milovidov
03aa8d4cfd
Update AlterCommands.cpp 2020-03-22 03:56:10 +03:00
alexey-milovidov
46829a63f3
Update StorageMergeTree.cpp 2020-03-22 03:53:40 +03:00
alexey-milovidov
7a92428046
Update MutationCommands.h 2020-03-22 03:50:06 +03:00
Alexey Milovidov
1bfe312834 Removed leftovers 2020-03-21 19:43:31 +03:00
Artem Zuikov
d3b5620ad6 multiple_joins_rewriter_version = 1 2020-03-21 19:13:06 +03:00
Alexey Milovidov
59976318e4 Remove old performance-test tool 2020-03-21 16:23:17 +03:00
alexey-milovidov
5645c202e6
Merge pull request #9790 from amosbird/cg
Better cli client
2020-03-21 16:05:20 +03:00
alexey-milovidov
7a6e70c705
Merge pull request #9765 from ClickHouse/clang-tidy-5
Clang Tidy, part 5
2020-03-21 15:50:48 +03:00
alesapin
fbf73012d2 Fix integration test 2020-03-21 11:10:44 +03:00
philip.han
bf1aa44d19 Skip AggregateFunctionWindowFunnelData::merge() if other.events_list is empty. 2020-03-21 14:47:06 +09:00
Amos Bird
6fe1839f9e
Better cli client 2020-03-21 13:17:12 +08:00
Alexey Milovidov
a13f3f6d6e Fixed build 2020-03-21 08:00:53 +03:00
Alexey Milovidov
fea3ceca05 Fixed error; added a test 2020-03-21 05:52:37 +03:00
alexey-milovidov
6520b45588
Merge pull request #9784 from zlobober/expose_process_list_for_user_info
Expose ProcessListForUserInfo structure from ProcessList.
2020-03-21 01:36:22 +03:00
Artem Zuikov
27f59c73a2 enable new setting for CI and improve test 2020-03-20 22:18:42 +03:00
alesapin
20970f0ba7 Remove files from part correctly 2020-03-20 22:07:09 +03:00
Alexey Milovidov
8255547656 Added one more check 2020-03-20 21:53:35 +03:00
Alexey Milovidov
de5f559304 Fixed strange whitespaces 2020-03-20 21:53:35 +03:00
Alexey Milovidov
a0f2940cb1 Fixed error 2020-03-20 21:53:35 +03:00
Alexey Milovidov
a5e3d4efb7 Added most of clang-static-analyzer checks 2020-03-20 21:53:35 +03:00
Alexey Milovidov
3f13464e3d clang-tidy, part 5 2020-03-20 21:53:35 +03:00
alexey-milovidov
44cb1b8305
Merge pull request #9774 from ClickHouse/better_test
Fix 01045 test
2020-03-20 21:40:04 +03:00
alexey-milovidov
f624bed408
Merge branch 'master' into patch-0320 2020-03-20 21:36:14 +03:00
Azat Khuzhin
550cfef2ba Fix max_distributed_connections w/o Processors 2020-03-20 20:51:37 +03:00
Azat Khuzhin
b40eac426f Fix max_distributed_connections w/ Processors
With Processors max_distributed_connections does not used anymore, since
it always uses not more then max_threads (see
TCPHandler::processOrdinaryQueryWithProcessors()/
QueryPipeline::execute()/PipelineExecutor::execute())

So just use QueryPipeline::getNumThreads(), that takes
max_distributed_connections into account.
2020-03-20 20:51:37 +03:00
Azat Khuzhin
977849df5a Test for max_distributed_connections via HTTP 2020-03-20 20:51:37 +03:00
Azat Khuzhin
391054039e Test for max_distributed_connections (via TCP) 2020-03-20 20:51:37 +03:00
Azat Khuzhin
62b60a09a4 Add missing space in StorageDistributed logging (sharding key) 2020-03-20 20:51:37 +03:00
Maxim Akhmedov
f1e1934390 Expose ProcessListForUserInfo structure from ProcessList. 2020-03-20 20:27:17 +03:00
Artem Zuikov
ad8b579f3a fix clang-8 warning 2020-03-20 20:16:36 +03:00
alesapin
2a533264e7 Correct merge with master (try 2) 2020-03-20 19:32:16 +03:00
alesapin
62f39b6f52 Correct merge with master 2020-03-20 19:28:41 +03:00
alesapin
90c436f940 Fix style 2020-03-20 15:45:05 +03:00
Artem Zuikov
61dee9ffaa fix clang-8 warning 2020-03-20 15:36:35 +03:00
alesapin
ba3ac3df32 Fix alter drop column for compact parts 2020-03-20 15:25:24 +03:00
Artem Zuikov
b0d54e474b update comment 2020-03-20 15:21:02 +03:00
Artem Zuikov
b6d2895511 add test 2020-03-20 15:16:00 +03:00
Artem Zuikov
ae69a53f2b update tests 2020-03-20 15:09:53 +03:00
Artem Zuikov
b3c7d2f184 fix pubclshed columns 2020-03-20 14:31:16 +03:00
alesapin
1e041b8791 Fix argument 2020-03-20 14:24:17 +03:00
alesapin
dcb505b993 Fix 01045 test 2020-03-20 14:22:25 +03:00
alesapin
5a3216b26f Merge with master 2020-03-20 13:45:36 +03:00
philip.han
7549c575b1 Add 'strict_order' option to windowFunnel() 2020-03-20 19:31:47 +09:00
hcz
ae2c60d224 Update tests and docs related to splitByString 2020-03-20 13:37:46 +08:00
hcz
3c5670c0e2 Fix empty string handling in splitByString 2020-03-20 13:37:25 +08:00
Vxider
a8c8466ffb fix clang build 2020-03-20 12:48:20 +08:00
Alexander Kuzmenkov
d5822e7ebe
Merge pull request #6892 from ClickHouse/aku/poco-1.9.3
Update Poco to 1.9.3.
2020-03-20 06:03:48 +03:00
Alexey Milovidov
344ad7afd5 Extra initialization for MSan 2020-03-20 05:32:28 +03:00
Alexey Milovidov
a31514baa9 Fix ugly indentation 2020-03-20 05:32:28 +03:00
Artem Zuikov
c45002a2ee multiple join rewriter v2 (in progress) 2020-03-20 03:58:20 +03:00
Nikolai Kochetov
0fa45c3838
Merge pull request #9757 from ClickHouse/fix-rows-before-limit
Fix rows before limit
2020-03-20 00:36:36 +03:00
alesapin
610a727b92 Fix tidy error 2020-03-19 22:12:38 +03:00
alexey-milovidov
791dddc184
Merge pull request #9754 from ClickHouse/fix_mutations_memory_consumption
Fix mutations huge memory consumption
2020-03-19 21:56:50 +03:00
Alexey Milovidov
64a45e32d8 Remove unused (obsolete) code from ThreadPool #9154 2020-03-19 21:45:28 +03:00
Alexey Milovidov
8d9aba4fc3 Merge branch 'ParallelInputsProcessor-GlobalThreadPool-shutdown-fix' of https://github.com/azat/ClickHouse into azat-ParallelInputsProcessor-GlobalThreadPool-shutdown-fix 2020-03-19 21:29:17 +03:00
Alexey Milovidov
1a3e5cfcc5 Fixed a test that may taint other tests if timed out 2020-03-19 20:31:49 +03:00
Nikolai Kochetov
175c95675b Try fix tests. 2020-03-19 20:18:33 +03:00
alesapin
72ba032348
Merge pull request #9734 from ClickHouse/fix_quoting_in_dictionary_ddl
Fix backquoting in dictionary ddl
2020-03-19 20:10:26 +03:00
Vxider
404fbc275e undo code format 2020-03-20 01:07:58 +08:00
Vxider
706eeb67a8 update setting name 2020-03-20 01:04:59 +08:00
Vxider
28dd543973 Enable parallel distributed INSERT SELECT 2020-03-20 00:51:09 +08:00
Pavel Kovalenko
f2dca656f9
MergeTree full support for S3 (#9646)
* IMergeDataPart full S3 support.

* MergeTreeData full S3 support.

* Compilation fixes.

* Mutations and merges S3 support.

* Fixed removing data part.

* MergeTree for S3 integration tests and fixes.

* Code style issues.

* Enable AWS logging.

* Fixed hardlink creation for DiskLocal.

* Fixed localBackup.cpp compilation.

* Fixed attaching partition.

* Get rid of extra methods in IDisk.

* Fixed storage config reloading.

* More tests with table manipulations.

* Remove unused error codes.

* Move localBackup to MergeTree folder.

* Minor fixes.
2020-03-19 19:37:55 +03:00
Alexander Kuzmenkov
9d9ae00956 Relax a test due to Poco regression.
Poco 1.9.3 has one second precision for mtime, because of this we can
miss an update of a dictionary file if it happens in the same second
we've read the file.

Should probably be fixed by switching to std::filesystem.

Also add some logs because finding out what's going on with dictionary
reloading is borderline impossible.
2020-03-19 19:05:41 +03:00
Alexander Kuzmenkov
e38f70de65 Doesn't look like I'll ever complete this. 2020-03-19 19:05:41 +03:00
Alexander Kuzmenkov
2b0b7efa8c Use the appropriate Int64 variant.
Our Int64 is int64_t, and Poco's is long long, which are distinct for
the purposes of template specialization on MacOS.
2020-03-19 19:05:41 +03:00
Alexander Kuzmenkov
10019b4cc6 Check order values in clickhouse-test 2020-03-19 19:05:41 +03:00
Alexander Kuzmenkov
486c061d34 Remove global scope from sigprocmask etc.
These functions may be macros on some platforms e.g. Mac OS
2020-03-19 19:05:41 +03:00
Alexander Kuzmenkov
8b754fdcde Straighten the ODBC integration test somewhat. 2020-03-19 19:05:41 +03:00
Alexander Kuzmenkov
dac83d2f9a Reset signal mask before calling exec().
It might be non-empty and the child process might not expect this. For
example, in one case we started clickhouse-odbc-bridge with blocked
SIGTERM and then it didn't shutdown properly along with the server.
2020-03-19 19:05:41 +03:00
Alexander Kuzmenkov
fbfa74e5c4 test 2020-03-19 19:05:41 +03:00
Alexander Kuzmenkov
42c59af127 Remove trailing whitespace. 2020-03-19 19:05:41 +03:00
alexey-milovidov
47738615e6 Update ShellCommand.h 2020-03-19 19:05:41 +03:00
alexey-milovidov
f716fb66f9 Update ShellCommand.cpp 2020-03-19 19:05:41 +03:00
Alexander Kuzmenkov
e864b6f338 More logs + build fix. 2020-03-19 19:05:41 +03:00
Alexander Kuzmenkov
2918324807 More logs to catch the ODBC bridge shutdown error.
Also increase a potentially flappy timeout in another test.
2020-03-19 19:05:41 +03:00
Alexander Kuzmenkov
3eac794fab Register Poco ODBC Connector on clickhouse-odbc-bridge startup 2020-03-19 19:05:41 +03:00