Commit Graph

1367 Commits

Author SHA1 Message Date
Alexey Milovidov
7ca1dff219 Merge branch 'master' of github.com:yandex/ClickHouse 2020-03-04 18:16:48 +03:00
Alexey Milovidov
06c8e04998 Fixed comment #4215 2020-03-04 18:16:32 +03:00
Vladimir Chebotarev
2bd6474379 Adding storage policies and disks while reloading configuration. 2020-03-04 15:10:17 +03:00
Azat Khuzhin
8adcbc7952 Send progress after final update (like logs)
Otherwise you will get non completed progress on TCP, HTTP does not
affected.

Final updateProgress called from the executeQueryImpl::finish_callback:
  (gdb) bt
  0  DB::TCPHandler::updateProgress (this=0x7fffb581e000, value=...) at TCPHandler.cpp:1178
  1  0x00007ffff7c62038 in DB::TCPHandler::<lambda(const DB::Progress&)>::operator()(const DB::Progress &) const (...) at TCPHandler.cpp:127
  4  0x00007fffe9a86671 in DB::<lambda(DB::IBlockInputStream*, DB::IBlockOutputStream*)>::operator()(DB::IBlockInputStream *, DB::IBlockOutputStream *) (__closure=0x7fffb588f300,
     stream_in=0x7fffb5800290, stream_out=0x0) at executeQuery.cpp:450
  5  0x00007fffe9a8b948 in std::_Function_handler<void(DB::IBlockInputStream*, DB::IBlockOutputStream*), DB::executeQueryImpl(...)::<lambda(DB::IBlockInputStream*, DB::IBlockOutputStream*)> >::_M_invoke(const std::_Any_data &, DB::IBlockInputStream *&&, DB::IBlockOutputStream *&&) (...) at std_function.h:300
  6  0x00007ffff7c7482f in std::function<>::operator()(DB::IBlockInputStream*, DB::IBlockOutputStream*) const (..) at std_function.h:688
  7  0x00007ffff7c6f82b in DB::BlockIO::onFinish (this=0x7fffb5820738) at BlockIO.h:43
  8  0x00007ffff7c65eb0 in DB::TCPHandler::processOrdinaryQuery (this=0x7fffb581e000) at TCPHandler.cpp:540
  9  0x00007ffff7c63a50 in DB::TCPHandler::runImpl (this=0x7fffb581e000) at TCPHandler.cpp:269
  10 0x00007ffff7c6a6fd in DB::TCPHandler::run (this=0x7fffb581e000) at TCPHandler.cpp:1226
  ...
2020-03-04 11:31:47 +03:00
alexey-milovidov
26c74d679f
Merge pull request #9493 from traceon/timezone-http-header
Set X-ClickHouse-Timezone HTTP response header to the server's timezone
2020-03-04 04:29:36 +03:00
alexey-milovidov
bcf0f99844
Merge pull request #9483 from ClickHouse/num_threads_for_query_pipeline
Better calculation for recommended number of threads to execute pipeline
2020-03-04 04:22:19 +03:00
Alexey Milovidov
a4e7c287b5 Merge branch 'master' into chaos-sanitizer 2020-03-03 23:06:02 +03:00
Nikita Mikhaylov
649df01627 rewrite replicated tables to plain merge tree 2020-03-03 19:36:47 +03:00
Denis Glazachev
975107f0ab Combine executeQuery() callbacks
Set X-ClickHouse-Timezone HTTP Response header in the executeQuery() callback
2020-03-03 19:32:41 +04:00
Nikita Mikhaylov
d9765991a7 replicated engine support 2020-03-03 16:15:23 +03:00
Nikolai Kochetov
72fe21c5ae Better calculation for recommended number of threads to execute query pipeline. 2020-03-03 13:28:37 +03:00
Nikita Mikhaylov
cbef417410 Merge branch 'clickhouse-copier' of github.com:nikitamikhaylov/ClickHouse into clickhouse-copier 2020-03-03 12:49:59 +03:00
Nikita Mikhaylov
aa0d44131d normal extracting 2020-03-03 12:49:06 +03:00
Alexey Milovidov
5b06842723 Remove excessive empty lines 2020-03-03 05:43:59 +03:00
Alexander Tokmakov
70dc82f9aa add StorageID to ASTInsertQuery 2020-03-02 23:23:58 +03:00
Alexey Milovidov
0ecf3b2c7b Reordered config.xml 2020-03-02 18:29:52 +03:00
Alexander Tokmakov
a4d12b31a1 Merge branch 'master' into split_databases_from_context 2020-03-02 17:57:54 +03:00
alexey-milovidov
020122d995
Merge pull request #9455 from ClickHouse/client-avoid-deadlock-message
Avoid message "deadlock avoided" in client
2020-03-02 15:13:17 +03:00
Nikita Mikhaylov
daed0bc6d8 Merge branch 'master' of github.com:ClickHouse/ClickHouse into clickhouse-copier 2020-03-02 13:24:36 +03:00
Ilya Yatsishin
c02ca3fbba
Merge pull request #9453 from ClickHouse/better-exception-message-length-required
Better exception message when length is required in HTTP
2020-03-02 11:44:19 +03:00
Alexey Milovidov
9bffd88b92 Using ThreadFuzzer 2020-03-02 00:58:50 +03:00
Vitaly Baranov
fc0376a170 Shard now clamps the settings got from the initiator to the shard's constaints instead of throwing an exception. 2020-03-01 02:18:49 +03:00
Alexey Milovidov
89ba7d5fc1 Avoid message "deadlock avoided" in client 2020-02-29 22:53:22 +03:00
Alexey Milovidov
9c206fca39 Better exception message when length is required in HTTP 2020-02-29 21:27:34 +03:00
Vitaly Baranov
91523752ce Use server config to set path to persistent storage for access entities. 2020-02-28 16:34:19 +03:00
CurtizJ
a17d286e83 allow to set query_id in clickhouse-benchmark 2020-02-27 20:21:01 +03:00
Alexey Milovidov
425ed714eb Merge branch 'master' of github.com:yandex/ClickHouse into errorcodes-style 2020-02-26 17:16:22 +03:00
Nikita Mikhaylov
9591678f84 useledd 2020-02-26 14:44:21 +03:00
Alexey Milovidov
029bcc7cd3 Fixed ErrorCodes, part 4 2020-02-25 21:58:28 +03:00
Amos Bird
ce28d2eb82
Better cmdline client 2020-02-26 02:40:52 +08:00
Alexey Milovidov
8f90c6ec12 Fixed ErrorCodes, part 3 2020-02-25 21:20:08 +03:00
Alexey Milovidov
cb6cd2ffbb Added missing ErrorCodes, part 2 2020-02-25 21:10:48 +03:00
Alexey Milovidov
766ae8261a Added some missing ErrorCodes 2020-02-25 21:02:41 +03:00
Alexey Milovidov
3602126a1e Remove unused ErrorCodes 2020-02-25 17:35:37 +03:00
Alexander Tokmakov
8548089e00 Merge branch 'master' into split_databases_from_context 2020-02-25 15:47:19 +03:00
Nikita Mikhaylov
476d25b6b2 fix build 2020-02-25 15:38:11 +03:00
Nikita Mikhaylov
1b8174b9d0
trigger ci 2020-02-23 17:25:55 +03:00
alexey-milovidov
afc306091b
Merge pull request #9262 from ClickHouse/fix_expressions_in_metadata
Fix expressions in metadata
2020-02-23 04:32:55 +03:00
Alexey Milovidov
21647ed842 Fixed warning 2020-02-22 23:22:38 +03:00
Alexander Tokmakov
852043c8d9 better configs 2020-02-22 17:26:39 +03:00
tavplubix
8358c952c3
Merge pull request #9302 from ClickHouse/fix_tests_with_secure_sockets
Try fix tests with secure sockets
2020-02-22 13:32:12 +03:00
Alexander Tokmakov
21e0eb5f11 try fix tests with secure sockets 2020-02-22 04:37:03 +03:00
Vitaly Baranov
c1e870d493
Merge pull request #9182 from vitlibar/RBAC-5.2
RBAC-5.2
2020-02-22 03:55:17 +03:00
Alexey Milovidov
5f9a56a38a Colorize logs that are send to client with "send_logs_level" setting 2020-02-21 23:01:38 +03:00
Nikita Mikhaylov
5e01f348c5 return back alter move 2020-02-21 19:47:43 +03:00
Nikita Mikhaylov
16322b1352 replace partition 2020-02-21 19:18:16 +03:00
Nikita Mikhaylov
0b4d8bdb08 move partition added 2020-02-21 19:00:50 +03:00
Alexander Tokmakov
d5e79153c2 Merge branch 'master' into split_databases_from_context 2020-02-21 18:09:02 +03:00
Nikolai Kochetov
30d41b34ba Merged with master 2020-02-21 11:47:56 +03:00
Vitaly Baranov
4f85c148b5 Move event handling away from Context. 2020-02-21 03:27:23 +03:00
Vitaly Baranov
5849dd2236 Slightly better solution for checking row policy for distributed tables,
now it checks both current user's and initial user's filters.
2020-02-21 00:57:42 +03:00
Nikita Mikhaylov
2869c01571 drop partition piece 2020-02-20 21:58:00 +03:00
Alexey Milovidov
5894a750d5 Merge branch 'master' into session-cleaner-better-build-time 2020-02-20 21:43:40 +03:00
Nikita Mikhaylov
1be4a35f15 successful copying 2020-02-20 20:26:20 +03:00
Nikita Mikhaylov
ce16a6e536 Merge branch 'master' of github.com:ClickHouse/ClickHouse into clickhouse-copier 2020-02-20 13:56:39 +03:00
Nikita Mikhaylov
b035dd815b merge finished 2020-02-20 13:01:02 +03:00
Nikita Mikhaylov
23ceddebbc codestyle final 2 2020-02-20 12:06:00 +03:00
Nikita Mikhaylov
6bc23f5eae merging 2020-02-20 12:01:06 +03:00
Nikita Mikhaylov
b08db134c1 merging 2020-02-20 12:00:41 +03:00
nikitamikhaylov
3c1f2b6124 style check final 2020-02-19 23:50:27 +03:00
nikitamikhaylov
6ca0776a61 Merge branch 'master' of github.com:ClickHouse/ClickHouse into copier-refactoring 2020-02-19 23:41:35 +03:00
Alexey Milovidov
a739e42740 Better build time 2020-02-19 21:41:22 +03:00
Nikita Mikhaylov
b0a4956824 Merge branch 'copier-refactoring' of github.com:nikitamikhaylov/ClickHouse into clickhouse-copier 2020-02-19 19:59:59 +03:00
Nikita Mikhaylov
caa4810c5c more codestyle 2020-02-19 18:59:47 +03:00
Nikita Mikhaylov
819a4ad6da codestyle 2020-02-19 18:45:49 +03:00
Nikolai Kochetov
76a21b3364 Use processors for sending external tables. 2020-02-19 18:12:21 +03:00
Nikita Mikhaylov
24cbd0d6d1 squashed commits 2020-02-19 18:01:08 +03:00
Alexey Milovidov
add281dfe3 Enable metric_log by default 2020-02-19 16:39:20 +03:00
alexey-milovidov
9037a5d29a
Suggestion from Azat 2020-02-19 11:27:57 +03:00
Nikita Mikhaylov
6527df83a1 copier split 2020-02-18 16:39:22 +03:00
Nikita Mikhaylov
038c9a889d something works 2020-02-18 16:26:08 +03:00
Nikita Mikhaylov
7d24baebb1 Merge branch 'master' of github.com:ClickHouse/ClickHouse into clickhouse-copier 2020-02-18 12:28:27 +03:00
alexey-milovidov
3fcf2d4e78
Merge pull request #9155 from ClickHouse/obfuscator-overgenerate-data
clickhouse-obfuscator: allow to generate more data than was in source
2020-02-17 23:51:57 +03:00
Ivan Lezhankin
102dad0ca0 Merge branch 'master' into arcadia 2020-02-17 17:37:10 +03:00
Ivan Lezhankin
39ea079034 More clean-up 2020-02-17 17:27:09 +03:00
Alexander Tokmakov
d710bd1812 better get... methods 2020-02-17 16:52:59 +03:00
Alexander Tokmakov
964b775c80 Merge branch 'master' into split_databases_from_context 2020-02-17 13:04:36 +03:00
Alexey Milovidov
76153ed8ac clickhouse-obfuscator: allow to generate more data than was in source 2020-02-17 10:52:13 +03:00
Ivan Lezhankin
4cedd4619d Code clean-up 2020-02-16 11:04:03 +03:00
Alexey Milovidov
3772ffdc9d Describe reasons when query profiler cannot work 2020-02-16 09:51:52 +03:00
Alexey Milovidov
63b7d6e5ac Describe reasons when query profiler cannot work 2020-02-16 09:49:24 +03:00
alexey-milovidov
e9af153819
Merge pull request #9126 from Melancholic/change_http_status
Fixed #5104. Return 503 status in /replicas_status if not ok
2020-02-15 02:59:18 +03:00
nagorny
15d3176d40 Ticket #5104. Return 503 status from /replicas_status if not ok 2020-02-14 17:20:27 +03:00
Alexander Tokmakov
c479bbe9f9 make Context::getLock() private 2020-02-14 00:00:03 +03:00
Nikita Mikhaylov
5795dfa00c remove anonymous namespaces 2020-02-13 17:23:41 +03:00
Nikita Mikhaylov
5f1fd17b7c ShardPartitionPiece path getters 2020-02-13 13:52:46 +03:00
Alexander Tokmakov
1d6afe9f39 Merge branch 'master' into split_databases_from_context 2020-02-12 21:18:32 +03:00
Alexander Tokmakov
b6039f8c50 remove tryGetExternalTable 2020-02-12 21:14:12 +03:00
Nikita Mikhaylov
b97aa2074d piece observing + config 2020-02-12 19:15:34 +03:00
Nikita Mikhaylov
22789a3b55 ShardPartitionPiece task added 2020-02-11 21:34:48 +03:00
Nikita Mikhaylov
b481682a1e just comments 2020-02-11 14:19:19 +03:00
Anatoly Pugachev
138d3800cf
Update config.xml
correct HTTP 404 link
2020-02-11 13:33:38 +03:00
Alexander Tokmakov
869e20d207 move databases from Context to DatabaseCatalog 2020-02-10 17:49:44 +03:00
Alexander Tokmakov
4ff7bf78ab add DatabaseCatalog 2020-02-10 17:32:59 +03:00
Nikita Mikhaylov
1c41d73d9b small refactoring + comments adding 2020-02-10 12:27:57 +03:00
Alexander Kuzmenkov
dae3811e25
Merge pull request #9015 from Slach/master
Track the number of MySQL connections
2020-02-09 17:01:01 +03:00
Ivan
1b55150701
Add row-level filter support to Distributed engine (#8926)
* Add tests
* Implement support for initial user on remote side.
2020-02-07 22:31:09 +03:00
Alexander Tokmakov
16a3bed290 Merge branch 'master' into fix_poco_ssl_timeouts 2020-02-07 16:36:45 +03:00
Slach
1bff5578b6 Merge branch 'master' of github.com:ClickHouse/ClickHouse 2020-02-07 08:03:45 +05:00
Alexander Tokmakov
acef7fc5bd add test 2020-02-06 20:23:05 +03:00
Vitaly Baranov
c9f2713cc4 Remove getting user by name from Context. 2020-02-06 18:12:53 +03:00
Slach
23b787c0d6 actualize description of system.metrics.TCPConnection
add system.metrics.MySQLConnection

Signed-off-by: Slach <bloodjazman@gmail.com>
2020-02-05 19:06:46 +05:00
alexey-milovidov
3a1e3f612e
Merge branch 'master' into idisk-seekable-readbuffer 2020-02-02 03:54:50 +03:00
alesapin
abe9ce8774
Merge pull request #8884 from azat/client-suggest-merge_tree_settings
Add system.merge_tree_settings into clickhouse-client suggest
2020-01-29 11:26:24 +03:00
Azat Khuzhin
3aeea41369 Add system.merge_tree_settings into clickhouse-client suggest 2020-01-28 22:25:43 +03:00
Pavel Kovalenko
07755ec8f7 Merge branch 'master' into idisk-seekable-readbuffer
# Conflicts:
#	dbms/programs/server/config.xml
2020-01-27 21:45:53 +03:00
Pavel Kovalenko
abfacdaadc SeekableReadBuffer refactoring.
Store size and multiple references for S3 metadata file.
Log engine support for S3.
2020-01-27 21:44:30 +03:00
Alexey Milovidov
87ee9ac099 Fixed ugly error in Client 2020-01-26 21:43:44 +03:00
alexey-milovidov
97a75dd8c9
Merge pull request #8786 from millb/X-ClickHouse-Exception-Code
X-ClickHouse-Exception-Code in HTTP Header
2020-01-26 03:43:38 +03:00
Alexey Milovidov
667e9ed6d4 Added example to config.xml and fixed formatting after previous committers #8794 2020-01-25 21:47:02 +03:00
Azat Khuzhin
6a73cf2381 Add text_log.level to limit entries that goes to system.text_log table
v2: use INT_MAX as default (since 0 is none)
2020-01-25 14:04:49 +03:00
Azat Khuzhin
c0ba5ed06b Update link to the poco logging levels 2020-01-24 21:13:28 +03:00
Nikolai Kochetov
b55ae23bb9
Merge pull request #8797 from ClickHouse/fix-null-format-for-processors-2
Skip blocks for Null format with processors.
2020-01-24 10:34:13 +03:00
alexey-milovidov
528d231a6b
Merge pull request #8750 from azat/temporary_data_configuration
Multiple paths (disks/volumes) for storing temporary data support
2020-01-24 06:21:52 +03:00
alexey-milovidov
c698132cca
Merge pull request #8769 from traceon/format-name-http-header
Set X-ClickHouse-Format HTTP response header to the format name
2020-01-23 22:23:26 +03:00
Azat Khuzhin
88bfb788a9 Add ability to use multiple disks/volumes for temporary data
This patch adds <tmp_policy> config directive, that will define the
policy to use for storing temporary files, if it is not set (default)
the <tmp_path> will be used.

Also tmp_policy has some limitations:
- move_factor              is ignored
- keep_free_space_bytes    is ignored
- max_data_part_size_bytes is ignored
- must have exactly one volume
2020-01-23 20:31:01 +03:00
Mikhail Korotov
c05652067e
Update HTTPHandler.cpp 2020-01-23 16:40:16 +03:00
Ivan Lezhankin
bfdab88efb Restore \G suffix support 2020-01-23 14:18:47 +03:00
Nikolai Kochetov
f431b10e38 Update TCPHandler. 2020-01-23 13:04:18 +03:00
Ivan
b80e3dcd46
Refactoring of replxx (#8748) 2020-01-23 11:18:19 +03:00
Denis Glazachev
b6fe187e59 Fix test/check failures 2020-01-22 22:52:04 +05:30
millb
7c6312fcb2 first attempt 2020-01-22 19:32:18 +03:00
Pavel Kovalenko
dce424fe11 SeekableReadBuffer initial implementation. IDisk readFile should return SeekableBuffer. 2020-01-22 19:17:25 +03:00
Denis Glazachev
d414131c3c Update callback type and name 2020-01-22 05:03:57 +05:30
Yuriy
f916e7d079 enabled MySQL wire protocol by default on port 9004 2020-01-22 01:38:20 +03:00
alexey-milovidov
2d599cb1cb
Update HTTPHandler.cpp 2020-01-21 23:28:35 +03:00
alexey-milovidov
5e7f80c664
Merge pull request #8760 from kreuzerkrieg/GCCSuggestOverride
Add GCC warning to suggest virtual function override
2020-01-21 22:12:26 +03:00
Denis Glazachev
79085bf629 Set X-ClickHouse-Format HTTP response header to the format name 2020-01-22 00:33:33 +05:30
kreuzerkrieg
4225ca4eec Add GCC warning to suggest virtual function override 2020-01-21 17:34:55 +02:00
kreuzerkrieg
a256741cf9 Add GCC warning to suggest virtual function override 2020-01-21 13:10:32 +02:00
Nikolai Kochetov
c28e224e24
Merge pull request #8735 from ClickHouse/processors-5.12
Processors 5.12
2020-01-21 11:51:07 +03:00
alexey-milovidov
c2e95c008e
Merge pull request #8724 from yurriy/less-mysql-logging
Proper logging levels in MySQL compatibility server
2020-01-19 16:19:30 +03:00
Alexey Milovidov
98d393c957 Fixed LineReader 2020-01-19 15:26:49 +03:00
Yuriy
6f4431b79f proper logging levels 2020-01-19 01:19:06 +00:00
Alexey Milovidov
db1bb630e0 Fixed configuration of replxx 2020-01-19 03:23:35 +03:00
Alexey Milovidov
47f6156ad8 Correct configuration of replxx 2020-01-19 03:01:49 +03:00
alexey-milovidov
2ba89d169e
Merge branch 'master' into readline-to-replxx-docs-and-corrections 2020-01-18 20:58:24 +03:00
alexey-milovidov
52e8252653
Merge pull request #8650 from ClickHouse/remove_istorage_weak_ptr
Get rid of StorageWeakPtr
2020-01-18 20:28:53 +03:00
alexey-milovidov
86a062110d
Merge pull request #8704 from kreuzerkrieg/MoreGCCWarnings
Enable -Wmissing-include-dirs for GCC
2020-01-18 20:12:56 +03:00
Alexey Milovidov
c0a5c664a9 Replace readline to replxx: docs and corrections 2020-01-18 18:44:08 +03:00
Alexey Milovidov
f7efa5e2c7 Merge branch 'replxx' of https://github.com/abyss7/ClickHouse into abyss7-replxx 2020-01-18 17:00:59 +03:00
alexey-milovidov
3e680b59ee
Merge pull request #8709 from ClickHouse/client-clusters-in-suggest
Added cluster names to suggestions in interactive mode in clickhouse-client
2020-01-18 14:36:43 +03:00
kreuzerkrieg
0bf3ea4247 Enable -Wmissing-include-dirs for GCC 2020-01-18 10:46:27 +02:00
Alexey Milovidov
9b5121d92e Do not interpolate quantiles in clickhouse-benchmark 2020-01-18 05:28:07 +03:00
Alexey Milovidov
d270fb69b5 Added cluster names to suggestions in interactive mode in clickhouse-client 2020-01-18 03:32:16 +03:00
Alexander Kuzmenkov
8de0f4fc34 Avoid stale log files.
When the logging configuration changes, the logging-related data
structures on the server are not properly updated. This leads to a bug
where logs are written to old files, and it is impossible to fix without
restarting the server. The log file grows indefinitely and eventually
makes the server run out of disk space (see #8696). To avoid
catastrophic consequences, require that the server is restarted to apply
logging configuration changes, until the proper fix is developed.
2020-01-17 22:27:41 +03:00
Nikolai Kochetov
7803e518c6 Remove query pipeline later. 2020-01-16 19:20:22 +03:00
Alexander Tokmakov
ff1b7e1386 get rid of StorageWeakPtr 2020-01-14 19:54:25 +03:00
Alexander Tokmakov
9389c83d4d Merge branch 'master' into table_name_in_istorage 2020-01-13 14:41:42 +03:00
alexey-milovidov
303b146a93
Merge branch 'master' into vfs_log 2020-01-12 20:16:30 +03:00