Commit Graph

764 Commits

Author SHA1 Message Date
alexey-milovidov
39c6fbc324
Merge pull request #5567 from vitlibar/really-lazy-dictionary-load
Non-blocking loading of external dictionaries
2019-06-15 22:15:53 +03:00
Alexey Milovidov
0f9599bf22 Removed bad code; added support for --param_name value 2019-06-15 21:56:32 +03:00
Alexey Milovidov
61bf0e9b12 Style 2019-06-15 21:25:27 +03:00
Alexey Milovidov
b079631f61 Fixed tests 2019-06-15 21:22:48 +03:00
Alexey Milovidov
fad6013270 Fixing query parameters 2019-06-15 20:52:53 +03:00
Alexey Milovidov
b2100c7bcf Removed strange quoting style like `this'. See https://english.stackexchange.com/questions/17695/any-reference-on-the-usage-of-a-backtick-and-single-quotation-mark-like-this
Added backQuote and backQuoteIfNeed when required to correctly quote identifiers with proper escaping.
2019-06-15 15:06:22 +03:00
Vitaly Baranov
b4384ce2a9 Dictionaries can be loaded in parallel.
A bad dictionary cannot block all the loading anymore.
Implemented really lazy loading of external dictionaries.
Provided more detailed information about the loading of each dictionary
to make diagnostics easier.
2019-06-14 22:18:47 +03:00
Alexey Milovidov
da04db2a93 Fixes for #5331 2019-06-14 21:56:28 +03:00
Alexey Milovidov
f535a2f55f Fixes for #5331 2019-06-14 21:32:22 +03:00
Alexey Milovidov
c5c2bd4a3f Merge branch 'prepared_statements' of https://github.com/sanych73/ClickHouse into sanych73-prepared_statements 2019-06-14 19:28:25 +03:00
proller
7e7b5b3810 Allow run query with remote() in clickhouse-local; Aloow redefine config from command line for clickhouse-local 2019-06-14 18:35:45 +03:00
proller
09f3d68f6e Use logging in clickhouse-local. Use config options in command line in clickhouse-client (#5540)
* Try fix macos server run

* Doc macos build
 # Please enter the commit message for your changes. Lines starting

* CLICKHOUSE-3957 start wip

* tests wip

* wip

* wip

* wip

* wip

* wip

* wip

* wip

* fix

* fix

* Making logger for clickhouse-local

* fixes

* wip

* wip

* wip

* wip

* clean

*      cf

* wip

* fix

* Update CMakeLists.txt

* Update argsToConfig.h

* Update argsToConfig.cpp

* Update ExtendedLogChannel.h

* Update OwnPatternFormatter.cpp
2019-06-14 17:00:37 +03:00
Alexander Tretiakov
905856f02d merge 2019-06-05 17:02:13 +03:00
Orivej Desh
5ec179377a DEVTOOLS-5170 Delete Y_IGNORE markers (#5533)
They have been superseded by a new include resolution configuration that lives
outside clickhouse source tree.
2019-06-05 14:52:39 +03:00
Alexander Tretiakov
f3ef4666e7 fix 2019-06-04 23:15:44 +03:00
Alexander Tretiakov
2f1a03dac0 merge 2019-06-04 21:08:08 +03:00
Anton Yuzhaninov
091b591681 Fix build without Brotli (#5513) (#5521) 2019-06-03 23:27:53 +03:00
proller
8b101d0556 CLICKHOUSE-4493 Ask client password on tty (#5092)
* CLICKHOUSE-4493 Ask client password on tty

* wip

* clang-format

* O_NOCTTY

* remove O_NOCTTY

* fix

* static

* readpassphrase

* freebsd fix

* fix

* Better

* fix style

* Update ConnectionParameters.cpp

* fixes

* fix

* fix
2019-06-03 03:57:33 +03:00
Konstantin Podshumok
d17deb6003 timeouts in performance tests 2019-06-02 12:43:57 +03:00
Konstantin Podshumok
88a3c2998c set timeouts in benchmark 2019-06-02 12:43:20 +03:00
Konstantin Podshumok
d688203029 set timeouts in copier 2019-06-02 12:43:20 +03:00
Konstantin Podshumok
ab1913186e fix timeouts in Suggest.h 2019-06-02 12:43:20 +03:00
Konstantin Podshumok
5cf4a4fd80 client: update timeouts usage 2019-06-02 12:43:20 +03:00
Nikita Lapkov
8f36af7760 Merge remote-tracking branch 'upstream/master' into query-poor-mans-profiler 2019-05-30 10:33:33 +00:00
Alexey Milovidov
05737678e2 Remove debug logging from MySQL protocol 2019-05-30 11:25:16 +03:00
alexey-milovidov
cd99406b63
Merge pull request #5455 from yandex/fixing-external-data-settings
Fix settings in ExternalData HTTP request
2019-05-29 03:23:56 +03:00
alexey-milovidov
8b050b0061
Update HTTPHandler.cpp 2019-05-29 03:23:47 +03:00
Danila Kutenin
98d28706f4 Fix settings in ExternalData HTTP request 2019-05-29 00:31:19 +03:00
Vitaly Baranov
908f7a80d6 Add precondition to run performance test with simdjson only on CPU
with AVX2 instructions.
2019-05-28 17:47:35 +03:00
Vitaly Baranov
a35d1e0b3d Allow using MariaDB as a client without exception. 2019-05-28 03:15:05 +03:00
Vitaly Baranov
c07bd87716 Print "ClickHouse" when writing server's info at the start of the client session. 2019-05-28 03:09:19 +03:00
Vitaly Baranov
7af34954f9 Clearer message if the client doesn't have plugin sha256_password. 2019-05-28 03:08:12 +03:00
proller
324317ff6f clickhouse-client: allow to run with unaccessable history file (read only, no disk space, file is directory, ...) 2019-05-27 21:56:50 +03:00
alexey-milovidov
ead911efc2
Merge pull request #5419 from yurriy/mysql
Improvements of MySQL Wire Protocol
2019-05-27 04:59:23 +03:00
Yuriy
96c2bb383f using logging level from config.xml 2019-05-26 22:30:23 +03:00
Sergi Vladykin
2be4721771 Merge branch 'master' of https://github.com/yandex/ClickHouse into bitmap1 2019-05-26 12:27:54 +03:00
Yuriy
96e3574a06 Improvements of MySQL Wire Protocol 2019-05-26 09:52:29 +03:00
Alexander Tretiakov
461fb1eaa8 fix test 2019-05-26 01:51:21 +03:00
Alexander Tretiakov
212731b3e2 merge 2019-05-26 01:45:15 +03:00
alexey-milovidov
461c4919d3
Merge pull request #5116 from PerformanceVision/send_header
Send a X-ClickHouse summary on the header for HTTP client with number of rows inserted
2019-05-25 20:20:35 +03:00
Nikita Lapkov
06d370dee2 Merge remote-tracking branch 'upstream/master' into query-poor-mans-profiler 2019-05-25 16:23:08 +00:00
Alexey Milovidov
b94f2be154 Merge branch 'mysql' of https://github.com/yurriy/ClickHouse into yurriy-mysql 2019-05-25 17:14:57 +03:00
Alexander Tretiakov
946fa5b47e fix style and add tests 2019-05-25 16:43:52 +03:00
alexey-milovidov
4825ec4928
Merge pull request #5216 from proller/fix15
CLICKHOUSE-4509 Fix error codes in DataPartsExchange
2019-05-25 16:13:26 +03:00
Nikita Lapkov
30c31bc85a Merge remote-tracking branch 'upstream/master' into query-poor-mans-profiler 2019-05-24 13:28:42 +00:00
alesapin
37313d64ee
Merge pull request #5367 from yandex/apply-substitutions-for-create-prepare-drop-query
[WIP] Add ability to make substitutions in create, fill and drop query in performance tests.
2019-05-24 11:59:01 +03:00
proller
3bb18d1dc2 Merge remote-tracking branch 'upstream/master' into fix15 2019-05-23 21:38:38 +03:00
Alexander Tretiakov
9099f1810b merge 2019-05-22 17:41:35 +03:00
stavrolia
dcd5a80843 Remove not used methods 2019-05-22 17:00:32 +03:00
stavrolia
c398db29d4 Fix style 2019-05-22 14:36:31 +03:00
proller
d6a90b6079
Build fixes (#5368) 2019-05-22 13:16:16 +03:00
Nikita Lapkov
382beefdb8 Merge remote-tracking branch 'upstream/master' into query-poor-mans-profiler 2019-05-21 22:52:57 +00:00
stavrolia
281a01f5f7 Add ability to make substitutions in create, fill and drop query. 2019-05-21 15:57:19 +03:00
proller
50b74deeb4 CLICKHOUSE-4509 Fix error codes in DataPartsExchange 2019-05-20 20:04:36 +03:00
Guillaume Tassery
6fada68fe5 forget client.cpp 2019-05-20 20:24:53 +07:00
Guillaume Tassery
77b7158cd8 Progress rename for total_rows and write_[rows|bytes] 2019-05-20 18:37:41 +07:00
Alexander Tretiakov
f6812bbb1a fix style 2019-05-19 02:57:26 +03:00
Alexander Tretiakov
c661f5c0a1 new 2019-05-19 00:07:23 +03:00
alexey-milovidov
dc5232d40d
Update Server.cpp 2019-05-18 13:17:26 +03:00
Yuriy
4a14eac00b fixed memory leak and changed logging levels 2019-05-17 16:00:09 +03:00
Yuriy
0cd3094240 fixed stack buffer overflow 2019-05-16 20:15:43 +03:00
Yuriy
a51c293ec6 merged 'origin/master' into mysql 2019-05-16 14:19:05 +03:00
stavrolia
ff4d989918 Fixed help instruction of usage 2019-05-16 13:52:41 +03:00
Yuriy
4ee84810b0 including information about query execution in response 2019-05-16 08:36:08 +03:00
Yuriy
459ec05828 fixed style 2019-05-16 06:45:17 +03:00
Yuriy
ff4937859e added MySQL wire protocol presentational format 2019-05-16 06:34:04 +03:00
proller
0da7463a6b
CLICKHOUSE-4519 Support dictionaries in clickhouse-copier (#5270) 2019-05-15 12:16:09 +03:00
proller
8814e0cda5
server: informative listen error messages (#5268) 2019-05-14 22:55:10 +03:00
Nikolai Kochetov
808d0f3b08 Merged with master. 2019-05-14 13:31:19 +03:00
proller
cc3de4115f
Build fixes (#5261) 2019-05-14 12:58:33 +03:00
Nikolai Kochetov
4453327344 Delete pipeline when query is finished. 2019-05-13 20:02:54 +03:00
alesapin
5aec6dd011 Fix banch of flapping perf tests. Improve average speed calculation 2019-05-13 17:09:11 +03:00
Nikolai Kochetov
73948ab747 Fix data race in PipelineExecutor. 2019-05-13 14:23:55 +03:00
Nikita Lapkov
6dbe205b55 Merge remote-tracking branch 'upstream/master' into query-poor-mans-profiler 2019-05-12 16:16:30 +00:00
svladykin
22389d4eca Support for bitmapHasAny and bitmapHasAll functions. 2019-05-12 17:47:31 +03:00
Alexey Milovidov
3a01720f5c Obfuscator: derive seed for individual columns by their name, not position 2019-05-03 01:09:38 +03:00
Alexey Milovidov
1be21e3cb6 Removed bad and useless code in ColumnsDescription 2019-05-02 00:43:05 +03:00
Nikolai Kochetov
e7d36c8b66 Fix rase in TCPHandler. 2019-04-30 19:12:58 +03:00
Nikolai Kochetov
1c0cf652ef Attach to current thread in threadpool. 2019-04-29 18:01:53 +03:00
Nikolai Kochetov
aacc0572e5 Attach to current thread in threadpool. 2019-04-29 16:57:29 +03:00
Yuriy
8a3e75d92f fixed style 2019-04-29 09:37:39 +03:00
Yuriy
d21cf9d85f ssl support 2019-04-29 09:05:30 +03:00
Vitaly Baranov
738a49f534 Use iterators instead of macros APPLY_FOR_SETTINGS and others. 2019-04-27 01:09:16 +03:00
Vitaly Baranov
8277e9d8f1 Refactoring of Settings based on new template class SettingsCollection.
Add new class SettingsConstraints.
2019-04-26 19:11:05 +03:00
proller
97c532c0f0
Build fixes (#5114)
Need to push builder docker image
2019-04-26 02:21:59 +03:00
proller
c6d0e095e0
Prepare cmake for new contrib/poco (#5062) 2019-04-25 00:33:04 +03:00
Alexey Milovidov
352d1a8dcf Fixed inconsistent indentation 2019-04-24 22:38:11 +03:00
Alexey Milovidov
33252941f9 Added a comment 2019-04-24 21:40:45 +03:00
Alexey Milovidov
2428ba70f5 Added option "always_load_suggestion_data" to clickhouse-client #5066 2019-04-24 19:47:04 +03:00
Alexey Milovidov
3741449017 Added option "always_load_suggestion_data" to clickhouse-client #5066 2019-04-24 19:45:21 +03:00
proller
ba4687e110
Cmake: dont use LINK_MODE (but use BUILD_SHARED_LIBS) (#5091) 2019-04-24 12:06:28 +03:00
Yuriy
a4bf3621e3 merged with master 2019-04-23 21:58:29 +03:00
proller
fe71142827 Fix segfault in performance-test when no options specified 2019-04-23 17:02:26 +03:00
proller
29c3433322
Freebsd build fixes (#5083) 2019-04-23 15:51:27 +03:00
Alexey Milovidov
58d7d1e451 Resolved some of PVS-Studio warnings 2019-04-22 19:07:09 +03:00
Yuriy
e4766a4ef9 caching_sha2_password authentication plugin 2019-04-22 13:57:50 +03:00
Nikolai Kochetov
a07b592a95 Undo add thread_group to ThreadPool 2019-04-18 21:40:55 +03:00
alesapin
214bf77b17
Merge pull request #5012 from nvartolomei/nv/lb-first-or-random
Add FIRST_OR_RANDOM Load Balancing policy
2019-04-18 18:54:04 +03:00
Nikolai Kochetov
8718b7bb40 Added thread_group argument to ThreadPool. 2019-04-18 17:55:43 +03:00
proller
525726a5e2
Remove pocoext (#5036) 2019-04-17 20:36:58 +03:00
Nicolae Vartolomei
c2ec23c953
Add FIRST_OR_RANDOM Load Balancing policy
For cross-replication topology setups load_balancing=in_order works best
as nodes handle equal amount of load and usually they hit only 1/n of
data (n = number of replicas), which makes page cache usage more
efficient.

The problem is when one node of the shard goes down. If one replica goes
down, the next one in config will handle twice the usual load while
remaining ones will handle usual traffic.

Closes #4820.
2019-04-15 23:31:40 +01:00
filimonov
909521447f
add clickhouse-benchmark accepted stages names 2019-04-15 12:22:05 +02:00
Mikhail Fandyushin
68106d92ea bringing query id header to consistency 2019-04-10 23:13:41 +03:00
Mikhail Fandyushin
7fc9b8c6fb Merge branch 'master' into brotli 2019-04-08 21:07:58 +03:00
Nikolai Kochetov
54b15385bd Calculate rows_before_limit_at_least. 2019-04-08 17:55:20 +03:00
Yuriy
2789a83c03 fixed compilation with clang 2019-04-08 10:03:04 +03:00
Nikita Lapkov
fbdf2c3525 Merge remote-tracking branch 'upstream/master' into query-poor-mans-profiler 2019-04-06 06:58:40 +00:00
proller
eaffca28dd Copier: auto upload task configuration from --task-file option (#4876)
* Copier: auto upload task configuration from --task-file option

* task-upload-force

* doc

* Update ClusterCopier.cpp

* Requested changes
2019-04-05 19:10:52 +03:00
Nikolai Kochetov
7626b1b267 Multiple fixes. 2019-04-05 13:52:07 +03:00
proller
bebb4cd140 Merge remote-tracking branch 'upstream/master' into fix15 2019-04-04 14:50:14 +03:00
proller
236f2a4354
clickhouse-copier - fix another segfault (#4900) 2019-04-04 12:22:54 +03:00
proller
5b1bde2e80 CLICKHOUSE-4387 Add (official build) to version of yandex builds 2019-04-03 17:06:59 +03:00
Nikolai Kochetov
5e39ec610c Merged with master 2019-04-03 14:21:38 +03:00
Nikolai Kochetov
94ff7f694a QueryPipeline [in progress]. 2019-04-03 13:14:36 +03:00
Yuriy
3ea33600a0 fixed style check 2019-04-03 01:56:49 +03:00
Yuriy
0f3ec94ebd added mysql protocol test 2019-04-03 01:45:06 +03:00
alesapin
1d031e9695 Fix readme 2019-04-01 19:36:46 +03:00
alesapin
5585eebe01 Fix level parsing 2019-04-01 19:34:27 +03:00
alesapin
966bee4d93 Parse compression codecs from AST 2019-04-01 19:28:20 +03:00
proller
edaec2353c
CLICKHOUSE-4421 Fix segfault in copier (#4835)
* Fix segfault in copier

* add test

* better runner
2019-04-01 17:58:04 +03:00
Yuriy
e91fd22b82 fixed style check 2019-04-01 12:59:49 +03:00
Yuriy
107f33e888 added password check and changed packets serialization 2019-04-01 12:27:39 +03:00
Vitaly Baranov
37b904b8f5
Merge pull request #4808 from vitlibar/kafka-with-protobuf-format
Kafka with protobuf format
2019-03-30 19:00:57 +03:00
Ivan
957d23267b
Minimal implementation of row-level security CLICKHOUSE-4315 (#4792)
For detailed description see the related PR
2019-03-29 23:31:06 +03:00
Vitaly Baranov
08f85804d0 Send query settings before data from client to server.
Apply query settings only for the containing query (client).
2019-03-29 17:39:00 +03:00
Alexey Milovidov
f4b819c692 Added TRUNCATE to the list of suggested keywords in clickhouse-client 2019-03-28 20:52:50 +03:00
proller
7bcf8ec344 Fix install in shared mode 2019-03-27 20:37:38 +03:00
Alexey Milovidov
9bc4632f20 Avoid progress bar flicker 2019-03-26 17:36:56 +03:00
Nikita Lapkov
4a4ff8d5bf Merge remote-tracking branch 'upstream/master' into query-poor-mans-profiler 2019-03-23 18:45:22 +00:00
alexey-milovidov
b1279c1323
Merge pull request #4743 from azat-archive/clickhouse-client-tty
clickhouse-client: fix --help without tty
2019-03-23 05:54:05 +03:00
Azat Khuzhin
6d8706e692
clickhouse-client: fix --help without tty
stdin_is_not_tty is detected too late when the --help message is
printed, so fix this and do not call ioctl if stdin is not tty.

Before this patch:
  $ clickhouse-client --help < /dev/null

debug build:
  $ dbms/programs/clickhouse-client --help < /dev/null
  Main options:
    --help
  clickhouse-client: ../contrib/boost/libs/program_options/src/options_description.cpp:542:
  void boost::program_options::{anonymous}::format_description(std::ostream&, const string&, unsigned int, unsigned int): Assertion `line_length > first_column_width' failed.
  Aborted (core dumped)

release build:
  $ dbms/programs/clickhouse-client --help < /dev/null
  .... print lots of empty lines and so forth ...

v2: add a test and bsdutils into image for tests
v3: adjust minimal cols to the length of one of the longest arguments,
since with line_length=3 boost will bail anyway (under script(1)
ioctl(TIOCGWINSZ) returnes ws_col=0)
2019-03-23 02:01:32 +03:00
proller
e9af289b4d
Fix link in split mode (#4773) 2019-03-22 22:09:13 +03:00
proller
fce9db12b9 Move Interpreters/Settings* -> Core/Settings* 2019-03-22 15:08:30 +03:00
Mikhail Fandyushin
e986d0eae6 HTTP Accept-Encoding: br; Final fixes 2019-03-21 00:04:35 +03:00
Mikhail Fandyushin
73a9644da2 HTTP Accept-Encoding: br; Expended ZlibCompressionMethod to generic CompressionMethod; Added brotli to CompressionMethod enum 2019-03-21 00:04:35 +03:00
proller
f697df2079
Tests: fix call .sh from .sh (#4732) 2019-03-20 23:04:49 +03:00
Alexey Milovidov
2f7ce49a9c Merge branch 'master' of github.com:yandex/ClickHouse 2019-03-20 00:35:26 +03:00
Alexey Milovidov
6732e4366c Commented out readonly user 2019-03-20 00:34:44 +03:00
proller
78e0b1af5e
Fix compression level detection when network_compression_method in lowercase (#4706) 2019-03-18 17:59:07 +03:00
Yuriy
bfd53e3ccc draft 2019-03-17 10:11:22 +03:00
Alexey Zatelepin
304c67da99 Merge branch 'master' into fix-add-materialized-column-after
Conflicts:
	dbms/src/Interpreters/InterpreterCreateQuery.cpp
	dbms/src/Interpreters/InterpreterDescribeQuery.cpp
	dbms/src/Interpreters/interpretSubquery.cpp
	dbms/src/Storages/ColumnsDescription.cpp
2019-03-17 00:46:53 +03:00
Ivan
8ac3e89628
Merge pull request #4649 from abyss7/iast-as
Implement and use method IAST::as<Derived>()
2019-03-15 23:22:46 +03:00
Alexey Zatelepin
a2debdb724 fix use-after-free [#CLICKHOUSE-3101] 2019-03-15 21:52:45 +03:00
Ivan Lezhankin
61954d855d More reverts 2019-03-15 20:09:14 +03:00
Alexey Zatelepin
b5a0a3fa23 store all kinds of columns in the same list in ColumnsDescription [#CLICKHOUSE-3101] 2019-03-15 19:37:52 +03:00
Ivan Lezhankin
4f6a494af8 Revert references where they were before refactoring. 2019-03-15 19:14:13 +03:00
Ivan Lezhankin
61c24e0844 Overload template method |as<>()| with reference type.
Move promotion logic to a separate class
2019-03-15 16:12:11 +03:00
proller
d243c665d1 libclickhouse.so : dont use debug postfix 2019-03-15 14:38:17 +03:00
Ivan Lezhankin
f64118030a Merge remote-tracking branch 'upstream/master' into iast-as 2019-03-13 17:23:02 +03:00
Alexey Milovidov
1ca16d7882 Fix "bad_alloc" handler clobbering by LLVM library 2019-03-12 22:30:59 +03:00