Commit Graph

864 Commits

Author SHA1 Message Date
Yuriy
96552a4d4e prevent rewriting packet in case of attempt to write more than initially calculated payload length 2019-07-28 03:41:41 +03:00
Yuriy
383fa25c51 resolved conflict 2019-07-28 02:00:15 +03:00
Alexey Milovidov
3eb29c1950 Clarified comment 2019-07-26 03:54:48 +03:00
Alexey Milovidov
2a9d606d4b Use text_log in development environments 2019-07-26 02:01:18 +03:00
Alexey Milovidov
e5df077c21 Added example in config 2019-07-26 02:00:18 +03:00
Alexey Milovidov
5a47b0b990 Sanity and configuration checks 2019-07-26 01:35:47 +03:00
Alexey Milovidov
1d499bcdc0 Allow to update PHDRCache 2019-07-25 22:54:16 +03:00
Alexey Milovidov
d95c6e1bc4 Attempt to solve signal safety of libunwind with solution from Fedor Korotkiy 2019-07-24 18:26:23 +03:00
alexey-milovidov
e4ad0da6e3
Merge pull request #4247 from laplab/query-poor-mans-profiler
Poor man's profiler on query level [Work in progress]
2019-07-23 03:02:58 +03:00
alexey-milovidov
ea9b36e531
Merge pull request #6091 from yurriy/php-client-test
MySQL Native Driver test
2019-07-21 23:29:24 +03:00
Yuriy
28a0481f1a php mysql client test 2019-07-21 15:19:14 +03:00
Yuriy
34a4d6a57a better 2019-07-19 21:46:57 +03:00
Yuriy
39ea5486f5 removed reinterpret_cast 2019-07-19 21:29:39 +03:00
Yuriy
475179cec7 added size limit for packets which are read without memory tracker (all packets except for COM_QUERY) 2019-07-19 20:55:07 +03:00
chertus
e15f6e9752 Merge branch 'master' into ast 2019-07-19 18:01:09 +03:00
Yuriy
1913ae9cee fixed asan check 2019-07-18 08:00:35 +03:00
chertus
fbc0c87c18 enable input_format_defaults_for_omitted_fields & disable (not working) defaults for table functions 2019-07-17 21:30:17 +03:00
alexey-milovidov
ea28254711
Merge pull request #5964 from nikitamikhaylov/logs_bugfix
"send_logs_level" bugfix
2019-07-17 17:42:54 +03:00
Nikita Mikhaylov
04de34a74f changes after review 2019-07-16 19:27:42 +03:00
alesapin
f5b7523429
Merge pull request #5899 from yandex/aku/perftest-mem
Report memory usage in performance tests.
2019-07-16 18:09:44 +03:00
Yuriy
1d6e31be4d merged master 2019-07-16 10:33:25 +03:00
Yuriy
a514de943c replacing not implemented query 2019-07-16 10:11:59 +03:00
Yuriy
4df72f18ce writing packets in parts 2019-07-16 09:39:18 +03:00
Nikita Mikhailov
cc5f87e352 Merge branch 'master' of github.com:yandex/ClickHouse into logs_bugfix 2019-07-15 19:31:54 +03:00
Yuriy
0ed77453d3 reading packets in parts 2019-07-15 01:13:56 +03:00
Yuriy
a6bd5bccff tiny fix 2019-07-14 11:27:58 +03:00
alexey-milovidov
a93c76837e
Merge pull request #5953 from abyss7/fix-filter-table
Implement getDatabaseName() and rename() for all storages
2019-07-13 00:51:39 +03:00
Nikolai Kochetov
e9f3d4d6b8
Merge pull request #4914 from yandex/processors
Processors
2019-07-11 19:22:02 +03:00
Nikita Lapkov
9d540abc84 refactor 2019-07-10 20:47:39 +00:00
Ivan Lezhankin
998aa795fc Merge remote-tracking branch 'upstream/master' into fix-filter-table 2019-07-10 18:14:15 +03:00
NIKITA MIKHAILOV
e05f5388bc clean after cherry-pick 2019-07-10 16:27:16 +03:00
NIKITA MIKHAILOV
865606b83c bugfix client logs + some tests 2019-07-10 16:15:22 +03:00
NIKITA MIKHAILOV
21ad247df3 only for saving this changes 2019-07-10 16:05:22 +03:00
Nikita Mikhaylov
55e9e21cc5 better includes 2019-07-10 16:05:12 +03:00
Nikita Mikhaylov
6ff9dfce34 first try 2019-07-10 16:04:01 +03:00
Alexey Milovidov
7643b1c7f9 Attempt to fix "splitted" build 2019-07-10 14:46:37 +03:00
Ivan Lezhankin
befb3ce15b Merge branch 'master' into fix-filter-table 2019-07-10 13:27:26 +03:00
Alexey Milovidov
499d798b34 Remove "clickhouse_compression" library because it is not a library (cyclic dependency via IDataType) 2019-07-10 00:37:43 +03:00
Alexey Milovidov
729ecfa9ab Fixed build without SSL (disable MySQL protocol support) 2019-07-09 19:41:11 +03:00
Ivan Lezhankin
9f01fa7aaa Implement getDatabaseName() and rename() for all storages 2019-07-09 18:40:21 +03:00
Alexey Milovidov
ed5abe83c0 Fixed build without SSL (disable MySQL protocol support) 2019-07-09 17:59:52 +03:00
Alexander Kuzmenkov
8c379fb972 Flush query log instead of waiting for it. 2019-07-09 17:22:42 +03:00
Nikolai Kochetov
0df2a67c19 Increase queue size in LazyOutputFormat in order to prevent potential lock. 2019-07-09 15:46:50 +03:00
Alexander Kuzmenkov
f260296f89 Print logs to stderr. 2019-07-09 12:49:34 +03:00
Alexey Milovidov
02eada5b35 Fixed error in prev. revision 2019-07-08 22:41:11 +03:00
Alexey Milovidov
c1bb550c07 Addition to prev. revision 2019-07-08 19:58:32 +03:00
Alexander Kuzmenkov
78df28f0e9 Cleanup. 2019-07-08 18:35:32 +03:00
Alexander Kuzmenkov
b928d87d8a error: declaration shadows a field of 'DB::PerformanceTest' 2019-07-08 18:08:46 +03:00
Alexander Kuzmenkov
bdbb77a0a1 Read the query log after running all the queries.
The log entries appear ~10s after a query has finished, so waiting
for them after each query takes too long.
2019-07-08 16:23:30 +03:00
Nikolai Kochetov
209793c981 Merged with master. 2019-07-08 16:00:54 +03:00
Nikolai Kochetov
472f32f718 Remove ThreadGroupThreadPoolCallbacks 2019-07-08 15:49:52 +03:00
Nikolai Kochetov
e5103d741c Fix lock in case of query was cancelled. 2019-07-08 15:48:16 +03:00
Alexey Milovidov
36269c4e2a Addition to prev. revision 2019-07-08 06:41:37 +03:00
Alexey Milovidov
f40b70884f Two more fixes for PVS-Studio 2019-07-08 05:14:32 +03:00
Alexey Milovidov
57d8dac95d Two more fixes for PVS-Studio 2019-07-08 05:06:15 +03:00
Alexey Milovidov
c35a832095 Two more fixes for PVS-Studio 2019-07-08 03:56:52 +03:00
Alexey Milovidov
553e6a273e Two more fixes for PVS-Studio 2019-07-08 03:51:43 +03:00
Nikita Lapkov
e935cb08a8 Merge remote-tracking branch 'upstream/master' into query-poor-mans-profiler 2019-07-07 01:06:10 +00:00
alexey-milovidov
a1cfdf2a60
Merge pull request #5855 from abyss7/no-undefined
Use --no-undefined linker option for split build
2019-07-07 01:47:11 +03:00
Alexey Milovidov
338c0d27ca Added "os_thread_priority" setting 2019-07-06 21:02:28 +03:00
Nikita Lapkov
aaea6cbfc9 Merge remote-tracking branch 'upstream/master' into query-poor-mans-profiler 2019-07-05 21:37:31 +00:00
Alexander Kuzmenkov
a43d3a6902 Report memory usage in performance tests. 2019-07-05 19:50:44 +03:00
Nikita Lapkov
b8585a5630 refactor and comments 2019-07-05 13:48:47 +00:00
alexey-milovidov
2469ec1af3
Merge pull request #5857 from CurtizJ/dns-cache
Implement dns cache with asynchronous update.
2019-07-05 15:56:26 +03:00
alexey-milovidov
a5bb0099dd
Merge pull request #5875 from yandex/more-robust-metrics-transmitter
Less locking in MetricsTransmitter
2019-07-05 14:05:08 +03:00
alexey-milovidov
c3c4f4aff0
Merge pull request #5880 from yandex/close-idle-connections
Close idle TCP connections
2019-07-05 14:04:28 +03:00
Nikolai Kochetov
bc1e9df6cc
Merge pull request #5871 from yandex/fix-clickhouse-copier-heap-use-after-free
Fix heap-use-after-free in ClusterCopier
2019-07-05 13:48:06 +03:00
Alexey Milovidov
433467c3df Added log message for idle connections 2019-07-05 02:03:20 +03:00
Alexey Milovidov
5229fa4538 Addition to prev. revision 2019-07-05 01:57:26 +03:00
Alexey Milovidov
6efca57979 Close idle connections #5879 2019-07-05 01:23:45 +03:00
Nikita Lapkov
0f579860f7 Merge remote-tracking branch 'upstream/master' into query-poor-mans-profiler 2019-07-04 22:13:51 +00:00
Alexey Milovidov
4875ee12d9 Less locking in MetricsTransmitter 2019-07-04 22:08:37 +03:00
akuzm
74d17789d0
Destroy the text log queue after the I/O blocks. (#5854)
These blocks contain threads that use the queue, so they must be
destroyed first. This was reported by ThreadSanitizer.
2019-07-04 19:21:24 +03:00
Nikolai Kochetov
72afe9b842 Fix heap-use-after-free in ClusterCopier caused by watch which try to use already removed copier object. 2019-07-04 17:48:40 +03:00
Ivan Lezhankin
3b995bdb02 Add missing dependecies on sight to enable --no-undefined option 2019-07-04 17:05:55 +03:00
CurtizJ
80e96995ae Merge branch 'master' of https://github.com/yandex/ClickHouse into dns-cache 2019-07-03 21:27:43 +03:00
CurtizJ
35ad1a3b6b implement dns cache with asynchronous update 2019-07-03 19:26:22 +03:00
Yuriy
450b20ca89 max_memory_usage support in MySQL wire protocol 2019-07-01 08:58:31 +03:00
Alexey Milovidov
498a2072b5 Fixed bug in query formatting with TEMPORARY tables 2019-06-29 19:58:32 +03:00
Alexey Milovidov
a643f2f75e Merge branch 'master' into sanych73-prepared_statements 2019-06-29 15:51:56 +03:00
proller
8b1651ae1f
arcadia fixes (#5795) 2019-06-29 15:04:47 +03:00
alexey-milovidov
7ce4cd7861
Merge pull request #5745 from nvartolomei/nv/clickhouse-copier-cross-replication
clickhouse-copier: Allow empty database name
2019-06-27 21:09:00 +03:00
proller
aeb7eb42d1 clickhouse-copier: Fix use-after free on shutdown (#5752)
* release script: convert .deb to .rpm and .tgz

* clickhouse-copier: Fix use-after free on shutdown

* Revert "Disable cluster copier tests"

This reverts commit 71872fc3c3.
2019-06-27 15:29:49 +03:00
Nikita Lapkov
7cff36fbfc Merge remote-tracking branch 'upstream/master' into query-poor-mans-profiler 2019-06-26 11:46:04 +00:00
Nicolae Vartolomei
59d66bb1d5 clickhouse-copier: Allow empty database name
This is needed to make clickhouse-copier work with cross-replication
setups (also known as [circular replication][1]).

When database name is not specified we rely on `<default_database>`
element from replica stanza.

Example:

```xml
<source_cluster>
    <shard>
        <replica>
            <host>localhost</host>
            <port>9000</port>
            <default_database>r0</default_database>
        </replica>
        <replica>
            <host>localhost</host>
            <port>666</port>
            <default_database>r1</default_database>
        </replica>
    </shard>
    <shard>
        <replica>
            <host>localhost</host>
            <port>666</port>
            <default_database>r0</default_database>
        </replica>
        <replica>
            <host>localhost</host>
            <port>9000</port>
            <default_database>r1</default_database>
        </replica>
    </shard>
</source_cluster>
```

[1]: https://www.altinity.com/blog/2018/5/10/circular-replication-cluster-topology-in-clickhouse
2019-06-25 22:09:11 +00:00
Nikolai Kochetov
f9b29bfdd2 Merged with master. 2019-06-25 20:00:54 +03:00
Nikolai Kochetov
3bee30a215 Update PipelineExecutor. 2019-06-25 19:41:11 +03:00
Nikolai Kochetov
a43f789338 Fix performance introspection. 2019-06-25 19:41:06 +03:00
proller
1ac09fa721
Split Common/config.h by libs (dbms) (#5715) 2019-06-24 14:17:15 +03:00
stavrolia
84871d9fa8 Remove <name> and <metrics> from performance tests fixed-5634 2019-06-18 19:55:13 +03:00
alesapin
e45d727e9d
Merge pull request #4558 from podshumok/distributred-timeout
Distributed and remote timeouts
2019-06-17 13:58:17 +03:00
Alexey Milovidov
88c35d541d Merge branch 'master' into sanych73-prepared_statements 2019-06-16 23:53:31 +03:00
Alexey Milovidov
224e6c7d72 Merge branch 'master' into sanych73-prepared_statements 2019-06-16 21:18:23 +03:00
Alexey Milovidov
413b780b65 Various fixes for PVS-Studio 2019-06-16 21:13:39 +03:00
Yuriy
2e29ea7b2e support of sessions and default_database in MySQL wire protocol 2019-06-16 18:12:37 +03:00
Alexey Milovidov
eb4f0920b1 Merge branch 'master' into sanych73-prepared_statements 2019-06-16 12:27:19 +03:00
Alexey Milovidov
ba18308080 Merge branch 'master' into levysh-testkeeper 2019-06-16 02:45:34 +03:00
Alexey Milovidov
7514674447 Merge remote-tracking branch 'origin/master' into sanych73-prepared_statements 2019-06-16 02:40:17 +03:00
Alexey Milovidov
f38855fe61 Merge branch 'master' into sanych73-prepared_statements 2019-06-16 02:39:55 +03:00
Alexey Milovidov
777af5544b Removed tons of trash
Removed tons of trash

Removed tons of trash

Removed tons of trash

Removed tons of trash

Removed tons of trash

Removed tons of trash

Removed tons of trash

Removed tons of trash

Removed tons of trash

Removed tons of trash
2019-06-16 02:35:27 +03:00
alexey-milovidov
39c6fbc324
Merge pull request #5567 from vitlibar/really-lazy-dictionary-load
Non-blocking loading of external dictionaries
2019-06-15 22:15:53 +03:00
Alexey Milovidov
0f9599bf22 Removed bad code; added support for --param_name value 2019-06-15 21:56:32 +03:00
Alexey Milovidov
61bf0e9b12 Style 2019-06-15 21:25:27 +03:00
Alexey Milovidov
b079631f61 Fixed tests 2019-06-15 21:22:48 +03:00
Alexey Milovidov
fad6013270 Fixing query parameters 2019-06-15 20:52:53 +03:00
Alexey Milovidov
b2100c7bcf Removed strange quoting style like `this'. See https://english.stackexchange.com/questions/17695/any-reference-on-the-usage-of-a-backtick-and-single-quotation-mark-like-this
Added backQuote and backQuoteIfNeed when required to correctly quote identifiers with proper escaping.
2019-06-15 15:06:22 +03:00
Vitaly Baranov
b4384ce2a9 Dictionaries can be loaded in parallel.
A bad dictionary cannot block all the loading anymore.
Implemented really lazy loading of external dictionaries.
Provided more detailed information about the loading of each dictionary
to make diagnostics easier.
2019-06-14 22:18:47 +03:00
Alexey Milovidov
da04db2a93 Fixes for #5331 2019-06-14 21:56:28 +03:00
Alexey Milovidov
f535a2f55f Fixes for #5331 2019-06-14 21:32:22 +03:00
Alexey Milovidov
c5c2bd4a3f Merge branch 'prepared_statements' of https://github.com/sanych73/ClickHouse into sanych73-prepared_statements 2019-06-14 19:28:25 +03:00
proller
7e7b5b3810 Allow run query with remote() in clickhouse-local; Aloow redefine config from command line for clickhouse-local 2019-06-14 18:35:45 +03:00
proller
09f3d68f6e Use logging in clickhouse-local. Use config options in command line in clickhouse-client (#5540)
* Try fix macos server run

* Doc macos build
 # Please enter the commit message for your changes. Lines starting

* CLICKHOUSE-3957 start wip

* tests wip

* wip

* wip

* wip

* wip

* wip

* wip

* wip

* fix

* fix

* Making logger for clickhouse-local

* fixes

* wip

* wip

* wip

* wip

* clean

*      cf

* wip

* fix

* Update CMakeLists.txt

* Update argsToConfig.h

* Update argsToConfig.cpp

* Update ExtendedLogChannel.h

* Update OwnPatternFormatter.cpp
2019-06-14 17:00:37 +03:00
Alexander Tretiakov
905856f02d merge 2019-06-05 17:02:13 +03:00
Orivej Desh
5ec179377a DEVTOOLS-5170 Delete Y_IGNORE markers (#5533)
They have been superseded by a new include resolution configuration that lives
outside clickhouse source tree.
2019-06-05 14:52:39 +03:00
Alexander Tretiakov
f3ef4666e7 fix 2019-06-04 23:15:44 +03:00
Alexander Tretiakov
2f1a03dac0 merge 2019-06-04 21:08:08 +03:00
Anton Yuzhaninov
091b591681 Fix build without Brotli (#5513) (#5521) 2019-06-03 23:27:53 +03:00
proller
8b101d0556 CLICKHOUSE-4493 Ask client password on tty (#5092)
* CLICKHOUSE-4493 Ask client password on tty

* wip

* clang-format

* O_NOCTTY

* remove O_NOCTTY

* fix

* static

* readpassphrase

* freebsd fix

* fix

* Better

* fix style

* Update ConnectionParameters.cpp

* fixes

* fix

* fix
2019-06-03 03:57:33 +03:00
Konstantin Podshumok
d17deb6003 timeouts in performance tests 2019-06-02 12:43:57 +03:00
Konstantin Podshumok
88a3c2998c set timeouts in benchmark 2019-06-02 12:43:20 +03:00
Konstantin Podshumok
d688203029 set timeouts in copier 2019-06-02 12:43:20 +03:00
Konstantin Podshumok
ab1913186e fix timeouts in Suggest.h 2019-06-02 12:43:20 +03:00
Konstantin Podshumok
5cf4a4fd80 client: update timeouts usage 2019-06-02 12:43:20 +03:00
Nikita Lapkov
8f36af7760 Merge remote-tracking branch 'upstream/master' into query-poor-mans-profiler 2019-05-30 10:33:33 +00:00
Alexey Milovidov
05737678e2 Remove debug logging from MySQL protocol 2019-05-30 11:25:16 +03:00
alexey-milovidov
cd99406b63
Merge pull request #5455 from yandex/fixing-external-data-settings
Fix settings in ExternalData HTTP request
2019-05-29 03:23:56 +03:00
alexey-milovidov
8b050b0061
Update HTTPHandler.cpp 2019-05-29 03:23:47 +03:00
Danila Kutenin
98d28706f4 Fix settings in ExternalData HTTP request 2019-05-29 00:31:19 +03:00
Vitaly Baranov
908f7a80d6 Add precondition to run performance test with simdjson only on CPU
with AVX2 instructions.
2019-05-28 17:47:35 +03:00
Vitaly Baranov
a35d1e0b3d Allow using MariaDB as a client without exception. 2019-05-28 03:15:05 +03:00
Vitaly Baranov
c07bd87716 Print "ClickHouse" when writing server's info at the start of the client session. 2019-05-28 03:09:19 +03:00
Vitaly Baranov
7af34954f9 Clearer message if the client doesn't have plugin sha256_password. 2019-05-28 03:08:12 +03:00
proller
324317ff6f clickhouse-client: allow to run with unaccessable history file (read only, no disk space, file is directory, ...) 2019-05-27 21:56:50 +03:00
alexey-milovidov
ead911efc2
Merge pull request #5419 from yurriy/mysql
Improvements of MySQL Wire Protocol
2019-05-27 04:59:23 +03:00
Yuriy
96c2bb383f using logging level from config.xml 2019-05-26 22:30:23 +03:00
Sergi Vladykin
2be4721771 Merge branch 'master' of https://github.com/yandex/ClickHouse into bitmap1 2019-05-26 12:27:54 +03:00
Yuriy
96e3574a06 Improvements of MySQL Wire Protocol 2019-05-26 09:52:29 +03:00
Alexander Tretiakov
461fb1eaa8 fix test 2019-05-26 01:51:21 +03:00
Alexander Tretiakov
212731b3e2 merge 2019-05-26 01:45:15 +03:00
alexey-milovidov
461c4919d3
Merge pull request #5116 from PerformanceVision/send_header
Send a X-ClickHouse summary on the header for HTTP client with number of rows inserted
2019-05-25 20:20:35 +03:00
Nikita Lapkov
06d370dee2 Merge remote-tracking branch 'upstream/master' into query-poor-mans-profiler 2019-05-25 16:23:08 +00:00
Alexey Milovidov
b94f2be154 Merge branch 'mysql' of https://github.com/yurriy/ClickHouse into yurriy-mysql 2019-05-25 17:14:57 +03:00
Alexander Tretiakov
946fa5b47e fix style and add tests 2019-05-25 16:43:52 +03:00
alexey-milovidov
4825ec4928
Merge pull request #5216 from proller/fix15
CLICKHOUSE-4509 Fix error codes in DataPartsExchange
2019-05-25 16:13:26 +03:00
Nikita Lapkov
30c31bc85a Merge remote-tracking branch 'upstream/master' into query-poor-mans-profiler 2019-05-24 13:28:42 +00:00
alesapin
37313d64ee
Merge pull request #5367 from yandex/apply-substitutions-for-create-prepare-drop-query
[WIP] Add ability to make substitutions in create, fill and drop query in performance tests.
2019-05-24 11:59:01 +03:00
proller
3bb18d1dc2 Merge remote-tracking branch 'upstream/master' into fix15 2019-05-23 21:38:38 +03:00
Alexander Tretiakov
9099f1810b merge 2019-05-22 17:41:35 +03:00
stavrolia
dcd5a80843 Remove not used methods 2019-05-22 17:00:32 +03:00
stavrolia
c398db29d4 Fix style 2019-05-22 14:36:31 +03:00