thevar1able/ClickHouse
1
0
Fork 0
mirror of https://github.com/ClickHouse/ClickHouse.git synced 2024-11-14 19:45:11 +00:00
Code Issues Packages Projects Releases Wiki Activity
27,865 Commits 9,131 Branches 1,774 Tags 2.1 GiB
8cd759565d
Commit Graph

803 Commits

Author SHA1 Message Date
Alexander Kuzmenkov
a43d3a6902 Report memory usage in performance tests. 2019-07-05 19:50:44 +03:00
Nikita Lapkov
b8585a5630 refactor and comments 2019-07-05 13:48:47 +00:00
alexey-milovidov
2469ec1af3
Merge pull request #5857 from CurtizJ/dns-cache 
Implement dns cache with asynchronous update.
 2019-07-05 15:56:26 +03:00
alexey-milovidov
a5bb0099dd
Merge pull request #5875 from yandex/more-robust-metrics-transmitter 
Less locking in MetricsTransmitter
 2019-07-05 14:05:08 +03:00
alexey-milovidov
c3c4f4aff0
Merge pull request #5880 from yandex/close-idle-connections 
Close idle TCP connections
 2019-07-05 14:04:28 +03:00
Nikolai Kochetov
bc1e9df6cc
Merge pull request #5871 from yandex/fix-clickhouse-copier-heap-use-after-free 
Fix heap-use-after-free in ClusterCopier
 2019-07-05 13:48:06 +03:00
Alexey Milovidov
433467c3df Added log message for idle connections 2019-07-05 02:03:20 +03:00
Alexey Milovidov
5229fa4538 Addition to prev. revision 2019-07-05 01:57:26 +03:00
Alexey Milovidov
6efca57979 Close idle connections #5879 2019-07-05 01:23:45 +03:00
Nikita Lapkov
0f579860f7 Merge remote-tracking branch 'upstream/master' into query-poor-mans-profiler 2019-07-04 22:13:51 +00:00
Alexey Milovidov
4875ee12d9 Less locking in MetricsTransmitter 2019-07-04 22:08:37 +03:00
akuzm
74d17789d0
Destroy the text log queue after the I/O blocks. (#5854) 
These blocks contain threads that use the queue, so they must be
destroyed first. This was reported by ThreadSanitizer.
 2019-07-04 19:21:24 +03:00
Nikolai Kochetov
72afe9b842 Fix heap-use-after-free in ClusterCopier caused by watch which try to use already removed copier object. 2019-07-04 17:48:40 +03:00
Ivan Lezhankin
3b995bdb02 Add missing dependecies on sight to enable --no-undefined option 2019-07-04 17:05:55 +03:00
CurtizJ
80e96995ae Merge branch 'master' of https://github.com/yandex/ClickHouse into dns-cache 2019-07-03 21:27:43 +03:00
CurtizJ
35ad1a3b6b implement dns cache with asynchronous update 2019-07-03 19:26:22 +03:00
Yuriy
450b20ca89 max_memory_usage support in MySQL wire protocol 2019-07-01 08:58:31 +03:00
Alexey Milovidov
498a2072b5 Fixed bug in query formatting with TEMPORARY tables 2019-06-29 19:58:32 +03:00
Alexey Milovidov
a643f2f75e Merge branch 'master' into sanych73-prepared_statements 2019-06-29 15:51:56 +03:00
proller
8b1651ae1f
arcadia fixes (#5795) 2019-06-29 15:04:47 +03:00
alexey-milovidov
7ce4cd7861
Merge pull request #5745 from nvartolomei/nv/clickhouse-copier-cross-replication 
clickhouse-copier: Allow empty database name
 2019-06-27 21:09:00 +03:00
proller
aeb7eb42d1 clickhouse-copier: Fix use-after free on shutdown (#5752) 
* release script: convert .deb to .rpm and .tgz

* clickhouse-copier: Fix use-after free on shutdown

* Revert "Disable cluster copier tests"

This reverts commit 71872fc3c3.
 2019-06-27 15:29:49 +03:00
Nikita Lapkov
7cff36fbfc Merge remote-tracking branch 'upstream/master' into query-poor-mans-profiler 2019-06-26 11:46:04 +00:00
Nicolae Vartolomei
59d66bb1d5 clickhouse-copier: Allow empty database name 
This is needed to make clickhouse-copier work with cross-replication
setups (also known as [circular replication][1]).

When database name is not specified we rely on `<default_database>`
element from replica stanza.

Example:

```xml
<source_cluster>
    <shard>
        <replica>
            <host>localhost</host>
            <port>9000</port>
            <default_database>r0</default_database>
        </replica>
        <replica>
            <host>localhost</host>
            <port>666</port>
            <default_database>r1</default_database>
        </replica>
    </shard>
    <shard>
        <replica>
            <host>localhost</host>
            <port>666</port>
            <default_database>r0</default_database>
        </replica>
        <replica>
            <host>localhost</host>
            <port>9000</port>
            <default_database>r1</default_database>
        </replica>
    </shard>
</source_cluster>
```

[1]: https://www.altinity.com/blog/2018/5/10/circular-replication-cluster-topology-in-clickhouse
 2019-06-25 22:09:11 +00:00
Nikolai Kochetov
f9b29bfdd2 Merged with master. 2019-06-25 20:00:54 +03:00
Nikolai Kochetov
3bee30a215 Update PipelineExecutor. 2019-06-25 19:41:11 +03:00
Nikolai Kochetov
a43f789338 Fix performance introspection. 2019-06-25 19:41:06 +03:00
proller
1ac09fa721
Split Common/config.h by libs (dbms) (#5715) 2019-06-24 14:17:15 +03:00
stavrolia
84871d9fa8 Remove <name> and <metrics> from performance tests fixed-5634 2019-06-18 19:55:13 +03:00
alesapin
e45d727e9d
Merge pull request #4558 from podshumok/distributred-timeout 
Distributed and remote timeouts
 2019-06-17 13:58:17 +03:00
Alexey Milovidov
88c35d541d Merge branch 'master' into sanych73-prepared_statements 2019-06-16 23:53:31 +03:00
Alexey Milovidov
224e6c7d72 Merge branch 'master' into sanych73-prepared_statements 2019-06-16 21:18:23 +03:00
Alexey Milovidov
413b780b65 Various fixes for PVS-Studio 2019-06-16 21:13:39 +03:00
Yuriy
2e29ea7b2e support of sessions and default_database in MySQL wire protocol 2019-06-16 18:12:37 +03:00
Alexey Milovidov
eb4f0920b1 Merge branch 'master' into sanych73-prepared_statements 2019-06-16 12:27:19 +03:00
Alexey Milovidov
ba18308080 Merge branch 'master' into levysh-testkeeper 2019-06-16 02:45:34 +03:00
Alexey Milovidov
7514674447 Merge remote-tracking branch 'origin/master' into sanych73-prepared_statements 2019-06-16 02:40:17 +03:00
Alexey Milovidov
f38855fe61 Merge branch 'master' into sanych73-prepared_statements 2019-06-16 02:39:55 +03:00
Alexey Milovidov
777af5544b Removed tons of trash 
Removed tons of trash

Removed tons of trash

Removed tons of trash

Removed tons of trash

Removed tons of trash

Removed tons of trash

Removed tons of trash

Removed tons of trash

Removed tons of trash

Removed tons of trash
 2019-06-16 02:35:27 +03:00
alexey-milovidov
39c6fbc324
Merge pull request #5567 from vitlibar/really-lazy-dictionary-load 
Non-blocking loading of external dictionaries
 2019-06-15 22:15:53 +03:00
Alexey Milovidov
0f9599bf22 Removed bad code; added support for --param_name value 2019-06-15 21:56:32 +03:00
Alexey Milovidov
61bf0e9b12 Style 2019-06-15 21:25:27 +03:00
Alexey Milovidov
b079631f61 Fixed tests 2019-06-15 21:22:48 +03:00
Alexey Milovidov
fad6013270 Fixing query parameters 2019-06-15 20:52:53 +03:00
Alexey Milovidov
b2100c7bcf Removed strange quoting style like `this'. See https://english.stackexchange.com/questions/17695/any-reference-on-the-usage-of-a-backtick-and-single-quotation-mark-like-this 
Added backQuote and backQuoteIfNeed when required to correctly quote identifiers with proper escaping.
 2019-06-15 15:06:22 +03:00
Vitaly Baranov
b4384ce2a9 Dictionaries can be loaded in parallel. 
A bad dictionary cannot block all the loading anymore.
Implemented really lazy loading of external dictionaries.
Provided more detailed information about the loading of each dictionary
to make diagnostics easier.
 2019-06-14 22:18:47 +03:00
Alexey Milovidov
da04db2a93 Fixes for #5331 2019-06-14 21:56:28 +03:00
Alexey Milovidov
f535a2f55f Fixes for #5331 2019-06-14 21:32:22 +03:00
Alexey Milovidov
c5c2bd4a3f Merge branch 'prepared_statements' of https://github.com/sanych73/ClickHouse into sanych73-prepared_statements 2019-06-14 19:28:25 +03:00
proller
7e7b5b3810 Allow run query with remote() in clickhouse-local; Aloow redefine config from command line for clickhouse-local 2019-06-14 18:35:45 +03:00
proller
09f3d68f6e Use logging in clickhouse-local. Use config options in command line in clickhouse-client (#5540) 
* Try fix macos server run

* Doc macos build
 # Please enter the commit message for your changes. Lines starting

* CLICKHOUSE-3957 start wip

* tests wip

* wip

* wip

* wip

* wip

* wip

* wip

* wip

* fix

* fix

* Making logger for clickhouse-local

* fixes

* wip

* wip

* wip

* wip

* clean

*      cf

* wip

* fix

* Update CMakeLists.txt

* Update argsToConfig.h

* Update argsToConfig.cpp

* Update ExtendedLogChannel.h

* Update OwnPatternFormatter.cpp
 2019-06-14 17:00:37 +03:00
Alexander Tretiakov
905856f02d merge 2019-06-05 17:02:13 +03:00
Orivej Desh
5ec179377a DEVTOOLS-5170 Delete Y_IGNORE markers (#5533) 
They have been superseded by a new include resolution configuration that lives
outside clickhouse source tree.
 2019-06-05 14:52:39 +03:00
Alexander Tretiakov
f3ef4666e7 fix 2019-06-04 23:15:44 +03:00
Alexander Tretiakov
2f1a03dac0 merge 2019-06-04 21:08:08 +03:00
Anton Yuzhaninov
091b591681 Fix build without Brotli (#5513) (#5521) 2019-06-03 23:27:53 +03:00
proller
8b101d0556 CLICKHOUSE-4493 Ask client password on tty (#5092) 
* CLICKHOUSE-4493 Ask client password on tty

* wip

* clang-format

* O_NOCTTY

* remove O_NOCTTY

* fix

* static

* readpassphrase

* freebsd fix

* fix

* Better

* fix style

* Update ConnectionParameters.cpp

* fixes

* fix

* fix
 2019-06-03 03:57:33 +03:00
Konstantin Podshumok
d17deb6003 timeouts in performance tests 2019-06-02 12:43:57 +03:00
Konstantin Podshumok
88a3c2998c set timeouts in benchmark 2019-06-02 12:43:20 +03:00
Konstantin Podshumok
d688203029 set timeouts in copier 2019-06-02 12:43:20 +03:00
Konstantin Podshumok
ab1913186e fix timeouts in Suggest.h 2019-06-02 12:43:20 +03:00
Konstantin Podshumok
5cf4a4fd80 client: update timeouts usage 2019-06-02 12:43:20 +03:00
Nikita Lapkov
8f36af7760 Merge remote-tracking branch 'upstream/master' into query-poor-mans-profiler 2019-05-30 10:33:33 +00:00
Alexey Milovidov
05737678e2 Remove debug logging from MySQL protocol 2019-05-30 11:25:16 +03:00
alexey-milovidov
cd99406b63
Merge pull request #5455 from yandex/fixing-external-data-settings 
Fix settings in ExternalData HTTP request
 2019-05-29 03:23:56 +03:00
alexey-milovidov
8b050b0061
Update HTTPHandler.cpp 2019-05-29 03:23:47 +03:00
Danila Kutenin
98d28706f4 Fix settings in ExternalData HTTP request 2019-05-29 00:31:19 +03:00
Vitaly Baranov
908f7a80d6 Add precondition to run performance test with simdjson only on CPU 
with AVX2 instructions.
 2019-05-28 17:47:35 +03:00
Vitaly Baranov
a35d1e0b3d Allow using MariaDB as a client without exception. 2019-05-28 03:15:05 +03:00
Vitaly Baranov
c07bd87716 Print "ClickHouse" when writing server's info at the start of the client session. 2019-05-28 03:09:19 +03:00
Vitaly Baranov
7af34954f9 Clearer message if the client doesn't have plugin sha256_password. 2019-05-28 03:08:12 +03:00
proller
324317ff6f clickhouse-client: allow to run with unaccessable history file (read only, no disk space, file is directory, ...) 2019-05-27 21:56:50 +03:00
alexey-milovidov
ead911efc2
Merge pull request #5419 from yurriy/mysql 
Improvements of MySQL Wire Protocol
 2019-05-27 04:59:23 +03:00
Yuriy
96c2bb383f using logging level from config.xml 2019-05-26 22:30:23 +03:00
Sergi Vladykin
2be4721771 Merge branch 'master' of https://github.com/yandex/ClickHouse into bitmap1 2019-05-26 12:27:54 +03:00
Yuriy
96e3574a06 Improvements of MySQL Wire Protocol 2019-05-26 09:52:29 +03:00
Alexander Tretiakov
461fb1eaa8 fix test 2019-05-26 01:51:21 +03:00
Alexander Tretiakov
212731b3e2 merge 2019-05-26 01:45:15 +03:00
alexey-milovidov
461c4919d3
Merge pull request #5116 from PerformanceVision/send_header 
Send a X-ClickHouse summary on the header for HTTP client with number of rows inserted
 2019-05-25 20:20:35 +03:00
Nikita Lapkov
06d370dee2 Merge remote-tracking branch 'upstream/master' into query-poor-mans-profiler 2019-05-25 16:23:08 +00:00
Alexey Milovidov
b94f2be154 Merge branch 'mysql' of https://github.com/yurriy/ClickHouse into yurriy-mysql 2019-05-25 17:14:57 +03:00
Alexander Tretiakov
946fa5b47e fix style and add tests 2019-05-25 16:43:52 +03:00
alexey-milovidov
4825ec4928
Merge pull request #5216 from proller/fix15 
CLICKHOUSE-4509 Fix error codes in DataPartsExchange
 2019-05-25 16:13:26 +03:00
Nikita Lapkov
30c31bc85a Merge remote-tracking branch 'upstream/master' into query-poor-mans-profiler 2019-05-24 13:28:42 +00:00
alesapin
37313d64ee
Merge pull request #5367 from yandex/apply-substitutions-for-create-prepare-drop-query 
[WIP] Add ability to make substitutions in create, fill and drop query in performance tests.
 2019-05-24 11:59:01 +03:00
proller
3bb18d1dc2 Merge remote-tracking branch 'upstream/master' into fix15 2019-05-23 21:38:38 +03:00
Alexander Tretiakov
9099f1810b merge 2019-05-22 17:41:35 +03:00
stavrolia
dcd5a80843 Remove not used methods 2019-05-22 17:00:32 +03:00
stavrolia
c398db29d4 Fix style 2019-05-22 14:36:31 +03:00
proller
d6a90b6079
Build fixes (#5368) 2019-05-22 13:16:16 +03:00
Nikita Lapkov
382beefdb8 Merge remote-tracking branch 'upstream/master' into query-poor-mans-profiler 2019-05-21 22:52:57 +00:00
stavrolia
281a01f5f7 Add ability to make substitutions in create, fill and drop query. 2019-05-21 15:57:19 +03:00
proller
50b74deeb4 CLICKHOUSE-4509 Fix error codes in DataPartsExchange 2019-05-20 20:04:36 +03:00
Guillaume Tassery
6fada68fe5 forget client.cpp 2019-05-20 20:24:53 +07:00
Guillaume Tassery
77b7158cd8 Progress rename for total_rows and write_[rows|bytes] 2019-05-20 18:37:41 +07:00
Alexander Tretiakov
f6812bbb1a fix style 2019-05-19 02:57:26 +03:00
Alexander Tretiakov
c661f5c0a1 new 2019-05-19 00:07:23 +03:00
alexey-milovidov
dc5232d40d
Update Server.cpp 2019-05-18 13:17:26 +03:00
Yuriy
4a14eac00b fixed memory leak and changed logging levels 2019-05-17 16:00:09 +03:00
Yuriy
0cd3094240 fixed stack buffer overflow 2019-05-16 20:15:43 +03:00
Yuriy
a51c293ec6 merged 'origin/master' into mysql 2019-05-16 14:19:05 +03:00
stavrolia
ff4d989918 Fixed help instruction of usage 2019-05-16 13:52:41 +03:00
Yuriy
4ee84810b0 including information about query execution in response 2019-05-16 08:36:08 +03:00
Yuriy
459ec05828 fixed style 2019-05-16 06:45:17 +03:00
Yuriy
ff4937859e added MySQL wire protocol presentational format 2019-05-16 06:34:04 +03:00
proller
0da7463a6b
CLICKHOUSE-4519 Support dictionaries in clickhouse-copier (#5270) 2019-05-15 12:16:09 +03:00
proller
8814e0cda5
server: informative listen error messages (#5268) 2019-05-14 22:55:10 +03:00
Nikolai Kochetov
808d0f3b08 Merged with master. 2019-05-14 13:31:19 +03:00
proller
cc3de4115f
Build fixes (#5261) 2019-05-14 12:58:33 +03:00
Nikolai Kochetov
4453327344 Delete pipeline when query is finished. 2019-05-13 20:02:54 +03:00
alesapin
5aec6dd011 Fix banch of flapping perf tests. Improve average speed calculation 2019-05-13 17:09:11 +03:00
Nikolai Kochetov
73948ab747 Fix data race in PipelineExecutor. 2019-05-13 14:23:55 +03:00
Nikita Lapkov
6dbe205b55 Merge remote-tracking branch 'upstream/master' into query-poor-mans-profiler 2019-05-12 16:16:30 +00:00
svladykin
22389d4eca Support for bitmapHasAny and bitmapHasAll functions. 2019-05-12 17:47:31 +03:00
Alexey Milovidov
3a01720f5c Obfuscator: derive seed for individual columns by their name, not position 2019-05-03 01:09:38 +03:00
Alexey Milovidov
1be21e3cb6 Removed bad and useless code in ColumnsDescription 2019-05-02 00:43:05 +03:00
Nikolai Kochetov
e7d36c8b66 Fix rase in TCPHandler. 2019-04-30 19:12:58 +03:00
Nikolai Kochetov
1c0cf652ef Attach to current thread in threadpool. 2019-04-29 18:01:53 +03:00
Nikolai Kochetov
aacc0572e5 Attach to current thread in threadpool. 2019-04-29 16:57:29 +03:00
Yuriy
8a3e75d92f fixed style 2019-04-29 09:37:39 +03:00
Yuriy
d21cf9d85f ssl support 2019-04-29 09:05:30 +03:00
Vitaly Baranov
738a49f534 Use iterators instead of macros APPLY_FOR_SETTINGS and others. 2019-04-27 01:09:16 +03:00
Vitaly Baranov
8277e9d8f1 Refactoring of Settings based on new template class SettingsCollection. 
Add new class SettingsConstraints.
 2019-04-26 19:11:05 +03:00
proller
97c532c0f0
Build fixes (#5114) 
Need to push builder docker image
 2019-04-26 02:21:59 +03:00
proller
c6d0e095e0
Prepare cmake for new contrib/poco (#5062) 2019-04-25 00:33:04 +03:00
Alexey Milovidov
352d1a8dcf Fixed inconsistent indentation 2019-04-24 22:38:11 +03:00
Alexey Milovidov
33252941f9 Added a comment 2019-04-24 21:40:45 +03:00
Alexey Milovidov
2428ba70f5 Added option "always_load_suggestion_data" to clickhouse-client #5066 2019-04-24 19:47:04 +03:00
Alexey Milovidov
3741449017 Added option "always_load_suggestion_data" to clickhouse-client #5066 2019-04-24 19:45:21 +03:00
proller
ba4687e110
Cmake: dont use LINK_MODE (but use BUILD_SHARED_LIBS) (#5091) 2019-04-24 12:06:28 +03:00
Yuriy
a4bf3621e3 merged with master 2019-04-23 21:58:29 +03:00
proller
fe71142827 Fix segfault in performance-test when no options specified 2019-04-23 17:02:26 +03:00
proller
29c3433322
Freebsd build fixes (#5083) 2019-04-23 15:51:27 +03:00
Alexey Milovidov
58d7d1e451 Resolved some of PVS-Studio warnings 2019-04-22 19:07:09 +03:00
Yuriy
e4766a4ef9 caching_sha2_password authentication plugin 2019-04-22 13:57:50 +03:00
Nikolai Kochetov
a07b592a95 Undo add thread_group to ThreadPool 2019-04-18 21:40:55 +03:00
alesapin
214bf77b17
Merge pull request #5012 from nvartolomei/nv/lb-first-or-random 
Add FIRST_OR_RANDOM Load Balancing policy
 2019-04-18 18:54:04 +03:00
Nikolai Kochetov
8718b7bb40 Added thread_group argument to ThreadPool. 2019-04-18 17:55:43 +03:00
proller
525726a5e2
Remove pocoext (#5036) 2019-04-17 20:36:58 +03:00
Nicolae Vartolomei
c2ec23c953
Add FIRST_OR_RANDOM Load Balancing policy 
For cross-replication topology setups load_balancing=in_order works best
as nodes handle equal amount of load and usually they hit only 1/n of
data (n = number of replicas), which makes page cache usage more
efficient.

The problem is when one node of the shard goes down. If one replica goes
down, the next one in config will handle twice the usual load while
remaining ones will handle usual traffic.

Closes #4820.
 2019-04-15 23:31:40 +01:00
filimonov
909521447f
add clickhouse-benchmark accepted stages names 2019-04-15 12:22:05 +02:00
Mikhail Fandyushin
68106d92ea bringing query id header to consistency 2019-04-10 23:13:41 +03:00
Mikhail Fandyushin
7fc9b8c6fb Merge branch 'master' into brotli 2019-04-08 21:07:58 +03:00
Nikolai Kochetov
54b15385bd Calculate rows_before_limit_at_least. 2019-04-08 17:55:20 +03:00
Yuriy
2789a83c03 fixed compilation with clang 2019-04-08 10:03:04 +03:00
Nikita Lapkov
fbdf2c3525 Merge remote-tracking branch 'upstream/master' into query-poor-mans-profiler 2019-04-06 06:58:40 +00:00
proller
eaffca28dd Copier: auto upload task configuration from --task-file option (#4876) 
* Copier: auto upload task configuration from --task-file option

* task-upload-force

* doc

* Update ClusterCopier.cpp

* Requested changes
 2019-04-05 19:10:52 +03:00
Nikolai Kochetov
7626b1b267 Multiple fixes. 2019-04-05 13:52:07 +03:00
proller
bebb4cd140 Merge remote-tracking branch 'upstream/master' into fix15 2019-04-04 14:50:14 +03:00
proller
236f2a4354
clickhouse-copier - fix another segfault (#4900) 2019-04-04 12:22:54 +03:00