Commit Graph

509 Commits

Author SHA1 Message Date
Denis Glazachev
9effacfbc1 Merge branch 'master' into ldap-per-user-authentication
* master: (1102 commits)
  Update README.md
  Update README.md
  Update README.md
  Update index.md
  [docs] add intrdocution for statements page (#12189)
  Revert "Run perf tests with memory sampling (for allocations >1M)"
  Sanitize LINK_LIBRARIES property for the directories (#12160)
  [docs] refactor Domains overview (#12186)
  DOCS-647: toStartOfSecond (#12190)
  [docs] add intrdocution for commercial page (#12187)
  DOCSUP-1348 Russian translation for new functions (#133) (#12194)
  changelog fixes
  Update index.md (#12191)
  Update zh kafka.md title (#12192)
  Added test for #3767
  style fix for #12152
  Tests for fixed issues #10846 and #7347
  changelog fixes
  [docs] introduction for special table engines (#12170)
  [docs] introduction for third-party interfaces (#12175)
  ...

# Conflicts:
#	src/Access/ya.make
#	src/Common/ErrorCodes.cpp
2020-07-08 00:42:09 +04:00
Nikita Mikhaylov
270551e599 done 2020-07-07 14:45:20 +03:00
alesapin
be85f9f98a
Merge pull request #12165 from vitlibar/fix-split-dictionary-source-table-name
Fix splitting table name of dictionary source
2020-07-07 11:49:36 +03:00
Azat Khuzhin
68ca3b7aec Do not try to adjust memory tracker amount if it is not larger then in total 2020-07-07 11:26:40 +03:00
Azat Khuzhin
d68ecdc84c Cap max_memory_usage* limits to the process resident memory
There are still some issues with memory tracking, but now with per-user
tracking:

    executeQuery: Code: 241, e.displayText() = DB::Exception: Memory limit (for user) exceeded: would use 437.72 GiB (attempt to allocate chunk of 4200926 bytes), maximum: 437.72 GiB (version 20.6.1.1) (from 10.7.140.7:31318)

Although the server is mostly idle:

    SELECT formatReadableSize(memory_usage)
    FROM system.processes

    ┌─formatReadableSize(memory_usage)─┐
    │ 289.28 MiB                       │
    │ 155.75 MiB                       │
    │ 0.00 B                           │
    └──────────────────────────────────┘

Refs: https://github.com/ClickHouse/ClickHouse/pull/10496/files#r450206865
Cc: @alexey-milovidov
2020-07-07 01:51:21 +03:00
Vitaly Baranov
4733504b51 Don't split dictionary source's table name into schema and table name itself
if ODBC driver doesn't support schema.
2020-07-06 23:41:39 +03:00
Nikita Mikhaylov
5c6d6bdf54
Merge pull request #11995 from azat/load_balancing-priority
Load balancing manual priority
2020-07-06 13:32:20 +04:00
alexey-milovidov
f1151ed474
Merge pull request #12133 from ClickHouse/normalize-pid-file
Normalize "pid" file handling #3501
2020-07-04 21:36:27 +03:00
alexey-milovidov
d9ea8cfc42
Update StatusFile.cpp 2020-07-04 16:57:04 +03:00
Alexey Milovidov
176a7f2f72 Normalize "pid" file handling #3501 2020-07-04 16:54:24 +03:00
alesapin
64583ceb22 Merge branch 'master' into add-storage-rabbitmq-read-only 2020-07-02 16:08:29 +03:00
Alexander Kuzmenkov
aa8461e996
Update ThreadProfileEvents.cpp 2020-06-30 10:47:19 +03:00
Alexander Kuzmenkov
1d838b7b3a
Update ThreadProfileEvents.cpp 2020-06-30 09:56:11 +03:00
Azat Khuzhin
ebff4eae7d Add replica priority for load_balancing
Make default 1, to match with <weight>
2020-06-29 23:03:28 +03:00
Alexander Kuzmenkov
877c10f5fa
Update ThreadProfileEvents.cpp 2020-06-29 17:13:16 +03:00
Alexander Kuzmenkov
9b9030caad
Update ThreadProfileEvents.cpp 2020-06-29 15:57:36 +03:00
Alexander Kuzmenkov
af8d62bbcb Add TLB misses perf counters. 2020-06-29 15:48:18 +03:00
kssenii
649eb8e348 Move reading from RabbitMQ into background task 2020-06-28 18:20:18 +00:00
alexey-milovidov
7376f18467
Merge pull request #11923 from ucasFL/client-not-argue
client exit with unrecognized arguments
2020-06-28 17:38:25 +03:00
alexey-milovidov
86ef3e1d8c
Update ErrorCodes.cpp 2020-06-28 17:37:42 +03:00
Alexey Milovidov
1462a66d1e Fix typos 2020-06-27 22:05:00 +03:00
feng lv
a159f1be54 Merge branch 'master' of github.com:ClickHouse/ClickHouse into client-not-argue 2020-06-26 17:34:24 +08:00
Alexander Kuzmenkov
a8db0b40d0 add page fault perf events 2020-06-25 23:42:31 +03:00
alexey-milovidov
a34032cace
Merge pull request #11300 from blinkov/sentry
Opt-in support for sending crash reports
2020-06-25 17:20:50 +03:00
alexey-milovidov
40755de412
Merge pull request #11908 from ClickHouse/zookeeper-modernize
Slightly modernize code around ZooKeeper
2020-06-25 16:25:50 +03:00
feng lv
6f3b78c774 client exit with unrecognized arguments
format code

fix
2020-06-25 18:09:35 +08:00
Azat Khuzhin
236cac3d52 Fix jemalloc under OSX (by registering it as default zone explicitly)
In case of OSX jemalloc register itself as a default zone allocator.

But when you link statically then zone_register() will not be called,
and even will be optimized out:

  $ nm clickhouse.patched  | grep -c zone_register
  0

Fix this, by manually calling it.

v2: extern C
2020-06-24 21:05:35 +03:00
Alexander Kuzmenkov
2da7b356ab
Merge pull request #11668 from bharatnc/bnc/config-max-num-threads
max_thread_pool_size setting for changing max Threads in Global Thread Pool
2020-06-24 16:11:21 +03:00
Alexey Milovidov
5a7e921135 Slightly modernize code around ZooKeeper 2020-06-24 14:02:14 +03:00
Ivan Blinkov
3ed76a388e send build_id to sentry as well + fix some minor issues 2020-06-24 00:27:04 +03:00
Ivan Blinkov
45d1ca2567 merge master 2020-06-24 00:18:16 +03:00
Ivan Blinkov
87d56d700f restore old toStringImpl signature 2020-06-24 00:15:54 +03:00
bharatnc
9be7ab0341 fix style check - removed unused LOGICAL_ERROR 2020-06-23 13:06:22 -07:00
Alexey Milovidov
cda2687195 Merge branch 'master' into fix-fpe-datetime64 2020-06-23 22:45:45 +03:00
Alexander Kuzmenkov
f0fbba5522 allow implicit initialization 2020-06-23 20:31:46 +03:00
Alexander Kuzmenkov
1a63972a4b Merge remote-tracking branch 'origin/master' into bnc/config-max-num-threads 2020-06-23 20:25:07 +03:00
alexey-milovidov
1c1e12f06b
Merge pull request #11826 from ClickHouse/send-logs-on-fatal-errors
Send logs to client on fatal errors if possible
2020-06-23 09:49:48 +03:00
Alexey Milovidov
75357ab98d constexpr intExp10 2020-06-22 23:32:29 +03:00
Alexander Kuzmenkov
96d2e9c997 Initialize GlobalThreadPool explicitly 2020-06-22 22:04:12 +03:00
Alexander Kuzmenkov
bd5ab9c686 Merge remote-tracking branch 'origin/master' into bnc/config-max-num-threads 2020-06-22 15:55:39 +03:00
Alexey Milovidov
b50b4b14de Merge branch 'master' into send-logs-on-fatal-errors 2020-06-22 15:48:46 +03:00
Alexander Kuzmenkov
ffc5b21bad Merge remote-tracking branch 'origin/master' into HEAD 2020-06-22 15:28:03 +03:00
alexey-milovidov
d6abf45a2d
Merge pull request #11847 from ClickHouse/DimasKovas-arch-chooser
Merging #10058
2020-06-22 14:01:10 +03:00
alexey-milovidov
281a6d6e46
Merge pull request #11824 from ClickHouse/print-build-id
Print build id in crash messages
2020-06-22 13:59:48 +03:00
Ivan Blinkov
7b1ab482b0 restore immediate stacktrace output 2020-06-22 10:22:13 +03:00
Ivan Blinkov
2c0ff29c48 Merge branch 'master' of github.com:ClickHouse/ClickHouse into sentry 2020-06-22 10:06:36 +03:00
alexey-milovidov
c3a5c32a48
Merge branch 'master' into arch-chooser 2020-06-21 21:30:06 +03:00
alexey-milovidov
59d3e200ce
Merge pull request #11831 from ClickHouse/decimal-cut-extra-digits-after-point
Make reading of Decimal more compatible with other DBMS
2020-06-21 21:03:06 +03:00
Alexey Milovidov
fac2c6050c Fix UBSan 2020-06-21 19:10:38 +03:00
Alexey Milovidov
0b2ffb9c77 Merge branch 'master' into print-build-id 2020-06-21 19:08:07 +03:00
Alexey Milovidov
71317dd59c Merge branch 'master' into send-logs-on-fatal-errors 2020-06-21 19:05:20 +03:00
alexey-milovidov
4ee623ccac
Merge pull request #10242 from MovElb/movelb-postgresql-wire-protocol-impl
PostgreSQL wire protocol implementation
2020-06-21 14:39:22 +03:00
alexey-milovidov
e6ab9b969e
Merge pull request #11830 from zlobober/fix_mmap_threshold
Move MMAP_THRESHOLD definition to .cpp file.
2020-06-21 14:07:07 +03:00
Alexey Milovidov
fe71a8eb8c Merge branch 'master' into send-logs-on-fatal-errors 2020-06-21 13:55:11 +03:00
Alexey Milovidov
227afea032 Merge branch 'master' into decimal-cut-extra-digits-after-point 2020-06-21 13:50:06 +03:00
Alexey Milovidov
7f05d2bac0 Merge branch 'master' into print-build-id 2020-06-21 13:44:32 +03:00
Maxim Akhmedov
2ff7f34968 Make constants in cpp file extern. 2020-06-21 00:45:20 +03:00
Alexey Milovidov
961568e978 Fix false MSan report in SymbolIndex 2020-06-20 22:05:03 +03:00
alexey-milovidov
603e690c18
Update Allocator.cpp 2020-06-20 21:52:36 +03:00
alexey-milovidov
87937e580e
Update Allocator.h 2020-06-20 21:52:13 +03:00
Alexey Milovidov
147cda2581 Merge branch 'master' into print-build-id 2020-06-20 21:05:31 +03:00
Denis Glazachev
6c1b2a4831 Merge branch 'master' into ldap-per-user-authentication
* master: (114 commits)
  Update alter.md (#11823)
  Update PODArray.h
  Added a test for #6549
  Update create.md
  Update create.md
  replacingmergetree translate into "替换合并树“ better (#11814)
  Whitespace
  Fix style
  Added a test
  Fix another 10% of bad code #11529
  Update join.md (#11798)
  Update memory.md (#11800)
  Whitespace
  Check for tests with "fail" in their names
  Fix 10% of bad code #11756
  Update PODArray.h
  avoid duplicate short system name
  adapt recent result as well
  [website] tune benchmark pages styling + add extra checks
  Added MSan suppression for Hyperscan
  ...

# Conflicts:
#	src/Common/ErrorCodes.cpp
2020-06-20 22:01:12 +04:00
alexey-milovidov
92d37efe18
Merge pull request #11736 from maxim-babenko/patch-1
Fix PODArrayBase::push_back_raw_many
2020-06-20 19:16:15 +03:00
Maxim Akhmedov
34fbc62033 Move MMAP_THRESHOLD definition to .cpp file. 2020-06-20 19:01:16 +03:00
Alexey Milovidov
408fc241d6 Make reading of Decimal more compatible with other DBMS 2020-06-20 17:43:01 +03:00
Alexey Milovidov
7ba25bd799 Make it work 2020-06-20 14:17:15 +03:00
Alexey Milovidov
ead4a2cfd9 Print build id in crash messages 2020-06-20 12:07:05 +03:00
Azat Khuzhin
b8ee2ea7d9 Pass max_ignored_errors/fallback_to_stale_replicas to PoolWithFailoverBase::get() too 2020-06-20 11:46:13 +03:00
Azat Khuzhin
de011a6edc Mark PoolWithFailoverBase::get() protected 2020-06-20 11:39:21 +03:00
Azat Khuzhin
dd054380bf Drop default values for some arguments of PoolWithFailoverBase::getMany 2020-06-20 11:21:18 +03:00
Azat Khuzhin
caa195c034 Add number of errors to ignore while choosing replicas (distributed_replica_max_ignored_errors)
This will allow avoid switching to another replica in case of error
(since error can be temporary).
2020-06-20 11:20:16 +03:00
Azat Khuzhin
687eb24f50 Fix divizion by zero for distributed_replica_error_half_life=0 2020-06-20 11:05:39 +03:00
Azat Khuzhin
2a5a8e70f4 Drop unused PoolWithFailoverBase<>::reportError() 2020-06-20 11:05:38 +03:00
alexey-milovidov
c256682068
Update PODArray.h 2020-06-20 10:45:51 +03:00
alexey-milovidov
2e604726e0
Update PODArray.h 2020-06-20 08:39:52 +03:00
Alexander Kuzmenkov
288f217df3 Merge remote-tracking branch 'origin/master' into HEAD 2020-06-19 23:07:53 +03:00
alexey-milovidov
08b53c1ab5
Update gtest_pod_array.cpp 2020-06-19 22:10:04 +03:00
Alexey Milovidov
5211a42c04 Remove leader election, step 3 2020-06-19 17:18:58 +03:00
Maxim Babenko
5895f25166 Styling 2020-06-19 16:30:00 +03:00
Maxim Babenko
8436688437 Add unittests for push_back_raw_many 2020-06-19 16:21:54 +03:00
Denis Glazachev
5db60202b6 Merge branch 'master' into ldap-per-user-authentication 2020-06-19 00:11:08 +04:00
maxim-babenko
c3dbf7d6bf
Fix PODArrayBase::push_back_raw_many
1) capacity check must be ready for overflow during memcpy
2) reserve must be called with the new size, not just delta
2020-06-17 19:38:23 +03:00
Vitaly Baranov
7011401cd4
Merge pull request #11670 from vitlibar/rbac-improve-parser-multiple-entities
RBAC: improve syntax
2020-06-17 16:26:02 +03:00
alexey-milovidov
e07d02015c
Merge pull request #11661 from ClickHouse/return-not-nullable-from-count-distinct-2
Return non-Nullable results from COUNT(DISTINCT), more complete.
2020-06-17 09:25:45 +03:00
alexey-milovidov
598fd75caf
Merge pull request #11639 from ClickHouse/remove-leader-election-2
Remove leader election, step 2: allow multiple leaders
2020-06-17 09:25:23 +03:00
alexey-milovidov
6e61f708d7
Merge pull request #11690 from ClickHouse/odbc-bridge-timeouts
Pass proper timeouts when communicating with XDBC bridge.
2020-06-17 03:18:29 +03:00
Alexey Milovidov
a655765040 Merge branch 'master' into return-not-nullable-from-count-distinct-2 2020-06-17 01:15:57 +03:00
Alexander Kuzmenkov
9cab822718
Merge pull request #11683 from ClickHouse/aku/merge-minmap-11603
Merge minMap, maxMap (#11603)
2020-06-17 00:02:33 +03:00
Alexey Milovidov
0a6054eece Merge branch 'master' into return-not-nullable-from-count-distinct-2 2020-06-16 22:31:33 +03:00
Alexey Milovidov
6c93016c91 Add suggestion from @alesap 2020-06-16 22:16:01 +03:00
Alexey Milovidov
b7ec5f94f2 Merge branch 'master' into odbc-bridge-timeouts 2020-06-16 22:14:43 +03:00
Ivan Blinkov
7e2bb1fd83 Merge branch 'master' of github.com:ClickHouse/ClickHouse into sentry 2020-06-16 16:02:55 +03:00
Bharat Nallan
334c5abe9b remove extra vertical space 2020-06-15 22:04:30 -07:00
Bharat Nallan
c43bd228ab make max global thread pool setting configurable
This PR adds a server level config for overriding the default max number
of threads in global thread pool that is currently allowed (10,000).

This might be useful in scenarios where there are a large number of
distributed queries that are executing concurrently and where the
default number of max threads might not be necessarily be sufficient.
2020-06-15 22:04:30 -07:00
Alexey Milovidov
125b007360 Merge branch 'master' into remove-leader-election-2 2020-06-16 05:56:29 +03:00
Alexey Milovidov
85a7676bf4 Fix flaky unit tests with ZooKeeper. 2020-06-16 02:32:30 +03:00
Alexey Milovidov
186d336e31 Use proper timeouts when communicating with xdbc-bridge 2020-06-16 01:35:15 +03:00
Alexey Milovidov
1e73a56a77 Whitespace 2020-06-16 01:23:56 +03:00
Alexey Milovidov
bc58e22c5b Whitespace 2020-06-16 01:23:13 +03:00
Vitaly Baranov
4bd00b02e2 Improve syntax of CREATE QUOTA. Now resource types and key types could be written with underscores.
Also rename columns key_type=>keys and source=>storage in table system.quotas.
2020-06-15 20:10:34 +03:00