Commit Graph

4416 Commits

Author SHA1 Message Date
Vitaliy Zakaznikov
d87ed7f267 * Adding max_live_view_insert_blocks_before_refresh setting
with default value of 64
* Updating writeIntoLiveView method to use max_live_view_insert_blocks_before_refresh
  from global context instead of hard coded number
* Adding squashing of the result blocks similar how it is done in materialized views
* Fixing bug in writeIntoLiveView that caused incoming block to be processed twice
  when maximum number of insert blocks was reached
2019-06-23 09:51:29 -04:00
Vitaliy Zakaznikov
bdeb45e8c7 Merge branch 'master' of https://github.com/vzakaznikov/ClickHouse into liveview 2019-06-17 13:04:48 -04:00
proller
dae5087fcf Build and test fixes 2019-06-17 19:50:31 +03:00
Vitaliy Zakaznikov
51bf8a1baa Merge branch 'master' of https://github.com/vzakaznikov/ClickHouse into liveview 2019-06-17 12:42:31 -04:00
Vitaliy Zakaznikov
8df3e48a7b * Fixing bug in writeIntoLiveView method where mergeable blocks
would always be reobtained after 64 inserts
2019-06-17 12:39:01 -04:00
alesapin
fd3abbe93d
Merge pull request #4935 from zhang2014/feature/support_system_replicas
Support system replicas queries for distributed
2019-06-17 15:30:30 +03:00
alesapin
e45d727e9d
Merge pull request #4558 from podshumok/distributred-timeout
Distributed and remote timeouts
2019-06-17 13:58:17 +03:00
alexey-milovidov
5fd319d0e9
Merge pull request #5648 from yandex/remove-number-of-stat-calls
Reduce number of "stat" syscalls for MergeTree data parts
2019-06-17 09:30:29 +03:00
Alexey Milovidov
62a3d00772 Added comment 2019-06-16 23:50:06 +03:00
Alexey Milovidov
ee5dcd50a0 Lowered CPU overhead for small data parts 2019-06-16 23:42:03 +03:00
Alexey Milovidov
14be0ca281 Reduce number of "stat" syscalls for MergeTree data parts 2019-06-16 23:13:54 +03:00
Alexey Milovidov
49c4f2ffed Reduce number of "stat" syscalls for MergeTree data parts 2019-06-16 23:11:30 +03:00
Alexey Milovidov
e3b21be1bb Reduce number of "stat" syscalls for MergeTree data parts 2019-06-16 23:02:45 +03:00
Alexey Milovidov
0ad13ca3d1 Reduce number of "stat" syscalls for MergeTree data parts 2019-06-16 22:59:30 +03:00
Alexey Milovidov
c1aa767a04 Reduce number of "stat" syscalls for MergeTree data parts 2019-06-16 22:53:05 +03:00
Alexey Milovidov
e4f314f88d Reduce number of "stat" syscalls for MergeTree data parts 2019-06-16 22:49:12 +03:00
Alexey Milovidov
801f34d325 Reduce number of "stat" syscalls for MergeTree data parts 2019-06-16 22:42:05 +03:00
Alexey Milovidov
b6acb29625 Reduce number of "stat" syscalls for MergeTree data parts 2019-06-16 22:36:15 +03:00
Alexey Milovidov
b494d17ca6 Reduce number of "stat" syscalls for MergeTree data parts 2019-06-16 22:32:52 +03:00
Alexey Milovidov
413b780b65 Various fixes for PVS-Studio 2019-06-16 21:13:39 +03:00
Vitaliy Zakaznikov
abc7c3f6c1 Merge branch 'master' of https://github.com/vzakaznikov/ClickHouse into liveview 2019-06-15 21:22:28 -04:00
alexey-milovidov
39c6fbc324
Merge pull request #5567 from vitlibar/really-lazy-dictionary-load
Non-blocking loading of external dictionaries
2019-06-15 22:15:53 +03:00
alexey-milovidov
a52e13b891
Merge pull request #5640 from yandex/use-ipv6-in-system-tables
Adopted IPv6 data type in system tables; unified client info columns in system.processes and system.query_log
2019-06-15 21:21:24 +03:00
Alexey Milovidov
d8f76152d5 Adopted IPv6 data type in system tables; unified client info columns in system.processes and system.query_log 2019-06-15 17:20:32 +03:00
Alexey Milovidov
b2100c7bcf Removed strange quoting style like `this'. See https://english.stackexchange.com/questions/17695/any-reference-on-the-usage-of-a-backtick-and-single-quotation-mark-like-this
Added backQuote and backQuoteIfNeed when required to correctly quote identifiers with proper escaping.
2019-06-15 15:06:22 +03:00
Vitaliy Zakaznikov
282ff6bfda * Fixing a bug in writeIntoLiveView method where blocks->front()
is called before checking if blocks vector is empty.
2019-06-14 21:08:46 -04:00
Vitaliy Zakaznikov
d6d0404c48 * Fixing bug in StorageLiveView.cpp getHeader() method
that sometimes addressed invalid pointer when getHeader()
  method was called without holding the mutex
2019-06-14 16:27:43 -04:00
Vitaly Baranov
b4384ce2a9 Dictionaries can be loaded in parallel.
A bad dictionary cannot block all the loading anymore.
Implemented really lazy loading of external dictionaries.
Provided more detailed information about the loading of each dictionary
to make diagnostics easier.
2019-06-14 22:18:47 +03:00
Alexey Milovidov
10722f53c7 Fixed performance degradation in SELECT from MergeTree tables #5631 2019-06-14 22:11:41 +03:00
Vitaliy Zakaznikov
13978c03f3 * Fixing a bug in StorageLiveView.cpp in the getHeader() method
when header block would not match blocks in the stream
  when Const column is present.
* Updating 00963_temporary_live_view_watch_live_timeout.py
  and removed timeout=5 after WATCH query is aborted with Ctrl-C
  so that the default timeout of 20sec is used
* Small style fixes in tests
2019-06-14 10:06:15 -04:00
proller
fc7ae399c4 Use system rapidjson; Fix types for macos; 2019-06-14 13:28:30 +03:00
alexey-milovidov
bc387e865f
Merge pull request #5549 from yandex/fix_deduplication_bug
Fix complex bug in deduplication
2019-06-14 09:23:15 +03:00
Vitaliy Zakaznikov
117f2d191e Merge branch 'master' of https://github.com/vzakaznikov/ClickHouse into liveview 2019-06-13 15:23:20 -04:00
Vitaliy Zakaznikov
b82bb4a954 * Updates to sync with yandex/master 2019-06-13 12:37:29 -04:00
Vitaliy Zakaznikov
8e868dd2fe Merge branch 'master' of https://github.com/yandex/ClickHouse 2019-06-13 12:31:13 -04:00
Alexey Milovidov
c846d0f6af Namespace comments are unneeded according to the code style.
find dbms -name '*.h' -or -name '*.cpp' | xargs grep -l -P '}\s*//+\s*namespace\s*' | xargs sed -i -r -e 's/}\s*\/\/+\s*namespace\s*.*$/}/'
2019-06-13 13:43:37 +03:00
Alexey Milovidov
8b87511e25 Namespace comments are unneeded according to the code style.
find dbms -name '*.h' -or -name '*.cpp' | xargs grep -l -P '}\s*//+\s*namespace\s*' | xargs sed -i -r -e 's/}\s*\/\/+\s*namespace\s*\w+/}/'
2019-06-13 13:37:13 +03:00
Vitaliy Zakaznikov
576393272b * Fixing styling check error 2019-06-12 20:45:41 -04:00
Vitaliy Zakaznikov
5983273694 Fixing bugs reported by sanitizers
* data race condition on storage is_dropped access
* invalid reference to storage after it is deleted
* invalid reference to mutex after storage is deleted
2019-06-12 09:11:44 -04:00
Vitaliy Zakaznikov
12060d8879 * Fixing errors that prevented clang build. 2019-06-11 08:27:47 -04:00
Vitaliy Zakaznikov
b6efd8599f * Trying again to fix style checks. Now running ./utils/check-style/check-style reports no errors. 2019-06-11 06:30:57 -04:00
Vitaliy Zakaznikov
a467e7c105 * Moving uexpect.py so that it can be found
* Trying to fix failed style checks
* Trying to fix clang build fail
2019-06-10 22:22:53 -04:00
Vitaliy Zakaznikov
a68980ab38 * Style check fixes 2019-06-10 07:41:33 -04:00
Vitaliy Zakaznikov
87b58e4150 * Fixing clang errors
* Fixing LIVE VIEW tests
2019-06-10 07:18:33 -04:00
Vitaliy Zakaznikov
5079180595 * Fixing a bug in LIVE VIEW tables. Before when a table
is created with "AS SELECT 1" the SELECT and WATCH queries would fail
* Adding and updating LIVE VIEW tests to increase coverage
2019-06-08 09:26:02 -04:00
Vitaliy Zakaznikov
b65ff910b6 Merge branch 'master' of https://github.com/vzakaznikov/ClickHouse into liveview 2019-06-07 08:02:59 -04:00
Vitaliy Zakaznikov
398f7e3c3f Merge branch 'master' of https://github.com/yandex/ClickHouse 2019-06-06 21:22:48 -04:00
Vitaliy Zakaznikov
2930965938 * Renaming live_view_heartbeat_delay setting to live_view_heartbeat_interval
and making the setting to be in seconds instead of usec
* Updated LIVE VIEW table to keep version consistent as long as the server is up
* Removed calculation of hash in writeIntoLiveView method as it is recalculated
  in the LiveViewBlockOutputStream
* Changed to using values from the local context for live_view_heartbeat_interval and
  temporary_live_view_timeout instead of the global context
* Updated LIVE VIEW tests to match the changes
2019-06-06 21:10:56 -04:00
alesapin
53e62b83d2 Fix complex bug in deduplication 2019-06-06 18:28:02 +03:00
Vitaliy Zakaznikov
e51f2c1dd1 Revert "Merge branch 'master' of https://github.com/vzakaznikov/ClickHouse into liveview"
This reverts commit 160ff4d519, reversing
changes made to a946d09f1b.
2019-06-05 18:52:31 -04:00