thevar1able/ClickHouse
1
0
Fork 0
mirror of https://github.com/ClickHouse/ClickHouse.git synced 2024-12-16 19:32:07 +00:00
Code Issues Packages Projects Releases Wiki Activity
29,205 Commits 9,319 Branches 1,783 Tags 2.1 GiB
1b313eedfa
Commit Graph

4980 Commits

Author SHA1 Message Date
Ivan Remen
8ad592dd07 Fix?? 2019-06-25 14:27:39 +03:00
alesapin
4a8a70a079
Merge pull request #5720 from coraxster/fix-5377 
MergedColumnOnlyOutputStream. Skip empty blocks. Fix 5377
 2019-06-25 13:35:09 +03:00
dmitry kuzmin
c72e4dfe08 5337: clang compiler fix 2019-06-24 18:07:01 +03:00
Alexey Milovidov
8f77d898f3 Renamed functions for consistency #5704 2019-06-24 17:51:37 +03:00
alexey-milovidov
8e41d89126
Merge pull request #5704 from zhang2014/fix/ISSUES-5697 
ISSUES-5697 fix insert and select query with mysql style identifier
 2019-06-24 17:40:28 +03:00
Nikita Vasilev
7b7517ff85 Merge remote-tracking branch 'upstream/master' into nikvas0/index_mutate 2019-06-24 16:44:44 +03:00
Ivan Lezhankin
0917573493 Merge remote-tracking branch 'upstream/master' into issue-5286 2019-06-24 14:42:58 +03:00
proller
1ac09fa721
Split Common/config.h by libs (dbms) (#5715) 2019-06-24 14:17:15 +03:00
Vitaliy Zakaznikov
d87ed7f267 * Adding max_live_view_insert_blocks_before_refresh setting 
with default value of 64
* Updating writeIntoLiveView method to use max_live_view_insert_blocks_before_refresh
  from global context instead of hard coded number
* Adding squashing of the result blocks similar how it is done in materialized views
* Fixing bug in writeIntoLiveView that caused incoming block to be processed twice
  when maximum number of insert blocks was reached
 2019-06-23 09:51:29 -04:00
dmitry kuzmin
c988293e1e 5337 fix: MergedColumn. skip empty blocks 2019-06-23 07:30:29 +03:00
zhang2014
b9cb1feb4c some review fixes 2019-06-22 12:40:41 +08:00
chertus
29700fd5e9 Auto version update to [19.11.0] [54423] 2019-06-21 18:47:02 +03:00
alesapin
efc0f7f65e Remove unused method 2019-06-21 18:19:47 +03:00
Ivan Lezhankin
b75db2ef04 Fix dropping message to early when stalling 2019-06-21 17:29:10 +03:00
zhang2014
1786407621 ISSUES-5697 fix insert and select query with mysql style identifier 2019-06-21 13:51:27 +08:00
proller
f111dbd45f Do not require gperf on build (#5701) 
* Build fixes

* fix

* USE_GPERF

* wip

* wip

* wip

* test -j

* Simpler

* fix

* FunctionsURL.h -> URL/FunctionsURL.h

* clean

* clean

* Always use gperf-generated file

* Generator for tldLookup.generated.cpp

* clang-format
 2019-06-21 02:50:53 +03:00
alexey-milovidov
606b074a4b
Merge pull request #5659 from yandex/ignore-mutation-limits 
Ignore query execution limits and limits for max parts size for merge while executing mutations.
 2019-06-21 02:14:41 +03:00
alexey-milovidov
73df46be2b
Merge pull request #5698 from abyss7/issue-5615 
Lower the probability of hanging when shutting down Kafka storage
 2019-06-21 02:11:07 +03:00
alesapin
3f7892ef50 Fix typo 2019-06-20 22:21:17 +03:00
alesapin
80f27968ac Add test for interaction of tables with different granularity and different versions 2019-06-20 19:25:32 +03:00
Ivan Lezhankin
ec78ec8365 Merge branch 'master' into issue-5286 2019-06-20 16:08:22 +03:00
Ivan Lezhankin
61750d09d2 Commit offsets for SELECTing from Kafka table too 2019-06-20 15:34:25 +03:00
proller
3d8c8ee83c
Build fixes. Split config.h (#5686) 2019-06-20 12:12:49 +03:00
alesapin
4ae502eaa6 Fix bug with wrong granularity detection 2019-06-20 11:48:56 +03:00
zhang2014
8221dd2a1a fix build and test failure 2019-06-20 08:33:37 +08:00
zhang2014
374aac3501 fix build & chmod shell test 2019-06-20 00:32:20 +08:00
alesapin
dd37370aab Fix test and add one 2019-06-19 19:16:13 +03:00
Ivan Lezhankin
fdd3f07860 Don't do premature subscription to topics 2019-06-19 19:15:30 +03:00
zhang2014
166018e41e fix code style & rename minmax, set 2019-06-19 23:30:48 +08:00
zhang2014
a50aea09f1 fix float in bloom filter 2019-06-19 23:13:21 +08:00
zhang2014
d145295163 convert type with condition 2019-06-19 23:12:06 +08:00
zhang2014
6c8ff6dc31 add some test 2019-06-19 23:12:05 +08:00
zhang2014
f52b16e1e1 support bloom filter for any type 2019-06-19 23:12:05 +08:00
alesapin
fefce49c8f Mixed parts by setting 2019-06-19 17:46:06 +03:00
alesapin
dd2e4fd805 Bug fixes 2019-06-19 15:30:56 +03:00
alesapin
f0c273ee4c More correct version 2019-06-19 14:59:08 +03:00
alesapin
d1de7431e1 Compilable 2019-06-19 13:26:26 +03:00
alesapin
7e11c3c78b Merge branch 'master' into index_granularity_by_default 2019-06-19 13:08:12 +03:00
alesapin
b544b62e44 A log of bugs 2019-06-19 13:07:56 +03:00
Ivan Lezhankin
9fd048cdbd Allow to select virtual columns in materialized view 2019-06-18 19:32:37 +03:00
Ivan Lezhankin
436052c67b Merge branch 'master' into issue-5286 2019-06-18 16:03:29 +03:00
alesapin
4f98f875c3
Add ability to write final mark for *MergeTree engines family (#5624) 
Add the ability to write final mark to *MergeTree engines family.
 2019-06-18 15:54:27 +03:00
alesapin
0bfb7b18ce Fix directory check 2019-06-18 14:38:04 +03:00
alesapin
d2615863f3 Merge branch 'master' into index_granularity_by_default 2019-06-18 13:52:41 +03:00
CurtizJ
e6dd92f9e1 ignore max part size for merge setting while executing mutations 2019-06-17 22:41:48 +03:00
Vitaliy Zakaznikov
bdeb45e8c7 Merge branch 'master' of https://github.com/vzakaznikov/ClickHouse into liveview 2019-06-17 13:04:48 -04:00
proller
dae5087fcf Build and test fixes 2019-06-17 19:50:31 +03:00
Vitaliy Zakaznikov
51bf8a1baa Merge branch 'master' of https://github.com/vzakaznikov/ClickHouse into liveview 2019-06-17 12:42:31 -04:00
Vitaliy Zakaznikov
8df3e48a7b * Fixing bug in writeIntoLiveView method where mergeable blocks 
would always be reobtained after 64 inserts
 2019-06-17 12:39:01 -04:00
Ivan Lezhankin
d907d8e8ca Commit offsets for SELECTing from Kafka table too 2019-06-17 19:27:18 +03:00
alesapin
fb22200890 Fix name hidding and stupid bug 2019-06-17 18:35:53 +03:00
alesapin
9e7d23b22e Style fix 2019-06-17 16:29:10 +03:00
alesapin
fd3abbe93d
Merge pull request #4935 from zhang2014/feature/support_system_replicas 
Support system replicas queries for distributed
 2019-06-17 15:30:30 +03:00
alesapin
e45d727e9d
Merge pull request #4558 from podshumok/distributred-timeout 
Distributed and remote timeouts
 2019-06-17 13:58:17 +03:00
alesapin
3a4dcfbacd Fix inconsistency in zookeeper metadata and disable adaptive granularity for old format 2019-06-17 13:34:25 +03:00
alesapin
e73cdbae90 Fix name hidding 2019-06-17 12:22:44 +03:00
alesapin
02af85411c Merge branch 'master' into index_granularity_by_default 2019-06-17 12:02:03 +03:00
alexey-milovidov
5fd319d0e9
Merge pull request #5648 from yandex/remove-number-of-stat-calls 
Reduce number of "stat" syscalls for MergeTree data parts
 2019-06-17 09:30:29 +03:00
Alexey Milovidov
62a3d00772 Added comment 2019-06-16 23:50:06 +03:00
Alexey Milovidov
ee5dcd50a0 Lowered CPU overhead for small data parts 2019-06-16 23:42:03 +03:00
Alexey Milovidov
14be0ca281 Reduce number of "stat" syscalls for MergeTree data parts 2019-06-16 23:13:54 +03:00
Alexey Milovidov
49c4f2ffed Reduce number of "stat" syscalls for MergeTree data parts 2019-06-16 23:11:30 +03:00
Alexey Milovidov
e3b21be1bb Reduce number of "stat" syscalls for MergeTree data parts 2019-06-16 23:02:45 +03:00
Alexey Milovidov
0ad13ca3d1 Reduce number of "stat" syscalls for MergeTree data parts 2019-06-16 22:59:30 +03:00
Alexey Milovidov
c1aa767a04 Reduce number of "stat" syscalls for MergeTree data parts 2019-06-16 22:53:05 +03:00
Alexey Milovidov
e4f314f88d Reduce number of "stat" syscalls for MergeTree data parts 2019-06-16 22:49:12 +03:00
Alexey Milovidov
801f34d325 Reduce number of "stat" syscalls for MergeTree data parts 2019-06-16 22:42:05 +03:00
Alexey Milovidov
b6acb29625 Reduce number of "stat" syscalls for MergeTree data parts 2019-06-16 22:36:15 +03:00
Alexey Milovidov
b494d17ca6 Reduce number of "stat" syscalls for MergeTree data parts 2019-06-16 22:32:52 +03:00
Alexey Milovidov
413b780b65 Various fixes for PVS-Studio 2019-06-16 21:13:39 +03:00
Vitaliy Zakaznikov
abc7c3f6c1 Merge branch 'master' of https://github.com/vzakaznikov/ClickHouse into liveview 2019-06-15 21:22:28 -04:00
alexey-milovidov
39c6fbc324
Merge pull request #5567 from vitlibar/really-lazy-dictionary-load 
Non-blocking loading of external dictionaries
 2019-06-15 22:15:53 +03:00
alexey-milovidov
a52e13b891
Merge pull request #5640 from yandex/use-ipv6-in-system-tables 
Adopted IPv6 data type in system tables; unified client info columns in system.processes and system.query_log
 2019-06-15 21:21:24 +03:00
Alexey Milovidov
d8f76152d5 Adopted IPv6 data type in system tables; unified client info columns in system.processes and system.query_log 2019-06-15 17:20:32 +03:00
Alexey Milovidov
b2100c7bcf Removed strange quoting style like `this'. See https://english.stackexchange.com/questions/17695/any-reference-on-the-usage-of-a-backtick-and-single-quotation-mark-like-this 
Added backQuote and backQuoteIfNeed when required to correctly quote identifiers with proper escaping.
 2019-06-15 15:06:22 +03:00
Vitaliy Zakaznikov
282ff6bfda * Fixing a bug in writeIntoLiveView method where blocks->front() 
is called before checking if blocks vector is empty.
 2019-06-14 21:08:46 -04:00
Vitaliy Zakaznikov
d6d0404c48 * Fixing bug in StorageLiveView.cpp getHeader() method 
that sometimes addressed invalid pointer when getHeader()
  method was called without holding the mutex
 2019-06-14 16:27:43 -04:00
Gleb Novikov
15004ce055 Merge branch 'master' into table-constraints 2019-06-14 23:10:48 +03:00
Vitaly Baranov
b4384ce2a9 Dictionaries can be loaded in parallel. 
A bad dictionary cannot block all the loading anymore.
Implemented really lazy loading of external dictionaries.
Provided more detailed information about the loading of each dictionary
to make diagnostics easier.
 2019-06-14 22:18:47 +03:00
Alexey Milovidov
10722f53c7 Fixed performance degradation in SELECT from MergeTree tables #5631 2019-06-14 22:11:41 +03:00
alesapin
22026e0333 Enable adaptive index granularity by default 2019-06-14 18:39:21 +03:00
Vitaliy Zakaznikov
13978c03f3 * Fixing a bug in StorageLiveView.cpp in the getHeader() method 
when header block would not match blocks in the stream
  when Const column is present.
* Updating 00963_temporary_live_view_watch_live_timeout.py
  and removed timeout=5 after WATCH query is aborted with Ctrl-C
  so that the default timeout of 20sec is used
* Small style fixes in tests
 2019-06-14 10:06:15 -04:00
proller
fc7ae399c4 Use system rapidjson; Fix types for macos; 2019-06-14 13:28:30 +03:00
alexey-milovidov
bc387e865f
Merge pull request #5549 from yandex/fix_deduplication_bug 
Fix complex bug in deduplication
 2019-06-14 09:23:15 +03:00
Vitaliy Zakaznikov
117f2d191e Merge branch 'master' of https://github.com/vzakaznikov/ClickHouse into liveview 2019-06-13 15:23:20 -04:00
Vitaliy Zakaznikov
b82bb4a954 * Updates to sync with yandex/master 2019-06-13 12:37:29 -04:00
Vitaliy Zakaznikov
8e868dd2fe Merge branch 'master' of https://github.com/yandex/ClickHouse 2019-06-13 12:31:13 -04:00
Alexey Milovidov
c846d0f6af Namespace comments are unneeded according to the code style. 
find dbms -name '*.h' -or -name '*.cpp' | xargs grep -l -P '}\s*//+\s*namespace\s*' | xargs sed -i -r -e 's/}\s*\/\/+\s*namespace\s*.*$/}/'
 2019-06-13 13:43:37 +03:00
Alexey Milovidov
8b87511e25 Namespace comments are unneeded according to the code style. 
find dbms -name '*.h' -or -name '*.cpp' | xargs grep -l -P '}\s*//+\s*namespace\s*' | xargs sed -i -r -e 's/}\s*\/\/+\s*namespace\s*\w+/}/'
 2019-06-13 13:37:13 +03:00
Vitaliy Zakaznikov
576393272b * Fixing styling check error 2019-06-12 20:45:41 -04:00
Vitaliy Zakaznikov
5983273694 Fixing bugs reported by sanitizers 
* data race condition on storage is_dropped access
* invalid reference to storage after it is deleted
* invalid reference to mutex after storage is deleted
 2019-06-12 09:11:44 -04:00
Vitaliy Zakaznikov
12060d8879 * Fixing errors that prevented clang build. 2019-06-11 08:27:47 -04:00
Vitaliy Zakaznikov
b6efd8599f * Trying again to fix style checks. Now running ./utils/check-style/check-style reports no errors. 2019-06-11 06:30:57 -04:00
Vitaliy Zakaznikov
a467e7c105 * Moving uexpect.py so that it can be found 
* Trying to fix failed style checks
* Trying to fix clang build fail
 2019-06-10 22:22:53 -04:00
Vitaliy Zakaznikov
a68980ab38 * Style check fixes 2019-06-10 07:41:33 -04:00
Vitaliy Zakaznikov
87b58e4150 * Fixing clang errors 
* Fixing LIVE VIEW tests
 2019-06-10 07:18:33 -04:00
Ivan Lezhankin
97558c1b41 Merge remote-tracking branch 'upstream/master' into issue-5286 2019-06-10 14:15:14 +03:00
Vitaliy Zakaznikov
5079180595 * Fixing a bug in LIVE VIEW tables. Before when a table 
is created with "AS SELECT 1" the SELECT and WATCH queries would fail
* Adding and updating LIVE VIEW tests to increase coverage
 2019-06-08 09:26:02 -04:00
Vitaliy Zakaznikov
b65ff910b6 Merge branch 'master' of https://github.com/vzakaznikov/ClickHouse into liveview 2019-06-07 08:02:59 -04:00
Vitaliy Zakaznikov
398f7e3c3f Merge branch 'master' of https://github.com/yandex/ClickHouse 2019-06-06 21:22:48 -04:00
Vitaliy Zakaznikov
2930965938 * Renaming live_view_heartbeat_delay setting to live_view_heartbeat_interval 
and making the setting to be in seconds instead of usec
* Updated LIVE VIEW table to keep version consistent as long as the server is up
* Removed calculation of hash in writeIntoLiveView method as it is recalculated
  in the LiveViewBlockOutputStream
* Changed to using values from the local context for live_view_heartbeat_interval and
  temporary_live_view_timeout instead of the global context
* Updated LIVE VIEW tests to match the changes
 2019-06-06 21:10:56 -04:00
alesapin
53e62b83d2 Fix complex bug in deduplication 2019-06-06 18:28:02 +03:00
Vitaliy Zakaznikov
e51f2c1dd1 Revert "Merge branch 'master' of https://github.com/vzakaznikov/ClickHouse into liveview" 
This reverts commit 160ff4d519, reversing
changes made to a946d09f1b.
 2019-06-05 18:52:31 -04:00
Vitaliy Zakaznikov
160ff4d519 Merge branch 'master' of https://github.com/vzakaznikov/ClickHouse into liveview 2019-06-05 18:42:26 -04:00
alexey-milovidov
42dbb7e881
Merge pull request #5539 from yandex/alter-ttl-fix 
Fixed alter modify ttl on ReplicatedMergeTree.
 2019-06-05 22:05:17 +03:00
CurtizJ
27d8b90dd9 fixed alter modify ttl on ReplicatedMergeTree and test added 2019-06-05 19:22:41 +03:00
Gleb Novikov
b8385aae8c Merge branch 'master' into table-constraints 2019-06-05 15:33:07 +03:00
Orivej Desh
5ec179377a DEVTOOLS-5170 Delete Y_IGNORE markers (#5533) 
They have been superseded by a new include resolution configuration that lives
outside clickhouse source tree.
 2019-06-05 14:52:39 +03:00
Vitaliy Zakaznikov
5f3be8134d * Disallowing writes into LIVE VIEW tables 
* Adding support for watching live views via HTTPHandler
* Small fix to WriteBufferValidUTF8.cpp to propagate next() call
* Updated copyData.cpp to treat block with no rows as
  "flush block"
* Updated PushingToViewsBlockOutputStream.cpp to directly use
  LIVE VIEW output stream instead of calling its write method
 2019-06-05 07:30:29 -04:00
Gleb Novikov
8bd2c7b3a7 Fixed DROP INDEX IF EXISTS and added simple test 2019-06-04 00:08:52 +03:00
Vitaliy Zakaznikov
fc21200bdd * Started to add LIVE VIEW table tests 
* Added uexpect.py module
* Fixed support for CREATE TEMPORARY LIVE VIEW
 2019-06-03 15:53:11 -04:00
Gleb Novikov
108b4c6a51 Merge branch 'master' into table-constraints 2019-06-03 22:15:33 +03:00
alesapin
db6de83fa1
Merge pull request #5520 from yandex/fix_inconsistent_parts_removing 
Fix inconsistent parts remove from local FS without dropping them from ZK
 2019-06-03 21:18:16 +03:00
Ivan
f70eed78d8
Don't do intermediate commits in Kafka tables by default (#5445) 
* Don't do intermediate commits in Kafka tables by default
* Use default settings' values as defaults in code
 2019-06-03 19:40:22 +03:00
alesapin
dfe214b37c Fix inconsistent parts remove from local FS without dropping them from ZK 2019-06-03 17:58:19 +03:00
Ivan Lezhankin
8326021d74 Fix style 2019-06-03 17:36:59 +03:00
Ivan Lezhankin
b311984879 Merge remote-tracking branch 'upstream/master' into issue-5286 2019-06-03 17:19:09 +03:00
Anastasiya Rodigina
77fa9c30ee fix little misprint 2019-06-03 07:36:55 +00:00
Anastasiya Rodigina
4ff02cff4d Fix some problems with tests, add more tests, more syntetic tests are coming today 2019-06-03 06:00:54 +00:00
Gleb Novikov
33f0ebd8ab Brace style fix 2019-06-02 18:08:28 +03:00
Gleb Novikov
e7293486bd Added ALTER TABLE support to constraints (ADD CONSTRAINT, DROP CONSTRAINT) 2019-06-02 17:41:12 +03:00
Konstantin Podshumok
9e7387182a StorageReplicatedMergeTree: move timeouts to RemoteBlockInputStream 2019-06-02 12:43:20 +03:00
Konstantin Podshumok
a61a8386f3 update timeouts usage in DistributedBlockOutputStream 2019-06-02 12:43:20 +03:00
Konstantin Podshumok
b801fcb79a fix timeouts usage in directory monitor 2019-06-02 12:43:20 +03:00
Gleb Novikov
2b5cf46842 Merge branch 'master' into table-constraints 2019-06-02 08:33:36 +03:00
Danila Kutenin
b5f42d36fa
Merge pull request #5498 from yandex/gcc9-warnings 
Fix gcc9 warnings and ICEs
 2019-06-01 15:12:41 +03:00
Vitaly Baranov
a4ce427bfa
Merge pull request #5429 from azat-archive/INSERT-into-Distributed-with-MATERIALIZED 
Fix INSERT into Distributed() table with MATERIALIZED column
 2019-06-01 12:28:45 +03:00
Vitaly Baranov
421c6a90e2
Use function getSampleBlockNonMaterialized() to simplify the solution 2019-05-31 21:31:09 +03:00
Danila Kutenin
7e2b3b59b8 Fix gcc9 warnings and ICE's 2019-05-31 11:55:01 +03:00
proller
1b0d1a4450 Info about frozen parts in system.parts (#5471) 
* wip

*    wip

* wip

* Clean

* fix test

* clean

* fix test

* fix test
 2019-05-31 07:03:46 +03:00
Vitaliy Zakaznikov
f06f0e3947 * Adding support for CREATE TEMPORARY LIVE VIEW 
* Fixing issue with setting _version virtual column
 2019-05-30 17:29:30 -04:00
Vitaliy Zakaznikov
673d1a46a0 * Adding support for _version virtual column to LIVE VIEWs when using SELECT 
* Adding support for _version column to LIVE VIEWS when using WATCH query
* Adding initial support for WATCH query on LIVE VIEWs
 2019-05-29 17:52:13 -04:00
alexey-milovidov
cf6f771fd2
Update StorageInput.h 2019-05-30 00:38:28 +03:00
alexey-milovidov
e44cdefefa
Update StorageInput.h 2019-05-29 23:59:03 +03:00
zhang2014
80788cd7a8 Rename system sync distributed to system flush distributed 2019-05-29 10:43:52 +08:00
zhang2014
1a33840964 fix review 2019-05-29 10:43:52 +08:00
zhang2014
c44f608868 support replicas system queries for distributed 2019-05-29 10:43:52 +08:00
Vitaliy Zakaznikov
d112695c42 * Adding other changes to support LIVE VIEWs 2019-05-28 17:17:48 -04:00
palasonicq
c873ed39bf Added input() function 2019-05-28 21:27:00 +03:00
alexey-milovidov
5adef8bc56
Merge pull request #5437 from TCeason/bug_fix 
ISSUES-5432 fix bad alloc when truncate join storage
 2019-05-28 20:33:14 +03:00
Ivan Lezhankin
6b1a9e0e52 Fix comment 2019-05-28 15:22:10 +03:00
tai
1ab21e5774 ISSUES-5432 fix bad alloc when truncate join storage 2019-05-28 14:23:07 +08:00
Ivan Lezhankin
1eccbc39c5 Don't add virtual column to empty block 2019-05-28 00:01:24 +03:00
Azat Khuzhin
e527def18a
Fix INSERT into Distributed() table with MATERIALIZED column 
By just skipping MATERIALIZED columns during processing.

P.S. you cannot use insert_allow_materialized_columns since it works
only for Buffer() engine.

Fixes: #4015
Fixes: #3673
Fixes: 01501fa8db ("correct column list
for rewritten INSERT query into Distributed [#CLICKHOUSE-4161]")
 2019-05-27 23:32:05 +03:00
Ivan Lezhankin
13212c9b01 Fix the hang on dropping Kafka table when there is no mat. views 2019-05-27 20:25:34 +03:00
Vitaliy Zakaznikov
9dd07bcc23 * Work in progress to redo live view implementation to be less invasive 2019-05-26 18:03:30 -04:00
Vitaliy Zakaznikov
084d538dc5 Merge branch 'master' of https://github.com/yandex/ClickHouse 2019-05-26 17:24:17 -04:00
Gleb Novikov
337897c4b8 Merge branch 'master' into table-constraints 2019-05-26 12:36:02 +03:00
alexey-milovidov
461c4919d3
Merge pull request #5116 from PerformanceVision/send_header 
Send a X-ClickHouse summary on the header for HTTP client with number of rows inserted
 2019-05-25 20:20:35 +03:00
Gleb Novikov
c926cf6562 Minor review fixes 2019-05-25 17:07:45 +03:00
alexey-milovidov
e0e35f3258
Merge pull request #5246 from nikvas0/nikvas0/fix_minmax_null 
[wip] fix null minmax
 2019-05-25 16:11:23 +03:00
alexey-milovidov
81ed764d6a
Merge pull request #5285 from abyss7/issue-5085 
Don't crash the server when Kafka consumers have failed to start
 2019-05-25 16:09:26 +03:00
alexey-milovidov
cb89e506a4
Merge pull request #5353 from yandex/aku/detached-parts-5164 
Add system.detached_parts table.
 2019-05-25 16:08:33 +03:00
alexey-milovidov
0c38226a25
Merge pull request #5366 from abyss7/storage-merge-sample 
Check that underlying tables support sampling for StorageMerge
 2019-05-25 15:44:02 +03:00
Gleb Novikov
c401d282da Merge branch 'master' into table-constraints 2019-05-25 14:26:08 +03:00
Anastasiya Rodigina
6c779e63b0 Edit reverse order 2019-05-25 14:09:23 +03:00
chertus
9eca696e82 actualize isNumber for Decimal 2019-05-24 15:11:03 +03:00
Ivan Lezhankin
19a850ad75 Use read callback to populate virtual columns in Kafka Engine 2019-05-23 16:20:25 +03:00
Ivan Lezhankin
800854119e Add buffer callback to fill in virtual columns 2019-05-23 14:15:18 +03:00
Ivan Lezhankin
dd906eabdc [WIP] refactoring 2019-05-22 22:38:43 +03:00
Alexander Kuzmenkov
6472040c6c Initialize StoragesInfo fields. 2019-05-21 16:58:55 +03:00
Ivan Lezhankin
28bddf9a4a [StorageMerge] check that underlying tables support sampling 2019-05-21 16:04:34 +03:00
Alexander Kuzmenkov
43655a8db7 Add system.detached_parts table. 
https://github.com/yandex/ClickHouse/issues/5164
 2019-05-21 15:06:36 +03:00
Ivan Lezhankin
cf39c4cc47 Embed virtual columns into IStorage 2019-05-21 14:24:32 +03:00
Ivan Lezhankin
11a5a6db70 Remove unused functions 2019-05-20 15:16:51 +03:00
Guillaume Tassery
77b7158cd8 Progress rename for total_rows and write_[rows|bytes] 2019-05-20 18:37:41 +07:00
Gleb Novikov
773849a43d Added constraints getter and setter to IStorage 2019-05-19 09:08:25 +03:00
Gleb Novikov
19d099f90a Removed ITableDeclaration 2019-05-19 09:03:18 +03:00
Gleb Novikov
2e7b6af137 Merge branch 'master' into table-constraints 2019-05-19 09:03:04 +03:00
Gleb Novikov
60a5b94ba4 Style fix 2019-05-19 08:44:31 +03:00
Gleb Novikov
300ec160f4 Constraints MVP 2019-05-19 08:27:00 +03:00
alexey-milovidov
2254b171a7
Merge pull request #5313 from yandex/fix-external-query-in-with-single-element 
Fix external queries with IN operator.
 2019-05-19 03:12:57 +03:00
Alexey Milovidov
648d2bdb25 Fixed test 2019-05-19 01:19:24 +03:00
Anastasiya Rodigina
b3d811a199 Fix some tests 2019-05-18 19:46:29 +03:00
Anastasiya Rodigina
6132b57beb Fix style issues 2019-05-18 16:22:49 +03:00
anrodigina
d7ee2cb907
Merge branch 'master' into clickhouse-4013 2019-05-18 15:34:23 +03:00
Anastasiya Rodigina
5978ca040b Resolve conflicts with master 2019-05-18 15:30:41 +03:00
Anastasiya Rodigina
31f5cb1eee Resolve conflicts with master 2019-05-18 15:29:57 +03:00
Anastasiya Rodigina
b5eab916f5 Resolve conflicts with master 2019-05-18 15:28:09 +03:00
Anastasiya Rodigina
bc09b51316 Add reading in pk_order 2019-05-18 15:21:40 +03:00
alexey-milovidov
7985ad10ef
Update IStorage.h 2019-05-18 12:31:51 +03:00
Gleb Novikov
ce93896608 Added constraints description to MergeTree and related storages 2019-05-18 11:05:52 +03:00
alexey-milovidov
fa4a7eb3d1
Merge branch 'master' into merge-itable-istorage 2019-05-18 00:37:12 +03:00
alexey-milovidov
8bf48de9c9
Merge pull request #5308 from abyss7/issue-5100 
Add setting to regulate Kafka committing policy
 2019-05-18 00:27:19 +03:00
Ivan Lezhankin
7b6c78402d Allow to shadow virtual column '_table' in Merge engine 2019-05-17 20:40:51 +03:00
Ivan Lezhankin
7f762aee88 Move some code from header to source file. 2019-05-17 17:48:03 +03:00
Ivan Lezhankin
0821d62516 Merge ITableDeclaration into IStorage. 
Also a couple of massive include-refactorings with better forwarding
 2019-05-17 17:34:25 +03:00
Gleb Novikov
7919a62198 Removed constraints getter and setter from StorageMergeTree 2019-05-17 09:21:29 +03:00
Gleb Novikov
07abed6d31 Renamed constraints getter and setter 2019-05-17 08:05:19 +03:00
Gleb Novikov
3c905e24e2 Merge branch 'master' into table-constraints 2019-05-17 08:02:33 +03:00
Gleb Novikov
72d5a4634c Syntax fix 2019-05-17 07:27:09 +03:00
Gleb Novikov
502d86bd02 Added constraints to InterpreterCreateQuery and storages 2019-05-17 07:08:03 +03:00
Alexey Milovidov
09073e1229 More tests 2019-05-17 01:55:29 +03:00
Alexey Milovidov
b075de45d6 Fixed test 2019-05-17 01:51:26 +03:00
Alexey Milovidov
dd9e993a87 Fixed issue #3540 (in progress) 2019-05-17 00:09:06 +03:00
Alexey Milovidov
5352b53671 Added missing file 2019-05-16 22:57:20 +03:00
Alexey Milovidov
d2bb2a9892 Added failing test 2019-05-16 22:00:46 +03:00
Ivan Lezhankin
a14013dff7 Add setting to regulate Kafka committing policy. 2019-05-16 18:20:30 +03:00
alexey-milovidov
8e2bdde93b
Update StorageKafka.cpp 2019-05-15 23:57:24 +03:00
proller
51ca4cbaa4
Build fixes (#5278) 2019-05-15 20:19:39 +03:00
Ivan
1ea9e3019d
Freeze the Kafka buffer after first empty response (#5283) 
* Check inside inferior streams for cancellation while reading.
* Stop reading from Kafka buffer after first empty read.
 2019-05-15 19:11:50 +03:00
Ivan Lezhankin
337ddf5047 Catch cppkafka exceptions about consumer creation failures 2019-05-15 17:23:52 +03:00
Artem Zuikov
98359a6a09
Merge pull request #5267 from 4ertus2/row_ref_list 
RowRefList improvements
 2019-05-15 13:38:48 +03:00
alexey-milovidov
88b34999fe
Merge pull request #5247 from zhang2014/fix/rename_data_race 
fix data race in rename query
 2019-05-14 22:07:52 +03:00
Ivan
4a5832b18a
Check the time limit every (flush_interval / poll_timeout) number of rows from Kafka (#5249) 2019-05-14 18:52:03 +03:00
chertus
6200d20dc2 RowRefList refactoring 2019-05-14 17:39:03 +03:00
proller
cc3de4115f
Build fixes (#5261) 2019-05-14 12:58:33 +03:00
zhang2014
2206ba464f fix data race in rename query 2019-05-13 15:54:38 +08:00
Nikita Vasilev
ee3c50e1a0 mayBeTrueOnGranule 2019-05-12 20:08:28 +03:00
Nikita Vasilev
3e02eaf28d fix null minmax 2019-05-12 20:01:36 +03:00
alexey-milovidov
f7343ecb6f
Merge pull request #4639 from IvanKush/feat/parallel-alter-modify 
feat alter:  parallelize processing of parts in alter modify
 2019-05-12 00:39:46 +03:00
Nikita Vasilev
b0307ceeef Merge remote-tracking branch 'upstream/master' into nikvas0/index_mutate 2019-05-11 22:04:57 +03:00
ivan-kush
ab6558b8b4 add spaces amp 2019-05-10 17:34:02 +03:00
alexey-milovidov
8ef7f3589a
Merge pull request #4936 from TCeason/feature/support_settings_for_async 
Suport settings for async distributed inserts (#4852)
 2019-05-09 23:59:29 +03:00
alexey-milovidov
001e4bfe76
Merge pull request #5209 from PerformanceVision/rename_mv 
Support rename operation for MaterializeView storage
 2019-05-09 23:10:41 +03:00
Nikita Vasilev
05f9373af0 Merge remote-tracking branch 'upstream/master' into nikvas0/index_mutate 2019-05-09 21:59:22 +03:00
Nikita Vasilev
6c0722db04 fix mutations with parts 2019-05-09 20:27:20 +03:00
Nikita Vasilev
ad07dd2e1f fix 2019-05-09 20:04:05 +03:00
Nikita Vasilev
8d2b32fda8 clear index 2019-05-09 17:25:18 +03:00
alexey-milovidov
4853b06f95
Merge pull request #5223 from proller/fix26 
Build fixes
 2019-05-09 11:38:20 +03:00
Guillaume Tassery
c8bf190f84 add unsafe function member for (add|remove)dependency for calling manually the context locking 2019-05-09 13:12:02 +07:00
proller
deddb40bf2 fix 2019-05-08 17:25:17 +03:00
proller
10c349e398 Fix macos build 2019-05-08 15:26:35 +03:00
chertus
4969ad2f98 correct comment & some renames 2019-05-08 13:53:45 +03:00
Ivan Kush
2a356791ab Merge branch 'master' into feat/parallel-alter-modify 2019-05-07 23:53:14 +03:00
ivan-kush
5bde1c69ab last try? 2019-05-07 23:41:15 +03:00
Guillaume Tassery
4cfb2859aa set generateInnerTableName function as inline 2019-05-07 14:38:10 +07:00
Guillaume Tassery
55dc86ef74 Support rename operation for MaterializeView storage 2019-05-07 13:54:55 +07:00
alexey-milovidov
63b3d7dbdb
Update MergeTreeData.h 2019-05-06 01:13:07 +03:00
alexey-milovidov
3e461e92c8
Update SelectQueryInfo.h 2019-05-05 23:35:05 +03:00
alexey-milovidov
c04c614bc0
Merge branch 'master' into clickhouse-4013 2019-05-05 23:22:45 +03:00
Nikita Vasilev
18593391b4 materialize query 2019-05-05 21:53:48 +03:00
Nikita Vasilev
27aeb3a36d fix 2019-05-05 21:19:07 +03:00
Nikita Vasilev
3bf2397332 materialize 2019-05-05 20:01:54 +03:00
Nikita Vasilev
dea174620b fix 2019-05-05 18:12:33 +03:00
Nikita Vasilev
d079e80659 operator= 2019-05-05 15:42:53 +03:00
Nikita Vasilev
87131d9e99 fix 2019-05-05 15:17:30 +03:00
Nikita Vasilev
85564c3a84 Merge remote-tracking branch 'upstream/master' into nikvas0/index_mutate 2019-05-05 14:34:10 +03:00
Nikita Vasilev
11d2785e8e parts drop 2019-05-05 10:59:07 +03:00
Alexey Milovidov
aca0195468 Miscellaneous 2019-05-04 19:17:11 +03:00
Alexey Milovidov
b2443f6aa6 Removed huge chunk of bad code 2019-05-04 06:45:58 +03:00
Alexey Milovidov
24dc2c858a Removed huge chunk of bad code 2019-05-03 21:07:59 +03:00
Alexey Milovidov
ad355897f7 Removed huge chunk of bad code 2019-05-03 05:09:41 +03:00
Alexey Milovidov
a6ca9f266f Removed huge chunk of bad code 2019-05-03 05:00:57 +03:00
Alexey Milovidov
41a32d8693 Removed bad code 2019-05-03 03:27:11 +03:00
Alexey Milovidov
0a8e888671 Fixed bad code 2019-05-03 03:26:46 +03:00
Alexey Milovidov
9537ff0594 Miscellaneous 2019-05-03 01:51:39 +03:00
alexey-milovidov
0dd0611873
Merge pull request #5173 from yandex/rename-method 
Rename method for consistency
 2019-05-03 00:58:51 +03:00
ivan-kush
abfb681a04 hz 2019-05-03 00:43:24 +03:00
ivan-kush
9ce742e040 Merge remote-tracking branch 'upstream/master' into feat/parallel-alter-modify 2019-05-03 00:25:56 +03:00
ivan-kush
d555a165a4 debug stress address 2019-05-02 21:48:38 +03:00
Alexey Milovidov
270a31abb5 Rename method for consistency 2019-05-02 19:07:23 +03:00
ivan-kush
ea82760463 add reset 2019-05-02 18:12:57 +03:00
Alexey Milovidov
6a271adad3 Added max_parts_in_total threshold to MergeTree tables 2019-05-02 17:48:54 +03:00
ivan-kush
3ecb66d965 debug stress address 2019-05-02 16:42:09 +03:00
ivan-kush
591325468b make_unique 2019-05-02 14:54:34 +03:00
Alexey Milovidov
1be21e3cb6 Removed bad and useless code in ColumnsDescription 2019-05-02 00:43:05 +03:00
ivan-kush
6ac5aa5e49 restart performance 2019-05-01 18:46:17 +03:00
ivan-kush
4a3a1fc6d9 return transactions cleaning 2019-05-01 15:43:43 +03:00
Ivan Kushnarenko
e38f6e08d8 debug tsan refactor trash 2019-05-01 13:26:49 +03:00
proller
83a35d7644 Update contributors 2019-04-30 22:46:07 +03:00
Ivan
dede124449
Fixes after premature merge of #5139 (#5143) 
* Implement move-constructor via move-assignment operator.
* Reimplement copy-ctor via copy-assignment operator too.
 2019-04-30 19:05:39 +03:00
Ivan
6291c4098f
Revert "Merge pull request #5139 from abyss7/fix-self-move" (#5150) 
This reverts commit bd1f8fe97a, reversing
changes made to 5d1091bfee.
 2019-04-29 23:33:26 +03:00
alexey-milovidov
bd1f8fe97a
Merge pull request #5139 from abyss7/fix-self-move 
Remove move-assignment to prevent possible self-move
 2019-04-29 17:08:23 +03:00
Ivan Lezhankin
9a1aee4c2e Remove move-assignment to prevent possible self-move 2019-04-29 16:47:28 +03:00
tai
b394a79af3 try fix batch async insert settings for Distributed 2019-04-29 17:02:23 +08:00
tai
0d39968233 Suport settings for async(#4852) 
There is no hash operation on Settings. Because it is less valuable for hash operations.

And I dont know how to write a testcase.
 2019-04-29 17:02:23 +08:00
Vitaly Baranov
28d9a80072 Rename macro APPLY_FOR_SETTINGS => LIST_OF_SETTINGS. 2019-04-29 03:22:59 +03:00
Ivan Kushnarenko
bdbe97276c remove groups 2019-04-27 23:15:10 +03:00
ivan-kush
26b3910b7d tsan debug 2019-04-27 20:01:30 +03:00
Ivan Kushnarenko
cb51558bdf check build clang7 splitted 2019-04-27 11:24:50 +03:00
Vitaly Baranov
1b8c01e940 Transform comments for MergeTreeSettings into descriptions. 2019-04-27 01:09:16 +03:00
Vitaly Baranov
738a49f534 Use iterators instead of macros APPLY_FOR_SETTINGS and others. 2019-04-27 01:09:16 +03:00
Vitaly Baranov
8277e9d8f1 Refactoring of Settings based on new template class SettingsCollection. 
Add new class SettingsConstraints.
 2019-04-26 19:11:05 +03:00
Vitaly Baranov
b24c69743e Use the same parameters in all APPLY_FOR_SETTINGS macros. 2019-04-26 19:11:05 +03:00
ivan-kush
ba61e16093 style 2019-04-26 00:37:57 +03:00
ivan-kush
86af5fc0c2 Merge remote-tracking branch 'upstream/master' into feat/parallel-alter-modify 2019-04-25 22:48:44 +03:00
ivan-kush
af02fe4a96 Merge remote-tracking branch 'origin/feat/parallel-alter-modify' into feat/parallel-alter-modify 2019-04-25 22:33:09 +03:00
ivan-kush
33201fa9a8 rev 2019-04-25 21:57:43 +03:00
proller
ba4687e110
Cmake: dont use LINK_MODE (but use BUILD_SHARED_LIBS) (#5091) 2019-04-24 12:06:28 +03:00
alexey-milovidov
0cf40e0029
Merge pull request #5082 from yandex/pvs-studio-fixes-3 
Resolved some of PVS-Studio warnings
 2019-04-22 22:06:07 +03:00
alexey-milovidov
b1cf026b5b
Merge pull request #5080 from abyss7/issue-4736 
Do not drop Kafka Consumer buffers after deletion of stream
 2019-04-22 19:18:33 +03:00
Alexey Milovidov
58d7d1e451 Resolved some of PVS-Studio warnings 2019-04-22 19:07:09 +03:00
Ivan Lezhankin
94bba1918f Do not drop Kafka consumer buffers after closing stream 2019-04-22 16:23:05 +03:00
alesapin
33b228c276 Fix own test 2019-04-18 19:33:28 +03:00
alesapin
d812ae7024 Use fixed_granularity as upper bound for adaptive granularity 2019-04-18 18:06:45 +03:00
Anastasiya Rodigina
0c1735f1b1 ReverseBlockInputStream, optimization of group by, tests 2019-04-18 00:20:51 +03:00
Nikita Vasilev
8e8c77a46b added indices to mutationsInterpreter 2019-04-17 20:07:07 +03:00
proller
1b020827f0 Move Poco/Ext/ThreadNumber.h to common/getThreadNumber.h (#5016) 2019-04-17 17:53:54 +03:00
alesapin
faeb95cfd7
Merge branch 'master' into adaptive_index_granularity 2019-04-15 19:36:36 +03:00
alesapin
8cd18c0723
Merge pull request #4991 from yandex/fix_ddl_on_relicated_table 
Do not send queries received from DDLWorker to leader replica
 2019-04-15 13:07:55 +03:00
Anton Popov
7f93f9ad2f TTL for columns and tables (#4212) 
Add TTL for columns and tables.
 2019-04-15 12:30:45 +03:00
Danila Kutenin
18a6b3123f Randomization in lfalloc 2019-04-13 17:45:01 +03:00
Danila Kutenin
622b2c8472 Enable LFAlloc for MarkCache and UncompressedCache 2019-04-13 15:07:43 +03:00
alesapin
f47e3292e1 Do not send queries to leader replica received from DDLWorker 2019-04-12 14:06:05 +03:00
alexey-milovidov
d083976b88
Merge pull request #4952 from 4ertus2/ast 
Rewrite ASTSelectQuery (consistent children)
 2019-04-11 13:38:44 +03:00
Alexey Milovidov
d591c7187f Simplified expression 2019-04-10 23:16:04 +03:00
Nikita Vasilev
20f0b17cf4 mutations 2019-04-10 20:44:39 +03:00
chertus
a698700faf fix tests (external storages) 2019-04-10 14:44:58 +03:00
chertus
82dc1fb1db rewrite ASTSelectQuery (consistent children) 2019-04-09 17:22:35 +03:00
alesapin
a53b002973 Merge remote-tracking branch 'origin' into adaptive_index_granularity 2019-04-08 14:29:33 +03:00
Alexey Milovidov
460b58379a Fixed bad whitespaces 2019-04-06 03:36:04 +03:00
Alexey Milovidov
571bc7065a Removed unused code related to MemoryTracker 2019-04-06 01:35:56 +03:00
alexey-milovidov
a6797a9fba
Merge pull request #4883 from yandex/fix_codec_delta_alter 
Fix alter modify of codec when column type is not specified
 2019-04-04 22:16:22 +03:00
Danila Kutenin
029dd107e4 Typos for many factories 2019-04-03 14:13:22 +03:00
alesapin
42a0c2f194 Fix alter modify of codec when column type is not specified 2019-04-02 15:51:31 +03:00
alesapin
f7f29fa3e7 Style fix 2019-04-01 15:10:32 +03:00
alesapin
e204be3877 Remove debug prints 2019-04-01 14:40:13 +03:00
alesapin
69b623c47c Return logic for cache 2019-04-01 14:09:30 +03:00
alesapin
37427077b8 Remove average granularity logic from code 2019-04-01 13:34:22 +03:00
alesapin
7b67200258 Merge remote-tracking branch 'origin' into adaptive_index_granularity 2019-04-01 11:54:19 +03:00
alesapin
78e09a221a Remove debug prints, little refactoring 2019-03-30 17:43:43 +03:00
alesapin
d6293d432c Commit missed files 2019-03-30 16:49:29 +03:00
alesapin
cdc18aa801 Rename IndexGranularity to MergeTreeIndexGranularity 2019-03-30 16:44:23 +03:00
Ivan
957d23267b
Minimal implementation of row-level security CLICKHOUSE-4315 (#4792) 
For detailed description see the related PR
 2019-03-29 23:31:06 +03:00
alesapin
2764401d0f Fix exception 'No message received' 2019-03-29 21:10:03 +03:00
Alexey Milovidov
88e94bad74 Removed "assumeMutable" usage in one case 2019-03-29 17:17:29 +03:00
alexey-milovidov
d10b256a8a
Merge pull request #4845 from yandex/max_partitions_per_insert_block 
Implement "max_partitions_per_insert_block" setting
 2019-03-29 16:20:46 +03:00
alexey-milovidov
976ee8a7ca
Merge pull request #4844 from yandex/fix-data-race-in-clear-old-temporary-directories 
Fixed data race in clearOldTemporaryDirectories
 2019-03-29 14:35:44 +03:00
Alexey Milovidov
8e8b5c40e2 Fixed error 2019-03-29 14:24:37 +03:00
Artem Zuikov
03cd41fbc7
Merge pull request #4774 from Gladdy/martijn-asof-join 
Request for feedback on implementation of ASOF join
 2019-03-29 13:19:31 +03:00
Alexey Milovidov
72d021c3d7 Implement "max_partitions_per_insert_block" setting #4700 2019-03-29 12:45:55 +03:00
Alexey Milovidov
8cb1619607 Implement "max_partitions_per_insert_block" setting #4700 2019-03-29 12:34:07 +03:00
Alexey Milovidov
8d3ef5df19 Fixed data race in clearOldTemporaryDirectories 2019-03-29 12:28:16 +03:00
Alexey Milovidov
34c0682353 Removed useless method 2019-03-29 11:37:05 +03:00
alesapin
2b9e261ab2 Better naming 2019-03-29 11:24:38 +03:00
Alexey Milovidov
a2e0f5d29c Merge branch 'master' into fix-race-condition-in-fetch-data-part 2019-03-29 04:22:20 +03:00
alexey-milovidov
72f27f4dec
Merge pull request #4836 from yandex/fix-race-condition-in-system-tables 
Fixed TSan report in StorageSystemTables
 2019-03-29 04:15:00 +03:00
Alexey Milovidov
46be1608a6 Fixed error #4836 2019-03-29 02:17:22 +03:00
Alexey Milovidov
3fb9814e3e Fixed race condition in fetchPart 2019-03-28 22:59:07 +03:00
Alexey Milovidov
350a0fe129 Miscellaneous 2019-03-28 22:58:41 +03:00
Alexey Milovidov
4645422176 Fixed TSan report in StorageSystemTables 2019-03-28 22:13:59 +03:00
alesapin
18d19aa346 More precise estimation of rows 2019-03-28 18:03:49 +03:00
Alexey Milovidov
4417705f32 Merge branch 'master' into cow-ptr-compositions 2019-03-28 17:47:59 +03:00
alesapin
594f91dd9d Save index granularity bytes into zookeeper 2019-03-28 15:44:14 +03:00
alesapin
1b8392a3d0 Style fixed 2019-03-28 12:02:56 +03:00
alesapin
5332642fee CI Fails fixes and little performance improvement 2019-03-28 11:52:09 +03:00
alesapin
3abf5e4ac0 Better code 2019-03-28 10:45:42 +03:00
alesapin
b3210550cb Fix stupid bug 2019-03-28 10:37:46 +03:00
alesapin
77554fd644 Remove unused variable 2019-03-27 21:02:19 +03:00
alesapin
ad16c7c931 Slightly better performance on index granularity 2019-03-27 20:33:55 +03:00
alesapin
e449760fde Remove debug print 2019-03-27 19:50:01 +03:00
alesapin
5528edea93 Fix build warnings 2019-03-27 19:23:38 +03:00
alesapin
22a75196ab Slightly more faster 2019-03-27 18:57:14 +03:00
alesapin
7c8236e145 Accident change 2019-03-27 17:14:27 +03:00
Martijn Bakker
ac68fc8088 pass the half-enforced style checks such that they cannot be run on a whole file automatically :( 2019-03-26 22:05:51 +00:00
Martijn Bakker
f6987cfa52 have the parser recognize asof joins and feed them through to the executor 
insert the time series into a struct ready for joining

working version that inserts the data into the hash table using the existing dispatching machinery for various types

working asof left join in clickhouse

add a test for the asof join

do some asof join cleanup

revisit the logic in case the values match between left and right side
 2019-03-26 19:17:21 +00:00
alexey-milovidov
aab7c79220
Merge pull request #4671 from LiuYangkuan/Buffer-supportsPrewhere 
change supportsPrewhere() of Buffer and return its destination_table supportsPrewhere
 2019-03-26 19:55:27 +03:00
alexey-milovidov
c2e4942009
Merge pull request #4705 from 4ertus2/ast 
SelectQueryOptions + fix duplicates in GLOBAL JOIN with asterisks
 2019-03-26 19:45:27 +03:00
alexey-milovidov
d047a62e31
Merge pull request #4790 from TCeason/fix_crash 
Fix crash when distributed modify order by
 2019-03-26 19:41:00 +03:00
alesapin
2b27b7f702 Fix indices 2019-03-26 17:40:03 +03:00
alesapin
48fb090cda Small fixes 2019-03-26 15:37:42 +03:00
alesapin
0378400972 Move all vertically possible streams to stopcondition 2019-03-26 14:37:32 +03:00
alesapin
2d0224aab4 Add average blocks size for ReplacingBlockInputStream 2019-03-26 13:23:14 +03:00
alesapin
2dfd6779f6 Remove exception 2019-03-26 12:46:09 +03:00
alesapin
bfbe1263ac Allow empty parts 2019-03-26 12:12:48 +03:00
tai
9d232778fc Fix crash when distributed modify order by 
Did not determine if order_by_ast is empty.
If it is null, it will clone a null pointer and cause server crash.
 2019-03-26 13:33:39 +08:00
proller
1584fd4367
Fix hyperscan library find and use (#4798) 2019-03-26 00:31:00 +03:00
alesapin
c0e29d3fb4 Fix first time read from mark 2019-03-25 19:55:48 +03:00
alesapin
aba51a11ba Large refactoring (only compilable) 2019-03-25 16:55:24 +03:00
alesapin
673a72eac6 Merge remote-tracking branch 'origin' into adaptive_index_granularity 2019-03-25 11:41:38 +03:00
Alexey Milovidov
fb19cf1eec Attempt to make compositions with COWPtr more convenient 2019-03-25 04:43:54 +03:00
Alexey Milovidov
25ab402d21 ParserCreateQuery: moved code to cpp 2019-03-24 01:45:28 +03:00
Alexey Milovidov
ba474ab21a Merge branch 'master' of github.com:yandex/ClickHouse 2019-03-23 04:27:16 +03:00
Alexey Milovidov
5a7237cc13 Miscellaneous 2019-03-23 04:27:08 +03:00
alexey-milovidov
69340528ff
Merge pull request #4772 from yandex/fix-force-recheck-parts 
Recheck parts in ReplicatedMergeTreeAlterThread in case of error
 2019-03-23 04:22:55 +03:00
Nikolai Kochetov
2311bbd95c Restore recheck parts in ReplicatedMergeTreeAlterThread in case of error. 2019-03-22 20:24:35 +03:00
chertus
0cc90cf2db rename insert_sample_with_metadata setting 2019-03-22 19:15:44 +03:00
alesapin
5aea16e2a0 Fix mutations bug 2019-03-22 15:56:58 +03:00
proller
fce9db12b9 Move Interpreters/Settings* -> Core/Settings* 2019-03-22 15:08:30 +03:00
proller
d6d83d4a5c
Allow build without ssl (#4525) (#4750) 2019-03-22 14:18:24 +03:00
alesapin
2a455af214 Merge remote-tracking branch 'origin' into adaptive_index_granularity 2019-03-21 16:39:50 +03:00
alesapin
ef5162e2e3 Some fixes 2019-03-20 23:01:15 +03:00
alesapin
fb555359e7 Read by block size only in case of Vertical merge 2019-03-20 20:20:10 +03:00
alesapin
0848380c19 Fix missed mark position inc 2019-03-20 20:11:43 +03:00
alesapin
b5d6813604 Fix vertical merge again 2019-03-20 20:04:34 +03:00
Nikita Vasilev
c10f10cc0b Merge remote-tracking branch 'upstream/master' into nikvas0/bloom_filter_index 2019-03-20 19:39:18 +03:00
alesapin
95a8be569d Check marks for adaptive granularity 2019-03-20 19:18:13 +03:00
Nikita Vasilev
09b9fe9491 _v1 2019-03-20 17:52:05 +03:00
liuyangkuan
fbcf82c4df add interpretation of PREWHERE in StorageBuffer::read 2019-03-20 14:45:04 +08:00
alesapin
ec474472e4 Make avg block size for stream optional 2019-03-19 17:36:42 +03:00
alesapin
2f037bad58 Fix bug in merging algorithm 2019-03-19 16:10:24 +03:00
alesapin
6c91bf8ba3 Remove redundant file 2019-03-19 13:26:53 +03:00
alesapin
76c31a7764 More tests on alter 2019-03-19 13:19:40 +03:00
alesapin
d8aa5c7c49 Slightly clearer debug and fix alter 2019-03-19 12:57:29 +03:00
alesapin
4ad4fc3f7b Fix granule size less than row size 2019-03-18 19:21:52 +03:00
alesapin
3fb494fea1 Unit test 2019-03-18 19:09:47 +03:00
alesapin
05215b181f More simpliest test 2019-03-18 19:09:31 +03:00
alesapin
2b2a637a38 Simpliest write/merge/select test works 2019-03-18 18:54:58 +03:00
chertus
bd559f8db8 SelectQueryOptions v3 (no inheritance) 2019-03-18 15:05:51 +03:00
alesapin
ce03636f05 Merge master 2019-03-18 15:02:33 +03:00
chertus
b6e2697101 Merge branch 'master' into ast 2019-03-18 13:36:13 +03:00
Alexey Zatelepin
304c67da99 Merge branch 'master' into fix-add-materialized-column-after 
Conflicts:
	dbms/src/Interpreters/InterpreterCreateQuery.cpp
	dbms/src/Interpreters/InterpreterDescribeQuery.cpp
	dbms/src/Interpreters/interpretSubquery.cpp
	dbms/src/Storages/ColumnsDescription.cpp
 2019-03-17 00:46:53 +03:00
Alexey Zatelepin
0526542ce2 fix Nested columns inplace flatten [#CLICKHOUSE-3101] 2019-03-16 18:07:08 +03:00
Alexey Milovidov
a1dd8fb831 Merge branch 'master' of github.com:yandex/ClickHouse 2019-03-16 01:50:54 +03:00
Alexey Milovidov
babb4f7b73 Miscellaneous 2019-03-16 01:50:46 +03:00
Ivan
8ac3e89628
Merge pull request #4649 from abyss7/iast-as 
Implement and use method IAST::as<Derived>()
 2019-03-15 23:22:46 +03:00
Alexey Zatelepin
a2debdb724 fix use-after-free [#CLICKHOUSE-3101] 2019-03-15 21:52:45 +03:00
Alexey Zatelepin
a030ce90b5 fix build 2019-03-15 20:40:16 +03:00
Ivan Lezhankin
61954d855d More reverts 2019-03-15 20:09:14 +03:00
Alexey Milovidov
86b803350d Updated contributors 2019-03-15 19:47:46 +03:00
chertus
5104665a05 Merge branch 'master' into ast 2019-03-15 19:40:26 +03:00
Alexey Zatelepin
dac1c0a6c3 fix formatting of column comments 2019-03-15 19:37:52 +03:00
Alexey Zatelepin
b5a0a3fa23 store all kinds of columns in the same list in ColumnsDescription [#CLICKHOUSE-3101] 2019-03-15 19:37:52 +03:00
Ivan Lezhankin
4f6a494af8 Revert references where they were before refactoring. 2019-03-15 19:14:13 +03:00
chertus
ffc3974934 SelectQueryOptions v2 2019-03-15 18:57:18 +03:00
chertus
53abdccb95 refactoring: extract SelectQueryOptions 2019-03-15 16:49:58 +03:00
alexey-milovidov
40944ca356
Merge pull request #4698 from yandex/fixed-insufficient-type-check-in-has-all-any-function 
Fixed insufficient type checking in hasAll, hasAny functions
 2019-03-15 04:55:26 +03:00
alexey-milovidov
94d2c35f1d
Merge pull request #4691 from yandex/improvements_in_replication_without_zookeeper 
Add ability to start replicated table without metadata in zookeeper
 2019-03-15 04:55:07 +03:00
Alexey Milovidov
a459b2c298 Fixed insufficient type checking in hasAll, hasAny functions 2019-03-15 02:10:51 +03:00
proller
4532218456 Fix insert(NULL) in StorageSystemGraphite 2019-03-14 23:55:34 +03:00
alesapin
47dbaca52b Fix stupid error 2019-03-14 21:22:04 +03:00
proller
1a33f4da40
Optional current_thread and memory_tracker (#4664) 2019-03-14 21:03:35 +03:00
alesapin
28a3e78aa5 Remove 'Adding of unexpected local part to zookeeper' logic because it's redundant. 2019-03-14 17:46:28 +03:00
Ivan Lezhankin
a6ca8bcb10 Merge remote-tracking branch 'upstream/master' into iast-as 2019-03-14 16:05:09 +03:00
alesapin
4f43893a35 Add ability to start table without metadata in zookeeper 2019-03-14 14:49:44 +03:00
Amos Bird
b405c7456f Refinement 2019-03-14 09:44:15 +08:00
alexey-milovidov
1cd7c91404
Merge pull request #4683 from amosbird/fixempty 
Do not wait when there is not log entry.
 2019-03-14 04:16:02 +03:00
Amos Bird
a69fa003bb Do not wait when there is not log entry. 2019-03-14 09:08:06 +08:00
liuyangkuan
80e37baff8 change supportsPrewhere() of table engine Buffer and return its destination_table supportsPrewhere() or not 2019-03-13 23:15:01 +08:00
Ivan Lezhankin
0dd31b587e Fix typo 2019-03-13 14:53:31 +03:00
Nikita Vasilev
0c0c693c93 fix 2019-03-12 18:20:54 +03:00
Nikita Vasilev
ad8b714ba3 fix 2019-03-12 16:36:15 +03:00
alexey-milovidov
24d0315f1e
Update StorageMergeTree.h 2019-03-12 16:26:48 +03:00
alexey-milovidov
fc3cb57881
Update StorageMergeTree.cpp 2019-03-12 16:26:26 +03:00
alexey-milovidov
72f785bd1d
Update StorageMergeTree.cpp 2019-03-12 16:24:56 +03:00
alexey-milovidov
6daee801fa
Update StorageMergeTree.cpp 2019-03-12 16:24:03 +03:00
Nikita Vasilev
42078a6c97 improved token extractor 2019-03-12 16:17:22 +03:00
Ivan Lezhankin
4c1a0ca255 Merge remote-tracking branch 'upstream/master' into iast-as 2019-03-12 15:51:18 +03:00
proller
8227f5fe63 Arcadia fix 2019-03-12 15:06:17 +03:00
ivan-kush
3f01882310 format2 2019-03-12 08:56:02 +03:00
ivan-kush
6acb39032f format 2019-03-11 23:17:50 +03:00
Alexey Zatelepin
b9c4908edb add the missing part of the comment 2019-03-11 22:07:09 +03:00
Nikita Vasilev
df68abe893 fix 2019-03-11 21:00:51 +03:00
Nikita Vasilev
d7e18db7f6 aggregator 2019-03-11 20:59:36 +03:00
Ivan Lezhankin
a3a8b2bbf7 Include IAST_fwd.h for using ASTPtr 2019-03-11 17:01:45 +03:00
Ivan Lezhankin
d1ead22073 Rename As<…> → as<…> 2019-03-11 16:22:51 +03:00
Ivan Lezhankin
1e9f7847dc Merge remote-tracking branch 'upstream/master' into iast-as 2019-03-11 16:11:22 +03:00
Ivan Lezhankin
a7e838e328 Replace all other casts to method IAST::As<Derived> 
Also remove some redundant methods like IsIdentifier() et. al.
 2019-03-11 15:49:39 +03:00
Nikita Vasilev
d171330599 Merge remote-tracking branch 'upstream/master' into nikvas0/bloom_filter_index 2019-03-11 13:06:09 +03:00
alexey-milovidov
edb72e09ae
Merge pull request #4640 from nikvas0/nikvas0/set_opt 
Improved data skipping indices calculation
 2019-03-11 00:26:48 +03:00
ivan-kush
c3182d4ae6 fix erase 2019-03-10 23:29:58 +03:00
alexey-milovidov
617a0a8938
Merge pull request #4592 from yandex/fix-concurrent-alters2 
Fix a race condition during concurrent ALTER COLUMN queries
 2019-03-10 19:11:49 +03:00
alexey-milovidov
c7c58785b5
Merge pull request #4637 from digitalist/use_sampling-fix-for-parallel-replicas 
fix use_sampling for parallel replicas (mpetrov/madmike)
 2019-03-10 19:02:40 +03:00
Nikita Vasilev
8615834804 fix 2019-03-10 11:23:59 +03:00
Nikita Vasilev
d7892e9ec7 Merge remote-tracking branch 'upstream/master' into nikvas0/set_opt 2019-03-10 11:23:01 +03:00
alexey-milovidov
6db73152d2
Hardening debug build (experimental) (#4632) 
* Hardening debug build: more granular memory mappings and ASLR; add memory protection for mark cache and index

* Addition to prev. revision

* Addition to prev. revision

* Addition to prev. revision
 2019-03-10 06:16:51 +03:00
alexey-milovidov
24bec290b5
Merge pull request #4584 from Felixoid/system.graphite_retentions 
Rework system.graphite_retentions
 2019-03-10 04:30:53 +03:00
alexey-milovidov
128fd20adf
Update registerStorageMergeTree.cpp 2019-03-10 04:30:42 +03:00
ivan-kush
521e897a92 init 2019-03-10 00:36:00 +03:00
Nikita Vasilev
d969b64237 set(0) 2019-03-09 21:17:29 +03:00
Nikita Vasilev
7f281327d9 fix 2019-03-09 18:26:52 +03:00
Alexey Elymanov
9bb64bd6d2 remove excessive check/exception 2019-03-09 17:51:10 +03:00
Alexey Elymanov
b1052cb72e fix use_sampling for parallel replicas (mpetrov/madmike) 2019-03-09 17:30:55 +03:00
Nikita Vasilev
b9d258dc99 new set 2019-03-09 17:03:41 +03:00
Nikita Vasilev
8e65c9a094 Merge remote-tracking branch 'upstream/master' into nikvas0/set_opt 2019-03-09 14:28:31 +03:00
Nikita Vasilev
a2480d7812 aggregation 2019-03-08 22:52:21 +03:00
Mikhail f. Shiryaev
2d27331f0c Merge remote-tracking branch 'origin/master' into system.graphite_retentions 2019-03-08 17:41:40 +01:00
Nikita Vasilev
c2fa53d9d4 aggregator 2019-03-08 18:36:39 +03:00
Mikhail Filimonov
5f626dc99e Fix broken progress in 19.3 (regression in 92769a2460) 
Introduce total_rows for table function `numbers()`.

fixes https://github.com/yandex/ClickHouse/issues/4429
resolves https://github.com/yandex/ClickHouse/issues/4284
 2019-03-08 15:36:40 +01:00
Ivan Lezhankin
0e325c7a4a Replace const typeid_casts with As<Derived>() method invocations 2019-03-08 12:48:20 +03:00
Nikita Vasilev
6a86a901b4 return KeyCondition 2019-03-08 11:29:48 +03:00
Nikita Vasilev
a77d20e56d Merge remote-tracking branch 'upstream/master' into nikvas0/bloom_filter_index 2019-03-08 11:13:48 +03:00
Mikhail f. Shiryaev
9e82b44b62 Review adjustment 2019-03-08 08:00:46 +01:00
Alex Zatelepin
896b8b15f6 fix build 2019-03-07 23:52:25 +03:00
Alexey Zatelepin
f3ea9541fc add comments 2019-03-07 21:34:46 +03:00
Alexey Zatelepin
3344955154 separate Read and Write lock holders, better method names 2019-03-07 21:10:21 +03:00
Alexey Milovidov
d53da3d497 Fixed typo 2019-03-07 20:58:28 +03:00
Alexey Zatelepin
ab025805a3 alter intention lock 2019-03-07 20:21:18 +03:00
alexey-milovidov
8b0d8644c8
Update StorageSystemGraphite.cpp 2019-03-07 19:55:53 +03:00
Nikita Vasilev
fcb82ba901 Merge remote-tracking branch 'upstream/master' into nikvas0/bloom_filter_index 2019-03-07 16:55:38 +03:00
Nikita Vasilev
d82ce5ddb3 move 2019-03-07 16:54:56 +03:00
Nikita Vasilev
01e682d23c fix 2019-03-07 14:31:23 +03:00
Nikita Vasilev
a555918fca rpnbuilder 2019-03-07 12:15:58 +03:00
Mikhail f. Shiryaev
bccbd52d78 Rework system.graphite_retentions table 2019-03-07 01:05:24 +01:00
alexey-milovidov
7e4c497e19
Merge pull request #4594 from yandex/fix-low-cardinality_serialization-for-set-index 
Fix Nullable and LowCardinality serialization for set index
 2019-03-06 21:57:26 +03:00
Nikita Vasilev
565633fb2b limited like for tokenbf 2019-03-06 18:30:27 +03:00
Nikita Vasilev
c428d9a64c Merge remote-tracking branch 'upstream/master' into nikvas0/bloom_filter_index 2019-03-06 16:36:34 +03:00
alexey-milovidov
1df9c1720e
Merge pull request #4426 from Felixoid/graphite-rollup 
Graphite rollup: combined rules
 2019-03-06 03:10:45 +03:00
Nikolai Kochetov
3bcab12966 Fix test. 2019-03-05 19:52:29 +03:00
Nikolai Kochetov
4b18b7dcdc Support Nullable columns for Set index. #4486 2019-03-05 15:17:54 +03:00
Nikolai Kochetov
52c9d4e1ad (De)Serialize set index with multiple bulks. #4486 2019-03-05 15:17:37 +03:00
alexey-milovidov
3924207040
Merge pull request #4405 from yandex/move-to-prewhere-improvement 
Move to prewhere improvement
 2019-03-03 19:06:43 +03:00
Alexey Milovidov
b8ff976ee9 Merge branch 'master' into move-to-prewhere-improvement 2019-03-02 04:34:49 +03:00
Alexey Milovidov
dbab34e21f Fixed error #4526 2019-03-02 04:05:36 +03:00
Alexey Milovidov
526e6488e0 Merge branch 'master' into fix-aio-threshold 2019-03-02 02:39:25 +03:00
alexey-milovidov
97cea95f74
Merge pull request #4536 from amosbird/fixedhashtable 
A Proper lookup table that uses HashTable's API
 2019-03-01 17:47:33 +03:00
Alexey Zatelepin
5b850bad47 fix build 2019-03-01 14:42:41 +03:00
Amos Bird
26ab5dd7a7 A Proper lookup table that uses HashTable's API 
This is the first step of allowing heterogeneous cells in hash tables.

performance test results are

```

1. HashMap<UInt16, UInt8, TrivialHash, HashTableFixedGrower<16>>;
2. NewLookupMap<UInt16, UInt8>

ResolutionWidth 30000 1 .................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................223550276.46
ResolutionWidth 30000 2 .................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................248772721.24
Best: 2 - 24877272124

ResolutionWidth 100000 1 ..........................................................................................................................................................................................................................................................238498413.99
ResolutionWidth 100000 2 ..........................................................................................................................................................................................................................................................261808889.98
Best: 2 - 26180888998

ResolutionWidth 300000 1 ...................................................................................239307348.81
ResolutionWidth 300000 2 ...................................................................................257592761.30
Best: 2 - 25759276130

ResolutionWidth 1000000 1 .........................240144759.26
ResolutionWidth 1000000 2 .........................257093531.91
Best: 2 - 25709353191

ResolutionWidth 5000000 1 .....241573260.35
ResolutionWidth 5000000 2 .....259314162.79
Best: 2 - 25931416279

ResolutionDepth 30000 1 .................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................217108119.84
ResolutionDepth 30000 2 .................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................249459504.41
Best: 2 - 24945950441

ResolutionDepth 100000 1 ..........................................................................................................................................................................................................................................................229065162.17
ResolutionDepth 100000 2 ..........................................................................................................................................................................................................................................................253769105.64
Best: 2 - 25376910564

ResolutionDepth 300000 1 ...................................................................................233079225.18
ResolutionDepth 300000 2 ...................................................................................256316273.78
Best: 2 - 25631627378

ResolutionDepth 1000000 1 .........................234184633.51
ResolutionDepth 1000000 2 .........................261100491.57
Best: 2 - 26110049157

ResolutionDepth 5000000 1 .....233118795.66
ResolutionDepth 5000000 2 .....252436160.41
Best: 2 - 25243616041

```
 2019-03-01 16:47:13 +08:00
alexey-milovidov
137f800423
Update StorageSystemColumns.cpp 2019-03-01 04:08:12 +03:00
Alexey Zatelepin
eee73dac42 Merge branch 'master' into fix-concurrent-alters 2019-02-28 19:19:21 +03:00
Alexey Zatelepin
c5dde2c9fd get rid of default query_id value in RWLock::getLock [#CLICKHOUSE-3789] 2019-02-28 12:37:05 +03:00
alexey-milovidov
40d8abbc34
Merge pull request #4523 from yandex/fix_column_description_parse 
Fix column description parse. Now creation of replicated MT table wit…
 2019-02-28 01:18:31 +03:00
Alexey Milovidov
62b246c5a4 Avoid excessive "stat" syscall\ 2019-02-27 23:02:48 +03:00
Alexey Milovidov
c3623f7bb6 Fixed error with underestimation of data size to read when choosing O_DIRECT mode 2019-02-27 22:32:54 +03:00
Alexey Zatelepin
5ac1d4dd4e rename LockHandler -> LockHolder [#CLICKHOUSE-3789] 2019-02-27 21:34:38 +03:00
Alexey Zatelepin
0d7ab9e3ea allow acquiring read lock to a table out of order if it was already locked by the same query [#CLICKHOUSE-3789] 
this is important in preventing ALTER deadlocks
 2019-02-27 21:34:38 +03:00
proller
23d70b2e04
Add Y_IGNORE (#4521) 2019-02-27 19:52:08 +03:00
alesapin
1909c87885 Fix column description parse. Now creation of replicated MT table with codecs and comments is possible without default 2019-02-27 19:41:51 +03:00
Nikita Vasilev
0b20d634cd fix 2019-02-26 23:36:15 +03:00