Commit Graph

1695 Commits

Author SHA1 Message Date
Nikolai Kochetov
7da72261a2 Merge branch 'master' into try-to-remove-dry-run 2019-08-16 15:50:48 +03:00
Nikolai Kochetov
18ad0e7e6b Merged with master. 2019-08-16 13:55:40 +03:00
alexey-milovidov
a466c7aebd
Merge pull request #6299 from CurtizJ/order-by-efficient
Optimizations of ranges selection while reading with enabled optimize_read_in_order.
2019-08-16 02:39:53 +03:00
Nikolai Kochetov
a4be4da9b4 Added recursiveMaterializeConstants. 2019-08-15 10:55:59 +03:00
Nikolai Kochetov
6586f059b5 Added recursiveMaterializeConstants. 2019-08-15 10:54:39 +03:00
Nikolai Kochetov
37a88e1407 Added recursiveMaterializeConstants. 2019-08-15 10:28:33 +03:00
Gleb Novikov
5ee4238538 small change to run CI 2019-08-15 03:53:16 +03:00
Gleb Novikov
ab1c4139de Added ReplicatedMergeTree support and test for constraints, also added VIOLATED_CONSTRAINT error 2019-08-14 22:51:03 +03:00
chertus
7c566f317c refactoring: extract SelectQueryExpressionAnalyzer from ExpressionAnalyzer 2019-08-14 22:30:30 +03:00
CurtizJ
0b3d7d8032 Merge remote-tracking branch 'upstream/master' into order-by-efficient 2019-08-14 21:26:25 +03:00
CurtizJ
a785d4a435 Merge branch 'master' of https://github.com/yandex/ClickHouse into merging_with_ties_and_with_fill 2019-08-14 20:24:47 +03:00
Nikolai Kochetov
287eb633b8 Merged with master 2019-08-14 18:16:52 +03:00
Nikolai Kochetov
8f55fdbd15 Wrap const columns in RemoteBlockInputStream. 2019-08-14 18:14:37 +03:00
chertus
ddde50c542 minor fixes in includes 2019-08-14 17:06:16 +03:00
CurtizJ
22d9bd06cc Merge branch 'dmitriiut-WITH_TIES_and_WITH_FILL' of https://github.com/dmitriiut/ClickHouse into merging_with_ties_and_with_fill 2019-08-14 16:40:07 +03:00
CurtizJ
94bca8315d Merge remote-tracking branch 'upstream/master' into order-by-efficient 2019-08-14 01:41:38 +03:00
CurtizJ
c3e0ceecde wait for finish calculations at underlying streams while cancelling AsynchronousBlockInputStream 2019-08-13 21:28:18 +03:00
CurtizJ
7ae73befd6 wait for finish calculations at underlying streams while cancelling AsynchronousBlockInputStream 2019-08-13 17:07:36 +03:00
Nikolai Kochetov
18939a5776 Fix build/ 2019-08-12 13:59:45 +03:00
Nikolai Kochetov
631bbde420 Merged with master. 2019-08-12 13:19:13 +03:00
Alexey Milovidov
2570907f44 Removed useless parameter 2019-08-12 00:45:18 +03:00
Gleb Novikov
381ea6cb6e Merge branch 'master' into table-constraints 2019-08-11 12:38:34 +03:00
Gleb Novikov
0233f32f9b Fixed AddresSanitizer error 2019-08-11 12:28:15 +03:00
Ivan
cce3ab08bb
Do not convert columns by position when pushing to materialized views (#6415)
* Do not convert columns by position
* Update 00984_materialized_view_to_columns.reference
2019-08-11 00:00:13 +03:00
kreuzerkrieg
112fc71276 adding -Wshadow for GCC 2019-08-09 23:58:16 +03:00
Nikolai Kochetov
40cc399037 Fix PushingToViewsBlockOutputStream. 2019-08-09 20:15:01 +03:00
Nikolai Kochetov
2ae3db7920 Merged with master. 2019-08-09 18:32:44 +03:00
Nikolai Kochetov
804a6fad8a Do not return extremes and totals for insert select. 2019-08-08 17:46:30 +03:00
Alexey Milovidov
a23813383d Attempt to fix performance test 2019-08-08 03:48:43 +03:00
Nikolai Kochetov
e361d336bb
Merge pull request #6239 from yandex/processors-and-output-formats
Processors and output formats
2019-08-05 19:45:17 +03:00
CurtizJ
cfe32ad89b Merge remote-tracking branch 'upstream/master' into order-by-efficient 2019-08-04 21:43:00 +03:00
Amos Bird
39b8141418 Fix recursive materialized view 2019-08-05 02:01:16 +08:00
Nikolai Kochetov
599f3ddf6e Merged with master. 2019-08-04 15:35:21 +03:00
Alexey Milovidov
8b8c59d71b Simplification of #3796 2019-08-04 03:29:32 +03:00
Alexey Milovidov
224bc4df97 Minor modifications + a comment #3796 2019-08-04 03:12:17 +03:00
alexey-milovidov
b045e85469
Merge pull request #3796 from amosbird/hang
Fix materialized view with column defaults.
2019-08-04 03:06:40 +03:00
alexey-milovidov
d3e4249420
Merge branch 'master' into ttldropparts 2019-08-03 02:17:29 +03:00
alexey-milovidov
149ed67462
Merge pull request #6281 from yandex/fix-low-cardinality-aggregate-arguments
Fix LowCardinality arguments conversion in AggregateFunctionFactory
2019-08-03 01:50:21 +03:00
alexey-milovidov
f8980e691e
Merge pull request #6274 from CurtizJ/ttl-old-parts
TTL improvements.
2019-08-02 22:51:28 +03:00
CurtizJ
5f7ebb18ed more optimal ranges selection at reading in order 2019-08-02 19:16:18 +03:00
Nikolai Kochetov
0201cdf61a Merge branch 'master' into processors-and-output-formats 2019-08-02 15:29:19 +03:00
Nikolai Kochetov
77ca4acf67 Remove LowCardinality in AggregatingSortedBlockInputStream. 2019-08-02 13:54:40 +03:00
Nikolai Kochetov
5a9a4b23c3 Remove LowCardinality in AggregatingSortedBlockInputStream. 2019-08-02 13:50:42 +03:00
Nikolai Kochetov
f71ce27a70 Remove LowCardinality in AggregatingSortedBlockInputStream. 2019-08-02 13:49:52 +03:00
CurtizJ
82f304f81e add query 'SYSTEM STOP TTL MERGES' 2019-08-01 18:36:12 +03:00
CurtizJ
f224269d41 filter by ttl parts created before 'alter ... modify ttl' query with 'optimize ... final' query 2019-08-01 14:10:42 +03:00
Sergi Vladykin
662364b720 performance bug fix: never read the children if we are not going to return any data 2019-07-31 22:36:03 +03:00
Nikolai Kochetov
0e61ca79d0 Update FormatFactory. 2019-07-31 13:34:31 +03:00
alexey-milovidov
bfdfb7c814
Merge pull request #6232 from yandex/limit-sleep-time-in-max-execution-speed
Limit sleep time in max_execution_speed; fixed Estimated query execution time (inf seconds) is too long
2019-07-31 05:54:05 +03:00
alexey-milovidov
7fd6204114
Merge pull request #6197 from yandex/thread_local_rng
Less number of "clock_gettime" calls; fixed ABI compatibility between debug/release in Allocator.
2019-07-31 04:36:30 +03:00
Alexey Milovidov
2205a0097d Avoid false exceptions like "Estimated query execution time (inf seconds) is too long" 2019-07-31 03:05:31 +03:00
Alexey Milovidov
f75dff9be8 Limit maximum sleep time for "max_execution_speed" settings 2019-07-31 02:57:53 +03:00
CurtizJ
218de76285 fix rollup and cube modifiers with two-level aggregation 2019-07-30 19:36:52 +03:00
Amos Bird
6db1c02bfd Fix materialized view with column defaults.
https://github.com/yandex/ClickHouse/issues/448
https://github.com/yandex/ClickHouse/issues/3484
https://github.com/yandex/ClickHouse/issues/3450
https://github.com/yandex/ClickHouse/issues/2878
https://github.com/yandex/ClickHouse/issues/2285
2019-07-30 10:49:54 +08:00
Gleb Novikov
a3ebe31535 Brace style fix 2019-07-29 22:41:08 +03:00
Sergi Vladykin
915092515c revert the performance bug fix 2019-07-29 11:20:11 +03:00
Alexey Milovidov
856cc1b9c5 Added thread_local_rng 2019-07-28 18:30:38 +03:00
Gleb Novikov
8f4883b0d2 Better constraint exception 2019-07-28 15:33:40 +03:00
Sergi Vladykin
c5a42a6948 TTL: Only drop altogether the expired parts and not partially prune them.
Though in regular merges eviction of expired values still must happen.
2019-07-28 13:30:46 +03:00
CurtizJ
08d5ebb54d Merge remote-tracking branch 'upstream/master' into order-by-efficient 2019-07-27 10:38:10 +03:00
Nikolai Kochetov
079e41ac26 Use IInputFormat and IOutputFormat by default. 2019-07-25 13:51:32 +03:00
alexey-milovidov
e4ad0da6e3
Merge pull request #4247 from laplab/query-poor-mans-profiler
Poor man's profiler on query level [Work in progress]
2019-07-23 03:02:58 +03:00
alexey-milovidov
67b72f4261
Merge pull request #6029 from yandex/aku/agg-arenas
Do not access shared arenas in aggregate function columns.
2019-07-20 03:16:24 +03:00
CurtizJ
b9dc472071 Merge remote-tracking branch 'upstream/master' into order-by-efficient 2019-07-19 01:09:59 +03:00
chertus
8f168005d9 disable (not working) defaults for table functions in HTTP 2019-07-18 19:54:31 +03:00
CurtizJ
4380404604 skip block with zero rows in MergingSortedBlockInputStream 2019-07-18 18:09:08 +03:00
CurtizJ
a3d25790bd basic implementation of reading in pk order and 'order by' optimization 2019-07-18 17:41:11 +03:00
chertus
6885e892ae do not damage ColumnsDescription in TTLBlockInputStream (appempt 2) 2019-07-18 16:44:29 +03:00
chertus
5f510d5657 fix damage ColumnsDescription in TTLBlockInputStream 2019-07-18 16:30:02 +03:00
Alexander Kuzmenkov
9df09f3506 Do not access shared arenas in aggregate function columns.
These arenas may be updated concurrently, so it is unsafe to
access them, as illustrated by issue #4402. Store them separately
and use a different arena for the updates. Change some callers
to accomodate for this.
2019-07-18 14:21:37 +03:00
chertus
fbc0c87c18 enable input_format_defaults_for_omitted_fields & disable (not working) defaults for table functions 2019-07-17 21:30:17 +03:00
alesapin
f5b7523429
Merge pull request #5899 from yandex/aku/perftest-mem
Report memory usage in performance tests.
2019-07-16 18:09:44 +03:00
Nikolai Kochetov
e9f3d4d6b8
Merge pull request #4914 from yandex/processors
Processors
2019-07-11 19:22:02 +03:00
Nikita Lapkov
9d540abc84 refactor 2019-07-10 20:47:39 +00:00
Vitaliy Zakaznikov
c84fd80345 * Fixing clang build by converting old style cast (Int64) to static_cast<Int64>. 2019-07-09 22:06:29 -04:00
Alexander Kuzmenkov
8c379fb972 Flush query log instead of waiting for it. 2019-07-09 17:22:42 +03:00
Vitaliy Zakaznikov
a80af666ad * Updates that incorporate comments from the review 2019-07-09 08:41:55 -04:00
alexey-milovidov
a8d8eb6b28
Merge pull request #5921 from yandex/pvs-studio-fixes-4
A few fixes for PVS-Studio
2019-07-09 01:10:05 +03:00
Alexander Kuzmenkov
78df28f0e9 Cleanup. 2019-07-08 18:35:32 +03:00
Nikolai Kochetov
a2cdab2799 Fix build. 2019-07-08 16:07:46 +03:00
Nikolai Kochetov
209793c981 Merged with master. 2019-07-08 16:00:54 +03:00
Alexey Milovidov
f40b70884f Two more fixes for PVS-Studio 2019-07-08 05:14:32 +03:00
Alexey Milovidov
ac20c515ab Better code in unit tests 2019-07-08 04:58:31 +03:00
Vitaliy Zakaznikov
24a3726235 Merge branch 'master' of https://github.com/vzakaznikov/ClickHouse into liveview 2019-07-07 20:03:14 -04:00
Alexander Kuzmenkov
a43d3a6902 Report memory usage in performance tests. 2019-07-05 19:50:44 +03:00
CurtizJ
410b62f7fa Merge branch 'clickhouse-4013' of https://github.com/anrodigina/ClickHouse into order-by-efficient 2019-07-05 13:48:04 +03:00
Nikita Lapkov
0f579860f7 Merge remote-tracking branch 'upstream/master' into query-poor-mans-profiler 2019-07-04 22:13:51 +00:00
Gleb Novikov
71c2ca0fe9 Merge branch 'master' into table-constraints 2019-07-04 22:40:00 +03:00
alexey-milovidov
d81ae49f2c
Merge pull request #5755 from 4ertus2/bugs
Fix wrong ColumnConst.isColumnNullable()
2019-07-03 02:06:07 +03:00
Vitaliy Zakaznikov
b5120931d5 Merge branch 'master' of https://github.com/yandex/ClickHouse into liveview 2019-07-01 18:12:31 -04:00
Vitaliy Zakaznikov
a363189dfc Merge branch 'master' of https://github.com/vzakaznikov/ClickHouse into liveview 2019-07-01 18:05:14 -04:00
alexey-milovidov
c43dfce041
Merge pull request #5382 from abyss7/issue-5286
Add virtual columns to Kafka Engine tables
2019-07-01 21:30:09 +03:00
alexey-milovidov
bf8c154d3d
Merge pull request #5819 from CurtizJ/fix-segfault-ttl
Fix segfault in TTL merge with non-physical columns in block.
2019-07-01 20:28:26 +03:00
CurtizJ
ecf9feab9c remove extra semicolon 2019-07-01 17:09:22 +03:00
CurtizJ
c0a63801fc fix segfault in ttl merge with non-physical columns in block 2019-07-01 15:50:50 +03:00
chertus
5df4ad0f28 Merge branch 'master' into bugs 2019-07-01 14:49:01 +03:00
alexey-milovidov
106a2d0c0f
Merge pull request #4930 from yandex/tsan-miscellaneous
Miscellaneous changes
2019-07-01 11:11:53 +03:00
alexey-milovidov
5fb7bf6854
Update ParallelInputsProcessor.h 2019-07-01 03:15:14 +03:00
Gleb Novikov
bb78012cf9 Removed unused method and assertions 2019-06-30 12:09:06 +02:00
Gleb Novikov
a146b7383e Merge branch 'master' into table-constraints 2019-06-30 11:32:02 +02:00
chertus
f19dee706a move IColumn.isColumnConst() outside of interface 2019-06-27 22:28:52 +03:00
Danila Kutenin
e67431e455 Use mimalloc instead of lfallocator 2019-06-27 18:13:19 +03:00
Nikita Lapkov
7cff36fbfc Merge remote-tracking branch 'upstream/master' into query-poor-mans-profiler 2019-06-26 11:46:04 +00:00
Nikolai Kochetov
f9b29bfdd2 Merged with master. 2019-06-25 20:00:54 +03:00
Ivan Lezhankin
61750d09d2 Commit offsets for SELECTing from Kafka table too 2019-06-20 15:34:25 +03:00
Ivan Lezhankin
9fd048cdbd Allow to select virtual columns in materialized view 2019-06-18 19:32:37 +03:00
Ivan Lezhankin
436052c67b Merge branch 'master' into issue-5286 2019-06-18 16:03:29 +03:00
Vitaliy Zakaznikov
51bf8a1baa Merge branch 'master' of https://github.com/vzakaznikov/ClickHouse into liveview 2019-06-17 12:42:31 -04:00
Ivan Lezhankin
d907d8e8ca Commit offsets for SELECTing from Kafka table too 2019-06-17 19:27:18 +03:00
alesapin
e45d727e9d
Merge pull request #4558 from podshumok/distributred-timeout
Distributed and remote timeouts
2019-06-17 13:58:17 +03:00
Vitaliy Zakaznikov
ea83a4cafa * Removing 'hash' column from WATCH [db.live_view] EVENTS query result
as hash of the result are not usually provided in ClickHouse.
  This is also done to match the implementation of the SELECT query that only
  returns '_version' virtual column when using LIVE VIEW tables.
2019-06-16 07:09:43 -04:00
Gleb Novikov
15004ce055 Merge branch 'master' into table-constraints 2019-06-14 23:10:48 +03:00
Vitaliy Zakaznikov
117f2d191e Merge branch 'master' of https://github.com/vzakaznikov/ClickHouse into liveview 2019-06-13 15:23:20 -04:00
Alexey Milovidov
8b87511e25 Namespace comments are unneeded according to the code style.
find dbms -name '*.h' -or -name '*.cpp' | xargs grep -l -P '}\s*//+\s*namespace\s*' | xargs sed -i -r -e 's/}\s*\/\/+\s*namespace\s*\w+/}/'
2019-06-13 13:37:13 +03:00
Vitaliy Zakaznikov
5983273694 Fixing bugs reported by sanitizers
* data race condition on storage is_dropped access
* invalid reference to storage after it is deleted
* invalid reference to mutex after storage is deleted
2019-06-12 09:11:44 -04:00
Vitaliy Zakaznikov
12060d8879 * Fixing errors that prevented clang build. 2019-06-11 08:27:47 -04:00
Vitaliy Zakaznikov
b6efd8599f * Trying again to fix style checks. Now running ./utils/check-style/check-style reports no errors. 2019-06-11 06:30:57 -04:00
Vitaliy Zakaznikov
a467e7c105 * Moving uexpect.py so that it can be found
* Trying to fix failed style checks
* Trying to fix clang build fail
2019-06-10 22:22:53 -04:00
Vitaliy Zakaznikov
fc4ea55b98 * Fixing bug in dbms/src/DataStreams/PushingToViewsBlockOutputStream.cpp
that was introduced when trying to fix a clang error.
2019-06-10 08:11:43 -04:00
Vitaliy Zakaznikov
a68980ab38 * Style check fixes 2019-06-10 07:41:33 -04:00
Vitaliy Zakaznikov
87b58e4150 * Fixing clang errors
* Fixing LIVE VIEW tests
2019-06-10 07:18:33 -04:00
Vitaliy Zakaznikov
b65ff910b6 Merge branch 'master' of https://github.com/vzakaznikov/ClickHouse into liveview 2019-06-07 08:02:59 -04:00
Vitaliy Zakaznikov
2930965938 * Renaming live_view_heartbeat_delay setting to live_view_heartbeat_interval
and making the setting to be in seconds instead of usec
* Updated LIVE VIEW table to keep version consistent as long as the server is up
* Removed calculation of hash in writeIntoLiveView method as it is recalculated
  in the LiveViewBlockOutputStream
* Changed to using values from the local context for live_view_heartbeat_interval and
  temporary_live_view_timeout instead of the global context
* Updated LIVE VIEW tests to match the changes
2019-06-06 21:10:56 -04:00
Gleb Novikov
375e464086 Fixed exception text 2019-06-06 00:25:48 +03:00
Vitaliy Zakaznikov
5f3be8134d * Disallowing writes into LIVE VIEW tables
* Adding support for watching live views via HTTPHandler
* Small fix to WriteBufferValidUTF8.cpp to propagate next() call
* Updated copyData.cpp to treat block with no rows as
  "flush block"
* Updated PushingToViewsBlockOutputStream.cpp to directly use
  LIVE VIEW output stream instead of calling its write method
2019-06-05 07:30:29 -04:00
Gleb Novikov
f413b1e346 Implemented memoryIsByte, replaced memoryIsZero with it, implemented memory check in CheckConstraintsBlockOutputStream 2019-06-05 11:05:46 +03:00
Gleb Novikov
b63623d014 Extended constraint exception with constraint name and expression 2019-06-05 10:33:34 +03:00
Ivan Lezhankin
b311984879 Merge remote-tracking branch 'upstream/master' into issue-5286 2019-06-03 17:19:09 +03:00
Konstantin Podshumok
f993ea6127 add timeouts to remote streams 2019-06-02 12:43:20 +03:00
Gleb Novikov
2b5cf46842 Merge branch 'master' into table-constraints 2019-06-02 08:33:36 +03:00
palasonicq
ea86a758a1 Added some improvements after code review 2019-05-30 23:12:44 +03:00
Nikita Lapkov
8f36af7760 Merge remote-tracking branch 'upstream/master' into query-poor-mans-profiler 2019-05-30 10:33:33 +00:00
Vitaliy Zakaznikov
673d1a46a0 * Adding support for _version virtual column to LIVE VIEWs when using SELECT
* Adding support for _version column to LIVE VIEWS when using WATCH query
* Adding initial support for WATCH query on LIVE VIEWs
2019-05-29 17:52:13 -04:00
Vitaliy Zakaznikov
d112695c42 * Adding other changes to support LIVE VIEWs 2019-05-28 17:17:48 -04:00
palasonicq
0823e397ea Added missed modifications 2019-05-28 21:30:10 +03:00
Ivan Lezhankin
1eccbc39c5 Don't add virtual column to empty block 2019-05-28 00:01:24 +03:00
Anastasiya Rodigina
21e27cb854 Make custom upper_bound - probably will change it 2019-05-27 10:50:37 +00:00
Gleb Novikov
1aaab07459 Fixed exception handling in 00952 test 2019-05-27 02:57:18 +03:00
Vitaliy Zakaznikov
9dd07bcc23 * Work in progress to redo live view implementation to be less invasive 2019-05-26 18:03:30 -04:00
Anastasiya Rodigina
cd5b3e60c5 Try 2 to fix tests 2019-05-26 21:41:12 +00:00
Anastasiya Rodigina
abec62bc5d Try 1 to fix tests - edit tabs 2019-05-26 20:47:48 +00:00
Anastasiya Rodigina
1c3f6ee6f0 Try 1 to fix tests - edit tabs 2019-05-26 20:43:46 +00:00
Anastasiya Rodigina
99f1aa65b3 Try 1 to fix tests 2019-05-26 20:41:51 +00:00
Gleb Novikov
337897c4b8 Merge branch 'master' into table-constraints 2019-05-26 12:36:02 +03:00
Yuriy
96e3574a06 Improvements of MySQL Wire Protocol 2019-05-26 09:52:29 +03:00
alexey-milovidov
461c4919d3
Merge pull request #5116 from PerformanceVision/send_header
Send a X-ClickHouse summary on the header for HTTP client with number of rows inserted
2019-05-25 20:20:35 +03:00
Nikita Lapkov
06d370dee2 Merge remote-tracking branch 'upstream/master' into query-poor-mans-profiler 2019-05-25 16:23:08 +00:00
Alexey Milovidov
b94f2be154 Merge branch 'mysql' of https://github.com/yurriy/ClickHouse into yurriy-mysql 2019-05-25 17:14:57 +03:00
Gleb Novikov
c401d282da Merge branch 'master' into table-constraints 2019-05-25 14:26:08 +03:00
Nikita Lapkov
30c31bc85a Merge remote-tracking branch 'upstream/master' into query-poor-mans-profiler 2019-05-24 13:28:42 +00:00