Commit Graph

1530 Commits

Author SHA1 Message Date
Ivan Lezhankin
dcff73c8d4 Fix build 2019-05-17 21:45:42 +03:00
Ivan Lezhankin
0821d62516 Merge ITableDeclaration into IStorage.
Also a couple of massive include-refactorings with better forwarding
2019-05-17 17:34:25 +03:00
Artem Zuikov
4eee10d788
Merge pull request #5271 from 4ertus2/some
Cache ExpressionBlockInputStream header
2019-05-17 13:14:22 +03:00
chertus
927557b0f8 move caching to ctor 2019-05-16 20:16:25 +03:00
Yuriy
0cd3094240 fixed stack buffer overflow 2019-05-16 20:15:43 +03:00
Yuriy
a51c293ec6 merged 'origin/master' into mysql 2019-05-16 14:19:05 +03:00
Yuriy
4ee84810b0 including information about query execution in response 2019-05-16 08:36:08 +03:00
Yuriy
459ec05828 fixed style 2019-05-16 06:45:17 +03:00
Yuriy
ff4937859e added MySQL wire protocol presentational format 2019-05-16 06:34:04 +03:00
chertus
4a5e2dfd3c cache ExpressionBlockInputStream header 2019-05-14 21:26:19 +03:00
Ivan
4a5832b18a
Check the time limit every (flush_interval / poll_timeout) number of rows from Kafka (#5249) 2019-05-14 18:52:03 +03:00
Nikolai Kochetov
808d0f3b08 Merged with master. 2019-05-14 13:31:19 +03:00
Anastasiya Rodigina
af4fff970b Revert "Changes in read in pk_order, UnionBlockInputStream and InterpreterSelectQuery"
This reverts commit 61d49e1e5f.
2019-05-10 23:22:45 +03:00
Anastasiya Rodigina
61d49e1e5f Changes in read in pk_order, UnionBlockInputStream and InterpreterSelectQuery 2019-05-10 22:09:15 +03:00
alexey-milovidov
8f8d2c048e
Merge pull request #4629 from bgranvea/simple_aggregate_function
SimpleAggregateFunction data type
2019-05-09 18:45:59 +03:00
alexey-milovidov
b611bc0695
Update ReverseBlockInputStream.h 2019-05-05 23:25:49 +03:00
alexey-milovidov
00753506dc
Update ReverseBlockInputStream.cpp 2019-05-05 23:24:05 +03:00
alexey-milovidov
c04c614bc0
Merge branch 'master' into clickhouse-4013 2019-05-05 23:22:45 +03:00
Alexey Milovidov
1be21e3cb6 Removed bad and useless code in ColumnsDescription 2019-05-02 00:43:05 +03:00
CurtizJ
7766f5c0c3 added offset for limit by 2019-04-29 16:12:39 +03:00
Anastasiya Rodigina
87b49f13b7 Edit review issues 2019-04-27 15:43:28 +03:00
Anastasiya Rodigina
e750755f8f Add comments and edit style 2019-04-27 14:59:08 +03:00
dmitriiut
a2c3fd2057 bug fixes 2019-04-23 04:48:51 +03:00
Alexey Milovidov
58d7d1e451 Resolved some of PVS-Studio warnings 2019-04-22 19:07:09 +03:00
dmitriiut
50c322bc6d WITH FILL version 2019-04-22 02:04:23 +03:00
dmitriiut
3c2922c406
Merge branch 'master' into dmitriiut-WITH_TIES_and_WITH_FILL 2019-04-21 19:37:38 +03:00
dmitriiut
e94575e1da fix progress 2019-04-21 19:16:25 +03:00
dmitrii
100cee18c3 comments + fix naming 2019-04-19 18:45:42 +03:00
dmitrii
a130850e15 limit with ties 2019-04-19 16:38:25 +03:00
Anastasiya Rodigina
a11fcffd0e fix style (removed whitespace) 2019-04-18 02:07:36 +03:00
Anastasiya Rodigina
ef0be2a721 Fix build and style issues 2019-04-18 01:58:24 +03:00
Anastasiya Rodigina
0c1735f1b1 ReverseBlockInputStream, optimization of group by, tests 2019-04-18 00:20:51 +03:00
alesapin
faeb95cfd7
Merge branch 'master' into adaptive_index_granularity 2019-04-15 19:36:36 +03:00
Anton Popov
7f93f9ad2f TTL for columns and tables (#4212)
Add TTL for columns and tables.
2019-04-15 12:30:45 +03:00
Danila Kutenin
622b2c8472 Enable LFAlloc for MarkCache and UncompressedCache 2019-04-13 15:07:43 +03:00
Nikolai Kochetov
54b15385bd Calculate rows_before_limit_at_least. 2019-04-08 17:55:20 +03:00
bgranvea
42b07c5ee9 refactor to avoid dynamic_cast in data type serialization 2019-04-08 15:39:42 +02:00
bgranvea
faa7d38cb5 fix for style 2019-04-08 15:39:42 +02:00
bgranvea
9d9d16e1ea support for SimpleAggregateFunction data type 2019-04-08 15:39:41 +02:00
alesapin
a53b002973 Merge remote-tracking branch 'origin' into adaptive_index_granularity 2019-04-08 14:29:33 +03:00
Alexey Milovidov
879d746abd Miscellaneous changes 2019-04-07 01:20:09 +03:00
Danila Kutenin
1c030e4ed1 Fix allocations for a while 2019-04-06 23:53:25 +03:00
Danila Kutenin
37d70ac558 MarkCache and UncompressedCache use different allocator to catch segfaults more reliable 2019-04-06 18:27:39 +03:00
Alexey Milovidov
571bc7065a Removed unused code related to MemoryTracker 2019-04-06 01:35:56 +03:00
Ivan Lezhankin
34cf495db8 Fix BlockIO::operator= 2019-04-05 19:21:46 +03:00
Nikolai Kochetov
7626b1b267 Multiple fixes. 2019-04-05 13:52:07 +03:00
Nikolai Kochetov
5e39ec610c Merged with master 2019-04-03 14:21:38 +03:00
Nikolai Kochetov
94ff7f694a QueryPipeline [in progress]. 2019-04-03 13:14:36 +03:00
alesapin
da19254fa9 Remove useless code 2019-04-01 14:29:31 +03:00
alesapin
7b67200258 Merge remote-tracking branch 'origin' into adaptive_index_granularity 2019-04-01 11:54:19 +03:00
Ivan
957d23267b
Minimal implementation of row-level security CLICKHOUSE-4315 (#4792)
For detailed description see the related PR
2019-03-29 23:31:06 +03:00
zhang2014
aab314f154 const insert interpreter 2019-03-29 23:47:16 +08:00
Alexey Milovidov
c8bc4d6e26 Fixed error 2019-03-28 19:48:14 +03:00
Alexey Milovidov
fa598d427d Fixed error 2019-03-28 19:28:54 +03:00
alesapin
c139c801f8 Better stop condition 2019-03-28 14:12:59 +03:00
alesapin
1b12d0219c Fix build 2019-03-28 12:31:57 +03:00
alesapin
1b8392a3d0 Style fixed 2019-03-28 12:02:56 +03:00
alesapin
5332642fee CI Fails fixes and little performance improvement 2019-03-28 11:52:09 +03:00
alesapin
e449760fde Remove debug print 2019-03-27 19:50:01 +03:00
alesapin
48fb090cda Small fixes 2019-03-26 15:37:42 +03:00
alesapin
0378400972 Move all vertically possible streams to stopcondition 2019-03-26 14:37:32 +03:00
alesapin
2d0224aab4 Add average blocks size for ReplacingBlockInputStream 2019-03-26 13:23:14 +03:00
alesapin
673a72eac6 Merge remote-tracking branch 'origin' into adaptive_index_granularity 2019-03-25 11:41:38 +03:00
Alexey Milovidov
fb19cf1eec Attempt to make compositions with COWPtr more convenient 2019-03-25 04:43:54 +03:00
proller
fce9db12b9 Move Interpreters/Settings* -> Core/Settings* 2019-03-22 15:08:30 +03:00
alesapin
b5d6813604 Fix vertical merge again 2019-03-20 20:04:34 +03:00
alesapin
95a8be569d Check marks for adaptive granularity 2019-03-20 19:18:13 +03:00
alesapin
ec474472e4 Make avg block size for stream optional 2019-03-19 17:36:42 +03:00
alesapin
2f037bad58 Fix bug in merging algorithm 2019-03-19 16:10:24 +03:00
alesapin
d8aa5c7c49 Slightly clearer debug and fix alter 2019-03-19 12:57:29 +03:00
alesapin
ce03636f05 Merge master 2019-03-18 15:02:33 +03:00
Alexey Zatelepin
304c67da99 Merge branch 'master' into fix-add-materialized-column-after
Conflicts:
	dbms/src/Interpreters/InterpreterCreateQuery.cpp
	dbms/src/Interpreters/InterpreterDescribeQuery.cpp
	dbms/src/Interpreters/interpretSubquery.cpp
	dbms/src/Storages/ColumnsDescription.cpp
2019-03-17 00:46:53 +03:00
Alexey Zatelepin
a030ce90b5 fix build 2019-03-15 20:40:16 +03:00
Alexey Zatelepin
b5a0a3fa23 store all kinds of columns in the same list in ColumnsDescription [#CLICKHOUSE-3101] 2019-03-15 19:37:52 +03:00
Ivan Lezhankin
d1ead22073 Rename As<…> → as<…> 2019-03-11 16:22:51 +03:00
Ivan Lezhankin
1e9f7847dc Merge remote-tracking branch 'upstream/master' into iast-as 2019-03-11 16:11:22 +03:00
Ivan Lezhankin
a7e838e328 Replace all other casts to method IAST::As<Derived>
Also remove some redundant methods like IsIdentifier() et. al.
2019-03-11 15:49:39 +03:00
alexey-milovidov
617a0a8938
Merge pull request #4592 from yandex/fix-concurrent-alters2
Fix a race condition during concurrent ALTER COLUMN queries
2019-03-10 19:11:49 +03:00
alexey-milovidov
24bec290b5
Merge pull request #4584 from Felixoid/system.graphite_retentions
Rework system.graphite_retentions
2019-03-10 04:30:53 +03:00
alexey-milovidov
bc6235c2f2
Update LimitBlockInputStream.cpp 2019-03-08 18:15:30 +03:00
alexey-milovidov
87e270c4a0
Update LimitBlockInputStream.cpp 2019-03-08 17:54:32 +03:00
Mikhail Filimonov
5f626dc99e Fix broken progress in 19.3 (regression in 92769a2460)
Introduce total_rows for table function `numbers()`.

fixes https://github.com/yandex/ClickHouse/issues/4429
resolves https://github.com/yandex/ClickHouse/issues/4284
2019-03-08 15:36:40 +01:00
Mikhail f. Shiryaev
9e82b44b62 Review adjustment 2019-03-08 08:00:46 +01:00
Alexey Zatelepin
3344955154 separate Read and Write lock holders, better method names 2019-03-07 21:10:21 +03:00
Alexey Zatelepin
ab025805a3 alter intention lock 2019-03-07 20:21:18 +03:00
Mikhail f. Shiryaev
bccbd52d78 Rework system.graphite_retentions table 2019-03-07 01:05:24 +01:00
Alexey Zatelepin
aff14bc899 clarify comment 2019-03-06 16:48:59 +03:00
Alexey Zatelepin
bc30ed92d4 fix order of destruction of table locks and child streams
Incorrect order could lead to a very rare `mutex lock failed: Invalid argument`
error when MergeTree table was dropped and its parts were deleted defore the destruction
of streams that were reading from that parts.
2019-03-06 15:25:59 +03:00
alexey-milovidov
1df9c1720e
Merge pull request #4426 from Felixoid/graphite-rollup
Graphite rollup: combined rules
2019-03-06 03:10:45 +03:00
alexey-milovidov
2e6dde45b4
Update GraphiteRollupSortedBlockInputStream.cpp 2019-03-06 03:09:49 +03:00
zhang2014
fb44b6692a rename setting name 2019-03-04 10:09:44 +08:00
zhang2014
eae6406f34 Better method name 2019-03-02 15:08:02 +08:00
zhang2014
be158c145b fix divide by zero crash 2019-03-02 15:08:02 +08:00
zhang2014
b696ef34d2 Add max_execution_speed & min_execution_bytes_speed & max_execution_bytes_speed 2019-03-02 15:08:02 +08:00
Alexey Zatelepin
0d7ab9e3ea allow acquiring read lock to a table out of order if it was already locked by the same query [#CLICKHOUSE-3789]
this is important in preventing ALTER deadlocks
2019-02-27 21:34:38 +03:00
Nikolai Kochetov
2f98e779e1 Added MergingSortedTransform. 2019-02-26 21:40:08 +03:00
Mikhail f. Shiryaev
88d63a0b3a Use pair of patterns to make combined RollupRules 2019-02-26 10:49:39 +01:00
Nikolai Kochetov
e91a0a31b7 Merge branch 'master' into processors 2019-02-21 19:19:35 +03:00
Vitaly Baranov
76aae5f5d0 Add support for settings 'format_schema' in a "INSERT INTO table FORMAT" query. 2019-02-20 05:32:29 +03:00
proller
e20c77e4c6 Add parquet support. Fixes, tests, ... 2019-02-19 23:51:44 +03:00
proller
88076bb8c9 Merge commit 'bf09c2047a47b74f089d701b9b1e4fcbe8955a7f' into fix23 2019-02-19 23:46:37 +03:00
Vitaly Baranov
ad377d421f MergingSortedBlockInputStream class constructor, "max_block_size" parameter: change type UInt64 -> size_t. 2019-02-19 14:56:08 +03:00
Nikolai Kochetov
b6fd31865e Merged with master. 2019-02-15 19:22:29 +03:00
Alexey Milovidov
4051306fa7 Fixed includes #4372 2019-02-12 22:09:51 +03:00
Alexey Milovidov
d558cf345c Faster calcelling of vertical merges 2019-02-12 22:04:13 +03:00
Ivan Lezhankin
2bd14117f4 Merge remote-tracking branch 'upstream/master' into issue-2675 2019-02-11 13:57:40 +03:00
alexey-milovidov
81a184c47f
Merge pull request #4301 from yandex/input-data-in-perf-test
Fix perf-test input data and refactor two tests
2019-02-11 12:52:03 +03:00
Alexey Milovidov
0861af12a3 Fixed thread names 2019-02-11 00:15:14 +03:00
Alexey Milovidov
58a6accee5 Updated test #4246 2019-02-10 19:55:12 +03:00
Alexey Milovidov
4799a343ee Addition to prev. revision #4246 2019-02-10 19:22:38 +03:00
Alexey Milovidov
c603d270f4 Cleanups #4246 2019-02-10 18:17:45 +03:00
Alexey Milovidov
322c46383e Addition to prev. revision #4297 2019-02-08 20:17:16 +03:00
Alexey Milovidov
9599e8ad2a Addition to prev. revision #4297 2019-02-08 18:21:06 +03:00
alesapin
dc98b50f14 Fix HTTP insert 2019-02-08 16:24:24 +03:00
Ivan Lezhankin
018df69d3d Merge remote-tracking branch 'upstream/master' into issue-2675 2019-02-07 15:45:21 +03:00
Alexey Milovidov
e6ae1e36b6 Addition to prev. revision #4297 2019-02-07 00:44:17 +03:00
Alexey Milovidov
bcd7d3cc63 Fixed wrong behaviour of -WithNames formats when doing INSERT SELECT ... FROM file #3469 2019-02-07 00:40:49 +03:00
alexey-milovidov
2686f64233
Merge pull request #4128 from yandex/unified-sets
Unified sets
2019-02-06 20:40:11 +03:00
Nikita Vasilev
a1b0dede07 Data Skipping Indices (#4143)
* made index parser

* added index parsing

* some fixes

* added index interface and factory

* fixed compilation

* ptrs

* added indexParts

* indextypes

* index condition

* IndexCondition

* added indexes in selectexecutor

* fix

* changed comment

* fix

* added granularity

* comments

* fix

* fix

* added writing indexes

* removed indexpart class

* fix

* added setSkipIndexes

* add rw for MergeTreeIndexes

* fixes

* upd error

* fix

* fix

* reading

* test index

* fixed nullptr error

* fixed

* fix

* unique names

* asts -> exprlist

* minmax index

* fix

* fixed select

* fixed merging

* fixed mutation

* working minmax

* removed test index

* fixed style

* added indexes to checkDataPart

* added tests for minmax index

* fixed constructor

* fix style

* fixed includes

* fixed setSkipIndexes

* added indexes meta to zookeeper

* added parsing

* removed throw

* alter cmds parse

* fix

* added alter

* fix

* alters fix

* fix alters

* fix "after"

* fixed alter

* alter fix + test

* fixes

* upd setSkipIndexes

* fixed alter bug with drop all indices

* fix metadata editing

* new test and repl fix

* rm test files

* fixed repl alter

* fix

* fix

* indices

* MTReadStream

* upd test for bug

* fix

* added useful parsers and ast classes

* fix

* fix comments

* replaced columns

* fix

* fixed parsing

* fixed printing

* fix err

* basic IndicesDescription

* go to IndicesDescr

* moved indices

* go to indicesDescr

* fix test minmax_index*

* fixed MT alter

* fixed bug with replMT indices storing in zk

* rename

* refactoring

* docs ru

* docs ru

* docs en

* refactor

* rename tests

* fix docs

* refactoring

* fix

* fix

* fix

* fixed style

* unique idx

* unique

* fix

* better minmax calculation

* upd

* added getBlock

* unique_condition

* added termForAST

* unique

* fixed not

* uniqueCondition::mayBeTrueOnGranule

* fix

* fixed bug with double column

* is always true

* fix

* key set

* spaces

* test

* tests

* fix

* unique

* fix

* fix

* fixed bug with duplicate column

* removed unused data

* fix

* fixes

* __bitSwapLastTwo

* fix
2019-02-05 17:50:25 +03:00
Nikolai Kochetov
8bcc9e580a Merged with master 2019-02-05 15:15:35 +03:00
Nikolai Kochetov
91c63c201c Delete commented code. 2019-02-05 13:55:08 +03:00
Nikolai Kochetov
264da7f9d3 Implemented sets using ColumnsHashing. 2019-02-05 13:55:15 +03:00
Alexey Milovidov
fe94a15092 Merge branch 'master' into dictionaries-user-profile 2019-02-04 17:11:53 +03:00
chertus
d6450bc488 Refactoring: extract SubqueryForSet to own files 2019-01-30 15:01:00 +03:00
Alexey Milovidov
0b0960e28f Fixed "Attempt to attach to nullptr thread group" when reloading dictionaries 2019-01-29 20:24:54 +03:00
Alexey Milovidov
4e3d9a0f15 Merge branch 'master' of github.com:yandex/ClickHouse into global-thread-pool 2019-01-28 14:20:24 +03:00
Léo Ercolanelli
e1d6017120 use sumMapWithOverflow in SummingSortedBlockInputStream 2019-01-25 20:36:18 +01:00
Alexey Milovidov
253ac93459 Addition to prev. revision #4150 2019-01-25 21:44:30 +03:00
Alexey Milovidov
65f8e4d4a8 Merge branch 'master' into global-thread-pool 2019-01-25 16:33:50 +03:00
Ivan Lezhankin
681266abd0 Poll messages in batches of max_block_size size. 2019-01-25 15:48:59 +03:00
Ivan Lezhankin
05ab15cc84 Merge IBlockInputStream and IProfilingBlockInputStream into one 2019-01-23 17:48:50 +03:00
maiha
6c83beafdd dbms: Fixed misspells in comments 2019-01-23 04:56:53 +09:00
Alexey Milovidov
f6b9b06307 Attempt to implemnt global thread pool #4018 2019-01-14 22:22:09 +03:00
Alexey Milovidov
abcd5a2a49 Attempt to implemnt global thread pool #4018 2019-01-11 22:12:36 +03:00
Alexey Milovidov
38b7a459d1 Merge branch 'master' into processors 2019-01-11 18:53:53 +03:00
Alexey Milovidov
19f4652959 Fixed bugs found by PVS-Studio 2019-01-09 18:44:20 +03:00
Alexey Milovidov
1d4701b0bc Added some warnings from clang's -Weverything 2019-01-04 15:10:00 +03:00
Alexey Milovidov
e33e5150b7 Miscellaneous [#CLICKHOUSE-2] 2019-01-02 09:44:36 +03:00
proller
300bbdfb43 Fix cyclic lib depend ppart 2: clean 2018-12-28 21:15:26 +03:00
Alexey Milovidov
3c84e47419 Fixed UB #3926 2018-12-27 03:33:54 +03:00
Alexey Milovidov
713a44c38e Fixed UB #3926 2018-12-27 03:33:32 +03:00
Alexey Milovidov
1191f1575d Less dependencies [#CLICKHOUSE-2] 2018-12-26 02:44:44 +03:00
Alexey Milovidov
a8f09809f5 Simplified logic with "IColumn::convertToFullColumnIfConst" (suggested by Amos Bird) [#CLICKHOUSE-2] 2018-12-21 19:00:07 +03:00
Nikolai Kochetov
4eb7a820d6 Fix style 2018-12-19 20:54:46 +03:00
Nikolai Kochetov
78321a04a1 Added low_cardinality_allow_in_native_format setting. 2018-12-19 19:47:30 +03:00
alexey-milovidov
cea269883c
Merge pull request #3803 from yandex/low-cardinality-native-format-conversion-2
LowCardinality support for old clients, part 2
2018-12-10 21:03:43 +03:00
Nikolai Kochetov
1a6127dce4 Remove LowCardinality from NativeBlockOutputStream types for old clients. 2018-12-10 15:09:37 +03:00
alexey-milovidov
0fdb3b9628
Merge branch 'master' into issue-3578 2018-12-07 23:53:34 +03:00
KochetovNicolai
431cff1613
Update NativeBlockInputStream.cpp
Fix type for LowCardinality inserts.
2018-12-07 20:17:50 +03:00
chertus
60dc8fcac2 fixes for review CLICKHOUSE-3578 2018-12-06 20:20:17 +03:00