thevar1able/ClickHouse
1
0
Fork 0
mirror of https://github.com/ClickHouse/ClickHouse.git synced 2024-12-15 19:02:04 +00:00
Code Issues Packages Projects Releases Wiki Activity
24,953 Commits 9,326 Branches 1,783 Tags 2.1 GiB
c401d282da
Commit Graph

4334 Commits

Author SHA1 Message Date
Nikita Vasilev
8615834804 fix 2019-03-10 11:23:59 +03:00
Nikita Vasilev
d7892e9ec7 Merge remote-tracking branch 'upstream/master' into nikvas0/set_opt 2019-03-10 11:23:01 +03:00
alexey-milovidov
6db73152d2
Hardening debug build (experimental) (#4632) 
* Hardening debug build: more granular memory mappings and ASLR; add memory protection for mark cache and index

* Addition to prev. revision

* Addition to prev. revision

* Addition to prev. revision
 2019-03-10 06:16:51 +03:00
alexey-milovidov
24bec290b5
Merge pull request #4584 from Felixoid/system.graphite_retentions 
Rework system.graphite_retentions
 2019-03-10 04:30:53 +03:00
alexey-milovidov
128fd20adf
Update registerStorageMergeTree.cpp 2019-03-10 04:30:42 +03:00
ivan-kush
521e897a92 init 2019-03-10 00:36:00 +03:00
Nikita Vasilev
d969b64237 set(0) 2019-03-09 21:17:29 +03:00
Nikita Vasilev
7f281327d9 fix 2019-03-09 18:26:52 +03:00
Alexey Elymanov
9bb64bd6d2 remove excessive check/exception 2019-03-09 17:51:10 +03:00
Alexey Elymanov
b1052cb72e fix use_sampling for parallel replicas (mpetrov/madmike) 2019-03-09 17:30:55 +03:00
Nikita Vasilev
b9d258dc99 new set 2019-03-09 17:03:41 +03:00
Nikita Vasilev
8e65c9a094 Merge remote-tracking branch 'upstream/master' into nikvas0/set_opt 2019-03-09 14:28:31 +03:00
Nikita Vasilev
a2480d7812 aggregation 2019-03-08 22:52:21 +03:00
Mikhail f. Shiryaev
2d27331f0c Merge remote-tracking branch 'origin/master' into system.graphite_retentions 2019-03-08 17:41:40 +01:00
Nikita Vasilev
c2fa53d9d4 aggregator 2019-03-08 18:36:39 +03:00
Mikhail Filimonov
5f626dc99e Fix broken progress in 19.3 (regression in 92769a2460) 
Introduce total_rows for table function `numbers()`.

fixes https://github.com/yandex/ClickHouse/issues/4429
resolves https://github.com/yandex/ClickHouse/issues/4284
 2019-03-08 15:36:40 +01:00
Ivan Lezhankin
0e325c7a4a Replace const typeid_casts with As<Derived>() method invocations 2019-03-08 12:48:20 +03:00
Nikita Vasilev
6a86a901b4 return KeyCondition 2019-03-08 11:29:48 +03:00
Nikita Vasilev
a77d20e56d Merge remote-tracking branch 'upstream/master' into nikvas0/bloom_filter_index 2019-03-08 11:13:48 +03:00
Mikhail f. Shiryaev
9e82b44b62 Review adjustment 2019-03-08 08:00:46 +01:00
Alex Zatelepin
896b8b15f6 fix build 2019-03-07 23:52:25 +03:00
Alexey Zatelepin
f3ea9541fc add comments 2019-03-07 21:34:46 +03:00
Alexey Zatelepin
3344955154 separate Read and Write lock holders, better method names 2019-03-07 21:10:21 +03:00
Alexey Milovidov
d53da3d497 Fixed typo 2019-03-07 20:58:28 +03:00
Alexey Zatelepin
ab025805a3 alter intention lock 2019-03-07 20:21:18 +03:00
alexey-milovidov
8b0d8644c8
Update StorageSystemGraphite.cpp 2019-03-07 19:55:53 +03:00
Nikita Vasilev
fcb82ba901 Merge remote-tracking branch 'upstream/master' into nikvas0/bloom_filter_index 2019-03-07 16:55:38 +03:00
Nikita Vasilev
d82ce5ddb3 move 2019-03-07 16:54:56 +03:00
Nikita Vasilev
01e682d23c fix 2019-03-07 14:31:23 +03:00
Nikita Vasilev
a555918fca rpnbuilder 2019-03-07 12:15:58 +03:00
Mikhail f. Shiryaev
bccbd52d78 Rework system.graphite_retentions table 2019-03-07 01:05:24 +01:00
alexey-milovidov
7e4c497e19
Merge pull request #4594 from yandex/fix-low-cardinality_serialization-for-set-index 
Fix Nullable and LowCardinality serialization for set index
 2019-03-06 21:57:26 +03:00
Nikita Vasilev
565633fb2b limited like for tokenbf 2019-03-06 18:30:27 +03:00
Nikita Vasilev
c428d9a64c Merge remote-tracking branch 'upstream/master' into nikvas0/bloom_filter_index 2019-03-06 16:36:34 +03:00
alexey-milovidov
1df9c1720e
Merge pull request #4426 from Felixoid/graphite-rollup 
Graphite rollup: combined rules
 2019-03-06 03:10:45 +03:00
Nikolai Kochetov
3bcab12966 Fix test. 2019-03-05 19:52:29 +03:00
Nikolai Kochetov
4b18b7dcdc Support Nullable columns for Set index. #4486 2019-03-05 15:17:54 +03:00
Nikolai Kochetov
52c9d4e1ad (De)Serialize set index with multiple bulks. #4486 2019-03-05 15:17:37 +03:00
alexey-milovidov
3924207040
Merge pull request #4405 from yandex/move-to-prewhere-improvement 
Move to prewhere improvement
 2019-03-03 19:06:43 +03:00
Alexey Milovidov
b8ff976ee9 Merge branch 'master' into move-to-prewhere-improvement 2019-03-02 04:34:49 +03:00
Alexey Milovidov
dbab34e21f Fixed error #4526 2019-03-02 04:05:36 +03:00
Alexey Milovidov
526e6488e0 Merge branch 'master' into fix-aio-threshold 2019-03-02 02:39:25 +03:00
alexey-milovidov
97cea95f74
Merge pull request #4536 from amosbird/fixedhashtable 
A Proper lookup table that uses HashTable's API
 2019-03-01 17:47:33 +03:00
Alexey Zatelepin
5b850bad47 fix build 2019-03-01 14:42:41 +03:00
Amos Bird
26ab5dd7a7 A Proper lookup table that uses HashTable's API 
This is the first step of allowing heterogeneous cells in hash tables.

performance test results are

```

1. HashMap<UInt16, UInt8, TrivialHash, HashTableFixedGrower<16>>;
2. NewLookupMap<UInt16, UInt8>

ResolutionWidth 30000 1 .................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................223550276.46
ResolutionWidth 30000 2 .................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................248772721.24
Best: 2 - 24877272124

ResolutionWidth 100000 1 ..........................................................................................................................................................................................................................................................238498413.99
ResolutionWidth 100000 2 ..........................................................................................................................................................................................................................................................261808889.98
Best: 2 - 26180888998

ResolutionWidth 300000 1 ...................................................................................239307348.81
ResolutionWidth 300000 2 ...................................................................................257592761.30
Best: 2 - 25759276130

ResolutionWidth 1000000 1 .........................240144759.26
ResolutionWidth 1000000 2 .........................257093531.91
Best: 2 - 25709353191

ResolutionWidth 5000000 1 .....241573260.35
ResolutionWidth 5000000 2 .....259314162.79
Best: 2 - 25931416279

ResolutionDepth 30000 1 .................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................217108119.84
ResolutionDepth 30000 2 .................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................249459504.41
Best: 2 - 24945950441

ResolutionDepth 100000 1 ..........................................................................................................................................................................................................................................................229065162.17
ResolutionDepth 100000 2 ..........................................................................................................................................................................................................................................................253769105.64
Best: 2 - 25376910564

ResolutionDepth 300000 1 ...................................................................................233079225.18
ResolutionDepth 300000 2 ...................................................................................256316273.78
Best: 2 - 25631627378

ResolutionDepth 1000000 1 .........................234184633.51
ResolutionDepth 1000000 2 .........................261100491.57
Best: 2 - 26110049157

ResolutionDepth 5000000 1 .....233118795.66
ResolutionDepth 5000000 2 .....252436160.41
Best: 2 - 25243616041

```
 2019-03-01 16:47:13 +08:00
alexey-milovidov
137f800423
Update StorageSystemColumns.cpp 2019-03-01 04:08:12 +03:00
Alexey Zatelepin
eee73dac42 Merge branch 'master' into fix-concurrent-alters 2019-02-28 19:19:21 +03:00
Alexey Zatelepin
c5dde2c9fd get rid of default query_id value in RWLock::getLock [#CLICKHOUSE-3789] 2019-02-28 12:37:05 +03:00
alexey-milovidov
40d8abbc34
Merge pull request #4523 from yandex/fix_column_description_parse 
Fix column description parse. Now creation of replicated MT table wit…
 2019-02-28 01:18:31 +03:00
Alexey Milovidov
62b246c5a4 Avoid excessive "stat" syscall\ 2019-02-27 23:02:48 +03:00
Alexey Milovidov
c3623f7bb6 Fixed error with underestimation of data size to read when choosing O_DIRECT mode 2019-02-27 22:32:54 +03:00
Alexey Zatelepin
5ac1d4dd4e rename LockHandler -> LockHolder [#CLICKHOUSE-3789] 2019-02-27 21:34:38 +03:00
Alexey Zatelepin
0d7ab9e3ea allow acquiring read lock to a table out of order if it was already locked by the same query [#CLICKHOUSE-3789] 
this is important in preventing ALTER deadlocks
 2019-02-27 21:34:38 +03:00
proller
23d70b2e04
Add Y_IGNORE (#4521) 2019-02-27 19:52:08 +03:00
alesapin
1909c87885 Fix column description parse. Now creation of replicated MT table with codecs and comments is possible without default 2019-02-27 19:41:51 +03:00
Nikita Vasilev
0b20d634cd fix 2019-02-26 23:36:15 +03:00
Nikita Vasilev
d6f227ece7 fix build 2019-02-26 22:37:07 +03:00
Mikhail f. Shiryaev
88d63a0b3a Use pair of patterns to make combined RollupRules 2019-02-26 10:49:39 +01:00
Nikita Vasilev
e5a4ecfc84 fixed style 2019-02-25 21:46:54 +03:00
Nikita Vasilev
58446d5145 fix 2019-02-25 21:38:57 +03:00
Nikita Vasilev
4b04c4bdde improved read 2019-02-25 21:30:02 +03:00
Nikita Vasilev
ef0de1b53e refactoring 2019-02-25 21:23:21 +03:00
Nikita Vasilev
289a6cb3d3 support like 2019-02-25 21:04:25 +03:00
Nikita Vasilev
69e6dea848 removed logs 2019-02-25 20:16:20 +03:00
Nikita Vasilev
72f5bdc485 tokenbf fix 2019-02-25 20:12:09 +03:00
Nikita Vasilev
4c3ed613e3 fix 2019-02-25 19:34:49 +03:00
Nikita Vasilev
c9e4657aae tokenbf 2019-02-25 17:23:19 +03:00
Nikita Vasilev
09e64be605 fix 2019-02-25 13:12:05 +03:00
Nikita Vasilev
c19a767433 fixed in 2019-02-25 11:43:19 +03:00
Nikita Vasilev
d02e1c0cdb in 2019-02-25 00:17:52 +03:00
Nikita Vasilev
ed28340a4c fixed string 2019-02-24 22:26:42 +03:00
Nikita Vasilev
c656045f96 fix 2019-02-24 22:07:45 +03:00
Nikita Vasilev
c8e8f14bf9 4 args 2019-02-24 21:55:56 +03:00
Nikita Vasilev
bb5a5932b4 fix 2019-02-23 17:12:15 +03:00
Nikita Vasilev
ca4d1e137c fix like 2019-02-23 16:06:23 +03:00
Nikita Vasilev
970f93d3c4 fix 2019-02-23 12:26:32 +03:00
Nikita Vasilev
81fdd13420 many columns 2019-02-22 22:59:40 +03:00
Nikita Vasilev
7f93057650 fix 2019-02-22 13:51:19 +03:00
Nikita Vasilev
16a1fd6692 fix 2019-02-22 11:15:52 +03:00
Nikita Vasilev
4ca9c02431 utf-8 2019-02-22 10:59:07 +03:00
Nikita Vasilev
9a28161414 fixed token extractor 2019-02-22 00:29:24 +03:00
Nikita Vasilev
34e2e2623e like 2019-02-21 23:32:36 +03:00
Nikita Vasilev
f66cef68ff fix in atom_map 2019-02-20 23:17:44 +03:00
Nikita Vasilev
ef55e93016 == 2019-02-20 22:27:23 +03:00
Nikita Vasilev
4e5bbc8176 fix 2019-02-20 20:17:31 +03:00
Nikita Vasilev
c35c671f4e key condition 2019-02-20 19:24:46 +03:00
Nikita Vasilev
5b1f443195 fix 2019-02-20 16:18:15 +03:00
Nikita Vasilev
f7c091d497 utf8 + fixes 2019-02-20 15:48:50 +03:00
Nikita Vasilev
4343ede944 bloom filter creator 2019-02-20 15:12:41 +03:00
Nikita Vasilev
fb002ab17c fix 2019-02-20 14:24:31 +03:00
Nikita Vasilev
3c3cc597ab added granule 2019-02-20 14:22:07 +03:00
proller
e20c77e4c6 Add parquet support. Fixes, tests, ... 2019-02-19 23:51:44 +03:00
Alexey Milovidov
9c23486551 Fixed backward incompatibility of table function "remote" introduced with column comments 2019-02-19 20:02:51 +03:00
Vitaly Baranov
ad377d421f MergingSortedBlockInputStream class constructor, "max_block_size" parameter: change type UInt64 -> size_t. 2019-02-19 14:56:08 +03:00
Vitaly Baranov
536edf7721 StorageSystemNumber class constructor, "offset" and "limit" parameters: change type size_t -> UInt64. 2019-02-19 14:56:08 +03:00
Vitaly Baranov
37e726c311 IStorageURLBase::getReadURIParams() and IStorageURLBase::getReadPOSTDataCallback() functions, "max_block_size" parameter: change type UInt64 -> size_t. 2019-02-19 14:56:17 +03:00
Vitaly Baranov
309df832ec IStorage::read() function, "max_block_size" parameter: change type UInt64 -> size_t. 2019-02-19 14:56:08 +03:00
Vitaly Baranov
ab7e7507a4 Revert incorrect fix compilation on Mac. 
This reverts commit ef6b20030c.
 2019-02-18 20:31:18 +03:00
Alexey Milovidov
b5b0c3eb28 Allow to move more than a single condition to PREWHERE 2019-02-15 22:25:29 +03:00
Alexey Milovidov
eb54d43c14 Do not move conditions on all queried columns to PREWHERE 2019-02-15 22:00:19 +03:00
alexey-milovidov
85a5ece942
Merge pull request #4407 from nikvas0/nikvas0/index_fix2 
indices fix
 2019-02-15 18:56:14 +03:00
proller
263e69e861
Build fixes (FreeBSD port) (#4397) 2019-02-15 14:46:07 +03:00
Nikita Vasilev
4fb7abfeff removed logs 2019-02-15 08:58:29 +03:00
Nikita Vasilev
83d37a6f83 removed logs 2019-02-15 08:56:37 +03:00
Alexey Milovidov
e758caa7a9 Better "optimize_move_to_prewhere" heuristic; simpler code 2019-02-15 02:51:17 +03:00
Alexey Milovidov
793b92987f Better "optimize_move_to_prewhere" heuristic 2019-02-14 23:09:44 +03:00
Alexey Milovidov
f30c05ed94 Better prewhere (incomplete) 2019-02-14 22:59:51 +03:00
alexey-milovidov
ed3a8a66a2
Merge pull request #4399 from yandex/better-replica-repair 
Better replica repair
 2019-02-14 21:50:20 +03:00
Nikita Vasilev
77d8fe0aee fix 2019-02-14 20:35:50 +03:00
Nikita Vasilev
610534e5ff fix 2019-02-14 19:59:26 +03:00
Alexey Milovidov
a216cba3c4 Better "optimize_move_to_prewhere" heuristic 2019-02-14 19:48:41 +03:00
Alexey Milovidov
21247ebfac Better replica repair logic: clearing obsolete queue 2019-02-14 17:04:28 +03:00
Alexey Milovidov
b7a4456007 Avoid "Memory limit exceeded" during ATTACH TABLE query 2019-02-14 16:05:44 +03:00
Nikita Vasilev
64e0732b4a fixed 2019-02-14 12:13:04 +03:00
Nikita Vasilev
683314b69b fix set 2019-02-14 12:06:32 +03:00
Nikita Vasilev
28840c79ed Merge branch 'master' into nikvas0/set_index_args 2019-02-14 10:44:57 +03:00
Nikita Vasilev
ca1484ae95 set exactly one arg 2019-02-13 22:26:24 +03:00
proller
f5560660be Fix brotli (unbundled, missing, ...) 2019-02-13 18:35:11 +03:00
Alexey Milovidov
49bb1f9ca3 Updated contributors 2019-02-13 17:17:53 +03:00
Alexey Zatelepin
15d0adaf5a add info about replicated_can_become_leader to logs and system.replicas [#CLICKHOUSE-4309] 2019-02-13 16:08:34 +03:00
Alexey Milovidov
e2d4dae5e1 Fixed race condition in removal of data parts #3531 2019-02-13 15:53:06 +03:00
Alexey Milovidov
d558cf345c Faster calcelling of vertical merges 2019-02-12 22:04:13 +03:00
alexey-milovidov
48280074c4
Merge pull request #4369 from yandex/fix-race-condition-merge-tree-clear-old-temporary-directories 
Fixed rare race condition on startup of non-replicated MergeTree tables: concurrent attempt to remove a temporary directory [#CLICKHOUSE-4296]
 2019-02-12 21:37:48 +03:00
alexey-milovidov
c1bf56c969
Merge pull request #4370 from nikvas0/nikvas0/index_setting 
allow_experimental_data_skipping_indices setting
 2019-02-12 21:19:55 +03:00
Nikita Vasilev
5279c7ff81 setting 2019-02-12 20:54:52 +03:00
Alexey Milovidov
7d1e755a7c Fixed rare race condition on startup of non-replicated MergeTree tables: concurrent attempt to remove a temporary directory [#CLICKHOUSE-4296] 2019-02-12 19:41:06 +03:00
proller
bdefba6c32 fix link order 2019-02-12 15:59:40 +03:00
proller
fa12941640 Merge remote-tracking branch 'upstream/master' into fix10 2019-02-12 15:58:57 +03:00
proller
558ebbcc31 New library clickhouse_storage_kafka 2019-02-12 14:17:46 +03:00
Vitaly Baranov
ef6b20030c Fix compilation on Mac. 2019-02-12 14:15:03 +03:00
proller
4078a62573 Fix build without contrib/cppkafka submodule 2019-02-11 19:34:32 +03:00
alexey-milovidov
1db4bd8c2a
Merge pull request #4117 from abyss7/issue-2675 
Better tests for Kafka engine
 2019-02-11 18:03:24 +03:00
Alexey Milovidov
94d1b6b4de Updated contributors 2019-02-11 17:16:07 +03:00
Ivan Lezhankin
15ad409875 Tests are now passing locally 2019-02-11 14:54:30 +03:00
Ivan Lezhankin
2bd14117f4 Merge remote-tracking branch 'upstream/master' into issue-2675 2019-02-11 13:57:40 +03:00
Alexey Milovidov
0861af12a3 Fixed thread names 2019-02-11 00:15:14 +03:00
alexey-milovidov
0dd618b9ad
Merge pull request #4326 from yandex/duplicate-includes 
Removed duplicate includes
 2019-02-10 22:31:37 +03:00
Alexey Milovidov
ba3cb83a84 Removed duplicate includes 2019-02-10 20:12:22 +03:00
Alexey Milovidov
58a6accee5 Updated test #4246 2019-02-10 19:55:12 +03:00
Alexey Milovidov
4799a343ee Addition to prev. revision #4246 2019-02-10 19:22:38 +03:00
Alexey Milovidov
c603d270f4 Cleanups #4246 2019-02-10 18:17:45 +03:00
alexey-milovidov
9650c4a0da
Merge pull request #4286 from nikvas0/nikvas0/index_fix 
Data Skipping Indices fix
 2019-02-10 00:53:04 +03:00
alexey-milovidov
2777e54a57
Merge pull request #4287 from yandex/mutations-introspection 
KILL MUTATION
 2019-02-10 00:51:30 +03:00
Alexey Milovidov
c2b6b15778 Fixed error in system.tables #3982 2019-02-08 17:10:26 +03:00
Nikita Vasilev
cecbd5d0ac Merge remote-tracking branch 'upstream/master' into nikvas0/index_fix 2019-02-08 00:17:35 +03:00
Ivan Lezhankin
018df69d3d Merge remote-tracking branch 'upstream/master' into issue-2675 2019-02-07 15:45:21 +03:00
Nikita Vasilev
a675ba2323 unique -> set 2019-02-06 23:05:50 +03:00
Alexey Milovidov
2eb1876a7a Slightly better message with reason for OPTIMIZE query with "optimize_throw_if_noop" 2019-02-06 18:44:27 +03:00
KochetovNicolai
9f971c276f
Merge pull request #3669 from Enmk/ipv4_and_ipv6_domains 
Ipv4 and ipv6 domains
 2019-02-06 18:16:58 +03:00
Alexey Zatelepin
3ec6f508f1 Merge branch 'master' into mutations-introspection 
Conflicts:
	dbms/src/Interpreters/InterpreterKillQueryQuery.cpp
 2019-02-06 15:22:48 +03:00
Nikita Vasilev
6ef6536460 Merge remote-tracking branch 'upstream/master' into nikvas0/index_fix 2019-02-06 14:23:35 +03:00
Nikita Vasilev
a618c7f334 fixed unique 2019-02-06 14:08:04 +03:00
Nikita Vasilev
28870b4d50 fixed indices register 2019-02-06 12:05:05 +03:00
Nikita Vasilev
fa1e46f8a7 granularity 2019-02-06 11:43:54 +03:00
Nikita Vasilev
e3879c0933 fix 2019-02-06 11:24:16 +03:00
Nikita Vasilev
c3f7344824 style 2019-02-06 11:17:57 +03:00
Nikita Vasilev
258367c1dd ASTs 2019-02-06 10:51:35 +03:00
Nikita Vasilev
ef154a4bb2 r fix 2019-02-06 10:49:18 +03:00
Nikita Vasilev
9eaabcbf3f Merge remote-tracking branch 'upstream/master' into nikvas0/index_fix 2019-02-05 22:19:47 +03:00
Nikita Vasilev
9921fc6719 removed toString 2019-02-05 21:46:35 +03:00
Nikita Vasilev
3bea03529b fixed bug in unique_index 2019-02-05 21:34:10 +03:00
Alexey Zatelepin
8e437b191e try executing other mutations immediately after KILL MUTATION [#CLICKHOUSE-3912] 2019-02-05 21:09:16 +03:00
Alexey Zatelepin
d482f3e5d0 return CancellationCode from killMutation [#CLICKHOUSE-3912] 2019-02-05 21:09:15 +03:00
Alexey Zatelepin
e32f153328 KILL MUTATION for StorageReplicatedMergeTree [#CLICKHOUSE-3912] 2019-02-05 21:09:15 +03:00
Alexey Zatelepin
059c1b3589 write part_log.partition_id everywhere 2019-02-05 21:09:15 +03:00
Alexey Zatelepin
ca93fd483a kill ordinary MergeTree mutations [#CLICKHOUSE-3912] 2019-02-05 21:09:10 +03:00
Alexey Zatelepin
5832e474a4 is_mutation flag in system.merges [#CLICKHOUSE-3912] 2019-02-05 21:09:05 +03:00
Alexey Zatelepin
92a4342c31 system.merges element for mutations [#CLICKHOUSE-3912] 2019-02-05 21:09:00 +03:00
Alexey Zatelepin
51017959f2 fix typo in calculation of part_log.rows_read 2019-02-05 21:09:00 +03:00
Alexey Zatelepin
67be566325 KILL MUTATION skeleton [#CLICKHOUSE-3912] 2019-02-05 21:08:41 +03:00
Alexey Milovidov
607951895a Fixed table function numbers with zero argument #4276 2019-02-05 20:05:33 +03:00
Alexey Milovidov
9dd2e75b71 Fixed warnings in clang 8 #4143 2019-02-05 19:43:52 +03:00
Nikita Vasilev
89913b9188 fix 2019-02-05 18:22:47 +03:00
Nikita Vasilev
a1b0dede07 Data Skipping Indices (#4143) 
* made index parser

* added index parsing

* some fixes

* added index interface and factory

* fixed compilation

* ptrs

* added indexParts

* indextypes

* index condition

* IndexCondition

* added indexes in selectexecutor

* fix

* changed comment

* fix

* added granularity

* comments

* fix

* fix

* added writing indexes

* removed indexpart class

* fix

* added setSkipIndexes

* add rw for MergeTreeIndexes

* fixes

* upd error

* fix

* fix

* reading

* test index

* fixed nullptr error

* fixed

* fix

* unique names

* asts -> exprlist

* minmax index

* fix

* fixed select

* fixed merging

* fixed mutation

* working minmax

* removed test index

* fixed style

* added indexes to checkDataPart

* added tests for minmax index

* fixed constructor

* fix style

* fixed includes

* fixed setSkipIndexes

* added indexes meta to zookeeper

* added parsing

* removed throw

* alter cmds parse

* fix

* added alter

* fix

* alters fix

* fix alters

* fix "after"

* fixed alter

* alter fix + test

* fixes

* upd setSkipIndexes

* fixed alter bug with drop all indices

* fix metadata editing

* new test and repl fix

* rm test files

* fixed repl alter

* fix

* fix

* indices

* MTReadStream

* upd test for bug

* fix

* added useful parsers and ast classes

* fix

* fix comments

* replaced columns

* fix

* fixed parsing

* fixed printing

* fix err

* basic IndicesDescription

* go to IndicesDescr

* moved indices

* go to indicesDescr

* fix test minmax_index*

* fixed MT alter

* fixed bug with replMT indices storing in zk

* rename

* refactoring

* docs ru

* docs ru

* docs en

* refactor

* rename tests

* fix docs

* refactoring

* fix

* fix

* fix

* fixed style

* unique idx

* unique

* fix

* better minmax calculation

* upd

* added getBlock

* unique_condition

* added termForAST

* unique

* fixed not

* uniqueCondition::mayBeTrueOnGranule

* fix

* fixed bug with double column

* is always true

* fix

* key set

* spaces

* test

* tests

* fix

* unique

* fix

* fix

* fixed bug with duplicate column

* removed unused data

* fix

* fixes

* __bitSwapLastTwo

* fix
 2019-02-05 17:50:25 +03:00
Nikita Vasilev
263b390c52 removed unnecessary actions 2019-02-05 16:59:43 +03:00
Nikita Vasilev
87a80a4361 fixed create as 2019-02-05 16:52:45 +03:00
Alexey Zatelepin
1512e17ab8 info about failed parts for ReplicatedMergeTree [#CLICKHOUSE-3912] 2019-02-05 16:37:16 +03:00
Alexey Zatelepin
b8ee63fa3a save information about failed parts for ordinary MergeTree mutations [#CLICKHOUSE-3192] 2019-02-05 16:04:58 +03:00
Alexey Milovidov
29c3195742 Removed bad code; fixed error 2019-02-05 02:18:04 +03:00
Alexey Milovidov
b0efd6089c Removed preemptive load of external dictionaries in presence of Dictionary database 2019-02-04 22:45:22 +03:00
Nikita Vasilev
5a7ca354a5 unknown field 2019-02-04 16:42:13 +03:00
Nikita Vasilev
fa07d1cf86 replace andBit 2019-02-04 13:42:30 +03:00
Vasily Nemkov
2716df8ab2 IPv4 and IPv6 Domain implementation. 
Added:
 * IDataTypeDomain interface;
 * method DataTypeFactory::registerDataTypeDomain for registering domains;
 * DataTypeDomainWithSimpleSerialization domain base class with simple serialization/deserialization;
 * Concrete IPv4 and IPv6 domain implementations: DataTypeDomanIPv6 and DataTypeDomanIPv4;

Updated:
 * IDataType text serialization/deserialization methods;
 * IDataType implementation to use domain for text serialization/deserialization;
 * Refactored implementation of the IPv4/IPv6 functions to use formatIPv4/v6 and parseIPv4/v6 from Common/formatIPv6.h;

Tests:
 * Added test cases for IPv4 and IPv6 domains.
 * Updated IPv4/v6 functions tests to validate more cases;
 * Added performance tests for IPv4 and IPv6 related functions;
 2019-02-04 12:37:46 +03:00
Alexey Milovidov
0f577da5c2 Updated system.contributors 2019-02-01 18:49:17 +03:00
alexey-milovidov
012bd5267b
Merge pull request #4195 from yandex/convert-parts-from-old-format 
А tool to convert an old month-partition part to the custom-partitioned format
 2019-01-31 22:45:44 +03:00
Nikita Vasilev
094ae0f810 fix 2019-01-30 22:48:24 +03:00
Nikita Vasilev
476f33f9a3 __bitSwapLastTwo 2019-01-30 22:40:01 +03:00
Ivan Lezhankin
39e2563f93 Create new consumers on-demand 
and give them some time for graceful assignment.
 2019-01-30 20:58:49 +03:00
Nikita Vasilev
0492ed780f fixes 2019-01-30 18:04:24 +03:00
Alexey Zatelepin
063366307f fix build 2019-01-30 18:03:43 +03:00
Alexey Zatelepin
8957e73681 a tool to convert an old month-partition part to the custom-partitioned format [#CLICKHOUSE-4231] 2019-01-30 16:51:39 +03:00
Nikita Vasilev
bcd07a4074 fix 2019-01-30 16:34:28 +03:00
Nikita Vasilev
69daa33462 removed unused data 2019-01-30 13:58:10 +03:00
Nikita Vasilev
160c8c0807 fixed bug with duplicate column 2019-01-30 13:18:59 +03:00
Nikita Vasilev
c0d7a8b0fd Merge branch 'nikvas0/index' of github.com:nikvas0/ClickHouse into nikvas0/index 2019-01-30 10:17:19 +03:00
Nikita Vasilev
6d7ccc6982 fix 2019-01-29 23:06:31 +03:00
Nikita Vasilev
c12b03d350 Merge remote-tracking branch 'upstream/master' into nikvas0/index 2019-01-29 23:00:12 +03:00
Nikita Vasilev
371e1658f8 fix 2019-01-29 21:40:10 +03:00
Nikita Vasilev
c4dad05b87 fix 2019-01-29 21:00:40 +03:00
Nikita Vasilev
9311c01ef7 spaces 2019-01-29 20:28:13 +03:00
Nikita Vasilev
4ec0923fc9 key set 2019-01-29 20:26:45 +03:00
Nikita Vasilev
68ea3f0ae0 fix 2019-01-29 20:09:17 +03:00
Nikita Vasilev
67af98670e is always true 2019-01-29 19:53:44 +03:00
Nikita Vasilev
149b0d84f9 fixed bug with double column 2019-01-29 16:13:18 +03:00
proller
2ab3138eb6 Merge remote-tracking branch 'upstream/master' into fix10 2019-01-28 17:01:06 +03:00
proller
22549cc43b Merge remote-tracking branch 'upstream/master' into fix10 2019-01-28 15:44:25 +03:00
Alexey Milovidov
4e3d9a0f15 Merge branch 'master' of github.com:yandex/ClickHouse into global-thread-pool 2019-01-28 14:20:24 +03:00
Nikita Vasilev
7c036e9b43 fix 2019-01-28 13:35:19 +03:00
Nikita Vasilev
b4d1bf869b uniqueCondition::mayBeTrueOnGranule 2019-01-28 11:15:13 +03:00
Nikita Vasilev
a74ed80f99 fixed not 2019-01-28 10:24:32 +03:00
Nikita Vasilev
00ec4cc6ca unique 2019-01-28 10:05:24 +03:00
alexey-milovidov
032ed27c27
Merge pull request #4154 from 4ertus2/joins 
Add IdentifierSemantic and PredicateExpressionsOptimizer refactoring
 2019-01-28 01:47:57 +03:00
Nikita Vasilev
aa37d95036 added termForAST 2019-01-28 00:08:14 +03:00
Nikita Vasilev
902c9a9e5c unique_condition 2019-01-27 23:24:33 +03:00
Nikita Vasilev
c701cb7e00 added getBlock 2019-01-27 21:23:08 +03:00
Nikita Vasilev
537b23ef15 upd 2019-01-27 21:02:15 +03:00
Alexey Milovidov
ef51f126b4 Removed extraordinarily bad code in StorageFile #2150 2019-01-27 03:38:30 +03:00
Nikita Vasilev
0ea031d188 Merge branch 'nikvas0/index' into nikvas0/unique_index 2019-01-26 22:43:30 +03:00
Nikita Vasilev
b94915b7da better minmax calculation 2019-01-26 22:31:12 +03:00
Nikita Vasilev
387ed1b7c3 unique 2019-01-26 18:45:38 +03:00
Nikita Vasilev
6b6b0aa79a unique idx 2019-01-26 16:12:13 +03:00
Nikita Vasilev
b2915bc844 Merge remote-tracking branch 'upstream/master' into nikvas0/index 2019-01-26 09:27:32 +03:00
Nikita Vasilev
0ea0b171f4 fixed style 2019-01-26 09:26:49 +03:00
proller
9230fe9917 Merge remote-tracking branch 'upstream/master' into fix10 2019-01-25 23:10:38 +03:00
proller
5328251ff1
Fix build without protobuf, gtest, cppkafka (#4152) 2019-01-25 23:02:03 +03:00
proller
6964fb47ff BUILD_DETERMINISTIC 2019-01-25 22:29:01 +03:00
chertus
091efcda95 add IdentifierSemantic and PredicateExpressionsOptimizer refactoring 2019-01-25 18:42:24 +03:00
Alexey Milovidov
65f8e4d4a8 Merge branch 'master' into global-thread-pool 2019-01-25 16:33:50 +03:00
Ivan Lezhankin
681266abd0 Poll messages in batches of max_block_size size. 2019-01-25 15:48:59 +03:00
alexey-milovidov
18f1266dab
Merge pull request #4099 from yandex/mutations-fix-in 
Get rid of IAST::range
 2019-01-24 20:29:13 +03:00
Alexey Milovidov
0e59fe0b46 Renamed setting and variables #3973 2019-01-24 20:12:05 +03:00
Ivan Lezhankin
9636bdcd67 Fix build 2019-01-24 15:44:58 +03:00
Ivan Lezhankin
862d419f31 Fix losing the next message after a broken one. 2019-01-24 14:58:25 +03:00
Ivan Lezhankin
425d483cfb Add integration tests 2019-01-24 14:58:25 +03:00
Ivan Lezhankin
c8e605327d Split StorageKafka.cpp on smaller files per class 2019-01-24 14:58:24 +03:00
alexey-milovidov
f13d094a4e
Merge pull request #3973 from amosbird/join_overwrite 
Add join_overwrite settings for StorageJoin.
 2019-01-24 02:05:13 +03:00
Ivan Lezhankin
05ab15cc84 Merge IBlockInputStream and IProfilingBlockInputStream into one 2019-01-23 17:48:50 +03:00
Alexey Zatelepin
370c8c4e54 Merge branch 'master' into mutations-fix-in 
Conflicts:
	dbms/src/Parsers/IAST.h
 2019-01-23 14:47:53 +03:00
Alexey Zatelepin
f3b4292fc6 add data types to the prepared_sets key for literals #4058 2019-01-23 14:20:01 +03:00
Alexey Zatelepin
5154814bf9 try to get rid of IAST::range #4058 2019-01-23 14:19:22 +03:00
maiha
6c83beafdd dbms: Fixed misspells in comments 2019-01-23 04:56:53 +09:00
Nikita Vasilev
d8f3bf7882 refactoring 2019-01-22 22:43:52 +03:00
Nikita Vasilev
d47cd4825d Merge remote-tracking branch 'upstream/master' into nikvas0/index 2019-01-22 19:02:20 +03:00
Nikita Vasilev
9ee50da8b6 refactor 2019-01-22 18:58:11 +03:00
Alexey Milovidov
c70e8cc5f0 Miscellaneous #3726 2019-01-21 22:45:26 +03:00
alexey-milovidov
b41fa8e7af
Merge pull request #3726 from zhang2014/feature/use_cluster_pool 
Use cluster connections pool in DirectoryMonitor
 2019-01-21 22:33:19 +03:00
Alexey Milovidov
f7ecfc776b Miscellaneous #4111 2019-01-21 21:04:08 +03:00
Nikita Vasilev
51830221bd refactoring 2019-01-21 20:54:27 +03:00
Nikita Vasilev
f0a0dbbf5a fixed bug with replMT indices storing in zk 2019-01-21 17:47:47 +03:00
alesapin
88c413fbe2 Remove accidental change 2019-01-21 17:03:34 +03:00
alesapin
34fb1c89f1 Add ability to choose codecs for storage log and tiny log 2019-01-21 17:00:06 +03:00
Nikita Vasilev
c32d1983a0 go to indicesDescr 2019-01-21 12:47:35 +03:00
Nikita Vasilev
977b1e20d0 moved indices 2019-01-20 23:03:17 +03:00
Nikita Vasilev
3f5447f471 go to IndicesDescr 2019-01-20 21:43:49 +03:00
Nikita Vasilev
093b94ae38 basic IndicesDescription 2019-01-20 20:49:53 +03:00
Nikita Vasilev
d6545177fb fix err 2019-01-20 18:50:11 +03:00
Nikita Vasilev
9120bebe56 fixed printing 2019-01-20 18:02:19 +03:00
Nikita Vasilev
5e626be07f fix 2019-01-20 14:34:13 +03:00
Nikita Vasilev
13a4fb2756 replaced columns 2019-01-20 14:03:21 +03:00
Nikita Vasilev
4a19523698 Merge remote-tracking branch 'upstream/master' into nikvas0/index 2019-01-20 10:14:06 +03:00
alexey-milovidov
ee23f6997d
Merge pull request #4084 from yandex/storage_hdfs_improvements 
Storage hdfs write and refactoring
 2019-01-20 02:51:39 +03:00
alexey-milovidov
3c6263e89e
Merge pull request #4094 from abyss7/issue-2675 
Add setting to Kafka Engine to control number of parsing errors
 2019-01-18 21:46:52 +03:00
Ivan Lezhankin
5f74094edb Fix a setting description. 2019-01-18 16:15:36 +03:00
Ivan Lezhankin
89ffb577b1 Implement additional Kafka engine setting for allowed parsing errors 2019-01-18 15:48:38 +03:00
zhang2014
998591b30d fix build failure 2019-01-18 10:31:28 +08:00
alexey-milovidov
3d4bd7cbf8
Merge branch 'master' into feature/use_cluster_pool 2019-01-18 01:02:39 +03:00
Alexey Milovidov
a7c468da8e Merge remote-tracking branch 'origin/master' into global-thread-pool 2019-01-17 21:57:01 +03:00
Nikita Vasilev
0e6f5b4356 fix 2019-01-17 21:22:45 +03:00
alesapin
b6ad3cf148 Remove shadow variable warning 2019-01-17 19:15:51 +03:00
Alexey Milovidov
178302cc5d Miscellaneous #3960 2019-01-17 17:45:02 +03:00
Nikita Vasilev
8c2a23a129 MTReadStream 2019-01-17 17:23:12 +03:00
alesapin
07e11577d3 Add write logic and remove strange multifile read logic 2019-01-17 17:10:30 +03:00
alexey-milovidov
0ec1fdef04
Merge pull request #3960 from yandex/zk-columns-compact-storage 
Compact storage of the part header in ZooKeeper
 2019-01-17 17:05:01 +03:00
Nikita Vasilev
c4a725a496 indices 2019-01-17 15:11:36 +03:00
Nikita Vasilev
6a09340eed Merge remote-tracking branch 'upstream/master' into nikvas0/index 2019-01-17 12:34:51 +03:00
Nikita Vasilev
d514d3739a fixed repl alter 2019-01-17 12:16:39 +03:00
Nikita Vasilev
062819f0a2 new test and repl fix 2019-01-17 11:05:26 +03:00
Nikita Vasilev
f8fa36c6bd fix metadata editing 2019-01-16 22:47:21 +03:00
Nikita Vasilev
62dde8c327 fixed alter bug with drop all indices 2019-01-16 22:31:04 +03:00
chertus
8bb35ac987 minor changes 2019-01-16 21:38:19 +03:00
Nikita Vasilev
579832ff9b upd setSkipIndexes 2019-01-16 21:35:03 +03:00
Nikita Vasilev
08d23c16d1 fixes 2019-01-16 21:24:38 +03:00
Nikita Vasilev
b4ce03ea7e alter fix + test 2019-01-16 20:59:47 +03:00
Nikita Vasilev
2de2b6f32e fixed alter 2019-01-16 19:53:38 +03:00
Alexey Zatelepin
0f8e5f8522 Merge branch 'master' into zk-columns-compact-storage 
Conflicts:
	dbms/src/Storages/StorageReplicatedMergeTree.cpp
 2019-01-16 17:45:16 +03:00
Nikita Vasilev
65539bfea0 fix "after" 2019-01-16 16:05:27 +03:00
Nikita Vasilev
8c35ccdd1d fix alters 2019-01-16 15:29:26 +03:00
Nikita Vasilev
b110738f61 alters fix 2019-01-15 22:14:47 +03:00
Nikita Vasilev
2f07e31903 fix 2019-01-15 20:39:10 +03:00
Nikita Vasilev
026a30092e added alter 2019-01-15 17:49:22 +03:00
alesapin
694f746798 Merge branch 'master' into compression_codec_alter 2019-01-15 13:52:45 +03:00
alexey-milovidov
bcc54d1606
Merge pull request #4025 from abyss7/fix-kafka 
Update Kafka libraries
 2019-01-15 00:23:20 +03:00
alexey-milovidov
8a251753be
Merge pull request #4056 from 4ertus2/ast 
Helpers for ASTIdentifier (based on 'QueryNormalizer refactoring' changes)
 2019-01-15 00:22:54 +03:00
Alexey Milovidov
f6b9b06307 Attempt to implemnt global thread pool #4018 2019-01-14 22:22:09 +03:00
chertus
dbb88e8cb4 helpers for ASTIdentifier (hide semantic and casts) 2019-01-14 21:15:04 +03:00
proller
4b6af5788a Fix macos build 2019-01-14 19:55:11 +03:00
zhang2014
cdb138f13c merge 2019-01-14 18:14:34 +03:00
proller
af0b875f57 Fix macos build 2019-01-14 17:17:43 +03:00
proller
c0b72492c0 Fix macos build 2019-01-14 16:34:14 +03:00
Ivan Lezhankin
337c092c7e Use cppkafka instead of raw C interface 2019-01-14 14:15:57 +03:00