Nikita Vasilev
df68abe893
fix
2019-03-11 21:00:51 +03:00
Nikita Vasilev
d7e18db7f6
aggregator
2019-03-11 20:59:36 +03:00
Ivan Lezhankin
d1ead22073
Rename As<…> → as<…>
2019-03-11 16:22:51 +03:00
Ivan Lezhankin
1e9f7847dc
Merge remote-tracking branch 'upstream/master' into iast-as
2019-03-11 16:11:22 +03:00
Ivan Lezhankin
a7e838e328
Replace all other casts to method IAST::As<Derived>
...
Also remove some redundant methods like IsIdentifier() et. al.
2019-03-11 15:49:39 +03:00
Nikita Vasilev
d171330599
Merge remote-tracking branch 'upstream/master' into nikvas0/bloom_filter_index
2019-03-11 13:06:09 +03:00
alexey-milovidov
edb72e09ae
Merge pull request #4640 from nikvas0/nikvas0/set_opt
...
Improved data skipping indices calculation
2019-03-11 00:26:48 +03:00
alexey-milovidov
617a0a8938
Merge pull request #4592 from yandex/fix-concurrent-alters2
...
Fix a race condition during concurrent ALTER COLUMN queries
2019-03-10 19:11:49 +03:00
alexey-milovidov
c7c58785b5
Merge pull request #4637 from digitalist/use_sampling-fix-for-parallel-replicas
...
fix use_sampling for parallel replicas (mpetrov/madmike)
2019-03-10 19:02:40 +03:00
Nikita Vasilev
8615834804
fix
2019-03-10 11:23:59 +03:00
Nikita Vasilev
d7892e9ec7
Merge remote-tracking branch 'upstream/master' into nikvas0/set_opt
2019-03-10 11:23:01 +03:00
alexey-milovidov
6db73152d2
Hardening debug build (experimental) ( #4632 )
...
* Hardening debug build: more granular memory mappings and ASLR; add memory protection for mark cache and index
* Addition to prev. revision
* Addition to prev. revision
* Addition to prev. revision
2019-03-10 06:16:51 +03:00
alexey-milovidov
128fd20adf
Update registerStorageMergeTree.cpp
2019-03-10 04:30:42 +03:00
Nikita Vasilev
d969b64237
set(0)
2019-03-09 21:17:29 +03:00
Nikita Vasilev
7f281327d9
fix
2019-03-09 18:26:52 +03:00
Alexey Elymanov
9bb64bd6d2
remove excessive check/exception
2019-03-09 17:51:10 +03:00
Alexey Elymanov
b1052cb72e
fix use_sampling for parallel replicas (mpetrov/madmike)
2019-03-09 17:30:55 +03:00
Nikita Vasilev
b9d258dc99
new set
2019-03-09 17:03:41 +03:00
Nikita Vasilev
a2480d7812
aggregation
2019-03-08 22:52:21 +03:00
Mikhail f. Shiryaev
2d27331f0c
Merge remote-tracking branch 'origin/master' into system.graphite_retentions
2019-03-08 17:41:40 +01:00
Nikita Vasilev
c2fa53d9d4
aggregator
2019-03-08 18:36:39 +03:00
Ivan Lezhankin
0e325c7a4a
Replace const typeid_casts with As<Derived>() method invocations
2019-03-08 12:48:20 +03:00
Nikita Vasilev
6a86a901b4
return KeyCondition
2019-03-08 11:29:48 +03:00
Nikita Vasilev
a77d20e56d
Merge remote-tracking branch 'upstream/master' into nikvas0/bloom_filter_index
2019-03-08 11:13:48 +03:00
Mikhail f. Shiryaev
9e82b44b62
Review adjustment
2019-03-08 08:00:46 +01:00
Alexey Zatelepin
3344955154
separate Read and Write lock holders, better method names
2019-03-07 21:10:21 +03:00
Alexey Milovidov
d53da3d497
Fixed typo
2019-03-07 20:58:28 +03:00
Alexey Zatelepin
ab025805a3
alter intention lock
2019-03-07 20:21:18 +03:00
Nikita Vasilev
fcb82ba901
Merge remote-tracking branch 'upstream/master' into nikvas0/bloom_filter_index
2019-03-07 16:55:38 +03:00
Nikita Vasilev
d82ce5ddb3
move
2019-03-07 16:54:56 +03:00
Nikita Vasilev
01e682d23c
fix
2019-03-07 14:31:23 +03:00
Nikita Vasilev
a555918fca
rpnbuilder
2019-03-07 12:15:58 +03:00
Mikhail f. Shiryaev
bccbd52d78
Rework system.graphite_retentions table
2019-03-07 01:05:24 +01:00
alexey-milovidov
7e4c497e19
Merge pull request #4594 from yandex/fix-low-cardinality_serialization-for-set-index
...
Fix Nullable and LowCardinality serialization for set index
2019-03-06 21:57:26 +03:00
Nikita Vasilev
565633fb2b
limited like for tokenbf
2019-03-06 18:30:27 +03:00
Nikita Vasilev
c428d9a64c
Merge remote-tracking branch 'upstream/master' into nikvas0/bloom_filter_index
2019-03-06 16:36:34 +03:00
alexey-milovidov
1df9c1720e
Merge pull request #4426 from Felixoid/graphite-rollup
...
Graphite rollup: combined rules
2019-03-06 03:10:45 +03:00
Nikolai Kochetov
3bcab12966
Fix test.
2019-03-05 19:52:29 +03:00
Nikolai Kochetov
4b18b7dcdc
Support Nullable columns for Set index. #4486
2019-03-05 15:17:54 +03:00
Nikolai Kochetov
52c9d4e1ad
(De)Serialize set index with multiple bulks. #4486
2019-03-05 15:17:37 +03:00
alexey-milovidov
3924207040
Merge pull request #4405 from yandex/move-to-prewhere-improvement
...
Move to prewhere improvement
2019-03-03 19:06:43 +03:00
Alexey Milovidov
b8ff976ee9
Merge branch 'master' into move-to-prewhere-improvement
2019-03-02 04:34:49 +03:00
Alexey Milovidov
dbab34e21f
Fixed error #4526
2019-03-02 04:05:36 +03:00
Alexey Milovidov
526e6488e0
Merge branch 'master' into fix-aio-threshold
2019-03-02 02:39:25 +03:00
alexey-milovidov
97cea95f74
Merge pull request #4536 from amosbird/fixedhashtable
...
A Proper lookup table that uses HashTable's API
2019-03-01 17:47:33 +03:00
Amos Bird
26ab5dd7a7
A Proper lookup table that uses HashTable's API
...
This is the first step of allowing heterogeneous cells in hash tables.
performance test results are
```
1. HashMap<UInt16, UInt8, TrivialHash, HashTableFixedGrower<16>>;
2. NewLookupMap<UInt16, UInt8>
ResolutionWidth 30000 1 .................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................223550276.46
ResolutionWidth 30000 2 .................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................248772721.24
Best: 2 - 24877272124
ResolutionWidth 100000 1 ..........................................................................................................................................................................................................................................................238498413.99
ResolutionWidth 100000 2 ..........................................................................................................................................................................................................................................................261808889.98
Best: 2 - 26180888998
ResolutionWidth 300000 1 ...................................................................................239307348.81
ResolutionWidth 300000 2 ...................................................................................257592761.30
Best: 2 - 25759276130
ResolutionWidth 1000000 1 .........................240144759.26
ResolutionWidth 1000000 2 .........................257093531.91
Best: 2 - 25709353191
ResolutionWidth 5000000 1 .....241573260.35
ResolutionWidth 5000000 2 .....259314162.79
Best: 2 - 25931416279
ResolutionDepth 30000 1 .................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................217108119.84
ResolutionDepth 30000 2 .................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................249459504.41
Best: 2 - 24945950441
ResolutionDepth 100000 1 ..........................................................................................................................................................................................................................................................229065162.17
ResolutionDepth 100000 2 ..........................................................................................................................................................................................................................................................253769105.64
Best: 2 - 25376910564
ResolutionDepth 300000 1 ...................................................................................233079225.18
ResolutionDepth 300000 2 ...................................................................................256316273.78
Best: 2 - 25631627378
ResolutionDepth 1000000 1 .........................234184633.51
ResolutionDepth 1000000 2 .........................261100491.57
Best: 2 - 26110049157
ResolutionDepth 5000000 1 .....233118795.66
ResolutionDepth 5000000 2 .....252436160.41
Best: 2 - 25243616041
```
2019-03-01 16:47:13 +08:00
Alexey Zatelepin
c5dde2c9fd
get rid of default query_id value in RWLock::getLock [#CLICKHOUSE-3789]
2019-02-28 12:37:05 +03:00
Alexey Milovidov
62b246c5a4
Avoid excessive "stat" syscall\
2019-02-27 23:02:48 +03:00
Alexey Milovidov
c3623f7bb6
Fixed error with underestimation of data size to read when choosing O_DIRECT mode
2019-02-27 22:32:54 +03:00
Alexey Zatelepin
0d7ab9e3ea
allow acquiring read lock to a table out of order if it was already locked by the same query [#CLICKHOUSE-3789]
...
this is important in preventing ALTER deadlocks
2019-02-27 21:34:38 +03:00
Nikita Vasilev
0b20d634cd
fix
2019-02-26 23:36:15 +03:00
Nikita Vasilev
d6f227ece7
fix build
2019-02-26 22:37:07 +03:00
Mikhail f. Shiryaev
88d63a0b3a
Use pair of patterns to make combined RollupRules
2019-02-26 10:49:39 +01:00
Nikita Vasilev
e5a4ecfc84
fixed style
2019-02-25 21:46:54 +03:00
Nikita Vasilev
58446d5145
fix
2019-02-25 21:38:57 +03:00
Nikita Vasilev
4b04c4bdde
improved read
2019-02-25 21:30:02 +03:00
Nikita Vasilev
ef0de1b53e
refactoring
2019-02-25 21:23:21 +03:00
Nikita Vasilev
289a6cb3d3
support like
2019-02-25 21:04:25 +03:00
Nikita Vasilev
69e6dea848
removed logs
2019-02-25 20:16:20 +03:00
Nikita Vasilev
72f5bdc485
tokenbf fix
2019-02-25 20:12:09 +03:00
Nikita Vasilev
4c3ed613e3
fix
2019-02-25 19:34:49 +03:00
Nikita Vasilev
c9e4657aae
tokenbf
2019-02-25 17:23:19 +03:00
Nikita Vasilev
09e64be605
fix
2019-02-25 13:12:05 +03:00
Nikita Vasilev
c19a767433
fixed in
2019-02-25 11:43:19 +03:00
Nikita Vasilev
d02e1c0cdb
in
2019-02-25 00:17:52 +03:00
Nikita Vasilev
ed28340a4c
fixed string
2019-02-24 22:26:42 +03:00
Nikita Vasilev
c656045f96
fix
2019-02-24 22:07:45 +03:00
Nikita Vasilev
c8e8f14bf9
4 args
2019-02-24 21:55:56 +03:00
Nikita Vasilev
bb5a5932b4
fix
2019-02-23 17:12:15 +03:00
Nikita Vasilev
ca4d1e137c
fix like
2019-02-23 16:06:23 +03:00
Nikita Vasilev
970f93d3c4
fix
2019-02-23 12:26:32 +03:00
Nikita Vasilev
81fdd13420
many columns
2019-02-22 22:59:40 +03:00
Nikita Vasilev
7f93057650
fix
2019-02-22 13:51:19 +03:00
Nikita Vasilev
16a1fd6692
fix
2019-02-22 11:15:52 +03:00
Nikita Vasilev
4ca9c02431
utf-8
2019-02-22 10:59:07 +03:00
Nikita Vasilev
9a28161414
fixed token extractor
2019-02-22 00:29:24 +03:00
Nikita Vasilev
34e2e2623e
like
2019-02-21 23:32:36 +03:00
Nikita Vasilev
f66cef68ff
fix in atom_map
2019-02-20 23:17:44 +03:00
Nikita Vasilev
ef55e93016
==
2019-02-20 22:27:23 +03:00
Nikita Vasilev
4e5bbc8176
fix
2019-02-20 20:17:31 +03:00
Nikita Vasilev
c35c671f4e
key condition
2019-02-20 19:24:46 +03:00
Nikita Vasilev
5b1f443195
fix
2019-02-20 16:18:15 +03:00
Nikita Vasilev
f7c091d497
utf8 + fixes
2019-02-20 15:48:50 +03:00
Nikita Vasilev
4343ede944
bloom filter creator
2019-02-20 15:12:41 +03:00
Nikita Vasilev
fb002ab17c
fix
2019-02-20 14:24:31 +03:00
Nikita Vasilev
3c3cc597ab
added granule
2019-02-20 14:22:07 +03:00
Vitaly Baranov
ad377d421f
MergingSortedBlockInputStream class constructor, "max_block_size" parameter: change type UInt64 -> size_t.
2019-02-19 14:56:08 +03:00
Vitaly Baranov
309df832ec
IStorage::read() function, "max_block_size" parameter: change type UInt64 -> size_t.
2019-02-19 14:56:08 +03:00
Alexey Milovidov
b5b0c3eb28
Allow to move more than a single condition to PREWHERE
2019-02-15 22:25:29 +03:00
Alexey Milovidov
eb54d43c14
Do not move conditions on all queried columns to PREWHERE
2019-02-15 22:00:19 +03:00
alexey-milovidov
85a5ece942
Merge pull request #4407 from nikvas0/nikvas0/index_fix2
...
indices fix
2019-02-15 18:56:14 +03:00
Nikita Vasilev
4fb7abfeff
removed logs
2019-02-15 08:58:29 +03:00
Nikita Vasilev
83d37a6f83
removed logs
2019-02-15 08:56:37 +03:00
Alexey Milovidov
e758caa7a9
Better "optimize_move_to_prewhere" heuristic; simpler code
2019-02-15 02:51:17 +03:00
Alexey Milovidov
793b92987f
Better "optimize_move_to_prewhere" heuristic
2019-02-14 23:09:44 +03:00
Alexey Milovidov
f30c05ed94
Better prewhere (incomplete)
2019-02-14 22:59:51 +03:00
Nikita Vasilev
77d8fe0aee
fix
2019-02-14 20:35:50 +03:00
Nikita Vasilev
610534e5ff
fix
2019-02-14 19:59:26 +03:00
Alexey Milovidov
a216cba3c4
Better "optimize_move_to_prewhere" heuristic
2019-02-14 19:48:41 +03:00
Alexey Milovidov
b7a4456007
Avoid "Memory limit exceeded" during ATTACH TABLE query
2019-02-14 16:05:44 +03:00
Nikita Vasilev
64e0732b4a
fixed
2019-02-14 12:13:04 +03:00
Nikita Vasilev
683314b69b
fix set
2019-02-14 12:06:32 +03:00
Nikita Vasilev
28840c79ed
Merge branch 'master' into nikvas0/set_index_args
2019-02-14 10:44:57 +03:00
Nikita Vasilev
ca1484ae95
set exactly one arg
2019-02-13 22:26:24 +03:00
Alexey Zatelepin
15d0adaf5a
add info about replicated_can_become_leader to logs and system.replicas [#CLICKHOUSE-4309]
2019-02-13 16:08:34 +03:00
Alexey Milovidov
e2d4dae5e1
Fixed race condition in removal of data parts #3531
2019-02-13 15:53:06 +03:00
Alexey Milovidov
d558cf345c
Faster calcelling of vertical merges
2019-02-12 22:04:13 +03:00
alexey-milovidov
48280074c4
Merge pull request #4369 from yandex/fix-race-condition-merge-tree-clear-old-temporary-directories
...
Fixed rare race condition on startup of non-replicated MergeTree tables: concurrent attempt to remove a temporary directory [#CLICKHOUSE-4296]
2019-02-12 21:37:48 +03:00
Nikita Vasilev
5279c7ff81
setting
2019-02-12 20:54:52 +03:00
Alexey Milovidov
7d1e755a7c
Fixed rare race condition on startup of non-replicated MergeTree tables: concurrent attempt to remove a temporary directory [#CLICKHOUSE-4296]
2019-02-12 19:41:06 +03:00
Alexey Milovidov
0861af12a3
Fixed thread names
2019-02-11 00:15:14 +03:00
Alexey Milovidov
58a6accee5
Updated test #4246
2019-02-10 19:55:12 +03:00
Alexey Milovidov
c603d270f4
Cleanups #4246
2019-02-10 18:17:45 +03:00
alexey-milovidov
9650c4a0da
Merge pull request #4286 from nikvas0/nikvas0/index_fix
...
Data Skipping Indices fix
2019-02-10 00:53:04 +03:00
alexey-milovidov
2777e54a57
Merge pull request #4287 from yandex/mutations-introspection
...
KILL MUTATION
2019-02-10 00:51:30 +03:00
Nikita Vasilev
cecbd5d0ac
Merge remote-tracking branch 'upstream/master' into nikvas0/index_fix
2019-02-08 00:17:35 +03:00
Nikita Vasilev
a675ba2323
unique -> set
2019-02-06 23:05:50 +03:00
KochetovNicolai
9f971c276f
Merge pull request #3669 from Enmk/ipv4_and_ipv6_domains
...
Ipv4 and ipv6 domains
2019-02-06 18:16:58 +03:00
Alexey Zatelepin
3ec6f508f1
Merge branch 'master' into mutations-introspection
...
Conflicts:
dbms/src/Interpreters/InterpreterKillQueryQuery.cpp
2019-02-06 15:22:48 +03:00
Nikita Vasilev
a618c7f334
fixed unique
2019-02-06 14:08:04 +03:00
Nikita Vasilev
28870b4d50
fixed indices register
2019-02-06 12:05:05 +03:00
Nikita Vasilev
fa1e46f8a7
granularity
2019-02-06 11:43:54 +03:00
Nikita Vasilev
e3879c0933
fix
2019-02-06 11:24:16 +03:00
Nikita Vasilev
c3f7344824
style
2019-02-06 11:17:57 +03:00
Nikita Vasilev
258367c1dd
ASTs
2019-02-06 10:51:35 +03:00
Nikita Vasilev
ef154a4bb2
r fix
2019-02-06 10:49:18 +03:00
Nikita Vasilev
9eaabcbf3f
Merge remote-tracking branch 'upstream/master' into nikvas0/index_fix
2019-02-05 22:19:47 +03:00
Nikita Vasilev
9921fc6719
removed toString
2019-02-05 21:46:35 +03:00
Nikita Vasilev
3bea03529b
fixed bug in unique_index
2019-02-05 21:34:10 +03:00
Alexey Zatelepin
8e437b191e
try executing other mutations immediately after KILL MUTATION [#CLICKHOUSE-3912]
2019-02-05 21:09:16 +03:00
Alexey Zatelepin
e32f153328
KILL MUTATION for StorageReplicatedMergeTree [#CLICKHOUSE-3912]
2019-02-05 21:09:15 +03:00
Alexey Zatelepin
059c1b3589
write part_log.partition_id everywhere
2019-02-05 21:09:15 +03:00
Alexey Zatelepin
ca93fd483a
kill ordinary MergeTree mutations [#CLICKHOUSE-3912]
2019-02-05 21:09:10 +03:00
Alexey Zatelepin
5832e474a4
is_mutation flag in system.merges [#CLICKHOUSE-3912]
2019-02-05 21:09:05 +03:00
Alexey Zatelepin
92a4342c31
system.merges element for mutations [#CLICKHOUSE-3912]
2019-02-05 21:09:00 +03:00
Alexey Milovidov
9dd2e75b71
Fixed warnings in clang 8 #4143
2019-02-05 19:43:52 +03:00
Nikita Vasilev
89913b9188
fix
2019-02-05 18:22:47 +03:00
Nikita Vasilev
a1b0dede07
Data Skipping Indices ( #4143 )
...
* made index parser
* added index parsing
* some fixes
* added index interface and factory
* fixed compilation
* ptrs
* added indexParts
* indextypes
* index condition
* IndexCondition
* added indexes in selectexecutor
* fix
* changed comment
* fix
* added granularity
* comments
* fix
* fix
* added writing indexes
* removed indexpart class
* fix
* added setSkipIndexes
* add rw for MergeTreeIndexes
* fixes
* upd error
* fix
* fix
* reading
* test index
* fixed nullptr error
* fixed
* fix
* unique names
* asts -> exprlist
* minmax index
* fix
* fixed select
* fixed merging
* fixed mutation
* working minmax
* removed test index
* fixed style
* added indexes to checkDataPart
* added tests for minmax index
* fixed constructor
* fix style
* fixed includes
* fixed setSkipIndexes
* added indexes meta to zookeeper
* added parsing
* removed throw
* alter cmds parse
* fix
* added alter
* fix
* alters fix
* fix alters
* fix "after"
* fixed alter
* alter fix + test
* fixes
* upd setSkipIndexes
* fixed alter bug with drop all indices
* fix metadata editing
* new test and repl fix
* rm test files
* fixed repl alter
* fix
* fix
* indices
* MTReadStream
* upd test for bug
* fix
* added useful parsers and ast classes
* fix
* fix comments
* replaced columns
* fix
* fixed parsing
* fixed printing
* fix err
* basic IndicesDescription
* go to IndicesDescr
* moved indices
* go to indicesDescr
* fix test minmax_index*
* fixed MT alter
* fixed bug with replMT indices storing in zk
* rename
* refactoring
* docs ru
* docs ru
* docs en
* refactor
* rename tests
* fix docs
* refactoring
* fix
* fix
* fix
* fixed style
* unique idx
* unique
* fix
* better minmax calculation
* upd
* added getBlock
* unique_condition
* added termForAST
* unique
* fixed not
* uniqueCondition::mayBeTrueOnGranule
* fix
* fixed bug with double column
* is always true
* fix
* key set
* spaces
* test
* tests
* fix
* unique
* fix
* fix
* fixed bug with duplicate column
* removed unused data
* fix
* fixes
* __bitSwapLastTwo
* fix
2019-02-05 17:50:25 +03:00
Nikita Vasilev
263b390c52
removed unnecessary actions
2019-02-05 16:59:43 +03:00
Nikita Vasilev
87a80a4361
fixed create as
2019-02-05 16:52:45 +03:00
Alexey Zatelepin
1512e17ab8
info about failed parts for ReplicatedMergeTree [#CLICKHOUSE-3912]
2019-02-05 16:37:16 +03:00
Alexey Zatelepin
b8ee63fa3a
save information about failed parts for ordinary MergeTree mutations [#CLICKHOUSE-3192]
2019-02-05 16:04:58 +03:00
Alexey Milovidov
29c3195742
Removed bad code; fixed error
2019-02-05 02:18:04 +03:00
Nikita Vasilev
5a7ca354a5
unknown field
2019-02-04 16:42:13 +03:00
Nikita Vasilev
fa07d1cf86
replace andBit
2019-02-04 13:42:30 +03:00
Vasily Nemkov
2716df8ab2
IPv4 and IPv6 Domain implementation.
...
Added:
* IDataTypeDomain interface;
* method DataTypeFactory::registerDataTypeDomain for registering domains;
* DataTypeDomainWithSimpleSerialization domain base class with simple serialization/deserialization;
* Concrete IPv4 and IPv6 domain implementations: DataTypeDomanIPv6 and DataTypeDomanIPv4;
Updated:
* IDataType text serialization/deserialization methods;
* IDataType implementation to use domain for text serialization/deserialization;
* Refactored implementation of the IPv4/IPv6 functions to use formatIPv4/v6 and parseIPv4/v6 from Common/formatIPv6.h;
Tests:
* Added test cases for IPv4 and IPv6 domains.
* Updated IPv4/v6 functions tests to validate more cases;
* Added performance tests for IPv4 and IPv6 related functions;
2019-02-04 12:37:46 +03:00
alexey-milovidov
012bd5267b
Merge pull request #4195 from yandex/convert-parts-from-old-format
...
А tool to convert an old month-partition part to the custom-partitioned format
2019-01-31 22:45:44 +03:00
Nikita Vasilev
094ae0f810
fix
2019-01-30 22:48:24 +03:00
Nikita Vasilev
476f33f9a3
__bitSwapLastTwo
2019-01-30 22:40:01 +03:00
Nikita Vasilev
0492ed780f
fixes
2019-01-30 18:04:24 +03:00