Commit Graph

5899 Commits

Author SHA1 Message Date
Alexey Milovidov
e1cc8289b2 Fixed error after merge [#CLICKHOUSE-3150]. 2017-07-21 09:46:50 +03:00
Alexey Milovidov
c7b1e92522 Fixed error after merge [#CLICKHOUSE-3150]. 2017-07-21 09:40:05 +03:00
alexey-milovidov
d4d266fa18 ColumnConst unification (#1011)
* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* Fixed error in ColumnArray::replicateGeneric [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].
2017-07-21 09:35:58 +03:00
alexey-milovidov
1a1112d8bb Update MergeTreeBlockReadUtils.h 2017-07-20 23:45:23 +03:00
Nikolai Kochetov
0b7439469d fixed MergeTreeBlockSizePredictor initialization for sample block 2017-07-20 23:45:23 +03:00
Nikolai Kochetov
00ae32c946 renamed approximate_number_of_rows_in_part to number_of_rows_in_part 2017-07-20 23:45:23 +03:00
Nikolai Kochetov
e612152584 changed initialization in MergeTreeBlockSizePredictor 2017-07-20 23:45:23 +03:00
Vladimir Chebotarev
7254478fde functions: Remote mode for hasColumnInTable. [#CHEBOTAREV-9] 2017-07-20 17:08:42 +03:00
Nikolai Kochetov
2afd84c40c fixed is_reading_finished status assignment in MergeTreeRangeReader [#CLICKHOUSE-3161] 2017-07-19 19:39:18 +03:00
Guillaume Tassery
57b4066da8 Improve performance for deserialization/serialization of UUID type 2017-07-19 19:26:37 +03:00
proller
3f9cdfe464 PerformanceTest: Add memory and threads info (#1004)
* Cmake: clear test variables with CMakePushCheckState (it will fix macos build issue)

* Add some perf tests

* Fix PerformanceTest, fix tests

* Add nyc-taxi queries

* Update PerformanceTest.cpp

* PerformanceTest: allow recursive .xml search

* Tests tune

* Move tests to dirs

* --recursive

* Add space

* PerformanceTest: Add memory and threads info
2017-07-19 18:18:47 +03:00
Nikolai Kochetov
b5e94ede62 fixed is_reading_finished status assignment in MergeTreeRangeReader [#CLICKHOUSE-3161] 2017-07-19 16:44:46 +03:00
Alexey Milovidov
6e6e9f9d38 Removed useless variable [#CLICKHOUSE-3161]. 2017-07-19 04:05:39 +03:00
proller
ae626281b6 PerformanceTest: add --recursive option. add more threaded/not threaded tests (#997)
* Cmake: clear test variables with CMakePushCheckState (it will fix macos build issue)

* Add some perf tests

* Fix PerformanceTest, fix tests

* Add nyc-taxi queries

* Update PerformanceTest.cpp

* PerformanceTest: allow recursive .xml search

* Tests tune

* Move tests to dirs

* --recursive

* Add space
2017-07-18 23:41:24 +03:00
Alexey Zatelepin
4866a37a2b fix selecting max_threads for MergingAggregatedBlockInputStream [#CLICKHOUSE-3156] 2017-07-18 23:40:23 +03:00
alexey-milovidov
25288ac4d5 Update PerformanceTest.cpp 2017-07-18 19:35:01 +03:00
proller
cd54ff0f82 Fix PerformanceTest, fix tests 2017-07-18 19:35:01 +03:00
Nikolai Kochetov
7e293df9af merged with master 2017-07-17 22:48:22 +03:00
Nikolai Kochetov
39cb5e0e3e fixed ColumnGathererStream finish reading condition 2017-07-17 22:43:09 +03:00
Nikolai Kochetov
eae94edd6b fixed vertical merge for ReplacingSortedBlockInputStream [#CLICKHOUSE-3131] 2017-07-17 22:40:30 +03:00
Alexey Milovidov
295459e89e Miscellaneous [#CLICKHOUSE-2]. 2017-07-17 01:55:40 +03:00
Alexey Milovidov
bfc099ea5f Miscellaneous [#CLICKHOUSE-2]. 2017-07-17 01:41:15 +03:00
Alexey Milovidov
930c373309 Added synonims for few data types for compatibility with Tableau [#CLICKHOUSE-3141]. 2017-07-16 08:09:47 +03:00
Alexey Milovidov
5f98f4b862 Addition to prev. revision [#CLICKHOUSE-3149]. 2017-07-16 07:11:11 +03:00
Alexey Milovidov
5c3ca0c16e Inverted dependency in DataTypeFactory [#CLICKHOUSE-3149]. 2017-07-16 07:11:11 +03:00
Alexey Milovidov
17786c0e6d Added missing file [#CLICKHOUSE-3148]. 2017-07-15 07:06:51 +03:00
Alexey Milovidov
9406b6a5aa Get rid of ASTSet, because it is not really an AST and it lead to bugs [#CLICKHOUSE-3148]. 2017-07-15 06:48:36 +03:00
Alexey Milovidov
200a1e27e3 Merge branch 'master' into get-rid-of-ast-set 2017-07-15 03:23:20 +03:00
Vitaliy Lyudvichenko
c6eb11aad5 Use more suitable method hasRealColumn. [#CLICKHOUSE-2896] 2017-07-15 03:21:19 +03:00
Vitaliy Lyudvichenko
9ce4ff4c5b Add check for unexisting column in CLEAR COLUMN. [#CLICKHOUSE-2896] 2017-07-15 03:21:19 +03:00
Alexey Zatelepin
b10e9d1f18 Vertical merge fix: don't forget to output last source_to_fully_copy [#CLICKHOUSE-3118] 2017-07-14 22:06:40 +03:00
Nikolai Kochetov
a13423e552 added vertical merge for ReplacingSortedBlockInputStream 2017-07-14 21:17:23 +03:00
Alexey Milovidov
9bb902c3ef Allow to use database.table in right hand side of IN, JOIN [#CLICKHOUSE-3144]. 2017-07-14 04:00:29 +03:00
Alexey Milovidov
4a5fb9eb7b Miscellaneous [#CLICKHOUSE-2]. 2017-07-14 03:34:00 +03:00
Alexey Milovidov
1a0f5dd7cf Getting rid of ASTSet (incomplete) [#CLICKHOUSE-2] 2017-07-14 03:33:37 +03:00
alexey-milovidov
37985d3cb8 Merge pull request #981 from yandex/reduce-memory-consumprion-during-reading-column-string-from-native-block
Reduce memory consumprion during reading column string from native block
2017-07-14 00:01:50 +03:00
Nikolai Kochetov
283810e8ab merged with master 2017-07-13 23:59:34 +03:00
Nikolai Kochetov
75be0b81d8 removed typeid_cast from IColumn.h 2017-07-13 23:58:19 +03:00
Maxim Fridental
82b53b712a findClusterIndex: fix virtual method, improve formatting 2017-07-13 22:39:37 +03:00
Maxim Fridental
ff4df27cad Improve implementation of findClusterIndex and findClusterValue, add test 2017-07-13 22:39:37 +03:00
Nikolai Kochetov
210f14aaba renamed IDataType::updateAvgValueSizeHints to IDataType::updateAvgValueSizeHint 2017-07-13 21:54:17 +03:00
Nikolai Kochetov
f3f217b40a fixed tests 2017-07-13 21:45:09 +03:00
Nikolai Kochetov
546012079c fixed reading with zero max block size setting 2017-07-13 21:45:09 +03:00
Nikolai Kochetov
e2d032b883 fixed reading with zero max block size setting 2017-07-13 21:45:09 +03:00
Nikolai Kochetov
8ea812e669 better comment for MergeTreeRangeReader 2017-07-13 21:45:09 +03:00
Nikolai Kochetov
f232afd2f8 round number of rows to nearest mark in MergeTreeBaseBlockInputStream 2017-07-13 21:45:09 +03:00
Nikolai Kochetov
f1775af3f0 deleted commented code 2017-07-13 21:45:09 +03:00
Nikolai Kochetov
30ed774bf7 refactoring and more comments in MergeTreeBaseBlockInputStream [#CLICKHOUSE-3065] 2017-07-13 21:45:09 +03:00
Nikolai Kochetov
89386394aa refactoring and more comments in MergeTreeBaseBlockInputStream [#CLICKHOUSE-3065] 2017-07-13 21:45:09 +03:00
Nikolai Kochetov
8c65d6013e added preferred_max_column_in_block_size_bytes setting, added filtration ratio prediction [#CLICKHOUSE-3065] 2017-07-13 21:45:09 +03:00
Nikolai Kochetov
4470afc9a9 added estimateNumRowsMax to MergeTreeBlockSizePredictor based on max column size 2017-07-13 21:45:09 +03:00
Nikolai Kochetov
6b29b3bd47 round number of rows to next mark in MergeTreeBaseBlockInputStream 2017-07-13 21:45:09 +03:00
Nikolai Kochetov
d14f64af7b delected commented logging code 2017-07-13 21:45:09 +03:00
Nikolai Kochetov
586dff9126 delay reading for granulas if prewhere column is false during partial granula reading 2017-07-13 21:45:09 +03:00
Nikolai Kochetov
86680f5513 fixed partial granula reading for const columns in prewhere 2017-07-13 21:45:09 +03:00
Nikolai Kochetov
609711b20c partial part reading with prewhere 2017-07-13 21:45:09 +03:00
Nikolai Kochetov
c6d5ef6d30 added MergeTreeRangeReader 2017-07-13 21:45:09 +03:00
Nikolai Kochetov
5d1f4355a1 fixed allocated size calculation for ColumnArray 2017-07-13 19:53:34 +03:00
Nikolai Kochetov
985e449bd3 added IDataType::updateAvgValueSizeHints; renamed PODArray::allocated_size to PODArray::allocated_bytes; renamed renamed IColumn::allocatedSize to IColumn::allocatedBytes; removed IColumn.h from IDataType.h 2017-07-13 19:49:09 +03:00
Nikolai Kochetov
7c450aa5a5 added Block::allocatedSize() 2017-07-13 17:47:46 +03:00
Nikolai Kochetov
d67a6c08cd fixed allocated size calculation for ColumnString and ColumnVector 2017-07-13 17:41:55 +03:00
Alexey Milovidov
8a8596c58f Using lexer: additions [#CLICKHOUSE-2]. 2017-07-13 09:10:56 +03:00
Alexey Milovidov
c4ea197232 Using lexer: fixed error [#CLICKHOUSE-2]. 2017-07-13 09:05:38 +03:00
Alexey Milovidov
aa7ab3e23e Using lexer: added missing file [#CLICKHOUSE-2]. 2017-07-13 08:59:01 +03:00
Alexey Milovidov
00486d0de4 Using lexer: better error messages [#CLICKHOUSE-2]. 2017-07-13 08:59:01 +03:00
Alexey Milovidov
cedf9b34c9 Using lexer: better error messages [#CLICKHOUSE-2]. 2017-07-13 08:59:01 +03:00
Alexey Milovidov
3659f653fb Using lexer: better error messages [#CLICKHOUSE-2]. 2017-07-13 08:59:01 +03:00
Alexey Milovidov
6f4f95412f Using lexer: better error messages [#CLICKHOUSE-2]. 2017-07-13 08:59:01 +03:00
Alexey Milovidov
708b69abed Using lexer: better error messages [#CLICKHOUSE-2]. 2017-07-13 08:59:01 +03:00
Alexey Milovidov
47d9083c08 Using lexer: better error messages [#CLICKHOUSE-2]. 2017-07-13 08:59:01 +03:00
Alexey Milovidov
96468884f3 Using lexer: better error messages [#CLICKHOUSE-2]. 2017-07-13 08:59:01 +03:00
Alexey Milovidov
0614ba5684 Using lexer: better error messages [#CLICKHOUSE-2]. 2017-07-13 08:59:01 +03:00
Alexey Milovidov
be1710ecef Using lexer (development) [#CLICKHOUSE-2]. 2017-07-13 08:59:01 +03:00
Alexey Milovidov
d4974b0724 Using lexer (development) [#CLICKHOUSE-2]. 2017-07-13 08:59:01 +03:00
Alexey Milovidov
f6ff1f7e72 Using lexer (development) [#CLICKHOUSE-2]. 2017-07-13 08:59:01 +03:00
Alexey Milovidov
2e6ceeba1c Using lexer (development) [#CLICKHOUSE-2]. 2017-07-13 08:59:01 +03:00
Alexey Milovidov
a8b6920eab Using lexer (development) [#CLICKHOUSE-2]. 2017-07-13 08:59:01 +03:00
Alexey Milovidov
cd8d8bf972 Using lexer (development) [#CLICKHOUSE-2]. 2017-07-13 08:59:01 +03:00
Alexey Milovidov
57d2f5d0e6 Using lexer (development) [#CLICKHOUSE-2]. 2017-07-13 08:59:01 +03:00
Alexey Milovidov
4562785c2a Using lexer (development) [#CLICKHOUSE-2]. 2017-07-13 08:59:01 +03:00
Alexey Milovidov
4255b81f3f Using lexer (development) [#CLICKHOUSE-2]. 2017-07-13 08:59:01 +03:00
Alexey Milovidov
65955d50e7 Using lexer (incomplete) [#CLICKHOUSE-2]. 2017-07-13 08:59:01 +03:00
Alexey Milovidov
bec6aac3bb Using lexer (incomplete) [#CLICKHOUSE-2]. 2017-07-13 08:59:01 +03:00
Alexey Milovidov
e4d410fe13 Using lexer (incomplete) [#CLICKHOUSE-2]. 2017-07-13 08:59:01 +03:00
Alexey Milovidov
d5c9301776 Using lexer (incomplete) [#CLICKHOUSE-2]. 2017-07-13 08:59:01 +03:00
Alexey Milovidov
02274ed511 Using lexer (incomplete) [#CLICKHOUSE-2]. 2017-07-13 08:59:01 +03:00
Alexey Milovidov
1cd998a9bd Using lexer (incomplete) [#CLICKHOUSE-2]. 2017-07-13 08:59:01 +03:00
Alexey Milovidov
7068d1ff81 Using lexer (incomplete) [#CLICKHOUSE-2]. 2017-07-13 08:59:01 +03:00
Alexey Milovidov
de75fa000b Using lexer (incomplete) [#CLICKHOUSE-2]. 2017-07-13 08:59:01 +03:00
Alexey Milovidov
2073fef375 Using lexer (incomplete) [#CLICKHOUSE-2]. 2017-07-13 08:59:01 +03:00
Alexey Milovidov
83c8043193 Using lexer (incomplete) [#CLICKHOUSE-2]. 2017-07-13 08:59:01 +03:00
Alexey Milovidov
1bab7fc344 Using lexer (incomplete) [#CLICKHOUSE-2]. 2017-07-13 08:59:01 +03:00
Alexey Milovidov
d815b766fa Using lexer (incomplete) [#CLICKHOUSE-2]. 2017-07-13 08:59:01 +03:00
Alexey Milovidov
4b1eeee1a3 Using lexer (incomplete) [#CLICKHOUSE-2]. 2017-07-13 08:59:01 +03:00
Alexey Milovidov
5b5795633e Using lexer (incomplete) [#CLICKHOUSE-2]. 2017-07-13 08:59:01 +03:00
Alexey Milovidov
ad598d5dfc Added lexer [#CLICKHOUSE-2]. 2017-07-13 08:59:01 +03:00
Alexey Milovidov
e8170fde2a Fixed error in prev. revisions [#CLICKHOUSE-2]. 2017-07-13 03:04:51 +03:00
Nikolai Kochetov
1cf669cc0a made collectIdentifiersInFirstLevelOfSelectQuery static 2017-07-12 21:51:51 +03:00
Nikolai Kochetov
5ed5e8c75d moved getRequestedColumns to StorageMerge::collectIdentifiersInFirstLevelOfSelectQuery 2017-07-12 21:51:51 +03:00
Nikolai Kochetov
7c705b1a24 added RemoveColumnsBlockInputStream 2017-07-12 21:51:51 +03:00
Nikolai Kochetov
5924b13f4c fixed unnecessary columns removing for merge table on distibuted 2017-07-12 21:51:51 +03:00
Nikolai Kochetov
489af678d5 added avg_value_size_hint for NativeBlockInputStream [#CLICKHOUSE-3066] 2017-07-12 21:41:08 +03:00
Alexey Zatelepin
58d541b740 slightly more robust ReplicatedMergeTreePartCheckThread::TemporarilyStop [#CLICKHOUSE-3074] 2017-07-12 20:09:44 +03:00
Alexey Zatelepin
bdc529645e fix cyclical yielding of leadership at startup [#CLICKHOUSE-3074] 2017-07-12 20:09:44 +03:00
Alexey Milovidov
1908b2b5a5 Fixed error in prev. revision [#CLICKHOUSE-2]. 2017-07-12 19:51:39 +03:00
Alexey Zatelepin
5e61a56743 always initialize trie ptr (just in case) [#CLICKHOUSE-3087] 2017-07-12 16:35:05 +03:00
Alexey Zatelepin
4d4387f1c8 fix reloading of TrieDictionary [#CLICKHOUSE-3087] 2017-07-12 16:35:05 +03:00
Alexey Milovidov
bb38ec2c21 Fixed discrepancy in file names [#CLICKHOUSE-2]. 2017-07-12 04:16:01 +03:00
Alexey Milovidov
1048fccf6b Misc [#CLICKHOUSE-2]. 2017-07-12 03:49:30 +03:00
Alexey Milovidov
24331a18f5 Removing dependency on functions from client: bug fixes [#CLICKHOUSE-2]. 2017-07-12 03:42:50 +03:00
Alexey Milovidov
976e47e1af Removing dependency on functions from client: preparation [#CLICKHOUSE-2]. 2017-07-12 03:42:50 +03:00
Alexey Milovidov
8c1a6f5736 Removing dependency on functions from client: preparation [#CLICKHOUSE-2]. 2017-07-12 03:42:50 +03:00
Alexey Milovidov
33c6e0b804 Removing dependency on functions from client: preparation [#CLICKHOUSE-2]. 2017-07-12 03:42:50 +03:00
Alexey Milovidov
3e3af1cff4 Misc [#CLICKHOUSE-2]. 2017-07-11 23:12:15 +03:00
Alexey Milovidov
fb8d8ec768 Fixed error (tnx Vladimir Chebotarev) [#CLICKHOUSE-2]. 2017-07-11 21:59:01 +03:00
Vitaliy Lyudvichenko
b843ea5b3f Resolves #964. Fixed input_format_skip_unknown_fields for negative numbers. [#CLICKHOUSE-3] 2017-07-11 21:36:51 +03:00
Alexey Zatelepin
7892129481 peformance-test: fix rows_read, bytes_read calculation [#CLICKHOUSE-3086] 2017-07-11 21:26:05 +03:00
Nikolai Kochetov
ee66169d5e added throw_if_column_not_found to FilterColumnsBlockInputStream [#CLICKHOUSE-3111] 2017-07-11 20:58:49 +03:00
Alexey Zatelepin
57ba50f585 allow batching Distributed inserts [#CLICKHOUSE-3126] 2017-07-11 20:56:17 +03:00
Alexey Zatelepin
4a98d83a3b introduce replicated_can_become_leader merge_tree setting [#CLICKHOUSE-3109] 2017-07-11 20:44:35 +03:00
Alexey Milovidov
cefc1a58b6 Merge branch 'master' of github.com:yandex/ClickHouse 2017-07-11 04:20:48 +03:00
Alexey Milovidov
2bd84600d1 Miscellaneous [#CLICKHOUSE-2]. 2017-07-11 04:20:40 +03:00
Nikolai Kochetov
524507b9b8 fixed setting comparison 2017-07-10 21:15:56 +03:00
Nikolai Kochetov
c06c234c63 added deleted comment after merge 2017-07-10 17:33:52 +03:00
Nikolai Kochetov
7d5590d66d Merge branch 'master' into output-format-json-quote-denormals 2017-07-10 17:29:17 +03:00
Nikolai Kochetov
39797813cc disabled check for settings with same value in readonly mode in InterpreterSetQuery [#CLICKHOUSE-3041]; added tests for output_format_json_quote_denormals setting 2017-07-10 17:03:34 +03:00
Alexey Milovidov
86eb4d2d06 Renamed Singleton to avoid conflicts with Arcadia* codebase [#DEVTOOLS-3343].
* - "Arcadia" is the name of Yandex's monorepo.
2017-07-10 07:34:14 +03:00
Alexey Milovidov
16a6eee397 Fixed build after merge [#CLICKHOUSE-3]. 2017-07-10 07:22:36 +03:00
Alexey Milovidov
1040abfd18 Fixed build after merge [#CLICKHOUSE-3]. 2017-07-10 07:16:11 +03:00
Alexey Milovidov
a742ac3b6c Fixed build after merge [#CLICKHOUSE-3]. 2017-07-10 07:10:39 +03:00
Alexey Milovidov
78e905aa3a Fixed build after merge [#CLICKHOUSE-3]. 2017-07-10 07:10:25 +03:00
alexey-milovidov
b64b243a73 Merge pull request #945 from YiuRULE/master
Implement natively uuid type in Clickhouse
2017-07-10 07:00:45 +03:00
Alexey Milovidov
119961133c Removed obsolete test [#CLICKHOUSE-3]. 2017-07-10 06:47:20 +03:00
Alexey Milovidov
bf58b8cdb1 Fixed test [#CLICKHOUSE-3]. 2017-07-10 06:45:04 +03:00
Alexey Milovidov
db3d56b1f5 Removed obsolete test binary [#CLICKHOUSE-3]. 2017-07-10 06:43:25 +03:00
Alexey Zatelepin
89939a685a Stream row sources from disk for vertical merge [#CLICKHOUSE-3118] 2017-07-09 21:57:06 +03:00
Alexey Zatelepin
1cd936579d introduce IColumn::gather() [#CLICKHOUSE-3118] 2017-07-09 21:57:06 +03:00
Nikolai Kochetov
d804855460 added FormatSettingsJSON.h 2017-07-09 20:16:26 +03:00
Nikolai Kochetov
25ac546e78 disabled exception during overriding settings with same value in readonly mode [#CLICKHOUSE-3041] 2017-07-09 20:16:26 +03:00
Nikolai Kochetov
63119eda7d updated FormatSettingsJSON 2017-07-09 20:16:26 +03:00
Nikolai Kochetov
0ead0ee2f1 added FormatSettingsJSON [#CLICKHOUSE-3060] 2017-07-09 20:16:26 +03:00
alexey-milovidov
894d09f797 Update IFunction.h 2017-07-09 17:13:51 +03:00
Marek Vavruša
ff73394124 PKCondition: infer index use with pk subexpression
By default only constraints explicitly matching
primary key expression (or expression wrapped in
a monotonic function) are eligible for part and
range selection. So for example, if index is:

(toStartOfHour(dt), UserID)

Then a query such as this resorts to full scan:

SELECT count() FROM t WHERE dt = now()

Intuitively, only parts with toStartOfHour(now())
could be selected, but it is less trivial to prove.
The primary key currently can be wrapped in a chain
of monotonic functions, so following would work:

toStartOfHour(dt) = toStartOfHour(now()) AND dt = now()

It must be however explicitly stated, if we wanted
to infer that we’d have to know the inverse function,
and prove that the inverse function is monotonic
on given interval. This is not practical as
there is no inverse function that for example undos
rounding, it isn’t strictly monotonic.

There are however functions that don’t transform
output range and preserve monotonicity on the
complete input range, such as rounding or casts
to a same or wider numeric type. This eliminates
the need to find inverse function, as no check for monotonicity over arbitrary interval is needed,
and thus makes this optimisation possible.
2017-07-09 17:13:51 +03:00
Vitaliy Lyudvichenko
b46a2a6eab Fixed infinite sleeping of low-priority queries. [#CLICKHOUSE-2] 2017-07-09 03:53:13 +03:00
Vitaliy Lyudvichenko
7150e9447a Fixed multiIf in case of empty arguments. [#CLICKHOUSE-3119] 2017-07-07 17:42:37 +03:00
Nikolai Kochetov
2f08ba9e94 added FormatSettingsJSON.h 2017-07-06 18:11:12 +03:00
Guillaume Tassery
2ec96fe822 Make UUID as a strong type 2017-07-06 16:50:29 +02:00
Nikolai Kochetov
d6001618f0 disabled exception during overriding settings with same value in readonly mode [#CLICKHOUSE-3041] 2017-07-06 17:42:31 +03:00
Liu Cong
08e43b149a Fix a typo of 'Columns/ColumnVector.h': metod => method 2017-07-05 20:46:37 +03:00
Nikolai Kochetov
c99a9b1c55 moved FilterColumnsBlockInputStream implementation to .cpp [#CLICKHOUSE-3111] 2017-07-05 20:14:17 +03:00
alexey-milovidov
85bdb472ea Update FilterColumnsBlockInputStream.h 2017-07-05 20:14:17 +03:00
alexey-milovidov
7bc0e40135 Update FilterColumnsBlockInputStream.h 2017-07-05 20:14:17 +03:00
Nikolai Kochetov
f1ec4cd863 added FilterColumnsBlockInputStream into StorageMerge [#CLICKHOUSE-3111] 2017-07-05 20:14:17 +03:00
Alexey Milovidov
66638c4158 Fixed error in StorageDictionary [#CLICKHOUSE-2]. 2017-07-05 19:36:45 +03:00
Guillaume Tassery
c6a5083419 Fix comparison of UInt128 to Float64 2017-07-05 18:29:16 +02:00
Nikolai Kochetov
13b275a174 updated FormatSettingsJSON 2017-07-05 19:28:57 +03:00
Guillaume Tassery
b90734920e Adapt UInt128 operator 2017-07-05 12:09:24 +02:00
Nikolai Kochetov
ebbca0001f added FormatSettingsJSON [#CLICKHOUSE-3060] 2017-07-04 19:26:38 +03:00
Guillaume Tassery
aeeb81fadf Rename field in UInt128 2017-07-04 18:10:36 +02:00
Alexey Milovidov
032d12d431 Fixed translation error [#CLICKHOUSE-2]. 2017-07-04 15:46:31 +03:00
Guillaume Tassery
cba9815981 Change Uuid to UUID datatype and make UInt128 a generic type 2017-07-04 12:42:53 +02:00
Alexey Milovidov
06f343c89e Misc [#CLICKHOUSE-3115]. 2017-07-04 00:04:40 +03:00
Alexey Milovidov
727ce48c23 Fixed error with selecting number of threads for distributed query processing [#CLICKHOUSE-3115]. 2017-07-04 00:04:10 +03:00
Alexey Milovidov
15cf838250 Cosmetics [#CLICKHOUSE-2] 2017-07-03 21:29:56 +03:00
Alexey Milovidov
c170b6f0d2 Removed useless code [#CLICKHOUSE-3111]. 2017-07-03 20:34:27 +03:00
Guillaume Tassery
d6ab06437a Remove mention of UUID type for dictonnary 2017-07-03 18:08:32 +02:00
Alexey Milovidov
5a015a1475 Misc fixes after merge [#CLICKHOUSE-3]. 2017-07-03 17:17:46 +03:00
Alexey Milovidov
a38bf1cbb3 Fixed bad code after merge [#CLICKHOUSE-3]. 2017-07-03 17:16:20 +03:00
Alexey Milovidov
320b1e635b Fixed build after merge [#CLICKHOUSE-3]. 2017-07-03 17:14:44 +03:00
Alexey Milovidov
43daa720a4 Fixed build after merge [#CLICKHOUSE-3]. 2017-07-03 17:09:32 +03:00
Marek Vavruša
d27bed228b Parser: fix CREATE VIEW IF EXISTS #934
The else branch forgot to consume whitespace after
CREATE token, and after VIEW token.
2017-07-03 17:01:43 +03:00
Maxim Fridental
e30c9242bc Implement functions findClusterIndex and findClusterValue. 2017-07-03 17:01:21 +03:00
Guillaume Tassery
525851ec68 sync master 2017-06-30 22:21:42 +02:00
Guillaume Tassery
1231952fca Implement UUID type and toUuid function 2017-06-30 22:01:27 +02:00
Alexey Zatelepin
9de4d8facb allow loading missing setting from config [#CLICKHOUSE-3091] 2017-06-28 19:56:35 +03:00
Alexey Zatelepin
7cf413dea8 Revert "Raised up limit on max size of parts to merge [#CLICKHOUSE-3091]."
This reverts commit 425156e32c.
2017-06-28 15:32:52 +03:00
Alexey Milovidov
2b67782845 Applied clang-format [#CLICKHOUSE-2]. 2017-06-28 15:30:23 +03:00
Alexey Milovidov
39ddcf1c74 Fixed build [#CLICKHOUSE-2]. 2017-06-28 15:24:49 +03:00
Alexey Milovidov
c6b83a1c60 Fixed build [#CLICKHOUSE-2]. 2017-06-28 15:22:07 +03:00
Alexey Zatelepin
6768ebd53f less strict parse() functions (restore compatibility with JDBC driver) [#CLICKHOUSE-2949] 2017-06-27 18:58:33 +03:00
Marek Vavruša
e189c39056 SpaceSaving: internal storage for StringRef{}
The SpaceSaving has now specialised storage for
some keys, which only copies keys that
are to be retained in the structure, not all.

Most of the PODs implement this interface empty,
so there shouldn’t be any extra cost.
2017-06-26 21:16:13 +03:00
Vitaliy Lyudvichenko
97f7b46ebd Fixed CLEAR COLUMN test in case of deduplication rollback. [#CLICKHOUSE-2] 2017-06-26 19:34:38 +03:00
Vitaliy Lyudvichenko
9c0da6e698 Addition to previous commit. Fix error code, rename test tables. [#CLICKHOUSE-2] 2017-06-26 17:35:26 +03:00
Vitaliy Lyudvichenko
49cbc33a6b Fix ZK exception in case of concurrent INSERTs in new partition. [#CLICKHOUSE-2] 2017-06-26 17:21:25 +03:00
Alex Zatelepin
8f250d4a18 Merge pull request #927 from yandex/fix-profile-info-race
Fix race condition while initializing BlockStreamProfileInfo
2017-06-26 16:38:26 +03:00
Vitaliy Lyudvichenko
b53d6976b3 Fix build after merge. [#CLICKHOUSE-2] 2017-06-26 15:47:15 +03:00
Alexey Zatelepin
1917de0380 fix race condition while initializing BlockStreamProfileInfo [#CLICKHOUSE-3099] 2017-06-26 15:30:35 +03:00
Alexey Milovidov
a48a21f593 Merge branch 'master' into CLICKHOUSE-2896 2017-06-26 11:54:58 +03:00
Alexey Milovidov
219740155a Merge branch 'master' of github.com:yandex/ClickHouse 2017-06-26 11:34:02 +03:00
Alexey Milovidov
0565aea988 Whitespaces [#CLICKHOUSE-2]. 2017-06-26 11:33:56 +03:00
alexey-milovidov
e122cf0bcf Merge pull request #914 from yandex/database-dictionary
DatabaseDictionary
2017-06-25 22:02:45 +03:00
Alexey Milovidov
8f145da1e8 Preparation [#CLICKHOUSE-2]. 2017-06-25 06:43:59 +03:00
Alexey Milovidov
dbc61a6a43 Added support for SQL-style quoting [#CLICKHOUSE-20]. 2017-06-25 06:43:37 +03:00
Alexey Milovidov
275a1d4651 Improvement [#CLICKHOUSE-3091]. 2017-06-25 05:48:38 +03:00
Alexey Milovidov
90a1ae1062 Fixed error in prev. revision [#CLICKHOUSE-3091]. 2017-06-25 05:22:10 +03:00
Alexey Milovidov
516b095423 Fixed error in prev. revision [#CLICKHOUSE-3091]. 2017-06-25 04:54:25 +03:00
Alexey Milovidov
8228acd3ea Removed obsolete code that was relevant only in extremely rare case of transforming CollapsingMergeTree to ReplicatedCollapsingMergeTree through ATTACHing data parts and while some considerations about data order in table is important [#CLICKHOUSE-3091]. 2017-06-25 03:51:51 +03:00
Alexey Milovidov
3c660fd65b Fixed translation errors [#CLICKHOUSE-3091]. 2017-06-25 03:17:08 +03:00
Alexey Milovidov
28e9e06992 Preparation: locking block number only after write to filesystem; removed obsolete code [#CLICKHOUSE-3091]. 2017-06-25 03:01:10 +03:00
Alexey Milovidov
c7f35997f5 Removed unused variable [#CLICKHOUSE-2]. 2017-06-25 01:36:43 +03:00
Alexey Milovidov
30b6c36b83 Added support for identifiers in double quotes [#CLICKHOUSE-20]. 2017-06-24 04:49:15 +03:00
proller
4db8d09de9 Reorganize includes. part 1 (#921)
* Make libunwind optional. Allow use custom libcctz

* fix

* Fix

* fix

* Update BaseDaemon.cpp

* Update CMakeLists.txt

* Reorganize includes. part 1

* Update dbms_include.cmake

* Reorganize includes. part 2

* Reorganize includes. part 3

* dbms/src/Common/ThreadPool -> libs/libcommon

* Reorganize includes. part 4

* Fix print_include_directories

* Update thread_creation_latency.cpp

* Update StringRef.h
2017-06-23 23:22:35 +03:00
Nikolai Kochetov
c2ddb63218 merged with remote 2017-06-23 19:04:30 +03:00
Nikolai Kochetov
adb632319d DatabaseDictionary creates new storage for every create table query; drop table works untill restart 2017-06-23 18:55:45 +03:00
Alexey Milovidov
061c214c16 Fixed error [#CLICKHOUSE-3074]. 2017-06-23 09:57:55 +03:00
Alexey Milovidov
3c33f1841f Little better [#CLICKHOUSE-2]. 2017-06-23 09:45:48 +03:00
Alexey Milovidov
f409cad0ac Miscellaneous [#CLICKHOUSE-3091]. 2017-06-23 09:18:00 +03:00
Alexey Milovidov
7f48f1a7f5 Fixed error [#CLICKHOUSE-2]. 2017-06-23 09:11:00 +03:00
Alexey Milovidov
d51245809f Fixed error in SessionCleaner [#CLICKHOUSE-2949]. 2017-06-23 08:53:04 +03:00
Alexey Milovidov
324fc7ef3e Miscellaneous [#CLICKHOUSE-3094]. 2017-06-23 08:39:27 +03:00
Alexey Zatelepin
87fbfe0950 correct comparisons for strings with null bytes [#CLICKHOUSE-3070] 2017-06-22 23:10:43 +03:00
Alexey Zatelepin
cc87d4ad80 add string comparisons performance test [#CLICKHOUSE-3070] 2017-06-22 23:10:43 +03:00
Alexey Milovidov
7d732343eb Fixed error in prev. revision [#CLICKHOUSE-3091]. 2017-06-22 22:52:06 +03:00
Alexey Milovidov
7b7b3ac3d8 Merge branch 'master' of github.com:yandex/ClickHouse 2017-06-22 22:45:36 +03:00
proller
70d9fb06b4 PerformanceTest: use getMultiple*FromConfig, fix debug helpers (#915)
* PerformanceTest: use getMultiple*FromConfig, fix debug helpers

* Missing file
2017-06-22 21:56:40 +03:00
Alexey Milovidov
425156e32c Raised up limit on max size of parts to merge [#CLICKHOUSE-3091]. 2017-06-22 21:29:40 +03:00
Alexey Milovidov
990e62e579 Miscellaneous [#CLICKHOUSE-2]. 2017-06-22 21:16:28 +03:00
proller
23fa44aa50 Server startup: print info about available ram and number of cores/threads (#906)
* Fix missing includes

* ComplexKeyCacheDictionary: Move includes to .cpp

* Fixing PerformanceTest: table_exists condition, move getMemoryAmount function to file. Add more debug helpers

* Multiplatform memory size getter

* Server startup: print info about available ram and number of cores/threads

* Requested changes

* Requested changes

* Requested changes

* fix

* Requested changes

* Requested changes
2017-06-22 21:08:14 +03:00
alexey-milovidov
145912724a Update DatabaseDictionary.h 2017-06-22 21:00:29 +03:00
alexey-milovidov
11b81e6683 Update StorageDictionary.cpp 2017-06-22 20:59:19 +03:00
Alexey Milovidov
6eb06774d3 Addition to prev. revision [#CLICKHOUSE-3091]. 2017-06-22 19:29:15 +03:00
Alexey Milovidov
c96719685c Lowered max_delay_to_insert to one second, because higher values are non practical and could be harmful for usual failover logic in client apps [#CLICKHOUSE-3091]. 2017-06-22 19:17:01 +03:00
Alexey Milovidov
941c281221 Updated comment [#CLICKHOUSE-3091]. 2017-06-22 19:09:03 +03:00
Alexey Milovidov
22e7070fb0 Merge branch 'master' of github.com:yandex/ClickHouse 2017-06-22 19:07:57 +03:00
Alexey Milovidov
bb7fc04e2b Whitespaces [#CLICKHOUSE-2]. 2017-06-22 19:07:52 +03:00
proller
8ef51bf19b Fixing PerformanceTest: table_exists condition, move getMemoryAmount function to file. Add more debug helpers (#905)
* Fix missing includes

* ComplexKeyCacheDictionary: Move includes to .cpp

* Fixing PerformanceTest: table_exists condition, move getMemoryAmount function to file. Add more debug helpers

* Multiplatform memory size getter

* Requested changes

* Requested changes

* Requested changes

* fix

* Requested changes
2017-06-22 18:57:37 +03:00
Nikolai Kochetov
4c114bc3a1 added DatabaseDictionary 2017-06-22 18:44:19 +03:00
Vitaliy Lyudvichenko
d7db235269 Better names and log messages. [#CLICKHOUSE-2896] 2017-06-22 18:32:09 +03:00
Vitaliy Lyudvichenko
99f502d5e0 Support OPTIMIZE query on non-leader replica. [#CLICKHOUSE-2] 2017-06-22 18:01:08 +03:00
proller
51b41aa0e3 Fix build 2017-06-22 17:14:13 +03:00
Vitaliy Lyudvichenko
eff3588f28 Rename DROP COLUMN FROM PARTITION -> CLEAR COLUMN IN PARTITION. [#CLICKHOUSE-2896] 2017-06-22 16:18:19 +03:00
Alexey Milovidov
4af5a9c7ba Merge branch 'cache_parts_that_cannot_be_merged' 2017-06-22 03:56:44 +03:00
Alexey Milovidov
946c275dfb Added missing case for broken files in StorageDistributed [#CLICKHOUSE-3091]. 2017-06-22 03:56:17 +03:00
Alexey Milovidov
db546dc827 Caching parts that cannot be merged for some time [#CLICKHOUSE-3091]. 2017-06-22 03:28:44 +03:00
Vitaliy Lyudvichenko
53adb891b3 Add replicated DROP COLUMN FROM partition for optimistic case. [#CLICKHOUSE-2896] 2017-06-22 00:56:38 +03:00
Alexey Zatelepin
374e92f76e performance-test: allow same stop condition to be present in all_of and any_of sections [#CLICKHOUSE-3086] 2017-06-21 22:20:57 +03:00
Alexey Zatelepin
1783d233e2 performance-test: do not take cancelled query times into account [#CLICKHOUSE-3086] 2017-06-21 22:20:57 +03:00
Alexey Zatelepin
0bc0150682 performance-test: add server version to json output [#CLICKHOUSE-3086] 2017-06-21 22:20:57 +03:00
Alexey Zatelepin
53aa599dc7 performance-test: rename params for clarity [#CLICKHOUSE-3086] 2017-06-21 22:20:57 +03:00
Alexey Zatelepin
678d1ef605 performance-test: fix incorrect results reporting [#CLICKHOUSE-3086] 2017-06-21 22:20:57 +03:00
Alexey Zatelepin
ef2cf67736 performance-test: allow several queries in xml scenarios [#CLICKHOUSE-3086] 2017-06-21 22:20:57 +03:00
Alexey Milovidov
7bdc87adf0 Loosened threshold on broken parts in filesystem [#CLICKHOUSE-3076]. 2017-06-21 22:11:11 +03:00
Alexey Milovidov
5c322f5756 Loosened threshold on amount of replica inconsistency to refuse server startup [#CLICKHOUSE-3076]. 2017-06-21 22:07:08 +03:00
Alexey Milovidov
f16eaa99a1 Fixed error with unusual case of ARRAY JOIN [#METR-25109]. 2017-06-21 21:21:37 +03:00
Alexey Milovidov
4738094d7e Fixed error when dynamically compiled .so file is broken [#METR-25550]. 2017-06-21 20:31:22 +03:00
Alexey Milovidov
6df5d556e5 Changed namespace [#DEVTOOLS-3381]. 2017-06-21 11:35:38 +03:00
Alexey Milovidov
a99f25f2a0 Merge branch 'master' of github.com:yandex/ClickHouse 2017-06-21 04:24:10 +03:00
Alexey Milovidov
604de2bfeb Better [#DEVTOOLS-3381]. 2017-06-21 04:24:05 +03:00
Vitaliy Lyudvichenko
8b72f573d8 Get rid of SET GLOBAL command. [#MTRSADMIN-3068] 2017-06-20 22:26:59 +03:00
Vitaliy Lyudvichenko
2167e4efdd Removed SET GLOBAL query. [#MTRSADMIN-3068]
It even was not supported properly in console client.
2017-06-20 22:26:59 +03:00