Commit Graph

4980 Commits

Author SHA1 Message Date
Alexey Milovidov
8b8c59d71b Simplification of #3796 2019-08-04 03:29:32 +03:00
Alexey Milovidov
a3a15d3a95 Addition to prev. revision 2019-08-04 03:28:12 +03:00
Alexey Milovidov
224bc4df97 Minor modifications + a comment #3796 2019-08-04 03:12:17 +03:00
alexey-milovidov
b045e85469
Merge pull request #3796 from amosbird/hang
Fix materialized view with column defaults.
2019-08-04 03:06:40 +03:00
alexey-milovidov
e61f647492
Merge pull request #6282 from nikvas0/nikvas0/fix_set_index
fix operators in set index
2019-08-04 02:52:57 +03:00
alexey-milovidov
2b6a28f617
Merge pull request #6279 from yandex/remove-cat-boost-pool
Removed table function "catBoostPool" and storage "CatBoostPool"
2019-08-03 04:59:55 +03:00
alexey-milovidov
d3e4249420
Merge branch 'master' into ttldropparts 2019-08-03 02:17:29 +03:00
Alexey Milovidov
21cb7de777 More validation of part_name 2019-08-02 23:21:31 +03:00
alexey-milovidov
f8980e691e
Merge pull request #6274 from CurtizJ/ttl-old-parts
TTL improvements.
2019-08-02 22:51:28 +03:00
Nikita Vasilev
bfa9a2c86f fixed index condition 2019-08-02 22:21:55 +03:00
Alexey Milovidov
a5105f85cf Removed table function "catBoostPool" and storage "CatBoostPool" 2019-08-02 21:52:43 +03:00
CurtizJ
e06a53a5d9 fix ranges selection at reading in order 2019-08-02 20:34:29 +03:00
Nikolai Kochetov
1f6a16b03a Remove ValuesRowInputStream. 2019-08-02 20:16:58 +03:00
CurtizJ
a6e85a331a more optimal ranges selection at reading in order 2019-08-02 19:37:43 +03:00
CurtizJ
5f7ebb18ed more optimal ranges selection at reading in order 2019-08-02 19:16:18 +03:00
Nikolai Kochetov
dd90932222 Update FormatFactory. 2019-08-02 18:06:31 +03:00
Nikita Vasilev
7aacbbdc5a fix bug 2019-08-01 22:18:36 +03:00
CurtizJ
d169f42b36 fix build 2019-08-01 22:07:31 +03:00
CurtizJ
b8dff6ebb1 more optimal ranges selection at reading in order 2019-08-01 22:03:39 +03:00
CurtizJ
82f304f81e add query 'SYSTEM STOP TTL MERGES' 2019-08-01 18:36:12 +03:00
CurtizJ
c30bdecf6d add missing comments 2019-08-01 15:00:35 +03:00
alexey-milovidov
e034dab1be
Merge pull request #6255 from yandex/storage-values-simplification
Simplified code with parsing table declaration for table functions.
2019-08-01 14:58:28 +03:00
CurtizJ
f224269d41 filter by ttl parts created before 'alter ... modify ttl' query with 'optimize ... final' query 2019-08-01 14:10:42 +03:00
Alexey Milovidov
12f6b75284 Fixed error 2019-08-01 05:34:58 +03:00
Alexey Milovidov
49b6749280 Merge branch 'master' into fix-malicious-replica 2019-08-01 05:11:45 +03:00
Alexey Milovidov
26bb14da4e Simplified table function "values" 2019-08-01 05:03:15 +03:00
alexey-milovidov
a8793fbef3
Merge pull request #6209 from dimarub2000/values_list
VALUES list
2019-08-01 04:36:04 +03:00
Alexey Milovidov
f3921ce3e0 Changed boost::filesystem to std::filesystem 2019-08-01 01:37:41 +03:00
Alexey Milovidov
bc9d620155 Fixed the case when malicious ClickHouse replica can force clickhouse-server to write to arbitrary path 2019-07-31 22:31:04 +03:00
Alexander Tokmakov
f0836553d4 drop detached partition 2019-07-31 18:27:21 +03:00
alexey-milovidov
ac5d2a225d
Merge pull request #6226 from yandex/aku/lock-tinylog
Lock the TinyLog storage when reading.
2019-07-31 17:40:55 +03:00
Dmitry Rubashkin
a449a00e58 Comments are now in right places 2019-07-31 17:12:05 +03:00
Dmitry Rubashkin
f91c64bd28 parser changed, test modified, comments added 2019-07-31 17:06:22 +03:00
Alexander Kuzmenkov
3ff143c60f Lock the TinyLog storage when reading.
Unlike StripeLog, we only have one set of files per column, so we can't
read concurrently with writing. We didn't use any locking before, and
that lead to user-visible error messages and tsan failures.
2019-07-31 13:59:12 +03:00
alexey-milovidov
30c35b1cbf
Update StorageValues.cpp 2019-07-31 01:06:48 +03:00
Alexander Tokmakov
c6717e0d3f refactor attachPartition 2019-07-30 22:11:15 +03:00
Alexander Tokmakov
2f33df1b2e rename all parts before attaching 2019-07-30 20:24:40 +03:00
Dmitry Rubashkin
7945d05565 Minor style fixes 2019-07-30 15:15:02 +03:00
Amos Bird
6db1c02bfd Fix materialized view with column defaults.
https://github.com/yandex/ClickHouse/issues/448
https://github.com/yandex/ClickHouse/issues/3484
https://github.com/yandex/ClickHouse/issues/3450
https://github.com/yandex/ClickHouse/issues/2878
https://github.com/yandex/ClickHouse/issues/2285
2019-07-30 10:49:54 +08:00
Alexey Milovidov
b5b80fb342 Merge branch 'master' into thread_local_rng 2019-07-30 03:19:48 +03:00
Dmitry Rubashkin
45aebda677 Fixes and test 2019-07-29 19:20:17 +03:00
Dmitry Rubashkin
e9784573ea Values list implementation 2019-07-29 17:02:34 +03:00
Alexander Tokmakov
3c15b87003 Merge branch 'master' into alter_table_drop_detached_part 2019-07-29 14:29:23 +03:00
alesapin
86831fe500 Add ability to create immutable settings 2019-07-29 14:03:50 +03:00
Alexander Tokmakov
0fc47fbbe4 fixes 2019-07-29 13:27:37 +03:00
alesapin
d9a2ac123a Fix small typo and merge 2019-07-29 12:17:37 +03:00
alexey-milovidov
129e88ee26
Merge pull request #6189 from CurtizJ/order-by-efficient
Fix reading in order of sorting key and refactoring.
2019-07-28 19:43:49 +03:00
Alexey Milovidov
856cc1b9c5 Added thread_local_rng 2019-07-28 18:30:38 +03:00
Alexey Milovidov
c0e0166991 Updated contributors 2019-07-28 18:11:47 +03:00
Nikita Vasilev
39b40f8e42 fix replicated indices mutations 2019-07-28 17:55:51 +03:00
Nikita Vasilev
4c5003b3b9 const & 2019-07-28 14:45:50 +03:00
Nikita Vasilev
908623c029 style 2019-07-28 14:32:03 +03:00
Nikita Vasilev
63fe714420 fix 2019-07-28 14:10:35 +03:00
Sergi Vladykin
c5a42a6948 TTL: Only drop altogether the expired parts and not partially prune them.
Though in regular merges eviction of expired values still must happen.
2019-07-28 13:30:46 +03:00
CurtizJ
b4991b38bf Merge remote-tracking branch 'upstream/master' into order-by-efficient 2019-07-28 04:26:43 +03:00
CurtizJ
d69d68f065 rename setting 'optimize_pk_order' and some functions 2019-07-28 04:16:56 +03:00
CurtizJ
95a6b85267 fix reading in order of sorting_key 2019-07-28 03:41:26 +03:00
alexey-milovidov
12a15316fd
Merge pull request #6181 from 4ertus2/joins
Fix crop column names in GLOBAL JOIN ON
2019-07-28 00:31:29 +03:00
Nikita Vasilev
1118ce04b9 fixed 2019-07-27 18:36:40 +03:00
CurtizJ
08d5ebb54d Merge remote-tracking branch 'upstream/master' into order-by-efficient 2019-07-27 10:38:10 +03:00
Nikita Vasilev
7efb1bcb12 Merge remote-tracking branch 'upstream/master' into nikvas0/index_mutate 2019-07-27 10:30:43 +03:00
CurtizJ
12dcfe1f25 reduce number of read rows while reading in reverse order 2019-07-27 03:33:47 +03:00
CurtizJ
b1d981ec3a better pipeline while reading in pk_order 2019-07-27 01:18:27 +03:00
chertus
9f9ba3a06f restore cropped names in JOIN ON section for distributed queries 2019-07-26 20:43:42 +03:00
alexey-milovidov
71cef7beac
Merge pull request #6156 from dimarub2000/master
ISSUE-6136: Fix DB::Exception throwed by bitmapContains
2019-07-25 23:00:42 +03:00
Alexander Tokmakov
3ba26aba43 tests 2019-07-25 19:28:08 +03:00
Alexander Tokmakov
e4212bfe59 add full part name to detached_parts 2019-07-25 19:26:36 +03:00
dimarub2000
f53f22fd17 ISSUE-6136: Fix DB::Exception throwed by bitmapContains 2019-07-25 18:56:20 +03:00
Alexander Tokmakov
1805ab5736 attach 2019-07-25 13:46:07 +03:00
CurtizJ
f5b93eb991 fix order by optimization 2019-07-25 13:45:01 +03:00
alexey-milovidov
7219e167d2
Merge pull request #6026 from bopohaa/fix-kafka-unclean-stream
Clear Kafka's buffer if an invalid message is found.
2019-07-25 04:30:37 +03:00
alexey-milovidov
56131a7fe7
Merge pull request #6080 from abyss7/issue-6071
Check background_task_handle before use
2019-07-25 04:16:47 +03:00
Alexey Milovidov
e52653aa06 Miscellaneous 2019-07-25 04:08:33 +03:00
alesapin
f7e0d17490 Fix some bugs 2019-07-24 18:22:16 +03:00
CurtizJ
3d706ec20e support 'order by' optimiation with simple monotonic functions 2019-07-24 17:23:57 +03:00
alesapin
8a00ce5ff1 Intermediate step 2019-07-24 15:56:39 +03:00
Alexander Tokmakov
6e4aabbb1a draft for StorageMergeTree 2019-07-23 23:18:18 +03:00
Alexander Tokmakov
ad787938f5 better detached part name parsing 2019-07-23 22:43:33 +03:00
Alexander Tokmakov
3c2172b750 parse and interpret query 2019-07-23 22:25:10 +03:00
Ivan Lezhankin
e8ef13edfa Check background_task_handle 2019-07-23 20:34:57 +03:00
alesapin
6e458a6a68 Fix secondary indices write with adaptive granularity 2019-07-23 18:27:36 +03:00
alexey-milovidov
cd6c15b79f
Merge pull request #6057 from dimarub2000/master
CREATE TABLE AS table_function()
2019-07-23 02:50:08 +03:00
Ivan Lezhankin
969cb2f826 Append _partition virtual column 2019-07-22 14:32:11 +03:00
Ivan Lezhankin
762f1d3a85 Merge remote-tracking branch 'upstream/master' into issue-5846 2019-07-22 13:19:37 +03:00
alexey-milovidov
3da461fea5
Merge pull request #6038 from yandex/Immowelt-ThreeDots
Merging COLUMNS matcher
2019-07-22 01:27:38 +03:00
CurtizJ
e559c8f949 fix build 2019-07-21 21:17:28 +03:00
alexey-milovidov
9f9dd040dd
Update StorageMergeTree.cpp 2019-07-21 17:14:55 +03:00
Alexey Milovidov
47058e8e11 Fixed error 2019-07-21 05:13:42 +03:00
Mikhail f. Shiryaev
15fd980d0b Add description "unable to select parts" and logging 2019-07-21 00:39:40 +02:00
alexey-milovidov
8008ce6e9e Update StorageReplicatedMergeTree.cpp 2019-07-20 10:44:05 +02:00
Mikhail f. Shiryaev
da50663e2c Pass a proper message to exception 2019-07-20 10:44:05 +02:00
Ivan Lezhankin
f9945494d9 Always resume consumer before subscription.
Also add more logs to see the difference between rd_kafka_assignment() vs rd_kafka_subscription()
2019-07-19 18:01:34 +03:00
CurtizJ
1bec5a8241 refactor MergeTree select streams 2019-07-19 17:56:00 +03:00
CurtizJ
2797c16930 fix prewhere at fetching columns 2019-07-19 13:14:27 +03:00
CurtizJ
b9dc472071 Merge remote-tracking branch 'upstream/master' into order-by-efficient 2019-07-19 01:09:59 +03:00
dimarub2000
20a846d753 Merge branch 'master' of github.com:yandex/ClickHouse 2019-07-18 21:52:18 +03:00
CurtizJ
12b3560def build fixes 2019-07-18 21:34:15 +03:00
Dmitry Rubashkin
7382cb41fa CREATE TABLE AS table_function() 2019-07-18 21:29:49 +03:00
CurtizJ
a3d25790bd basic implementation of reading in pk order and 'order by' optimization 2019-07-18 17:41:11 +03:00
Amos Bird
71233e11a9 minor updates. 2019-07-17 14:17:34 +08:00
Nik
4a30eba32f Fix style check 2019-07-16 22:34:47 +04:00
Amos Bird
9fa955403b Optimize count()
Choose the smallest column to count if possible.
2019-07-17 02:29:17 +08:00
alexey-milovidov
45b7588ab1
Merge pull request #6025 from dimarub2000/master
Minor fixes for FullTextIndex string functions
2019-07-16 19:30:32 +03:00
Nik
922c3eb22e Clear Kafka's buffer if an invalid message is found. 2019-07-16 19:27:42 +04:00
Dmitry Rubashkin
dcd8696466 Minor fixes 2019-07-16 14:40:11 +03:00
alexey-milovidov
ceffbf39d6
Merge pull request #5965 from dimarub2000/master
Primary key, MergeTreeIndexFullText and MergeTreeIndexSet support for string functions
2019-07-16 03:36:42 +03:00
Alexey Milovidov
27b9f79cba Fixed error after refactoring 2019-07-15 23:26:55 +03:00
Gleb Novikov
c1d91222d5 Ranamed setPrimaryKeyIndicesAndColumns to setProperties 2019-07-13 13:42:52 +03:00
alexey-milovidov
a93c76837e
Merge pull request #5953 from abyss7/fix-filter-table
Implement getDatabaseName() and rename() for all storages
2019-07-13 00:51:39 +03:00
dimarub2000
4005987fc4 multiSearchAny fixed, tests added, minor syle changes 2019-07-12 14:35:17 +03:00
dimarub2000
e5d4f11c73 Deleted some extra implementations, fixed style. multiSearchAny still not working. 2019-07-11 16:44:44 +03:00
dimarub2000
1480b8e62c Actually set index already woks for everything. Here are some tests. 2019-07-11 15:31:24 +03:00
dimarub2000
88778b0f5b minor style changes 2019-07-10 18:12:02 +03:00
dimarub2000
f5ba5e3ca9 Merge branch 'master' of github.com:dimarub2000/ClickHouse 2019-07-10 18:08:10 +03:00
dimarub2000
c9a5b3c9ab primary key and MergeTreeIndexFullText support for string functions 2019-07-10 17:53:57 +03:00
Vitaly Baranov
3a74f326a8 Fix unused variable in checkDataPart.cpp 2019-07-10 15:13:10 +03:00
Ivan Lezhankin
befb3ce15b Merge branch 'master' into fix-filter-table 2019-07-10 13:27:26 +03:00
Ivan Lezhankin
8a600c39af Fix build for gtests 2019-07-09 21:53:16 +03:00
Ivan Lezhankin
9f01fa7aaa Implement getDatabaseName() and rename() for all storages 2019-07-09 18:40:21 +03:00
Vitaliy Zakaznikov
a80af666ad * Updates that incorporate comments from the review 2019-07-09 08:41:55 -04:00
alesapin
d4c44320ea Merge branch 'fix_fetch_of_existing_part' of github.com:yandex/ClickHouse into fix_fetch_of_existing_part 2019-07-09 12:04:00 +03:00
alesapin
9a17a461ea Review fixes and better tests 2019-07-09 12:02:52 +03:00
alesapin
6a3b543e10 Merge branch 'master' of github.com:yandex/ClickHouse into fix_fetch_of_existing_part 2019-07-09 11:21:44 +03:00
alexey-milovidov
a8d8eb6b28
Merge pull request #5921 from yandex/pvs-studio-fixes-4
A few fixes for PVS-Studio
2019-07-09 01:10:05 +03:00
alexey-milovidov
c491cddb78
Update CheckResults.h 2019-07-08 22:56:48 +03:00
Alexey Milovidov
886e8ea0d4 Merge branch 'master' into pvs-studio-fixes-4 2019-07-08 19:58:42 +03:00
Alexey Milovidov
3f92ecf334 Merge branch 'master' into add-noreturn 2019-07-08 16:13:56 +03:00
Alexey Milovidov
f40b70884f Two more fixes for PVS-Studio 2019-07-08 05:14:32 +03:00
Alexey Milovidov
ac20c515ab Better code in unit tests 2019-07-08 04:58:31 +03:00
Alexey Milovidov
4752dae9bb Allowed unresolvable addresses in cluster configuration #5714 2019-07-08 04:43:41 +03:00
Vitaliy Zakaznikov
24a3726235 Merge branch 'master' of https://github.com/vzakaznikov/ClickHouse into liveview 2019-07-07 20:03:14 -04:00
Vitaliy Zakaznikov
259a95a3da * Updates to fix issues after the merge 2019-07-07 19:57:58 -04:00
Alexey Milovidov
19059ef650 One more fix for PVS-Studio 2019-07-08 02:29:54 +03:00
alexey-milovidov
8d4358f19c
Merge pull request #5919 from dimarub2000/master
startsWith now uses PK index
2019-07-08 02:06:05 +03:00
alexey-milovidov
0480706ff4
Update KeyCondition.cpp 2019-07-08 00:28:03 +03:00
dimarub2000
0b756c48a8 also style changes 2019-07-07 18:56:15 +03:00
dimarub2000
95118a5fa3 also style changes 2019-07-07 18:54:13 +03:00
dimarub2000
94523c00cd minor style changes 2019-07-07 18:52:20 +03:00
dimarub2000
2693ce27ff startsWith now uses PK index 2019-07-07 18:48:34 +03:00
Alexey Milovidov
2e6280de07 Fixed #5797 2019-07-07 03:20:38 +03:00
alexey-milovidov
a1cfdf2a60
Merge pull request #5855 from abyss7/no-undefined
Use --no-undefined linker option for split build
2019-07-07 01:47:11 +03:00
Gleb Novikov
3757aa9d02 More style fix 2019-07-06 23:30:48 +03:00
alexey-milovidov
eb2ffccaf3
Merge pull request #5874 from nikitamikhaylov/master
Add data checksums to system.parts_columns table. #5151
2019-07-05 23:58:58 +03:00
Nikita Mikhaylov
afdd45fd85 checksum added to system_parts 2019-07-05 18:32:55 +03:00
CurtizJ
a49112a14e Merge branch 'master' of https://github.com/yandex/ClickHouse into order-by-efficient 2019-07-05 16:41:48 +03:00
alexey-milovidov
2469ec1af3
Merge pull request #5857 from CurtizJ/dns-cache
Implement dns cache with asynchronous update.
2019-07-05 15:56:26 +03:00
Nikita Mikhaylov
1ffa488be4 lowercase added~ 2019-07-05 14:45:47 +03:00
CurtizJ
410b62f7fa Merge branch 'clickhouse-4013' of https://github.com/anrodigina/ClickHouse into order-by-efficient 2019-07-05 13:48:04 +03:00
Nikita Mikhaylov
f8dde20dcb easier code 2019-07-05 13:13:44 +03:00
Nikita Mikhaylov
0e25190433 checksums now output in the same way + tests are better 2019-07-05 12:00:19 +03:00
Gleb Novikov
430400c3c5 Style fix 2019-07-05 10:16:34 +03:00
Alexey Milovidov
2c6dd99644 Updated contributors 2019-07-05 04:13:03 +03:00
Gleb Novikov
71c2ca0fe9 Merge branch 'master' into table-constraints 2019-07-04 22:40:00 +03:00
Nikita Mikhaylov
fc75c8f62e done 2019-07-04 21:27:14 +03:00
Ivan Lezhankin
3b995bdb02 Add missing dependecies on sight to enable --no-undefined option 2019-07-04 17:05:55 +03:00
alesapin
65437d2289 Fix final mark and tests 2019-07-04 13:21:14 +03:00
alesapin
a0496da05f Merge branch 'master' of github.com:yandex/ClickHouse into fix_fetch_of_existing_part 2019-07-04 12:46:54 +03:00
alesapin
18544e8f64 Missed file and style fix 2019-07-04 09:04:31 +03:00
alesapin
477a7450fb Add test for data corruption 2019-07-03 23:51:13 +03:00
CurtizJ
187812a00e cleanup 2019-07-03 21:34:37 +03:00
CurtizJ
80e96995ae Merge branch 'master' of https://github.com/yandex/ClickHouse into dns-cache 2019-07-03 21:27:43 +03:00
Ivan
fdae12a51c
Keep on reading of new Kafka messages after stalling (#5852) 2019-07-03 19:51:11 +03:00
CurtizJ
35ad1a3b6b implement dns cache with asynchronous update 2019-07-03 19:26:22 +03:00
alesapin
3925a3bd13 Generalize check query 2019-07-03 16:17:19 +03:00
alesapin
6b0498cd93 First version of check cmd 2019-07-03 11:49:52 +03:00
alexey-milovidov
50c22ef71a
Merge pull request #5628 from yandex/index_granularity_by_default
Enable adaptive index granularity by default
2019-07-03 02:15:33 +03:00
alexey-milovidov
d81ae49f2c
Merge pull request #5755 from 4ertus2/bugs
Fix wrong ColumnConst.isColumnNullable()
2019-07-03 02:06:07 +03:00
alexey-milovidov
de92b9854e
Merge pull request #5838 from 4ertus2/joins
Joins refactoring: extract joinDispatch into own file
2019-07-03 01:55:45 +03:00
chertus
207145025c Join.h refactoring: extract joinDispatch into own file 2019-07-02 17:38:31 +03:00
alexey-milovidov
1bda6994ad
Merge pull request #5832 from yandex/fix_low_cardinality_check
Fix low cardinality check
2019-07-02 17:06:06 +03:00
alesapin
cbb0d640f4 Add comments 2019-07-02 14:34:16 +03:00
alesapin
f68b5216a8 Fix prefix reading and skip check for low cardinality dictionary 2019-07-02 13:55:47 +03:00
Vitaliy Zakaznikov
b5120931d5 Merge branch 'master' of https://github.com/yandex/ClickHouse into liveview 2019-07-01 18:12:31 -04:00
Vitaliy Zakaznikov
a363189dfc Merge branch 'master' of https://github.com/vzakaznikov/ClickHouse into liveview 2019-07-01 18:05:14 -04:00
Nikita Lapkov
9641d058d0 Merge remote-tracking branch 'upstream/master' into update_libunwind 2019-07-01 21:11:26 +00:00
alexey-milovidov
c43dfce041
Merge pull request #5382 from abyss7/issue-5286
Add virtual columns to Kafka Engine tables
2019-07-01 21:30:09 +03:00
chertus
5df4ad0f28 Merge branch 'master' into bugs 2019-07-01 14:49:01 +03:00
Alexey Milovidov
b86aca37ea Merge branch 'h3-integration' of https://github.com/BHYCHIK/ClickHouse into BHYCHIK-h3-integration 2019-06-30 19:15:33 +03:00
alexey-milovidov
feafcb21bd
Merge branch 'master' into h3-integration 2019-06-30 16:19:11 +03:00
Gleb Novikov
ea4d42c3ac Merged DROP_(COLUMN|INDEX|CONSTRAINT) AST parsing into one block 2019-06-30 12:09:58 +02:00
Gleb Novikov
a146b7383e Merge branch 'master' into table-constraints 2019-06-30 11:32:02 +02:00
Alexey Milovidov
725bcd9d02 Merge branch 'master' into sanych73-prepared_statements 2019-06-30 02:59:37 +03:00
Alexey Milovidov
88fc72f0b9 Merge branch 'feature/bloom_filter' of https://github.com/zhang2014/ClickHouse into zhang2014-feature/bloom_filter 2019-06-29 20:44:11 +03:00
Alexey Milovidov
6566bb7088 Updated tests 2019-06-29 19:18:59 +03:00
Nikita Lapkov
2a131185b0 Merge remote-tracking branch 'upstream/master' into update_libunwind 2019-06-28 18:20:23 +00:00
Nikita Lapkov
f8d2b5effd introduce Backtrace class 2019-06-28 18:06:38 +00:00
alexey-milovidov
18659e367e
Merge pull request #5758 from zlobober/bool_masks
Extend KeyCondition interface so that it returns BoolMask.
2019-06-28 14:51:52 +03:00
alexey-milovidov
6e77fc4abe
Merge pull request #5775 from yandex/lfalloc2mimalloc
Use mimalloc instead of lfallocator
2019-06-28 14:48:18 +03:00
chertus
f19dee706a move IColumn.isColumnConst() outside of interface 2019-06-27 22:28:52 +03:00
chertus
db7c8748e9 remove IColumn.isColumnNullable() 2019-06-27 21:50:20 +03:00
alexey-milovidov
246f34d8f6
Merge pull request #5768 from abyss7/better-log
Print table name in message about missing column
2019-06-27 18:49:40 +03:00
Danila Kutenin
e67431e455 Use mimalloc instead of lfallocator 2019-06-27 18:13:19 +03:00
Maxim Akhmedov
2cacc3cfd2 CHYT-142: extend KeyCondition interface so that it returns BoolMask. 2019-06-27 16:31:33 +03:00
Alexey Milovidov
8f3ff6c77a Removed inconsistent whitespaces 2019-06-27 16:20:33 +03:00
Ivan Lezhankin
9d3eef80b0 Print table name in message about missing column. 2019-06-27 13:56:04 +03:00
chertus
65c0d23efa better casts to ColumnNullable 2019-06-26 20:20:33 +03:00
alesapin
b7f173ad2c Execute some distributed DDL queries on leader 2019-06-26 17:52:20 +03:00
Nikita Vasilev
7079c91a0e Merge remote-tracking branch 'upstream/master' into nikvas0/index_mutate 2019-06-25 16:34:11 +03:00
Nikita Vasilev
9873b04611 StringRef -> String (race cond) 2019-06-25 16:10:09 +03:00
Ivan Remen
df4bd3eec6 Merge remote-tracking branch 'main/master' into h3-integration 2019-06-25 15:43:33 +03:00
Ivan Remen
8ad592dd07 Fix?? 2019-06-25 14:27:39 +03:00
alesapin
4a8a70a079
Merge pull request #5720 from coraxster/fix-5377
MergedColumnOnlyOutputStream. Skip empty blocks. Fix 5377
2019-06-25 13:35:09 +03:00
dmitry kuzmin
c72e4dfe08 5337: clang compiler fix 2019-06-24 18:07:01 +03:00
Alexey Milovidov
8f77d898f3 Renamed functions for consistency #5704 2019-06-24 17:51:37 +03:00
alexey-milovidov
8e41d89126
Merge pull request #5704 from zhang2014/fix/ISSUES-5697
ISSUES-5697 fix insert and select query with mysql style identifier
2019-06-24 17:40:28 +03:00
Nikita Vasilev
7b7517ff85 Merge remote-tracking branch 'upstream/master' into nikvas0/index_mutate 2019-06-24 16:44:44 +03:00
Ivan Lezhankin
0917573493 Merge remote-tracking branch 'upstream/master' into issue-5286 2019-06-24 14:42:58 +03:00
proller
1ac09fa721
Split Common/config.h by libs (dbms) (#5715) 2019-06-24 14:17:15 +03:00
Vitaliy Zakaznikov
d87ed7f267 * Adding max_live_view_insert_blocks_before_refresh setting
with default value of 64
* Updating writeIntoLiveView method to use max_live_view_insert_blocks_before_refresh
  from global context instead of hard coded number
* Adding squashing of the result blocks similar how it is done in materialized views
* Fixing bug in writeIntoLiveView that caused incoming block to be processed twice
  when maximum number of insert blocks was reached
2019-06-23 09:51:29 -04:00
dmitry kuzmin
c988293e1e 5337 fix: MergedColumn. skip empty blocks 2019-06-23 07:30:29 +03:00
zhang2014
b9cb1feb4c some review fixes 2019-06-22 12:40:41 +08:00
chertus
29700fd5e9 Auto version update to [19.11.0] [54423] 2019-06-21 18:47:02 +03:00
alesapin
efc0f7f65e Remove unused method 2019-06-21 18:19:47 +03:00
Ivan Lezhankin
b75db2ef04 Fix dropping message to early when stalling 2019-06-21 17:29:10 +03:00
zhang2014
1786407621 ISSUES-5697 fix insert and select query with mysql style identifier 2019-06-21 13:51:27 +08:00
proller
f111dbd45f Do not require gperf on build (#5701)
* Build fixes

* fix

* USE_GPERF

* wip

* wip

* wip

* test -j

* Simpler

* fix

* FunctionsURL.h -> URL/FunctionsURL.h

* clean

* clean

* Always use gperf-generated file

* Generator for tldLookup.generated.cpp

* clang-format
2019-06-21 02:50:53 +03:00
alexey-milovidov
606b074a4b
Merge pull request #5659 from yandex/ignore-mutation-limits
Ignore query execution limits and limits for max parts size for merge while executing mutations.
2019-06-21 02:14:41 +03:00
alexey-milovidov
73df46be2b
Merge pull request #5698 from abyss7/issue-5615
Lower the probability of hanging when shutting down Kafka storage
2019-06-21 02:11:07 +03:00
alesapin
3f7892ef50 Fix typo 2019-06-20 22:21:17 +03:00
alesapin
80f27968ac Add test for interaction of tables with different granularity and different versions 2019-06-20 19:25:32 +03:00
Ivan Lezhankin
ec78ec8365 Merge branch 'master' into issue-5286 2019-06-20 16:08:22 +03:00
Ivan Lezhankin
61750d09d2 Commit offsets for SELECTing from Kafka table too 2019-06-20 15:34:25 +03:00
proller
3d8c8ee83c
Build fixes. Split config.h (#5686) 2019-06-20 12:12:49 +03:00
alesapin
4ae502eaa6 Fix bug with wrong granularity detection 2019-06-20 11:48:56 +03:00
zhang2014
8221dd2a1a fix build and test failure 2019-06-20 08:33:37 +08:00
zhang2014
374aac3501 fix build & chmod shell test 2019-06-20 00:32:20 +08:00
alesapin
dd37370aab Fix test and add one 2019-06-19 19:16:13 +03:00
Ivan Lezhankin
fdd3f07860 Don't do premature subscription to topics 2019-06-19 19:15:30 +03:00
zhang2014
166018e41e fix code style & rename minmax, set 2019-06-19 23:30:48 +08:00
zhang2014
a50aea09f1 fix float in bloom filter 2019-06-19 23:13:21 +08:00
zhang2014
d145295163 convert type with condition 2019-06-19 23:12:06 +08:00
zhang2014
6c8ff6dc31 add some test 2019-06-19 23:12:05 +08:00
zhang2014
f52b16e1e1 support bloom filter for any type 2019-06-19 23:12:05 +08:00
alesapin
fefce49c8f Mixed parts by setting 2019-06-19 17:46:06 +03:00
alesapin
dd2e4fd805 Bug fixes 2019-06-19 15:30:56 +03:00
alesapin
f0c273ee4c More correct version 2019-06-19 14:59:08 +03:00
alesapin
d1de7431e1 Compilable 2019-06-19 13:26:26 +03:00
alesapin
7e11c3c78b Merge branch 'master' into index_granularity_by_default 2019-06-19 13:08:12 +03:00
alesapin
b544b62e44 A log of bugs 2019-06-19 13:07:56 +03:00
Ivan Lezhankin
9fd048cdbd Allow to select virtual columns in materialized view 2019-06-18 19:32:37 +03:00
Ivan Lezhankin
436052c67b Merge branch 'master' into issue-5286 2019-06-18 16:03:29 +03:00
alesapin
4f98f875c3
Add ability to write final mark for *MergeTree engines family (#5624)
Add the ability to write final mark to *MergeTree engines family.
2019-06-18 15:54:27 +03:00
alesapin
0bfb7b18ce Fix directory check 2019-06-18 14:38:04 +03:00
alesapin
d2615863f3 Merge branch 'master' into index_granularity_by_default 2019-06-18 13:52:41 +03:00
CurtizJ
e6dd92f9e1 ignore max part size for merge setting while executing mutations 2019-06-17 22:41:48 +03:00
Vitaliy Zakaznikov
bdeb45e8c7 Merge branch 'master' of https://github.com/vzakaznikov/ClickHouse into liveview 2019-06-17 13:04:48 -04:00
proller
dae5087fcf Build and test fixes 2019-06-17 19:50:31 +03:00
Vitaliy Zakaznikov
51bf8a1baa Merge branch 'master' of https://github.com/vzakaznikov/ClickHouse into liveview 2019-06-17 12:42:31 -04:00
Vitaliy Zakaznikov
8df3e48a7b * Fixing bug in writeIntoLiveView method where mergeable blocks
would always be reobtained after 64 inserts
2019-06-17 12:39:01 -04:00
Ivan Lezhankin
d907d8e8ca Commit offsets for SELECTing from Kafka table too 2019-06-17 19:27:18 +03:00
alesapin
fb22200890 Fix name hidding and stupid bug 2019-06-17 18:35:53 +03:00
alesapin
9e7d23b22e Style fix 2019-06-17 16:29:10 +03:00
alesapin
fd3abbe93d
Merge pull request #4935 from zhang2014/feature/support_system_replicas
Support system replicas queries for distributed
2019-06-17 15:30:30 +03:00
alesapin
e45d727e9d
Merge pull request #4558 from podshumok/distributred-timeout
Distributed and remote timeouts
2019-06-17 13:58:17 +03:00
alesapin
3a4dcfbacd Fix inconsistency in zookeeper metadata and disable adaptive granularity for old format 2019-06-17 13:34:25 +03:00
alesapin
e73cdbae90 Fix name hidding 2019-06-17 12:22:44 +03:00
alesapin
02af85411c Merge branch 'master' into index_granularity_by_default 2019-06-17 12:02:03 +03:00
alexey-milovidov
5fd319d0e9
Merge pull request #5648 from yandex/remove-number-of-stat-calls
Reduce number of "stat" syscalls for MergeTree data parts
2019-06-17 09:30:29 +03:00
Alexey Milovidov
62a3d00772 Added comment 2019-06-16 23:50:06 +03:00
Alexey Milovidov
ee5dcd50a0 Lowered CPU overhead for small data parts 2019-06-16 23:42:03 +03:00
Alexey Milovidov
14be0ca281 Reduce number of "stat" syscalls for MergeTree data parts 2019-06-16 23:13:54 +03:00
Alexey Milovidov
49c4f2ffed Reduce number of "stat" syscalls for MergeTree data parts 2019-06-16 23:11:30 +03:00
Alexey Milovidov
e3b21be1bb Reduce number of "stat" syscalls for MergeTree data parts 2019-06-16 23:02:45 +03:00
Alexey Milovidov
0ad13ca3d1 Reduce number of "stat" syscalls for MergeTree data parts 2019-06-16 22:59:30 +03:00
Alexey Milovidov
c1aa767a04 Reduce number of "stat" syscalls for MergeTree data parts 2019-06-16 22:53:05 +03:00
Alexey Milovidov
e4f314f88d Reduce number of "stat" syscalls for MergeTree data parts 2019-06-16 22:49:12 +03:00
Alexey Milovidov
801f34d325 Reduce number of "stat" syscalls for MergeTree data parts 2019-06-16 22:42:05 +03:00
Alexey Milovidov
b6acb29625 Reduce number of "stat" syscalls for MergeTree data parts 2019-06-16 22:36:15 +03:00
Alexey Milovidov
b494d17ca6 Reduce number of "stat" syscalls for MergeTree data parts 2019-06-16 22:32:52 +03:00
Alexey Milovidov
413b780b65 Various fixes for PVS-Studio 2019-06-16 21:13:39 +03:00
Vitaliy Zakaznikov
abc7c3f6c1 Merge branch 'master' of https://github.com/vzakaznikov/ClickHouse into liveview 2019-06-15 21:22:28 -04:00
alexey-milovidov
39c6fbc324
Merge pull request #5567 from vitlibar/really-lazy-dictionary-load
Non-blocking loading of external dictionaries
2019-06-15 22:15:53 +03:00
alexey-milovidov
a52e13b891
Merge pull request #5640 from yandex/use-ipv6-in-system-tables
Adopted IPv6 data type in system tables; unified client info columns in system.processes and system.query_log
2019-06-15 21:21:24 +03:00
Alexey Milovidov
d8f76152d5 Adopted IPv6 data type in system tables; unified client info columns in system.processes and system.query_log 2019-06-15 17:20:32 +03:00
Alexey Milovidov
b2100c7bcf Removed strange quoting style like `this'. See https://english.stackexchange.com/questions/17695/any-reference-on-the-usage-of-a-backtick-and-single-quotation-mark-like-this
Added backQuote and backQuoteIfNeed when required to correctly quote identifiers with proper escaping.
2019-06-15 15:06:22 +03:00
Vitaliy Zakaznikov
282ff6bfda * Fixing a bug in writeIntoLiveView method where blocks->front()
is called before checking if blocks vector is empty.
2019-06-14 21:08:46 -04:00
Vitaliy Zakaznikov
d6d0404c48 * Fixing bug in StorageLiveView.cpp getHeader() method
that sometimes addressed invalid pointer when getHeader()
  method was called without holding the mutex
2019-06-14 16:27:43 -04:00
Gleb Novikov
15004ce055 Merge branch 'master' into table-constraints 2019-06-14 23:10:48 +03:00
Vitaly Baranov
b4384ce2a9 Dictionaries can be loaded in parallel.
A bad dictionary cannot block all the loading anymore.
Implemented really lazy loading of external dictionaries.
Provided more detailed information about the loading of each dictionary
to make diagnostics easier.
2019-06-14 22:18:47 +03:00
Alexey Milovidov
10722f53c7 Fixed performance degradation in SELECT from MergeTree tables #5631 2019-06-14 22:11:41 +03:00
alesapin
22026e0333 Enable adaptive index granularity by default 2019-06-14 18:39:21 +03:00
Vitaliy Zakaznikov
13978c03f3 * Fixing a bug in StorageLiveView.cpp in the getHeader() method
when header block would not match blocks in the stream
  when Const column is present.
* Updating 00963_temporary_live_view_watch_live_timeout.py
  and removed timeout=5 after WATCH query is aborted with Ctrl-C
  so that the default timeout of 20sec is used
* Small style fixes in tests
2019-06-14 10:06:15 -04:00
proller
fc7ae399c4 Use system rapidjson; Fix types for macos; 2019-06-14 13:28:30 +03:00
alexey-milovidov
bc387e865f
Merge pull request #5549 from yandex/fix_deduplication_bug
Fix complex bug in deduplication
2019-06-14 09:23:15 +03:00
Vitaliy Zakaznikov
117f2d191e Merge branch 'master' of https://github.com/vzakaznikov/ClickHouse into liveview 2019-06-13 15:23:20 -04:00
Vitaliy Zakaznikov
b82bb4a954 * Updates to sync with yandex/master 2019-06-13 12:37:29 -04:00
Vitaliy Zakaznikov
8e868dd2fe Merge branch 'master' of https://github.com/yandex/ClickHouse 2019-06-13 12:31:13 -04:00
Alexey Milovidov
c846d0f6af Namespace comments are unneeded according to the code style.
find dbms -name '*.h' -or -name '*.cpp' | xargs grep -l -P '}\s*//+\s*namespace\s*' | xargs sed -i -r -e 's/}\s*\/\/+\s*namespace\s*.*$/}/'
2019-06-13 13:43:37 +03:00
Alexey Milovidov
8b87511e25 Namespace comments are unneeded according to the code style.
find dbms -name '*.h' -or -name '*.cpp' | xargs grep -l -P '}\s*//+\s*namespace\s*' | xargs sed -i -r -e 's/}\s*\/\/+\s*namespace\s*\w+/}/'
2019-06-13 13:37:13 +03:00
Vitaliy Zakaznikov
576393272b * Fixing styling check error 2019-06-12 20:45:41 -04:00
Vitaliy Zakaznikov
5983273694 Fixing bugs reported by sanitizers
* data race condition on storage is_dropped access
* invalid reference to storage after it is deleted
* invalid reference to mutex after storage is deleted
2019-06-12 09:11:44 -04:00
Vitaliy Zakaznikov
12060d8879 * Fixing errors that prevented clang build. 2019-06-11 08:27:47 -04:00
Vitaliy Zakaznikov
b6efd8599f * Trying again to fix style checks. Now running ./utils/check-style/check-style reports no errors. 2019-06-11 06:30:57 -04:00
Vitaliy Zakaznikov
a467e7c105 * Moving uexpect.py so that it can be found
* Trying to fix failed style checks
* Trying to fix clang build fail
2019-06-10 22:22:53 -04:00
Vitaliy Zakaznikov
a68980ab38 * Style check fixes 2019-06-10 07:41:33 -04:00
Vitaliy Zakaznikov
87b58e4150 * Fixing clang errors
* Fixing LIVE VIEW tests
2019-06-10 07:18:33 -04:00
Ivan Lezhankin
97558c1b41 Merge remote-tracking branch 'upstream/master' into issue-5286 2019-06-10 14:15:14 +03:00
Vitaliy Zakaznikov
5079180595 * Fixing a bug in LIVE VIEW tables. Before when a table
is created with "AS SELECT 1" the SELECT and WATCH queries would fail
* Adding and updating LIVE VIEW tests to increase coverage
2019-06-08 09:26:02 -04:00
Vitaliy Zakaznikov
b65ff910b6 Merge branch 'master' of https://github.com/vzakaznikov/ClickHouse into liveview 2019-06-07 08:02:59 -04:00
Vitaliy Zakaznikov
398f7e3c3f Merge branch 'master' of https://github.com/yandex/ClickHouse 2019-06-06 21:22:48 -04:00