Commit Graph

5182 Commits

Author SHA1 Message Date
alexey-milovidov
261abd6c41
Merge pull request #6319 from nikvas0/nikvas0/fix_set_index
Add Comments for set index functions
2019-08-04 16:39:57 +03:00
Nikita Vasilev
5d47a858c5 add comments 2019-08-04 16:03:38 +03:00
Nikolai Kochetov
599f3ddf6e Merged with master. 2019-08-04 15:35:21 +03:00
alexey-milovidov
291dc0f66e
Merge pull request #6316 from yandex/alias-in-materialized-view-simplification
Simplification of #3796
2019-08-04 06:29:02 +03:00
Alexey Milovidov
8b8c59d71b Simplification of #3796 2019-08-04 03:29:32 +03:00
Alexey Milovidov
a3a15d3a95 Addition to prev. revision 2019-08-04 03:28:12 +03:00
Alexey Milovidov
224bc4df97 Minor modifications + a comment #3796 2019-08-04 03:12:17 +03:00
alexey-milovidov
b045e85469
Merge pull request #3796 from amosbird/hang
Fix materialized view with column defaults.
2019-08-04 03:06:40 +03:00
alexey-milovidov
e61f647492
Merge pull request #6282 from nikvas0/nikvas0/fix_set_index
fix operators in set index
2019-08-04 02:52:57 +03:00
alexey-milovidov
2b6a28f617
Merge pull request #6279 from yandex/remove-cat-boost-pool
Removed table function "catBoostPool" and storage "CatBoostPool"
2019-08-03 04:59:55 +03:00
alexey-milovidov
d3e4249420
Merge branch 'master' into ttldropparts 2019-08-03 02:17:29 +03:00
Alexey Milovidov
21cb7de777 More validation of part_name 2019-08-02 23:21:31 +03:00
alexey-milovidov
f8980e691e
Merge pull request #6274 from CurtizJ/ttl-old-parts
TTL improvements.
2019-08-02 22:51:28 +03:00
Nikita Vasilev
bfa9a2c86f fixed index condition 2019-08-02 22:21:55 +03:00
Alexey Milovidov
a5105f85cf Removed table function "catBoostPool" and storage "CatBoostPool" 2019-08-02 21:52:43 +03:00
CurtizJ
e06a53a5d9 fix ranges selection at reading in order 2019-08-02 20:34:29 +03:00
Nikolai Kochetov
1f6a16b03a Remove ValuesRowInputStream. 2019-08-02 20:16:58 +03:00
CurtizJ
a6e85a331a more optimal ranges selection at reading in order 2019-08-02 19:37:43 +03:00
CurtizJ
5f7ebb18ed more optimal ranges selection at reading in order 2019-08-02 19:16:18 +03:00
Nikolai Kochetov
dd90932222 Update FormatFactory. 2019-08-02 18:06:31 +03:00
Nikita Vasilev
7aacbbdc5a fix bug 2019-08-01 22:18:36 +03:00
CurtizJ
d169f42b36 fix build 2019-08-01 22:07:31 +03:00
CurtizJ
b8dff6ebb1 more optimal ranges selection at reading in order 2019-08-01 22:03:39 +03:00
CurtizJ
82f304f81e add query 'SYSTEM STOP TTL MERGES' 2019-08-01 18:36:12 +03:00
CurtizJ
c30bdecf6d add missing comments 2019-08-01 15:00:35 +03:00
alexey-milovidov
e034dab1be
Merge pull request #6255 from yandex/storage-values-simplification
Simplified code with parsing table declaration for table functions.
2019-08-01 14:58:28 +03:00
CurtizJ
f224269d41 filter by ttl parts created before 'alter ... modify ttl' query with 'optimize ... final' query 2019-08-01 14:10:42 +03:00
Igr Mineev
0f1e8404dc Merge branch 'master' of github.com:yandex/ClickHouse into feature_multiple_disks 2019-08-01 13:42:59 +03:00
Igr Mineev
fc79ed86ef Ready for review 2019-08-01 13:29:14 +03:00
Alexey Milovidov
12f6b75284 Fixed error 2019-08-01 05:34:58 +03:00
Alexey Milovidov
49b6749280 Merge branch 'master' into fix-malicious-replica 2019-08-01 05:11:45 +03:00
Alexey Milovidov
26bb14da4e Simplified table function "values" 2019-08-01 05:03:15 +03:00
alexey-milovidov
a8793fbef3
Merge pull request #6209 from dimarub2000/values_list
VALUES list
2019-08-01 04:36:04 +03:00
Alexey Milovidov
f3921ce3e0 Changed boost::filesystem to std::filesystem 2019-08-01 01:37:41 +03:00
Alexey Milovidov
bc9d620155 Fixed the case when malicious ClickHouse replica can force clickhouse-server to write to arbitrary path 2019-07-31 22:31:04 +03:00
Alexander Tokmakov
f0836553d4 drop detached partition 2019-07-31 18:27:21 +03:00
alexey-milovidov
ac5d2a225d
Merge pull request #6226 from yandex/aku/lock-tinylog
Lock the TinyLog storage when reading.
2019-07-31 17:40:55 +03:00
Dmitry Rubashkin
a449a00e58 Comments are now in right places 2019-07-31 17:12:05 +03:00
Dmitry Rubashkin
f91c64bd28 parser changed, test modified, comments added 2019-07-31 17:06:22 +03:00
Alexander Kuzmenkov
3ff143c60f Lock the TinyLog storage when reading.
Unlike StripeLog, we only have one set of files per column, so we can't
read concurrently with writing. We didn't use any locking before, and
that lead to user-visible error messages and tsan failures.
2019-07-31 13:59:12 +03:00
alexey-milovidov
30c35b1cbf
Update StorageValues.cpp 2019-07-31 01:06:48 +03:00
Alexander Tokmakov
c6717e0d3f refactor attachPartition 2019-07-30 22:11:15 +03:00
Alexander Tokmakov
2f33df1b2e rename all parts before attaching 2019-07-30 20:24:40 +03:00
Igr Mineev
7f7b47fc0a Add check of RW access to paths on start. Add multiple disks tests. 2019-07-30 19:15:57 +03:00
Igr Mineev
31c36efa25 Merge branch 'master' of github.com:yandex/ClickHouse into feature_multiple_disks 2019-07-30 19:13:58 +03:00
Dmitry Rubashkin
7945d05565 Minor style fixes 2019-07-30 15:15:02 +03:00
Amos Bird
6db1c02bfd Fix materialized view with column defaults.
https://github.com/yandex/ClickHouse/issues/448
https://github.com/yandex/ClickHouse/issues/3484
https://github.com/yandex/ClickHouse/issues/3450
https://github.com/yandex/ClickHouse/issues/2878
https://github.com/yandex/ClickHouse/issues/2285
2019-07-30 10:49:54 +08:00
Alexey Milovidov
b5b80fb342 Merge branch 'master' into thread_local_rng 2019-07-30 03:19:48 +03:00
Dmitry Rubashkin
45aebda677 Fixes and test 2019-07-29 19:20:17 +03:00
Dmitry Rubashkin
e9784573ea Values list implementation 2019-07-29 17:02:34 +03:00
Alexander Tokmakov
3c15b87003 Merge branch 'master' into alter_table_drop_detached_part 2019-07-29 14:29:23 +03:00
alesapin
86831fe500 Add ability to create immutable settings 2019-07-29 14:03:50 +03:00
Alexander Tokmakov
0fc47fbbe4 fixes 2019-07-29 13:27:37 +03:00
alesapin
d9a2ac123a Fix small typo and merge 2019-07-29 12:17:37 +03:00
alexey-milovidov
129e88ee26
Merge pull request #6189 from CurtizJ/order-by-efficient
Fix reading in order of sorting key and refactoring.
2019-07-28 19:43:49 +03:00
Alexey Milovidov
856cc1b9c5 Added thread_local_rng 2019-07-28 18:30:38 +03:00
Alexey Milovidov
c0e0166991 Updated contributors 2019-07-28 18:11:47 +03:00
Nikita Vasilev
39b40f8e42 fix replicated indices mutations 2019-07-28 17:55:51 +03:00
Nikita Vasilev
4c5003b3b9 const & 2019-07-28 14:45:50 +03:00
Nikita Vasilev
908623c029 style 2019-07-28 14:32:03 +03:00
Nikita Vasilev
63fe714420 fix 2019-07-28 14:10:35 +03:00
Sergi Vladykin
c5a42a6948 TTL: Only drop altogether the expired parts and not partially prune them.
Though in regular merges eviction of expired values still must happen.
2019-07-28 13:30:46 +03:00
CurtizJ
b4991b38bf Merge remote-tracking branch 'upstream/master' into order-by-efficient 2019-07-28 04:26:43 +03:00
CurtizJ
d69d68f065 rename setting 'optimize_pk_order' and some functions 2019-07-28 04:16:56 +03:00
CurtizJ
95a6b85267 fix reading in order of sorting_key 2019-07-28 03:41:26 +03:00
alexey-milovidov
12a15316fd
Merge pull request #6181 from 4ertus2/joins
Fix crop column names in GLOBAL JOIN ON
2019-07-28 00:31:29 +03:00
Nikita Vasilev
1118ce04b9 fixed 2019-07-27 18:36:40 +03:00
CurtizJ
08d5ebb54d Merge remote-tracking branch 'upstream/master' into order-by-efficient 2019-07-27 10:38:10 +03:00
Nikita Vasilev
7efb1bcb12 Merge remote-tracking branch 'upstream/master' into nikvas0/index_mutate 2019-07-27 10:30:43 +03:00
CurtizJ
12dcfe1f25 reduce number of read rows while reading in reverse order 2019-07-27 03:33:47 +03:00
CurtizJ
b1d981ec3a better pipeline while reading in pk_order 2019-07-27 01:18:27 +03:00
chertus
9f9ba3a06f restore cropped names in JOIN ON section for distributed queries 2019-07-26 20:43:42 +03:00
alexey-milovidov
71cef7beac
Merge pull request #6156 from dimarub2000/master
ISSUE-6136: Fix DB::Exception throwed by bitmapContains
2019-07-25 23:00:42 +03:00
Igr Mineev
7a31feeec0 Add tests for multiple disks. Fix Alter query. 2019-07-25 21:21:01 +03:00
Alexander Tokmakov
3ba26aba43 tests 2019-07-25 19:28:08 +03:00
Alexander Tokmakov
e4212bfe59 add full part name to detached_parts 2019-07-25 19:26:36 +03:00
dimarub2000
f53f22fd17 ISSUE-6136: Fix DB::Exception throwed by bitmapContains 2019-07-25 18:56:20 +03:00
Igr Mineev
e7e2627201 Checking unique names for volumes. 2019-07-25 14:42:48 +03:00
Alexander Tokmakov
1805ab5736 attach 2019-07-25 13:46:07 +03:00
CurtizJ
f5b93eb991 fix order by optimization 2019-07-25 13:45:01 +03:00
Igr Mineev
549c62a18a Fix build 2019-07-25 12:40:20 +03:00
alexey-milovidov
7219e167d2
Merge pull request #6026 from bopohaa/fix-kafka-unclean-stream
Clear Kafka's buffer if an invalid message is found.
2019-07-25 04:30:37 +03:00
alexey-milovidov
56131a7fe7
Merge pull request #6080 from abyss7/issue-6071
Check background_task_handle before use
2019-07-25 04:16:47 +03:00
Alexey Milovidov
e52653aa06 Miscellaneous 2019-07-25 04:08:33 +03:00
alesapin
f7e0d17490 Fix some bugs 2019-07-24 18:22:16 +03:00
CurtizJ
3d706ec20e support 'order by' optimiation with simple monotonic functions 2019-07-24 17:23:57 +03:00
alesapin
8a00ce5ff1 Intermediate step 2019-07-24 15:56:39 +03:00
Alexander Tokmakov
6e4aabbb1a draft for StorageMergeTree 2019-07-23 23:18:18 +03:00
Alexander Tokmakov
ad787938f5 better detached part name parsing 2019-07-23 22:43:33 +03:00
Alexander Tokmakov
3c2172b750 parse and interpret query 2019-07-23 22:25:10 +03:00
Ivan Lezhankin
e8ef13edfa Check background_task_handle 2019-07-23 20:34:57 +03:00
alesapin
6e458a6a68 Fix secondary indices write with adaptive granularity 2019-07-23 18:27:36 +03:00
Igr
3e017ec69c
Merge branch 'master' into feature_multiple_disks 2019-07-23 16:38:20 +03:00
Igr Mineev
e967c23adb Add Space interface for reservation. Add move to volume command 2019-07-23 16:34:17 +03:00
Igr Mineev
2925657f5e Remove non-alter move command. 2019-07-23 12:38:26 +03:00
alexey-milovidov
cd6c15b79f
Merge pull request #6057 from dimarub2000/master
CREATE TABLE AS table_function()
2019-07-23 02:50:08 +03:00
Ivan Lezhankin
969cb2f826 Append _partition virtual column 2019-07-22 14:32:11 +03:00
Ivan Lezhankin
762f1d3a85 Merge remote-tracking branch 'upstream/master' into issue-5846 2019-07-22 13:19:37 +03:00
alexey-milovidov
3da461fea5
Merge pull request #6038 from yandex/Immowelt-ThreeDots
Merging COLUMNS matcher
2019-07-22 01:27:38 +03:00
CurtizJ
e559c8f949 fix build 2019-07-21 21:17:28 +03:00
alexey-milovidov
9f9dd040dd
Update StorageMergeTree.cpp 2019-07-21 17:14:55 +03:00
Alexey Milovidov
47058e8e11 Fixed error 2019-07-21 05:13:42 +03:00
Mikhail f. Shiryaev
15fd980d0b Add description "unable to select parts" and logging 2019-07-21 00:39:40 +02:00
alexey-milovidov
8008ce6e9e Update StorageReplicatedMergeTree.cpp 2019-07-20 10:44:05 +02:00
Mikhail f. Shiryaev
da50663e2c Pass a proper message to exception 2019-07-20 10:44:05 +02:00
Ivan Lezhankin
f9945494d9 Always resume consumer before subscription.
Also add more logs to see the difference between rd_kafka_assignment() vs rd_kafka_subscription()
2019-07-19 18:01:34 +03:00
CurtizJ
1bec5a8241 refactor MergeTree select streams 2019-07-19 17:56:00 +03:00
CurtizJ
2797c16930 fix prewhere at fetching columns 2019-07-19 13:14:27 +03:00
CurtizJ
b9dc472071 Merge remote-tracking branch 'upstream/master' into order-by-efficient 2019-07-19 01:09:59 +03:00
dimarub2000
20a846d753 Merge branch 'master' of github.com:yandex/ClickHouse 2019-07-18 21:52:18 +03:00
CurtizJ
12b3560def build fixes 2019-07-18 21:34:15 +03:00
Dmitry Rubashkin
7382cb41fa CREATE TABLE AS table_function() 2019-07-18 21:29:49 +03:00
Igr Mineev
52bca488dc Add alter move part command 2019-07-18 18:19:03 +03:00
CurtizJ
a3d25790bd basic implementation of reading in pk order and 'order by' optimization 2019-07-18 17:41:11 +03:00
Amos Bird
71233e11a9 minor updates. 2019-07-17 14:17:34 +08:00
Nik
4a30eba32f Fix style check 2019-07-16 22:34:47 +04:00
Amos Bird
9fa955403b Optimize count()
Choose the smallest column to count if possible.
2019-07-17 02:29:17 +08:00
Igr Mineev
770b74ac17 Add names for volumes 2019-07-16 21:20:47 +03:00
alexey-milovidov
45b7588ab1
Merge pull request #6025 from dimarub2000/master
Minor fixes for FullTextIndex string functions
2019-07-16 19:30:32 +03:00
Nik
922c3eb22e Clear Kafka's buffer if an invalid message is found. 2019-07-16 19:27:42 +04:00
Igr Mineev
ad497fbaa1 Fix bug with duplication of parts on restart 2019-07-16 16:06:23 +03:00
Dmitry Rubashkin
dcd8696466 Minor fixes 2019-07-16 14:40:11 +03:00
Igr Mineev
90fab48cd7 Stylefixes 2019-07-16 14:07:04 +03:00
Igr Mineev
21e0bec3d0 Merge remote-tracking branch 'upstream/master' into feature_multiple_disks 2019-07-16 13:45:07 +03:00
alexey-milovidov
ceffbf39d6
Merge pull request #5965 from dimarub2000/master
Primary key, MergeTreeIndexFullText and MergeTreeIndexSet support for string functions
2019-07-16 03:36:42 +03:00
Alexey Milovidov
27b9f79cba Fixed error after refactoring 2019-07-15 23:26:55 +03:00
Gleb Novikov
c1d91222d5 Ranamed setPrimaryKeyIndicesAndColumns to setProperties 2019-07-13 13:42:52 +03:00
alexey-milovidov
a93c76837e
Merge pull request #5953 from abyss7/fix-filter-table
Implement getDatabaseName() and rename() for all storages
2019-07-13 00:51:39 +03:00
dimarub2000
4005987fc4 multiSearchAny fixed, tests added, minor syle changes 2019-07-12 14:35:17 +03:00
dimarub2000
e5d4f11c73 Deleted some extra implementations, fixed style. multiSearchAny still not working. 2019-07-11 16:44:44 +03:00
dimarub2000
1480b8e62c Actually set index already woks for everything. Here are some tests. 2019-07-11 15:31:24 +03:00
dimarub2000
88778b0f5b minor style changes 2019-07-10 18:12:02 +03:00
dimarub2000
f5ba5e3ca9 Merge branch 'master' of github.com:dimarub2000/ClickHouse 2019-07-10 18:08:10 +03:00
dimarub2000
c9a5b3c9ab primary key and MergeTreeIndexFullText support for string functions 2019-07-10 17:53:57 +03:00
Vitaly Baranov
3a74f326a8 Fix unused variable in checkDataPart.cpp 2019-07-10 15:13:10 +03:00
Ivan Lezhankin
befb3ce15b Merge branch 'master' into fix-filter-table 2019-07-10 13:27:26 +03:00
Ivan Lezhankin
8a600c39af Fix build for gtests 2019-07-09 21:53:16 +03:00
Ivan Lezhankin
9f01fa7aaa Implement getDatabaseName() and rename() for all storages 2019-07-09 18:40:21 +03:00
Vitaliy Zakaznikov
a80af666ad * Updates that incorporate comments from the review 2019-07-09 08:41:55 -04:00
alesapin
d4c44320ea Merge branch 'fix_fetch_of_existing_part' of github.com:yandex/ClickHouse into fix_fetch_of_existing_part 2019-07-09 12:04:00 +03:00
alesapin
9a17a461ea Review fixes and better tests 2019-07-09 12:02:52 +03:00
alesapin
6a3b543e10 Merge branch 'master' of github.com:yandex/ClickHouse into fix_fetch_of_existing_part 2019-07-09 11:21:44 +03:00
alexey-milovidov
a8d8eb6b28
Merge pull request #5921 from yandex/pvs-studio-fixes-4
A few fixes for PVS-Studio
2019-07-09 01:10:05 +03:00
alexey-milovidov
c491cddb78
Update CheckResults.h 2019-07-08 22:56:48 +03:00
Alexey Milovidov
886e8ea0d4 Merge branch 'master' into pvs-studio-fixes-4 2019-07-08 19:58:42 +03:00
Alexey Milovidov
3f92ecf334 Merge branch 'master' into add-noreturn 2019-07-08 16:13:56 +03:00
Alexey Milovidov
f40b70884f Two more fixes for PVS-Studio 2019-07-08 05:14:32 +03:00
Alexey Milovidov
ac20c515ab Better code in unit tests 2019-07-08 04:58:31 +03:00
Alexey Milovidov
4752dae9bb Allowed unresolvable addresses in cluster configuration #5714 2019-07-08 04:43:41 +03:00
Vitaliy Zakaznikov
24a3726235 Merge branch 'master' of https://github.com/vzakaznikov/ClickHouse into liveview 2019-07-07 20:03:14 -04:00
Vitaliy Zakaznikov
259a95a3da * Updates to fix issues after the merge 2019-07-07 19:57:58 -04:00
Alexey Milovidov
19059ef650 One more fix for PVS-Studio 2019-07-08 02:29:54 +03:00
alexey-milovidov
8d4358f19c
Merge pull request #5919 from dimarub2000/master
startsWith now uses PK index
2019-07-08 02:06:05 +03:00
alexey-milovidov
0480706ff4
Update KeyCondition.cpp 2019-07-08 00:28:03 +03:00
dimarub2000
0b756c48a8 also style changes 2019-07-07 18:56:15 +03:00
dimarub2000
95118a5fa3 also style changes 2019-07-07 18:54:13 +03:00
dimarub2000
94523c00cd minor style changes 2019-07-07 18:52:20 +03:00
dimarub2000
2693ce27ff startsWith now uses PK index 2019-07-07 18:48:34 +03:00
Alexey Milovidov
2e6280de07 Fixed #5797 2019-07-07 03:20:38 +03:00
alexey-milovidov
a1cfdf2a60
Merge pull request #5855 from abyss7/no-undefined
Use --no-undefined linker option for split build
2019-07-07 01:47:11 +03:00
Gleb Novikov
3757aa9d02 More style fix 2019-07-06 23:30:48 +03:00
alexey-milovidov
eb2ffccaf3
Merge pull request #5874 from nikitamikhaylov/master
Add data checksums to system.parts_columns table. #5151
2019-07-05 23:58:58 +03:00
Nikita Mikhaylov
afdd45fd85 checksum added to system_parts 2019-07-05 18:32:55 +03:00
CurtizJ
a49112a14e Merge branch 'master' of https://github.com/yandex/ClickHouse into order-by-efficient 2019-07-05 16:41:48 +03:00
alexey-milovidov
2469ec1af3
Merge pull request #5857 from CurtizJ/dns-cache
Implement dns cache with asynchronous update.
2019-07-05 15:56:26 +03:00
Nikita Mikhaylov
1ffa488be4 lowercase added~ 2019-07-05 14:45:47 +03:00
CurtizJ
410b62f7fa Merge branch 'clickhouse-4013' of https://github.com/anrodigina/ClickHouse into order-by-efficient 2019-07-05 13:48:04 +03:00
Nikita Mikhaylov
f8dde20dcb easier code 2019-07-05 13:13:44 +03:00
Nikita Mikhaylov
0e25190433 checksums now output in the same way + tests are better 2019-07-05 12:00:19 +03:00
Gleb Novikov
430400c3c5 Style fix 2019-07-05 10:16:34 +03:00
Alexey Milovidov
2c6dd99644 Updated contributors 2019-07-05 04:13:03 +03:00
Gleb Novikov
71c2ca0fe9 Merge branch 'master' into table-constraints 2019-07-04 22:40:00 +03:00
Nikita Mikhaylov
fc75c8f62e done 2019-07-04 21:27:14 +03:00
Ivan Lezhankin
3b995bdb02 Add missing dependecies on sight to enable --no-undefined option 2019-07-04 17:05:55 +03:00
alesapin
65437d2289 Fix final mark and tests 2019-07-04 13:21:14 +03:00
alesapin
a0496da05f Merge branch 'master' of github.com:yandex/ClickHouse into fix_fetch_of_existing_part 2019-07-04 12:46:54 +03:00
alesapin
18544e8f64 Missed file and style fix 2019-07-04 09:04:31 +03:00
alesapin
477a7450fb Add test for data corruption 2019-07-03 23:51:13 +03:00
CurtizJ
187812a00e cleanup 2019-07-03 21:34:37 +03:00
CurtizJ
80e96995ae Merge branch 'master' of https://github.com/yandex/ClickHouse into dns-cache 2019-07-03 21:27:43 +03:00
Ivan
fdae12a51c
Keep on reading of new Kafka messages after stalling (#5852) 2019-07-03 19:51:11 +03:00
CurtizJ
35ad1a3b6b implement dns cache with asynchronous update 2019-07-03 19:26:22 +03:00
alesapin
3925a3bd13 Generalize check query 2019-07-03 16:17:19 +03:00
alesapin
6b0498cd93 First version of check cmd 2019-07-03 11:49:52 +03:00
alexey-milovidov
50c22ef71a
Merge pull request #5628 from yandex/index_granularity_by_default
Enable adaptive index granularity by default
2019-07-03 02:15:33 +03:00
alexey-milovidov
d81ae49f2c
Merge pull request #5755 from 4ertus2/bugs
Fix wrong ColumnConst.isColumnNullable()
2019-07-03 02:06:07 +03:00
alexey-milovidov
de92b9854e
Merge pull request #5838 from 4ertus2/joins
Joins refactoring: extract joinDispatch into own file
2019-07-03 01:55:45 +03:00
chertus
207145025c Join.h refactoring: extract joinDispatch into own file 2019-07-02 17:38:31 +03:00
alexey-milovidov
1bda6994ad
Merge pull request #5832 from yandex/fix_low_cardinality_check
Fix low cardinality check
2019-07-02 17:06:06 +03:00
alesapin
cbb0d640f4 Add comments 2019-07-02 14:34:16 +03:00
alesapin
f68b5216a8 Fix prefix reading and skip check for low cardinality dictionary 2019-07-02 13:55:47 +03:00
Vitaliy Zakaznikov
b5120931d5 Merge branch 'master' of https://github.com/yandex/ClickHouse into liveview 2019-07-01 18:12:31 -04:00
Vitaliy Zakaznikov
a363189dfc Merge branch 'master' of https://github.com/vzakaznikov/ClickHouse into liveview 2019-07-01 18:05:14 -04:00
Nikita Lapkov
9641d058d0 Merge remote-tracking branch 'upstream/master' into update_libunwind 2019-07-01 21:11:26 +00:00
alexey-milovidov
c43dfce041
Merge pull request #5382 from abyss7/issue-5286
Add virtual columns to Kafka Engine tables
2019-07-01 21:30:09 +03:00
chertus
5df4ad0f28 Merge branch 'master' into bugs 2019-07-01 14:49:01 +03:00
Alexey Milovidov
b86aca37ea Merge branch 'h3-integration' of https://github.com/BHYCHIK/ClickHouse into BHYCHIK-h3-integration 2019-06-30 19:15:33 +03:00
alexey-milovidov
feafcb21bd
Merge branch 'master' into h3-integration 2019-06-30 16:19:11 +03:00
Gleb Novikov
ea4d42c3ac Merged DROP_(COLUMN|INDEX|CONSTRAINT) AST parsing into one block 2019-06-30 12:09:58 +02:00
Gleb Novikov
a146b7383e Merge branch 'master' into table-constraints 2019-06-30 11:32:02 +02:00
Alexey Milovidov
725bcd9d02 Merge branch 'master' into sanych73-prepared_statements 2019-06-30 02:59:37 +03:00
Alexey Milovidov
88fc72f0b9 Merge branch 'feature/bloom_filter' of https://github.com/zhang2014/ClickHouse into zhang2014-feature/bloom_filter 2019-06-29 20:44:11 +03:00
Alexey Milovidov
6566bb7088 Updated tests 2019-06-29 19:18:59 +03:00
Nikita Lapkov
2a131185b0 Merge remote-tracking branch 'upstream/master' into update_libunwind 2019-06-28 18:20:23 +00:00
Nikita Lapkov
f8d2b5effd introduce Backtrace class 2019-06-28 18:06:38 +00:00
alexey-milovidov
18659e367e
Merge pull request #5758 from zlobober/bool_masks
Extend KeyCondition interface so that it returns BoolMask.
2019-06-28 14:51:52 +03:00
alexey-milovidov
6e77fc4abe
Merge pull request #5775 from yandex/lfalloc2mimalloc
Use mimalloc instead of lfallocator
2019-06-28 14:48:18 +03:00
chertus
f19dee706a move IColumn.isColumnConst() outside of interface 2019-06-27 22:28:52 +03:00
chertus
db7c8748e9 remove IColumn.isColumnNullable() 2019-06-27 21:50:20 +03:00
alexey-milovidov
246f34d8f6
Merge pull request #5768 from abyss7/better-log
Print table name in message about missing column
2019-06-27 18:49:40 +03:00
Danila Kutenin
e67431e455 Use mimalloc instead of lfallocator 2019-06-27 18:13:19 +03:00
Maxim Akhmedov
2cacc3cfd2 CHYT-142: extend KeyCondition interface so that it returns BoolMask. 2019-06-27 16:31:33 +03:00
Alexey Milovidov
8f3ff6c77a Removed inconsistent whitespaces 2019-06-27 16:20:33 +03:00
Ivan Lezhankin
9d3eef80b0 Print table name in message about missing column. 2019-06-27 13:56:04 +03:00
chertus
65c0d23efa better casts to ColumnNullable 2019-06-26 20:20:33 +03:00
alesapin
b7f173ad2c Execute some distributed DDL queries on leader 2019-06-26 17:52:20 +03:00
Nikita Vasilev
7079c91a0e Merge remote-tracking branch 'upstream/master' into nikvas0/index_mutate 2019-06-25 16:34:11 +03:00
Nikita Vasilev
9873b04611 StringRef -> String (race cond) 2019-06-25 16:10:09 +03:00
Ivan Remen
df4bd3eec6 Merge remote-tracking branch 'main/master' into h3-integration 2019-06-25 15:43:33 +03:00
Ivan Remen
8ad592dd07 Fix?? 2019-06-25 14:27:39 +03:00
alesapin
4a8a70a079
Merge pull request #5720 from coraxster/fix-5377
MergedColumnOnlyOutputStream. Skip empty blocks. Fix 5377
2019-06-25 13:35:09 +03:00
dmitry kuzmin
c72e4dfe08 5337: clang compiler fix 2019-06-24 18:07:01 +03:00
Alexey Milovidov
8f77d898f3 Renamed functions for consistency #5704 2019-06-24 17:51:37 +03:00
alexey-milovidov
8e41d89126
Merge pull request #5704 from zhang2014/fix/ISSUES-5697
ISSUES-5697 fix insert and select query with mysql style identifier
2019-06-24 17:40:28 +03:00
Nikita Vasilev
7b7517ff85 Merge remote-tracking branch 'upstream/master' into nikvas0/index_mutate 2019-06-24 16:44:44 +03:00
Ivan Lezhankin
0917573493 Merge remote-tracking branch 'upstream/master' into issue-5286 2019-06-24 14:42:58 +03:00
proller
1ac09fa721
Split Common/config.h by libs (dbms) (#5715) 2019-06-24 14:17:15 +03:00
Vitaliy Zakaznikov
d87ed7f267 * Adding max_live_view_insert_blocks_before_refresh setting
with default value of 64
* Updating writeIntoLiveView method to use max_live_view_insert_blocks_before_refresh
  from global context instead of hard coded number
* Adding squashing of the result blocks similar how it is done in materialized views
* Fixing bug in writeIntoLiveView that caused incoming block to be processed twice
  when maximum number of insert blocks was reached
2019-06-23 09:51:29 -04:00
dmitry kuzmin
c988293e1e 5337 fix: MergedColumn. skip empty blocks 2019-06-23 07:30:29 +03:00
zhang2014
b9cb1feb4c some review fixes 2019-06-22 12:40:41 +08:00
chertus
29700fd5e9 Auto version update to [19.11.0] [54423] 2019-06-21 18:47:02 +03:00
alesapin
efc0f7f65e Remove unused method 2019-06-21 18:19:47 +03:00
Ivan Lezhankin
b75db2ef04 Fix dropping message to early when stalling 2019-06-21 17:29:10 +03:00
zhang2014
1786407621 ISSUES-5697 fix insert and select query with mysql style identifier 2019-06-21 13:51:27 +08:00
proller
f111dbd45f Do not require gperf on build (#5701)
* Build fixes

* fix

* USE_GPERF

* wip

* wip

* wip

* test -j

* Simpler

* fix

* FunctionsURL.h -> URL/FunctionsURL.h

* clean

* clean

* Always use gperf-generated file

* Generator for tldLookup.generated.cpp

* clang-format
2019-06-21 02:50:53 +03:00
alexey-milovidov
606b074a4b
Merge pull request #5659 from yandex/ignore-mutation-limits
Ignore query execution limits and limits for max parts size for merge while executing mutations.
2019-06-21 02:14:41 +03:00
alexey-milovidov
73df46be2b
Merge pull request #5698 from abyss7/issue-5615
Lower the probability of hanging when shutting down Kafka storage
2019-06-21 02:11:07 +03:00
alesapin
3f7892ef50 Fix typo 2019-06-20 22:21:17 +03:00
alesapin
80f27968ac Add test for interaction of tables with different granularity and different versions 2019-06-20 19:25:32 +03:00
Ivan Lezhankin
ec78ec8365 Merge branch 'master' into issue-5286 2019-06-20 16:08:22 +03:00
Ivan Lezhankin
61750d09d2 Commit offsets for SELECTing from Kafka table too 2019-06-20 15:34:25 +03:00
proller
3d8c8ee83c
Build fixes. Split config.h (#5686) 2019-06-20 12:12:49 +03:00
alesapin
4ae502eaa6 Fix bug with wrong granularity detection 2019-06-20 11:48:56 +03:00
zhang2014
8221dd2a1a fix build and test failure 2019-06-20 08:33:37 +08:00
Igr Mineev
23049ac9e8 Add mergetree part move in background. 2019-06-19 20:56:41 +03:00
zhang2014
374aac3501 fix build & chmod shell test 2019-06-20 00:32:20 +08:00
alesapin
dd37370aab Fix test and add one 2019-06-19 19:16:13 +03:00
Ivan Lezhankin
fdd3f07860 Don't do premature subscription to topics 2019-06-19 19:15:30 +03:00
zhang2014
166018e41e fix code style & rename minmax, set 2019-06-19 23:30:48 +08:00
zhang2014
a50aea09f1 fix float in bloom filter 2019-06-19 23:13:21 +08:00
zhang2014
d145295163 convert type with condition 2019-06-19 23:12:06 +08:00
zhang2014
6c8ff6dc31 add some test 2019-06-19 23:12:05 +08:00
zhang2014
f52b16e1e1 support bloom filter for any type 2019-06-19 23:12:05 +08:00
alesapin
fefce49c8f Mixed parts by setting 2019-06-19 17:46:06 +03:00
alesapin
dd2e4fd805 Bug fixes 2019-06-19 15:30:56 +03:00
alesapin
f0c273ee4c More correct version 2019-06-19 14:59:08 +03:00
alesapin
d1de7431e1 Compilable 2019-06-19 13:26:26 +03:00
alesapin
7e11c3c78b Merge branch 'master' into index_granularity_by_default 2019-06-19 13:08:12 +03:00
alesapin
b544b62e44 A log of bugs 2019-06-19 13:07:56 +03:00
Ivan Lezhankin
9fd048cdbd Allow to select virtual columns in materialized view 2019-06-18 19:32:37 +03:00
Ivan Lezhankin
436052c67b Merge branch 'master' into issue-5286 2019-06-18 16:03:29 +03:00
alesapin
4f98f875c3
Add ability to write final mark for *MergeTree engines family (#5624)
Add the ability to write final mark to *MergeTree engines family.
2019-06-18 15:54:27 +03:00
alesapin
0bfb7b18ce Fix directory check 2019-06-18 14:38:04 +03:00
alesapin
d2615863f3 Merge branch 'master' into index_granularity_by_default 2019-06-18 13:52:41 +03:00
CurtizJ
e6dd92f9e1 ignore max part size for merge setting while executing mutations 2019-06-17 22:41:48 +03:00
Vitaliy Zakaznikov
bdeb45e8c7 Merge branch 'master' of https://github.com/vzakaznikov/ClickHouse into liveview 2019-06-17 13:04:48 -04:00
proller
dae5087fcf Build and test fixes 2019-06-17 19:50:31 +03:00
Vitaliy Zakaznikov
51bf8a1baa Merge branch 'master' of https://github.com/vzakaznikov/ClickHouse into liveview 2019-06-17 12:42:31 -04:00
Vitaliy Zakaznikov
8df3e48a7b * Fixing bug in writeIntoLiveView method where mergeable blocks
would always be reobtained after 64 inserts
2019-06-17 12:39:01 -04:00
Ivan Lezhankin
d907d8e8ca Commit offsets for SELECTing from Kafka table too 2019-06-17 19:27:18 +03:00
alesapin
fb22200890 Fix name hidding and stupid bug 2019-06-17 18:35:53 +03:00
alesapin
9e7d23b22e Style fix 2019-06-17 16:29:10 +03:00
alesapin
fd3abbe93d
Merge pull request #4935 from zhang2014/feature/support_system_replicas
Support system replicas queries for distributed
2019-06-17 15:30:30 +03:00
alesapin
e45d727e9d
Merge pull request #4558 from podshumok/distributred-timeout
Distributed and remote timeouts
2019-06-17 13:58:17 +03:00
alesapin
3a4dcfbacd Fix inconsistency in zookeeper metadata and disable adaptive granularity for old format 2019-06-17 13:34:25 +03:00
alesapin
e73cdbae90 Fix name hidding 2019-06-17 12:22:44 +03:00
alesapin
02af85411c Merge branch 'master' into index_granularity_by_default 2019-06-17 12:02:03 +03:00
alexey-milovidov
5fd319d0e9
Merge pull request #5648 from yandex/remove-number-of-stat-calls
Reduce number of "stat" syscalls for MergeTree data parts
2019-06-17 09:30:29 +03:00
Alexey Milovidov
62a3d00772 Added comment 2019-06-16 23:50:06 +03:00
Alexey Milovidov
ee5dcd50a0 Lowered CPU overhead for small data parts 2019-06-16 23:42:03 +03:00
Alexey Milovidov
14be0ca281 Reduce number of "stat" syscalls for MergeTree data parts 2019-06-16 23:13:54 +03:00
Alexey Milovidov
49c4f2ffed Reduce number of "stat" syscalls for MergeTree data parts 2019-06-16 23:11:30 +03:00
Alexey Milovidov
e3b21be1bb Reduce number of "stat" syscalls for MergeTree data parts 2019-06-16 23:02:45 +03:00
Alexey Milovidov
0ad13ca3d1 Reduce number of "stat" syscalls for MergeTree data parts 2019-06-16 22:59:30 +03:00
Alexey Milovidov
c1aa767a04 Reduce number of "stat" syscalls for MergeTree data parts 2019-06-16 22:53:05 +03:00
Alexey Milovidov
e4f314f88d Reduce number of "stat" syscalls for MergeTree data parts 2019-06-16 22:49:12 +03:00
Alexey Milovidov
801f34d325 Reduce number of "stat" syscalls for MergeTree data parts 2019-06-16 22:42:05 +03:00
Alexey Milovidov
b6acb29625 Reduce number of "stat" syscalls for MergeTree data parts 2019-06-16 22:36:15 +03:00
Alexey Milovidov
b494d17ca6 Reduce number of "stat" syscalls for MergeTree data parts 2019-06-16 22:32:52 +03:00
Alexey Milovidov
413b780b65 Various fixes for PVS-Studio 2019-06-16 21:13:39 +03:00
Vitaliy Zakaznikov
abc7c3f6c1 Merge branch 'master' of https://github.com/vzakaznikov/ClickHouse into liveview 2019-06-15 21:22:28 -04:00
alexey-milovidov
39c6fbc324
Merge pull request #5567 from vitlibar/really-lazy-dictionary-load
Non-blocking loading of external dictionaries
2019-06-15 22:15:53 +03:00
alexey-milovidov
a52e13b891
Merge pull request #5640 from yandex/use-ipv6-in-system-tables
Adopted IPv6 data type in system tables; unified client info columns in system.processes and system.query_log
2019-06-15 21:21:24 +03:00
Alexey Milovidov
d8f76152d5 Adopted IPv6 data type in system tables; unified client info columns in system.processes and system.query_log 2019-06-15 17:20:32 +03:00
Alexey Milovidov
b2100c7bcf Removed strange quoting style like `this'. See https://english.stackexchange.com/questions/17695/any-reference-on-the-usage-of-a-backtick-and-single-quotation-mark-like-this
Added backQuote and backQuoteIfNeed when required to correctly quote identifiers with proper escaping.
2019-06-15 15:06:22 +03:00
Vitaliy Zakaznikov
282ff6bfda * Fixing a bug in writeIntoLiveView method where blocks->front()
is called before checking if blocks vector is empty.
2019-06-14 21:08:46 -04:00
Vitaliy Zakaznikov
d6d0404c48 * Fixing bug in StorageLiveView.cpp getHeader() method
that sometimes addressed invalid pointer when getHeader()
  method was called without holding the mutex
2019-06-14 16:27:43 -04:00
Gleb Novikov
15004ce055 Merge branch 'master' into table-constraints 2019-06-14 23:10:48 +03:00
Vitaly Baranov
b4384ce2a9 Dictionaries can be loaded in parallel.
A bad dictionary cannot block all the loading anymore.
Implemented really lazy loading of external dictionaries.
Provided more detailed information about the loading of each dictionary
to make diagnostics easier.
2019-06-14 22:18:47 +03:00
Alexey Milovidov
10722f53c7 Fixed performance degradation in SELECT from MergeTree tables #5631 2019-06-14 22:11:41 +03:00
alesapin
22026e0333 Enable adaptive index granularity by default 2019-06-14 18:39:21 +03:00
Vitaliy Zakaznikov
13978c03f3 * Fixing a bug in StorageLiveView.cpp in the getHeader() method
when header block would not match blocks in the stream
  when Const column is present.
* Updating 00963_temporary_live_view_watch_live_timeout.py
  and removed timeout=5 after WATCH query is aborted with Ctrl-C
  so that the default timeout of 20sec is used
* Small style fixes in tests
2019-06-14 10:06:15 -04:00
proller
fc7ae399c4 Use system rapidjson; Fix types for macos; 2019-06-14 13:28:30 +03:00
alexey-milovidov
bc387e865f
Merge pull request #5549 from yandex/fix_deduplication_bug
Fix complex bug in deduplication
2019-06-14 09:23:15 +03:00
Vitaliy Zakaznikov
117f2d191e Merge branch 'master' of https://github.com/vzakaznikov/ClickHouse into liveview 2019-06-13 15:23:20 -04:00
Vitaliy Zakaznikov
b82bb4a954 * Updates to sync with yandex/master 2019-06-13 12:37:29 -04:00
Vitaliy Zakaznikov
8e868dd2fe Merge branch 'master' of https://github.com/yandex/ClickHouse 2019-06-13 12:31:13 -04:00
Alexey Milovidov
c846d0f6af Namespace comments are unneeded according to the code style.
find dbms -name '*.h' -or -name '*.cpp' | xargs grep -l -P '}\s*//+\s*namespace\s*' | xargs sed -i -r -e 's/}\s*\/\/+\s*namespace\s*.*$/}/'
2019-06-13 13:43:37 +03:00
Alexey Milovidov
8b87511e25 Namespace comments are unneeded according to the code style.
find dbms -name '*.h' -or -name '*.cpp' | xargs grep -l -P '}\s*//+\s*namespace\s*' | xargs sed -i -r -e 's/}\s*\/\/+\s*namespace\s*\w+/}/'
2019-06-13 13:37:13 +03:00
Vitaliy Zakaznikov
576393272b * Fixing styling check error 2019-06-12 20:45:41 -04:00
Vitaliy Zakaznikov
5983273694 Fixing bugs reported by sanitizers
* data race condition on storage is_dropped access
* invalid reference to storage after it is deleted
* invalid reference to mutex after storage is deleted
2019-06-12 09:11:44 -04:00
Vitaliy Zakaznikov
12060d8879 * Fixing errors that prevented clang build. 2019-06-11 08:27:47 -04:00
Vitaliy Zakaznikov
b6efd8599f * Trying again to fix style checks. Now running ./utils/check-style/check-style reports no errors. 2019-06-11 06:30:57 -04:00
Vitaliy Zakaznikov
a467e7c105 * Moving uexpect.py so that it can be found
* Trying to fix failed style checks
* Trying to fix clang build fail
2019-06-10 22:22:53 -04:00
Vitaliy Zakaznikov
a68980ab38 * Style check fixes 2019-06-10 07:41:33 -04:00
Vitaliy Zakaznikov
87b58e4150 * Fixing clang errors
* Fixing LIVE VIEW tests
2019-06-10 07:18:33 -04:00
Ivan Lezhankin
97558c1b41 Merge remote-tracking branch 'upstream/master' into issue-5286 2019-06-10 14:15:14 +03:00
Igr Mineev
842c72bb6d Merge branch 'master' into feature_multiple_disks 2019-06-09 15:38:54 +03:00
Igr Mineev
54b688e559 Stylefix 2019-06-09 15:31:03 +03:00
Vitaliy Zakaznikov
5079180595 * Fixing a bug in LIVE VIEW tables. Before when a table
is created with "AS SELECT 1" the SELECT and WATCH queries would fail
* Adding and updating LIVE VIEW tests to increase coverage
2019-06-08 09:26:02 -04:00
Igr Mineev
0eba56c4a7 Added move command. 2019-06-07 22:16:42 +03:00
Vitaliy Zakaznikov
b65ff910b6 Merge branch 'master' of https://github.com/vzakaznikov/ClickHouse into liveview 2019-06-07 08:02:59 -04:00
Vitaliy Zakaznikov
398f7e3c3f Merge branch 'master' of https://github.com/yandex/ClickHouse 2019-06-06 21:22:48 -04:00
Vitaliy Zakaznikov
2930965938 * Renaming live_view_heartbeat_delay setting to live_view_heartbeat_interval
and making the setting to be in seconds instead of usec
* Updated LIVE VIEW table to keep version consistent as long as the server is up
* Removed calculation of hash in writeIntoLiveView method as it is recalculated
  in the LiveViewBlockOutputStream
* Changed to using values from the local context for live_view_heartbeat_interval and
  temporary_live_view_timeout instead of the global context
* Updated LIVE VIEW tests to match the changes
2019-06-06 21:10:56 -04:00
alesapin
53e62b83d2 Fix complex bug in deduplication 2019-06-06 18:28:02 +03:00
Vitaliy Zakaznikov
e51f2c1dd1 Revert "Merge branch 'master' of https://github.com/vzakaznikov/ClickHouse into liveview"
This reverts commit 160ff4d519, reversing
changes made to a946d09f1b.
2019-06-05 18:52:31 -04:00
Vitaliy Zakaznikov
160ff4d519 Merge branch 'master' of https://github.com/vzakaznikov/ClickHouse into liveview 2019-06-05 18:42:26 -04:00
alexey-milovidov
42dbb7e881
Merge pull request #5539 from yandex/alter-ttl-fix
Fixed alter modify ttl on ReplicatedMergeTree.
2019-06-05 22:05:17 +03:00
CurtizJ
27d8b90dd9 fixed alter modify ttl on ReplicatedMergeTree and test added 2019-06-05 19:22:41 +03:00
Gleb Novikov
b8385aae8c Merge branch 'master' into table-constraints 2019-06-05 15:33:07 +03:00
Orivej Desh
5ec179377a DEVTOOLS-5170 Delete Y_IGNORE markers (#5533)
They have been superseded by a new include resolution configuration that lives
outside clickhouse source tree.
2019-06-05 14:52:39 +03:00
Vitaliy Zakaznikov
5f3be8134d * Disallowing writes into LIVE VIEW tables
* Adding support for watching live views via HTTPHandler
* Small fix to WriteBufferValidUTF8.cpp to propagate next() call
* Updated copyData.cpp to treat block with no rows as
  "flush block"
* Updated PushingToViewsBlockOutputStream.cpp to directly use
  LIVE VIEW output stream instead of calling its write method
2019-06-05 07:30:29 -04:00
Gleb Novikov
8bd2c7b3a7 Fixed DROP INDEX IF EXISTS and added simple test 2019-06-04 00:08:52 +03:00
Vitaliy Zakaznikov
fc21200bdd * Started to add LIVE VIEW table tests
* Added uexpect.py module
* Fixed support for CREATE TEMPORARY LIVE VIEW
2019-06-03 15:53:11 -04:00
Gleb Novikov
108b4c6a51 Merge branch 'master' into table-constraints 2019-06-03 22:15:33 +03:00
alesapin
db6de83fa1
Merge pull request #5520 from yandex/fix_inconsistent_parts_removing
Fix inconsistent parts remove from local FS without dropping them from ZK
2019-06-03 21:18:16 +03:00
Ivan
f70eed78d8
Don't do intermediate commits in Kafka tables by default (#5445)
* Don't do intermediate commits in Kafka tables by default
* Use default settings' values as defaults in code
2019-06-03 19:40:22 +03:00
alesapin
dfe214b37c Fix inconsistent parts remove from local FS without dropping them from ZK 2019-06-03 17:58:19 +03:00
Ivan Lezhankin
8326021d74 Fix style 2019-06-03 17:36:59 +03:00
Ivan Lezhankin
b311984879 Merge remote-tracking branch 'upstream/master' into issue-5286 2019-06-03 17:19:09 +03:00
Anastasiya Rodigina
77fa9c30ee fix little misprint 2019-06-03 07:36:55 +00:00
Anastasiya Rodigina
4ff02cff4d Fix some problems with tests, add more tests, more syntetic tests are coming today 2019-06-03 06:00:54 +00:00
Gleb Novikov
33f0ebd8ab Brace style fix 2019-06-02 18:08:28 +03:00
Gleb Novikov
e7293486bd Added ALTER TABLE support to constraints (ADD CONSTRAINT, DROP CONSTRAINT) 2019-06-02 17:41:12 +03:00
Konstantin Podshumok
9e7387182a StorageReplicatedMergeTree: move timeouts to RemoteBlockInputStream 2019-06-02 12:43:20 +03:00
Konstantin Podshumok
a61a8386f3 update timeouts usage in DistributedBlockOutputStream 2019-06-02 12:43:20 +03:00
Konstantin Podshumok
b801fcb79a fix timeouts usage in directory monitor 2019-06-02 12:43:20 +03:00
Gleb Novikov
2b5cf46842 Merge branch 'master' into table-constraints 2019-06-02 08:33:36 +03:00
Danila Kutenin
b5f42d36fa
Merge pull request #5498 from yandex/gcc9-warnings
Fix gcc9 warnings and ICEs
2019-06-01 15:12:41 +03:00
Vitaly Baranov
a4ce427bfa
Merge pull request #5429 from azat-archive/INSERT-into-Distributed-with-MATERIALIZED
Fix INSERT into Distributed() table with MATERIALIZED column
2019-06-01 12:28:45 +03:00
Vitaly Baranov
421c6a90e2
Use function getSampleBlockNonMaterialized() to simplify the solution 2019-05-31 21:31:09 +03:00
Danila Kutenin
7e2b3b59b8 Fix gcc9 warnings and ICE's 2019-05-31 11:55:01 +03:00
proller
1b0d1a4450 Info about frozen parts in system.parts (#5471)
* wip

*    wip

* wip

* Clean

* fix test

* clean

* fix test

* fix test
2019-05-31 07:03:46 +03:00
Vitaliy Zakaznikov
f06f0e3947 * Adding support for CREATE TEMPORARY LIVE VIEW
* Fixing issue with setting _version virtual column
2019-05-30 17:29:30 -04:00
Vitaliy Zakaznikov
673d1a46a0 * Adding support for _version virtual column to LIVE VIEWs when using SELECT
* Adding support for _version column to LIVE VIEWS when using WATCH query
* Adding initial support for WATCH query on LIVE VIEWs
2019-05-29 17:52:13 -04:00
alexey-milovidov
cf6f771fd2
Update StorageInput.h 2019-05-30 00:38:28 +03:00
alexey-milovidov
e44cdefefa
Update StorageInput.h 2019-05-29 23:59:03 +03:00
zhang2014
80788cd7a8 Rename system sync distributed to system flush distributed 2019-05-29 10:43:52 +08:00
zhang2014
1a33840964 fix review 2019-05-29 10:43:52 +08:00
zhang2014
c44f608868 support replicas system queries for distributed 2019-05-29 10:43:52 +08:00
Vitaliy Zakaznikov
d112695c42 * Adding other changes to support LIVE VIEWs 2019-05-28 17:17:48 -04:00
palasonicq
c873ed39bf Added input() function 2019-05-28 21:27:00 +03:00
alexey-milovidov
5adef8bc56
Merge pull request #5437 from TCeason/bug_fix
ISSUES-5432 fix bad alloc when truncate join storage
2019-05-28 20:33:14 +03:00
Ivan Lezhankin
6b1a9e0e52 Fix comment 2019-05-28 15:22:10 +03:00
tai
1ab21e5774 ISSUES-5432 fix bad alloc when truncate join storage 2019-05-28 14:23:07 +08:00
Ivan Lezhankin
1eccbc39c5 Don't add virtual column to empty block 2019-05-28 00:01:24 +03:00
Azat Khuzhin
e527def18a
Fix INSERT into Distributed() table with MATERIALIZED column
By just skipping MATERIALIZED columns during processing.

P.S. you cannot use insert_allow_materialized_columns since it works
only for Buffer() engine.

Fixes: #4015
Fixes: #3673
Fixes: 01501fa8db ("correct column list
for rewritten INSERT query into Distributed [#CLICKHOUSE-4161]")
2019-05-27 23:32:05 +03:00
Ivan Lezhankin
13212c9b01 Fix the hang on dropping Kafka table when there is no mat. views 2019-05-27 20:25:34 +03:00
Vitaliy Zakaznikov
9dd07bcc23 * Work in progress to redo live view implementation to be less invasive 2019-05-26 18:03:30 -04:00
Vitaliy Zakaznikov
084d538dc5 Merge branch 'master' of https://github.com/yandex/ClickHouse 2019-05-26 17:24:17 -04:00
Gleb Novikov
337897c4b8 Merge branch 'master' into table-constraints 2019-05-26 12:36:02 +03:00
alexey-milovidov
461c4919d3
Merge pull request #5116 from PerformanceVision/send_header
Send a X-ClickHouse summary on the header for HTTP client with number of rows inserted
2019-05-25 20:20:35 +03:00
Gleb Novikov
c926cf6562 Minor review fixes 2019-05-25 17:07:45 +03:00
alexey-milovidov
e0e35f3258
Merge pull request #5246 from nikvas0/nikvas0/fix_minmax_null
[wip] fix null minmax
2019-05-25 16:11:23 +03:00
alexey-milovidov
81ed764d6a
Merge pull request #5285 from abyss7/issue-5085
Don't crash the server when Kafka consumers have failed to start
2019-05-25 16:09:26 +03:00
alexey-milovidov
cb89e506a4
Merge pull request #5353 from yandex/aku/detached-parts-5164
Add system.detached_parts table.
2019-05-25 16:08:33 +03:00
alexey-milovidov
0c38226a25
Merge pull request #5366 from abyss7/storage-merge-sample
Check that underlying tables support sampling for StorageMerge
2019-05-25 15:44:02 +03:00
Gleb Novikov
c401d282da Merge branch 'master' into table-constraints 2019-05-25 14:26:08 +03:00
Anastasiya Rodigina
6c779e63b0 Edit reverse order 2019-05-25 14:09:23 +03:00
Igor Mineev
15ee6207ab Chg 'Schema' to 'StoragePolicy'. Add system.disks. Add system.storage_politics. Add disk to system.parts. Add policy to system.tables. 2019-05-24 22:03:07 +03:00
chertus
9eca696e82 actualize isNumber for Decimal 2019-05-24 15:11:03 +03:00
Ivan Lezhankin
19a850ad75 Use read callback to populate virtual columns in Kafka Engine 2019-05-23 16:20:25 +03:00
Ivan Lezhankin
800854119e Add buffer callback to fill in virtual columns 2019-05-23 14:15:18 +03:00
Ivan Lezhankin
dd906eabdc [WIP] refactoring 2019-05-22 22:38:43 +03:00
Igor Mineev
4f61c9d30f Const Schema fix 2019-05-22 22:20:10 +03:00
Igor Mineev
a209f45f62 Add keep_free_space_ratio param 2019-05-21 20:57:17 +03:00
Igor Mineev
320d509b42 Fix default data path 2019-05-21 20:27:43 +03:00
Igor Mineev
430748bd54 Detach path fix 2019-05-21 18:42:13 +03:00
Igor Mineev
f504c21229 Fetch fix. Style fix 2019-05-21 17:06:33 +03:00
Alexander Kuzmenkov
6472040c6c Initialize StoragesInfo fields. 2019-05-21 16:58:55 +03:00
Ivan Lezhankin
28bddf9a4a [StorageMerge] check that underlying tables support sampling 2019-05-21 16:04:34 +03:00
Alexander Kuzmenkov
43655a8db7 Add system.detached_parts table.
https://github.com/yandex/ClickHouse/issues/5164
2019-05-21 15:06:36 +03:00
Ivan Lezhankin
cf39c4cc47 Embed virtual columns into IStorage 2019-05-21 14:24:32 +03:00
Igor Mineev
645ce7c9a4 Bugfix 2019-05-21 14:09:57 +03:00
Ivan Lezhankin
11a5a6db70 Remove unused functions 2019-05-20 15:16:51 +03:00
Guillaume Tassery
77b7158cd8 Progress rename for total_rows and write_[rows|bytes] 2019-05-20 18:37:41 +07:00
Gleb Novikov
773849a43d Added constraints getter and setter to IStorage 2019-05-19 09:08:25 +03:00
Gleb Novikov
19d099f90a Removed ITableDeclaration 2019-05-19 09:03:18 +03:00
Gleb Novikov
2e7b6af137 Merge branch 'master' into table-constraints 2019-05-19 09:03:04 +03:00
Gleb Novikov
60a5b94ba4 Style fix 2019-05-19 08:44:31 +03:00
Gleb Novikov
300ec160f4 Constraints MVP 2019-05-19 08:27:00 +03:00
alexey-milovidov
2254b171a7
Merge pull request #5313 from yandex/fix-external-query-in-with-single-element
Fix external queries with IN operator.
2019-05-19 03:12:57 +03:00
Alexey Milovidov
648d2bdb25 Fixed test 2019-05-19 01:19:24 +03:00
Anastasiya Rodigina
b3d811a199 Fix some tests 2019-05-18 19:46:29 +03:00
Anastasiya Rodigina
6132b57beb Fix style issues 2019-05-18 16:22:49 +03:00
anrodigina
d7ee2cb907
Merge branch 'master' into clickhouse-4013 2019-05-18 15:34:23 +03:00
Anastasiya Rodigina
5978ca040b Resolve conflicts with master 2019-05-18 15:30:41 +03:00
Anastasiya Rodigina
31f5cb1eee Resolve conflicts with master 2019-05-18 15:29:57 +03:00
Anastasiya Rodigina
b5eab916f5 Resolve conflicts with master 2019-05-18 15:28:09 +03:00
Anastasiya Rodigina
bc09b51316 Add reading in pk_order 2019-05-18 15:21:40 +03:00
alexey-milovidov
7985ad10ef
Update IStorage.h 2019-05-18 12:31:51 +03:00
Gleb Novikov
ce93896608 Added constraints description to MergeTree and related storages 2019-05-18 11:05:52 +03:00
alexey-milovidov
fa4a7eb3d1
Merge branch 'master' into merge-itable-istorage 2019-05-18 00:37:12 +03:00
alexey-milovidov
8bf48de9c9
Merge pull request #5308 from abyss7/issue-5100
Add setting to regulate Kafka committing policy
2019-05-18 00:27:19 +03:00
Ivan Lezhankin
7b6c78402d Allow to shadow virtual column '_table' in Merge engine 2019-05-17 20:40:51 +03:00
Ivan Lezhankin
7f762aee88 Move some code from header to source file. 2019-05-17 17:48:03 +03:00
Ivan Lezhankin
0821d62516 Merge ITableDeclaration into IStorage.
Also a couple of massive include-refactorings with better forwarding
2019-05-17 17:34:25 +03:00
Gleb Novikov
7919a62198 Removed constraints getter and setter from StorageMergeTree 2019-05-17 09:21:29 +03:00
Gleb Novikov
07abed6d31 Renamed constraints getter and setter 2019-05-17 08:05:19 +03:00
Gleb Novikov
3c905e24e2 Merge branch 'master' into table-constraints 2019-05-17 08:02:33 +03:00
Gleb Novikov
72d5a4634c Syntax fix 2019-05-17 07:27:09 +03:00
Gleb Novikov
502d86bd02 Added constraints to InterpreterCreateQuery and storages 2019-05-17 07:08:03 +03:00
Alexey Milovidov
09073e1229 More tests 2019-05-17 01:55:29 +03:00
Alexey Milovidov
b075de45d6 Fixed test 2019-05-17 01:51:26 +03:00
Alexey Milovidov
dd9e993a87 Fixed issue #3540 (in progress) 2019-05-17 00:09:06 +03:00
Alexey Milovidov
5352b53671 Added missing file 2019-05-16 22:57:20 +03:00
Alexey Milovidov
d2bb2a9892 Added failing test 2019-05-16 22:00:46 +03:00
Ivan Lezhankin
a14013dff7 Add setting to regulate Kafka committing policy. 2019-05-16 18:20:30 +03:00
alexey-milovidov
8e2bdde93b
Update StorageKafka.cpp 2019-05-15 23:57:24 +03:00
proller
51ca4cbaa4
Build fixes (#5278) 2019-05-15 20:19:39 +03:00
Igor Mineev
f74b7331f5 Minor fixes 2019-05-15 19:49:55 +03:00
Ivan
1ea9e3019d
Freeze the Kafka buffer after first empty response (#5283)
* Check inside inferior streams for cancellation while reading.
* Stop reading from Kafka buffer after first empty read.
2019-05-15 19:11:50 +03:00
Ivan Lezhankin
337ddf5047 Catch cppkafka exceptions about consumer creation failures 2019-05-15 17:23:52 +03:00
Artem Zuikov
98359a6a09
Merge pull request #5267 from 4ertus2/row_ref_list
RowRefList improvements
2019-05-15 13:38:48 +03:00
alexey-milovidov
88b34999fe
Merge pull request #5247 from zhang2014/fix/rename_data_race
fix data race in rename query
2019-05-14 22:07:52 +03:00
Ivan
4a5832b18a
Check the time limit every (flush_interval / poll_timeout) number of rows from Kafka (#5249) 2019-05-14 18:52:03 +03:00
chertus
6200d20dc2 RowRefList refactoring 2019-05-14 17:39:03 +03:00
proller
cc3de4115f
Build fixes (#5261) 2019-05-14 12:58:33 +03:00
Igor Mineev
74466de6d8 Minor fixes. 2019-05-13 23:58:22 +03:00
zhang2014
2206ba464f fix data race in rename query 2019-05-13 15:54:38 +08:00
Nikita Vasilev
ee3c50e1a0 mayBeTrueOnGranule 2019-05-12 20:08:28 +03:00
Nikita Vasilev
3e02eaf28d fix null minmax 2019-05-12 20:01:36 +03:00
Igor Mineev
6596c3f6e0 DataPartsExchange new protocol with data size. StorageReplicatedMergeTree::fetchPartition multipath fix. Choosing on mutate any disk to write mutation file. 2019-05-12 17:57:23 +03:00
alexey-milovidov
f7343ecb6f
Merge pull request #4639 from IvanKush/feat/parallel-alter-modify
feat alter:  parallelize processing of parts in alter modify
2019-05-12 00:39:46 +03:00
Igor Mineev
af300c667b Bugfix 2019-05-11 23:44:43 +03:00
Nikita Vasilev
b0307ceeef Merge remote-tracking branch 'upstream/master' into nikvas0/index_mutate 2019-05-11 22:04:57 +03:00
Igor Mineev
b4b000bf84 Merge branch 'master' into feature_multiple_disks 2019-05-11 21:50:29 +03:00
Igor Mineev
a3f513914b Schemas names fix. 2019-05-11 21:00:43 +03:00
ivan-kush
ab6558b8b4 add spaces amp 2019-05-10 17:34:02 +03:00
alexey-milovidov
8ef7f3589a
Merge pull request #4936 from TCeason/feature/support_settings_for_async
Suport settings for async distributed inserts (#4852)
2019-05-09 23:59:29 +03:00