thevar1able/ClickHouse
1
0
Fork 0
mirror of https://github.com/ClickHouse/ClickHouse.git synced 2024-12-15 19:02:04 +00:00
Code Issues Packages Projects Releases Wiki Activity
32,832 Commits 9,326 Branches 1,783 Tags 2.1 GiB
f04a2a5f7b
Commit Graph

5519 Commits

Author SHA1 Message Date
alexey-milovidov
a466c7aebd
Merge pull request #6299 from CurtizJ/order-by-efficient 
Optimizations of ranges selection while reading with enabled optimize_read_in_order.
 2019-08-16 02:39:53 +03:00
alexey-milovidov
a70bfa13d4
Merge pull request #6467 from nikitamikhaylov/system_metric_log 
system.metric_log table
 2019-08-16 02:28:53 +03:00
alesapin
f988ff538b Less code 2019-08-15 20:02:04 +03:00
Nikita Vasilev
00a5fe7836 Merge remote-tracking branch 'upstream/master' into nikvas0/index_mutate 2019-08-15 19:48:57 +03:00
alesapin
d81961c4ca Fix strange code 2019-08-15 12:43:31 +03:00
Gleb Novikov
ab1c4139de Added ReplicatedMergeTree support and test for constraints, also added VIOLATED_CONSTRAINT error 2019-08-14 22:51:03 +03:00
CurtizJ
0b3d7d8032 Merge remote-tracking branch 'upstream/master' into order-by-efficient 2019-08-14 21:26:25 +03:00
alesapin
e391ce813d refactoring 2019-08-14 18:20:52 +03:00
Nikolai Kochetov
287eb633b8 Merged with master 2019-08-14 18:16:52 +03:00
Nikolai Kochetov
0635188104 Allow constants for RemoteBlockInputStream. 2019-08-14 18:14:32 +03:00
chertus
ddde50c542 minor fixes in includes 2019-08-14 17:06:16 +03:00
alesapin
6a283b6bde Remove segfault 2019-08-14 14:59:45 +03:00
alesapin
a2ca18d287 Fix test 2019-08-14 13:30:36 +03:00
alesapin
949890ee90 Merged 2019-08-14 12:46:30 +03:00
CurtizJ
94bca8315d Merge remote-tracking branch 'upstream/master' into order-by-efficient 2019-08-14 01:41:38 +03:00
alesapin
96f62fefcc Add mutex for settings 2019-08-13 19:34:52 +03:00
alesapin
031bfc7bf3 Remove reference 2019-08-13 17:46:18 +03:00
Nikita Mikhaylov
bbe20b3f9f done 2019-08-13 17:31:46 +03:00
alesapin
f988090111 Remove redundant move 2019-08-13 15:10:58 +03:00
alesapin
b00903330f Remove empty block 2019-08-13 15:03:42 +03:00
alesapin
bf5ec73582 Fix clang build 2019-08-13 14:40:45 +03:00
alesapin
7b1039568c Revert old changed 2019-08-13 14:24:18 +03:00
alesapin
ad81c743c1 Buildable code 2019-08-13 13:29:31 +03:00
alesapin
428c753ed7 Merge with master 2019-08-13 11:37:47 +03:00
alesapin
8e72d4c2ec Tryin COW settings 2019-08-13 11:35:49 +03:00
alesapin
98d38e041f Fix recreation of replicated table with fixed granularity 2019-08-12 16:30:29 +03:00
Nikolai Kochetov
43e5cbe35c Fix build/ 2019-08-12 14:06:28 +03:00
Nikolai Kochetov
18939a5776 Fix build/ 2019-08-12 13:59:45 +03:00
Nikolai Kochetov
631bbde420 Merged with master. 2019-08-12 13:19:13 +03:00
Alexey Milovidov
fbaf6b9a4b Parallel loading of data parts #6074 2019-08-11 23:02:51 +03:00
Alexey Milovidov
0b1a4420cb More simple 2019-08-11 22:30:39 +03:00
Alexey Milovidov
006a5e51b7 Merge branch 'master' into speed-up-parts-removal 2019-08-11 22:26:24 +03:00
Alexey Milovidov
1cd87078c2 Merge branch 'master' of github.com:yandex/ClickHouse 2019-08-11 22:24:53 +03:00
Alexey Milovidov
2f73b72007 Style 2019-08-11 22:24:42 +03:00
Alexey Milovidov
ed7db76c94 Speed-up parts removal #6372 2019-08-11 22:14:42 +03:00
Gleb Novikov
3b9e1f9bf7 Fixed getIdentifierName call in AlterCommand::parse 2019-08-11 13:39:17 +03:00
Gleb Novikov
381ea6cb6e Merge branch 'master' into table-constraints 2019-08-11 12:38:34 +03:00
alexey-milovidov
25e97b0b87
Merge pull request #6400 from abyss7/issue-5286 
Add more virtual columns to Kafka engine
 2019-08-11 05:17:27 +03:00
alexey-milovidov
8520288044
Merge pull request #6416 from 4ertus2/some 
Refactoring: move collectUsedColumns() to SyntaxAnalyzer
 2019-08-11 05:16:22 +03:00
Ivan Lezhankin
fd27ac9e9e Merge remote-tracking branch 'upstream/master' into issue-5286 2019-08-11 00:11:44 +03:00
alexey-milovidov
838c5e535f
Merge pull request #6433 from yandex/prevent-stack-overflow-in-parser 
Fixed possible stack overflow in parser
 2019-08-10 23:58:54 +03:00
Nikita Vasilev
75e381bde4 Merge remote-tracking branch 'upstream/master' into nikvas0/index_mutate 2019-08-10 23:07:50 +03:00
Alexey Milovidov
afef5c6c70 Added stack protection; added a test 2019-08-10 20:51:47 +03:00
kreuzerkrieg
112fc71276 adding -Wshadow for GCC 2019-08-09 23:58:16 +03:00
Nikolai Kochetov
2ae3db7920 Merged with master. 2019-08-09 18:32:44 +03:00
chertus
e06c994b0e refactoring: move collectUsedColumns from ExpressionAnalyzer to SyntaxAnalyzer 2019-08-09 17:50:04 +03:00
Nikolai Kochetov
a1023bebff Fix tests. 2019-08-09 16:37:42 +03:00
alesapin
2803fcc2ba Make atomic settings 2019-08-09 16:07:19 +03:00
alexey-milovidov
28e87cc430
Merge pull request #6409 from yandex/get-identifier-name-fixed-unpleasant-code 
Fixed unsafe code around "getIdentifier" function.
 2019-08-09 02:31:49 +03:00
Alexey Milovidov
2ba185b4aa Addition to prev. revision 2019-08-08 23:10:58 +03:00
Alexey Milovidov
a6e4b34ab4 Fixed unpleasant code #6401 2019-08-08 23:02:30 +03:00
Alexander Tokmakov
ae6efb23b4 Merge branch 'master' into alter_table_drop_detached_part 2019-08-08 22:31:31 +03:00
alesapin
a03fcd9f12 Make settings values atomic to avoid race conditions 2019-08-08 22:29:56 +03:00
Alexey Milovidov
e7c7694377 Removed virtual columns from system.columns for backward compatibility 2019-08-08 18:48:32 +03:00
alesapin
e0d18c0fe8 Merge branch 'master' into merge_tree_settings_alter 2019-08-08 18:16:22 +03:00
Ivan Lezhankin
e90bf74ce8 Merge branch 'master' into issue-5286 2019-08-08 12:57:00 +03:00
alexey-milovidov
9c2165b800
Merge pull request #6388 from yandex/transform-query-substring-test 
Added a test just in case
 2019-08-08 03:11:37 +03:00
alexey-milovidov
0d3b383c98
Merge pull request #6384 from CurtizJ/fix-optimize-unused-shards 
Fix segfault with enabled 'optimize_skip_unused_shards' and missing sharding key.
 2019-08-08 03:04:23 +03:00
alexey-milovidov
355b1e5594
Merge pull request #6352 from yandex/no_space_left_on_device_message 
Print extra info in exception message for "no space left on device"
 2019-08-07 22:28:38 +03:00
Alexey Milovidov
688a80dd80 Added a test just in case #6381 2019-08-07 21:52:53 +03:00
Ivan
1bf6e034e8
Fix infinite loop when reading Kafka messages (#6354) 
* Do not pause/resume consumer at all
* Fix kafka tests
* Try to ensure the subscription
* Set timeout for kafka tests and return 'while True'
* Update cluster.py
* When doing a raw select from kafka, ignore client errors.
  They may rise due to 'Local: Timed out' while subscribing.
 2019-08-07 19:10:14 +03:00
CurtizJ
7e22f78ce4 fix segfault with enabled 'optimize_skip_unused_shards' and missing sharding key 2019-08-07 18:47:25 +03:00
alesapin
7409f1a3de More comments 2019-08-07 18:33:10 +03:00
alesapin
13e4581317 More general 2019-08-07 18:21:45 +03:00
Alexander Tokmakov
5cf183cbe3 fixes after review 2019-08-07 15:55:27 +03:00
Alexander Tokmakov
aefc664819 refactor throwFromErrno 2019-08-06 21:54:06 +03:00
Nikita Vasilev
90ce4608fb Merge remote-tracking branch 'upstream/master' into nikvas0/index_mutate 2019-08-06 21:07:13 +03:00
alesapin
bca40a8608 Better name 2019-08-06 19:34:27 +03:00
alesapin
e62101b8e8 Better comment 2019-08-06 19:29:31 +03:00
Alexander Tokmakov
c3039196da fixes 2019-08-06 17:51:27 +03:00
Ivan Lezhankin
b55da1888a Add "_timestamp" virtual column 2019-08-06 17:18:37 +03:00
alesapin
ca29343f54 Uniq settings 2019-08-06 17:09:36 +03:00
Ivan Lezhankin
4bc2b32c3e Merge branch 'master' into issue-5286 2019-08-06 16:25:51 +03:00
alesapin
303c4e5a58 Make index_granularity_bytes immutable 2019-08-06 16:06:09 +03:00
alesapin
84fd4906ca Changes for engines 2019-08-06 16:04:29 +03:00
alesapin
52b9658bcf Merge with master 2019-08-06 15:55:12 +03:00
alesapin
e12cb8da6d Add some changes 2019-08-06 15:52:08 +03:00
Alexander Tokmakov
c96b10be9f style fixes 2019-08-06 15:51:10 +03:00
Alexander Tokmakov
75d10f4160 print extra info in exception message 2019-08-05 22:41:20 +03:00
Nikita Vasilev
7b8c0f1750 experiment 2019-08-05 21:06:05 +03:00
Nikolai Kochetov
e361d336bb
Merge pull request #6239 from yandex/processors-and-output-formats 
Processors and output formats
 2019-08-05 19:45:17 +03:00
Alexey Milovidov
95532f2d31 Fixed minor discrepancies 2019-08-05 19:04:47 +03:00
chertus
ef7d19e143 better JOIN exception messages #5565 2019-08-05 17:03:14 +03:00
CurtizJ
cfe32ad89b Merge remote-tracking branch 'upstream/master' into order-by-efficient 2019-08-04 21:43:00 +03:00
Nikita Vasilev
4c53b90e66 fixed MergedColumnOnlyOutputStream 2019-08-04 21:28:46 +03:00
Nikolai Kochetov
b0b7ed791d Merge branch 'master' into processors-and-output-formats 2019-08-04 19:47:26 +03:00
Nikita Vasilev
4a39538625 Merge remote-tracking branch 'upstream/master' into nikvas0/index_mutate 2019-08-04 16:58:21 +03:00
alexey-milovidov
261abd6c41
Merge pull request #6319 from nikvas0/nikvas0/fix_set_index 
Add Comments for set index functions
 2019-08-04 16:39:57 +03:00
Nikita Vasilev
5d47a858c5 add comments 2019-08-04 16:03:38 +03:00
Nikolai Kochetov
599f3ddf6e Merged with master. 2019-08-04 15:35:21 +03:00
alexey-milovidov
291dc0f66e
Merge pull request #6316 from yandex/alias-in-materialized-view-simplification 
Simplification of #3796
 2019-08-04 06:29:02 +03:00
Alexey Milovidov
8b8c59d71b Simplification of #3796 2019-08-04 03:29:32 +03:00
Alexey Milovidov
a3a15d3a95 Addition to prev. revision 2019-08-04 03:28:12 +03:00
Alexey Milovidov
224bc4df97 Minor modifications + a comment #3796 2019-08-04 03:12:17 +03:00
alexey-milovidov
b045e85469
Merge pull request #3796 from amosbird/hang 
Fix materialized view with column defaults.
 2019-08-04 03:06:40 +03:00
alexey-milovidov
e61f647492
Merge pull request #6282 from nikvas0/nikvas0/fix_set_index 
fix operators in set index
 2019-08-04 02:52:57 +03:00
alexey-milovidov
2b6a28f617
Merge pull request #6279 from yandex/remove-cat-boost-pool 
Removed table function "catBoostPool" and storage "CatBoostPool"
 2019-08-03 04:59:55 +03:00
alexey-milovidov
d3e4249420
Merge branch 'master' into ttldropparts 2019-08-03 02:17:29 +03:00
Alexey Milovidov
21cb7de777 More validation of part_name 2019-08-02 23:21:31 +03:00
alexey-milovidov
f8980e691e
Merge pull request #6274 from CurtizJ/ttl-old-parts 
TTL improvements.
 2019-08-02 22:51:28 +03:00
Nikita Vasilev
bfa9a2c86f fixed index condition 2019-08-02 22:21:55 +03:00
Alexey Milovidov
a5105f85cf Removed table function "catBoostPool" and storage "CatBoostPool" 2019-08-02 21:52:43 +03:00
CurtizJ
e06a53a5d9 fix ranges selection at reading in order 2019-08-02 20:34:29 +03:00
Nikolai Kochetov
1f6a16b03a Remove ValuesRowInputStream. 2019-08-02 20:16:58 +03:00
CurtizJ
a6e85a331a more optimal ranges selection at reading in order 2019-08-02 19:37:43 +03:00
CurtizJ
5f7ebb18ed more optimal ranges selection at reading in order 2019-08-02 19:16:18 +03:00
Nikolai Kochetov
dd90932222 Update FormatFactory. 2019-08-02 18:06:31 +03:00
Nikita Vasilev
7aacbbdc5a fix bug 2019-08-01 22:18:36 +03:00
CurtizJ
d169f42b36 fix build 2019-08-01 22:07:31 +03:00
CurtizJ
b8dff6ebb1 more optimal ranges selection at reading in order 2019-08-01 22:03:39 +03:00
CurtizJ
82f304f81e add query 'SYSTEM STOP TTL MERGES' 2019-08-01 18:36:12 +03:00
CurtizJ
c30bdecf6d add missing comments 2019-08-01 15:00:35 +03:00
alexey-milovidov
e034dab1be
Merge pull request #6255 from yandex/storage-values-simplification 
Simplified code with parsing table declaration for table functions.
 2019-08-01 14:58:28 +03:00
CurtizJ
f224269d41 filter by ttl parts created before 'alter ... modify ttl' query with 'optimize ... final' query 2019-08-01 14:10:42 +03:00
Igr Mineev
0f1e8404dc Merge branch 'master' of github.com:yandex/ClickHouse into feature_multiple_disks 2019-08-01 13:42:59 +03:00
Igr Mineev
fc79ed86ef Ready for review 2019-08-01 13:29:14 +03:00
Alexey Milovidov
12f6b75284 Fixed error 2019-08-01 05:34:58 +03:00
Alexey Milovidov
49b6749280 Merge branch 'master' into fix-malicious-replica 2019-08-01 05:11:45 +03:00
Alexey Milovidov
26bb14da4e Simplified table function "values" 2019-08-01 05:03:15 +03:00
alexey-milovidov
a8793fbef3
Merge pull request #6209 from dimarub2000/values_list 
VALUES list
 2019-08-01 04:36:04 +03:00
Alexey Milovidov
f3921ce3e0 Changed boost::filesystem to std::filesystem 2019-08-01 01:37:41 +03:00
Alexey Milovidov
bc9d620155 Fixed the case when malicious ClickHouse replica can force clickhouse-server to write to arbitrary path 2019-07-31 22:31:04 +03:00
Alexander Tokmakov
f0836553d4 drop detached partition 2019-07-31 18:27:21 +03:00
alexey-milovidov
ac5d2a225d
Merge pull request #6226 from yandex/aku/lock-tinylog 
Lock the TinyLog storage when reading.
 2019-07-31 17:40:55 +03:00
Dmitry Rubashkin
a449a00e58 Comments are now in right places 2019-07-31 17:12:05 +03:00
Dmitry Rubashkin
f91c64bd28 parser changed, test modified, comments added 2019-07-31 17:06:22 +03:00
Alexander Kuzmenkov
3ff143c60f Lock the TinyLog storage when reading. 
Unlike StripeLog, we only have one set of files per column, so we can't
read concurrently with writing. We didn't use any locking before, and
that lead to user-visible error messages and tsan failures.
 2019-07-31 13:59:12 +03:00
alexey-milovidov
30c35b1cbf
Update StorageValues.cpp 2019-07-31 01:06:48 +03:00
Alexander Tokmakov
c6717e0d3f refactor attachPartition 2019-07-30 22:11:15 +03:00
Alexander Tokmakov
2f33df1b2e rename all parts before attaching 2019-07-30 20:24:40 +03:00
Igr Mineev
7f7b47fc0a Add check of RW access to paths on start. Add multiple disks tests. 2019-07-30 19:15:57 +03:00
Igr Mineev
31c36efa25 Merge branch 'master' of github.com:yandex/ClickHouse into feature_multiple_disks 2019-07-30 19:13:58 +03:00
Dmitry Rubashkin
7945d05565 Minor style fixes 2019-07-30 15:15:02 +03:00
Amos Bird
6db1c02bfd Fix materialized view with column defaults. 
https://github.com/yandex/ClickHouse/issues/448
https://github.com/yandex/ClickHouse/issues/3484
https://github.com/yandex/ClickHouse/issues/3450
https://github.com/yandex/ClickHouse/issues/2878
https://github.com/yandex/ClickHouse/issues/2285
 2019-07-30 10:49:54 +08:00
Alexey Milovidov
b5b80fb342 Merge branch 'master' into thread_local_rng 2019-07-30 03:19:48 +03:00
Dmitry Rubashkin
45aebda677 Fixes and test 2019-07-29 19:20:17 +03:00
Dmitry Rubashkin
e9784573ea Values list implementation 2019-07-29 17:02:34 +03:00
Alexander Tokmakov
3c15b87003 Merge branch 'master' into alter_table_drop_detached_part 2019-07-29 14:29:23 +03:00
alesapin
86831fe500 Add ability to create immutable settings 2019-07-29 14:03:50 +03:00
Alexander Tokmakov
0fc47fbbe4 fixes 2019-07-29 13:27:37 +03:00
alesapin
d9a2ac123a Fix small typo and merge 2019-07-29 12:17:37 +03:00
alexey-milovidov
129e88ee26
Merge pull request #6189 from CurtizJ/order-by-efficient 
Fix reading in order of sorting key and refactoring.
 2019-07-28 19:43:49 +03:00
Alexey Milovidov
856cc1b9c5 Added thread_local_rng 2019-07-28 18:30:38 +03:00
Alexey Milovidov
c0e0166991 Updated contributors 2019-07-28 18:11:47 +03:00
Nikita Vasilev
39b40f8e42 fix replicated indices mutations 2019-07-28 17:55:51 +03:00
Nikita Vasilev
4c5003b3b9 const & 2019-07-28 14:45:50 +03:00
Nikita Vasilev
908623c029 style 2019-07-28 14:32:03 +03:00
Nikita Vasilev
63fe714420 fix 2019-07-28 14:10:35 +03:00
Sergi Vladykin
c5a42a6948 TTL: Only drop altogether the expired parts and not partially prune them. 
Though in regular merges eviction of expired values still must happen.
 2019-07-28 13:30:46 +03:00
CurtizJ
b4991b38bf Merge remote-tracking branch 'upstream/master' into order-by-efficient 2019-07-28 04:26:43 +03:00
CurtizJ
d69d68f065 rename setting 'optimize_pk_order' and some functions 2019-07-28 04:16:56 +03:00
CurtizJ
95a6b85267 fix reading in order of sorting_key 2019-07-28 03:41:26 +03:00
alexey-milovidov
12a15316fd
Merge pull request #6181 from 4ertus2/joins 
Fix crop column names in GLOBAL JOIN ON
 2019-07-28 00:31:29 +03:00
Nikita Vasilev
1118ce04b9 fixed 2019-07-27 18:36:40 +03:00
CurtizJ
08d5ebb54d Merge remote-tracking branch 'upstream/master' into order-by-efficient 2019-07-27 10:38:10 +03:00
Nikita Vasilev
7efb1bcb12 Merge remote-tracking branch 'upstream/master' into nikvas0/index_mutate 2019-07-27 10:30:43 +03:00
CurtizJ
12dcfe1f25 reduce number of read rows while reading in reverse order 2019-07-27 03:33:47 +03:00
CurtizJ
b1d981ec3a better pipeline while reading in pk_order 2019-07-27 01:18:27 +03:00
chertus
9f9ba3a06f restore cropped names in JOIN ON section for distributed queries 2019-07-26 20:43:42 +03:00
alexey-milovidov
71cef7beac
Merge pull request #6156 from dimarub2000/master 
ISSUE-6136: Fix DB::Exception throwed by bitmapContains
 2019-07-25 23:00:42 +03:00
Igr Mineev
7a31feeec0 Add tests for multiple disks. Fix Alter query. 2019-07-25 21:21:01 +03:00
Alexander Tokmakov
3ba26aba43 tests 2019-07-25 19:28:08 +03:00
Alexander Tokmakov
e4212bfe59 add full part name to detached_parts 2019-07-25 19:26:36 +03:00
dimarub2000
f53f22fd17 ISSUE-6136: Fix DB::Exception throwed by bitmapContains 2019-07-25 18:56:20 +03:00
Igr Mineev
e7e2627201 Checking unique names for volumes. 2019-07-25 14:42:48 +03:00
Alexander Tokmakov
1805ab5736 attach 2019-07-25 13:46:07 +03:00
CurtizJ
f5b93eb991 fix order by optimization 2019-07-25 13:45:01 +03:00
Igr Mineev
549c62a18a Fix build 2019-07-25 12:40:20 +03:00
alexey-milovidov
7219e167d2
Merge pull request #6026 from bopohaa/fix-kafka-unclean-stream 
Clear Kafka's buffer if an invalid message is found.
 2019-07-25 04:30:37 +03:00
alexey-milovidov
56131a7fe7
Merge pull request #6080 from abyss7/issue-6071 
Check background_task_handle before use
 2019-07-25 04:16:47 +03:00
Alexey Milovidov
e52653aa06 Miscellaneous 2019-07-25 04:08:33 +03:00
alesapin
f7e0d17490 Fix some bugs 2019-07-24 18:22:16 +03:00
CurtizJ
3d706ec20e support 'order by' optimiation with simple monotonic functions 2019-07-24 17:23:57 +03:00
alesapin
8a00ce5ff1 Intermediate step 2019-07-24 15:56:39 +03:00
Alexander Tokmakov
6e4aabbb1a draft for StorageMergeTree 2019-07-23 23:18:18 +03:00
Alexander Tokmakov
ad787938f5 better detached part name parsing 2019-07-23 22:43:33 +03:00
Alexander Tokmakov
3c2172b750 parse and interpret query 2019-07-23 22:25:10 +03:00
Ivan Lezhankin
e8ef13edfa Check background_task_handle 2019-07-23 20:34:57 +03:00
alesapin
6e458a6a68 Fix secondary indices write with adaptive granularity 2019-07-23 18:27:36 +03:00
Igr
3e017ec69c
Merge branch 'master' into feature_multiple_disks 2019-07-23 16:38:20 +03:00
Igr Mineev
e967c23adb Add Space interface for reservation. Add move to volume command 2019-07-23 16:34:17 +03:00
Igr Mineev
2925657f5e Remove non-alter move command. 2019-07-23 12:38:26 +03:00
alexey-milovidov
cd6c15b79f
Merge pull request #6057 from dimarub2000/master 
CREATE TABLE AS table_function()
 2019-07-23 02:50:08 +03:00
Ivan Lezhankin
969cb2f826 Append _partition virtual column 2019-07-22 14:32:11 +03:00
Ivan Lezhankin
762f1d3a85 Merge remote-tracking branch 'upstream/master' into issue-5846 2019-07-22 13:19:37 +03:00
alexey-milovidov
3da461fea5
Merge pull request #6038 from yandex/Immowelt-ThreeDots 
Merging COLUMNS matcher
 2019-07-22 01:27:38 +03:00
CurtizJ
e559c8f949 fix build 2019-07-21 21:17:28 +03:00
alexey-milovidov
9f9dd040dd
Update StorageMergeTree.cpp 2019-07-21 17:14:55 +03:00
Alexey Milovidov
47058e8e11 Fixed error 2019-07-21 05:13:42 +03:00
Mikhail f. Shiryaev
15fd980d0b Add description "unable to select parts" and logging 2019-07-21 00:39:40 +02:00
alexey-milovidov
8008ce6e9e Update StorageReplicatedMergeTree.cpp 2019-07-20 10:44:05 +02:00
Mikhail f. Shiryaev
da50663e2c Pass a proper message to exception 2019-07-20 10:44:05 +02:00
Ivan Lezhankin
f9945494d9 Always resume consumer before subscription. 
Also add more logs to see the difference between rd_kafka_assignment() vs rd_kafka_subscription()
 2019-07-19 18:01:34 +03:00
CurtizJ
1bec5a8241 refactor MergeTree select streams 2019-07-19 17:56:00 +03:00
CurtizJ
2797c16930 fix prewhere at fetching columns 2019-07-19 13:14:27 +03:00
CurtizJ
b9dc472071 Merge remote-tracking branch 'upstream/master' into order-by-efficient 2019-07-19 01:09:59 +03:00
dimarub2000
20a846d753 Merge branch 'master' of github.com:yandex/ClickHouse 2019-07-18 21:52:18 +03:00
CurtizJ
12b3560def build fixes 2019-07-18 21:34:15 +03:00
Dmitry Rubashkin
7382cb41fa CREATE TABLE AS table_function() 2019-07-18 21:29:49 +03:00
Igr Mineev
52bca488dc Add alter move part command 2019-07-18 18:19:03 +03:00
CurtizJ
a3d25790bd basic implementation of reading in pk order and 'order by' optimization 2019-07-18 17:41:11 +03:00
Amos Bird
71233e11a9 minor updates. 2019-07-17 14:17:34 +08:00
Nik
4a30eba32f Fix style check 2019-07-16 22:34:47 +04:00
Amos Bird
9fa955403b Optimize count() 
Choose the smallest column to count if possible.
 2019-07-17 02:29:17 +08:00
Igr Mineev
770b74ac17 Add names for volumes 2019-07-16 21:20:47 +03:00
alexey-milovidov
45b7588ab1
Merge pull request #6025 from dimarub2000/master 
Minor fixes for FullTextIndex string functions
 2019-07-16 19:30:32 +03:00
Nik
922c3eb22e Clear Kafka's buffer if an invalid message is found. 2019-07-16 19:27:42 +04:00
Igr Mineev
ad497fbaa1 Fix bug with duplication of parts on restart 2019-07-16 16:06:23 +03:00
Dmitry Rubashkin
dcd8696466 Minor fixes 2019-07-16 14:40:11 +03:00
Igr Mineev
90fab48cd7 Stylefixes 2019-07-16 14:07:04 +03:00
Igr Mineev
21e0bec3d0 Merge remote-tracking branch 'upstream/master' into feature_multiple_disks 2019-07-16 13:45:07 +03:00
alexey-milovidov
ceffbf39d6
Merge pull request #5965 from dimarub2000/master 
Primary key, MergeTreeIndexFullText and MergeTreeIndexSet support for string functions
 2019-07-16 03:36:42 +03:00
Alexey Milovidov
27b9f79cba Fixed error after refactoring 2019-07-15 23:26:55 +03:00
Gleb Novikov
c1d91222d5 Ranamed setPrimaryKeyIndicesAndColumns to setProperties 2019-07-13 13:42:52 +03:00
alexey-milovidov
a93c76837e
Merge pull request #5953 from abyss7/fix-filter-table 
Implement getDatabaseName() and rename() for all storages
 2019-07-13 00:51:39 +03:00
dimarub2000
4005987fc4 multiSearchAny fixed, tests added, minor syle changes 2019-07-12 14:35:17 +03:00
dimarub2000
e5d4f11c73 Deleted some extra implementations, fixed style. multiSearchAny still not working. 2019-07-11 16:44:44 +03:00
dimarub2000
1480b8e62c Actually set index already woks for everything. Here are some tests. 2019-07-11 15:31:24 +03:00
dimarub2000
88778b0f5b minor style changes 2019-07-10 18:12:02 +03:00
dimarub2000
f5ba5e3ca9 Merge branch 'master' of github.com:dimarub2000/ClickHouse 2019-07-10 18:08:10 +03:00
dimarub2000
c9a5b3c9ab primary key and MergeTreeIndexFullText support for string functions 2019-07-10 17:53:57 +03:00
Vitaly Baranov
3a74f326a8 Fix unused variable in checkDataPart.cpp 2019-07-10 15:13:10 +03:00
Ivan Lezhankin
befb3ce15b Merge branch 'master' into fix-filter-table 2019-07-10 13:27:26 +03:00
Ivan Lezhankin
8a600c39af Fix build for gtests 2019-07-09 21:53:16 +03:00
Ivan Lezhankin
9f01fa7aaa Implement getDatabaseName() and rename() for all storages 2019-07-09 18:40:21 +03:00
Vitaliy Zakaznikov
a80af666ad * Updates that incorporate comments from the review 2019-07-09 08:41:55 -04:00
alesapin
d4c44320ea Merge branch 'fix_fetch_of_existing_part' of github.com:yandex/ClickHouse into fix_fetch_of_existing_part 2019-07-09 12:04:00 +03:00
alesapin
9a17a461ea Review fixes and better tests 2019-07-09 12:02:52 +03:00
alesapin
6a3b543e10 Merge branch 'master' of github.com:yandex/ClickHouse into fix_fetch_of_existing_part 2019-07-09 11:21:44 +03:00
alexey-milovidov
a8d8eb6b28
Merge pull request #5921 from yandex/pvs-studio-fixes-4 
A few fixes for PVS-Studio
 2019-07-09 01:10:05 +03:00
alexey-milovidov
c491cddb78
Update CheckResults.h 2019-07-08 22:56:48 +03:00
Alexey Milovidov
886e8ea0d4 Merge branch 'master' into pvs-studio-fixes-4 2019-07-08 19:58:42 +03:00
Alexey Milovidov
3f92ecf334 Merge branch 'master' into add-noreturn 2019-07-08 16:13:56 +03:00
Alexey Milovidov
f40b70884f Two more fixes for PVS-Studio 2019-07-08 05:14:32 +03:00
Alexey Milovidov
ac20c515ab Better code in unit tests 2019-07-08 04:58:31 +03:00
Alexey Milovidov
4752dae9bb Allowed unresolvable addresses in cluster configuration #5714 2019-07-08 04:43:41 +03:00
Vitaliy Zakaznikov
24a3726235 Merge branch 'master' of https://github.com/vzakaznikov/ClickHouse into liveview 2019-07-07 20:03:14 -04:00
Vitaliy Zakaznikov
259a95a3da * Updates to fix issues after the merge 2019-07-07 19:57:58 -04:00
Alexey Milovidov
19059ef650 One more fix for PVS-Studio 2019-07-08 02:29:54 +03:00
alexey-milovidov
8d4358f19c
Merge pull request #5919 from dimarub2000/master 
startsWith now uses PK index
 2019-07-08 02:06:05 +03:00
alexey-milovidov
0480706ff4
Update KeyCondition.cpp 2019-07-08 00:28:03 +03:00
dimarub2000
0b756c48a8 also style changes 2019-07-07 18:56:15 +03:00
dimarub2000
95118a5fa3 also style changes 2019-07-07 18:54:13 +03:00
dimarub2000
94523c00cd minor style changes 2019-07-07 18:52:20 +03:00
dimarub2000
2693ce27ff startsWith now uses PK index 2019-07-07 18:48:34 +03:00
Alexey Milovidov
2e6280de07 Fixed #5797 2019-07-07 03:20:38 +03:00
alexey-milovidov
a1cfdf2a60
Merge pull request #5855 from abyss7/no-undefined 
Use --no-undefined linker option for split build
 2019-07-07 01:47:11 +03:00
Gleb Novikov
3757aa9d02 More style fix 2019-07-06 23:30:48 +03:00
alexey-milovidov
eb2ffccaf3
Merge pull request #5874 from nikitamikhaylov/master 
Add data checksums to system.parts_columns table. #5151
 2019-07-05 23:58:58 +03:00
Nikita Mikhaylov
afdd45fd85 checksum added to system_parts 2019-07-05 18:32:55 +03:00
CurtizJ
a49112a14e Merge branch 'master' of https://github.com/yandex/ClickHouse into order-by-efficient 2019-07-05 16:41:48 +03:00
alexey-milovidov
2469ec1af3
Merge pull request #5857 from CurtizJ/dns-cache 
Implement dns cache with asynchronous update.
 2019-07-05 15:56:26 +03:00
Nikita Mikhaylov
1ffa488be4 lowercase added~ 2019-07-05 14:45:47 +03:00
CurtizJ
410b62f7fa Merge branch 'clickhouse-4013' of https://github.com/anrodigina/ClickHouse into order-by-efficient 2019-07-05 13:48:04 +03:00
Nikita Mikhaylov
f8dde20dcb easier code 2019-07-05 13:13:44 +03:00
Nikita Mikhaylov
0e25190433 checksums now output in the same way + tests are better 2019-07-05 12:00:19 +03:00
Gleb Novikov
430400c3c5 Style fix 2019-07-05 10:16:34 +03:00
Alexey Milovidov
2c6dd99644 Updated contributors 2019-07-05 04:13:03 +03:00
Gleb Novikov
71c2ca0fe9 Merge branch 'master' into table-constraints 2019-07-04 22:40:00 +03:00
Nikita Mikhaylov
fc75c8f62e done 2019-07-04 21:27:14 +03:00
Ivan Lezhankin
3b995bdb02 Add missing dependecies on sight to enable --no-undefined option 2019-07-04 17:05:55 +03:00
alesapin
65437d2289 Fix final mark and tests 2019-07-04 13:21:14 +03:00
alesapin
a0496da05f Merge branch 'master' of github.com:yandex/ClickHouse into fix_fetch_of_existing_part 2019-07-04 12:46:54 +03:00
alesapin
18544e8f64 Missed file and style fix 2019-07-04 09:04:31 +03:00
alesapin
477a7450fb Add test for data corruption 2019-07-03 23:51:13 +03:00
CurtizJ
187812a00e cleanup 2019-07-03 21:34:37 +03:00
CurtizJ
80e96995ae Merge branch 'master' of https://github.com/yandex/ClickHouse into dns-cache 2019-07-03 21:27:43 +03:00
Ivan
fdae12a51c
Keep on reading of new Kafka messages after stalling (#5852) 2019-07-03 19:51:11 +03:00
CurtizJ
35ad1a3b6b implement dns cache with asynchronous update 2019-07-03 19:26:22 +03:00
alesapin
3925a3bd13 Generalize check query 2019-07-03 16:17:19 +03:00
alesapin
6b0498cd93 First version of check cmd 2019-07-03 11:49:52 +03:00
alexey-milovidov
50c22ef71a
Merge pull request #5628 from yandex/index_granularity_by_default 
Enable adaptive index granularity by default
 2019-07-03 02:15:33 +03:00
alexey-milovidov
d81ae49f2c
Merge pull request #5755 from 4ertus2/bugs 
Fix wrong ColumnConst.isColumnNullable()
 2019-07-03 02:06:07 +03:00
alexey-milovidov
de92b9854e
Merge pull request #5838 from 4ertus2/joins 
Joins refactoring: extract joinDispatch into own file
 2019-07-03 01:55:45 +03:00
chertus
207145025c Join.h refactoring: extract joinDispatch into own file 2019-07-02 17:38:31 +03:00
alexey-milovidov
1bda6994ad
Merge pull request #5832 from yandex/fix_low_cardinality_check 
Fix low cardinality check
 2019-07-02 17:06:06 +03:00
alesapin
cbb0d640f4 Add comments 2019-07-02 14:34:16 +03:00
alesapin
f68b5216a8 Fix prefix reading and skip check for low cardinality dictionary 2019-07-02 13:55:47 +03:00
Vitaliy Zakaznikov
b5120931d5 Merge branch 'master' of https://github.com/yandex/ClickHouse into liveview 2019-07-01 18:12:31 -04:00
Vitaliy Zakaznikov
a363189dfc Merge branch 'master' of https://github.com/vzakaznikov/ClickHouse into liveview 2019-07-01 18:05:14 -04:00
Nikita Lapkov
9641d058d0 Merge remote-tracking branch 'upstream/master' into update_libunwind 2019-07-01 21:11:26 +00:00
alexey-milovidov
c43dfce041
Merge pull request #5382 from abyss7/issue-5286 
Add virtual columns to Kafka Engine tables
 2019-07-01 21:30:09 +03:00
chertus
5df4ad0f28 Merge branch 'master' into bugs 2019-07-01 14:49:01 +03:00
Alexey Milovidov
b86aca37ea Merge branch 'h3-integration' of https://github.com/BHYCHIK/ClickHouse into BHYCHIK-h3-integration 2019-06-30 19:15:33 +03:00
alexey-milovidov
feafcb21bd
Merge branch 'master' into h3-integration 2019-06-30 16:19:11 +03:00
Gleb Novikov
ea4d42c3ac Merged DROP_(COLUMN|INDEX|CONSTRAINT) AST parsing into one block 2019-06-30 12:09:58 +02:00
Gleb Novikov
a146b7383e Merge branch 'master' into table-constraints 2019-06-30 11:32:02 +02:00
Alexey Milovidov
725bcd9d02 Merge branch 'master' into sanych73-prepared_statements 2019-06-30 02:59:37 +03:00
Alexey Milovidov
88fc72f0b9 Merge branch 'feature/bloom_filter' of https://github.com/zhang2014/ClickHouse into zhang2014-feature/bloom_filter 2019-06-29 20:44:11 +03:00
Alexey Milovidov
6566bb7088 Updated tests 2019-06-29 19:18:59 +03:00
Nikita Lapkov
2a131185b0 Merge remote-tracking branch 'upstream/master' into update_libunwind 2019-06-28 18:20:23 +00:00
Nikita Lapkov
f8d2b5effd introduce Backtrace class 2019-06-28 18:06:38 +00:00
alexey-milovidov
18659e367e
Merge pull request #5758 from zlobober/bool_masks 
Extend KeyCondition interface so that it returns BoolMask.
 2019-06-28 14:51:52 +03:00
alexey-milovidov
6e77fc4abe
Merge pull request #5775 from yandex/lfalloc2mimalloc 
Use mimalloc instead of lfallocator
 2019-06-28 14:48:18 +03:00
chertus
f19dee706a move IColumn.isColumnConst() outside of interface 2019-06-27 22:28:52 +03:00
chertus
db7c8748e9 remove IColumn.isColumnNullable() 2019-06-27 21:50:20 +03:00
alexey-milovidov
246f34d8f6
Merge pull request #5768 from abyss7/better-log 
Print table name in message about missing column
 2019-06-27 18:49:40 +03:00
Danila Kutenin
e67431e455 Use mimalloc instead of lfallocator 2019-06-27 18:13:19 +03:00
Maxim Akhmedov
2cacc3cfd2 CHYT-142: extend KeyCondition interface so that it returns BoolMask. 2019-06-27 16:31:33 +03:00
Alexey Milovidov
8f3ff6c77a Removed inconsistent whitespaces 2019-06-27 16:20:33 +03:00
Ivan Lezhankin
9d3eef80b0 Print table name in message about missing column. 2019-06-27 13:56:04 +03:00
chertus
65c0d23efa better casts to ColumnNullable 2019-06-26 20:20:33 +03:00
alesapin
b7f173ad2c Execute some distributed DDL queries on leader 2019-06-26 17:52:20 +03:00
Nikita Vasilev
7079c91a0e Merge remote-tracking branch 'upstream/master' into nikvas0/index_mutate 2019-06-25 16:34:11 +03:00
Nikita Vasilev
9873b04611 StringRef -> String (race cond) 2019-06-25 16:10:09 +03:00
Ivan Remen
df4bd3eec6 Merge remote-tracking branch 'main/master' into h3-integration 2019-06-25 15:43:33 +03:00
Ivan Remen
8ad592dd07 Fix?? 2019-06-25 14:27:39 +03:00
alesapin
4a8a70a079
Merge pull request #5720 from coraxster/fix-5377 
MergedColumnOnlyOutputStream. Skip empty blocks. Fix 5377
 2019-06-25 13:35:09 +03:00
dmitry kuzmin
c72e4dfe08 5337: clang compiler fix 2019-06-24 18:07:01 +03:00
Alexey Milovidov
8f77d898f3 Renamed functions for consistency #5704 2019-06-24 17:51:37 +03:00
alexey-milovidov
8e41d89126
Merge pull request #5704 from zhang2014/fix/ISSUES-5697 
ISSUES-5697 fix insert and select query with mysql style identifier
 2019-06-24 17:40:28 +03:00
Nikita Vasilev
7b7517ff85 Merge remote-tracking branch 'upstream/master' into nikvas0/index_mutate 2019-06-24 16:44:44 +03:00
Ivan Lezhankin
0917573493 Merge remote-tracking branch 'upstream/master' into issue-5286 2019-06-24 14:42:58 +03:00
proller
1ac09fa721
Split Common/config.h by libs (dbms) (#5715) 2019-06-24 14:17:15 +03:00
Vitaliy Zakaznikov
d87ed7f267 * Adding max_live_view_insert_blocks_before_refresh setting 
with default value of 64
* Updating writeIntoLiveView method to use max_live_view_insert_blocks_before_refresh
  from global context instead of hard coded number
* Adding squashing of the result blocks similar how it is done in materialized views
* Fixing bug in writeIntoLiveView that caused incoming block to be processed twice
  when maximum number of insert blocks was reached
 2019-06-23 09:51:29 -04:00
dmitry kuzmin
c988293e1e 5337 fix: MergedColumn. skip empty blocks 2019-06-23 07:30:29 +03:00
zhang2014
b9cb1feb4c some review fixes 2019-06-22 12:40:41 +08:00
chertus
29700fd5e9 Auto version update to [19.11.0] [54423] 2019-06-21 18:47:02 +03:00
alesapin
efc0f7f65e Remove unused method 2019-06-21 18:19:47 +03:00
Ivan Lezhankin
b75db2ef04 Fix dropping message to early when stalling 2019-06-21 17:29:10 +03:00
zhang2014
1786407621 ISSUES-5697 fix insert and select query with mysql style identifier 2019-06-21 13:51:27 +08:00
proller
f111dbd45f Do not require gperf on build (#5701) 
* Build fixes

* fix

* USE_GPERF

* wip

* wip

* wip

* test -j

* Simpler

* fix

* FunctionsURL.h -> URL/FunctionsURL.h

* clean

* clean

* Always use gperf-generated file

* Generator for tldLookup.generated.cpp

* clang-format
 2019-06-21 02:50:53 +03:00
alexey-milovidov
606b074a4b
Merge pull request #5659 from yandex/ignore-mutation-limits 
Ignore query execution limits and limits for max parts size for merge while executing mutations.
 2019-06-21 02:14:41 +03:00
alexey-milovidov
73df46be2b
Merge pull request #5698 from abyss7/issue-5615 
Lower the probability of hanging when shutting down Kafka storage
 2019-06-21 02:11:07 +03:00
alesapin
3f7892ef50 Fix typo 2019-06-20 22:21:17 +03:00
alesapin
80f27968ac Add test for interaction of tables with different granularity and different versions 2019-06-20 19:25:32 +03:00
Ivan Lezhankin
ec78ec8365 Merge branch 'master' into issue-5286 2019-06-20 16:08:22 +03:00
Ivan Lezhankin
61750d09d2 Commit offsets for SELECTing from Kafka table too 2019-06-20 15:34:25 +03:00
proller
3d8c8ee83c
Build fixes. Split config.h (#5686) 2019-06-20 12:12:49 +03:00
alesapin
4ae502eaa6 Fix bug with wrong granularity detection 2019-06-20 11:48:56 +03:00
zhang2014
8221dd2a1a fix build and test failure 2019-06-20 08:33:37 +08:00
Igr Mineev
23049ac9e8 Add mergetree part move in background. 2019-06-19 20:56:41 +03:00
zhang2014
374aac3501 fix build & chmod shell test 2019-06-20 00:32:20 +08:00
alesapin
dd37370aab Fix test and add one 2019-06-19 19:16:13 +03:00
Ivan Lezhankin
fdd3f07860 Don't do premature subscription to topics 2019-06-19 19:15:30 +03:00
zhang2014
166018e41e fix code style & rename minmax, set 2019-06-19 23:30:48 +08:00
zhang2014
a50aea09f1 fix float in bloom filter 2019-06-19 23:13:21 +08:00
zhang2014
d145295163 convert type with condition 2019-06-19 23:12:06 +08:00
zhang2014
6c8ff6dc31 add some test 2019-06-19 23:12:05 +08:00
zhang2014
f52b16e1e1 support bloom filter for any type 2019-06-19 23:12:05 +08:00
alesapin
fefce49c8f Mixed parts by setting 2019-06-19 17:46:06 +03:00
alesapin
dd2e4fd805 Bug fixes 2019-06-19 15:30:56 +03:00
alesapin
f0c273ee4c More correct version 2019-06-19 14:59:08 +03:00
alesapin
d1de7431e1 Compilable 2019-06-19 13:26:26 +03:00
alesapin
7e11c3c78b Merge branch 'master' into index_granularity_by_default 2019-06-19 13:08:12 +03:00
alesapin
b544b62e44 A log of bugs 2019-06-19 13:07:56 +03:00
Ivan Lezhankin
9fd048cdbd Allow to select virtual columns in materialized view 2019-06-18 19:32:37 +03:00
Ivan Lezhankin
436052c67b Merge branch 'master' into issue-5286 2019-06-18 16:03:29 +03:00
alesapin
4f98f875c3
Add ability to write final mark for *MergeTree engines family (#5624) 
Add the ability to write final mark to *MergeTree engines family.
 2019-06-18 15:54:27 +03:00
alesapin
0bfb7b18ce Fix directory check 2019-06-18 14:38:04 +03:00
alesapin
d2615863f3 Merge branch 'master' into index_granularity_by_default 2019-06-18 13:52:41 +03:00
CurtizJ
e6dd92f9e1 ignore max part size for merge setting while executing mutations 2019-06-17 22:41:48 +03:00
Vitaliy Zakaznikov
bdeb45e8c7 Merge branch 'master' of https://github.com/vzakaznikov/ClickHouse into liveview 2019-06-17 13:04:48 -04:00
proller
dae5087fcf Build and test fixes 2019-06-17 19:50:31 +03:00
Vitaliy Zakaznikov
51bf8a1baa Merge branch 'master' of https://github.com/vzakaznikov/ClickHouse into liveview 2019-06-17 12:42:31 -04:00
Vitaliy Zakaznikov
8df3e48a7b * Fixing bug in writeIntoLiveView method where mergeable blocks 
would always be reobtained after 64 inserts
 2019-06-17 12:39:01 -04:00
Ivan Lezhankin
d907d8e8ca Commit offsets for SELECTing from Kafka table too 2019-06-17 19:27:18 +03:00
alesapin
fb22200890 Fix name hidding and stupid bug 2019-06-17 18:35:53 +03:00
alesapin
9e7d23b22e Style fix 2019-06-17 16:29:10 +03:00
alesapin
fd3abbe93d
Merge pull request #4935 from zhang2014/feature/support_system_replicas 
Support system replicas queries for distributed
 2019-06-17 15:30:30 +03:00
alesapin
e45d727e9d
Merge pull request #4558 from podshumok/distributred-timeout 
Distributed and remote timeouts
 2019-06-17 13:58:17 +03:00
alesapin
3a4dcfbacd Fix inconsistency in zookeeper metadata and disable adaptive granularity for old format 2019-06-17 13:34:25 +03:00
alesapin
e73cdbae90 Fix name hidding 2019-06-17 12:22:44 +03:00
alesapin
02af85411c Merge branch 'master' into index_granularity_by_default 2019-06-17 12:02:03 +03:00
alexey-milovidov
5fd319d0e9
Merge pull request #5648 from yandex/remove-number-of-stat-calls 
Reduce number of "stat" syscalls for MergeTree data parts
 2019-06-17 09:30:29 +03:00
Alexey Milovidov
62a3d00772 Added comment 2019-06-16 23:50:06 +03:00
Alexey Milovidov
ee5dcd50a0 Lowered CPU overhead for small data parts 2019-06-16 23:42:03 +03:00
Alexey Milovidov
14be0ca281 Reduce number of "stat" syscalls for MergeTree data parts 2019-06-16 23:13:54 +03:00
Alexey Milovidov
49c4f2ffed Reduce number of "stat" syscalls for MergeTree data parts 2019-06-16 23:11:30 +03:00
Alexey Milovidov
e3b21be1bb Reduce number of "stat" syscalls for MergeTree data parts 2019-06-16 23:02:45 +03:00
Alexey Milovidov
0ad13ca3d1 Reduce number of "stat" syscalls for MergeTree data parts 2019-06-16 22:59:30 +03:00
Alexey Milovidov
c1aa767a04 Reduce number of "stat" syscalls for MergeTree data parts 2019-06-16 22:53:05 +03:00
Alexey Milovidov
e4f314f88d Reduce number of "stat" syscalls for MergeTree data parts 2019-06-16 22:49:12 +03:00
Alexey Milovidov
801f34d325 Reduce number of "stat" syscalls for MergeTree data parts 2019-06-16 22:42:05 +03:00
Alexey Milovidov
b6acb29625 Reduce number of "stat" syscalls for MergeTree data parts 2019-06-16 22:36:15 +03:00
Alexey Milovidov
b494d17ca6 Reduce number of "stat" syscalls for MergeTree data parts 2019-06-16 22:32:52 +03:00
Alexey Milovidov
413b780b65 Various fixes for PVS-Studio 2019-06-16 21:13:39 +03:00
Vitaliy Zakaznikov
abc7c3f6c1 Merge branch 'master' of https://github.com/vzakaznikov/ClickHouse into liveview 2019-06-15 21:22:28 -04:00
alexey-milovidov
39c6fbc324
Merge pull request #5567 from vitlibar/really-lazy-dictionary-load 
Non-blocking loading of external dictionaries
 2019-06-15 22:15:53 +03:00
alexey-milovidov
a52e13b891
Merge pull request #5640 from yandex/use-ipv6-in-system-tables 
Adopted IPv6 data type in system tables; unified client info columns in system.processes and system.query_log
 2019-06-15 21:21:24 +03:00
Alexey Milovidov
d8f76152d5 Adopted IPv6 data type in system tables; unified client info columns in system.processes and system.query_log 2019-06-15 17:20:32 +03:00
Alexey Milovidov
b2100c7bcf Removed strange quoting style like `this'. See https://english.stackexchange.com/questions/17695/any-reference-on-the-usage-of-a-backtick-and-single-quotation-mark-like-this 
Added backQuote and backQuoteIfNeed when required to correctly quote identifiers with proper escaping.
 2019-06-15 15:06:22 +03:00
Vitaliy Zakaznikov
282ff6bfda * Fixing a bug in writeIntoLiveView method where blocks->front() 
is called before checking if blocks vector is empty.
 2019-06-14 21:08:46 -04:00
Vitaliy Zakaznikov
d6d0404c48 * Fixing bug in StorageLiveView.cpp getHeader() method 
that sometimes addressed invalid pointer when getHeader()
  method was called without holding the mutex
 2019-06-14 16:27:43 -04:00
Gleb Novikov
15004ce055 Merge branch 'master' into table-constraints 2019-06-14 23:10:48 +03:00
Vitaly Baranov
b4384ce2a9 Dictionaries can be loaded in parallel. 
A bad dictionary cannot block all the loading anymore.
Implemented really lazy loading of external dictionaries.
Provided more detailed information about the loading of each dictionary
to make diagnostics easier.
 2019-06-14 22:18:47 +03:00
Alexey Milovidov
10722f53c7 Fixed performance degradation in SELECT from MergeTree tables #5631 2019-06-14 22:11:41 +03:00
alesapin
22026e0333 Enable adaptive index granularity by default 2019-06-14 18:39:21 +03:00
Vitaliy Zakaznikov
13978c03f3 * Fixing a bug in StorageLiveView.cpp in the getHeader() method 
when header block would not match blocks in the stream
  when Const column is present.
* Updating 00963_temporary_live_view_watch_live_timeout.py
  and removed timeout=5 after WATCH query is aborted with Ctrl-C
  so that the default timeout of 20sec is used
* Small style fixes in tests
 2019-06-14 10:06:15 -04:00
proller
fc7ae399c4 Use system rapidjson; Fix types for macos; 2019-06-14 13:28:30 +03:00
alexey-milovidov
bc387e865f
Merge pull request #5549 from yandex/fix_deduplication_bug 
Fix complex bug in deduplication
 2019-06-14 09:23:15 +03:00
Vitaliy Zakaznikov
117f2d191e Merge branch 'master' of https://github.com/vzakaznikov/ClickHouse into liveview 2019-06-13 15:23:20 -04:00
Vitaliy Zakaznikov
b82bb4a954 * Updates to sync with yandex/master 2019-06-13 12:37:29 -04:00
Vitaliy Zakaznikov
8e868dd2fe Merge branch 'master' of https://github.com/yandex/ClickHouse 2019-06-13 12:31:13 -04:00
Alexey Milovidov
c846d0f6af Namespace comments are unneeded according to the code style. 
find dbms -name '*.h' -or -name '*.cpp' | xargs grep -l -P '}\s*//+\s*namespace\s*' | xargs sed -i -r -e 's/}\s*\/\/+\s*namespace\s*.*$/}/'
 2019-06-13 13:43:37 +03:00
Alexey Milovidov
8b87511e25 Namespace comments are unneeded according to the code style. 
find dbms -name '*.h' -or -name '*.cpp' | xargs grep -l -P '}\s*//+\s*namespace\s*' | xargs sed -i -r -e 's/}\s*\/\/+\s*namespace\s*\w+/}/'
 2019-06-13 13:37:13 +03:00
Vitaliy Zakaznikov
576393272b * Fixing styling check error 2019-06-12 20:45:41 -04:00
Vitaliy Zakaznikov
5983273694 Fixing bugs reported by sanitizers 
* data race condition on storage is_dropped access
* invalid reference to storage after it is deleted
* invalid reference to mutex after storage is deleted
 2019-06-12 09:11:44 -04:00
Vitaliy Zakaznikov
12060d8879 * Fixing errors that prevented clang build. 2019-06-11 08:27:47 -04:00
Vitaliy Zakaznikov
b6efd8599f * Trying again to fix style checks. Now running ./utils/check-style/check-style reports no errors. 2019-06-11 06:30:57 -04:00
Vitaliy Zakaznikov
a467e7c105 * Moving uexpect.py so that it can be found 
* Trying to fix failed style checks
* Trying to fix clang build fail
 2019-06-10 22:22:53 -04:00
Vitaliy Zakaznikov
a68980ab38 * Style check fixes 2019-06-10 07:41:33 -04:00
Vitaliy Zakaznikov
87b58e4150 * Fixing clang errors 
* Fixing LIVE VIEW tests
 2019-06-10 07:18:33 -04:00
Ivan Lezhankin
97558c1b41 Merge remote-tracking branch 'upstream/master' into issue-5286 2019-06-10 14:15:14 +03:00
Igr Mineev
842c72bb6d Merge branch 'master' into feature_multiple_disks 2019-06-09 15:38:54 +03:00
Igr Mineev
54b688e559 Stylefix 2019-06-09 15:31:03 +03:00
Vitaliy Zakaznikov
5079180595 * Fixing a bug in LIVE VIEW tables. Before when a table 
is created with "AS SELECT 1" the SELECT and WATCH queries would fail
* Adding and updating LIVE VIEW tests to increase coverage
 2019-06-08 09:26:02 -04:00
Igr Mineev
0eba56c4a7 Added move command. 2019-06-07 22:16:42 +03:00
Vitaliy Zakaznikov
b65ff910b6 Merge branch 'master' of https://github.com/vzakaznikov/ClickHouse into liveview 2019-06-07 08:02:59 -04:00
Vitaliy Zakaznikov
398f7e3c3f Merge branch 'master' of https://github.com/yandex/ClickHouse 2019-06-06 21:22:48 -04:00
Vitaliy Zakaznikov
2930965938 * Renaming live_view_heartbeat_delay setting to live_view_heartbeat_interval 
and making the setting to be in seconds instead of usec
* Updated LIVE VIEW table to keep version consistent as long as the server is up
* Removed calculation of hash in writeIntoLiveView method as it is recalculated
  in the LiveViewBlockOutputStream
* Changed to using values from the local context for live_view_heartbeat_interval and
  temporary_live_view_timeout instead of the global context
* Updated LIVE VIEW tests to match the changes
 2019-06-06 21:10:56 -04:00
alesapin
53e62b83d2 Fix complex bug in deduplication 2019-06-06 18:28:02 +03:00
Vitaliy Zakaznikov
e51f2c1dd1 Revert "Merge branch 'master' of https://github.com/vzakaznikov/ClickHouse into liveview" 
This reverts commit 160ff4d519, reversing
changes made to a946d09f1b.
 2019-06-05 18:52:31 -04:00
Vitaliy Zakaznikov
160ff4d519 Merge branch 'master' of https://github.com/vzakaznikov/ClickHouse into liveview 2019-06-05 18:42:26 -04:00
alexey-milovidov
42dbb7e881
Merge pull request #5539 from yandex/alter-ttl-fix 
Fixed alter modify ttl on ReplicatedMergeTree.
 2019-06-05 22:05:17 +03:00
CurtizJ
27d8b90dd9 fixed alter modify ttl on ReplicatedMergeTree and test added 2019-06-05 19:22:41 +03:00
Gleb Novikov
b8385aae8c Merge branch 'master' into table-constraints 2019-06-05 15:33:07 +03:00
Orivej Desh
5ec179377a DEVTOOLS-5170 Delete Y_IGNORE markers (#5533) 
They have been superseded by a new include resolution configuration that lives
outside clickhouse source tree.
 2019-06-05 14:52:39 +03:00
Vitaliy Zakaznikov
5f3be8134d * Disallowing writes into LIVE VIEW tables 
* Adding support for watching live views via HTTPHandler
* Small fix to WriteBufferValidUTF8.cpp to propagate next() call
* Updated copyData.cpp to treat block with no rows as
  "flush block"
* Updated PushingToViewsBlockOutputStream.cpp to directly use
  LIVE VIEW output stream instead of calling its write method
 2019-06-05 07:30:29 -04:00
Gleb Novikov
8bd2c7b3a7 Fixed DROP INDEX IF EXISTS and added simple test 2019-06-04 00:08:52 +03:00
Vitaliy Zakaznikov
fc21200bdd * Started to add LIVE VIEW table tests 
* Added uexpect.py module
* Fixed support for CREATE TEMPORARY LIVE VIEW
 2019-06-03 15:53:11 -04:00
Gleb Novikov
108b4c6a51 Merge branch 'master' into table-constraints 2019-06-03 22:15:33 +03:00
alesapin
db6de83fa1
Merge pull request #5520 from yandex/fix_inconsistent_parts_removing 
Fix inconsistent parts remove from local FS without dropping them from ZK
 2019-06-03 21:18:16 +03:00
Ivan
f70eed78d8
Don't do intermediate commits in Kafka tables by default (#5445) 
* Don't do intermediate commits in Kafka tables by default
* Use default settings' values as defaults in code
 2019-06-03 19:40:22 +03:00
alesapin
dfe214b37c Fix inconsistent parts remove from local FS without dropping them from ZK 2019-06-03 17:58:19 +03:00
Ivan Lezhankin
8326021d74 Fix style 2019-06-03 17:36:59 +03:00
Ivan Lezhankin
b311984879 Merge remote-tracking branch 'upstream/master' into issue-5286 2019-06-03 17:19:09 +03:00
Anastasiya Rodigina
77fa9c30ee fix little misprint 2019-06-03 07:36:55 +00:00
Anastasiya Rodigina
4ff02cff4d Fix some problems with tests, add more tests, more syntetic tests are coming today 2019-06-03 06:00:54 +00:00
Gleb Novikov
33f0ebd8ab Brace style fix 2019-06-02 18:08:28 +03:00
Gleb Novikov
e7293486bd Added ALTER TABLE support to constraints (ADD CONSTRAINT, DROP CONSTRAINT) 2019-06-02 17:41:12 +03:00
Konstantin Podshumok
9e7387182a StorageReplicatedMergeTree: move timeouts to RemoteBlockInputStream 2019-06-02 12:43:20 +03:00
Konstantin Podshumok
a61a8386f3 update timeouts usage in DistributedBlockOutputStream 2019-06-02 12:43:20 +03:00
Konstantin Podshumok
b801fcb79a fix timeouts usage in directory monitor 2019-06-02 12:43:20 +03:00
Gleb Novikov
2b5cf46842 Merge branch 'master' into table-constraints 2019-06-02 08:33:36 +03:00
Danila Kutenin
b5f42d36fa
Merge pull request #5498 from yandex/gcc9-warnings 
Fix gcc9 warnings and ICEs
 2019-06-01 15:12:41 +03:00
Vitaly Baranov
a4ce427bfa
Merge pull request #5429 from azat-archive/INSERT-into-Distributed-with-MATERIALIZED 
Fix INSERT into Distributed() table with MATERIALIZED column
 2019-06-01 12:28:45 +03:00
Vitaly Baranov
421c6a90e2
Use function getSampleBlockNonMaterialized() to simplify the solution 2019-05-31 21:31:09 +03:00
Danila Kutenin
7e2b3b59b8 Fix gcc9 warnings and ICE's 2019-05-31 11:55:01 +03:00
proller
1b0d1a4450 Info about frozen parts in system.parts (#5471) 
* wip

*    wip

* wip

* Clean

* fix test

* clean

* fix test

* fix test
 2019-05-31 07:03:46 +03:00
Vitaliy Zakaznikov
f06f0e3947 * Adding support for CREATE TEMPORARY LIVE VIEW 
* Fixing issue with setting _version virtual column
 2019-05-30 17:29:30 -04:00
Vitaliy Zakaznikov
673d1a46a0 * Adding support for _version virtual column to LIVE VIEWs when using SELECT 
* Adding support for _version column to LIVE VIEWS when using WATCH query
* Adding initial support for WATCH query on LIVE VIEWs
 2019-05-29 17:52:13 -04:00
alexey-milovidov
cf6f771fd2
Update StorageInput.h 2019-05-30 00:38:28 +03:00
alexey-milovidov
e44cdefefa
Update StorageInput.h 2019-05-29 23:59:03 +03:00
zhang2014
80788cd7a8 Rename system sync distributed to system flush distributed 2019-05-29 10:43:52 +08:00
zhang2014
1a33840964 fix review 2019-05-29 10:43:52 +08:00
zhang2014
c44f608868 support replicas system queries for distributed 2019-05-29 10:43:52 +08:00
Vitaliy Zakaznikov
d112695c42 * Adding other changes to support LIVE VIEWs 2019-05-28 17:17:48 -04:00
palasonicq
c873ed39bf Added input() function 2019-05-28 21:27:00 +03:00
alexey-milovidov
5adef8bc56
Merge pull request #5437 from TCeason/bug_fix 
ISSUES-5432 fix bad alloc when truncate join storage
 2019-05-28 20:33:14 +03:00
Ivan Lezhankin
6b1a9e0e52 Fix comment 2019-05-28 15:22:10 +03:00
tai
1ab21e5774 ISSUES-5432 fix bad alloc when truncate join storage 2019-05-28 14:23:07 +08:00
Ivan Lezhankin
1eccbc39c5 Don't add virtual column to empty block 2019-05-28 00:01:24 +03:00
Azat Khuzhin
e527def18a
Fix INSERT into Distributed() table with MATERIALIZED column 
By just skipping MATERIALIZED columns during processing.

P.S. you cannot use insert_allow_materialized_columns since it works
only for Buffer() engine.

Fixes: #4015
Fixes: #3673
Fixes: 01501fa8db ("correct column list
for rewritten INSERT query into Distributed [#CLICKHOUSE-4161]")
 2019-05-27 23:32:05 +03:00
Ivan Lezhankin
13212c9b01 Fix the hang on dropping Kafka table when there is no mat. views 2019-05-27 20:25:34 +03:00
Vitaliy Zakaznikov
9dd07bcc23 * Work in progress to redo live view implementation to be less invasive 2019-05-26 18:03:30 -04:00
Vitaliy Zakaznikov
084d538dc5 Merge branch 'master' of https://github.com/yandex/ClickHouse 2019-05-26 17:24:17 -04:00
Gleb Novikov
337897c4b8 Merge branch 'master' into table-constraints 2019-05-26 12:36:02 +03:00
alexey-milovidov
461c4919d3
Merge pull request #5116 from PerformanceVision/send_header 
Send a X-ClickHouse summary on the header for HTTP client with number of rows inserted
 2019-05-25 20:20:35 +03:00
Gleb Novikov
c926cf6562 Minor review fixes 2019-05-25 17:07:45 +03:00
alexey-milovidov
e0e35f3258
Merge pull request #5246 from nikvas0/nikvas0/fix_minmax_null 
[wip] fix null minmax
 2019-05-25 16:11:23 +03:00
alexey-milovidov
81ed764d6a
Merge pull request #5285 from abyss7/issue-5085 
Don't crash the server when Kafka consumers have failed to start
 2019-05-25 16:09:26 +03:00
alexey-milovidov
cb89e506a4
Merge pull request #5353 from yandex/aku/detached-parts-5164 
Add system.detached_parts table.
 2019-05-25 16:08:33 +03:00
alexey-milovidov
0c38226a25
Merge pull request #5366 from abyss7/storage-merge-sample 
Check that underlying tables support sampling for StorageMerge
 2019-05-25 15:44:02 +03:00
Gleb Novikov
c401d282da Merge branch 'master' into table-constraints 2019-05-25 14:26:08 +03:00
Anastasiya Rodigina
6c779e63b0 Edit reverse order 2019-05-25 14:09:23 +03:00
Igor Mineev
15ee6207ab Chg 'Schema' to 'StoragePolicy'. Add system.disks. Add system.storage_politics. Add disk to system.parts. Add policy to system.tables. 2019-05-24 22:03:07 +03:00
chertus
9eca696e82 actualize isNumber for Decimal 2019-05-24 15:11:03 +03:00
Ivan Lezhankin
19a850ad75 Use read callback to populate virtual columns in Kafka Engine 2019-05-23 16:20:25 +03:00
Ivan Lezhankin
800854119e Add buffer callback to fill in virtual columns 2019-05-23 14:15:18 +03:00
Ivan Lezhankin
dd906eabdc [WIP] refactoring 2019-05-22 22:38:43 +03:00
Igor Mineev
4f61c9d30f Const Schema fix 2019-05-22 22:20:10 +03:00
Igor Mineev
a209f45f62 Add keep_free_space_ratio param 2019-05-21 20:57:17 +03:00
Igor Mineev
320d509b42 Fix default data path 2019-05-21 20:27:43 +03:00
Igor Mineev
430748bd54 Detach path fix 2019-05-21 18:42:13 +03:00
Igor Mineev
f504c21229 Fetch fix. Style fix 2019-05-21 17:06:33 +03:00
Alexander Kuzmenkov
6472040c6c Initialize StoragesInfo fields. 2019-05-21 16:58:55 +03:00
Ivan Lezhankin
28bddf9a4a [StorageMerge] check that underlying tables support sampling 2019-05-21 16:04:34 +03:00
Alexander Kuzmenkov
43655a8db7 Add system.detached_parts table. 
https://github.com/yandex/ClickHouse/issues/5164
 2019-05-21 15:06:36 +03:00
Ivan Lezhankin
cf39c4cc47 Embed virtual columns into IStorage 2019-05-21 14:24:32 +03:00
Igor Mineev
645ce7c9a4 Bugfix 2019-05-21 14:09:57 +03:00
Ivan Lezhankin
11a5a6db70 Remove unused functions 2019-05-20 15:16:51 +03:00
Guillaume Tassery
77b7158cd8 Progress rename for total_rows and write_[rows|bytes] 2019-05-20 18:37:41 +07:00
Gleb Novikov
773849a43d Added constraints getter and setter to IStorage 2019-05-19 09:08:25 +03:00
Gleb Novikov
19d099f90a Removed ITableDeclaration 2019-05-19 09:03:18 +03:00
Gleb Novikov
2e7b6af137 Merge branch 'master' into table-constraints 2019-05-19 09:03:04 +03:00
Gleb Novikov
60a5b94ba4 Style fix 2019-05-19 08:44:31 +03:00
Gleb Novikov
300ec160f4 Constraints MVP 2019-05-19 08:27:00 +03:00
alexey-milovidov
2254b171a7
Merge pull request #5313 from yandex/fix-external-query-in-with-single-element 
Fix external queries with IN operator.
 2019-05-19 03:12:57 +03:00
Alexey Milovidov
648d2bdb25 Fixed test 2019-05-19 01:19:24 +03:00
Anastasiya Rodigina
b3d811a199 Fix some tests 2019-05-18 19:46:29 +03:00
Anastasiya Rodigina
6132b57beb Fix style issues 2019-05-18 16:22:49 +03:00
anrodigina
d7ee2cb907
Merge branch 'master' into clickhouse-4013 2019-05-18 15:34:23 +03:00
Anastasiya Rodigina
5978ca040b Resolve conflicts with master 2019-05-18 15:30:41 +03:00
Anastasiya Rodigina
31f5cb1eee Resolve conflicts with master 2019-05-18 15:29:57 +03:00
Anastasiya Rodigina
b5eab916f5 Resolve conflicts with master 2019-05-18 15:28:09 +03:00
Anastasiya Rodigina
bc09b51316 Add reading in pk_order 2019-05-18 15:21:40 +03:00
alexey-milovidov
7985ad10ef
Update IStorage.h 2019-05-18 12:31:51 +03:00
Gleb Novikov
ce93896608 Added constraints description to MergeTree and related storages 2019-05-18 11:05:52 +03:00
alexey-milovidov
fa4a7eb3d1
Merge branch 'master' into merge-itable-istorage 2019-05-18 00:37:12 +03:00
alexey-milovidov
8bf48de9c9
Merge pull request #5308 from abyss7/issue-5100 
Add setting to regulate Kafka committing policy
 2019-05-18 00:27:19 +03:00
Ivan Lezhankin
7b6c78402d Allow to shadow virtual column '_table' in Merge engine 2019-05-17 20:40:51 +03:00
Ivan Lezhankin
7f762aee88 Move some code from header to source file. 2019-05-17 17:48:03 +03:00
Ivan Lezhankin
0821d62516 Merge ITableDeclaration into IStorage. 
Also a couple of massive include-refactorings with better forwarding
 2019-05-17 17:34:25 +03:00
Gleb Novikov
7919a62198 Removed constraints getter and setter from StorageMergeTree 2019-05-17 09:21:29 +03:00
Gleb Novikov
07abed6d31 Renamed constraints getter and setter 2019-05-17 08:05:19 +03:00
Gleb Novikov
3c905e24e2 Merge branch 'master' into table-constraints 2019-05-17 08:02:33 +03:00
Gleb Novikov
72d5a4634c Syntax fix 2019-05-17 07:27:09 +03:00
Gleb Novikov
502d86bd02 Added constraints to InterpreterCreateQuery and storages 2019-05-17 07:08:03 +03:00
Alexey Milovidov
09073e1229 More tests 2019-05-17 01:55:29 +03:00
Alexey Milovidov
b075de45d6 Fixed test 2019-05-17 01:51:26 +03:00
Alexey Milovidov
dd9e993a87 Fixed issue #3540 (in progress) 2019-05-17 00:09:06 +03:00
Alexey Milovidov
5352b53671 Added missing file 2019-05-16 22:57:20 +03:00
Alexey Milovidov
d2bb2a9892 Added failing test 2019-05-16 22:00:46 +03:00
Ivan Lezhankin
a14013dff7 Add setting to regulate Kafka committing policy. 2019-05-16 18:20:30 +03:00
alexey-milovidov
8e2bdde93b
Update StorageKafka.cpp 2019-05-15 23:57:24 +03:00
proller
51ca4cbaa4
Build fixes (#5278) 2019-05-15 20:19:39 +03:00
Igor Mineev
f74b7331f5 Minor fixes 2019-05-15 19:49:55 +03:00
Ivan
1ea9e3019d
Freeze the Kafka buffer after first empty response (#5283) 
* Check inside inferior streams for cancellation while reading.
* Stop reading from Kafka buffer after first empty read.
 2019-05-15 19:11:50 +03:00
Ivan Lezhankin
337ddf5047 Catch cppkafka exceptions about consumer creation failures 2019-05-15 17:23:52 +03:00
Artem Zuikov
98359a6a09
Merge pull request #5267 from 4ertus2/row_ref_list 
RowRefList improvements
 2019-05-15 13:38:48 +03:00
alexey-milovidov
88b34999fe
Merge pull request #5247 from zhang2014/fix/rename_data_race 
fix data race in rename query
 2019-05-14 22:07:52 +03:00
Ivan
4a5832b18a
Check the time limit every (flush_interval / poll_timeout) number of rows from Kafka (#5249) 2019-05-14 18:52:03 +03:00
chertus
6200d20dc2 RowRefList refactoring 2019-05-14 17:39:03 +03:00
proller
cc3de4115f
Build fixes (#5261) 2019-05-14 12:58:33 +03:00
Igor Mineev
74466de6d8 Minor fixes. 2019-05-13 23:58:22 +03:00
zhang2014
2206ba464f fix data race in rename query 2019-05-13 15:54:38 +08:00
Nikita Vasilev
ee3c50e1a0 mayBeTrueOnGranule 2019-05-12 20:08:28 +03:00
Nikita Vasilev
3e02eaf28d fix null minmax 2019-05-12 20:01:36 +03:00
Igor Mineev
6596c3f6e0 DataPartsExchange new protocol with data size. StorageReplicatedMergeTree::fetchPartition multipath fix. Choosing on mutate any disk to write mutation file. 2019-05-12 17:57:23 +03:00
alexey-milovidov
f7343ecb6f
Merge pull request #4639 from IvanKush/feat/parallel-alter-modify 
feat alter:  parallelize processing of parts in alter modify
 2019-05-12 00:39:46 +03:00
Igor Mineev
af300c667b Bugfix 2019-05-11 23:44:43 +03:00
Nikita Vasilev
b0307ceeef Merge remote-tracking branch 'upstream/master' into nikvas0/index_mutate 2019-05-11 22:04:57 +03:00
Igor Mineev
b4b000bf84 Merge branch 'master' into feature_multiple_disks 2019-05-11 21:50:29 +03:00
Igor Mineev
a3f513914b Schemas names fix. 2019-05-11 21:00:43 +03:00
ivan-kush
ab6558b8b4 add spaces amp 2019-05-10 17:34:02 +03:00
alexey-milovidov
8ef7f3589a
Merge pull request #4936 from TCeason/feature/support_settings_for_async 
Suport settings for async distributed inserts (#4852)
 2019-05-09 23:59:29 +03:00
alexey-milovidov
001e4bfe76
Merge pull request #5209 from PerformanceVision/rename_mv 
Support rename operation for MaterializeView storage
 2019-05-09 23:10:41 +03:00
Nikita Vasilev
05f9373af0 Merge remote-tracking branch 'upstream/master' into nikvas0/index_mutate 2019-05-09 21:59:22 +03:00
Igor Mineev
254356bd58 Systemtable paths Bugfix. 2019-05-09 20:53:34 +03:00
Nikita Vasilev
6c0722db04 fix mutations with parts 2019-05-09 20:27:20 +03:00
Nikita Vasilev
ad07dd2e1f fix 2019-05-09 20:04:05 +03:00
Nikita Vasilev
8d2b32fda8 clear index 2019-05-09 17:25:18 +03:00
alexey-milovidov
4853b06f95
Merge pull request #5223 from proller/fix26 
Build fixes
 2019-05-09 11:38:20 +03:00
Guillaume Tassery
c8bf190f84 add unsafe function member for (add|remove)dependency for calling manually the context locking 2019-05-09 13:12:02 +07:00
proller
deddb40bf2 fix 2019-05-08 17:25:17 +03:00
proller
10c349e398 Fix macos build 2019-05-08 15:26:35 +03:00
chertus
4969ad2f98 correct comment & some renames 2019-05-08 13:53:45 +03:00
Ivan Kush
2a356791ab Merge branch 'master' into feat/parallel-alter-modify 2019-05-07 23:53:14 +03:00
ivan-kush
5bde1c69ab last try? 2019-05-07 23:41:15 +03:00
Guillaume Tassery
4cfb2859aa set generateInnerTableName function as inline 2019-05-07 14:38:10 +07:00
Guillaume Tassery
55dc86ef74 Support rename operation for MaterializeView storage 2019-05-07 13:54:55 +07:00
alexey-milovidov
63b3d7dbdb
Update MergeTreeData.h 2019-05-06 01:13:07 +03:00
alexey-milovidov
3e461e92c8
Update SelectQueryInfo.h 2019-05-05 23:35:05 +03:00
alexey-milovidov
c04c614bc0
Merge branch 'master' into clickhouse-4013 2019-05-05 23:22:45 +03:00
Nikita Vasilev
18593391b4 materialize query 2019-05-05 21:53:48 +03:00
Nikita Vasilev
27aeb3a36d fix 2019-05-05 21:19:07 +03:00
Nikita Vasilev
3bf2397332 materialize 2019-05-05 20:01:54 +03:00
Nikita Vasilev
dea174620b fix 2019-05-05 18:12:33 +03:00
Nikita Vasilev
d079e80659 operator= 2019-05-05 15:42:53 +03:00
Nikita Vasilev
87131d9e99 fix 2019-05-05 15:17:30 +03:00
Nikita Vasilev
85564c3a84 Merge remote-tracking branch 'upstream/master' into nikvas0/index_mutate 2019-05-05 14:34:10 +03:00
Nikita Vasilev
11d2785e8e parts drop 2019-05-05 10:59:07 +03:00
Alexey Milovidov
aca0195468 Miscellaneous 2019-05-04 19:17:11 +03:00
Alexey Milovidov
b2443f6aa6 Removed huge chunk of bad code 2019-05-04 06:45:58 +03:00
Alexey Milovidov
24dc2c858a Removed huge chunk of bad code 2019-05-03 21:07:59 +03:00
Alexey Milovidov
ad355897f7 Removed huge chunk of bad code 2019-05-03 05:09:41 +03:00
Alexey Milovidov
a6ca9f266f Removed huge chunk of bad code 2019-05-03 05:00:57 +03:00
Alexey Milovidov
41a32d8693 Removed bad code 2019-05-03 03:27:11 +03:00
Alexey Milovidov
0a8e888671 Fixed bad code 2019-05-03 03:26:46 +03:00
Alexey Milovidov
9537ff0594 Miscellaneous 2019-05-03 01:51:39 +03:00
alexey-milovidov
0dd0611873
Merge pull request #5173 from yandex/rename-method 
Rename method for consistency
 2019-05-03 00:58:51 +03:00
ivan-kush
abfb681a04 hz 2019-05-03 00:43:24 +03:00
ivan-kush
9ce742e040 Merge remote-tracking branch 'upstream/master' into feat/parallel-alter-modify 2019-05-03 00:25:56 +03:00
ivan-kush
d555a165a4 debug stress address 2019-05-02 21:48:38 +03:00
Alexey Milovidov
270a31abb5 Rename method for consistency 2019-05-02 19:07:23 +03:00
ivan-kush
ea82760463 add reset 2019-05-02 18:12:57 +03:00
Alexey Milovidov
6a271adad3 Added max_parts_in_total threshold to MergeTree tables 2019-05-02 17:48:54 +03:00
ivan-kush
3ecb66d965 debug stress address 2019-05-02 16:42:09 +03:00
ivan-kush
591325468b make_unique 2019-05-02 14:54:34 +03:00
Alexey Milovidov
1be21e3cb6 Removed bad and useless code in ColumnsDescription 2019-05-02 00:43:05 +03:00
ivan-kush
6ac5aa5e49 restart performance 2019-05-01 18:46:17 +03:00
ivan-kush
4a3a1fc6d9 return transactions cleaning 2019-05-01 15:43:43 +03:00
Ivan Kushnarenko
e38f6e08d8 debug tsan refactor trash 2019-05-01 13:26:49 +03:00
proller
83a35d7644 Update contributors 2019-04-30 22:46:07 +03:00
Ivan
dede124449
Fixes after premature merge of #5139 (#5143) 
* Implement move-constructor via move-assignment operator.
* Reimplement copy-ctor via copy-assignment operator too.
 2019-04-30 19:05:39 +03:00
Ivan
6291c4098f
Revert "Merge pull request #5139 from abyss7/fix-self-move" (#5150) 
This reverts commit bd1f8fe97a, reversing
changes made to 5d1091bfee.
 2019-04-29 23:33:26 +03:00
alexey-milovidov
bd1f8fe97a
Merge pull request #5139 from abyss7/fix-self-move 
Remove move-assignment to prevent possible self-move
 2019-04-29 17:08:23 +03:00
Ivan Lezhankin
9a1aee4c2e Remove move-assignment to prevent possible self-move 2019-04-29 16:47:28 +03:00
tai
b394a79af3 try fix batch async insert settings for Distributed 2019-04-29 17:02:23 +08:00
tai
0d39968233 Suport settings for async(#4852) 
There is no hash operation on Settings. Because it is less valuable for hash operations.

And I dont know how to write a testcase.
 2019-04-29 17:02:23 +08:00
Vitaly Baranov
28d9a80072 Rename macro APPLY_FOR_SETTINGS => LIST_OF_SETTINGS. 2019-04-29 03:22:59 +03:00
Igor Mineev
e7faa04726 Fix. 2019-04-28 17:49:41 +03:00
Ivan Kushnarenko
bdbe97276c remove groups 2019-04-27 23:15:10 +03:00
ivan-kush
26b3910b7d tsan debug 2019-04-27 20:01:30 +03:00
Ivan Kushnarenko
cb51558bdf check build clang7 splitted 2019-04-27 11:24:50 +03:00
Vitaly Baranov
1b8c01e940 Transform comments for MergeTreeSettings into descriptions. 2019-04-27 01:09:16 +03:00
Vitaly Baranov
738a49f534 Use iterators instead of macros APPLY_FOR_SETTINGS and others. 2019-04-27 01:09:16 +03:00
Vitaly Baranov
8277e9d8f1 Refactoring of Settings based on new template class SettingsCollection. 
Add new class SettingsConstraints.
 2019-04-26 19:11:05 +03:00
Vitaly Baranov
b24c69743e Use the same parameters in all APPLY_FOR_SETTINGS macros. 2019-04-26 19:11:05 +03:00
ivan-kush
ba61e16093 style 2019-04-26 00:37:57 +03:00
ivan-kush
86af5fc0c2 Merge remote-tracking branch 'upstream/master' into feat/parallel-alter-modify 2019-04-25 22:48:44 +03:00
ivan-kush
af02fe4a96 Merge remote-tracking branch 'origin/feat/parallel-alter-modify' into feat/parallel-alter-modify 2019-04-25 22:33:09 +03:00
ivan-kush
33201fa9a8 rev 2019-04-25 21:57:43 +03:00
Igor Mineev
8edcae5530 Merge remote-tracking branch 'upstream/master' into feature_multiple_disks 2019-04-24 15:35:08 +03:00
proller
ba4687e110
Cmake: dont use LINK_MODE (but use BUILD_SHARED_LIBS) (#5091) 2019-04-24 12:06:28 +03:00
alexey-milovidov
0cf40e0029
Merge pull request #5082 from yandex/pvs-studio-fixes-3 
Resolved some of PVS-Studio warnings
 2019-04-22 22:06:07 +03:00
alexey-milovidov
b1cf026b5b
Merge pull request #5080 from abyss7/issue-4736 
Do not drop Kafka Consumer buffers after deletion of stream
 2019-04-22 19:18:33 +03:00
Alexey Milovidov
58d7d1e451 Resolved some of PVS-Studio warnings 2019-04-22 19:07:09 +03:00
Ivan Lezhankin
94bba1918f Do not drop Kafka consumer buffers after closing stream 2019-04-22 16:23:05 +03:00
Igor Mineev
e4c8467b49 Default disk initialization bug fix. Stylefix. 2019-04-21 23:23:02 +03:00
Igor Mineev
79abe85328 New data path: disk_path + db_name + table_name. Removed default path from MergeTree Constructor 2019-04-21 21:38:44 +03:00
alesapin
33b228c276 Fix own test 2019-04-18 19:33:28 +03:00
alesapin
d812ae7024 Use fixed_granularity as upper bound for adaptive granularity 2019-04-18 18:06:45 +03:00
Anastasiya Rodigina
0c1735f1b1 ReverseBlockInputStream, optimization of group by, tests 2019-04-18 00:20:51 +03:00
Nikita Vasilev
8e8c77a46b added indices to mutationsInterpreter 2019-04-17 20:07:07 +03:00
proller
1b020827f0 Move Poco/Ext/ThreadNumber.h to common/getThreadNumber.h (#5016) 2019-04-17 17:53:54 +03:00
alesapin
faeb95cfd7
Merge branch 'master' into adaptive_index_granularity 2019-04-15 19:36:36 +03:00
alesapin
8cd18c0723
Merge pull request #4991 from yandex/fix_ddl_on_relicated_table 
Do not send queries received from DDLWorker to leader replica
 2019-04-15 13:07:55 +03:00
Anton Popov
7f93f9ad2f TTL for columns and tables (#4212) 
Add TTL for columns and tables.
 2019-04-15 12:30:45 +03:00
Danila Kutenin
18a6b3123f Randomization in lfalloc 2019-04-13 17:45:01 +03:00
Danila Kutenin
622b2c8472 Enable LFAlloc for MarkCache and UncompressedCache 2019-04-13 15:07:43 +03:00
alesapin
f47e3292e1 Do not send queries to leader replica received from DDLWorker 2019-04-12 14:06:05 +03:00
alexey-milovidov
d083976b88
Merge pull request #4952 from 4ertus2/ast 
Rewrite ASTSelectQuery (consistent children)
 2019-04-11 13:38:44 +03:00
Alexey Milovidov
d591c7187f Simplified expression 2019-04-10 23:16:04 +03:00
Nikita Vasilev
20f0b17cf4 mutations 2019-04-10 20:44:39 +03:00
chertus
a698700faf fix tests (external storages) 2019-04-10 14:44:58 +03:00
chertus
82dc1fb1db rewrite ASTSelectQuery (consistent children) 2019-04-09 17:22:35 +03:00
alesapin
a53b002973 Merge remote-tracking branch 'origin' into adaptive_index_granularity 2019-04-08 14:29:33 +03:00
Igor Mineev
d05c23bd1d Clang build fix. 2019-04-06 18:21:29 +03:00
Alexey Milovidov
460b58379a Fixed bad whitespaces 2019-04-06 03:36:04 +03:00
Alexey Milovidov
571bc7065a Removed unused code related to MemoryTracker 2019-04-06 01:35:56 +03:00
Igor Mineev
563ab2a5ec Merge remote-tracking branch 'upstream/master' into feature_multiple_disks 2019-04-05 23:07:24 +03:00
Igor Mineev
2d805679ae Stylefixes. 2019-04-05 22:58:59 +03:00
Igor Mineev
3a38b16da1 Add rename MergeTreeData function. Add shared_ptr to disks in Volumes. 2019-04-05 22:45:59 +03:00
Igor Mineev
968b7286e2 Stylefixes. 2019-04-05 20:37:27 +03:00
Igor Mineev
e426f3bd4c MergeTree schema settings 2019-04-05 16:04:03 +03:00
Igor Mineev
0b1a33c722 Format file moved to default. Add default Storage configuration 2019-04-05 15:30:26 +03:00
alexey-milovidov
a6797a9fba
Merge pull request #4883 from yandex/fix_codec_delta_alter 
Fix alter modify of codec when column type is not specified
 2019-04-04 22:16:22 +03:00
Igor Mineev
7824aa528f Add Schemes to config. Parse scheme as default on MergeTreeData init 2019-04-04 20:19:11 +03:00
Igor Mineev
0441480502 Storage getDataPath -> getDataPaths 2019-04-04 16:13:59 +03:00
Igor Mineev
341e3f1c5b Add space reservation for each new MargeTreeDataPart. 2019-04-03 15:52:09 +03:00
Danila Kutenin
029dd107e4 Typos for many factories 2019-04-03 14:13:22 +03:00
alesapin
42a0c2f194 Fix alter modify of codec when column type is not specified 2019-04-02 15:51:31 +03:00
Igor Mineev
8047d16a96 Add Path chooser. Add DiskMonitort multiple disks support 2019-04-01 21:41:19 +03:00
alesapin
f7f29fa3e7 Style fix 2019-04-01 15:10:32 +03:00
alesapin
e204be3877 Remove debug prints 2019-04-01 14:40:13 +03:00
alesapin
69b623c47c Return logic for cache 2019-04-01 14:09:30 +03:00
alesapin
37427077b8 Remove average granularity logic from code 2019-04-01 13:34:22 +03:00
alesapin
7b67200258 Merge remote-tracking branch 'origin' into adaptive_index_granularity 2019-04-01 11:54:19 +03:00
alesapin
78e09a221a Remove debug prints, little refactoring 2019-03-30 17:43:43 +03:00
alesapin
d6293d432c Commit missed files 2019-03-30 16:49:29 +03:00
alesapin
cdc18aa801 Rename IndexGranularity to MergeTreeIndexGranularity 2019-03-30 16:44:23 +03:00
Ivan
957d23267b
Minimal implementation of row-level security CLICKHOUSE-4315 (#4792) 
For detailed description see the related PR
 2019-03-29 23:31:06 +03:00
alesapin
2764401d0f Fix exception 'No message received' 2019-03-29 21:10:03 +03:00
Alexey Milovidov
88e94bad74 Removed "assumeMutable" usage in one case 2019-03-29 17:17:29 +03:00
alexey-milovidov
d10b256a8a
Merge pull request #4845 from yandex/max_partitions_per_insert_block 
Implement "max_partitions_per_insert_block" setting
 2019-03-29 16:20:46 +03:00
alexey-milovidov
976ee8a7ca
Merge pull request #4844 from yandex/fix-data-race-in-clear-old-temporary-directories 
Fixed data race in clearOldTemporaryDirectories
 2019-03-29 14:35:44 +03:00
Alexey Milovidov
8e8b5c40e2 Fixed error 2019-03-29 14:24:37 +03:00
Artem Zuikov
03cd41fbc7
Merge pull request #4774 from Gladdy/martijn-asof-join 
Request for feedback on implementation of ASOF join
 2019-03-29 13:19:31 +03:00
Alexey Milovidov
72d021c3d7 Implement "max_partitions_per_insert_block" setting #4700 2019-03-29 12:45:55 +03:00
Alexey Milovidov
8cb1619607 Implement "max_partitions_per_insert_block" setting #4700 2019-03-29 12:34:07 +03:00
Alexey Milovidov
8d3ef5df19 Fixed data race in clearOldTemporaryDirectories 2019-03-29 12:28:16 +03:00
Alexey Milovidov
34c0682353 Removed useless method 2019-03-29 11:37:05 +03:00
alesapin
2b9e261ab2 Better naming 2019-03-29 11:24:38 +03:00
Alexey Milovidov
a2e0f5d29c Merge branch 'master' into fix-race-condition-in-fetch-data-part 2019-03-29 04:22:20 +03:00
alexey-milovidov
72f27f4dec
Merge pull request #4836 from yandex/fix-race-condition-in-system-tables 
Fixed TSan report in StorageSystemTables
 2019-03-29 04:15:00 +03:00
Alexey Milovidov
46be1608a6 Fixed error #4836 2019-03-29 02:17:22 +03:00
Alexey Milovidov
3fb9814e3e Fixed race condition in fetchPart 2019-03-28 22:59:07 +03:00
Alexey Milovidov
350a0fe129 Miscellaneous 2019-03-28 22:58:41 +03:00
Alexey Milovidov
4645422176 Fixed TSan report in StorageSystemTables 2019-03-28 22:13:59 +03:00
alesapin
18d19aa346 More precise estimation of rows 2019-03-28 18:03:49 +03:00
Alexey Milovidov
4417705f32 Merge branch 'master' into cow-ptr-compositions 2019-03-28 17:47:59 +03:00
alesapin
594f91dd9d Save index granularity bytes into zookeeper 2019-03-28 15:44:14 +03:00
alesapin
1b8392a3d0 Style fixed 2019-03-28 12:02:56 +03:00
alesapin
5332642fee CI Fails fixes and little performance improvement 2019-03-28 11:52:09 +03:00
alesapin
3abf5e4ac0 Better code 2019-03-28 10:45:42 +03:00
alesapin
b3210550cb Fix stupid bug 2019-03-28 10:37:46 +03:00
alesapin
77554fd644 Remove unused variable 2019-03-27 21:02:19 +03:00
alesapin
ad16c7c931 Slightly better performance on index granularity 2019-03-27 20:33:55 +03:00
alesapin
e449760fde Remove debug print 2019-03-27 19:50:01 +03:00
alesapin
5528edea93 Fix build warnings 2019-03-27 19:23:38 +03:00
alesapin
22a75196ab Slightly more faster 2019-03-27 18:57:14 +03:00
alesapin
7c8236e145 Accident change 2019-03-27 17:14:27 +03:00
Martijn Bakker
ac68fc8088 pass the half-enforced style checks such that they cannot be run on a whole file automatically :( 2019-03-26 22:05:51 +00:00
Martijn Bakker
f6987cfa52 have the parser recognize asof joins and feed them through to the executor 
insert the time series into a struct ready for joining

working version that inserts the data into the hash table using the existing dispatching machinery for various types

working asof left join in clickhouse

add a test for the asof join

do some asof join cleanup

revisit the logic in case the values match between left and right side
 2019-03-26 19:17:21 +00:00
alexey-milovidov
aab7c79220
Merge pull request #4671 from LiuYangkuan/Buffer-supportsPrewhere 
change supportsPrewhere() of Buffer and return its destination_table supportsPrewhere
 2019-03-26 19:55:27 +03:00
alexey-milovidov
c2e4942009
Merge pull request #4705 from 4ertus2/ast 
SelectQueryOptions + fix duplicates in GLOBAL JOIN with asterisks
 2019-03-26 19:45:27 +03:00
alexey-milovidov
d047a62e31
Merge pull request #4790 from TCeason/fix_crash 
Fix crash when distributed modify order by
 2019-03-26 19:41:00 +03:00
alesapin
2b27b7f702 Fix indices 2019-03-26 17:40:03 +03:00
alesapin
48fb090cda Small fixes 2019-03-26 15:37:42 +03:00
alesapin
0378400972 Move all vertically possible streams to stopcondition 2019-03-26 14:37:32 +03:00
alesapin
2d0224aab4 Add average blocks size for ReplacingBlockInputStream 2019-03-26 13:23:14 +03:00
alesapin
2dfd6779f6 Remove exception 2019-03-26 12:46:09 +03:00
alesapin
bfbe1263ac Allow empty parts 2019-03-26 12:12:48 +03:00
tai
9d232778fc Fix crash when distributed modify order by 
Did not determine if order_by_ast is empty.
If it is null, it will clone a null pointer and cause server crash.
 2019-03-26 13:33:39 +08:00
proller
1584fd4367
Fix hyperscan library find and use (#4798) 2019-03-26 00:31:00 +03:00
alesapin
c0e29d3fb4 Fix first time read from mark 2019-03-25 19:55:48 +03:00
alesapin
aba51a11ba Large refactoring (only compilable) 2019-03-25 16:55:24 +03:00
alesapin
673a72eac6 Merge remote-tracking branch 'origin' into adaptive_index_granularity 2019-03-25 11:41:38 +03:00