Commit Graph

4937 Commits

Author SHA1 Message Date
Alexey Milovidov
666029db6e Merge branch 'added-test-for-race-conditions' of github.com:yandex/ClickHouse into added-test-for-race-conditions 2019-08-20 03:50:40 +03:00
Alexey Milovidov
99aa5cce38 Fixed idiotic error in system.parts 2019-08-20 03:49:58 +03:00
Alexey Milovidov
f1fef3f169 Merge branch 'master' of github.com:yandex/ClickHouse 2019-08-20 03:48:24 +03:00
Alexey Milovidov
e594c344f5 Fixed idiotic error in system.parts 2019-08-20 03:48:08 +03:00
alexey-milovidov
3a909c54c5
Merge pull request #6523 from yandex/fix_inconsistent_parts_after_clone_replica
Fix inconsistent parts after clone replica
2019-08-20 02:25:00 +03:00
alexey-milovidov
fe634d69fe
Merge pull request #6550 from yandex/fix_6125
Fix NPE when using IN clause with a subquery with a tuple
2019-08-20 01:39:02 +03:00
Alexander Kazakov
fe5cd47068
Process prewhere clause in "skip unused shards" optimization (#6521)
* Process prewhere clause in optimize_skip_unused_shards

* Better diagnostics and logging
2019-08-19 23:28:24 +03:00
Alexey Milovidov
5575be034d Whitespaces 2019-08-19 22:32:02 +03:00
Alexey Milovidov
22a11343e8 Attempt to fix race condition 2019-08-19 22:02:20 +03:00
Alexey Milovidov
d2e5789f82 Fixed strange code in mutations that may lead to memory corruption 2019-08-19 21:12:22 +03:00
Alexander Tokmakov
c62eb7a3ae check columns count and types 2019-08-19 19:51:50 +03:00
Alexander Tokmakov
be5df60c7a Merge branch 'master' into fix_inconsistent_parts_after_clone_replica 2019-08-19 17:34:22 +03:00
Alexander Tokmakov
6991683a5f remove local parts which source replica doesnt have 2019-08-19 15:08:45 +03:00
alesapin
f2a8c18c1f Simplify lock 2019-08-19 14:18:58 +03:00
alesapin
69015f292e Fix wrong merge 2019-08-19 14:18:39 +03:00
alesapin
6d29ed99d9 Fix bug with enable_mixed_granularity_parts and mutations 2019-08-19 13:37:04 +03:00
alesapin
99e85ff753 Fix build 2019-08-19 11:25:07 +03:00
alesapin
e7542810bb Merge with master 2019-08-19 11:20:48 +03:00
Nikolai Kochetov
cb848159e1 Merged with master. 2019-08-18 14:52:49 +03:00
alexey-milovidov
e2687fc2d5
Merge pull request #6513 from yandex/parts-race-condition
Fix race condition in system.parts vs. ALTER
2019-08-17 22:30:16 +03:00
alesapin
af2a947ba1
Update StorageSystemParts.cpp 2019-08-16 18:06:02 +03:00
Nikolai Kochetov
7da72261a2 Merge branch 'master' into try-to-remove-dry-run 2019-08-16 15:50:48 +03:00
Nikolai Kochetov
18ad0e7e6b Merged with master. 2019-08-16 13:55:40 +03:00
Alexey Milovidov
b66719725f Fix race condition in system.parts vs. ALTER 2019-08-16 03:49:33 +03:00
alexey-milovidov
01a046e8ca
Merge pull request #5053 from nikvas0/nikvas0/index_mutate
indices and mutations
2019-08-16 02:44:48 +03:00
alexey-milovidov
a466c7aebd
Merge pull request #6299 from CurtizJ/order-by-efficient
Optimizations of ranges selection while reading with enabled optimize_read_in_order.
2019-08-16 02:39:53 +03:00
alexey-milovidov
a70bfa13d4
Merge pull request #6467 from nikitamikhaylov/system_metric_log
system.metric_log table
2019-08-16 02:28:53 +03:00
Nikita Vasilev
00a5fe7836 Merge remote-tracking branch 'upstream/master' into nikvas0/index_mutate 2019-08-15 19:48:57 +03:00
Gleb Novikov
ab1c4139de Added ReplicatedMergeTree support and test for constraints, also added VIOLATED_CONSTRAINT error 2019-08-14 22:51:03 +03:00
CurtizJ
0b3d7d8032 Merge remote-tracking branch 'upstream/master' into order-by-efficient 2019-08-14 21:26:25 +03:00
Nikolai Kochetov
287eb633b8 Merged with master 2019-08-14 18:16:52 +03:00
Nikolai Kochetov
0635188104 Allow constants for RemoteBlockInputStream. 2019-08-14 18:14:32 +03:00
chertus
ddde50c542 minor fixes in includes 2019-08-14 17:06:16 +03:00
CurtizJ
94bca8315d Merge remote-tracking branch 'upstream/master' into order-by-efficient 2019-08-14 01:41:38 +03:00
alesapin
96f62fefcc Add mutex for settings 2019-08-13 19:34:52 +03:00
alesapin
031bfc7bf3 Remove reference 2019-08-13 17:46:18 +03:00
Nikita Mikhaylov
bbe20b3f9f done 2019-08-13 17:31:46 +03:00
alesapin
f988090111 Remove redundant move 2019-08-13 15:10:58 +03:00
alesapin
b00903330f Remove empty block 2019-08-13 15:03:42 +03:00
alesapin
bf5ec73582 Fix clang build 2019-08-13 14:40:45 +03:00
alesapin
7b1039568c Revert old changed 2019-08-13 14:24:18 +03:00
alesapin
ad81c743c1 Buildable code 2019-08-13 13:29:31 +03:00
alesapin
428c753ed7 Merge with master 2019-08-13 11:37:47 +03:00
alesapin
8e72d4c2ec Tryin COW settings 2019-08-13 11:35:49 +03:00
alesapin
98d38e041f Fix recreation of replicated table with fixed granularity 2019-08-12 16:30:29 +03:00
Nikolai Kochetov
43e5cbe35c Fix build/ 2019-08-12 14:06:28 +03:00
Nikolai Kochetov
18939a5776 Fix build/ 2019-08-12 13:59:45 +03:00
Nikolai Kochetov
631bbde420 Merged with master. 2019-08-12 13:19:13 +03:00
Alexey Milovidov
fbaf6b9a4b Parallel loading of data parts #6074 2019-08-11 23:02:51 +03:00
Alexey Milovidov
0b1a4420cb More simple 2019-08-11 22:30:39 +03:00
Alexey Milovidov
006a5e51b7 Merge branch 'master' into speed-up-parts-removal 2019-08-11 22:26:24 +03:00
Alexey Milovidov
1cd87078c2 Merge branch 'master' of github.com:yandex/ClickHouse 2019-08-11 22:24:53 +03:00
Alexey Milovidov
2f73b72007 Style 2019-08-11 22:24:42 +03:00
Alexey Milovidov
ed7db76c94 Speed-up parts removal #6372 2019-08-11 22:14:42 +03:00
Gleb Novikov
3b9e1f9bf7 Fixed getIdentifierName call in AlterCommand::parse 2019-08-11 13:39:17 +03:00
Gleb Novikov
381ea6cb6e Merge branch 'master' into table-constraints 2019-08-11 12:38:34 +03:00
alexey-milovidov
25e97b0b87
Merge pull request #6400 from abyss7/issue-5286
Add more virtual columns to Kafka engine
2019-08-11 05:17:27 +03:00
alexey-milovidov
8520288044
Merge pull request #6416 from 4ertus2/some
Refactoring: move collectUsedColumns() to SyntaxAnalyzer
2019-08-11 05:16:22 +03:00
Ivan Lezhankin
fd27ac9e9e Merge remote-tracking branch 'upstream/master' into issue-5286 2019-08-11 00:11:44 +03:00
alexey-milovidov
838c5e535f
Merge pull request #6433 from yandex/prevent-stack-overflow-in-parser
Fixed possible stack overflow in parser
2019-08-10 23:58:54 +03:00
Nikita Vasilev
75e381bde4 Merge remote-tracking branch 'upstream/master' into nikvas0/index_mutate 2019-08-10 23:07:50 +03:00
Alexey Milovidov
afef5c6c70 Added stack protection; added a test 2019-08-10 20:51:47 +03:00
kreuzerkrieg
112fc71276 adding -Wshadow for GCC 2019-08-09 23:58:16 +03:00
Nikolai Kochetov
2ae3db7920 Merged with master. 2019-08-09 18:32:44 +03:00
chertus
e06c994b0e refactoring: move collectUsedColumns from ExpressionAnalyzer to SyntaxAnalyzer 2019-08-09 17:50:04 +03:00
Nikolai Kochetov
a1023bebff Fix tests. 2019-08-09 16:37:42 +03:00
alesapin
2803fcc2ba Make atomic settings 2019-08-09 16:07:19 +03:00
alexey-milovidov
28e87cc430
Merge pull request #6409 from yandex/get-identifier-name-fixed-unpleasant-code
Fixed unsafe code around "getIdentifier" function.
2019-08-09 02:31:49 +03:00
Alexey Milovidov
2ba185b4aa Addition to prev. revision 2019-08-08 23:10:58 +03:00
Alexey Milovidov
a6e4b34ab4 Fixed unpleasant code #6401 2019-08-08 23:02:30 +03:00
Alexander Tokmakov
ae6efb23b4 Merge branch 'master' into alter_table_drop_detached_part 2019-08-08 22:31:31 +03:00
alesapin
a03fcd9f12 Make settings values atomic to avoid race conditions 2019-08-08 22:29:56 +03:00
Alexey Milovidov
e7c7694377 Removed virtual columns from system.columns for backward compatibility 2019-08-08 18:48:32 +03:00
alesapin
e0d18c0fe8 Merge branch 'master' into merge_tree_settings_alter 2019-08-08 18:16:22 +03:00
Ivan Lezhankin
e90bf74ce8 Merge branch 'master' into issue-5286 2019-08-08 12:57:00 +03:00
alexey-milovidov
9c2165b800
Merge pull request #6388 from yandex/transform-query-substring-test
Added a test just in case
2019-08-08 03:11:37 +03:00
alexey-milovidov
0d3b383c98
Merge pull request #6384 from CurtizJ/fix-optimize-unused-shards
Fix segfault with enabled 'optimize_skip_unused_shards' and missing sharding key.
2019-08-08 03:04:23 +03:00
alexey-milovidov
355b1e5594
Merge pull request #6352 from yandex/no_space_left_on_device_message
Print extra info in exception message for "no space left on device"
2019-08-07 22:28:38 +03:00
Alexey Milovidov
688a80dd80 Added a test just in case #6381 2019-08-07 21:52:53 +03:00
Ivan
1bf6e034e8
Fix infinite loop when reading Kafka messages (#6354)
* Do not pause/resume consumer at all
* Fix kafka tests
* Try to ensure the subscription
* Set timeout for kafka tests and return 'while True'
* Update cluster.py
* When doing a raw select from kafka, ignore client errors.
  They may rise due to 'Local: Timed out' while subscribing.
2019-08-07 19:10:14 +03:00
CurtizJ
7e22f78ce4 fix segfault with enabled 'optimize_skip_unused_shards' and missing sharding key 2019-08-07 18:47:25 +03:00
alesapin
7409f1a3de More comments 2019-08-07 18:33:10 +03:00
alesapin
13e4581317 More general 2019-08-07 18:21:45 +03:00
Alexander Tokmakov
5cf183cbe3 fixes after review 2019-08-07 15:55:27 +03:00
Alexander Tokmakov
aefc664819 refactor throwFromErrno 2019-08-06 21:54:06 +03:00
Nikita Vasilev
90ce4608fb Merge remote-tracking branch 'upstream/master' into nikvas0/index_mutate 2019-08-06 21:07:13 +03:00
alesapin
bca40a8608 Better name 2019-08-06 19:34:27 +03:00
alesapin
e62101b8e8 Better comment 2019-08-06 19:29:31 +03:00
Alexander Tokmakov
c3039196da fixes 2019-08-06 17:51:27 +03:00
Ivan Lezhankin
b55da1888a Add "_timestamp" virtual column 2019-08-06 17:18:37 +03:00
alesapin
ca29343f54 Uniq settings 2019-08-06 17:09:36 +03:00
Ivan Lezhankin
4bc2b32c3e Merge branch 'master' into issue-5286 2019-08-06 16:25:51 +03:00
alesapin
303c4e5a58 Make index_granularity_bytes immutable 2019-08-06 16:06:09 +03:00
alesapin
84fd4906ca Changes for engines 2019-08-06 16:04:29 +03:00
alesapin
52b9658bcf Merge with master 2019-08-06 15:55:12 +03:00
alesapin
e12cb8da6d Add some changes 2019-08-06 15:52:08 +03:00
Alexander Tokmakov
c96b10be9f style fixes 2019-08-06 15:51:10 +03:00
Alexander Tokmakov
75d10f4160 print extra info in exception message 2019-08-05 22:41:20 +03:00
Nikita Vasilev
7b8c0f1750 experiment 2019-08-05 21:06:05 +03:00
Nikolai Kochetov
e361d336bb
Merge pull request #6239 from yandex/processors-and-output-formats
Processors and output formats
2019-08-05 19:45:17 +03:00
Alexey Milovidov
95532f2d31 Fixed minor discrepancies 2019-08-05 19:04:47 +03:00
chertus
ef7d19e143 better JOIN exception messages #5565 2019-08-05 17:03:14 +03:00
CurtizJ
cfe32ad89b Merge remote-tracking branch 'upstream/master' into order-by-efficient 2019-08-04 21:43:00 +03:00
Nikita Vasilev
4c53b90e66 fixed MergedColumnOnlyOutputStream 2019-08-04 21:28:46 +03:00
Nikolai Kochetov
b0b7ed791d Merge branch 'master' into processors-and-output-formats 2019-08-04 19:47:26 +03:00
Nikita Vasilev
4a39538625 Merge remote-tracking branch 'upstream/master' into nikvas0/index_mutate 2019-08-04 16:58:21 +03:00
alexey-milovidov
261abd6c41
Merge pull request #6319 from nikvas0/nikvas0/fix_set_index
Add Comments for set index functions
2019-08-04 16:39:57 +03:00
Nikita Vasilev
5d47a858c5 add comments 2019-08-04 16:03:38 +03:00
Nikolai Kochetov
599f3ddf6e Merged with master. 2019-08-04 15:35:21 +03:00
alexey-milovidov
291dc0f66e
Merge pull request #6316 from yandex/alias-in-materialized-view-simplification
Simplification of #3796
2019-08-04 06:29:02 +03:00
Alexey Milovidov
8b8c59d71b Simplification of #3796 2019-08-04 03:29:32 +03:00
Alexey Milovidov
a3a15d3a95 Addition to prev. revision 2019-08-04 03:28:12 +03:00
Alexey Milovidov
224bc4df97 Minor modifications + a comment #3796 2019-08-04 03:12:17 +03:00
alexey-milovidov
b045e85469
Merge pull request #3796 from amosbird/hang
Fix materialized view with column defaults.
2019-08-04 03:06:40 +03:00
alexey-milovidov
e61f647492
Merge pull request #6282 from nikvas0/nikvas0/fix_set_index
fix operators in set index
2019-08-04 02:52:57 +03:00
alexey-milovidov
2b6a28f617
Merge pull request #6279 from yandex/remove-cat-boost-pool
Removed table function "catBoostPool" and storage "CatBoostPool"
2019-08-03 04:59:55 +03:00
alexey-milovidov
d3e4249420
Merge branch 'master' into ttldropparts 2019-08-03 02:17:29 +03:00
Alexey Milovidov
21cb7de777 More validation of part_name 2019-08-02 23:21:31 +03:00
alexey-milovidov
f8980e691e
Merge pull request #6274 from CurtizJ/ttl-old-parts
TTL improvements.
2019-08-02 22:51:28 +03:00
Nikita Vasilev
bfa9a2c86f fixed index condition 2019-08-02 22:21:55 +03:00
Alexey Milovidov
a5105f85cf Removed table function "catBoostPool" and storage "CatBoostPool" 2019-08-02 21:52:43 +03:00
CurtizJ
e06a53a5d9 fix ranges selection at reading in order 2019-08-02 20:34:29 +03:00
Nikolai Kochetov
1f6a16b03a Remove ValuesRowInputStream. 2019-08-02 20:16:58 +03:00
CurtizJ
a6e85a331a more optimal ranges selection at reading in order 2019-08-02 19:37:43 +03:00
CurtizJ
5f7ebb18ed more optimal ranges selection at reading in order 2019-08-02 19:16:18 +03:00
Nikolai Kochetov
dd90932222 Update FormatFactory. 2019-08-02 18:06:31 +03:00
Nikita Vasilev
7aacbbdc5a fix bug 2019-08-01 22:18:36 +03:00
CurtizJ
d169f42b36 fix build 2019-08-01 22:07:31 +03:00
CurtizJ
b8dff6ebb1 more optimal ranges selection at reading in order 2019-08-01 22:03:39 +03:00
CurtizJ
82f304f81e add query 'SYSTEM STOP TTL MERGES' 2019-08-01 18:36:12 +03:00
CurtizJ
c30bdecf6d add missing comments 2019-08-01 15:00:35 +03:00
alexey-milovidov
e034dab1be
Merge pull request #6255 from yandex/storage-values-simplification
Simplified code with parsing table declaration for table functions.
2019-08-01 14:58:28 +03:00
CurtizJ
f224269d41 filter by ttl parts created before 'alter ... modify ttl' query with 'optimize ... final' query 2019-08-01 14:10:42 +03:00
Alexey Milovidov
12f6b75284 Fixed error 2019-08-01 05:34:58 +03:00
Alexey Milovidov
49b6749280 Merge branch 'master' into fix-malicious-replica 2019-08-01 05:11:45 +03:00
Alexey Milovidov
26bb14da4e Simplified table function "values" 2019-08-01 05:03:15 +03:00
alexey-milovidov
a8793fbef3
Merge pull request #6209 from dimarub2000/values_list
VALUES list
2019-08-01 04:36:04 +03:00
Alexey Milovidov
f3921ce3e0 Changed boost::filesystem to std::filesystem 2019-08-01 01:37:41 +03:00
Alexey Milovidov
bc9d620155 Fixed the case when malicious ClickHouse replica can force clickhouse-server to write to arbitrary path 2019-07-31 22:31:04 +03:00
Alexander Tokmakov
f0836553d4 drop detached partition 2019-07-31 18:27:21 +03:00
alexey-milovidov
ac5d2a225d
Merge pull request #6226 from yandex/aku/lock-tinylog
Lock the TinyLog storage when reading.
2019-07-31 17:40:55 +03:00
Dmitry Rubashkin
a449a00e58 Comments are now in right places 2019-07-31 17:12:05 +03:00
Dmitry Rubashkin
f91c64bd28 parser changed, test modified, comments added 2019-07-31 17:06:22 +03:00
Alexander Kuzmenkov
3ff143c60f Lock the TinyLog storage when reading.
Unlike StripeLog, we only have one set of files per column, so we can't
read concurrently with writing. We didn't use any locking before, and
that lead to user-visible error messages and tsan failures.
2019-07-31 13:59:12 +03:00
alexey-milovidov
30c35b1cbf
Update StorageValues.cpp 2019-07-31 01:06:48 +03:00
Alexander Tokmakov
c6717e0d3f refactor attachPartition 2019-07-30 22:11:15 +03:00
Alexander Tokmakov
2f33df1b2e rename all parts before attaching 2019-07-30 20:24:40 +03:00
Dmitry Rubashkin
7945d05565 Minor style fixes 2019-07-30 15:15:02 +03:00
Amos Bird
6db1c02bfd Fix materialized view with column defaults.
https://github.com/yandex/ClickHouse/issues/448
https://github.com/yandex/ClickHouse/issues/3484
https://github.com/yandex/ClickHouse/issues/3450
https://github.com/yandex/ClickHouse/issues/2878
https://github.com/yandex/ClickHouse/issues/2285
2019-07-30 10:49:54 +08:00
Alexey Milovidov
b5b80fb342 Merge branch 'master' into thread_local_rng 2019-07-30 03:19:48 +03:00