thevar1able/ClickHouse
1
0
Fork 0
mirror of https://github.com/ClickHouse/ClickHouse.git synced 2024-10-19 06:50:50 +00:00
Code Issues Packages Projects Releases Wiki Activity
30,147 Commits 9,026 Branches 1,770 Tags 1.8 GiB
ffe8931cda
Commit Graph

5146 Commits

Author SHA1 Message Date
alesapin
52442cf549 Add system stop moves query 2019-09-03 17:50:49 +03:00
alesapin
48004e9b7b Style fixes 2019-09-03 15:25:58 +03:00
alexey-milovidov
ab75e8c26d
Merge pull request #6205 from zhang2014/fix/some_mutation 
fix some mutation bug
 2019-09-03 14:33:20 +03:00
alesapin
8d76febe02 Add moves to part log 2019-09-03 14:32:25 +03:00
alesapin
0e47bbca4d Fix style check 2019-09-03 12:18:02 +03:00
alesapin
d08d99954f Ugly working code 2019-09-03 11:48:43 +03:00
alesapin
27b0a06005 Fix stupid bug 2019-09-03 11:30:59 +03:00
alesapin
e7308c1f21 Merge branch 'master' into ObjatieGroba-feature_multiple_disks 2019-09-03 11:02:32 +03:00
alesapin
f0c5ee5877 Merge with master 2019-09-02 20:34:18 +03:00
alesapin
5af8c196bd Move initialization of MergedColumnOnlyStream to constructor 2019-09-02 19:31:09 +03:00
Vasily Nemkov
f98c488834 Post-review fixes 
* Actually using the replica recovery settings for cluster
* A bit of doc on DBMS_CONNECTION_POOL_WITH_FAILOVER_MAX_ERROR_COUNT
* StorageDistributedDirectoryMonitor using settings for ConnectionPoolWithFailover
* Using SettingSeconds instead of SettingUInt64 for replica_error_decrease_period
 2019-09-02 17:26:25 +03:00
Vasily Nemkov
84fc4ba4c8 Replica recovery fixes 
* Added a limit on how many errors can replica accumulate
* Decreased default error halving time to 60 seconds
* Made both configurable via settings
* Showing errors count and estimated recovery time for each replica in system.clusters
 2019-09-02 17:26:25 +03:00
alesapin
198031f787 Refactoring 2019-09-02 14:35:53 +03:00
alesapin
e7ee9b7a67 Merge master 2019-09-02 11:46:00 +03:00
alexey-milovidov
2e86aece86
Merge pull request #6763 from yandex/add-os-thread-ids-in-system-tables 
Add "os_thread_ids" column to system tables
 2019-09-01 04:30:16 +03:00
alexey-milovidov
1dd28867b0
Merge pull request #6689 from yandex/merge_tree_settings_alter 
Refactoring of immutable settings
 2019-09-01 04:29:47 +03:00
Alexey Milovidov
cb79e2371e Add "os_thread_ids" column to system tables 2019-09-01 00:47:15 +03:00
alesapin
7382a9f3c3 Rename method for settings check 2019-09-01 00:15:40 +03:00
Alexey Milovidov
bb0ca310ab Allow to ATTACH live views 2019-08-31 02:38:03 +03:00
alesapin
2647d4ca15 Rename immutable to readonly 2019-08-30 23:12:26 +03:00
alesapin
6f30338c08 Fixes 2019-08-30 21:31:35 +03:00
alexey-milovidov
6352c57afb
Merge pull request #6748 from yandex/fix_bad_size_of_marks 
Fix bad size of marks with skip indices
 2019-08-30 20:26:59 +03:00
alesapin
808f4d0b8a Intermediate refactoring 2019-08-30 19:50:59 +03:00
stavrolia
974789d379 add const 2019-08-30 18:19:05 +03:00
alesapin
d4ea6a5234 Fix comment 2019-08-30 17:30:28 +03:00
alesapin
f6120558df Fix bad size of marks 2019-08-30 17:29:08 +03:00
alesapin
d7e54d3c14 Merge branch 'master' of github.com:yandex/ClickHouse into ObjatieGroba-feature_multiple_disks 2019-08-30 12:53:24 +03:00
Vitaly Baranov
da8f67123f Improve error handling in cache dictionaries: 
allow using expired values while the source of a cache dictionary doesn't respond;
clone the source after an error to reset connections;
don't ask the source for a little time after error;
show the last exception in system.dictionaries for a cache dictionary too.
 2019-08-30 12:50:38 +03:00
Alexey Milovidov
0bca68e50b Style 2019-08-29 21:55:20 +03:00
alesapin
1813b96f82 Finally build, possible trash. 2019-08-29 19:17:47 +03:00
Ivan
5851316742
Don't interrupt copyData() used inside Kafka materialized views (#6597) 
* Print better offsets on commit
* Stop consumption on the read buffer level
* Don't use cancellation in the middle of copyData()
* Add test
* Disable squashing stream for Kafka materialized views
* Commit last read message, since rdkafka auto-modifies offset
 2019-08-29 18:36:07 +03:00
alexey-milovidov
c19e5faf4c
Merge pull request #6717 from yandex/fix-data-race-in-storage-merge 
Fix for data race in StorageMerge
 2019-08-29 18:25:48 +03:00
alesapin
dac55278ad Better comments 2019-08-29 14:15:56 +03:00
alesapin
702b47ae5b Remove redundant changes 2019-08-29 13:56:43 +03:00
alesapin
0899b3818d Remove redundant changes 2019-08-29 13:49:26 +03:00
alesapin
67f9753775 Merge branch 'master' into bad_size_of_marks_skip_idx_bug 2019-08-29 11:07:56 +03:00
zhang2014
74c9eea657 fix test failure 2019-08-29 11:34:00 +08:00
zhang2014
3c7405bdb0 move test to integration & refer max_expanded_ast_elements 2019-08-29 11:31:22 +08:00
zhang2014
92740212b5 fix build failure 2019-08-29 11:15:15 +08:00
zhang2014
6c3626b629 truncate should remove mutations 2019-08-29 11:14:40 +08:00
zhang2014
54b65bac50 fix max_ast_elements settings with merge mutation 2019-08-29 11:06:35 +08:00
Alexey Milovidov
d1a980fcdd Fix for data race in StorageMerge 2019-08-29 01:18:26 +03:00
alesapin
b4d98f6e13 Trying to fix vertical merge 2019-08-28 21:23:20 +03:00
alexey-milovidov
44dd3bd792
Merge pull request #6692 from yandex/remove-queue_max_wait_ms 
Set default value of "queue_max_wait_ms" to zero, because current value makes no sense
 2019-08-28 21:06:09 +03:00
alexey-milovidov
7b9b67fd71
Merge pull request #6695 from yandex/improve-table-locks 
Avoid possible deadlock in TRUNCATE of Replicated table.
 2019-08-28 21:05:26 +03:00
Alexey Milovidov
d1c268c2ed Added setting "kafka_max_wait_ms" 2019-08-28 18:24:23 +03:00
alexey-milovidov
696d505a1a
Merge pull request #6656 from vzakaznikov/fix_live_view_no_users_thread 
Fix live view no users thread
 2019-08-28 16:33:36 +03:00
Alexey Milovidov
a1101e5278 Fixed build 2019-08-28 16:21:19 +03:00
Alexey Milovidov
8b973fd9f2 Merge branch 'improve-table-locks' of github.com:yandex/ClickHouse into improve-table-locks 2019-08-28 15:59:23 +03:00
Alexey Milovidov
625e128770 Merge branch 'master' into improve-table-locks 2019-08-28 15:41:30 +03:00
Alexey Milovidov
c8798b2ffa Slightly improve table locks 2019-08-28 02:47:30 +03:00
Alexey Milovidov
285d66cee1 Improve table locks (incomplete) 2019-08-27 23:43:08 +03:00
alexey-milovidov
c736d6b495
Merge pull request #6676 from dimarub2000/right_left_problem_#6381 
Query transformation for external database fixed.
 2019-08-27 23:11:39 +03:00
stavrolia
f4e0dceddb some changes 2019-08-27 18:20:31 +03:00
Alexey Milovidov
8ca00a26f6 Fixed build 2019-08-27 17:31:34 +03:00
Alexey Milovidov
c385c950ba Merge branch 'master' into replicate-merge-tree-minor-lock-improvement 2019-08-27 17:30:48 +03:00
alexey-milovidov
d12ced8099
Merge pull request #6191 from svladykin/ttldropparts 
TTL: Only drop altogether the expired parts and not partially prune them.
 2019-08-27 16:54:56 +03:00
alesapin
106b9717cd Refactoring of immutable settings 2019-08-27 16:14:19 +03:00
Dmitry Rubashkin
17f18e42c0 new line 2019-08-27 16:13:40 +03:00
Dmitry Rubashkin
f1f85a5a24 Fixed case with single subquery and added tests. 2019-08-27 16:09:58 +03:00
alexey-milovidov
8db93d392b
Merge pull request #6685 from yandex/merge_tree_settings_alter 
Alter merge tree settings with other types of alter
 2019-08-27 16:07:28 +03:00
alesapin
36472b14f9 Defend kafka storage from alters 2019-08-27 12:48:20 +03:00
alesapin
7851d8fe0a Add ability to alter settings with other types of alter 2019-08-27 12:34:53 +03:00
Alexey Milovidov
57fa4e1dd7 Minor lock improvement for ReplicatedMergeTree 2019-08-27 00:40:29 +03:00
alexey-milovidov
561b173ddc
Merge pull request #6675 from yandex/simplify-shared-ptr-helper 
Simplify shared_ptr_helper
 2019-08-27 00:36:52 +03:00
CurtizJ
5f25c2d7b4 merging with master 2019-08-26 22:49:52 +03:00
CurtizJ
1774ac4b9e Merge remote-tracking branch 'upstream/master' into HEAD 2019-08-26 22:29:12 +03:00
Alexey Milovidov
0eec226c9a Simplify shared_ptr_helper 2019-08-26 22:07:29 +03:00
Dmitry Rubashkin
0c75d5f42b Function transformQueryForExternalDatabase() fixed 2019-08-26 22:03:47 +03:00
alesapin
cf31187254 Resolve conflicts 2019-08-26 21:08:58 +03:00
alesapin
0d0ebf885f Remove two redundant arguments from alter 2019-08-26 17:50:34 +03:00
alesapin
dff0cc1e1c Remove COW and add MultiVersion 2019-08-26 17:24:29 +03:00
Alexey Milovidov
479b4d81f3 Fixed error 2019-08-26 16:46:07 +03:00
Alexey Milovidov
60d660e263 Merge branch 'master' into merge-constraints 2019-08-26 16:13:44 +03:00
alexey-milovidov
c2b6cffabc
Update IStorage.cpp 2019-08-26 15:39:35 +03:00
alesapin
062034dfd8 Eventually merged with master 2019-08-26 13:07:32 +03:00
Alexey Milovidov
25635d1ab0 Fixed build of tests 2019-08-26 05:46:21 +03:00
Alexey Milovidov
2a3e0eb1f1 Merge branch 'master' into merge-constraints 2019-08-26 04:30:31 +03:00
Vitaliy Zakaznikov
7fb13b12f9 Reverting to previous no users thread functionality to avoid 
keeping no users thread always alive for each live view.
 2019-08-25 08:27:47 -04:00
Vitaliy Zakaznikov
2342d64d1b * Updating no users thread to sleep 3 times longer when users are present 
to reduce the number of times thread wakes up.
* Updating startNoUsersThread to return if the thread is already running.
 2019-08-25 07:36:08 -04:00
Vitaliy Zakaznikov
62988800e6 Rewriting implementation of LIVE VIEW no users thread. 2019-08-24 21:40:24 -04:00
Alexey Milovidov
d798cbde2f Fixed double whitespaces 2019-08-25 01:28:06 +03:00
Nikita Vasilev
2dbfabd08c fix Set index check useless (#6651) 
* fixed useless detection

* fixed useless detection

* fix

* fix

* fix
 2019-08-25 01:01:36 +03:00
Alexey Milovidov
3fef8e92ad Merging CONSTRAINTS support 2019-08-25 00:20:20 +03:00
alexey-milovidov
eeeaf8fbee
Merge pull request #6643 from yandex/double-whitespaces 
Added a check for double whitespaces
 2019-08-23 23:10:12 +03:00
alexey-milovidov
012a5f8911
Merge pull request #6596 from Enmk/hasToken 
hasToken function implementation
 2019-08-23 21:41:33 +03:00
Alexey Milovidov
b42f85e16b Added a check for double whitespaces 2019-08-23 21:30:04 +03:00
Alexey Milovidov
4366791b63 Merge branch 'table-constraints' of https://github.com/NanoBjorn/ClickHouse into NanoBjorn-table-constraints 2019-08-23 07:49:10 +03:00
alexey-milovidov
7012a421c6
Merge branch 'master' into alter_table_drop_detached_part 2019-08-23 05:22:07 +03:00
alexey-milovidov
3a237b4375
Merge pull request #6617 from yandex/fix_too_many_parts_while_mutation_6502 
Fix too many parts while mutation
 2019-08-23 04:27:43 +03:00
Alexey Milovidov
78c3be175c Added experimental setting for LIVE VIEWs 2019-08-23 02:46:40 +03:00
Alexey Milovidov
c4712f1e6e Make the code less bad 2019-08-23 02:22:57 +03:00
Alexey Milovidov
859736d935 Basic code quality of Live View 2019-08-23 01:41:30 +03:00
Alexander Tokmakov
81022bb3e9 Merge branch 'master' into alter_table_drop_detached_part 2019-08-22 23:38:58 +03:00
Alexander Tokmakov
acce56095f limit number of background threads for mutations 2019-08-22 22:35:46 +03:00
Vasily Nemkov
6d78e3be94 hasToken function implementation 
* Function to check if given token is present in a string;
* Special case for hasToken to 'tokenbf_v1' index;
* Test cases for hasToken()
* Test case for hasToken() + 'tokenbf_v1' integration
 2019-08-22 18:00:35 +03:00
alexey-milovidov
903601d3e3
Merge pull request #6600 from yandex/distributed-files-to-send-metric 
Added a metric for the number of files to send in Distributed tables.
 2019-08-22 07:34:09 +03:00
alexey-milovidov
f0e0793cdd
Merge pull request #6581 from yandex/assert_cast 
Added checks to static_cast of columns.
 2019-08-22 05:09:34 +03:00
Alexey Milovidov
6bbf3bd634 Added a metric for the number of files to send in Distributed tables 2019-08-22 04:30:49 +03:00
alesapin
b9d3d04c57 Move tasks in schedule pool 2019-08-21 19:02:13 +03:00
alesapin
be5dd3b994 Remove stupid logic 2019-08-21 16:15:44 +03:00
alesapin
6b85834ae3 Remove excessive logging 2019-08-21 16:11:08 +03:00
Alexander Tokmakov
5cb8605f61 limit number of mutations in the queue 2019-08-21 16:10:33 +03:00
alesapin
d2fe947535 Add test for race condition, found it and fix it 2019-08-21 15:32:48 +03:00
alesapin
eb5e052855 merge and fixes 2019-08-21 13:09:29 +03:00
alesapin
70ca7f4156 Merge with master 2019-08-21 11:57:35 +03:00
alexey-milovidov
308baa182e
Merge branch 'master' into table-constraints 2019-08-21 06:33:08 +03:00
Alexey Milovidov
d848009827 Fixed false data race in "MergeTreeDataPart::is_frozen" field 2019-08-21 06:16:59 +03:00
Alexey Milovidov
8966520801 Added "assert_cast" function as a replacement for static_cast for columns 2019-08-21 05:28:04 +03:00
alexey-milovidov
3f607b21fe
Merge pull request #6375 from yandex/try-to-remove-dry-run 
Try to remove dry run
 2019-08-21 03:52:41 +03:00
alexey-milovidov
58358ec856
Merge pull request #6514 from yandex/added-test-for-race-conditions 
Added a test for race conditions.
 2019-08-21 01:33:34 +03:00
Alexey Milovidov
c1de51dc5b Better code 2019-08-20 22:53:27 +03:00
alexey-milovidov
f9968fbcfc
Merge pull request #6554 from yandex/add-table-finctions-number-mt 
Add table function numbers_mt
 2019-08-20 22:42:27 +03:00
alexey-milovidov
31a4b816fe
Merge pull request #6566 from yandex/filimonov-remove-duplicated-const 
remove doubled const TABLE_IS_READ_ONLY
 2019-08-20 22:24:40 +03:00
alesapin
e44ab4f4cd Add tests for partitions alter 2019-08-20 22:04:58 +03:00
alesapin
8417eb9d95 Remove old tests 2019-08-20 21:35:35 +03:00
Alexey Milovidov
295aafb13f Parallel ALTER modify: don't use ThreadPool if the number of threads is one 2019-08-20 21:18:37 +03:00
Alexey Milovidov
c8859febcb Merge branch 'master' into added-test-for-race-conditions 2019-08-20 21:05:25 +03:00
alesapin
120e27a385 Lock parts with dirty hack 2019-08-20 21:00:48 +03:00
alesapin
9c8ec6e4fc Fixes for replicated merge tree 2019-08-20 20:16:32 +03:00
Nikolai Kochetov
822fe63f3b Added comment. 2019-08-20 19:13:18 +03:00
Nikolai Kochetov
aef03fd9bf
Merge pull request #6425 from yandex/vzakaznikov-liveview 
Merge LIVE VIEW
 2019-08-20 17:13:42 +03:00
Nikolai Kochetov
7bd748c969 Renamed NumbersMtBlockInputStream to NumbersMultiThreadedBlockInputStream. 2019-08-20 17:13:06 +03:00
filimonov
8d0c2eacfd
remove doubled const TABLE_IS_READ_ONLY 2019-08-20 13:18:08 +02:00
Ivan
a502424c33
Implement support for insertion into Kafka tables (#6012) 
* Add write-callback on each row for RowOutputStream
* Fix build of new rdkafka library
* Poll messages if Kafka outgoing queue is full
* Add test
* Add test producer-consumer
* Truncate delimiter from last row in message
 2019-08-20 14:17:57 +03:00
Nikolai Kochetov
0c0e5010dc Added NumbersMtBlockInputStream. 2019-08-20 13:29:04 +03:00
Nikolai Kochetov
7f31b8bf9c Added NumbersMtBlockInputStream. 2019-08-20 13:28:20 +03:00
alesapin
00bdd6c680 Support move partition 2019-08-20 12:59:19 +03:00
Gleb Novikov
86fecc7501 Merge branch 'master' into table-constraints 2019-08-20 12:17:56 +03:00
alesapin
5690498424 Remove excessive logging 2019-08-20 11:44:09 +03:00
alesapin
8408ffbfa6 Almost working replicated MT 2019-08-20 11:38:02 +03:00
Nikolai Kochetov
cdf1ce3171 Merge branch 'master' into vzakaznikov-liveview 2019-08-20 10:41:31 +03:00
Alexey Milovidov
b7cb55a06e Added a comment 2019-08-20 04:46:48 +03:00
Alexey Milovidov
a574727269 Attempt to fix deadlock 2019-08-20 04:24:53 +03:00
Alexey Milovidov
666029db6e Merge branch 'added-test-for-race-conditions' of github.com:yandex/ClickHouse into added-test-for-race-conditions 2019-08-20 03:50:40 +03:00
Alexey Milovidov
99aa5cce38 Fixed idiotic error in system.parts 2019-08-20 03:49:58 +03:00
Alexey Milovidov
f1fef3f169 Merge branch 'master' of github.com:yandex/ClickHouse 2019-08-20 03:48:24 +03:00
Alexey Milovidov
e594c344f5 Fixed idiotic error in system.parts 2019-08-20 03:48:08 +03:00
alexey-milovidov
3a909c54c5
Merge pull request #6523 from yandex/fix_inconsistent_parts_after_clone_replica 
Fix inconsistent parts after clone replica
 2019-08-20 02:25:00 +03:00
alexey-milovidov
fe634d69fe
Merge pull request #6550 from yandex/fix_6125 
Fix NPE when using IN clause with a subquery with a tuple
 2019-08-20 01:39:02 +03:00
Alexander Kazakov
fe5cd47068
Process prewhere clause in "skip unused shards" optimization (#6521) 
* Process prewhere clause in optimize_skip_unused_shards

* Better diagnostics and logging
 2019-08-19 23:28:24 +03:00
Alexey Milovidov
5575be034d Whitespaces 2019-08-19 22:32:02 +03:00
Alexey Milovidov
22a11343e8 Attempt to fix race condition 2019-08-19 22:02:20 +03:00
stavrolia
1190e866aa Fix 2019-08-19 21:12:50 +03:00
stavrolia
b3fd5bc141 Add tests, comments and fix 2019-08-19 21:12:50 +03:00
stavrolia
2f2bf953eb fix and add test for storage file version 2019-08-19 21:12:50 +03:00
stavrolia
32fad1e961 fix 2019-08-19 21:12:50 +03:00
stavrolia
229dd7c2b6 wip 2019-08-19 21:12:50 +03:00
stavrolia
f9037fee2c Fix File version 2019-08-19 21:12:50 +03:00
stavrolia
b386b3090c Impove HDFS version 2019-08-19 21:12:50 +03:00