Commit Graph

5180 Commits

Author SHA1 Message Date
alexey-milovidov
25de2e12a2
Merge pull request #6399 from Enmk/replica_recovery_interval
Improvements for failover of Distributed queries
2019-09-07 03:21:30 +03:00
stavrolia
f533485d19 Minor code cleanup 2019-09-06 21:29:41 +03:00
alesapin
cfd753a1f3 Add test and found bugs 2019-09-06 18:09:20 +03:00
Anton Popov
69da4f30b3
Merge branch 'master' into merging_input_function 2019-09-06 16:20:00 +03:00
alesapin
ea8e543b1a Add protocol version to cookies 2019-09-06 15:18:56 +03:00
alesapin
0c9a9dee1c Merge with master 2019-09-06 11:53:32 +03:00
Olga Khvostikova
4129d8cf60
Merge pull request #6092 from yandex/globs-in-file-one-more-attempt
Globs in storage file and HDFS
2019-09-05 23:05:37 +03:00
stavrolia
5e37510aae Better 2019-09-05 21:09:19 +03:00
alesapin
ab518d7787 Split code to parts 2019-09-05 18:53:23 +03:00
stavrolia
587a780ba2 Better 2019-09-05 17:42:17 +03:00
CurtizJ
b04cea7463 minor fixes of table function input 2019-09-05 16:17:01 +03:00
alesapin
f576cbb8a4 Simplify code 2019-09-05 16:12:29 +03:00
Vasily Nemkov
c2fc71b5e5 Post-PR fixes
Renamed settings, updated docs.
2019-09-05 13:35:36 +03:00
alesapin
b71faee8cd Merge branch 'master' into ObjatieGroba-feature_multiple_disks 2019-09-05 13:19:05 +03:00
Ivan
ab7df6b6dd
Fix kafka tests (#6805)
* Commit offsets more precisely
* Get rid of DelimitedReadBuffer since read buffers don't line up well
* Increase timeouts
2019-09-05 00:25:33 +03:00
stavrolia
5d6959173c Improvement 2019-09-04 22:55:56 +03:00
alesapin
66362cedbc Refactoring 2019-09-04 21:26:18 +03:00
alesapin
c003f443f9 Refactor 2019-09-04 20:26:53 +03:00
Vladimir Chebotarev
fa01cc162c Merge fix. 2019-09-04 16:10:25 +00:00
alesapin
13bbae5860 Remove trash 2019-09-04 19:00:20 +03:00
Vladimir Chebotarev
97b7635c8a Minimum block size to configuration. 2019-09-04 13:39:54 +00:00
Vladimir Chebotarev
dd32c92f2a Minor fixes. 2019-09-04 13:39:53 +00:00
Vladimir Chebotarev
1944ff1a48 POST to PUT, refactoring. 2019-09-04 13:39:53 +00:00
Vladimir Chebotarev
78f57c5f2a First attempt to make redirects. 2019-09-04 13:39:53 +00:00
Vladimir Chebotarev
ff09934219 Table function and storage. 2019-09-04 13:39:53 +00:00
Vladimir Chebotarev
47985cf8a7 Wrong commit. 2019-09-04 13:39:53 +00:00
Vladimir Chebotarev
ce69683673 Copy-paste from StorageFile. 2019-09-04 13:39:53 +00:00
alesapin
a4c3937153 Small refactoring 2019-09-04 16:24:55 +03:00
alesapin
8b6abab486 Merge branch 'master' into ObjatieGroba-feature_multiple_disks 2019-09-04 15:41:27 +03:00
CurtizJ
7accc09066 Merge branch 'palasonic-add-input-function' of https://github.com/palasonic1/ClickHouse into merging_input_function 2019-09-04 15:25:20 +03:00
alesapin
18ef235a3f Fix indices mrk file extension 2019-09-04 15:22:20 +03:00
alesapin
16a544f300 Fix bug with mutations after granularity change 2019-09-04 15:19:42 +03:00
stavrolia
32bf915610 More docs 2019-09-04 14:11:30 +03:00
alesapin
e6e6c11ba3 Better test and NOTHING_TO_DO 2019-09-03 20:06:36 +03:00
alesapin
52442cf549 Add system stop moves query 2019-09-03 17:50:49 +03:00
alesapin
48004e9b7b Style fixes 2019-09-03 15:25:58 +03:00
alexey-milovidov
ab75e8c26d
Merge pull request #6205 from zhang2014/fix/some_mutation
fix some mutation bug
2019-09-03 14:33:20 +03:00
alesapin
8d76febe02 Add moves to part log 2019-09-03 14:32:25 +03:00
alesapin
0e47bbca4d Fix style check 2019-09-03 12:18:02 +03:00
alesapin
d08d99954f Ugly working code 2019-09-03 11:48:43 +03:00
alesapin
27b0a06005 Fix stupid bug 2019-09-03 11:30:59 +03:00
alesapin
e7308c1f21 Merge branch 'master' into ObjatieGroba-feature_multiple_disks 2019-09-03 11:02:32 +03:00
alesapin
f0c5ee5877 Merge with master 2019-09-02 20:34:18 +03:00
alesapin
5af8c196bd Move initialization of MergedColumnOnlyStream to constructor 2019-09-02 19:31:09 +03:00
Vasily Nemkov
f98c488834 Post-review fixes
* Actually using the replica recovery settings for cluster
* A bit of doc on DBMS_CONNECTION_POOL_WITH_FAILOVER_MAX_ERROR_COUNT
* StorageDistributedDirectoryMonitor using settings for ConnectionPoolWithFailover
* Using SettingSeconds instead of SettingUInt64 for replica_error_decrease_period
2019-09-02 17:26:25 +03:00
Vasily Nemkov
84fc4ba4c8 Replica recovery fixes
* Added a limit on how many errors can replica accumulate
* Decreased default error halving time to 60 seconds
* Made both configurable via settings
* Showing errors count and estimated recovery time for each replica in system.clusters
2019-09-02 17:26:25 +03:00
alesapin
198031f787 Refactoring 2019-09-02 14:35:53 +03:00
alesapin
e7ee9b7a67 Merge master 2019-09-02 11:46:00 +03:00
alexey-milovidov
2e86aece86
Merge pull request #6763 from yandex/add-os-thread-ids-in-system-tables
Add "os_thread_ids" column to system tables
2019-09-01 04:30:16 +03:00
alexey-milovidov
1dd28867b0
Merge pull request #6689 from yandex/merge_tree_settings_alter
Refactoring of immutable settings
2019-09-01 04:29:47 +03:00
Alexey Milovidov
cb79e2371e Add "os_thread_ids" column to system tables 2019-09-01 00:47:15 +03:00
alesapin
7382a9f3c3 Rename method for settings check 2019-09-01 00:15:40 +03:00
Alexey Milovidov
bb0ca310ab Allow to ATTACH live views 2019-08-31 02:38:03 +03:00
alesapin
2647d4ca15 Rename immutable to readonly 2019-08-30 23:12:26 +03:00
alesapin
6f30338c08 Fixes 2019-08-30 21:31:35 +03:00
alexey-milovidov
6352c57afb
Merge pull request #6748 from yandex/fix_bad_size_of_marks
Fix bad size of marks with skip indices
2019-08-30 20:26:59 +03:00
alesapin
808f4d0b8a Intermediate refactoring 2019-08-30 19:50:59 +03:00
stavrolia
974789d379 add const 2019-08-30 18:19:05 +03:00
alesapin
d4ea6a5234 Fix comment 2019-08-30 17:30:28 +03:00
alesapin
f6120558df Fix bad size of marks 2019-08-30 17:29:08 +03:00
alesapin
d7e54d3c14 Merge branch 'master' of github.com:yandex/ClickHouse into ObjatieGroba-feature_multiple_disks 2019-08-30 12:53:24 +03:00
Vitaly Baranov
da8f67123f Improve error handling in cache dictionaries:
allow using expired values while the source of a cache dictionary doesn't respond;
clone the source after an error to reset connections;
don't ask the source for a little time after error;
show the last exception in system.dictionaries for a cache dictionary too.
2019-08-30 12:50:38 +03:00
Alexey Milovidov
0bca68e50b Style 2019-08-29 21:55:20 +03:00
alesapin
1813b96f82 Finally build, possible trash. 2019-08-29 19:17:47 +03:00
Ivan
5851316742
Don't interrupt copyData() used inside Kafka materialized views (#6597)
* Print better offsets on commit
* Stop consumption on the read buffer level
* Don't use cancellation in the middle of copyData()
* Add test
* Disable squashing stream for Kafka materialized views
* Commit last read message, since rdkafka auto-modifies offset
2019-08-29 18:36:07 +03:00
alexey-milovidov
c19e5faf4c
Merge pull request #6717 from yandex/fix-data-race-in-storage-merge
Fix for data race in StorageMerge
2019-08-29 18:25:48 +03:00
alesapin
dac55278ad Better comments 2019-08-29 14:15:56 +03:00
alesapin
702b47ae5b Remove redundant changes 2019-08-29 13:56:43 +03:00
alesapin
0899b3818d Remove redundant changes 2019-08-29 13:49:26 +03:00
alesapin
67f9753775 Merge branch 'master' into bad_size_of_marks_skip_idx_bug 2019-08-29 11:07:56 +03:00
zhang2014
74c9eea657 fix test failure 2019-08-29 11:34:00 +08:00
zhang2014
3c7405bdb0 move test to integration & refer max_expanded_ast_elements 2019-08-29 11:31:22 +08:00
zhang2014
92740212b5 fix build failure 2019-08-29 11:15:15 +08:00
zhang2014
6c3626b629 truncate should remove mutations 2019-08-29 11:14:40 +08:00
zhang2014
54b65bac50 fix max_ast_elements settings with merge mutation 2019-08-29 11:06:35 +08:00
Alexey Milovidov
d1a980fcdd Fix for data race in StorageMerge 2019-08-29 01:18:26 +03:00
alesapin
b4d98f6e13 Trying to fix vertical merge 2019-08-28 21:23:20 +03:00
alexey-milovidov
44dd3bd792
Merge pull request #6692 from yandex/remove-queue_max_wait_ms
Set default value of "queue_max_wait_ms" to zero, because current value makes no sense
2019-08-28 21:06:09 +03:00
alexey-milovidov
7b9b67fd71
Merge pull request #6695 from yandex/improve-table-locks
Avoid possible deadlock in TRUNCATE of Replicated table.
2019-08-28 21:05:26 +03:00
Alexey Milovidov
d1c268c2ed Added setting "kafka_max_wait_ms" 2019-08-28 18:24:23 +03:00
alexey-milovidov
696d505a1a
Merge pull request #6656 from vzakaznikov/fix_live_view_no_users_thread
Fix live view no users thread
2019-08-28 16:33:36 +03:00
Alexey Milovidov
a1101e5278 Fixed build 2019-08-28 16:21:19 +03:00
Alexey Milovidov
8b973fd9f2 Merge branch 'improve-table-locks' of github.com:yandex/ClickHouse into improve-table-locks 2019-08-28 15:59:23 +03:00
Alexey Milovidov
625e128770 Merge branch 'master' into improve-table-locks 2019-08-28 15:41:30 +03:00
Alexey Milovidov
c8798b2ffa Slightly improve table locks 2019-08-28 02:47:30 +03:00
Alexey Milovidov
285d66cee1 Improve table locks (incomplete) 2019-08-27 23:43:08 +03:00
alexey-milovidov
c736d6b495
Merge pull request #6676 from dimarub2000/right_left_problem_#6381
Query transformation for external database fixed.
2019-08-27 23:11:39 +03:00
stavrolia
f4e0dceddb some changes 2019-08-27 18:20:31 +03:00
Alexey Milovidov
8ca00a26f6 Fixed build 2019-08-27 17:31:34 +03:00
Alexey Milovidov
c385c950ba Merge branch 'master' into replicate-merge-tree-minor-lock-improvement 2019-08-27 17:30:48 +03:00
alexey-milovidov
d12ced8099
Merge pull request #6191 from svladykin/ttldropparts
TTL: Only drop altogether the expired parts and not partially prune them.
2019-08-27 16:54:56 +03:00
alesapin
106b9717cd Refactoring of immutable settings 2019-08-27 16:14:19 +03:00
Dmitry Rubashkin
17f18e42c0 new line 2019-08-27 16:13:40 +03:00
Dmitry Rubashkin
f1f85a5a24 Fixed case with single subquery and added tests. 2019-08-27 16:09:58 +03:00
alexey-milovidov
8db93d392b
Merge pull request #6685 from yandex/merge_tree_settings_alter
Alter merge tree settings with other types of alter
2019-08-27 16:07:28 +03:00
alesapin
36472b14f9 Defend kafka storage from alters 2019-08-27 12:48:20 +03:00
alesapin
7851d8fe0a Add ability to alter settings with other types of alter 2019-08-27 12:34:53 +03:00
Alexey Milovidov
57fa4e1dd7 Minor lock improvement for ReplicatedMergeTree 2019-08-27 00:40:29 +03:00
alexey-milovidov
561b173ddc
Merge pull request #6675 from yandex/simplify-shared-ptr-helper
Simplify shared_ptr_helper
2019-08-27 00:36:52 +03:00
CurtizJ
5f25c2d7b4 merging with master 2019-08-26 22:49:52 +03:00
CurtizJ
1774ac4b9e Merge remote-tracking branch 'upstream/master' into HEAD 2019-08-26 22:29:12 +03:00
Alexey Milovidov
0eec226c9a Simplify shared_ptr_helper 2019-08-26 22:07:29 +03:00
Dmitry Rubashkin
0c75d5f42b Function transformQueryForExternalDatabase() fixed 2019-08-26 22:03:47 +03:00
alesapin
cf31187254 Resolve conflicts 2019-08-26 21:08:58 +03:00
alesapin
0d0ebf885f Remove two redundant arguments from alter 2019-08-26 17:50:34 +03:00
alesapin
dff0cc1e1c Remove COW and add MultiVersion 2019-08-26 17:24:29 +03:00
Alexey Milovidov
479b4d81f3 Fixed error 2019-08-26 16:46:07 +03:00
Alexey Milovidov
60d660e263 Merge branch 'master' into merge-constraints 2019-08-26 16:13:44 +03:00
alexey-milovidov
c2b6cffabc
Update IStorage.cpp 2019-08-26 15:39:35 +03:00
alesapin
062034dfd8 Eventually merged with master 2019-08-26 13:07:32 +03:00
Alexey Milovidov
25635d1ab0 Fixed build of tests 2019-08-26 05:46:21 +03:00
Alexey Milovidov
2a3e0eb1f1 Merge branch 'master' into merge-constraints 2019-08-26 04:30:31 +03:00
Vitaliy Zakaznikov
7fb13b12f9 Reverting to previous no users thread functionality to avoid
keeping no users thread always alive for each live view.
2019-08-25 08:27:47 -04:00
Vitaliy Zakaznikov
2342d64d1b * Updating no users thread to sleep 3 times longer when users are present
to reduce the number of times thread wakes up.
* Updating startNoUsersThread to return if the thread is already running.
2019-08-25 07:36:08 -04:00
Vitaliy Zakaznikov
62988800e6 Rewriting implementation of LIVE VIEW no users thread. 2019-08-24 21:40:24 -04:00
Alexey Milovidov
d798cbde2f Fixed double whitespaces 2019-08-25 01:28:06 +03:00
Nikita Vasilev
2dbfabd08c fix Set index check useless (#6651)
* fixed useless detection

* fixed useless detection

* fix

* fix

* fix
2019-08-25 01:01:36 +03:00
Alexey Milovidov
3fef8e92ad Merging CONSTRAINTS support 2019-08-25 00:20:20 +03:00
alexey-milovidov
eeeaf8fbee
Merge pull request #6643 from yandex/double-whitespaces
Added a check for double whitespaces
2019-08-23 23:10:12 +03:00
alexey-milovidov
012a5f8911
Merge pull request #6596 from Enmk/hasToken
hasToken function implementation
2019-08-23 21:41:33 +03:00
Alexey Milovidov
b42f85e16b Added a check for double whitespaces 2019-08-23 21:30:04 +03:00
Alexey Milovidov
4366791b63 Merge branch 'table-constraints' of https://github.com/NanoBjorn/ClickHouse into NanoBjorn-table-constraints 2019-08-23 07:49:10 +03:00
alexey-milovidov
7012a421c6
Merge branch 'master' into alter_table_drop_detached_part 2019-08-23 05:22:07 +03:00
alexey-milovidov
3a237b4375
Merge pull request #6617 from yandex/fix_too_many_parts_while_mutation_6502
Fix too many parts while mutation
2019-08-23 04:27:43 +03:00
Alexey Milovidov
78c3be175c Added experimental setting for LIVE VIEWs 2019-08-23 02:46:40 +03:00
Alexey Milovidov
c4712f1e6e Make the code less bad 2019-08-23 02:22:57 +03:00
Alexey Milovidov
859736d935 Basic code quality of Live View 2019-08-23 01:41:30 +03:00
Alexander Tokmakov
81022bb3e9 Merge branch 'master' into alter_table_drop_detached_part 2019-08-22 23:38:58 +03:00
Alexander Tokmakov
acce56095f limit number of background threads for mutations 2019-08-22 22:35:46 +03:00
Vasily Nemkov
6d78e3be94 hasToken function implementation
* Function to check if given token is present in a string;
* Special case for hasToken to 'tokenbf_v1' index;
* Test cases for hasToken()
* Test case for hasToken() + 'tokenbf_v1' integration
2019-08-22 18:00:35 +03:00
alexey-milovidov
903601d3e3
Merge pull request #6600 from yandex/distributed-files-to-send-metric
Added a metric for the number of files to send in Distributed tables.
2019-08-22 07:34:09 +03:00
alexey-milovidov
f0e0793cdd
Merge pull request #6581 from yandex/assert_cast
Added checks to static_cast of columns.
2019-08-22 05:09:34 +03:00
Alexey Milovidov
6bbf3bd634 Added a metric for the number of files to send in Distributed tables 2019-08-22 04:30:49 +03:00
alesapin
b9d3d04c57 Move tasks in schedule pool 2019-08-21 19:02:13 +03:00
alesapin
be5dd3b994 Remove stupid logic 2019-08-21 16:15:44 +03:00
alesapin
6b85834ae3 Remove excessive logging 2019-08-21 16:11:08 +03:00
Alexander Tokmakov
5cb8605f61 limit number of mutations in the queue 2019-08-21 16:10:33 +03:00
alesapin
d2fe947535 Add test for race condition, found it and fix it 2019-08-21 15:32:48 +03:00
alesapin
eb5e052855 merge and fixes 2019-08-21 13:09:29 +03:00
alesapin
70ca7f4156 Merge with master 2019-08-21 11:57:35 +03:00
alexey-milovidov
308baa182e
Merge branch 'master' into table-constraints 2019-08-21 06:33:08 +03:00
Alexey Milovidov
d848009827 Fixed false data race in "MergeTreeDataPart::is_frozen" field 2019-08-21 06:16:59 +03:00
Alexey Milovidov
8966520801 Added "assert_cast" function as a replacement for static_cast for columns 2019-08-21 05:28:04 +03:00
alexey-milovidov
3f607b21fe
Merge pull request #6375 from yandex/try-to-remove-dry-run
Try to remove dry run
2019-08-21 03:52:41 +03:00
alexey-milovidov
58358ec856
Merge pull request #6514 from yandex/added-test-for-race-conditions
Added a test for race conditions.
2019-08-21 01:33:34 +03:00
Alexey Milovidov
c1de51dc5b Better code 2019-08-20 22:53:27 +03:00
alexey-milovidov
f9968fbcfc
Merge pull request #6554 from yandex/add-table-finctions-number-mt
Add table function numbers_mt
2019-08-20 22:42:27 +03:00
alexey-milovidov
31a4b816fe
Merge pull request #6566 from yandex/filimonov-remove-duplicated-const
remove doubled const TABLE_IS_READ_ONLY
2019-08-20 22:24:40 +03:00
alesapin
e44ab4f4cd Add tests for partitions alter 2019-08-20 22:04:58 +03:00
alesapin
8417eb9d95 Remove old tests 2019-08-20 21:35:35 +03:00