thevar1able/ClickHouse
1
0
Fork 0
mirror of https://github.com/ClickHouse/ClickHouse.git synced 2024-12-17 11:52:27 +00:00
Code Issues Packages Projects Releases Wiki Activity
32,154 Commits 9,326 Branches 1,784 Tags 2.1 GiB
cb777f6c50
Commit Graph

5439 Commits

Author SHA1 Message Date
alexey-milovidov
56bd02cf3a
Merge pull request #7016 from ClickHouse/yet-another-minor-changes-and-docs-for-hdfs 
Cleanup hdfs docs (instead of #6876 for  #5371)
 2019-09-24 02:23:59 +03:00
alexey-milovidov
e2cc551b22
Merge pull request #6914 from maqroll/master 
+ Redirect URL Storage
 2019-09-24 02:07:06 +03:00
Nikolai Kochetov
5108ebeece Remove Block from RangeReader. 2019-09-23 22:22:02 +03:00
Alexey Milovidov
8579c26efb Changed repository URL 2019-09-23 19:18:19 +03:00
Olga Khvostikova
a6296b2eb0
Merge branch 'master' into yet-another-minor-changes-and-docs-for-hdfs 2019-09-23 18:16:01 +03:00
stavrolia
fbe3270dfb need to mention... 2019-09-23 17:50:33 +03:00
Vladimir Chebotarev
f8c0fef919 Attempt to make table-level setting s3_min_upload_part_size. 2019-09-23 12:41:59 +00:00
maqroll
a6e7519f9d Merge remote-tracking branch 'upstream/master' 2019-09-23 07:55:07 +00:00
philip.han
613927c36c Removed useless code and improve type checking for bloom_filter index 2019-09-23 12:40:48 +09:00
Alexey Milovidov
bdea16e308 Merging S3: Moved S3 settings to <s3> in config to correspond to <merge_tree> and <kafka> 2019-09-23 01:44:10 +03:00
Alexey Milovidov
c03857b2ae Merging S3: part 2 2019-09-23 01:13:42 +03:00
alexey-milovidov
2054f80623
Merge pull request #5596 from excitoon-favorites/table_function_s3 
s3 table function and storage
 2019-09-23 00:53:06 +03:00
alexey-milovidov
5970aafd9a
Merge pull request #7032 from azat-archive/distributed-directory-monitor-SIGSEGV 
Avoid SIGSEGV on batch send failure (file with index XX is absent)
 2019-09-22 05:12:55 +03:00
Azat Khuzhin
b22b65dd29
Avoid SIGSEGV on batch send failure (file with index XX is absent) 
In case of the following error:
  Failed to send batch: file with index 23742 is absent

NULL dereference will occur for the "remote".
 2019-09-21 02:22:25 +03:00
Alexey Milovidov
42b739550b Renamed "storage_policy_name" to "storage_policy" 2019-09-20 23:35:50 +03:00
alexey-milovidov
123b8cb43c
Merge pull request #6990 from Akazz/timeout_for_sync_replica_cmd 
Fixed timeout mechanism for SYNC REPLICA command + simplified related code
 2019-09-20 20:32:51 +03:00
Ivan
cffc254922
Always read and insert Kafka messages as a whole (#6950) 
* Always read and insert Kafka messages as a whole.
 2019-09-20 15:12:32 +03:00
stavrolia
7309e813bc cleanup hdfs docs 2019-09-20 14:26:00 +03:00
alesapin
b289d7e6a5 Fix system contributors generating script 2019-09-19 17:41:49 +03:00
Akazz
4ae3db45c6 Fixed timeout reading in SYNC REPLICA 2019-09-19 14:04:57 +03:00
philip.han
365f61c896 Fix code-style 2019-09-19 18:24:07 +09:00
maqroll
3765084358 Proper ReadWriteBufferFromHTTP constructor args 2019-09-19 07:33:54 +00:00
Artem Zuikov
aae82eed5a
Merge pull request #6940 from 4ertus2/mjoin 
PartialMergeJoin
 2019-09-18 16:16:10 +03:00
root
ea5480fd72 merge 
Committer: maqroll <loteroc@gmail.com>
 2019-09-18 13:13:40 +00:00
CurtizJ
79a08ef8ea Merge remote-tracking branch 'upstream/master' into merging_redis 2019-09-18 12:58:22 +03:00
philip.han
b25151b61b Make bloom_filter-index support some types of Arrays. 2019-09-18 18:32:44 +09:00
Azat Khuzhin
780341060f
Replace libsparsehash with sparsehash-c11 
- use sparsehash-c11 over libsparsehash
- fix typos in find_sparsehash and users of the vars (s/SPARCE/SPARSE/)
- drop libsparsehash-dev from docker images (but keep for unbunlded build)
- use ::google over GOOGLE_NAMESPACE
 2019-09-18 00:08:20 +03:00
CurtizJ
df82e4bde8 fix build 2019-09-17 17:55:09 +03:00
CurtizJ
4480e97f9f fix build 2019-09-17 17:16:07 +03:00
root
5ec0005400 +UpdatableSessionBase 
Committer: maqroll <loteroc@gmail.com>
 2019-09-16 17:28:41 +00:00
chertus
cbd96af079 fix use after free (change Join <-> AnalyzedJoin ownership) 2019-09-16 15:37:46 +03:00
alexey-milovidov
6503369138
Merge pull request #6895 from azat-archive/distributed_directory_monitor_max_sleep_time-v2 
[RFC] Drop max_sleep_time limit from StorageDistributedDirectoryMonitor
 2019-09-14 18:39:27 +03:00
Nikolai Kochetov
3c53dfd227 Add processors to StorageMergeTree [WIP]. 2019-09-13 18:41:09 +03:00
Nikolai Kochetov
1f5e62d741 Added IStorage::readWithProcessors. 2019-09-13 15:59:48 +03:00
alesapin
02cff38fef Merge with master 2019-09-13 13:58:23 +03:00
Vladimir Chebotarev
1b715069fb Merge fix. 2019-09-12 14:38:53 +00:00
Vladimir Chebotarev
599ff389f7 Merge fix. 2019-09-12 11:57:55 +00:00
Azat Khuzhin
02befdd8c2
Introduce distributed_directory_monitor_max_sleep_time_ms setting 
This will replace static 30 seconds max_sleep_time for the
StorageDistributedDirectoryMonitor, since in some cases 30 seconds can
be too large.
 2019-09-12 03:16:06 +03:00
alesapin
b0fce77c3d Fix path to data on disk 2019-09-11 20:17:10 +03:00
l
cdbcfc2c90 + Redirect 2019-09-11 18:39:30 +02:00
chertus
73dafaa223 better required-right-keys logic 2019-09-11 18:57:09 +03:00
Ivan Lezhankin
c5f1352394 Decide to put delimiter only after polled message 2019-09-11 16:16:43 +03:00
alesapin
0b8aec469f Make absolute path on disks start from /clickhouse/data, fix freeze and rename, add tests 2019-09-11 13:57:32 +03:00
Amos Bird
a1310ffbe6 Split libdbms.so using object library 
Now the linking time of incremental builds are around 1-2 seconds
 2019-09-11 01:56:01 +08:00
alesapin
34a454aa62 Remove redundant code, that caused race for part object 2019-09-10 20:17:10 +03:00
alesapin
5a45265344 Create global dir 2019-09-10 17:32:32 +03:00
alesapin
65851e27d0 Fix freeze partition 2019-09-10 16:06:26 +03:00
alesapin
ac4ab3ca2b Fix rename bug 2019-09-10 15:23:18 +03:00
alesapin
193049293a More comments, more readable code 2019-09-10 14:21:59 +03:00
alesapin
4702e40ed7 Fix bug with b_free and small refactoring 2019-09-10 11:56:27 +03:00
chertus
1b313eedfa MergeJoin in progress 2019-09-09 22:43:37 +03:00
alesapin
23f2cb5016 Remove double space 2019-09-09 20:02:52 +03:00
alesapin
189644e743 Better logging 2019-09-09 20:01:19 +03:00
Ivan
6c32fc3fc1
Store offsets manually for each message (#6872) 2019-09-09 19:59:51 +03:00
alesapin
9f88baebb9 More constants, better tests 2019-09-09 16:50:19 +03:00
alesapin
2288d25972 Add parser test 2019-09-09 15:41:46 +03:00
alesapin
ef08d6f10b More tests 2019-09-09 15:28:28 +03:00
alesapin
27419c965e Merge with master 2019-09-09 14:13:36 +03:00
alexey-milovidov
8389200229
Merge pull request #6832 from CurtizJ/merging_input_function 
Merging #5450 (table function input).
 2019-09-07 20:16:45 +03:00
alexey-milovidov
25de2e12a2
Merge pull request #6399 from Enmk/replica_recovery_interval 
Improvements for failover of Distributed queries
 2019-09-07 03:21:30 +03:00
stavrolia
f533485d19 Minor code cleanup 2019-09-06 21:29:41 +03:00
alesapin
cfd753a1f3 Add test and found bugs 2019-09-06 18:09:20 +03:00
Anton Popov
69da4f30b3
Merge branch 'master' into merging_input_function 2019-09-06 16:20:00 +03:00
alesapin
ea8e543b1a Add protocol version to cookies 2019-09-06 15:18:56 +03:00
alesapin
0c9a9dee1c Merge with master 2019-09-06 11:53:32 +03:00
Olga Khvostikova
4129d8cf60
Merge pull request #6092 from yandex/globs-in-file-one-more-attempt 
Globs in storage file and HDFS
 2019-09-05 23:05:37 +03:00
stavrolia
5e37510aae Better 2019-09-05 21:09:19 +03:00
alesapin
ab518d7787 Split code to parts 2019-09-05 18:53:23 +03:00
stavrolia
587a780ba2 Better 2019-09-05 17:42:17 +03:00
CurtizJ
b04cea7463 minor fixes of table function input 2019-09-05 16:17:01 +03:00
alesapin
f576cbb8a4 Simplify code 2019-09-05 16:12:29 +03:00
Vasily Nemkov
c2fc71b5e5 Post-PR fixes 
Renamed settings, updated docs.
 2019-09-05 13:35:36 +03:00
alesapin
b71faee8cd Merge branch 'master' into ObjatieGroba-feature_multiple_disks 2019-09-05 13:19:05 +03:00
Ivan
ab7df6b6dd
Fix kafka tests (#6805) 
* Commit offsets more precisely
* Get rid of DelimitedReadBuffer since read buffers don't line up well
* Increase timeouts
 2019-09-05 00:25:33 +03:00
stavrolia
5d6959173c Improvement 2019-09-04 22:55:56 +03:00
alesapin
66362cedbc Refactoring 2019-09-04 21:26:18 +03:00
alesapin
c003f443f9 Refactor 2019-09-04 20:26:53 +03:00
Vladimir Chebotarev
fa01cc162c Merge fix. 2019-09-04 16:10:25 +00:00
alesapin
13bbae5860 Remove trash 2019-09-04 19:00:20 +03:00
Vladimir Chebotarev
97b7635c8a Minimum block size to configuration. 2019-09-04 13:39:54 +00:00
Vladimir Chebotarev
dd32c92f2a Minor fixes. 2019-09-04 13:39:53 +00:00
Vladimir Chebotarev
1944ff1a48 POST to PUT, refactoring. 2019-09-04 13:39:53 +00:00
Vladimir Chebotarev
78f57c5f2a First attempt to make redirects. 2019-09-04 13:39:53 +00:00
Vladimir Chebotarev
ff09934219 Table function and storage. 2019-09-04 13:39:53 +00:00
Vladimir Chebotarev
47985cf8a7 Wrong commit. 2019-09-04 13:39:53 +00:00
Vladimir Chebotarev
ce69683673 Copy-paste from StorageFile. 2019-09-04 13:39:53 +00:00
alesapin
a4c3937153 Small refactoring 2019-09-04 16:24:55 +03:00
alesapin
8b6abab486 Merge branch 'master' into ObjatieGroba-feature_multiple_disks 2019-09-04 15:41:27 +03:00
CurtizJ
7accc09066 Merge branch 'palasonic-add-input-function' of https://github.com/palasonic1/ClickHouse into merging_input_function 2019-09-04 15:25:20 +03:00
alesapin
18ef235a3f Fix indices mrk file extension 2019-09-04 15:22:20 +03:00
alesapin
16a544f300 Fix bug with mutations after granularity change 2019-09-04 15:19:42 +03:00
stavrolia
32bf915610 More docs 2019-09-04 14:11:30 +03:00
alesapin
e6e6c11ba3 Better test and NOTHING_TO_DO 2019-09-03 20:06:36 +03:00
alesapin
52442cf549 Add system stop moves query 2019-09-03 17:50:49 +03:00
alesapin
48004e9b7b Style fixes 2019-09-03 15:25:58 +03:00
alexey-milovidov
ab75e8c26d
Merge pull request #6205 from zhang2014/fix/some_mutation 
fix some mutation bug
 2019-09-03 14:33:20 +03:00
alesapin
8d76febe02 Add moves to part log 2019-09-03 14:32:25 +03:00
alesapin
0e47bbca4d Fix style check 2019-09-03 12:18:02 +03:00
alesapin
d08d99954f Ugly working code 2019-09-03 11:48:43 +03:00
alesapin
27b0a06005 Fix stupid bug 2019-09-03 11:30:59 +03:00
alesapin
e7308c1f21 Merge branch 'master' into ObjatieGroba-feature_multiple_disks 2019-09-03 11:02:32 +03:00
alesapin
f0c5ee5877 Merge with master 2019-09-02 20:34:18 +03:00
alesapin
5af8c196bd Move initialization of MergedColumnOnlyStream to constructor 2019-09-02 19:31:09 +03:00
Vasily Nemkov
f98c488834 Post-review fixes 
* Actually using the replica recovery settings for cluster
* A bit of doc on DBMS_CONNECTION_POOL_WITH_FAILOVER_MAX_ERROR_COUNT
* StorageDistributedDirectoryMonitor using settings for ConnectionPoolWithFailover
* Using SettingSeconds instead of SettingUInt64 for replica_error_decrease_period
 2019-09-02 17:26:25 +03:00
Vasily Nemkov
84fc4ba4c8 Replica recovery fixes 
* Added a limit on how many errors can replica accumulate
* Decreased default error halving time to 60 seconds
* Made both configurable via settings
* Showing errors count and estimated recovery time for each replica in system.clusters
 2019-09-02 17:26:25 +03:00
alesapin
198031f787 Refactoring 2019-09-02 14:35:53 +03:00
alesapin
e7ee9b7a67 Merge master 2019-09-02 11:46:00 +03:00
alexey-milovidov
2e86aece86
Merge pull request #6763 from yandex/add-os-thread-ids-in-system-tables 
Add "os_thread_ids" column to system tables
 2019-09-01 04:30:16 +03:00
alexey-milovidov
1dd28867b0
Merge pull request #6689 from yandex/merge_tree_settings_alter 
Refactoring of immutable settings
 2019-09-01 04:29:47 +03:00
Alexey Milovidov
cb79e2371e Add "os_thread_ids" column to system tables 2019-09-01 00:47:15 +03:00
alesapin
7382a9f3c3 Rename method for settings check 2019-09-01 00:15:40 +03:00
Alexey Milovidov
bb0ca310ab Allow to ATTACH live views 2019-08-31 02:38:03 +03:00
alesapin
2647d4ca15 Rename immutable to readonly 2019-08-30 23:12:26 +03:00
alesapin
6f30338c08 Fixes 2019-08-30 21:31:35 +03:00
alexey-milovidov
6352c57afb
Merge pull request #6748 from yandex/fix_bad_size_of_marks 
Fix bad size of marks with skip indices
 2019-08-30 20:26:59 +03:00
alesapin
808f4d0b8a Intermediate refactoring 2019-08-30 19:50:59 +03:00
stavrolia
974789d379 add const 2019-08-30 18:19:05 +03:00
alesapin
d4ea6a5234 Fix comment 2019-08-30 17:30:28 +03:00
alesapin
f6120558df Fix bad size of marks 2019-08-30 17:29:08 +03:00
alesapin
d7e54d3c14 Merge branch 'master' of github.com:yandex/ClickHouse into ObjatieGroba-feature_multiple_disks 2019-08-30 12:53:24 +03:00
Vitaly Baranov
da8f67123f Improve error handling in cache dictionaries: 
allow using expired values while the source of a cache dictionary doesn't respond;
clone the source after an error to reset connections;
don't ask the source for a little time after error;
show the last exception in system.dictionaries for a cache dictionary too.
 2019-08-30 12:50:38 +03:00
Alexey Milovidov
0bca68e50b Style 2019-08-29 21:55:20 +03:00
alesapin
1813b96f82 Finally build, possible trash. 2019-08-29 19:17:47 +03:00
Ivan
5851316742
Don't interrupt copyData() used inside Kafka materialized views (#6597) 
* Print better offsets on commit
* Stop consumption on the read buffer level
* Don't use cancellation in the middle of copyData()
* Add test
* Disable squashing stream for Kafka materialized views
* Commit last read message, since rdkafka auto-modifies offset
 2019-08-29 18:36:07 +03:00
alexey-milovidov
c19e5faf4c
Merge pull request #6717 from yandex/fix-data-race-in-storage-merge 
Fix for data race in StorageMerge
 2019-08-29 18:25:48 +03:00
alesapin
dac55278ad Better comments 2019-08-29 14:15:56 +03:00
alesapin
702b47ae5b Remove redundant changes 2019-08-29 13:56:43 +03:00
alesapin
0899b3818d Remove redundant changes 2019-08-29 13:49:26 +03:00
alesapin
67f9753775 Merge branch 'master' into bad_size_of_marks_skip_idx_bug 2019-08-29 11:07:56 +03:00
zhang2014
74c9eea657 fix test failure 2019-08-29 11:34:00 +08:00
zhang2014
3c7405bdb0 move test to integration & refer max_expanded_ast_elements 2019-08-29 11:31:22 +08:00
zhang2014
92740212b5 fix build failure 2019-08-29 11:15:15 +08:00
zhang2014
6c3626b629 truncate should remove mutations 2019-08-29 11:14:40 +08:00
zhang2014
54b65bac50 fix max_ast_elements settings with merge mutation 2019-08-29 11:06:35 +08:00
Alexey Milovidov
d1a980fcdd Fix for data race in StorageMerge 2019-08-29 01:18:26 +03:00
alesapin
b4d98f6e13 Trying to fix vertical merge 2019-08-28 21:23:20 +03:00
alexey-milovidov
44dd3bd792
Merge pull request #6692 from yandex/remove-queue_max_wait_ms 
Set default value of "queue_max_wait_ms" to zero, because current value makes no sense
 2019-08-28 21:06:09 +03:00
alexey-milovidov
7b9b67fd71
Merge pull request #6695 from yandex/improve-table-locks 
Avoid possible deadlock in TRUNCATE of Replicated table.
 2019-08-28 21:05:26 +03:00
Alexey Milovidov
d1c268c2ed Added setting "kafka_max_wait_ms" 2019-08-28 18:24:23 +03:00
alexey-milovidov
696d505a1a
Merge pull request #6656 from vzakaznikov/fix_live_view_no_users_thread 
Fix live view no users thread
 2019-08-28 16:33:36 +03:00
Alexey Milovidov
a1101e5278 Fixed build 2019-08-28 16:21:19 +03:00
Alexey Milovidov
8b973fd9f2 Merge branch 'improve-table-locks' of github.com:yandex/ClickHouse into improve-table-locks 2019-08-28 15:59:23 +03:00
Alexey Milovidov
625e128770 Merge branch 'master' into improve-table-locks 2019-08-28 15:41:30 +03:00
Alexey Milovidov
c8798b2ffa Slightly improve table locks 2019-08-28 02:47:30 +03:00
Alexey Milovidov
285d66cee1 Improve table locks (incomplete) 2019-08-27 23:43:08 +03:00
alexey-milovidov
c736d6b495
Merge pull request #6676 from dimarub2000/right_left_problem_#6381 
Query transformation for external database fixed.
 2019-08-27 23:11:39 +03:00
stavrolia
f4e0dceddb some changes 2019-08-27 18:20:31 +03:00
Alexey Milovidov
8ca00a26f6 Fixed build 2019-08-27 17:31:34 +03:00
Alexey Milovidov
c385c950ba Merge branch 'master' into replicate-merge-tree-minor-lock-improvement 2019-08-27 17:30:48 +03:00
alexey-milovidov
d12ced8099
Merge pull request #6191 from svladykin/ttldropparts 
TTL: Only drop altogether the expired parts and not partially prune them.
 2019-08-27 16:54:56 +03:00
alesapin
106b9717cd Refactoring of immutable settings 2019-08-27 16:14:19 +03:00
Dmitry Rubashkin
17f18e42c0 new line 2019-08-27 16:13:40 +03:00
Dmitry Rubashkin
f1f85a5a24 Fixed case with single subquery and added tests. 2019-08-27 16:09:58 +03:00
alexey-milovidov
8db93d392b
Merge pull request #6685 from yandex/merge_tree_settings_alter 
Alter merge tree settings with other types of alter
 2019-08-27 16:07:28 +03:00
alesapin
36472b14f9 Defend kafka storage from alters 2019-08-27 12:48:20 +03:00
alesapin
7851d8fe0a Add ability to alter settings with other types of alter 2019-08-27 12:34:53 +03:00
Alexey Milovidov
57fa4e1dd7 Minor lock improvement for ReplicatedMergeTree 2019-08-27 00:40:29 +03:00
alexey-milovidov
561b173ddc
Merge pull request #6675 from yandex/simplify-shared-ptr-helper 
Simplify shared_ptr_helper
 2019-08-27 00:36:52 +03:00
CurtizJ
5f25c2d7b4 merging with master 2019-08-26 22:49:52 +03:00
CurtizJ
1774ac4b9e Merge remote-tracking branch 'upstream/master' into HEAD 2019-08-26 22:29:12 +03:00
Alexey Milovidov
0eec226c9a Simplify shared_ptr_helper 2019-08-26 22:07:29 +03:00
Dmitry Rubashkin
0c75d5f42b Function transformQueryForExternalDatabase() fixed 2019-08-26 22:03:47 +03:00
alesapin
cf31187254 Resolve conflicts 2019-08-26 21:08:58 +03:00
alesapin
0d0ebf885f Remove two redundant arguments from alter 2019-08-26 17:50:34 +03:00
alesapin
dff0cc1e1c Remove COW and add MultiVersion 2019-08-26 17:24:29 +03:00
Alexey Milovidov
479b4d81f3 Fixed error 2019-08-26 16:46:07 +03:00
Alexey Milovidov
60d660e263 Merge branch 'master' into merge-constraints 2019-08-26 16:13:44 +03:00
alexey-milovidov
c2b6cffabc
Update IStorage.cpp 2019-08-26 15:39:35 +03:00
alesapin
062034dfd8 Eventually merged with master 2019-08-26 13:07:32 +03:00
Alexey Milovidov
25635d1ab0 Fixed build of tests 2019-08-26 05:46:21 +03:00
Alexey Milovidov
2a3e0eb1f1 Merge branch 'master' into merge-constraints 2019-08-26 04:30:31 +03:00
Vitaliy Zakaznikov
7fb13b12f9 Reverting to previous no users thread functionality to avoid 
keeping no users thread always alive for each live view.
 2019-08-25 08:27:47 -04:00
Vitaliy Zakaznikov
2342d64d1b * Updating no users thread to sleep 3 times longer when users are present 
to reduce the number of times thread wakes up.
* Updating startNoUsersThread to return if the thread is already running.
 2019-08-25 07:36:08 -04:00
Vitaliy Zakaznikov
62988800e6 Rewriting implementation of LIVE VIEW no users thread. 2019-08-24 21:40:24 -04:00
Alexey Milovidov
d798cbde2f Fixed double whitespaces 2019-08-25 01:28:06 +03:00
Nikita Vasilev
2dbfabd08c fix Set index check useless (#6651) 
* fixed useless detection

* fixed useless detection

* fix

* fix

* fix
 2019-08-25 01:01:36 +03:00
Alexey Milovidov
3fef8e92ad Merging CONSTRAINTS support 2019-08-25 00:20:20 +03:00
alexey-milovidov
eeeaf8fbee
Merge pull request #6643 from yandex/double-whitespaces 
Added a check for double whitespaces
 2019-08-23 23:10:12 +03:00
alexey-milovidov
012a5f8911
Merge pull request #6596 from Enmk/hasToken 
hasToken function implementation
 2019-08-23 21:41:33 +03:00
Alexey Milovidov
b42f85e16b Added a check for double whitespaces 2019-08-23 21:30:04 +03:00
Alexey Milovidov
4366791b63 Merge branch 'table-constraints' of https://github.com/NanoBjorn/ClickHouse into NanoBjorn-table-constraints 2019-08-23 07:49:10 +03:00
alexey-milovidov
7012a421c6
Merge branch 'master' into alter_table_drop_detached_part 2019-08-23 05:22:07 +03:00
alexey-milovidov
3a237b4375
Merge pull request #6617 from yandex/fix_too_many_parts_while_mutation_6502 
Fix too many parts while mutation
 2019-08-23 04:27:43 +03:00
Alexey Milovidov
78c3be175c Added experimental setting for LIVE VIEWs 2019-08-23 02:46:40 +03:00
Alexey Milovidov
c4712f1e6e Make the code less bad 2019-08-23 02:22:57 +03:00
Alexey Milovidov
859736d935 Basic code quality of Live View 2019-08-23 01:41:30 +03:00
Alexander Tokmakov
81022bb3e9 Merge branch 'master' into alter_table_drop_detached_part 2019-08-22 23:38:58 +03:00
Alexander Tokmakov
acce56095f limit number of background threads for mutations 2019-08-22 22:35:46 +03:00
Vasily Nemkov
6d78e3be94 hasToken function implementation 
* Function to check if given token is present in a string;
* Special case for hasToken to 'tokenbf_v1' index;
* Test cases for hasToken()
* Test case for hasToken() + 'tokenbf_v1' integration
 2019-08-22 18:00:35 +03:00
alexey-milovidov
903601d3e3
Merge pull request #6600 from yandex/distributed-files-to-send-metric 
Added a metric for the number of files to send in Distributed tables.
 2019-08-22 07:34:09 +03:00
alexey-milovidov
f0e0793cdd
Merge pull request #6581 from yandex/assert_cast 
Added checks to static_cast of columns.
 2019-08-22 05:09:34 +03:00
Alexey Milovidov
6bbf3bd634 Added a metric for the number of files to send in Distributed tables 2019-08-22 04:30:49 +03:00
alesapin
b9d3d04c57 Move tasks in schedule pool 2019-08-21 19:02:13 +03:00
alesapin
be5dd3b994 Remove stupid logic 2019-08-21 16:15:44 +03:00
alesapin
6b85834ae3 Remove excessive logging 2019-08-21 16:11:08 +03:00
Alexander Tokmakov
5cb8605f61 limit number of mutations in the queue 2019-08-21 16:10:33 +03:00
alesapin
d2fe947535 Add test for race condition, found it and fix it 2019-08-21 15:32:48 +03:00
alesapin
eb5e052855 merge and fixes 2019-08-21 13:09:29 +03:00
alesapin
70ca7f4156 Merge with master 2019-08-21 11:57:35 +03:00
alexey-milovidov
308baa182e
Merge branch 'master' into table-constraints 2019-08-21 06:33:08 +03:00
Alexey Milovidov
d848009827 Fixed false data race in "MergeTreeDataPart::is_frozen" field 2019-08-21 06:16:59 +03:00
Alexey Milovidov
8966520801 Added "assert_cast" function as a replacement for static_cast for columns 2019-08-21 05:28:04 +03:00
alexey-milovidov
3f607b21fe
Merge pull request #6375 from yandex/try-to-remove-dry-run 
Try to remove dry run
 2019-08-21 03:52:41 +03:00
alexey-milovidov
58358ec856
Merge pull request #6514 from yandex/added-test-for-race-conditions 
Added a test for race conditions.
 2019-08-21 01:33:34 +03:00
Alexey Milovidov
c1de51dc5b Better code 2019-08-20 22:53:27 +03:00
alexey-milovidov
f9968fbcfc
Merge pull request #6554 from yandex/add-table-finctions-number-mt 
Add table function numbers_mt
 2019-08-20 22:42:27 +03:00
alexey-milovidov
31a4b816fe
Merge pull request #6566 from yandex/filimonov-remove-duplicated-const 
remove doubled const TABLE_IS_READ_ONLY
 2019-08-20 22:24:40 +03:00
alesapin
e44ab4f4cd Add tests for partitions alter 2019-08-20 22:04:58 +03:00
alesapin
8417eb9d95 Remove old tests 2019-08-20 21:35:35 +03:00
Alexey Milovidov
295aafb13f Parallel ALTER modify: don't use ThreadPool if the number of threads is one 2019-08-20 21:18:37 +03:00
Alexey Milovidov
c8859febcb Merge branch 'master' into added-test-for-race-conditions 2019-08-20 21:05:25 +03:00
alesapin
120e27a385 Lock parts with dirty hack 2019-08-20 21:00:48 +03:00
alesapin
9c8ec6e4fc Fixes for replicated merge tree 2019-08-20 20:16:32 +03:00
Nikolai Kochetov
822fe63f3b Added comment. 2019-08-20 19:13:18 +03:00
Nikolai Kochetov
aef03fd9bf
Merge pull request #6425 from yandex/vzakaznikov-liveview 
Merge LIVE VIEW
 2019-08-20 17:13:42 +03:00
Nikolai Kochetov
7bd748c969 Renamed NumbersMtBlockInputStream to NumbersMultiThreadedBlockInputStream. 2019-08-20 17:13:06 +03:00
filimonov
8d0c2eacfd
remove doubled const TABLE_IS_READ_ONLY 2019-08-20 13:18:08 +02:00
Ivan
a502424c33
Implement support for insertion into Kafka tables (#6012) 
* Add write-callback on each row for RowOutputStream
* Fix build of new rdkafka library
* Poll messages if Kafka outgoing queue is full
* Add test
* Add test producer-consumer
* Truncate delimiter from last row in message
 2019-08-20 14:17:57 +03:00
Nikolai Kochetov
0c0e5010dc Added NumbersMtBlockInputStream. 2019-08-20 13:29:04 +03:00
Nikolai Kochetov
7f31b8bf9c Added NumbersMtBlockInputStream. 2019-08-20 13:28:20 +03:00
alesapin
00bdd6c680 Support move partition 2019-08-20 12:59:19 +03:00
Gleb Novikov
86fecc7501 Merge branch 'master' into table-constraints 2019-08-20 12:17:56 +03:00
alesapin
5690498424 Remove excessive logging 2019-08-20 11:44:09 +03:00
alesapin
8408ffbfa6 Almost working replicated MT 2019-08-20 11:38:02 +03:00
Nikolai Kochetov
cdf1ce3171 Merge branch 'master' into vzakaznikov-liveview 2019-08-20 10:41:31 +03:00
Alexey Milovidov
b7cb55a06e Added a comment 2019-08-20 04:46:48 +03:00
Alexey Milovidov
a574727269 Attempt to fix deadlock 2019-08-20 04:24:53 +03:00
Alexey Milovidov
666029db6e Merge branch 'added-test-for-race-conditions' of github.com:yandex/ClickHouse into added-test-for-race-conditions 2019-08-20 03:50:40 +03:00
Alexey Milovidov
99aa5cce38 Fixed idiotic error in system.parts 2019-08-20 03:49:58 +03:00
Alexey Milovidov
f1fef3f169 Merge branch 'master' of github.com:yandex/ClickHouse 2019-08-20 03:48:24 +03:00
Alexey Milovidov
e594c344f5 Fixed idiotic error in system.parts 2019-08-20 03:48:08 +03:00
alexey-milovidov
3a909c54c5
Merge pull request #6523 from yandex/fix_inconsistent_parts_after_clone_replica 
Fix inconsistent parts after clone replica
 2019-08-20 02:25:00 +03:00
alexey-milovidov
fe634d69fe
Merge pull request #6550 from yandex/fix_6125 
Fix NPE when using IN clause with a subquery with a tuple
 2019-08-20 01:39:02 +03:00
Alexander Kazakov
fe5cd47068
Process prewhere clause in "skip unused shards" optimization (#6521) 
* Process prewhere clause in optimize_skip_unused_shards

* Better diagnostics and logging
 2019-08-19 23:28:24 +03:00
Alexey Milovidov
5575be034d Whitespaces 2019-08-19 22:32:02 +03:00
Alexey Milovidov
22a11343e8 Attempt to fix race condition 2019-08-19 22:02:20 +03:00
stavrolia
1190e866aa Fix 2019-08-19 21:12:50 +03:00
stavrolia
b3fd5bc141 Add tests, comments and fix 2019-08-19 21:12:50 +03:00
stavrolia
2f2bf953eb fix and add test for storage file version 2019-08-19 21:12:50 +03:00
stavrolia
32fad1e961 fix 2019-08-19 21:12:50 +03:00
stavrolia
229dd7c2b6 wip 2019-08-19 21:12:50 +03:00
stavrolia
f9037fee2c Fix File version 2019-08-19 21:12:50 +03:00
stavrolia
b386b3090c Impove HDFS version 2019-08-19 21:12:50 +03:00
stavrolia
95cb95105d Add recursive version for storage file 2019-08-19 21:12:50 +03:00
stavrolia
7addd50c16 recursive version for StorageHDFS and some tests for it 2019-08-19 21:12:50 +03:00
stavrolia
a3b35d5569 WIP 2019-08-19 21:12:50 +03:00
stavrolia
e6d85de79a wip small change 2019-08-19 21:12:50 +03:00
stavrolia
6055c61e7f wip hdfs 2019-08-19 21:12:50 +03:00
stavrolia
dbf1417bd6 Globs in storage file 2019-08-19 21:12:50 +03:00
Alexey Milovidov
d2e5789f82 Fixed strange code in mutations that may lead to memory corruption 2019-08-19 21:12:22 +03:00
alesapin
e9e67a2688 Almost compilable 2019-08-19 20:59:16 +03:00
Alexander Tokmakov
c62eb7a3ae check columns count and types 2019-08-19 19:51:50 +03:00
alesapin
4ccdb8f92e Better code 2019-08-19 17:40:12 +03:00
Alexander Tokmakov
be5df60c7a Merge branch 'master' into fix_inconsistent_parts_after_clone_replica 2019-08-19 17:34:22 +03:00
Alexander Tokmakov
6991683a5f remove local parts which source replica doesnt have 2019-08-19 15:08:45 +03:00
alesapin
f2a8c18c1f Simplify lock 2019-08-19 14:18:58 +03:00
alesapin
69015f292e Fix wrong merge 2019-08-19 14:18:39 +03:00
alesapin
6d29ed99d9 Fix bug with enable_mixed_granularity_parts and mutations 2019-08-19 13:37:04 +03:00
alesapin
a85cdc91a6 Merge branch 'master' into ObjatieGroba-feature_multiple_disks 2019-08-19 11:34:02 +03:00
alesapin
99e85ff753 Fix build 2019-08-19 11:25:07 +03:00
alesapin
e7542810bb Merge with master 2019-08-19 11:20:48 +03:00
Nikolai Kochetov
cb848159e1 Merged with master. 2019-08-18 14:52:49 +03:00
alexey-milovidov
e2687fc2d5
Merge pull request #6513 from yandex/parts-race-condition 
Fix race condition in system.parts vs. ALTER
 2019-08-17 22:30:16 +03:00
alesapin
defc1e30ca Some improvements 2019-08-16 18:57:19 +03:00
alesapin
af2a947ba1
Update StorageSystemParts.cpp 2019-08-16 18:06:02 +03:00
Nikolai Kochetov
7da72261a2 Merge branch 'master' into try-to-remove-dry-run 2019-08-16 15:50:48 +03:00
Nikolai Kochetov
18ad0e7e6b Merged with master. 2019-08-16 13:55:40 +03:00
alesapin
6333f4b074 Better 2019-08-16 12:20:44 +03:00
Alexey Milovidov
b66719725f Fix race condition in system.parts vs. ALTER 2019-08-16 03:49:33 +03:00
alexey-milovidov
01a046e8ca
Merge pull request #5053 from nikvas0/nikvas0/index_mutate 
indices and mutations
 2019-08-16 02:44:48 +03:00
alexey-milovidov
a466c7aebd
Merge pull request #6299 from CurtizJ/order-by-efficient 
Optimizations of ranges selection while reading with enabled optimize_read_in_order.
 2019-08-16 02:39:53 +03:00
alexey-milovidov
a70bfa13d4
Merge pull request #6467 from nikitamikhaylov/system_metric_log 
system.metric_log table
 2019-08-16 02:28:53 +03:00
alesapin
f988ff538b Less code 2019-08-15 20:02:04 +03:00
Nikita Vasilev
00a5fe7836 Merge remote-tracking branch 'upstream/master' into nikvas0/index_mutate 2019-08-15 19:48:57 +03:00
alesapin
d81961c4ca Fix strange code 2019-08-15 12:43:31 +03:00
Gleb Novikov
ab1c4139de Added ReplicatedMergeTree support and test for constraints, also added VIOLATED_CONSTRAINT error 2019-08-14 22:51:03 +03:00
CurtizJ
0b3d7d8032 Merge remote-tracking branch 'upstream/master' into order-by-efficient 2019-08-14 21:26:25 +03:00
alesapin
e391ce813d refactoring 2019-08-14 18:20:52 +03:00
Nikolai Kochetov
287eb633b8 Merged with master 2019-08-14 18:16:52 +03:00
Nikolai Kochetov
0635188104 Allow constants for RemoteBlockInputStream. 2019-08-14 18:14:32 +03:00
chertus
ddde50c542 minor fixes in includes 2019-08-14 17:06:16 +03:00
alesapin
6a283b6bde Remove segfault 2019-08-14 14:59:45 +03:00
alesapin
a2ca18d287 Fix test 2019-08-14 13:30:36 +03:00
alesapin
949890ee90 Merged 2019-08-14 12:46:30 +03:00
CurtizJ
94bca8315d Merge remote-tracking branch 'upstream/master' into order-by-efficient 2019-08-14 01:41:38 +03:00
alesapin
96f62fefcc Add mutex for settings 2019-08-13 19:34:52 +03:00
alesapin
031bfc7bf3 Remove reference 2019-08-13 17:46:18 +03:00
Nikita Mikhaylov
bbe20b3f9f done 2019-08-13 17:31:46 +03:00
alesapin
f988090111 Remove redundant move 2019-08-13 15:10:58 +03:00
alesapin
b00903330f Remove empty block 2019-08-13 15:03:42 +03:00
alesapin
bf5ec73582 Fix clang build 2019-08-13 14:40:45 +03:00
alesapin
7b1039568c Revert old changed 2019-08-13 14:24:18 +03:00
alesapin
ad81c743c1 Buildable code 2019-08-13 13:29:31 +03:00
alesapin
428c753ed7 Merge with master 2019-08-13 11:37:47 +03:00
alesapin
8e72d4c2ec Tryin COW settings 2019-08-13 11:35:49 +03:00
alesapin
98d38e041f Fix recreation of replicated table with fixed granularity 2019-08-12 16:30:29 +03:00
Nikolai Kochetov
43e5cbe35c Fix build/ 2019-08-12 14:06:28 +03:00
Nikolai Kochetov
18939a5776 Fix build/ 2019-08-12 13:59:45 +03:00
Nikolai Kochetov
631bbde420 Merged with master. 2019-08-12 13:19:13 +03:00
Alexey Milovidov
fbaf6b9a4b Parallel loading of data parts #6074 2019-08-11 23:02:51 +03:00
Alexey Milovidov
0b1a4420cb More simple 2019-08-11 22:30:39 +03:00
Alexey Milovidov
006a5e51b7 Merge branch 'master' into speed-up-parts-removal 2019-08-11 22:26:24 +03:00
Alexey Milovidov
1cd87078c2 Merge branch 'master' of github.com:yandex/ClickHouse 2019-08-11 22:24:53 +03:00
Alexey Milovidov
2f73b72007 Style 2019-08-11 22:24:42 +03:00
Alexey Milovidov
ed7db76c94 Speed-up parts removal #6372 2019-08-11 22:14:42 +03:00
Gleb Novikov
3b9e1f9bf7 Fixed getIdentifierName call in AlterCommand::parse 2019-08-11 13:39:17 +03:00
Gleb Novikov
381ea6cb6e Merge branch 'master' into table-constraints 2019-08-11 12:38:34 +03:00
alexey-milovidov
25e97b0b87
Merge pull request #6400 from abyss7/issue-5286 
Add more virtual columns to Kafka engine
 2019-08-11 05:17:27 +03:00
alexey-milovidov
8520288044
Merge pull request #6416 from 4ertus2/some 
Refactoring: move collectUsedColumns() to SyntaxAnalyzer
 2019-08-11 05:16:22 +03:00
Ivan Lezhankin
fd27ac9e9e Merge remote-tracking branch 'upstream/master' into issue-5286 2019-08-11 00:11:44 +03:00
alexey-milovidov
838c5e535f
Merge pull request #6433 from yandex/prevent-stack-overflow-in-parser 
Fixed possible stack overflow in parser
 2019-08-10 23:58:54 +03:00
Nikita Vasilev
75e381bde4 Merge remote-tracking branch 'upstream/master' into nikvas0/index_mutate 2019-08-10 23:07:50 +03:00
Alexey Milovidov
afef5c6c70 Added stack protection; added a test 2019-08-10 20:51:47 +03:00
kreuzerkrieg
112fc71276 adding -Wshadow for GCC 2019-08-09 23:58:16 +03:00
Nikolai Kochetov
2ae3db7920 Merged with master. 2019-08-09 18:32:44 +03:00
chertus
e06c994b0e refactoring: move collectUsedColumns from ExpressionAnalyzer to SyntaxAnalyzer 2019-08-09 17:50:04 +03:00
Nikolai Kochetov
a1023bebff Fix tests. 2019-08-09 16:37:42 +03:00
alesapin
2803fcc2ba Make atomic settings 2019-08-09 16:07:19 +03:00
alexey-milovidov
28e87cc430
Merge pull request #6409 from yandex/get-identifier-name-fixed-unpleasant-code 
Fixed unsafe code around "getIdentifier" function.
 2019-08-09 02:31:49 +03:00
Alexey Milovidov
2ba185b4aa Addition to prev. revision 2019-08-08 23:10:58 +03:00
Alexey Milovidov
a6e4b34ab4 Fixed unpleasant code #6401 2019-08-08 23:02:30 +03:00
Alexander Tokmakov
ae6efb23b4 Merge branch 'master' into alter_table_drop_detached_part 2019-08-08 22:31:31 +03:00
alesapin
a03fcd9f12 Make settings values atomic to avoid race conditions 2019-08-08 22:29:56 +03:00
Alexey Milovidov
e7c7694377 Removed virtual columns from system.columns for backward compatibility 2019-08-08 18:48:32 +03:00
alesapin
e0d18c0fe8 Merge branch 'master' into merge_tree_settings_alter 2019-08-08 18:16:22 +03:00
Ivan Lezhankin
e90bf74ce8 Merge branch 'master' into issue-5286 2019-08-08 12:57:00 +03:00
alexey-milovidov
9c2165b800
Merge pull request #6388 from yandex/transform-query-substring-test 
Added a test just in case
 2019-08-08 03:11:37 +03:00
alexey-milovidov
0d3b383c98
Merge pull request #6384 from CurtizJ/fix-optimize-unused-shards 
Fix segfault with enabled 'optimize_skip_unused_shards' and missing sharding key.
 2019-08-08 03:04:23 +03:00
alexey-milovidov
355b1e5594
Merge pull request #6352 from yandex/no_space_left_on_device_message 
Print extra info in exception message for "no space left on device"
 2019-08-07 22:28:38 +03:00
Alexey Milovidov
688a80dd80 Added a test just in case #6381 2019-08-07 21:52:53 +03:00
Ivan
1bf6e034e8
Fix infinite loop when reading Kafka messages (#6354) 
* Do not pause/resume consumer at all
* Fix kafka tests
* Try to ensure the subscription
* Set timeout for kafka tests and return 'while True'
* Update cluster.py
* When doing a raw select from kafka, ignore client errors.
  They may rise due to 'Local: Timed out' while subscribing.
 2019-08-07 19:10:14 +03:00
CurtizJ
7e22f78ce4 fix segfault with enabled 'optimize_skip_unused_shards' and missing sharding key 2019-08-07 18:47:25 +03:00
alesapin
7409f1a3de More comments 2019-08-07 18:33:10 +03:00
alesapin
13e4581317 More general 2019-08-07 18:21:45 +03:00
Alexander Tokmakov
5cf183cbe3 fixes after review 2019-08-07 15:55:27 +03:00
Alexander Tokmakov
aefc664819 refactor throwFromErrno 2019-08-06 21:54:06 +03:00
Nikita Vasilev
90ce4608fb Merge remote-tracking branch 'upstream/master' into nikvas0/index_mutate 2019-08-06 21:07:13 +03:00
alesapin
bca40a8608 Better name 2019-08-06 19:34:27 +03:00
alesapin
e62101b8e8 Better comment 2019-08-06 19:29:31 +03:00
Alexander Tokmakov
c3039196da fixes 2019-08-06 17:51:27 +03:00
Ivan Lezhankin
b55da1888a Add "_timestamp" virtual column 2019-08-06 17:18:37 +03:00
alesapin
ca29343f54 Uniq settings 2019-08-06 17:09:36 +03:00
Ivan Lezhankin
4bc2b32c3e Merge branch 'master' into issue-5286 2019-08-06 16:25:51 +03:00
alesapin
303c4e5a58 Make index_granularity_bytes immutable 2019-08-06 16:06:09 +03:00
alesapin
84fd4906ca Changes for engines 2019-08-06 16:04:29 +03:00
alesapin
52b9658bcf Merge with master 2019-08-06 15:55:12 +03:00
alesapin
e12cb8da6d Add some changes 2019-08-06 15:52:08 +03:00
Alexander Tokmakov
c96b10be9f style fixes 2019-08-06 15:51:10 +03:00
Alexander Tokmakov
75d10f4160 print extra info in exception message 2019-08-05 22:41:20 +03:00
Nikita Vasilev
7b8c0f1750 experiment 2019-08-05 21:06:05 +03:00