Commit Graph

21421 Commits

Author SHA1 Message Date
alesapin
a4c3937153 Small refactoring 2019-09-04 16:24:55 +03:00
Nikolai Kochetov
b9e26d15de Try to enumerate streams again. 2019-09-04 16:17:50 +03:00
alesapin
3ffa9fa972 Resolve conflict 2019-09-04 15:44:12 +03:00
alesapin
8b6abab486 Merge branch 'master' into ObjatieGroba-feature_multiple_disks 2019-09-04 15:41:27 +03:00
Nikolai Kochetov
3a7e7287c0 Update PipelineExecutor. 2019-09-04 15:34:15 +03:00
CurtizJ
7accc09066 Merge branch 'palasonic-add-input-function' of https://github.com/palasonic1/ClickHouse into merging_input_function 2019-09-04 15:25:20 +03:00
alesapin
18ef235a3f Fix indices mrk file extension 2019-09-04 15:22:20 +03:00
alesapin
16a544f300 Fix bug with mutations after granularity change 2019-09-04 15:19:42 +03:00
stavrolia
32bf915610 More docs 2019-09-04 14:11:30 +03:00
chertus
904cfed046 better includes 2019-09-04 13:15:34 +03:00
Nikolai Kochetov
5246be8a17 Update PipelineExecutor. 2019-09-04 12:37:56 +03:00
Alexey Milovidov
6176041935 Fixed style 2019-09-04 02:08:46 +03:00
Alexey Milovidov
ece7a05cec Added an example of query masking rules for developers 2019-09-04 02:07:08 +03:00
CurtizJ
9cfcbd6649 fix bug in FillingBlockInputStream 2019-09-04 01:01:09 +03:00
Alexey Milovidov
843f8303b0 Minor modifications 2019-09-03 23:27:46 +03:00
Alexey Milovidov
9959e8d3e1 Fixed build 2019-09-03 23:07:27 +03:00
alexey-milovidov
b2e80b0cd9
Merge branch 'master' into query_masking 2019-09-03 22:58:15 +03:00
alexey-milovidov
1ae8150f28
Update Context.cpp 2019-09-03 22:53:59 +03:00
alexey-milovidov
4f7d472cb7
Merge pull request #6048 from Akazz/ternary-logic-light
Correct implementation of ternary logic for AND/OR
2019-09-03 22:09:56 +03:00
alexey-milovidov
5f33fd946f
Merge pull request #6711 from dimarub2000/exception_while_insert
Exception check added in client when sending insertion data.
2019-09-03 21:47:48 +03:00
akuzm
357f59cc48
Merge pull request #6667 from yandex/aku/mmap-populate
Pre-fault pages when allocating memory with mmap().
2019-09-03 21:41:53 +03:00
alexey-milovidov
152dba1b2e
Merge pull request #6796 from CurtizJ/fix-flappy-ttl-test
Fix column TTL with user defaults.
2019-09-03 21:35:00 +03:00
Alexey Milovidov
9cf0c780fb Better code 2019-09-03 21:23:13 +03:00
alexey-milovidov
845a612b95
Merge pull request #6773 from infinivision/fix_issue_6575
fix DataTypeAggregateFunction deserialization
2019-09-03 21:19:41 +03:00
Nikolai Kochetov
73c052f576 Revert PipelineExecutor changes. 2019-09-03 21:05:44 +03:00
alesapin
94fe4e6521 better test 2019-09-03 20:16:01 +03:00
alesapin
e6e6c11ba3 Better test and NOTHING_TO_DO 2019-09-03 20:06:36 +03:00
Artem Zuikov
0a998fddce
Merge pull request #6801 from 4ertus2/mjoin
Refactoring: wrap Join logic via AnalyzedJoin iface
2019-09-03 19:53:49 +03:00
Zhichang Yu
fd0947899d fix 00980_shard_aggregation_state_deserialization.sql 2019-09-03 23:47:09 +08:00
alesapin
52442cf549 Add system stop moves query 2019-09-03 17:50:49 +03:00
chertus
bb3dedf1dc move Join object from ExpressionAction into AnalyzedJoin 2019-09-03 17:36:02 +03:00
stavrolia
97ac979645 Add docs for hdfs and fix some review comments 2019-09-03 17:23:51 +03:00
Dmitry Rubashkin
40a056c79b Better naming. 2019-09-03 16:55:26 +03:00
alex-zaitsev
9032d8a196
Fixed tcp_keep_alive_timeout description 2019-09-03 16:30:15 +03:00
Nikolai Kochetov
16284b98b5 Disable 00963_achimbab for processors pipeline. 2019-09-03 15:42:24 +03:00
alesapin
48004e9b7b Style fixes 2019-09-03 15:25:58 +03:00
Nikolai Kochetov
5113bd3650 Add task stilling to PipelineExecutor. 2019-09-03 15:06:45 +03:00
alexey-milovidov
87e061d0e1
Merge pull request #6733 from 4ertus2/some
Add subquery_requires_alias setting (disabled by default)
2019-09-03 14:34:28 +03:00
alexey-milovidov
ab75e8c26d
Merge pull request #6205 from zhang2014/fix/some_mutation
fix some mutation bug
2019-09-03 14:33:20 +03:00
alesapin
8d76febe02 Add moves to part log 2019-09-03 14:32:25 +03:00
Nikolai Kochetov
aa9481e76e Add task stilling to PipelineExecutor. 2019-09-03 14:22:34 +03:00
alexey-milovidov
7847de1947
Merge pull request #6629 from CurtizJ/read-in-order-2
Implement 'read in order' optimization with processors.
2019-09-03 14:21:19 +03:00
Nikolai Kochetov
99476d0039 Add task stilling to PipelineExecutor. 2019-09-03 14:15:37 +03:00
CurtizJ
22badef1a2 Merge remote-tracking branch 'upstream/master' into merging_with_ties_and_with_fill 2019-09-03 13:47:18 +03:00
Anton Popov
aeb1860e62
Update 01006_ttl_with_default_2.sql 2019-09-03 13:31:52 +03:00
CurtizJ
ba98c038ab fix column ttl with user defaults 2019-09-03 13:27:02 +03:00
Nikolai Kochetov
e55647eee9 Force add resize befor aggregating transform. 2019-09-03 13:14:13 +03:00
CurtizJ
6d821c4877 fix build 2019-09-03 13:07:31 +03:00
Zhichang Yu
fb5c11146a added functional test for shard bitmap deserialization 2019-09-03 17:39:15 +08:00
Dmitry Rubashkin
ede0077df6 fix 2019-09-03 12:38:50 +03:00
Dmitry Rubashkin
d2b9990a2a Unexpected packets received in a better way now. 2019-09-03 12:36:16 +03:00
alesapin
0e47bbca4d Fix style check 2019-09-03 12:18:02 +03:00
alesapin
a7606d063b Better test 2019-09-03 12:16:35 +03:00
alesapin
d08d99954f Ugly working code 2019-09-03 11:48:43 +03:00
Nikolai Kochetov
702c1b03da Revert to LFStack. 2019-09-03 11:42:26 +03:00
alesapin
27b0a06005 Fix stupid bug 2019-09-03 11:30:59 +03:00
alesapin
e7308c1f21 Merge branch 'master' into ObjatieGroba-feature_multiple_disks 2019-09-03 11:02:32 +03:00
zhang2014
9c50c7c718 fix crash when touches all rows alter 2019-09-03 13:48:02 +08:00
alexey-milovidov
cda9ac7385
Merge pull request #6780 from yandex/fix_mergex_column_only_stream
Move initialization of MergedColumnOnlyStream to constructor
2019-09-03 01:37:51 +03:00
alexey-milovidov
a52874b203
Merge pull request #6709 from yandex/time-zone-configuration
Fixed error with processing "timezone" in server configuration file.
2019-09-03 01:37:26 +03:00
alexey-milovidov
7447d89f1f
Merge pull request #6785 from 4ertus2/mjoin
More JOINs refactoring
2019-09-03 01:36:59 +03:00
CurtizJ
973b533377 Merge remote-tracking branch 'upstream/master' into read-in-order-2 2019-09-03 00:59:51 +03:00
Alexey Milovidov
1903053aa1 Fixed error in test 2019-09-02 22:58:48 +03:00
chertus
fce1b47250 more JOIN refactoring: move logic out of ExpressionAnalyzer/ExpressionAction 2019-09-02 22:58:45 +03:00
Alexey Milovidov
89e86e1d41 Slightly better config management in integration tests 2019-09-02 22:57:09 +03:00
alesapin
04a3db5857 Better test 2019-09-02 22:32:08 +03:00
Alexey Milovidov
5dbafdefdb Merge branch 'master' into time-zone-configuration 2019-09-02 22:15:52 +03:00
Alexey Milovidov
457bc541ee Merge branch 'master' of github.com:yandex/ClickHouse 2019-09-02 22:13:22 +03:00
Alexey Milovidov
2b0af524cb Added a test #2282 2019-09-02 22:13:12 +03:00
alexey-milovidov
5042780423
Merge pull request #6776 from vitlibar/split-test-dictionaries
Split the integration test `test_dictionaries` into 4 separate tests.
2019-09-02 22:07:46 +03:00
alexey-milovidov
f180f7dd3d
Merge pull request #6779 from proller/fix27
CLICKHOUSE-4644 function arrayEnumerateUniqRanked: fix for empty arrays
2019-09-02 21:40:35 +03:00
CurtizJ
257df66b02 fix flappy ttl test 2019-09-02 21:29:56 +03:00
alesapin
f0c5ee5877 Merge with master 2019-09-02 20:34:18 +03:00
CurtizJ
4fea3e9688 style fixes 2019-09-02 20:18:44 +03:00
Nikolai Kochetov
52ca3f2b4c Add stream enumeration to Processors. 2019-09-02 20:01:03 +03:00
Nikolai Kochetov
cfbb3ce6f9 Add stream enumeration to Processors. 2019-09-02 19:58:24 +03:00
Nikolai Kochetov
5352ac9145 Add stream enumeration to Processors. 2019-09-02 19:57:06 +03:00
Nikolai Kochetov
1f70aee2e6 Add stream enumeration to Processors. 2019-09-02 19:55:01 +03:00
alesapin
5af8c196bd Move initialization of MergedColumnOnlyStream to constructor 2019-09-02 19:31:09 +03:00
proller
184e2ef9ab CLICKHOUSE-4644 arrayEnumerateUniqRanked: fix for empty arrays 2019-09-02 18:49:25 +03:00
Nikolai Kochetov
88044fdc16 Add stream enumeration to Processors. 2019-09-02 18:49:18 +03:00
Alexander Kuzmenkov
fd00889981 Pre-fault mmapped buffers for hash tables.
Mmaped pages are copy-on-write references to the zero page, and are
faulted in on the first write. Hash table resize touches most of the
newly allocated buffer, so it's faster to pre-fault all pages after
allocation, instead of having the resize loop interrupted by page
faults.
2019-09-02 18:38:29 +03:00
Alexander Kuzmenkov
ce120ebc0d Cosmetic change: Remove unused template parameters from Allocator. 2019-09-02 18:38:29 +03:00
CurtizJ
e122d54dcb update comments 2019-09-02 18:22:27 +03:00
Nikolai Kochetov
464595a548 Add allow_processors flag to executeQuery. 2019-09-02 18:19:01 +03:00
Alexey Milovidov
402599a38c Merge branch 'master' into time-zone-configuration 2019-09-02 18:13:54 +03:00
Alexey Milovidov
7bf411548f Merge branch 'master' of github.com:yandex/ClickHouse into add-test-for-deadlock-system-tables 2019-09-02 18:04:15 +03:00
Nikolai Kochetov
52eae3a242 Add stream enumeration to Processors. 2019-09-02 17:55:43 +03:00
alexey-milovidov
a71a1693f0
Merge pull request #6777 from yandex/fix-pvs-warning-in-pipeline-executor
Fix PVS warning in PipelineExecutor.
2019-09-02 17:53:28 +03:00
alexey-milovidov
3f5d0ef2a8
Merge pull request #6775 from yandex/aku/pvs-warning
Remove a redundant condition (found by PVS Studio).
2019-09-02 17:52:25 +03:00
Vitaly Baranov
d64d75eb6d Split the integration test test_dictionaries into 4 separate tests. 2019-09-02 17:50:57 +03:00
Nikolai Kochetov
0016d99f5e Add stream enumeration to Processors. 2019-09-02 17:49:05 +03:00
CurtizJ
de5e2b4d6b Merge remote-tracking branch 'upstream/master' into merging_with_ties_and_with_fill 2019-09-02 17:34:49 +03:00
CurtizJ
da11fb86b7 implement 'with fill' modifier with processors 2019-09-02 17:29:51 +03:00
Vasily Nemkov
f98c488834 Post-review fixes
* Actually using the replica recovery settings for cluster
* A bit of doc on DBMS_CONNECTION_POOL_WITH_FAILOVER_MAX_ERROR_COUNT
* StorageDistributedDirectoryMonitor using settings for ConnectionPoolWithFailover
* Using SettingSeconds instead of SettingUInt64 for replica_error_decrease_period
2019-09-02 17:26:25 +03:00
Vasily Nemkov
84fc4ba4c8 Replica recovery fixes
* Added a limit on how many errors can replica accumulate
* Decreased default error halving time to 60 seconds
* Made both configurable via settings
* Showing errors count and estimated recovery time for each replica in system.clusters
2019-09-02 17:26:25 +03:00
alexey-milovidov
0967ecf03b
Merge pull request #6727 from yandex/merging_template_format
Merging Template format
2019-09-02 17:25:43 +03:00
Alexey Milovidov
dcdd8c6e3c Merge branch 'master' into add-test-for-deadlock-system-tables 2019-09-02 16:39:26 +03:00
Nikolai Kochetov
2eecd35d27 Fix PVS warning in PipelineExecutor. 2019-09-02 16:30:51 +03:00
Alexander Kuzmenkov
ab2bd54022 Remove a redundant condition (found by PVS-Studio). 2019-09-02 16:17:14 +03:00
Nikolai Kochetov
bf0c0ed4f1 Merge branch 'master' into processors-2 2019-09-02 16:02:09 +03:00
chertus
bc95027cee better setting name: joined_subquery_requires_alias 2019-09-02 15:53:31 +03:00
Nikolai Kochetov
278e33cfa3 Try add LFStack. 2019-09-02 15:48:58 +03:00
Nikolai Kochetov
5005c0006c Try add LFStack. 2019-09-02 15:34:18 +03:00
chertus
2c0d569fa8 Merge branch 'master' into some 2019-09-02 15:32:24 +03:00
Zhichang Yu
9e587fb139 fix DataTypeAggregateFunction deserialization 2019-09-02 20:09:40 +08:00
alesapin
198031f787 Refactoring 2019-09-02 14:35:53 +03:00
Nikolai Kochetov
6221a42fcc Comment out all stopwatchs in PipelineExecutor. 2019-09-02 14:02:08 +03:00
Alexander Tokmakov
3da233ef42 fix build 2019-09-02 13:47:06 +03:00
Alexander Tokmakov
e2928481a3 Merge branch 'master' into merging_template_format 2019-09-02 12:41:34 +03:00
alesapin
e7ee9b7a67 Merge master 2019-09-02 11:46:00 +03:00
Alexey Milovidov
85f45747a5 Fixed test 2019-09-02 04:04:41 +03:00
Alexey Milovidov
951079c457 Updated test 2019-09-02 04:00:58 +03:00
Alexey Milovidov
32adf456d8 Remove support for recursive-by-thread RWLocks because it makes no sense 2019-09-02 03:59:27 +03:00
Alexey Milovidov
e5ad85ba26 Fixed test 2019-09-02 03:21:42 +03:00
Alexey Milovidov
2d331fb992 Fixed possible deadlock in RWLock 2019-09-02 03:12:01 +03:00
Alexey Milovidov
de2586cd15 Merge branch 'master' into add-test-for-deadlock-system-tables 2019-09-02 00:59:25 +03:00
Alexey Milovidov
7d1b1de895 Temporarily remove all LIVE VIEW tests 2019-09-02 00:49:11 +03:00
Alexey Milovidov
ba1c70add0 Merge branch 'add-test-for-deadlock-system-tables' of github.com:yandex/ClickHouse into add-test-for-deadlock-system-tables 2019-09-01 22:21:22 +03:00
Alexey Milovidov
de44330cfa Updated exception message 2019-09-01 22:21:00 +03:00
Alexey Milovidov
45a9b4e184 Merge branch 'master' into add-test-for-deadlock-system-tables 2019-09-01 22:20:04 +03:00
Alexey Milovidov
4ebf610808 Disable query profiler with sanitizers 2019-09-01 19:21:54 +03:00
Alexey Milovidov
8917572087 Speed up another test in cases when query_log is large (such as on production servers) 2019-09-01 18:28:43 +03:00
Alexey Milovidov
55f11b3675 Speed up test for "text_log" in cases when text_log is large (such as on production servers) 2019-09-01 18:25:46 +03:00
Ivan
4d21f97d6a
Increase test timeout 2019-09-01 16:03:38 +03:00
Alexey Milovidov
6940395c5d Fixed tests 2019-09-01 15:40:06 +03:00
Alexey Milovidov
2b6d27d587 Merge branch 'add-test-for-deadlock-system-tables' of github.com:yandex/ClickHouse into add-test-for-deadlock-system-tables 2019-09-01 15:16:54 +03:00
Alexey Milovidov
27d753eab7 Fixed error 2019-09-01 15:16:31 +03:00
alexey-milovidov
7ababf2644
Merge branch 'master' into add-test-for-deadlock-system-tables 2019-09-01 04:35:10 +03:00
Alexey Milovidov
6f02cd145f Added a kludge (experimental) 2019-09-01 04:32:44 +03:00
alexey-milovidov
2e86aece86
Merge pull request #6763 from yandex/add-os-thread-ids-in-system-tables
Add "os_thread_ids" column to system tables
2019-09-01 04:30:16 +03:00
alexey-milovidov
1dd28867b0
Merge pull request #6689 from yandex/merge_tree_settings_alter
Refactoring of immutable settings
2019-09-01 04:29:47 +03:00
Alexey Milovidov
23b28e6cdc Added another test for deadlock 2019-09-01 02:35:33 +03:00
Alexey Milovidov
cb79e2371e Add "os_thread_ids" column to system tables 2019-09-01 00:47:15 +03:00
Alexey Milovidov
dcc6163d32 Added function "trap" 2019-09-01 00:39:17 +03:00
alesapin
7382a9f3c3 Rename method for settings check 2019-09-01 00:15:40 +03:00
alexey-milovidov
d8d2b623d2
Merge pull request #6759 from yandex/add-test-rwr-shard-deadlock
Added a test for possible deadlock in distributed queries
2019-08-31 18:51:48 +03:00
alexey-milovidov
fcfc807bb3
Merge pull request #6756 from yandex/add-test-deadlock-rename-table
Added a test for deadlock in RENAME TABLE
2019-08-31 16:01:59 +03:00
Alexey Milovidov
aac0b27daa Fixed possible deadlock in distributed queries 2019-08-31 15:18:14 +03:00
Alexey Milovidov
783df7a5c5 Added a test that prooves that our locking model is non-viable 2019-08-31 14:32:14 +03:00
Alexey Milovidov
c0e465f9f0 Stress test: more beautiful 2019-08-31 14:20:09 +03:00
Alexey Milovidov
01035a9e78 Merge branch 'master' of github.com:yandex/ClickHouse into add-test-deadlock-rename-table 2019-08-31 13:46:24 +03:00
alexey-milovidov
ddbb1abbaf
Merge pull request #6752 from yandex/added-test-rename-merge-race-condition
Added a test for RENAME / Merge table race condition
2019-08-31 13:45:41 +03:00
alexey-milovidov
3767979295
Merge pull request #6753 from yandex/avoid-race-condition-processors
Avoid data race on Settings in KILL QUERY.
2019-08-31 13:45:14 +03:00
alexey-milovidov
d90518dadf
Merge pull request #6755 from vitlibar/add-test-reload-after-fail-in-cache-dictionary
Add integration test for handling errors by a cache dictionary.
2019-08-31 13:44:40 +03:00
Alexey Milovidov
3568d3d890 Updated test 2019-08-31 13:38:20 +03:00
Alexey Milovidov
202673e3bd Avoid deadlock in multiple tables RENAME 2019-08-31 13:37:28 +03:00
Nikolai Kochetov
300dc80194 Update Aggregator interface. 2019-08-31 11:58:16 +03:00
Alexey Milovidov
d879bcb010 Added a test for deadlock in RENAME TABLE 2019-08-31 05:32:42 +03:00
Alexey Milovidov
e4376a3f6f Addition to prev. revision 2019-08-31 04:21:10 +03:00
Vitaly Baranov
fbd616b6a4 Add integration test for handling errors by a cache dictionary. 2019-08-31 03:39:38 +03:00
Alexey Milovidov
57c8091e5b Better stress test script 2019-08-31 03:30:12 +03:00
Alexey Milovidov
5fcdd6f20b Added stress test variant that is as simple to run as ./stress 2019-08-31 03:19:10 +03:00
Alexey Milovidov
bb0ca310ab Allow to ATTACH live views 2019-08-31 02:38:03 +03:00
Alexey Milovidov
fd85a862f0 Added a test just in case 2019-08-31 02:19:05 +03:00
Alexey Milovidov
2fd8f5c324 Removed code that I don't understand and that has no comments 2019-08-31 02:09:08 +03:00
Alexey Milovidov
cc118b3fed Added a test for RENAME / Merge table race condition 2019-08-31 01:43:15 +03:00
alesapin
2647d4ca15 Rename immutable to readonly 2019-08-30 23:12:26 +03:00
Alexander Tokmakov
cd5d733f75 rewrite unit test with gtest 2019-08-30 22:08:23 +03:00
alesapin
6f30338c08 Fixes 2019-08-30 21:31:35 +03:00
Ivan
cd5c0fc9ac
Fix build issues (#6744)
* libcxxabi uses exception handling library as public
* Don't set -stdlib for internal libc++ - it poisons the checks.
* Enable capnproto in unbundled build back
2019-08-30 20:40:27 +03:00
alexey-milovidov
6352c57afb
Merge pull request #6748 from yandex/fix_bad_size_of_marks
Fix bad size of marks with skip indices
2019-08-30 20:26:59 +03:00
Alexander Tokmakov
4c744af113 minor style fixes 2019-08-30 20:25:35 +03:00
alesapin
808f4d0b8a Intermediate refactoring 2019-08-30 19:50:59 +03:00
Alexey Milovidov
ace08fa344 Merge branch 'master' into time-zone-configuration 2019-08-30 19:27:08 +03:00
Alexey Milovidov
83c75ca2ad Added a test (but it doesn't reproduce the issue #6746) 2019-08-30 19:21:05 +03:00
stavrolia
974789d379 add const 2019-08-30 18:19:05 +03:00
alesapin
d4ea6a5234 Fix comment 2019-08-30 17:30:28 +03:00
alesapin
f6120558df Fix bad size of marks 2019-08-30 17:29:08 +03:00
Nikolai Kochetov
18fff141d1 Update max_threads for processors. 2019-08-30 17:21:22 +03:00
Alexey Milovidov
4cb640717b Fixed test 2019-08-30 16:28:27 +03:00
stavrolia
f51901bb3f fix comment 2019-08-30 16:27:05 +03:00
Alexey Milovidov
da5e7f31c4 Updated README 2019-08-30 16:25:34 +03:00
Alexey Milovidov
48bf4abdf0 Fixed function name 2019-08-30 16:14:47 +03:00
Alexey Milovidov
3fdcc4ab30 Fixed typo in README.md 2019-08-30 16:14:20 +03:00
alexey-milovidov
ce73e17ff6
Merge pull request #6730 from yandex/fallback_o_direct
Fallback from O_DIRECT.
2019-08-30 16:08:19 +03:00
alexey-milovidov
e5a7f451f0
Merge pull request #6737 from vitlibar/improve-error-handling-in-cache-dictionary
Improve error handling in cache dictionaries
2019-08-30 16:06:07 +03:00
alexey-milovidov
b27f5a7390
Merge pull request #6740 from Enmk/reduced_locking_in_IBlockInputStream
Reduced children_mutex lock scope in IBlockInputStream
2019-08-30 16:02:22 +03:00
chertus
e9c4f36586 Merge branch 'master' into some 2019-08-30 15:49:55 +03:00
alesapin
d7e54d3c14 Merge branch 'master' of github.com:yandex/ClickHouse into ObjatieGroba-feature_multiple_disks 2019-08-30 12:53:24 +03:00
Vitaly Baranov
da8f67123f Improve error handling in cache dictionaries:
allow using expired values while the source of a cache dictionary doesn't respond;
clone the source after an error to reset connections;
don't ask the source for a little time after error;
show the last exception in system.dictionaries for a cache dictionary too.
2019-08-30 12:50:38 +03:00
Vasily Nemkov
b66485a1d2 Reduced children_mutex lock scope in IBlockInputStream
This is to fix TSan warning 'lock-order-inversion'.
Thread locks IBlockInputStream::children_mutex (A) and then subsequently locks
MergeTreeDataPart::columns_lock mutex (B), holding it for extended period of
time, surviving the unlock of the A. Then, while B is still locked, A
is locked again, causing a TSan warning.
2019-08-30 11:24:00 +03:00
CurtizJ
048d3da9ab better types comparison and conversion in FillingBlockInputStream 2019-08-30 01:24:33 +03:00
Alexander Tokmakov
e3982704ea try to fix build 2019-08-30 00:46:36 +03:00
alexey-milovidov
358ad13930
Merge pull request #6715 from yandex/remove-mimalloc
Remove mimalloc
2019-08-30 00:41:33 +03:00
Alexander Tokmakov
d95d53b4e4 better error messages 2019-08-29 22:35:59 +03:00
Alexey Milovidov
0bca68e50b Style 2019-08-29 21:55:20 +03:00
chertus
3ad43daae3 Merge branch 'master' into some 2019-08-29 21:50:47 +03:00
chertus
d5cfbcf6e1 subquery_requires_alias setting (disabled by default) 2019-08-29 21:45:34 +03:00
Dmitry Rubashkin
876847f3f7 Now stacked logs are received in appropriate way. 2019-08-29 20:30:16 +03:00
CurtizJ
a6e43c4119 merging with master 2019-08-29 19:48:02 +03:00
alesapin
1813b96f82 Finally build, possible trash. 2019-08-29 19:17:47 +03:00
Alexey Milovidov
a894288fa0 Fallback from O_DIRECT. 2019-08-29 18:48:00 +03:00
stavrolia
011c752ed7 Add unit test 2019-08-29 18:38:33 +03:00
Ivan
5851316742
Don't interrupt copyData() used inside Kafka materialized views (#6597)
* Print better offsets on commit
* Stop consumption on the read buffer level
* Don't use cancellation in the middle of copyData()
* Add test
* Disable squashing stream for Kafka materialized views
* Commit last read message, since rdkafka auto-modifies offset
2019-08-29 18:36:07 +03:00
alexey-milovidov
c19e5faf4c
Merge pull request #6717 from yandex/fix-data-race-in-storage-merge
Fix for data race in StorageMerge
2019-08-29 18:25:48 +03:00
CurtizJ
d7a712e7ae update logic of 'with fill' modifier 2019-08-29 18:19:12 +03:00
alexey-milovidov
2b124c5af8
Merge pull request #6718 from vitlibar/fix-extract-tuple-from-json
Fix extracting a Tuple from JSON
2019-08-29 17:40:26 +03:00
Alexander Tokmakov
03c83169bd Merge branch 'master' into merging_template_format 2019-08-29 16:34:25 +03:00
Alexander Tokmakov
d6ca9fee63 unit test for PeekableReadBuffer 2019-08-29 16:30:43 +03:00
alesapin
549c61cad9
Update MarkInCompressedFile.h 2019-08-29 15:38:20 +03:00
Dmitry Rubashkin
4bd79c47dc Now send_logs_level won't affect catching exception. Test added. 2019-08-29 15:36:06 +03:00
alesapin
dac55278ad Better comments 2019-08-29 14:15:56 +03:00
alesapin
702b47ae5b Remove redundant changes 2019-08-29 13:56:43 +03:00
alesapin
0899b3818d Remove redundant changes 2019-08-29 13:49:26 +03:00
alesapin
67f9753775 Merge branch 'master' into bad_size_of_marks_skip_idx_bug 2019-08-29 11:07:56 +03:00
alesapin
d3b378ea10 Fix flappy test (descrease number of iterations) 2019-08-29 11:02:50 +03:00
zhang2014
275c0d88b3 fix build failure 2019-08-29 12:54:09 +08:00
zhang2014
74c9eea657 fix test failure 2019-08-29 11:34:00 +08:00
zhang2014
3c7405bdb0 move test to integration & refer max_expanded_ast_elements 2019-08-29 11:31:22 +08:00
zhang2014
92740212b5 fix build failure 2019-08-29 11:15:15 +08:00
zhang2014
7432845f60 add test case 2019-08-29 11:14:40 +08:00
zhang2014
6c3626b629 truncate should remove mutations 2019-08-29 11:14:40 +08:00
zhang2014
54b65bac50 fix max_ast_elements settings with merge mutation 2019-08-29 11:06:35 +08:00
Vitaly Baranov
4ec12c3d24 Add more tests for JSON functions. 2019-08-29 01:55:35 +03:00
Vitaly Baranov
6cbb52128b Fix extracting tuple from JSON. 2019-08-29 01:55:35 +03:00
Alexey Milovidov
d1a980fcdd Fix for data race in StorageMerge 2019-08-29 01:18:26 +03:00
Ivan
b4339f266d
Make a better build scheme (#6500)
* Fix shared build
* Major default libs refactor
* Fix build with gcc_eh
* Link all libraries as a big group.
* Use global interface library as a group
* Build capnproto using our cmake
* Use only internal libunwind
2019-08-28 23:49:37 +03:00
Alexey Milovidov
06ea75f9fd Merge branch 'master' of github.com:yandex/ClickHouse 2019-08-28 23:15:28 +03:00
Alexey Milovidov
e9875950a4 Make test timeout to be more significant 2019-08-28 22:36:04 +03:00
Alexey Milovidov
39d50b5144 Remove mimalloc 2019-08-28 22:01:52 +03:00
Artem Zuikov
405f060f4f
Merge pull request #6708 from 4ertus2/some
Test for #4858
2019-08-28 21:57:46 +03:00
Alexey Milovidov
48dce81e61 Minor modifications after #6413 2019-08-28 21:54:30 +03:00
alexey-milovidov
33311a9bf1
Merge branch 'master' into atomic_zookeeper2 2019-08-28 21:34:42 +03:00
alesapin
b4d98f6e13 Trying to fix vertical merge 2019-08-28 21:23:20 +03:00
alexey-milovidov
44dd3bd792
Merge pull request #6692 from yandex/remove-queue_max_wait_ms
Set default value of "queue_max_wait_ms" to zero, because current value makes no sense
2019-08-28 21:06:09 +03:00
alexey-milovidov
7b9b67fd71
Merge pull request #6695 from yandex/improve-table-locks
Avoid possible deadlock in TRUNCATE of Replicated table.
2019-08-28 21:05:26 +03:00
alexey-milovidov
6d2dca3242
Merge pull request #6705 from 4ertus2/bugs
JOINs with not nullable types and join_use_nulls=1
2019-08-28 21:05:16 +03:00
alexey-milovidov
c72dffc591
Merge pull request #6706 from yandex/client-do-not-substitute-inside-query
Disable Poco::AbstractConfiguration substitutions in query in clickhouse-client
2019-08-28 21:04:56 +03:00
Alexey Milovidov
eb15c9416a Fixed style 2019-08-28 21:00:40 +03:00
Dmitry Rubashkin
4b7f5f20c1 Exception check added when sending data by parts. 2019-08-28 20:52:17 +03:00
Nikolai Kochetov
d6e13cbb92 Update max_threads for processors. 2019-08-28 20:48:41 +03:00
Nikolai Kochetov
ca232cebfb Update max_threads for processors. 2019-08-28 20:30:48 +03:00
Alexey Milovidov
509717dea7 Added integration test 2019-08-28 20:18:19 +03:00
Alexey Milovidov
cf57a88495 Added a way to forbid static initialization of a class 2019-08-28 20:13:29 +03:00
Alexey Milovidov
30cc569845 Avoid initializing DateLUT in static constructors 2019-08-28 20:11:40 +03:00
chertus
91bc0eca11 add test for #4858 2019-08-28 20:00:20 +03:00
Alexander Tokmakov
c8096542bf more tests and fixes 2019-08-28 19:46:54 +03:00
chertus
5e27937227 fix RIGHT JOIN for Tuples 2019-08-28 18:44:18 +03:00
alexey-milovidov
e2b05f6f9c
Merge pull request #6700 from yandex/aku/shm-5417-formatting
Formatting changes for StringHashMap PR #5417.
2019-08-28 18:30:59 +03:00
alexey-milovidov
819f1f2aa6
Merge pull request #6701 from yandex/aku/no-cache-low-cardinality
Disable consecutive key optimization for UInt8/16 LowCardinality columns.
2019-08-28 18:30:24 +03:00
Alexey Milovidov
b6a0dba2df Added a setting "connection_pool_max_wait_ms" 2019-08-28 18:27:26 +03:00
Alexey Milovidov
cced091881 Addition to prev. revision 2019-08-28 18:24:35 +03:00
Alexey Milovidov
d1c268c2ed Added setting "kafka_max_wait_ms" 2019-08-28 18:24:23 +03:00
Alexey Milovidov
06c0e35e46 Added setting "replace_running_query_max_wait_ms" 2019-08-28 18:21:57 +03:00
Alexey Milovidov
d06e350312 Added setting "replace_running_query_max_wait_ms" 2019-08-28 18:20:22 +03:00
Alexey Milovidov
a9702aa6f2 Merge branch 'master' into remove-queue_max_wait_ms 2019-08-28 18:16:53 +03:00
alexey-milovidov
24c8ee9fcd
Merge pull request #6703 from arenadata/ADQM-40
test for orc input format
2019-08-28 18:14:40 +03:00
Alexey Milovidov
f519234908 Added a test 2019-08-28 18:13:19 +03:00
Alexey Milovidov
10b878b30b Disable Poco::AbstractConfiguration substitutions in query in clickhouse-client 2019-08-28 18:06:30 +03:00
chertus
90d5410aaa join_use_nulls with not nullable types 2019-08-28 17:14:09 +03:00
dimarub2000
6fe40a0d90
Merge branch 'master' into perfomance_test_help_size 2019-08-28 16:38:54 +03:00
alexey-milovidov
696d505a1a
Merge pull request #6656 from vzakaznikov/fix_live_view_no_users_thread
Fix live view no users thread
2019-08-28 16:33:36 +03:00
akonyaev
9d0e5b925b ADQM-40 test for orc input format 2019-08-28 16:26:38 +03:00
Alexey Milovidov
a1101e5278 Fixed build 2019-08-28 16:21:19 +03:00
Alexey Milovidov
8b973fd9f2 Merge branch 'improve-table-locks' of github.com:yandex/ClickHouse into improve-table-locks 2019-08-28 15:59:23 +03:00
Alexey Milovidov
625e128770 Merge branch 'master' into improve-table-locks 2019-08-28 15:41:30 +03:00
Alexey Milovidov
99d62efb4d Added a test 2019-08-28 15:26:13 +03:00
Alexander Kuzmenkov
0b5a7f5f4a Disable consecutive key optimization for UInt8/16 LowCardinality
columns.

A follow-up to #6298, this is as well a part of StringHashMap PR #5417
by Amos Bird.
2019-08-28 14:05:52 +03:00
Alexander Kuzmenkov
24a8755b82 Formatting changes for StringHashMap PR #5417. 2019-08-28 13:52:14 +03:00
Alexey Milovidov
32c7f9688a Removed extra quoting from Settings 2019-08-28 13:13:22 +03:00
Artem Zuikov
8fa4575a88
Merge pull request #6693 from 4ertus2/mjoin
Minor refactoring
2019-08-28 10:12:37 +03:00
Alexey Milovidov
f2d081a785 Addition to prev. revision 2019-08-28 03:42:45 +03:00
Alexey Milovidov
3db38c690e Changes to Benchmark after merge 2019-08-28 03:15:08 +03:00
Alexey Milovidov
c8798b2ffa Slightly improve table locks 2019-08-28 02:47:30 +03:00
alexey-milovidov
44424651b0
Merge pull request #6343 from dimarub2000/benchmark_comparison_mode
[WIP] Clickhouse-benchmark comparison mode
2019-08-28 02:38:07 +03:00
alexey-milovidov
4782c1170c
Merge pull request #6691 from yandex/weiqxu-master
Merging "check free space when use external sort/aggerator"
2019-08-28 01:55:18 +03:00
Alexey Milovidov
e7cbd34a29 Improve table locks (incomplete) 2019-08-27 23:43:35 +03:00
Alexey Milovidov
285d66cee1 Improve table locks (incomplete) 2019-08-27 23:43:08 +03:00
Vitaliy Zakaznikov
e80ff65a0f Removing allow_experimental_live_view option from clickhouse-client.xml. 2019-08-27 16:23:12 -04:00
alexey-milovidov
c736d6b495
Merge pull request #6676 from dimarub2000/right_left_problem_#6381
Query transformation for external database fixed.
2019-08-27 23:11:39 +03:00
chertus
5208a70203 one less place with changed nullability columns 2019-08-27 22:41:51 +03:00
Alexey Milovidov
63c0070cd5 Fixed flacky test 2019-08-27 22:32:33 +03:00
Alexey Milovidov
0add95b7d8 Set default value of "queue_max_wait_ms" to zero, because current value makes no sense 2019-08-27 22:21:53 +03:00
Alexey Milovidov
25c53ccd9e Rename setting 2019-08-27 22:05:35 +03:00
Alexey Milovidov
b21fdff77e Merging #6678 2019-08-27 21:59:21 +03:00
Alexey Milovidov
5ca8f8d695 Merge branch 'master' of https://github.com/weiqxu/ClickHouse into weiqxu-master 2019-08-27 21:52:09 +03:00
Nikolai Kochetov
4cb52cebea Update max_threads for processors. 2019-08-27 21:37:28 +03:00
Alexander Tokmakov
93c672aa0b delete BlockInputStreamFromRowInputStream 2019-08-27 21:29:56 +03:00
CurtizJ
a169213691 test for limit with ties 2019-08-27 21:11:02 +03:00
CurtizJ
50d870705c limit with ties for processors 2019-08-27 20:48:42 +03:00
Alexander Tokmakov
cf3a8b993b allow skipping fields in TemplateRowInputFormat 2019-08-27 19:53:26 +03:00
stavrolia
f4e0dceddb some changes 2019-08-27 18:20:31 +03:00
Alexey Milovidov
8ca00a26f6 Fixed build 2019-08-27 17:31:34 +03:00
Alexey Milovidov
c385c950ba Merge branch 'master' into replicate-merge-tree-minor-lock-improvement 2019-08-27 17:30:48 +03:00
CurtizJ
42633c801b Merge remote-tracking branch 'upstream/master' into merging_with_ties_and_with_fill 2019-08-27 17:11:57 +03:00
alexey-milovidov
d12ced8099
Merge pull request #6191 from svladykin/ttldropparts
TTL: Only drop altogether the expired parts and not partially prune them.
2019-08-27 16:54:56 +03:00
alesapin
106b9717cd Refactoring of immutable settings 2019-08-27 16:14:19 +03:00
Dmitry Rubashkin
17f18e42c0 new line 2019-08-27 16:13:40 +03:00
Dmitry Rubashkin
f1f85a5a24 Fixed case with single subquery and added tests. 2019-08-27 16:09:58 +03:00
alexey-milovidov
8db93d392b
Merge pull request #6685 from yandex/merge_tree_settings_alter
Alter merge tree settings with other types of alter
2019-08-27 16:07:28 +03:00
alesapin
36472b14f9 Defend kafka storage from alters 2019-08-27 12:48:20 +03:00
alesapin
7851d8fe0a Add ability to alter settings with other types of alter 2019-08-27 12:34:53 +03:00
Nikolai Kochetov
d958316e58 Enable processors by default. Do not check block srtucture in SourceFromInutStream if not debug. 2019-08-27 11:17:42 +03:00
Weiqing Xu
2fbcd607f3 check free space when use external sort/aggerator 2019-08-27 08:23:07 +08:00
Vitaliy Zakaznikov
5fb5c8dffc Updating all live view tests to set the allow_experimental_live_view option. 2019-08-26 19:50:37 -04:00
Alexey Milovidov
66203973f2 Merge branch 'master' of github.com:yandex/ClickHouse 2019-08-27 00:41:18 +03:00
Alexey Milovidov
7985270624 Disable processors by default 2019-08-27 00:41:10 +03:00
Alexey Milovidov
d654f2507e Fixed typo in test 2019-08-27 00:40:56 +03:00
Alexey Milovidov
57fa4e1dd7 Minor lock improvement for ReplicatedMergeTree 2019-08-27 00:40:29 +03:00