Commit Graph

12673 Commits

Author SHA1 Message Date
alexey-milovidov
75c4728787
Merge pull request #23229 from ClickHouse/unhex-case-insensitive1
Make function `unhex` case insensitive for compatibility
2021-04-17 23:32:03 +03:00
Alexander Tokmakov
0354312294 minor fixes in attach query 2021-04-17 22:43:02 +03:00
alexey-milovidov
212f68e279
Merge branch 'master' into fix-odbc 2021-04-17 21:29:03 +03:00
Maksim Kita
abf2a87ce7 Added system query reload model 2021-04-17 20:59:08 +03:00
Alexey Milovidov
8ac953f459 Make function unhex case insensitive for compatibility 2021-04-17 19:31:35 +03:00
alesapin
ce848ff2f0 Fix tidy 2021-04-17 17:06:49 +03:00
Alexey Milovidov
77e64b3ebd Merge branch 'master' into protocol-compression-auto 2021-04-17 16:46:51 +03:00
alexey-milovidov
138c6ae228
Merge pull request #23185 from ClickHouse/fix_22573
Fix data_type_default_nullable on ATTACH
2021-04-17 16:13:42 +03:00
alexey-milovidov
2634bccfc2
Merge pull request #23208 from ClickHouse/missing-semicolon
Fixed missing semicolon in exception message #14978
2021-04-17 16:03:07 +03:00
alexey-milovidov
a1ce6632d8
Merge pull request #23207 from ClickHouse/fix-bug-in-lowcardinality
Fix fairly terrible bug in LowCardinality #16171
2021-04-17 15:58:50 +03:00
alesapin
9fb3784f19 Merge branch 'master' into keeper_bench_mark 2021-04-17 15:58:33 +03:00
kssenii
5dc2dfa437 Fix 2021-04-17 09:00:58 +00:00
Azat Khuzhin
6064f3ef1d Fix memory tracking with min_bytes_to_use_mmap_io
With min_bytes_to_use_mmap_io=1 memory regions for mmap() will not be
accounted. But this creates issues, since if you will run simple
"SELECT * FROM big_enough_table" it will mmap lot's of files and the
process RSS will grow at some point, and before the kernel will
understand that it needs to unmap physical pages the clickhouse-server
will sync total_memory_tracker with RSS of the process and the
allocations will fail by per-server memory limits.

Also note, that this does not address all the issues with mmap()
regions.

v2: move track/untrack into the MMapReadBufferFromFileWithCache to avoid
data-race [1]

  [1]: https://clickhouse-test-reports.s3.yandex.net/23211/6acf6cb9b22cee7db8d1aa523a6208f63e792f7a/functional_stateful_tests_(thread).html#fail1
2021-04-17 10:37:38 +03:00
Nikita Mikhaylov
7a23d8292f done 2021-04-16 23:53:26 +00:00
Maksim Kita
3f3f928c1f
Merge pull request #21639 from changvvb/support-apple-m1
Support Apple m1
2021-04-17 02:44:15 +03:00
Alexey Milovidov
ec473a90d2 Fixed missing semicolon in exception message 2021-04-17 02:14:48 +03:00
Alexey Milovidov
36fe378a17 Fix fairly terrible bug in LowCardinality #16171 2021-04-17 02:11:21 +03:00
alexey-milovidov
786f340256
Merge pull request #22755 from kssenii/postgresql-protocol-with-row-policy
Allow row policy in postgresql protocol
2021-04-17 01:55:30 +03:00
Maksim Kita
d381e59791
Merge pull request #23114 from kitaisreal/fix-arcadia-build-s3
Fix arcadia build S3
2021-04-16 23:35:10 +03:00
Maksim Kita
4be441c6d5
Merge branch 'master' into support-apple-m1 2021-04-16 23:33:12 +03:00
alesapin
1b4e3ea1d4 Fix unit tests with new API 2021-04-16 23:07:40 +03:00
alesapin
5c7fa239e2 One more typo 2021-04-16 22:08:52 +03:00
Alexander Kuzmenkov
2782b2a6b0 fix 2021-04-16 21:50:12 +03:00
alesapin
8ff272cf7c Fix typo 2021-04-16 21:35:03 +03:00
alesapin
15cd9b116c Remove debug 2021-04-16 21:32:37 +03:00
alesapin
690045c67f Fix nasty bug 2021-04-16 21:31:23 +03:00
alexey-milovidov
74a0ac6917
Merge pull request #23160 from azat/logging-v2
[RFC] Change logging from trace to debug for messages with rows/bytes
2021-04-16 21:18:32 +03:00
Alexander Kuzmenkov
b991cbf9d6 more stable formatting for negate() 2021-04-16 19:28:33 +03:00
Alexander Tokmakov
3b4bd18809 fix prewhere in materialize mysql 2021-04-16 18:51:27 +03:00
tavplubix
3d1885f08c
Merge pull request #23177 from marsno1/fix-exception-log
Fix exception message for "parts_to_throw_insert"
2021-04-16 18:15:07 +03:00
Pavel Kovalenko
760a2ccedf DiskS3 restore file format change and minor improvements. 2021-04-16 17:43:16 +03:00
alesapin
7ed32dddf0 More checks 2021-04-16 17:00:12 +03:00
alesapin
7f69910e97 Followup fix 2021-04-16 16:56:57 +03:00
alesapin
539f6cda8b Followup fix 2021-04-16 16:56:05 +03:00
alesapin
aecab0a1f6 Followup fix 2021-04-16 16:55:39 +03:00
alesapin
e724952c03 Fix obvious bug 2021-04-16 16:53:48 +03:00
alesapin
f168bfae6d More optimal 2021-04-16 16:50:09 +03:00
Maksim Kita
d88e0b1b44 Use local shard if there are no remote connections 2021-04-16 16:01:53 +03:00
Nikita Mikhaylov
0ddb396338 add Y_IGNORE 2021-04-16 15:52:48 +03:00
Kruglov Pavel
deb86ee520
Merge pull request #22986 from azat/StorageBuffer-flush
[RFC] Add ability to flush buffer only in background for StorageBuffer
2021-04-16 15:14:24 +03:00
Anton Popov
b14798af2a Merge branch 'dev_nested_upadte' of git://github.com/hexiaoting/ClickHouse into nested-update 2021-04-16 14:41:19 +03:00
Nikolai Kochetov
d5882620b2 Fix condition 2021-04-16 14:33:20 +03:00
Alexander Kuzmenkov
74b4c56ba4
Merge pull request #21589 from dmalkr/dmalkr/arrayFold
Function `arrayFold` for folding over array with accumulator
2021-04-16 14:23:53 +03:00
Alexander Kuzmenkov
440efb6fb6
Update arrayFold.cpp 2021-04-16 14:22:23 +03:00
Nikolai Kochetov
23089a2fec Add special setting to show indexes. 2021-04-16 14:11:45 +03:00
Alexander Kuzmenkov
5e0fb440a5
Update TreeRewriter.cpp 2021-04-16 13:35:02 +03:00
Alexander Tokmakov
ebf0a3119e fix data_type_default_nullable on attach 2021-04-16 13:29:33 +03:00
Nikolai Kochetov
8d8e57615c A little bit better index description. 2021-04-16 12:42:23 +03:00
tavplubix
b5cbbce314
Merge pull request #22706 from songenjie/fetch_part
[clickhouse][server][ddl]support fetch part
2021-04-16 12:26:51 +03:00
tavplubix
ae3dc3dfc0
Merge pull request #23161 from ClickHouse/logs_for_debuging_test_failures
More verbose logs for debuging test failures with Replicated and Keeper
2021-04-16 12:01:58 +03:00
Maksim Kita
1797a67cf8
Merge pull request #22925 from kitaisreal/flat_dictionary_performance_test_fix
Dictionaries updated performance tests
2021-04-16 10:46:41 +03:00
madianjun
9238d8e54a Fix exception message for parts_to_throw_insert 2021-04-16 14:28:52 +08:00
Alexey Milovidov
9110a76d00 Reordered settings to avoid confusion 2021-04-16 00:14:37 +03:00
alexey-milovidov
dcb5d1b395
Merge pull request #23096 from ClickHouse/markdown-bad-alignment
Fix unpleasant behaviour of `Markdown` format
2021-04-16 00:06:58 +03:00
alexey-milovidov
081bb6e275
Merge pull request #23000 from ClickHouse/speedup-intdiv
Dynamic dispatch for `intDiv`
2021-04-16 00:05:43 +03:00
Pavel Kovalenko
84a420b806 Replace dynamic log getting with private log field in Disk classes. 2021-04-15 23:38:44 +03:00
Maksim Kita
94b228acc9
Update PocoHTTPClient.h 2021-04-15 21:51:15 +03:00
Alexander Tokmakov
0ad6205fa6 logs for debuging test failures with Replicated and Keeper 2021-04-15 21:34:53 +03:00
Azat Khuzhin
19e0439629 Add ability to flush buffer only in background for StorageBuffer
Add 3 new engine arguments:
- flush_time
- flush_rows
- flush_bytes

That will be checked only for background flush, this maybe useful if
INSERT latency is "crucial".
2021-04-15 21:22:13 +03:00
Azat Khuzhin
d2cf03ea41 Change logging from trace to debug for messages with rows/bytes 2021-04-15 21:00:16 +03:00
Nikolai Kochetov
be52b2889a Better description for key condition. 2021-04-15 20:30:04 +03:00
Alexander Kuzmenkov
2489b6af96 cleanup 2021-04-15 19:40:49 +03:00
Alexander Kuzmenkov
3b95b637a5 Merge remote-tracking branch 'origin/master' into HEAD 2021-04-15 18:19:53 +03:00
changvvb
0be5976967 Merge branch 'support-apple-m1' of github.com:changvvb/ClickHouse into support-apple-m1 2021-04-15 22:57:23 +08:00
changvvb
4eee2d0977 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into support-apple-m1 2021-04-15 22:54:26 +08:00
Alexey Milovidov
bd49e696c4 Minor change 2021-04-15 16:59:00 +03:00
Pavel Kruglov
847cd54c6b Add Y_IGNORE to includes 2021-04-15 15:06:40 +03:00
Pavel Kovalenko
6a067d705a Missed include. 2021-04-15 14:59:01 +03:00
Dmitry Krylov
bf51f94f37 Fix constness 2021-04-15 21:46:15 +10:00
Alexey Milovidov
d19b2cb948 Fix build 2021-04-15 14:41:55 +03:00
alexey-milovidov
b097140bb4
Merge pull request #23083 from azat/logging
Tiny logging improvements
2021-04-15 14:39:47 +03:00
Maksim Kita
e361f5943f
Merge pull request #22999 from azat/no-optimize_skip_unused_shards-single-node
Do not perform optimize_skip_unused_shards for cluster with one node
2021-04-15 14:36:56 +03:00
alexey-milovidov
69eac517b6
Merge pull request #23086 from azat/memory-blocking
Block all memory tracking limits in dtors/SCOPE_EXIT_*SAFE/tryLogCurrentException
2021-04-15 14:36:10 +03:00
Nikita Mikhaylov
a6b43f6765
Merge pull request #22594 from excitoon-favorites/betters3timeouts
Consistent AWS timeouts
2021-04-15 14:29:21 +03:00
Vladimir Chebotarev
f3e152739b Rebase fix. 2021-04-15 14:00:59 +03:00
Vladimir
8c7ffda676
Merge pull request #22753 from ClickHouse/revert-19685-dev_joinon 2021-04-15 12:42:50 +03:00
Maksim Kita
eceed68d62 Fix arcadia build S3 2021-04-15 12:31:09 +03:00
Dmitry Krylov
75036debf4 Check type match of lambda and accumulator 2021-04-15 19:25:30 +10:00
alesapin
50103ff0bc Merge branch 'master' into keeper_bench_mark 2021-04-15 11:30:33 +03:00
Pavel Kovalenko
e53fc635f6 Disk S3 restore test improvements. 2021-04-15 11:26:44 +03:00
Vladimir Chebotarev
95866e6e8d Rebase fix. 2021-04-15 10:57:08 +03:00
Vladimir Chebotarev
f59d35efd8 Rebase fix. 2021-04-15 10:53:00 +03:00
Vladimir Chebotarev
6e379fe778 Final style fix. 2021-04-15 10:01:47 +03:00
Vladimir Chebotarev
71621eb676 Style fix. 2021-04-15 10:01:47 +03:00
Vladimir Chebotarev
f85e521e47 Style fix. 2021-04-15 10:01:47 +03:00
Vladimir Chebotarev
342d907b65 Review fixes. 2021-04-15 10:01:47 +03:00
Vladimir Chebotarev
116423b30c Some refactoring. 2021-04-15 10:01:47 +03:00
Vladimir Chebotarev
c0ea3ce08a Removed STS client. 2021-04-15 10:01:43 +03:00
Vladimir Chebotarev
c61cfd0d97 Minor build fixes. 2021-04-15 10:01:16 +03:00
Vladimir Chebotarev
aae8a1f9d9 Moved AWSSTSAssumeRoleCredentialsProvider to the top of the provider chain. 2021-04-15 10:01:16 +03:00
Vladimir Chebotarev
3a467ffc50 Attempt to make credentials provider which uses internal credentials provider chain. 2021-04-15 10:01:13 +03:00
Vladimir Chebotarev
037a4de854 Added STS GetCallerIdentity credentials provider. 2021-04-15 10:00:18 +03:00
Vladimir Chebotarev
817c5cec25 Correct S3 read retries. 2021-04-15 09:47:22 +03:00
Vladimir Chebotarev
cf903d526c Better logging. 2021-04-15 09:47:22 +03:00
Vladimir Chebotarev
10bf56e540 Attempt to add retries to S3 reads. 2021-04-15 09:47:19 +03:00
Pavel Kovalenko
a2623a2d97 Rework Disk S3 revision number storing / searching. 2021-04-15 02:09:20 +03:00
Alexey Milovidov
15153e504a Fix unpleasant behaviour of Markdown format 2021-04-15 02:08:43 +03:00
alexey-milovidov
9b546f3b89
Merge pull request #22657 from amosbird/ctefix3
Fix CTE usage in view definition
2021-04-15 02:01:10 +03:00
Alexey Milovidov
2ae8839e3d Style 2021-04-15 01:28:40 +03:00
Alexey Milovidov
7f7e04117d Arcadia, ARM, PowerPC 2021-04-15 01:27:53 +03:00
Alexey Milovidov
f6f0d001cd Merge branch 'master' into speedup-intdiv 2021-04-15 01:27:15 +03:00
Pavel Kovalenko
cad81e3742 Disk S3 possibility to restore parts to 'detached' directory. 2021-04-15 00:55:48 +03:00
Alexey Milovidov
17d04cbca9 Merge branch 'master' into protocol-compression-auto 2021-04-15 00:24:07 +03:00
tavplubix
2479c80fb7
Merge branch 'master' into fix_attach_mv 2021-04-15 00:07:48 +03:00
Azat Khuzhin
9b9e0a9bbc Block all memory tracking limits in destructors 2021-04-14 23:38:42 +03:00
Azat Khuzhin
22d394c4a3 Block all memory tracking limits in tryLogCurrentException() 2021-04-14 23:38:41 +03:00
Azat Khuzhin
b6d7562cc2 Update comments for memoryTrackerCanThrow() 2021-04-14 23:38:41 +03:00
tavplubix
021cafff49
Merge pull request #23041 from ClickHouse/fix_testkeeper_multi_response
Fix multi response in TestKeeper
2021-04-14 23:25:40 +03:00
Azat Khuzhin
4b69684cd2 Add logging about pushing to underlying in StorageKafka 2021-04-14 23:15:31 +03:00
Azat Khuzhin
6b9534cad8 Add copyData() with std::atomic and progress callback 2021-04-14 23:15:31 +03:00
Azat Khuzhin
3a2e8fea68 Change logging levels for PushingToViewsBlockOutputStream
Use different logging levels for overall push and push per view.
2021-04-14 23:15:31 +03:00
Pavel Kovalenko
b1ba2cf2bc Disk S3 possibility to restore parts to 'detached' directory. 2021-04-14 19:21:26 +03:00
Maksim Kita
2c3abcaad1 Updated test 2021-04-14 16:49:38 +03:00
alexey-milovidov
496c2e45d0
Merge pull request #23036 from Enmk/fix_extractAllGroupsHorizontal_max_matches
Fixed erroneus failure of extractAllGroupsHorizontal on large columns
2021-04-14 15:57:19 +03:00
Ivan
2b78765957
Merge branch 'master' into postgresql-protocol-with-row-policy 2021-04-14 14:50:28 +03:00
Christian
969b63d1ac
Excludes views from syncing in MaterializeMySQL (#22760)
* Excludes views from syncing in MaterializeMySQL

* Adds integration test for ignoring MySQL views on initial replication

* Fixes bug in initial integration test for excluding views from replicating to ClickHouse on initial replication

* Fixes bug in initial integration test for excluding views from replicating to ClickHouse on initial replication

* Replace assert with check_query

Co-authored-by: Christian Frøystad <christian@securepractice.no>
Co-authored-by: Ivan <5627721+abyss7@users.noreply.github.com>
2021-04-14 14:19:07 +03:00
alexey-milovidov
f8ce5547aa
Merge pull request #21318 from azat/servers-pool-wait
Fix SIGSEGV by waiting servers thread pool
2021-04-14 14:15:07 +03:00
alexey-milovidov
d3f8a9c23a
Merge pull request #23044 from ClickHouse/array-has-any-all-generic
Fix unfinished code in GatherUtils #20272
2021-04-14 13:57:30 +03:00
songenjie
c06c624fc7 fix build 2021-04-14 18:55:42 +08:00
Maksim Kita
470b0db8a2
Merge pull request #23049 from ClickHouse/remove-useless-code-6
Remove useless files
2021-04-14 13:27:54 +03:00
songenjie
1fc040ac58 fix some Suggestfix some Suggest 2021-04-14 17:54:56 +08:00
songenjie
8566df9b7d fix some Suggest 2021-04-14 17:11:59 +08:00
hexiaoting
61e2ffc0dd Fix build error 2021-04-14 16:53:06 +08:00
hexiaoting
89d74e40ed Fix error for derived class 2021-04-14 16:45:05 +08:00
Maksim Kita
4425bec599
Merge pull request #22764 from kitaisreal/connection-pool
Moved BorrowedObjectPool to common
2021-04-14 11:23:56 +03:00
Maksim Kita
dcf41db1ae
Merge pull request #23048 from kitaisreal/library-dictionary-bridge-library-interface
LibraryDictionary bridge library interface
2021-04-14 11:23:29 +03:00
songenjie
f731739fab fix suggests 2021-04-14 10:05:41 +08:00
alexey-milovidov
6a2a9cecdd
Update extractAllGroups.h 2021-04-14 01:24:46 +03:00
Alexey Milovidov
6f56c3280f Uncompress data in Distributed sends if needed 2021-04-14 00:53:39 +03:00
Vasily Nemkov
77bdb5b391 Fixed erroneus failure of extractAllGroupsHorizontal on large columns 2021-04-14 00:17:06 +03:00
Alexey Milovidov
e08c8a3d2c Merge branch 'master' into protocol-compression-auto 2021-04-13 23:43:08 +03:00
Nikita Mikhaylov
2a86d76ccd style 2021-04-13 23:19:04 +03:00
Nikita Mikhaylov
ec35a878d3 simplify storages3cluster 2021-04-13 23:17:25 +03:00
Maksim Kita
0cfe018fd4 Moved BorrowedObjectPool to common 2021-04-13 23:15:22 +03:00
tavplubix
39d55556b8
Update StorageMaterializedView.cpp 2021-04-13 23:14:05 +03:00
Alexey Milovidov
07b610cf70 Remove useless files 2021-04-13 23:04:13 +03:00
Nikita Mikhaylov
5aac762d9c apply suggestion from Maksim Polyanskiy 2021-04-13 22:57:01 +03:00
Maksim Kita
616d7d19f8 LibraryDictionary bridge library interface 2021-04-13 22:53:36 +03:00
Nikita Mikhaylov
3954eff276 do not use cluster from config on remote replicas 2021-04-13 22:39:43 +03:00
Nikita Mikhaylov
b05718feac style 2021-04-13 22:39:43 +03:00
Nikita Mikhaylov
c9ae4cb467 multiplem pipes on remote 2021-04-13 22:39:43 +03:00
Nikita Mikhaylov
024374a2ec review fixes 2021-04-13 22:39:43 +03:00
Nikita Mikhaylov
f36a715c32 delete unused code 2021-04-13 22:39:43 +03:00
Nikita Mikhaylov
a15757a9c9 better renaming 2021-04-13 22:39:43 +03:00
Nikita Mikhaylov
09a62e713a rename to s3Cluster 2021-04-13 22:39:43 +03:00
Nikita Mikhaylov
a743442a17 build fixes 2021-04-13 22:39:43 +03:00
Nikita Mikhaylov
507cb8514a review fixes 2021-04-13 22:39:43 +03:00
Nikita Mikhaylov
75230e3701 better 2021-04-13 22:39:43 +03:00
Nikita Mikhaylov
7a68820342 style 2021-04-13 22:39:42 +03:00
Nikita Mikhaylov
7b95ff579d fix S3 test 2021-04-13 22:39:42 +03:00