tavplubix
7d6ab32eb6
Update DatabaseCatalog.cpp
2020-04-24 01:08:26 +03:00
Артем Стрельцов
d7e27d4326
added SETTINGS section to DDL-query for CREATE DICTIONARY
2020-04-24 00:57:40 +03:00
Артем Стрельцов
f39fdf7182
some progress in parsing settings (i did this commit for having something to backup to)
2020-04-23 23:50:01 +03:00
Alexander Tokmakov
8be4d51111
fix build
2020-04-23 22:50:05 +03:00
Alexey Milovidov
2b569cf260
Added clarification in exception message #10405
2020-04-23 21:31:37 +03:00
Alexander Tokmakov
15e7ce0053
fixes
2020-04-23 21:00:43 +03:00
Alexander Tokmakov
f413061e0d
remove Context from some IDatabase methods
2020-04-23 19:51:48 +03:00
alesapin
5ae25b68e4
Remove redundant virtual from function
2020-04-23 18:18:33 +03:00
alesapin
b0a73589b0
Remove virtual columns as separate field from IStorage
2020-04-23 18:09:00 +03:00
Alexander Tokmakov
04d6b59ac0
Merge branch 'master' into database_atomic
2020-04-23 17:31:37 +03:00
Артем Стрельцов
5da371b9c0
added settings parsing from DDL-query (they aren't applied now)
2020-04-23 15:39:27 +03:00
alexey-milovidov
1ecfa27cd3
Merge pull request #10441 from ClickHouse/remove_casts_from_defaults
...
Remove CAST from DEFAULT expressions during table creation.
2020-04-23 12:36:12 +03:00
Nikita Mikhaylov
3520755ab5
fix c++20 usage
2020-04-23 12:00:43 +03:00
Azat Khuzhin
4f5ec14f27
Configure thread names for buffer/distributed schedule pools
2020-04-23 03:16:14 +03:00
Azat Khuzhin
d854049d21
Add tasks/memory metrics for distributed/buffer schedule pools
...
Follow-up-for: #10315
Follow-up-for: #10263
2020-04-23 02:18:37 +03:00
Azat Khuzhin
c04c73b4c4
Drop unused MemoryTrackingForMerges from Context
...
It set in src/Storages/MergeTree/MergeList.cpp anyway.
2020-04-23 01:57:33 +03:00
alexey-milovidov
77969d11a5
Merge pull request #10442 from zhang2014/fix/create_database_failure
...
Not remove metadata directory when attach database fails
2020-04-23 01:07:13 +03:00
alexey-milovidov
b8e3655f0d
Merge pull request #10445 from azat/logger-source-coloring-client
...
Make logger name colored in client too
2020-04-23 00:35:40 +03:00
alexey-milovidov
fd27ce619b
Merge pull request #10444 from ClickHouse/server-memory-profiler
...
Simple server wide memory profiler
2020-04-23 00:34:23 +03:00
alexey-milovidov
4f6bb00424
Merge pull request #10420 from ClickHouse/clang-tidy-8
...
Fixes for clang-tidy on clang-10
2020-04-23 00:33:41 +03:00
Alexander Tokmakov
e02b5790af
fix
2020-04-22 23:49:13 +03:00
Alexander Tokmakov
1833ac7f16
fixes
2020-04-22 23:43:10 +03:00
Nikita Mikhaylov
3cf2016867
Merge pull request #10188 from nikitamikhaylov/quorum_bug
...
insert_quorum vs drop partition or ttl
2020-04-23 00:11:57 +04:00
alexey-milovidov
9e14603ae5
Update DatabaseFactory.cpp
2020-04-22 22:37:30 +03:00
Azat Khuzhin
8715cef94c
Make logger name colored in client too
...
Follow-up-for: #10343
2020-04-22 22:34:35 +03:00
Alexey Milovidov
282b5785c1
Fixed error
2020-04-22 21:41:19 +03:00
Alexander Kuzmenkov
3d5809a4ac
Merge pull request #10340 from ClickHouse/aku/unstable-codec-test
...
Copy less memory in squashing transform.
2020-04-22 21:18:42 +03:00
Alexey Milovidov
73dd78bac1
Merge branch 'master' into clang-tidy-8
2020-04-22 21:04:47 +03:00
Alexey Milovidov
07dcf40a6a
Simple server wide memory profiler
2020-04-22 20:52:21 +03:00
zhang2014
a622208284
Not remove metadata directory when attach database fails
2020-04-23 00:03:58 +08:00
Alexey Milovidov
d189375051
Fix Mac OS build
2020-04-22 17:56:31 +03:00
alesapin
45b8cb5b37
Remove casts from table creation by default
2020-04-22 17:29:38 +03:00
Alexander Tokmakov
fefbbd37df
Merge branch 'master' into database_atomic
2020-04-22 17:02:30 +03:00
zhang2014
0a0555d4d7
ISSUES-9623 fix failure test case
2020-04-22 18:34:42 +08:00
Alexey Milovidov
d3418bbb02
Fix clang-tidy
2020-04-22 11:45:14 +03:00
Alexey Milovidov
8c9408f927
Checkpoint
2020-04-22 11:31:10 +03:00
zhang2014
bfb87f0eab
ISSUES-9623 check the number and type of arguments when creating BloomFilter index
2020-04-22 16:17:09 +08:00
Alexey Milovidov
03e17405cd
Checkpoint
2020-04-22 10:03:43 +03:00
Alexey Milovidov
603d132d45
Checkpoint
2020-04-22 09:34:20 +03:00
Alexey Milovidov
1e325a9fd9
Checkpoint
2020-04-22 09:22:14 +03:00
alexey-milovidov
7065a8ba9c
Merge pull request #10422 from azat/fallback_to_stale_replicas-over-skip_unavailable_shards
...
Prefer fallback_to_stale_replicas over skip_unavailable_shards
2020-04-22 09:20:25 +03:00
Alexey Milovidov
0a7edce036
Checkpoint
2020-04-22 09:01:33 +03:00
Alexey Milovidov
be22a4b94e
Checkpoint
2020-04-22 08:39:31 +03:00
Alexey Milovidov
b9b5036749
Merge branch 'master' into clang-tidy-8
2020-04-22 07:54:27 +03:00
Alexey Milovidov
e6acb35d95
Added a fix from Vadim Plakhtinskiy @VadimPlh
2020-04-22 07:32:05 +03:00
alexey-milovidov
eb0a1ec755
Merge pull request #10415 from azat/dict-load-after-detach-attach
...
Fix dictionary name (RELOAD and system.dictionaries) after DETACH/ATTACH
2020-04-22 06:57:08 +03:00
alexey-milovidov
7690c34e5b
Merge pull request #10424 from ClickHouse/tsv-bom-extra-case
...
Allow to parse BOM in TSV if the first column cannot contain BOM in its value
2020-04-22 06:56:43 +03:00
Alexander Kuzmenkov
d1c5e38a21
Merge pull request #10385 from CurtizJ/tuple-literal
...
Parse tuples of tuples as literals
2020-04-22 05:49:14 +03:00
alexey-milovidov
98294dc9fa
Merge pull request #10421 from ClickHouse/max_server_memory_usage_as_server_level_setting
...
Make max_server_memory_usage server level setting.
2020-04-22 03:34:17 +03:00
Alexey Milovidov
c805ed4dea
Fixes for clang-tidy on clang-10
2020-04-22 03:29:38 +03:00
Alexey Milovidov
e8a9c7d518
Allow to parse BOM in TSV if the first column cannot contain BOM in its value
2020-04-22 02:46:42 +03:00
Alexander Kuzmenkov
c232f641b4
Merge branch 'master' into aku/unstable-codec-test
2020-04-22 02:40:53 +03:00
alexey-milovidov
0754eb7e78
Merge pull request #10416 from 4ertus2/perf
...
Improve HashJoin memory usage
2020-04-22 01:44:46 +03:00
Azat Khuzhin
0cc9dbd35b
Prefer fallback_to_stale_replicas over skip_unavailable_shards
...
Patch from: @alex-zaitsev
2020-04-22 01:42:23 +03:00
Alexey Milovidov
0482e2e3ea
Implement suggestion from Sergey Veletsky
2020-04-22 01:40:18 +03:00
alexey-milovidov
fcf5c3c6e1
Merge pull request #10399 from ClickHouse/fix-distributed_group_by_no_merge-segfault
...
Fix segfault with distributed_group_by_no_merge
2020-04-22 01:28:02 +03:00
Ivan
555488a458
Fix build in Arcadia ( #10413 )
2020-04-21 23:23:44 +03:00
Artem Zuikov
96b9edae29
fix comment
2020-04-21 22:09:18 +03:00
Artem Zuikov
17b0641b02
improve HashJoin memory usage
2020-04-21 22:01:34 +03:00
Alexey Milovidov
33338b722a
Fix Mac OS #10246
2020-04-21 21:49:28 +03:00
Azat Khuzhin
9173895f85
Fix dictionary name (RELOAD and system.dictionaries) after DETACH/ATTACH
...
After DETACH/ATTACH (or at server startup) the following will be broken:
- SYSTEM RELOAD DICTIONARY db_name.dict_name
- system.dictionaries will not have database for those dictionaries
The problem is that after DETACH/ATTACH the dictionary information is
obtained from metadata/$db/$dict.sql, but it does not have database
name.
Fix this by passing database name to the getDictionaryConfigurationFromAST().
Introduced-in: #10234
2020-04-21 21:03:12 +03:00
Alexander Kuzmenkov
fcfbe4bfea
Update SquashingTransform.h
2020-04-21 19:27:56 +03:00
Alexander Kuzmenkov
a32ef00bf1
less copying
2020-04-21 17:59:57 +03:00
Anton Popov
3ccff833c1
fix ConstantExpressionTemplate with arrays
2020-04-21 15:54:36 +03:00
Nikita Mikhaylov
2173bcf28e
Merge branch 'master' of github.com:ClickHouse/ClickHouse into quorum_bug
2020-04-21 14:35:06 +03:00
Nikolai Kochetov
87a0b40ace
Do not create extra totals and extremes ports.
2020-04-21 12:31:40 +03:00
Nikolai Kochetov
1d2388de39
Drop currently calculated totals and extremes before aggregation.
2020-04-21 11:45:28 +03:00
Alexey Milovidov
4cc0269de0
Fix flattening of Array(Tuple(...)) #10259
2020-04-21 02:44:51 +03:00
alexey-milovidov
4ecc86beca
Merge pull request #9950 from ClickHouse/aku/literal-columns
...
Create unique columns for literals
2020-04-21 02:30:17 +03:00
alexey-milovidov
2645dede2c
Merge pull request #10386 from palasonic1/palasonic-fix-read-hash-table
...
Fix reading HashTable from buffer
2020-04-21 02:26:47 +03:00
tavplubix
1a067484c8
Merge pull request #10137 from kekekekule/direct_queries
...
Add custom settings support for certain dictionary sources
2020-04-21 01:21:32 +03:00
Alexander Tokmakov
17c0317b80
minor fixes
2020-04-21 01:17:53 +03:00
alexey-milovidov
8c2839d3c9
Merge pull request #10308 from ClickHouse/shared-context-lifetime
...
Shared context lifetime
2020-04-21 00:12:45 +03:00
alexey-milovidov
fe1309e575
Merge pull request #10381 from ClickHouse/fix-concat-prepare
...
Fix concat prepare
2020-04-21 00:07:32 +03:00
alexey-milovidov
ab922d44d5
Merge pull request #10379 from ClickHouse/only_fetch_repliac
...
Add setting always_fetch_merged_part
2020-04-21 00:07:00 +03:00
alexey-milovidov
2c8576798b
Merge pull request #10354 from oandrew/avro-nested
...
Avro nested fields insert support
2020-04-20 23:36:02 +03:00
alexey-milovidov
3d4696d4ef
Update AvroRowInputFormat.cpp
2020-04-20 23:34:48 +03:00
alexey-milovidov
c4758b69a2
Merge pull request #10378 from hczhcz/patch-0420
...
Add JSONExtractKeysAndValuesRaw
2020-04-20 23:30:40 +03:00
alexey-milovidov
4912940009
Update FunctionsJSON.h
2020-04-20 23:28:54 +03:00
alexey-milovidov
2d799cf096
Merge pull request #10375 from azat/aggregator-drop-disk-reservation
...
Drop disks reservation in Aggregator
2020-04-20 23:22:14 +03:00
Maxim Serebryakov
a99a340b0b
fix reading HashTable and HashSet
2020-04-20 23:19:03 +03:00
Anton Popov
e1b7e2de2f
parse tuples of tuples as literals
2020-04-20 23:14:56 +03:00
alexey-milovidov
69b6f135e7
Merge pull request #10382 from excitoon-favorites/altercodec
...
Allowed to alter column in non-modifying data mode when the same type is specified
2020-04-20 22:54:53 +03:00
alexey-milovidov
f6de9c6ffd
Update AlterCommands.cpp
2020-04-20 22:54:08 +03:00
alexey-milovidov
1eca5088ec
Update AlterCommands.cpp
2020-04-20 22:53:19 +03:00
alexey-milovidov
faeab5f649
Merge pull request #10370 from amosbird/clang-10
...
clang-10 fix
2020-04-20 22:47:12 +03:00
Alexander Kuzmenkov
3ee89344af
Statically dispatch on whether the argument is a Tuple
2020-04-20 18:37:28 +03:00
Ivan
d5b0a7e691
Fix Arcadia build ( #10380 )
2020-04-20 15:21:25 +03:00
Vladimir Chebotarev
82985ff594
Allowed to alter column in non-modifying data mode when the same type is specified.
2020-04-20 14:15:06 +03:00
Alexander Tokmakov
b29bddac12
Merge branch 'master' into database_atomic
2020-04-20 14:09:09 +03:00
Nikolai Kochetov
3dbc9b5562
Fix prepare for ConcatProcessor.
2020-04-20 14:03:29 +03:00
Nikita Mikhaylov
05206df88c
better
2020-04-20 13:56:59 +03:00
alesapin
1bc84ec8b4
Fix comments
2020-04-20 13:56:23 +03:00
alesapin
8767ea7efa
Add setting which restrict replica to merge parts by itself and always prefer dowloading from other replicas.
2020-04-20 13:53:29 +03:00
Nikolai Kochetov
c2c99b02bc
Fix prepare for ConcatProcessor.
2020-04-20 13:36:38 +03:00
hcz
32573c0590
Add JSONExtractKeysAndValuesRaw
2020-04-20 18:08:22 +08:00
Nikolai Kochetov
052598534a
Try fix unit tests.
2020-04-20 12:42:56 +03:00
Azat Khuzhin
9ca86dbf34
Drop disks reservation in Aggregator
...
True reservation (IVolume::reserve()) will not takes compression into
account, and you aggregate a lot of data then it will likely fail even
though it can be completed, but just because you have big
max_bytes_before_external_group_by and huge max_threads it will fail.
2020-04-20 11:33:46 +03:00
alexey-milovidov
9d0004cba0
Merge pull request #10365 from ClickHouse/avoid-infinite-loop-in-hierarchical-dictionaries
...
Avoid infinite loop in hierarchical dictionaries
2020-04-20 10:54:16 +03:00
Amos Bird
2d08c8e4ab
clang-10 fix
2020-04-20 15:45:37 +08:00
alexey-milovidov
83e17ae327
Merge pull request #9885 from ClickHouse/sorting-processors
...
Sorting processors
2020-04-20 09:30:03 +03:00
Alexey Milovidov
d7264b292d
Merge branch 'master' into sorting-processors
2020-04-20 09:29:41 +03:00
Alexey Milovidov
70054e90d6
Merge branch 'master' into execute-query-flush-format-2
2020-04-20 09:19:34 +03:00
alexey-milovidov
587e16e23b
Merge pull request #10363 from ClickHouse/fixed-string-compare-as-zero-padded
...
Compare with fixed string of different size as if strings are zero padded
2020-04-20 09:14:27 +03:00
Alexey Milovidov
47e4d14ece
Whitespace
2020-04-20 09:13:04 +03:00
alexey-milovidov
1577d771df
Merge pull request #10341 from azat/auto_distributed_group_by_no_merge
...
Auto distributed_group_by_no_merge on GROUP BY sharding key
2020-04-20 08:30:27 +03:00
Alexey Milovidov
a3195d56ae
Fix translation
2020-04-20 07:19:50 +03:00
Alexey Milovidov
be4d20e690
Fixed an error and added a test
2020-04-20 07:02:52 +03:00
Alexey Milovidov
acde587c75
Merge branch 'master' into fixed-string-compare-as-zero-padded
2020-04-20 06:49:21 +03:00
Alexey Milovidov
c893edf46f
Fix style
2020-04-20 06:48:35 +03:00
alexey-milovidov
fd738f9a61
Merge pull request #10364 from ClickHouse/check-error-code-in-part-check
...
Check for error code in part check
2020-04-20 06:46:36 +03:00
alexey-milovidov
7e5b044e67
Merge pull request #10362 from ClickHouse/rework-total-memory-tracker
...
Rework total memory tracker
2020-04-20 06:16:49 +03:00
Alexey Milovidov
3862085af7
Fix for embedded dictionaries
2020-04-20 05:39:43 +03:00
Alexey Milovidov
d99c26a40c
Fix infinite loop in dictIsIn function #515
2020-04-20 05:31:21 +03:00
Alexey Milovidov
7023e096ec
Check for error code in part check #6269
2020-04-20 04:44:24 +03:00
Alexey Milovidov
59a9edd018
Added forgotten modification
2020-04-20 04:43:25 +03:00
Alexey Milovidov
d783162548
Compare with fixed string as smaller string is zero padded #9272
2020-04-20 04:01:31 +03:00
Alexey Milovidov
237db26688
Less wrong
2020-04-20 02:11:41 +03:00
Alexey Milovidov
39c6c9a5d7
Merge remote-tracking branch 'origin/master' into system-tables-lazy-load
2020-04-20 02:00:46 +03:00
Alexey Milovidov
3755a5ba54
Added suggestion from Azat
2020-04-20 01:59:21 +03:00
Alexey Milovidov
2987e70aab
Introduce "max_server_memory_usage" setting
2020-04-20 01:59:21 +03:00
Alexey Milovidov
ec6b176f3b
Rework total memory tracker #10293
2020-04-20 01:59:21 +03:00
Azat Khuzhin
e44d5c5749
Fix clang readability-container-size-empty warning in StorageDistributed::canForceGroupByNoMerge()
2020-04-20 01:12:22 +03:00
Alexey Milovidov
1c00953b3e
Added test tool
2020-04-19 23:57:34 +03:00
Alexey Milovidov
71c4418876
More memory statistics
2020-04-19 23:49:13 +03:00
Alexey Milovidov
25f3184dbe
Merge branch 'master' into async-metric-memory-usage
2020-04-19 23:18:12 +03:00
Alexey Milovidov
8d3e6ed5e3
Added missing code
2020-04-19 23:04:59 +03:00
Alexey Milovidov
ca6bea3731
Added a patch from Alexander Burmak
2020-04-19 22:53:12 +03:00
zhang2014
57cbecf935
ISSUES-5436 reworking predefine http
2020-04-20 03:18:36 +08:00
Alexey Milovidov
5262512f0c
Flush output for interactive applications
2020-04-19 22:02:36 +03:00
zhang2014
835dc4c445
After merge upsream master fix
2020-04-20 02:26:42 +08:00
zhang2014
8105a9bbe0
ISSUES-5436 fix review suggestions
2020-04-20 02:26:06 +08:00
zhang2014
847f7ab439
ISSUES-5436 fix build failure & fix test failure
2020-04-20 02:25:43 +08:00
zhang2014
6b716e511b
ISSUES-5436 support custom http [part 6]
2020-04-20 02:25:12 +08:00
zhang2014
7aef95b082
ISSUES-5436 support custom http [part 5]
2020-04-20 02:23:18 +08:00
zhang2014
fd00757178
ISSUES-5436 support custom http [part 4]
2020-04-20 02:23:18 +08:00
zhang2014
60abff3341
ISSUES-5436 support custom http [part 3]
2020-04-20 02:23:18 +08:00
zhang2014
183eb82b7c
ISSUES-5436 support custom http [part 2]
2020-04-20 02:23:18 +08:00
zhang2014
159ba24fca
ISSUES-5436 support custom http
2020-04-20 02:23:18 +08:00
Alexey Milovidov
cf6bbaeb97
Flush output format on each block in executeQuery
2020-04-19 21:12:40 +03:00
Azat Khuzhin
be1dec9239
Fix distributed_group_by_no_merge optimization for Distributed-over-Distributed
2020-04-19 21:11:14 +03:00
Azat Khuzhin
93d049fe64
Allow auto distributed_group_by_no_merge for DISTINCT of sharding key
2020-04-19 18:53:37 +03:00
Nikolai Kochetov
67b3487207
Try fix build.
2020-04-19 18:46:12 +03:00
Nikolai Kochetov
e969f66aca
Try fix test.
2020-04-19 18:41:35 +03:00
Azat Khuzhin
de4a723264
Auto distributed_group_by_no_merge on GROUP BY injective function of sharding key
2020-04-19 18:33:49 +03:00
Azat Khuzhin
5d11118cc9
Use thread pool (background_distributed_schedule_pool_size) for distributed sends
...
After #8756 the problem with 1 thread for each (distributed table, disk)
for distributed sends became even worse (since there can be multiple
disks), so use predefined thread pool for this tasks, that can be
controlled with background_distributed_schedule_pool_size knob.
2020-04-19 12:01:56 +03:00
Azat Khuzhin
201d5d5b25
Update comment for background_schedule_pool_size
...
Include info about:
- kafka streaming
- dns cache updates
2020-04-19 11:20:57 +03:00
Andrew Onyshchuk
68f2e93443
Fix style
2020-04-18 22:54:22 -05:00
Azat Khuzhin
673ddc9d77
Drop superfluous locking for atomic in DirectoryMonitor
2020-04-19 00:22:48 +03:00
Andrew Onyshchuk
14647ed03b
Add Avro nested fields insert support
2020-04-18 15:46:24 -05:00