kssenii
a594f388a4
Merge master
2022-03-01 19:43:45 +01:00
alesapin
cba5fe44a9
Merge branch 'master' into unrestricted-zk-reads
2022-03-01 18:09:21 +01:00
kssenii
092ec45b47
Merge master
2022-03-01 12:06:56 +01:00
mergify[bot]
8014cdf9d3
Merge branch 'master' into random-settings
2022-02-28 14:06:22 +00:00
Anton Popov
fcdebea925
Merge remote-tracking branch 'upstream/master' into HEAD
2022-02-25 13:41:30 +03:00
Alexander Tokmakov
aa6b9a2abc
Merge branch 'master' into mvcc_prototype
2022-02-23 23:22:03 +03:00
kssenii
003b807b00
Fix
2022-02-23 20:33:05 +01:00
kssenii
4543513a5d
Add comments
2022-02-21 13:54:03 +01:00
mergify[bot]
314ab73b11
Merge branch 'master' into nv/move-part-settings-cleanup
2022-02-21 10:18:44 +00:00
Sergei Trifonov
b6bb479c48
add setting to enable unrestricted reads from zookeeper
2022-02-16 23:03:44 +03:00
avogar
1e797c1a8f
Fix some tests
2022-02-16 15:10:02 +00:00
kssenii
47f94120da
Merge master
2022-02-16 14:43:28 +01:00
Alexander Tokmakov
1e4e569151
Merge branch 'master' into mvcc_prototype
2022-02-15 02:26:47 +03:00
alexey-milovidov
bc206ec423
Merge pull request #31182 from ClickHouse/memory-overcommit
...
Memory overcommit
2022-02-14 23:55:02 +03:00
mergify[bot]
55ee701d07
Merge branch 'master' into kssenii-patch-3
2022-02-14 08:08:59 +00:00
Nikolai Kochetov
b7972d5ae0
Merge pull request #34456 from ClickHouse/allow_experimental_projection_optimization-by-default
...
Allow allow_experimental_projection_optimization by default
2022-02-11 17:52:15 +01:00
Alexander Tokmakov
07e66e690d
Merge branch 'master' into mvcc_prototype
2022-02-11 15:53:32 +03:00
mergify[bot]
cb3e5f8538
Merge branch 'master' into memory-overcommit
2022-02-10 11:01:43 +00:00
Anton Popov
18940b8637
Merge remote-tracking branch 'upstream/master' into HEAD
2022-02-09 23:38:38 +03:00
mergify[bot]
d55eadc3c9
Merge branch 'master' into default-table-engine
2022-02-09 17:08:31 +00:00
Nikolai Kochetov
8ea5aab7aa
Update Settings.h
2022-02-09 17:02:44 +03:00
Kseniia Sumarokova
43dc769022
Update Settings.h
2022-02-09 14:19:07 +01:00
Nikolai Kochetov
881b5ebbbb
Update Settings.h
2022-02-09 15:53:24 +03:00
alesapin
437940b29d
Merge pull request #34422 from ClickHouse/add_settings_to_part_size_in_s3
...
Add settings for multipart upload part size in s3
2022-02-09 12:51:20 +03:00
alesapin
f6e7cea1f8
Add settings for S3 multipart upload parts size
2022-02-08 19:38:04 +03:00
Kruglov Pavel
720310fcf1
Merge branch 'master' into http-buffer-skip-not-found-url-for-globs
2022-02-08 16:56:22 +03:00
Yatsishin Ilya
bcf4303286
Merge remote-tracking branch 'origin' into default-table-engine
2022-02-08 10:35:29 +00:00
Kruglov Pavel
b4fec2af7c
Merge pull request #34065 from Avogar/msgpack
...
Support UUID in MsgPack format
2022-02-08 11:42:17 +03:00
kssenii
eba3011ada
Fix
2022-02-07 20:40:47 +01:00
Nicolae Vartolomei
7d77678a9f
Remove useless setting experimental_query_deduplication_send_all_part_uuids
...
This setting made sense for testing deduplication before part movement was actually implemented.
allow_experimental_query_deduplication setting is enough and code is covered by test_part_moves_between_shards
2022-02-07 19:03:20 +00:00
kssenii
2e58733750
Merge master
2022-02-07 15:23:10 +01:00
avogar
77b42bb9ff
Support UUID in MsgPack format
2022-02-07 17:11:44 +03:00
Yatsishin Ilya
e0803064e6
Merge remote-tracking branch 'origin' into default-table-engine
2022-02-07 08:45:32 +00:00
taiyang-li
26f2a0ef51
move clickhouse-format code from settings to format.cpp
2022-02-07 13:34:13 +08:00
taiyang-li
caed1898b0
add options for clickhouse-format
2022-02-06 11:22:05 +08:00
Alexander Tokmakov
ca5f951558
Merge branch 'master' into mvcc_prototype
2022-02-03 18:56:44 +03:00
Azat Khuzhin
1d19851590
Disable data skipping indexes by default for queries with FINAL
...
This patch adds use_skip_indexes_if_final setting, that is OFF by
default. Since skipping data for queries with FINAL may produce
incorrect result.
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-02-02 13:31:50 +03:00
Yatsishin Ilya
2a698b8da3
Merge remote-tracking branch 'origin/master' into default-table-engine
2022-02-01 13:23:52 +00:00
Alexander Tokmakov
5fad3fdffc
throw exception on non-transactional queries
2022-02-01 01:27:55 +03:00
Yatsishin Ilya
676fc5b20f
Initial commit
2022-01-31 17:10:59 +00:00
Anton Popov
78b9f15abb
Merge remote-tracking branch 'upstream/master' into HEAD
2022-01-30 03:24:37 +03:00
alexey-milovidov
f6684dbc62
Merge pull request #32304 from devcrafter/deduplication_token_7461
...
insert_deduplication_token setting for INSERT statement
2022-01-28 13:03:55 +03:00
kssenii
c91b86e220
Better
2022-01-26 21:56:08 +03:00
Anton Popov
e8ce091e68
Merge remote-tracking branch 'upstream/master' into HEAD
2022-01-21 20:11:18 +03:00
Dmitry Novik
c0970b75ee
Merge branch 'master' into memory-overcommit
2022-01-18 15:30:24 +03:00
Kruglov Pavel
5a908e8edd
Merge branch 'master' into formats-with-suffixes
2022-01-14 16:45:20 +03:00
Igor Nikonov
102b9cdcfb
Merge remote-tracking branch 'origin/master' into deduplication_token_7461
2022-01-09 19:15:33 +01:00
taiyang-li
1e102bc1b2
merge master
2022-01-01 09:01:06 +08:00
avogar
da7209df29
Add description to settings
2021-12-29 21:25:06 +03:00
avogar
97788b9c21
Allow to create new files on insert for File/S3/HDFS engines
2021-12-29 21:19:13 +03:00
Kruglov Pavel
489a30859f
Merge pull request #32455 from Avogar/schema-inference
...
Automatic schema inference for input formats
2021-12-29 21:03:48 +03:00
mergify[bot]
5070784282
Merge branch 'master' into memory-overcommit
2021-12-29 10:35:32 +00:00
avogar
8112a71233
Implement schema inference for most input formats
2021-12-29 12:18:56 +03:00
Denny Crane
12763976b1
Update Settings.h
...
obsolete max_alter_threads
2021-12-28 16:35:46 -04:00
mergify[bot]
1e0642065b
Merge branch 'master' into deduplication_token_7461
2021-12-22 15:27:28 +00:00
taiyang-li
2597925724
merge master
2021-12-21 15:55:39 +08:00
Antonio Andelic
25f88356e4
Add hints for SET query and HTTP request param settings
2021-12-20 16:57:09 +01:00
taiyang-li
7192458601
fix code typo
2021-12-20 18:10:15 +08:00
kreuzerkrieg
f06c37d206
Stop reading incomplete stripes and skip rows.
2021-12-19 18:41:32 +02:00
Igor Nikonov
100ee92c64
insert_deduplication_token setting for INSERT statement
...
The setting allows a user to provide own deduplication semantic in Replicated*MergeTree
If provided, it's used instead of data digest to generate block ID
So, for example, by providing a unique value for the setting in each INSERT statement,
user can avoid the same inserted data being deduplicated
Inserting data within the same INSERT statement are split into blocks
according to the *insert_block_size* settings
(max_insert_block_size, min_insert_block_size_rows, min_insert_block_size_bytes).
Each block with the same INSERT statement will get an ordinal number.
The ordinal number is added to insert_deduplication_token to get block dedup token
i.e. <token>_0, <token>_1, ... Deduplication is done per block
So, to guarantee deduplication for two same INSERT queries,
dedup token and number of blocks to have to be the same
Issue: #7461
2021-12-19 13:15:45 +00:00
Anton Popov
99ebabd822
Merge remote-tracking branch 'upstream/master' into HEAD
2021-12-17 19:02:29 +03:00
Kseniia Sumarokova
77b3ebe44e
Merge pull request #32734 from kssenii/mysql-fix-timeouts
...
Allow to control connection timeouts for mysql
2021-12-17 10:13:33 +03:00
taiyang-li
d033fc4c24
merge master and fix conflict
2021-12-17 15:11:21 +08:00
kssenii
2e813fe3cd
Update defaults
2021-12-15 08:18:43 +00:00
Azat Khuzhin
33ffd343f3
Add ability to drain connections synchronously
...
This is mostly for testing, to avoid hiding errors.
2021-12-14 10:18:57 +03:00
kssenii
f0d0714e47
Pass timeouts for mysql
2021-12-13 22:12:33 +00:00
mergify[bot]
b81d600c1e
Merge branch 'master' into memory-overcommit
2021-12-12 23:01:56 +00:00
李扬
8675086104
Merge branch 'master' into hive_table
2021-12-12 09:01:46 -06:00
Nikita Mikhaylov
dbf5091016
Parallel reading from replicas ( #29279 )
2021-12-09 13:39:28 +03:00
mergify[bot]
600dcb749a
Merge branch 'master' into memory-overcommit
2021-12-07 00:40:20 +00:00
leosunli
8d04495840
set hdfs_replication default value 0
...
Signed-off-by: leosunli <lisheng.sun08@gmail.com>
2021-12-06 14:32:32 +08:00
leosunli
5be58a8839
Make HDFS replication configurable in WriteBufferFromHDFSImpl#WriteBufferFromHDFSImpl
...
Signed-off-by: leosunli <lisheng.sun08@gmail.com>
2021-12-06 14:32:31 +08:00
Kruglov Pavel
049b2c0c14
Merge pull request #31072 from MaxWk/feature-support-bool-type
...
Feature support bool type
2021-12-02 14:50:29 +03:00
taiyang-li
2f4e7e1d4e
merge master
2021-12-02 19:48:21 +08:00
taiyang-li
9ec8272186
refactor hive text input format
2021-12-02 16:14:25 +08:00
Kseniia Sumarokova
87574e8bf6
Merge pull request #31053 from kssenii/rabbit-kafka-select-commit
...
rabbitmq/kafka allow to commit on select only under setting
2021-12-01 18:23:08 +03:00
Anton Popov
6f4d9a53b2
Merge remote-tracking branch 'origin/sparse-serialization' into HEAD
2021-12-01 15:54:33 +03:00
Kseniia Sumarokova
e879cf75e3
Update Settings.h
2021-11-30 22:06:36 +03:00
kssenii
2ea4e7c4e7
Better
2021-11-29 15:05:02 +00:00
mergify[bot]
8d5460b469
Merge branch 'master' into feature-support-bool-type
2021-11-29 11:50:18 +00:00
taiyang-li
c7a0fe467f
fix code stylke
2021-11-29 16:22:43 +08:00
kssenii
223048d395
Merge branch 'master' of github.com:ClickHouse/ClickHouse into vxider-window-view
2021-11-26 01:06:06 +03:00
Kseniia Sumarokova
93cf66df12
Merge pull request #30936 from kssenii/seekable-read-buffers
...
Reduce memory usage for some formats when reading with s3/url/hdfs
2021-11-25 11:19:24 +03:00
Anton Popov
ccd78e3838
Merge remote-tracking branch 'upstream/master' into HEAD
2021-11-22 17:19:35 +03:00
Anton Popov
43cfa4467b
Merge pull request #31476 from CurtizJ/merging-constraints
...
Merging #18787 (Constraints)
2021-11-22 15:57:59 +03:00
Kruglov Pavel
814a36ba69
Merge pull request #31434 from Avogar/custom-with-names-and-types
...
Add formats CustomSeparatedWithNames/WithNamesAndTypes
2021-11-22 13:24:00 +03:00
kssenii
6c8867a719
Fix style check
2021-11-20 16:21:43 +03:00
kssenii
ff969b4605
Merge branch 'master' of github.com:ClickHouse/ClickHouse into seekable-read-buffers
2021-11-20 15:03:13 +03:00
kevin wan
fc6b01749f
Update src/Core/Settings.h
...
Co-authored-by: Kruglov Pavel <48961922+Avogar@users.noreply.github.com>
2021-11-19 20:24:39 +08:00
vdimir
2e0d3efba0
disable partial_merge_join_left_table_buffer_bytes due to bug
2021-11-19 12:59:23 +03:00
vdimir
f3d0e6d999
remove partial_merge_join_optimizations
...
this option is redundant because optimization is controlled by partial_merge_join_left_table_buffer_bytes
2021-11-19 12:58:46 +03:00
MaxWk
f17d5b02e4
use bool representation
2021-11-19 14:30:22 +08:00
kssenii
6a39d871b2
Merge branch 'master' of github.com:ClickHouse/ClickHouse into vxider-window-view
2021-11-18 17:29:11 +03:00
avogar
73d1918410
tmp
2021-11-16 17:10:30 +03:00
Alexander Tokmakov
416a82b99a
Merge branch 'master' into check_dependencies_on_drop
2021-11-15 13:35:45 +03:00
Kseniia Sumarokova
59d4eb99c2
Merge pull request #31291 from kssenii/update-async-reads-setting
...
Make remote_filesystem_read_method=threadpool by default
2021-11-13 19:19:35 +03:00
kssenii
f18dcd2287
Merge branch 'master' of github.com:ClickHouse/ClickHouse into seekable-read-buffers
2021-11-13 14:38:57 +03:00
tavplubix
de6a6f3227
Merge pull request #31180 from ClickHouse/merge_selecting_backoff
...
Slightly better backoff for merge selecting task
2021-11-11 20:57:40 +03:00
Kseniia Sumarokova
b3bacac021
Merge pull request #29894 from kssenii/retriable-http
...
Make http read buffer retriable
2021-11-11 19:50:50 +03:00
Alexander Tokmakov
108b5a70e2
mark settings as obsolete
2021-11-11 14:21:42 +03:00
Alexander Tokmakov
627dde7aba
Merge branch 'master' into merge_selecting_backoff
2021-11-11 13:43:10 +03:00
tavplubix
dd720ec9b4
Merge pull request #31252 from ClickHouse/warning_for_obsolete_settings
...
Show warning if some obsolete setting changed
2021-11-11 13:41:49 +03:00
kssenii
0dda1f280b
Update setting remote_filesystem_read_method
2021-11-11 13:19:49 +03:00
Kseniia Sumarokova
e20cb0c10a
Merge branch 'master' into retriable-http
2021-11-11 11:52:06 +03:00
MaxWk
d42a454837
support some bool format
2021-11-11 16:01:32 +08:00
kssenii
62c70ce5cf
Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into retriable-http
2021-11-10 21:16:11 +00:00
kssenii
175f903624
Fix
2021-11-10 21:14:17 +00:00
Anton Popov
833652e8f4
Merge branch 'nikvas0/simple_optimizations' of git://github.com/nikvas0/ClickHouse into merging-constraints
2021-11-10 19:35:28 +03:00
Alexander Tokmakov
9d83832bde
show warning if some obsolete setting changed
2021-11-10 18:49:13 +03:00
kssenii
618c332f9c
Rename read_threadpool to threadpool
2021-11-10 07:46:18 +00:00
Dmitry Novik
9464dc2fd3
Add waiting timeout
2021-11-09 16:02:36 +03:00
Dmitry Novik
0816dedaea
Introduce memory overcommit
2021-11-09 16:02:36 +03:00
Anton Popov
a20922b2d3
Merge remote-tracking branch 'origin/sparse-serialization' into HEAD
2021-11-09 15:36:25 +03:00
Alexander Tokmakov
51bd98294e
better merge selecting backoff
2021-11-09 15:26:51 +03:00
vdimir
2fb21906de
Disable optimize_syntax_fuse_functions by default
2021-11-08 15:25:56 +03:00
kssenii
4bc2a29345
Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into retriable-http
2021-11-04 14:41:24 +00:00
vdimir
08545795b5
Separate option for enabling fuse syntax for sum, avg, count
2021-11-03 15:13:09 +03:00
kssenii
ec11179f91
Merge branch 'master' of github.com:ClickHouse/ClickHouse into seekable-read-buffers
2021-11-03 14:33:31 +03:00
kssenii
45ea820297
Reduce memory usage for some formats
2021-11-03 14:30:03 +03:00
Kruglov Pavel
327a34e9da
Merge pull request #30497 from Avogar/null-deserialization
...
Add custom null representation support for TSV/CSV input formats, fix Nullable(String) deserializing in some formats
2021-11-03 11:30:25 +03:00
Alexander Tokmakov
56aeff734a
Merge branch 'master' into check_dependencies_on_drop
2021-11-02 16:15:30 +03:00
Alexander Tokmakov
598dbe04db
fix tests, support rename
2021-11-02 15:58:45 +03:00
Kseniia Sumarokova
4c675f0151
Merge pull request #30970 from kssenii/add-setting-for-remote-reads
...
Add settings for remote async reads
2021-11-02 15:28:09 +03:00
avogar
42ab57f0e5
Set output_format_avro_rows_in_file default to 1
2021-11-02 14:06:10 +03:00
Kruglov Pavel
901ebcede6
Merge pull request #30351 from arenadata/ADQM-335
...
output_format_avro_rows_in_file
2021-11-02 12:25:27 +03:00
Kruglov Pavel
1f8535c02b
Merge branch 'master' into null-deserialization
2021-11-02 12:15:21 +03:00
kssenii
53c0e1ae61
Add setting for remote reads
2021-11-01 18:14:18 +03:00
kssenii
2940d9fd19
Squashed commit of the following:
...
commit a1acc7ed3485bd158cf42f26b2d2a1bca84b7269
Author: kssenii <sumarokovakseniia@mail.ru>
Date: Sun Oct 31 14:47:25 2021 +0000
Fix
commit 12a27d445bf17e321a7355f1ba857d11b70a285chttps://github.com/ClickHouse/ClickHouse into retriable-http
commit 55f1ba857daeba8104d182f3754b8a2647b88a667024f51b552bb586bed3https://github.com/ClickHouse/ClickHouse into retriable-http
commit 7024f51b557de5fca0751ecb6ad05d855b10261chttps://github.com/ClickHouse/ClickHouse into retriable-http
commit 1ecb6ad05d710ee9687828d2485716158b4c26b7https://github.com/ClickHouse/ClickHouse into retriable-http
commit 28d24857167c20ca07b7ccb02cac569e4fe0f3c8d1138a8a25https://github.com/ClickHouse/ClickHouse into retriable-http
commit 9e4fe0f3c89814cb1b45daed77038bhttps://github.com/ClickHouse/ClickHouse into retriable-http
commit 9814cb1b451c8b1b1133969999ff10https://github.com/ClickHouse/ClickHouse into retriable-http
commit 1c8b1b1133e7dbfff5d23329b668d6198adc7ecdhttps://github.com/ClickHouse/ClickHouse into retriable-http
2021-10-31 17:53:08 +03:00
Kruglov Pavel
7d4f211d5b
Merge branch 'master' into tsv-csv
2021-10-29 16:38:06 +03:00
kssenii
f17e321a73
Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into retriable-http
2021-10-29 08:03:25 +00:00
kssenii
55f1ba857d
Small fixes
2021-10-29 07:38:42 +00:00
kssenii
4f3433b4e1
Some clean up before merging
2021-10-29 01:04:52 +03:00
kssenii
7e2ea97e3c
Merge branch 'master' of github.com:ClickHouse/ClickHouse into disk-async-read
2021-10-28 18:46:21 +03:00
Kseniia Sumarokova
acdcb53f18
Update Settings.h
2021-10-28 09:25:34 +03:00
Kseniia Sumarokova
afc0b2068c
Update Settings.h
2021-10-28 01:04:16 +03:00
kssenii
82f3754b8a
Slightly better
2021-10-27 20:20:15 +00:00
Kruglov Pavel
0715566cc0
Merge branch 'master' into tsv-csv
2021-10-27 17:52:49 +03:00
avogar
d1ef96a5ef
Add test, avoid unnecessary allocations, use PeekableReadBuffer only in corner case
2021-10-27 17:29:15 +03:00
kssenii
52296e8b04
Merge branch 'master' of github.com:ClickHouse/ClickHouse into disk-async-read
2021-10-25 00:22:32 +03:00
kssenii
7de5fca075
Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into retriable-http
2021-10-24 17:04:24 +00:00
kssenii
39b9e9c258
Merge branch 'master' of github.com:ClickHouse/ClickHouse into disk-async-read
2021-10-22 15:40:41 +03:00
avogar
d5c5a3213b
Add custom null representation support for TSV/CSV input formats, fix bugs in deserializing NULLs in some cases
2021-10-21 16:52:27 +03:00
Ilya Golshtein
9f9f4a561c
output_format_avro_rows_in_file - fixes
2021-10-19 23:26:55 +03:00
Anton Popov
82bff416f6
Merge remote-tracking branch 'upstream/master' into HEAD
2021-10-19 16:48:47 +03:00
Anton Popov
c547ffa313
improve performance of aggregation in order primary key with function with heavy states
2021-10-19 16:36:31 +03:00
Kruglov Pavel
5052ec3ab0
Merge branch 'master' into tsv-csv
2021-10-19 12:03:52 +03:00
Ilya Golshtein
d90302aa3b
output_format_avro_rows_in_file
2021-10-18 19:01:06 +03:00
kssenii
ccb02cac56
Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into retriable-http
2021-10-15 12:36:30 +00:00
kssenii
881ae8617e
Merge branch 'master' of github.com:ClickHouse/ClickHouse into disk-async-read
2021-10-15 15:09:56 +03:00
avogar
ce22f534c4
Add CapnProto output format, refactor CapnProto input format
2021-10-14 16:43:22 +03:00
