Maksim Kita
3a2b3ce503
Standardize behaviour of CAST into IPv4, IPv6, toIPv4, toIPv6 functions
2022-03-12 17:12:05 +00:00
Nikolai Kochetov
cdc529fa2a
Add database_replicated_allow_only_replicated_engine setting.
2022-03-11 16:03:05 +00:00
Antonio Andelic
f5d3a8a31d
Polishing
2022-03-11 13:38:19 +00:00
Antonio Andelic
28e9508c4e
Improve shared pool and add settings
2022-03-11 08:33:34 +00:00
shuchaome
46cb4483a6
Optimise by lowering schema on the beginning. Add a functional test.
2022-03-11 14:34:46 +08:00
shuchaome
56795b831d
add setting to lower column case when reading parquet/orc file
2022-03-09 16:07:02 +08:00
zzsmdfj
00794fd4a4
to #31469_MaterializedMysql_mysqlDate2CkDate32-add MySQLDataTypesSupport setting
2022-03-09 15:58:43 +08:00
Azat Khuzhin
3a5a39a9df
Do not delay final part writing by default
...
For async s3 writes final part flushing was defered until all the INSERT
block was processed, however in case of too many partitions/columns you
may exceed max_memory_usage limit (since each stream has overhead).
Introduce max_insert_delayed_streams_for_parallel_writes (with default
to 1000 for S3, 0 otherwise), to avoid this.
This should "Memory limit exceeded" errors in performance tests.
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-03-08 22:17:36 +03:00
kssenii
5260822964
Merge master
2022-03-08 18:21:28 +01:00
Alexander Tokmakov
8acfb8d27f
Merge branch 'master' into mvcc_prototype
2022-03-07 17:40:15 +01:00
Anton Popov
0bc57da238
Merge remote-tracking branch 'upstream/master' into HEAD
2022-03-07 14:46:08 +00:00
Anton Popov
df3b07fe7c
Merge remote-tracking branch 'upstream/master' into HEAD
2022-03-03 22:25:28 +00:00
mergify[bot]
c90d24e10b
Merge branch 'master' into random-settings
2022-03-03 13:07:12 +00:00
Kseniia Sumarokova
b11b34dc8c
Merge pull request #34849 from kssenii/fix-too-many-columns
...
Fix reading too many columns for s3 and url storages
2022-03-03 13:57:22 +01:00
Maksim Kita
f1b1baf56e
Merge pull request #34982 from Cai-Yao/master
...
date_time_input_format = 'best_effort_us'
2022-03-03 09:22:57 +01:00
mergify[bot]
e169813004
Merge branch 'master' into fix-too-many-columns
2022-03-02 18:46:35 +00:00
Kruglov Pavel
3b92b9037f
Merge branch 'master' into random-settings
2022-03-02 21:09:48 +03:00
kssenii
d5952109fb
Merge master
2022-03-02 18:15:25 +01:00
avogar
d25d83580a
Fix tests
2022-03-02 16:33:21 +00:00
cwkyaoyao
72194bbaf3
Add date_time_input_format = best_effort_us
2022-03-02 16:00:06 +08:00
kssenii
a594f388a4
Merge master
2022-03-01 19:43:45 +01:00
alesapin
cba5fe44a9
Merge branch 'master' into unrestricted-zk-reads
2022-03-01 18:09:21 +01:00
kssenii
092ec45b47
Merge master
2022-03-01 12:06:56 +01:00
mergify[bot]
8014cdf9d3
Merge branch 'master' into random-settings
2022-02-28 14:06:22 +00:00
Anton Popov
fcdebea925
Merge remote-tracking branch 'upstream/master' into HEAD
2022-02-25 13:41:30 +03:00
Alexander Tokmakov
aa6b9a2abc
Merge branch 'master' into mvcc_prototype
2022-02-23 23:22:03 +03:00
kssenii
003b807b00
Fix
2022-02-23 20:33:05 +01:00
kssenii
4543513a5d
Add comments
2022-02-21 13:54:03 +01:00
mergify[bot]
314ab73b11
Merge branch 'master' into nv/move-part-settings-cleanup
2022-02-21 10:18:44 +00:00
Sergei Trifonov
b6bb479c48
add setting to enable unrestricted reads from zookeeper
2022-02-16 23:03:44 +03:00
avogar
1e797c1a8f
Fix some tests
2022-02-16 15:10:02 +00:00
kssenii
47f94120da
Merge master
2022-02-16 14:43:28 +01:00
Alexander Tokmakov
1e4e569151
Merge branch 'master' into mvcc_prototype
2022-02-15 02:26:47 +03:00
alexey-milovidov
bc206ec423
Merge pull request #31182 from ClickHouse/memory-overcommit
...
Memory overcommit
2022-02-14 23:55:02 +03:00
mergify[bot]
55ee701d07
Merge branch 'master' into kssenii-patch-3
2022-02-14 08:08:59 +00:00
Nikolai Kochetov
b7972d5ae0
Merge pull request #34456 from ClickHouse/allow_experimental_projection_optimization-by-default
...
Allow allow_experimental_projection_optimization by default
2022-02-11 17:52:15 +01:00
Alexander Tokmakov
07e66e690d
Merge branch 'master' into mvcc_prototype
2022-02-11 15:53:32 +03:00
mergify[bot]
cb3e5f8538
Merge branch 'master' into memory-overcommit
2022-02-10 11:01:43 +00:00
Anton Popov
18940b8637
Merge remote-tracking branch 'upstream/master' into HEAD
2022-02-09 23:38:38 +03:00
mergify[bot]
d55eadc3c9
Merge branch 'master' into default-table-engine
2022-02-09 17:08:31 +00:00
Nikolai Kochetov
8ea5aab7aa
Update Settings.h
2022-02-09 17:02:44 +03:00
Kseniia Sumarokova
43dc769022
Update Settings.h
2022-02-09 14:19:07 +01:00
Nikolai Kochetov
881b5ebbbb
Update Settings.h
2022-02-09 15:53:24 +03:00
alesapin
437940b29d
Merge pull request #34422 from ClickHouse/add_settings_to_part_size_in_s3
...
Add settings for multipart upload part size in s3
2022-02-09 12:51:20 +03:00
alesapin
f6e7cea1f8
Add settings for S3 multipart upload parts size
2022-02-08 19:38:04 +03:00
Kruglov Pavel
720310fcf1
Merge branch 'master' into http-buffer-skip-not-found-url-for-globs
2022-02-08 16:56:22 +03:00
Yatsishin Ilya
bcf4303286
Merge remote-tracking branch 'origin' into default-table-engine
2022-02-08 10:35:29 +00:00
Kruglov Pavel
b4fec2af7c
Merge pull request #34065 from Avogar/msgpack
...
Support UUID in MsgPack format
2022-02-08 11:42:17 +03:00
kssenii
eba3011ada
Fix
2022-02-07 20:40:47 +01:00
Nicolae Vartolomei
7d77678a9f
Remove useless setting experimental_query_deduplication_send_all_part_uuids
...
This setting made sense for testing deduplication before part movement was actually implemented.
allow_experimental_query_deduplication setting is enough and code is covered by test_part_moves_between_shards
2022-02-07 19:03:20 +00:00
kssenii
2e58733750
Merge master
2022-02-07 15:23:10 +01:00
avogar
77b42bb9ff
Support UUID in MsgPack format
2022-02-07 17:11:44 +03:00
Yatsishin Ilya
e0803064e6
Merge remote-tracking branch 'origin' into default-table-engine
2022-02-07 08:45:32 +00:00
taiyang-li
26f2a0ef51
move clickhouse-format code from settings to format.cpp
2022-02-07 13:34:13 +08:00
taiyang-li
caed1898b0
add options for clickhouse-format
2022-02-06 11:22:05 +08:00
Alexander Tokmakov
ca5f951558
Merge branch 'master' into mvcc_prototype
2022-02-03 18:56:44 +03:00
Azat Khuzhin
1d19851590
Disable data skipping indexes by default for queries with FINAL
...
This patch adds use_skip_indexes_if_final setting, that is OFF by
default. Since skipping data for queries with FINAL may produce
incorrect result.
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-02-02 13:31:50 +03:00
Yatsishin Ilya
2a698b8da3
Merge remote-tracking branch 'origin/master' into default-table-engine
2022-02-01 13:23:52 +00:00
Alexander Tokmakov
5fad3fdffc
throw exception on non-transactional queries
2022-02-01 01:27:55 +03:00
Yatsishin Ilya
676fc5b20f
Initial commit
2022-01-31 17:10:59 +00:00
Anton Popov
78b9f15abb
Merge remote-tracking branch 'upstream/master' into HEAD
2022-01-30 03:24:37 +03:00
alexey-milovidov
f6684dbc62
Merge pull request #32304 from devcrafter/deduplication_token_7461
...
insert_deduplication_token setting for INSERT statement
2022-01-28 13:03:55 +03:00
kssenii
c91b86e220
Better
2022-01-26 21:56:08 +03:00
Anton Popov
e8ce091e68
Merge remote-tracking branch 'upstream/master' into HEAD
2022-01-21 20:11:18 +03:00
Dmitry Novik
c0970b75ee
Merge branch 'master' into memory-overcommit
2022-01-18 15:30:24 +03:00
Kruglov Pavel
5a908e8edd
Merge branch 'master' into formats-with-suffixes
2022-01-14 16:45:20 +03:00
Igor Nikonov
102b9cdcfb
Merge remote-tracking branch 'origin/master' into deduplication_token_7461
2022-01-09 19:15:33 +01:00
taiyang-li
1e102bc1b2
merge master
2022-01-01 09:01:06 +08:00
avogar
da7209df29
Add description to settings
2021-12-29 21:25:06 +03:00
avogar
97788b9c21
Allow to create new files on insert for File/S3/HDFS engines
2021-12-29 21:19:13 +03:00
Kruglov Pavel
489a30859f
Merge pull request #32455 from Avogar/schema-inference
...
Automatic schema inference for input formats
2021-12-29 21:03:48 +03:00
mergify[bot]
5070784282
Merge branch 'master' into memory-overcommit
2021-12-29 10:35:32 +00:00
avogar
8112a71233
Implement schema inference for most input formats
2021-12-29 12:18:56 +03:00
Denny Crane
12763976b1
Update Settings.h
...
obsolete max_alter_threads
2021-12-28 16:35:46 -04:00
mergify[bot]
1e0642065b
Merge branch 'master' into deduplication_token_7461
2021-12-22 15:27:28 +00:00
taiyang-li
2597925724
merge master
2021-12-21 15:55:39 +08:00
Antonio Andelic
25f88356e4
Add hints for SET query and HTTP request param settings
2021-12-20 16:57:09 +01:00
taiyang-li
7192458601
fix code typo
2021-12-20 18:10:15 +08:00
kreuzerkrieg
f06c37d206
Stop reading incomplete stripes and skip rows.
2021-12-19 18:41:32 +02:00
Igor Nikonov
100ee92c64
insert_deduplication_token setting for INSERT statement
...
The setting allows a user to provide own deduplication semantic in Replicated*MergeTree
If provided, it's used instead of data digest to generate block ID
So, for example, by providing a unique value for the setting in each INSERT statement,
user can avoid the same inserted data being deduplicated
Inserting data within the same INSERT statement are split into blocks
according to the *insert_block_size* settings
(max_insert_block_size, min_insert_block_size_rows, min_insert_block_size_bytes).
Each block with the same INSERT statement will get an ordinal number.
The ordinal number is added to insert_deduplication_token to get block dedup token
i.e. <token>_0, <token>_1, ... Deduplication is done per block
So, to guarantee deduplication for two same INSERT queries,
dedup token and number of blocks to have to be the same
Issue: #7461
2021-12-19 13:15:45 +00:00
Anton Popov
99ebabd822
Merge remote-tracking branch 'upstream/master' into HEAD
2021-12-17 19:02:29 +03:00
Kseniia Sumarokova
77b3ebe44e
Merge pull request #32734 from kssenii/mysql-fix-timeouts
...
Allow to control connection timeouts for mysql
2021-12-17 10:13:33 +03:00
taiyang-li
d033fc4c24
merge master and fix conflict
2021-12-17 15:11:21 +08:00
kssenii
2e813fe3cd
Update defaults
2021-12-15 08:18:43 +00:00
Azat Khuzhin
33ffd343f3
Add ability to drain connections synchronously
...
This is mostly for testing, to avoid hiding errors.
2021-12-14 10:18:57 +03:00
kssenii
f0d0714e47
Pass timeouts for mysql
2021-12-13 22:12:33 +00:00
mergify[bot]
b81d600c1e
Merge branch 'master' into memory-overcommit
2021-12-12 23:01:56 +00:00
李扬
8675086104
Merge branch 'master' into hive_table
2021-12-12 09:01:46 -06:00
Nikita Mikhaylov
dbf5091016
Parallel reading from replicas ( #29279 )
2021-12-09 13:39:28 +03:00
mergify[bot]
600dcb749a
Merge branch 'master' into memory-overcommit
2021-12-07 00:40:20 +00:00
leosunli
8d04495840
set hdfs_replication default value 0
...
Signed-off-by: leosunli <lisheng.sun08@gmail.com>
2021-12-06 14:32:32 +08:00
leosunli
5be58a8839
Make HDFS replication configurable in WriteBufferFromHDFSImpl#WriteBufferFromHDFSImpl
...
Signed-off-by: leosunli <lisheng.sun08@gmail.com>
2021-12-06 14:32:31 +08:00
Kruglov Pavel
049b2c0c14
Merge pull request #31072 from MaxWk/feature-support-bool-type
...
Feature support bool type
2021-12-02 14:50:29 +03:00
taiyang-li
2f4e7e1d4e
merge master
2021-12-02 19:48:21 +08:00
taiyang-li
9ec8272186
refactor hive text input format
2021-12-02 16:14:25 +08:00
Kseniia Sumarokova
87574e8bf6
Merge pull request #31053 from kssenii/rabbit-kafka-select-commit
...
rabbitmq/kafka allow to commit on select only under setting
2021-12-01 18:23:08 +03:00
Anton Popov
6f4d9a53b2
Merge remote-tracking branch 'origin/sparse-serialization' into HEAD
2021-12-01 15:54:33 +03:00
Kseniia Sumarokova
e879cf75e3
Update Settings.h
2021-11-30 22:06:36 +03:00
kssenii
2ea4e7c4e7
Better
2021-11-29 15:05:02 +00:00
mergify[bot]
8d5460b469
Merge branch 'master' into feature-support-bool-type
2021-11-29 11:50:18 +00:00
