mergify[bot]
314ab73b11
Merge branch 'master' into nv/move-part-settings-cleanup
2022-02-21 10:18:44 +00:00
Sergei Trifonov
b6bb479c48
add setting to enable unrestricted reads from zookeeper
2022-02-16 23:03:44 +03:00
avogar
1e797c1a8f
Fix some tests
2022-02-16 15:10:02 +00:00
kssenii
47f94120da
Merge master
2022-02-16 14:43:28 +01:00
Alexander Tokmakov
1e4e569151
Merge branch 'master' into mvcc_prototype
2022-02-15 02:26:47 +03:00
alexey-milovidov
bc206ec423
Merge pull request #31182 from ClickHouse/memory-overcommit
...
Memory overcommit
2022-02-14 23:55:02 +03:00
mergify[bot]
55ee701d07
Merge branch 'master' into kssenii-patch-3
2022-02-14 08:08:59 +00:00
Nikolai Kochetov
b7972d5ae0
Merge pull request #34456 from ClickHouse/allow_experimental_projection_optimization-by-default
...
Allow allow_experimental_projection_optimization by default
2022-02-11 17:52:15 +01:00
Alexander Tokmakov
07e66e690d
Merge branch 'master' into mvcc_prototype
2022-02-11 15:53:32 +03:00
mergify[bot]
cb3e5f8538
Merge branch 'master' into memory-overcommit
2022-02-10 11:01:43 +00:00
Anton Popov
18940b8637
Merge remote-tracking branch 'upstream/master' into HEAD
2022-02-09 23:38:38 +03:00
mergify[bot]
d55eadc3c9
Merge branch 'master' into default-table-engine
2022-02-09 17:08:31 +00:00
Nikolai Kochetov
8ea5aab7aa
Update Settings.h
2022-02-09 17:02:44 +03:00
Kseniia Sumarokova
43dc769022
Update Settings.h
2022-02-09 14:19:07 +01:00
Nikolai Kochetov
881b5ebbbb
Update Settings.h
2022-02-09 15:53:24 +03:00
alesapin
437940b29d
Merge pull request #34422 from ClickHouse/add_settings_to_part_size_in_s3
...
Add settings for multipart upload part size in s3
2022-02-09 12:51:20 +03:00
alesapin
f6e7cea1f8
Add settings for S3 multipart upload parts size
2022-02-08 19:38:04 +03:00
Kruglov Pavel
720310fcf1
Merge branch 'master' into http-buffer-skip-not-found-url-for-globs
2022-02-08 16:56:22 +03:00
Yatsishin Ilya
bcf4303286
Merge remote-tracking branch 'origin' into default-table-engine
2022-02-08 10:35:29 +00:00
Kruglov Pavel
b4fec2af7c
Merge pull request #34065 from Avogar/msgpack
...
Support UUID in MsgPack format
2022-02-08 11:42:17 +03:00
kssenii
eba3011ada
Fix
2022-02-07 20:40:47 +01:00
Nicolae Vartolomei
7d77678a9f
Remove useless setting experimental_query_deduplication_send_all_part_uuids
...
This setting made sense for testing deduplication before part movement was actually implemented.
allow_experimental_query_deduplication setting is enough and code is covered by test_part_moves_between_shards
2022-02-07 19:03:20 +00:00
kssenii
2e58733750
Merge master
2022-02-07 15:23:10 +01:00
avogar
77b42bb9ff
Support UUID in MsgPack format
2022-02-07 17:11:44 +03:00
Yatsishin Ilya
e0803064e6
Merge remote-tracking branch 'origin' into default-table-engine
2022-02-07 08:45:32 +00:00
taiyang-li
26f2a0ef51
move clickhouse-format code from settings to format.cpp
2022-02-07 13:34:13 +08:00
taiyang-li
caed1898b0
add options for clickhouse-format
2022-02-06 11:22:05 +08:00
Alexander Tokmakov
ca5f951558
Merge branch 'master' into mvcc_prototype
2022-02-03 18:56:44 +03:00
Azat Khuzhin
1d19851590
Disable data skipping indexes by default for queries with FINAL
...
This patch adds use_skip_indexes_if_final setting, that is OFF by
default. Since skipping data for queries with FINAL may produce
incorrect result.
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-02-02 13:31:50 +03:00
Yatsishin Ilya
2a698b8da3
Merge remote-tracking branch 'origin/master' into default-table-engine
2022-02-01 13:23:52 +00:00
Alexander Tokmakov
5fad3fdffc
throw exception on non-transactional queries
2022-02-01 01:27:55 +03:00
Yatsishin Ilya
676fc5b20f
Initial commit
2022-01-31 17:10:59 +00:00
Anton Popov
78b9f15abb
Merge remote-tracking branch 'upstream/master' into HEAD
2022-01-30 03:24:37 +03:00
alexey-milovidov
f6684dbc62
Merge pull request #32304 from devcrafter/deduplication_token_7461
...
insert_deduplication_token setting for INSERT statement
2022-01-28 13:03:55 +03:00
kssenii
c91b86e220
Better
2022-01-26 21:56:08 +03:00
Anton Popov
e8ce091e68
Merge remote-tracking branch 'upstream/master' into HEAD
2022-01-21 20:11:18 +03:00
Dmitry Novik
c0970b75ee
Merge branch 'master' into memory-overcommit
2022-01-18 15:30:24 +03:00
Alexey Milovidov
d10c32ec67
Enable some settings
2022-01-14 22:02:58 +03:00
Kruglov Pavel
5a908e8edd
Merge branch 'master' into formats-with-suffixes
2022-01-14 16:45:20 +03:00
Igor Nikonov
102b9cdcfb
Merge remote-tracking branch 'origin/master' into deduplication_token_7461
2022-01-09 19:15:33 +01:00
taiyang-li
1e102bc1b2
merge master
2022-01-01 09:01:06 +08:00
avogar
da7209df29
Add description to settings
2021-12-29 21:25:06 +03:00
avogar
97788b9c21
Allow to create new files on insert for File/S3/HDFS engines
2021-12-29 21:19:13 +03:00
Kruglov Pavel
489a30859f
Merge pull request #32455 from Avogar/schema-inference
...
Automatic schema inference for input formats
2021-12-29 21:03:48 +03:00
mergify[bot]
5070784282
Merge branch 'master' into memory-overcommit
2021-12-29 10:35:32 +00:00
avogar
8112a71233
Implement schema inference for most input formats
2021-12-29 12:18:56 +03:00
Denny Crane
12763976b1
Update Settings.h
...
obsolete max_alter_threads
2021-12-28 16:35:46 -04:00
mergify[bot]
1e0642065b
Merge branch 'master' into deduplication_token_7461
2021-12-22 15:27:28 +00:00
taiyang-li
2597925724
merge master
2021-12-21 15:55:39 +08:00
Antonio Andelic
25f88356e4
Add hints for SET query and HTTP request param settings
2021-12-20 16:57:09 +01:00
taiyang-li
7192458601
fix code typo
2021-12-20 18:10:15 +08:00
kreuzerkrieg
f06c37d206
Stop reading incomplete stripes and skip rows.
2021-12-19 18:41:32 +02:00
Igor Nikonov
100ee92c64
insert_deduplication_token setting for INSERT statement
...
The setting allows a user to provide own deduplication semantic in Replicated*MergeTree
If provided, it's used instead of data digest to generate block ID
So, for example, by providing a unique value for the setting in each INSERT statement,
user can avoid the same inserted data being deduplicated
Inserting data within the same INSERT statement are split into blocks
according to the *insert_block_size* settings
(max_insert_block_size, min_insert_block_size_rows, min_insert_block_size_bytes).
Each block with the same INSERT statement will get an ordinal number.
The ordinal number is added to insert_deduplication_token to get block dedup token
i.e. <token>_0, <token>_1, ... Deduplication is done per block
So, to guarantee deduplication for two same INSERT queries,
dedup token and number of blocks to have to be the same
Issue: #7461
2021-12-19 13:15:45 +00:00
Anton Popov
99ebabd822
Merge remote-tracking branch 'upstream/master' into HEAD
2021-12-17 19:02:29 +03:00
Kseniia Sumarokova
77b3ebe44e
Merge pull request #32734 from kssenii/mysql-fix-timeouts
...
Allow to control connection timeouts for mysql
2021-12-17 10:13:33 +03:00
taiyang-li
d033fc4c24
merge master and fix conflict
2021-12-17 15:11:21 +08:00
kssenii
2e813fe3cd
Update defaults
2021-12-15 08:18:43 +00:00
Azat Khuzhin
33ffd343f3
Add ability to drain connections synchronously
...
This is mostly for testing, to avoid hiding errors.
2021-12-14 10:18:57 +03:00
kssenii
f0d0714e47
Pass timeouts for mysql
2021-12-13 22:12:33 +00:00
mergify[bot]
b81d600c1e
Merge branch 'master' into memory-overcommit
2021-12-12 23:01:56 +00:00
李扬
8675086104
Merge branch 'master' into hive_table
2021-12-12 09:01:46 -06:00
Nikita Mikhaylov
dbf5091016
Parallel reading from replicas ( #29279 )
2021-12-09 13:39:28 +03:00
mergify[bot]
600dcb749a
Merge branch 'master' into memory-overcommit
2021-12-07 00:40:20 +00:00
leosunli
8d04495840
set hdfs_replication default value 0
...
Signed-off-by: leosunli <lisheng.sun08@gmail.com>
2021-12-06 14:32:32 +08:00
leosunli
5be58a8839
Make HDFS replication configurable in WriteBufferFromHDFSImpl#WriteBufferFromHDFSImpl
...
Signed-off-by: leosunli <lisheng.sun08@gmail.com>
2021-12-06 14:32:31 +08:00
Kruglov Pavel
049b2c0c14
Merge pull request #31072 from MaxWk/feature-support-bool-type
...
Feature support bool type
2021-12-02 14:50:29 +03:00
taiyang-li
2f4e7e1d4e
merge master
2021-12-02 19:48:21 +08:00
taiyang-li
9ec8272186
refactor hive text input format
2021-12-02 16:14:25 +08:00
Kseniia Sumarokova
87574e8bf6
Merge pull request #31053 from kssenii/rabbit-kafka-select-commit
...
rabbitmq/kafka allow to commit on select only under setting
2021-12-01 18:23:08 +03:00
Anton Popov
6f4d9a53b2
Merge remote-tracking branch 'origin/sparse-serialization' into HEAD
2021-12-01 15:54:33 +03:00
Kseniia Sumarokova
e879cf75e3
Update Settings.h
2021-11-30 22:06:36 +03:00
kssenii
2ea4e7c4e7
Better
2021-11-29 15:05:02 +00:00
mergify[bot]
8d5460b469
Merge branch 'master' into feature-support-bool-type
2021-11-29 11:50:18 +00:00
taiyang-li
c7a0fe467f
fix code stylke
2021-11-29 16:22:43 +08:00
kssenii
223048d395
Merge branch 'master' of github.com:ClickHouse/ClickHouse into vxider-window-view
2021-11-26 01:06:06 +03:00
Kseniia Sumarokova
93cf66df12
Merge pull request #30936 from kssenii/seekable-read-buffers
...
Reduce memory usage for some formats when reading with s3/url/hdfs
2021-11-25 11:19:24 +03:00
Anton Popov
ccd78e3838
Merge remote-tracking branch 'upstream/master' into HEAD
2021-11-22 17:19:35 +03:00
Anton Popov
43cfa4467b
Merge pull request #31476 from CurtizJ/merging-constraints
...
Merging #18787 (Constraints)
2021-11-22 15:57:59 +03:00
Kruglov Pavel
814a36ba69
Merge pull request #31434 from Avogar/custom-with-names-and-types
...
Add formats CustomSeparatedWithNames/WithNamesAndTypes
2021-11-22 13:24:00 +03:00
kssenii
6c8867a719
Fix style check
2021-11-20 16:21:43 +03:00
kssenii
ff969b4605
Merge branch 'master' of github.com:ClickHouse/ClickHouse into seekable-read-buffers
2021-11-20 15:03:13 +03:00
kevin wan
fc6b01749f
Update src/Core/Settings.h
...
Co-authored-by: Kruglov Pavel <48961922+Avogar@users.noreply.github.com>
2021-11-19 20:24:39 +08:00
vdimir
2e0d3efba0
disable partial_merge_join_left_table_buffer_bytes due to bug
2021-11-19 12:59:23 +03:00
vdimir
f3d0e6d999
remove partial_merge_join_optimizations
...
this option is redundant because optimization is controlled by partial_merge_join_left_table_buffer_bytes
2021-11-19 12:58:46 +03:00
MaxWk
f17d5b02e4
use bool representation
2021-11-19 14:30:22 +08:00
kssenii
6a39d871b2
Merge branch 'master' of github.com:ClickHouse/ClickHouse into vxider-window-view
2021-11-18 17:29:11 +03:00
avogar
73d1918410
tmp
2021-11-16 17:10:30 +03:00
Alexander Tokmakov
416a82b99a
Merge branch 'master' into check_dependencies_on_drop
2021-11-15 13:35:45 +03:00
Kseniia Sumarokova
59d4eb99c2
Merge pull request #31291 from kssenii/update-async-reads-setting
...
Make remote_filesystem_read_method=threadpool by default
2021-11-13 19:19:35 +03:00
kssenii
f18dcd2287
Merge branch 'master' of github.com:ClickHouse/ClickHouse into seekable-read-buffers
2021-11-13 14:38:57 +03:00
tavplubix
de6a6f3227
Merge pull request #31180 from ClickHouse/merge_selecting_backoff
...
Slightly better backoff for merge selecting task
2021-11-11 20:57:40 +03:00
Kseniia Sumarokova
b3bacac021
Merge pull request #29894 from kssenii/retriable-http
...
Make http read buffer retriable
2021-11-11 19:50:50 +03:00
Alexander Tokmakov
108b5a70e2
mark settings as obsolete
2021-11-11 14:21:42 +03:00
Alexander Tokmakov
627dde7aba
Merge branch 'master' into merge_selecting_backoff
2021-11-11 13:43:10 +03:00
tavplubix
dd720ec9b4
Merge pull request #31252 from ClickHouse/warning_for_obsolete_settings
...
Show warning if some obsolete setting changed
2021-11-11 13:41:49 +03:00
kssenii
0dda1f280b
Update setting remote_filesystem_read_method
2021-11-11 13:19:49 +03:00
Kseniia Sumarokova
e20cb0c10a
Merge branch 'master' into retriable-http
2021-11-11 11:52:06 +03:00
MaxWk
d42a454837
support some bool format
2021-11-11 16:01:32 +08:00
kssenii
62c70ce5cf
Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into retriable-http
2021-11-10 21:16:11 +00:00
kssenii
175f903624
Fix
2021-11-10 21:14:17 +00:00
Anton Popov
833652e8f4
Merge branch 'nikvas0/simple_optimizations' of git://github.com/nikvas0/ClickHouse into merging-constraints
2021-11-10 19:35:28 +03:00
Alexander Tokmakov
9d83832bde
show warning if some obsolete setting changed
2021-11-10 18:49:13 +03:00
kssenii
618c332f9c
Rename read_threadpool to threadpool
2021-11-10 07:46:18 +00:00
Dmitry Novik
9464dc2fd3
Add waiting timeout
2021-11-09 16:02:36 +03:00
Dmitry Novik
0816dedaea
Introduce memory overcommit
2021-11-09 16:02:36 +03:00
Anton Popov
a20922b2d3
Merge remote-tracking branch 'origin/sparse-serialization' into HEAD
2021-11-09 15:36:25 +03:00
Alexander Tokmakov
51bd98294e
better merge selecting backoff
2021-11-09 15:26:51 +03:00
vdimir
2fb21906de
Disable optimize_syntax_fuse_functions by default
2021-11-08 15:25:56 +03:00
kssenii
4bc2a29345
Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into retriable-http
2021-11-04 14:41:24 +00:00
vdimir
08545795b5
Separate option for enabling fuse syntax for sum, avg, count
2021-11-03 15:13:09 +03:00
kssenii
ec11179f91
Merge branch 'master' of github.com:ClickHouse/ClickHouse into seekable-read-buffers
2021-11-03 14:33:31 +03:00
kssenii
45ea820297
Reduce memory usage for some formats
2021-11-03 14:30:03 +03:00
Kruglov Pavel
327a34e9da
Merge pull request #30497 from Avogar/null-deserialization
...
Add custom null representation support for TSV/CSV input formats, fix Nullable(String) deserializing in some formats
2021-11-03 11:30:25 +03:00
Alexander Tokmakov
56aeff734a
Merge branch 'master' into check_dependencies_on_drop
2021-11-02 16:15:30 +03:00
Alexander Tokmakov
598dbe04db
fix tests, support rename
2021-11-02 15:58:45 +03:00
Kseniia Sumarokova
4c675f0151
Merge pull request #30970 from kssenii/add-setting-for-remote-reads
...
Add settings for remote async reads
2021-11-02 15:28:09 +03:00
avogar
42ab57f0e5
Set output_format_avro_rows_in_file default to 1
2021-11-02 14:06:10 +03:00
Kruglov Pavel
901ebcede6
Merge pull request #30351 from arenadata/ADQM-335
...
output_format_avro_rows_in_file
2021-11-02 12:25:27 +03:00
Kruglov Pavel
1f8535c02b
Merge branch 'master' into null-deserialization
2021-11-02 12:15:21 +03:00
kssenii
53c0e1ae61
Add setting for remote reads
2021-11-01 18:14:18 +03:00
kssenii
2940d9fd19
Squashed commit of the following:
...
commit a1acc7ed3485bd158cf42f26b2d2a1bca84b7269
Author: kssenii <sumarokovakseniia@mail.ru>
Date: Sun Oct 31 14:47:25 2021 +0000
Fix
commit 12a27d445bf17e321a7355f1ba857d11b70a285chttps://github.com/ClickHouse/ClickHouse into retriable-http
commit 55f1ba857daeba8104d182f3754b8a2647b88a667024f51b552bb586bed3https://github.com/ClickHouse/ClickHouse into retriable-http
commit 7024f51b557de5fca0751ecb6ad05d855b10261chttps://github.com/ClickHouse/ClickHouse into retriable-http
commit 1ecb6ad05d710ee9687828d2485716158b4c26b7https://github.com/ClickHouse/ClickHouse into retriable-http
commit 28d24857167c20ca07b7ccb02cac569e4fe0f3c8d1138a8a25https://github.com/ClickHouse/ClickHouse into retriable-http
commit 9e4fe0f3c89814cb1b45daed77038bhttps://github.com/ClickHouse/ClickHouse into retriable-http
commit 9814cb1b451c8b1b1133969999ff10https://github.com/ClickHouse/ClickHouse into retriable-http
commit 1c8b1b1133e7dbfff5d23329b668d6198adc7ecdhttps://github.com/ClickHouse/ClickHouse into retriable-http
2021-10-31 17:53:08 +03:00
Kruglov Pavel
7d4f211d5b
Merge branch 'master' into tsv-csv
2021-10-29 16:38:06 +03:00
kssenii
f17e321a73
Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into retriable-http
2021-10-29 08:03:25 +00:00
kssenii
55f1ba857d
Small fixes
2021-10-29 07:38:42 +00:00
kssenii
4f3433b4e1
Some clean up before merging
2021-10-29 01:04:52 +03:00
kssenii
7e2ea97e3c
Merge branch 'master' of github.com:ClickHouse/ClickHouse into disk-async-read
2021-10-28 18:46:21 +03:00
Kseniia Sumarokova
acdcb53f18
Update Settings.h
2021-10-28 09:25:34 +03:00
Kseniia Sumarokova
afc0b2068c
Update Settings.h
2021-10-28 01:04:16 +03:00
kssenii
82f3754b8a
Slightly better
2021-10-27 20:20:15 +00:00
Kruglov Pavel
0715566cc0
Merge branch 'master' into tsv-csv
2021-10-27 17:52:49 +03:00
avogar
d1ef96a5ef
Add test, avoid unnecessary allocations, use PeekableReadBuffer only in corner case
2021-10-27 17:29:15 +03:00
kssenii
52296e8b04
Merge branch 'master' of github.com:ClickHouse/ClickHouse into disk-async-read
2021-10-25 00:22:32 +03:00
kssenii
7de5fca075
Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into retriable-http
2021-10-24 17:04:24 +00:00
kssenii
39b9e9c258
Merge branch 'master' of github.com:ClickHouse/ClickHouse into disk-async-read
2021-10-22 15:40:41 +03:00
avogar
d5c5a3213b
Add custom null representation support for TSV/CSV input formats, fix bugs in deserializing NULLs in some cases
2021-10-21 16:52:27 +03:00
Ilya Golshtein
9f9f4a561c
output_format_avro_rows_in_file - fixes
2021-10-19 23:26:55 +03:00
Anton Popov
82bff416f6
Merge remote-tracking branch 'upstream/master' into HEAD
2021-10-19 16:48:47 +03:00
Anton Popov
c547ffa313
improve performance of aggregation in order primary key with function with heavy states
2021-10-19 16:36:31 +03:00
Kruglov Pavel
5052ec3ab0
Merge branch 'master' into tsv-csv
2021-10-19 12:03:52 +03:00
Ilya Golshtein
d90302aa3b
output_format_avro_rows_in_file
2021-10-18 19:01:06 +03:00
kssenii
ccb02cac56
Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into retriable-http
2021-10-15 12:36:30 +00:00
kssenii
881ae8617e
Merge branch 'master' of github.com:ClickHouse/ClickHouse into disk-async-read
2021-10-15 15:09:56 +03:00
avogar
ce22f534c4
Add CapnProto output format, refactor CapnProto input format
2021-10-14 16:43:22 +03:00
avogar
2979c0dee7
Support columns mapping and types checking in RowBinaryWithNamesAndTypes format
2021-10-14 15:05:49 +03:00
avogar
324dfd4f81
Refactor and improve TSV, CSV and JSONCompactEachRow formats, fix some bugs in formats
2021-10-14 13:32:49 +03:00
tavplubix
7742b96497
Remove metadata leftovers on drop database ( #30054 )
...
* remove metadata leftovers on drop database
* Update InterpreterDropQuery.cpp
* Update DatabaseCatalog.cpp
2021-10-13 13:34:18 +03:00
kssenii
1c8b1b1133
Better
2021-10-12 09:33:07 +00:00
kssenii
e7dbfff5d2
Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into retriable-http
2021-10-12 06:19:15 +00:00
Azat Khuzhin
063f9cffab
Allow memory profiler under sanitizers
...
Only query profiler cannot work reliably with sanitizers (due to
unwinding from signal handler), but memory profiler should be fine.
Plus sometimes the problem appears only on build with sanitizers, so it
will be useful to have memory related profiling in trace_log.
Also there is a flaky check for stateless tests, that uses build with
ASan, and now trace_log there is empty, which sometimes does not allow
to debug further.
2021-10-11 10:21:26 +03:00
kssenii
fde6f0507d
Merge remote-tracking branch 'origin/retriable-http' into disk-async-read
2021-10-10 20:23:44 +03:00
kssenii
f3f820c6e0
HTTP read buffer retries
2021-10-08 15:41:55 +03:00
kssenii
d6e1d0503d
Merge branch 'master' of github.com:ClickHouse/ClickHouse into disk-async-read
2021-10-07 16:21:00 +03:00
Nikita Mikhaylov
b31d11478b
Merge pull request #29680 from azat/defines
...
Cleanup common defines
2021-10-04 20:13:29 +03:00
Maksim Kita
8eda58acfb
Merge pull request #29516 from lingtaolf/feature/support-HSTS
...
Support HSTS in Clickhouse HTTP server
2021-10-04 12:49:51 +03:00
Azat Khuzhin
0b83345560
Remove macros for distributed connection timeouts
2021-10-03 14:34:03 +03:00
Azat Khuzhin
f6e3583ffa
Remove macros for hedged request timeouts
2021-10-03 14:34:03 +03:00
Azat Khuzhin
0a6885d806
Remove DEFAULT_LIVE_VIEW_HEARTBEAT_INTERVAL_SEC
2021-10-03 14:34:03 +03:00
Azat Khuzhin
dc2cb6d996
Remove DBMS_DEFAULT_DISTRIBUTED_CONNECTIONS_POOL_SIZE
2021-10-03 14:34:03 +03:00
Nikita Mikhaylov
9756b8dc33
Added an ability to execute more merges and mutations than threads, added new settings ( #29140 )
2021-10-01 00:26:24 +03:00
凌涛
a13d6b0aea
Check all requests
2021-09-30 13:40:48 +08:00
Azat Khuzhin
a218c3a28c
Enable per-query memory profiler (set to memory_profiler_step=4MiB) globally
...
Let's see at performance tests. And yes, they should show the
difference, if any, since they uses clickhouse python driver, which does
not knows about default settings, so new server will have this setting
set, while old server - upstream/master, will not.
2021-09-27 22:46:35 +03:00
Maksim Kita
d0f53cfc31
Added setting use_skip_indexes
2021-09-27 12:17:00 +03:00
Kruglov Pavel
55553026ee
Merge pull request #29206 from azat/strict-external-queries
...
Add ability to disable converting expressions to local filter for external queries
2021-09-23 13:22:12 +03:00
kssenii
1b9565dfa8
Merge branch 'master' of github.com:ClickHouse/ClickHouse into disk-async-read
2021-09-22 22:08:44 +03:00
Kseniia Sumarokova
17b1dd4bc6
Merge branch 'master' into better-retries-2
2021-09-21 13:55:53 +03:00
Anton Popov
ea4fd19e28
Merge pull request #29087 from CurtizJ/asyn-inserts-follow-up
...
Minor enhancements in async inserts
2021-09-21 13:38:52 +03:00
kssenii
975033e6e3
Fix
2021-09-21 09:44:54 +00:00
Vladimir C
bc7c41efff
Merge pull request #26657 from hexiaoting/fuse_quantile
2021-09-21 12:33:07 +03:00
Vladimir C
9abd8aea6d
Merge pull request #29123 from depressed-pho/csv-custom-null
2021-09-21 11:35:21 +03:00
Azat Khuzhin
9c20519f33
Add ability to disable converting expressions to local filter for external queries
...
Sometimes it is undesirable to remove any expressions from WHERE, since
this may lead to reading the whole table, and this is pretty heavy job
for MySQL and PostgreSQL (even if you read only one column).
So external_table_strict_query had been introduced to prohibit this and
fail the query instead.
2021-09-21 02:41:07 +03:00
Anton Popov
83e45adad6
Merge remote-tracking branch 'upstream/master' into HEAD
2021-09-20 20:04:50 +03:00
kssenii
f312760dca
Better
2021-09-20 19:57:15 +03:00
kssenii
12b90da5de
Better retries
2021-09-19 20:50:50 +00:00
PHO
3c4b1ea9c5
New setting: output_format_csv_null_representation
...
This is the same as output_format_tsv_null_representation but is for CSV output.
2021-09-17 17:58:23 +09:00
Anton Popov
99175f7acc
minor enhancements in async inserts
2021-09-16 20:55:34 +03:00
Anton Popov
f6191b98e7
Merge remote-tracking branch 'upstream/master' into HEAD
2021-09-15 17:47:22 +03:00
Anton Popov
9646edf3dc
fix possible race in AsynchronousInsertQueue
2021-09-15 02:54:10 +03:00
Anton Popov
fc17936c12
Merge remote-tracking branch 'upstream/master' into HEAD
2021-09-14 23:02:30 +03:00
mergify[bot]
fa903ac255
Merge branch 'master' into describe-with-subcolumns
2021-09-14 14:43:29 +00:00
vdimir
a3304a87a4
Rename optimize_syntax_fuse_aggregate -> optimize_syntax_fuse_functions
2021-09-14 15:27:12 +03:00
vdimir
a1463d5719
Merge remote-tracking branch 'origin/master' into fuse_quantile
2021-09-14 15:23:06 +03:00
vdimir
5a1aeeb044
Use optimize_syntax_fuse_aggregate instead of optimize_fuse_sum_count_avg and optimize_fuse_quantile
2021-09-14 15:21:16 +03:00
Anton Popov
02a7edf902
allow to include subccolumns in describe query
2021-09-12 00:07:33 +03:00
Pavel Kruglov
9c756fc4b2
Fix bug with LowCardinality in short-curcuit function evaluation
2021-09-11 12:56:25 +03:00
Anton Popov
8e5b3b2f6c
Merge remote-tracking branch 'upstream/master' into HEAD
2021-09-09 15:12:34 +03:00
Anton Popov
4c388e3d84
Merge remote-tracking branch 'origin/sparse-serialization' into HEAD
2021-09-09 14:10:16 +03:00
tavplubix
341a6c51d6
Merging #24866 ( #28691 )
...
* Add StorageSystemISTables.cpp/.h
* Another attempt
* Columns and Views
* Add information schema db and fix information schema 'tables' table
* fix build
* remove copy-paste, add views to system tables
* add test
* fix
* fix_tests
Co-authored-by: Damir Petrov <petrovdamir2235@gmail.com>
Co-authored-by: Damir Petrov <0442a403@verstehen.sas.yp-c.yandex.net>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2021-09-09 12:37:51 +03:00
Anton Popov
1f41f4541f
change timeouts in async insert to milliseconds
2021-09-08 18:30:04 +03:00
Anton Ivashkin
5ff99314b1
Reduce default settings for S3 multipart upload part size
2021-09-07 12:51:00 +03:00
Anton Popov
5e421ab272
Merge remote-tracking branch 'upstream/master' into HEAD
2021-09-02 02:42:50 +03:00
alexey-milovidov
77d085f264
Merge pull request #27527 from evillique/log_queries_probability
...
Add log_queries_probability setting
2021-09-01 00:51:23 +03:00
Alexey Milovidov
ca6f6306f3
Merge branch 'master' into async-reads
2021-08-31 02:52:58 +03:00
Kseniia Sumarokova
00bea71610
Merge pull request #25251 from kssenii/disk-over-web-server
...
ClickHouse over web server with static files
2021-08-30 16:18:59 +03:00
Nikolay Degterinsky
2433d88b82
Merge branch 'master' into log_queries_probability
2021-08-30 12:55:33 +03:00
Alexey Milovidov
e4f3d97b52
Merge branch 'master' of github.com:yandex/ClickHouse into async-reads
2021-08-29 21:42:14 +03:00
Alexey Milovidov
79e0433ba7
Merge branch 'master' of github.com:yandex/ClickHouse into async-reads
2021-08-28 01:19:16 +03:00
Anton Popov
9e67943878
add waiting for async inserts
2021-08-28 00:29:10 +03:00
tavplubix
c36fe210b8
Revert "Add test for #13398 "
2021-08-27 21:07:10 +03:00
tavplubix
703101fe4d
Merge pull request #27931 from ClickHouse/wait_for_all_replicas_timeouts
...
Avoid too long waiting for inactive replicas
2021-08-27 14:31:36 +03:00
Alexey Milovidov
46732e781f
Merge branch 'master' of github.com:yandex/ClickHouse into async-reads
2021-08-27 01:57:48 +03:00
Kruglov Pavel
5bc332c40c
Merge pull request #28054 from kssenii/mysql
...
Add test for #13398
2021-08-26 16:39:43 +03:00
Anton Popov
6d3274c22c
Merge remote-tracking branch 'upstream/master' into HEAD
2021-08-26 03:31:46 +03:00
Alexey Milovidov
3cb9cf7242
Merge branch 'master' of github.com:yandex/ClickHouse into async-reads
2021-08-26 01:55:46 +03:00
Alexey Milovidov
d8250ab3d6
Preparation
2021-08-26 01:14:42 +03:00
Nikolay Degterinsky
2c81a35b4e
Add setting
2021-08-25 17:41:21 +03:00
Alexey Milovidov
8f57216180
Progress on development
2021-08-25 00:45:58 +03:00
Alexey Milovidov
4d9ad3725d
Merge branch 'master' into async-reads
2021-08-25 00:45:40 +03:00
Azat Khuzhin
37043b74bf
Enable optimize_distributed_group_by_sharding_key by default
...
Since it requires optimize_skip_unused_shards this should be safe.
2021-08-24 23:49:50 +03:00
Vitaly Baranov
64f69462c6
Merge pull request #27921 from vitlibar/add-tests-for-field-init
...
Allow implicit cast bool to Field
2021-08-24 17:15:44 +03:00
kssenii
0d5000f917
Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into mysql
2021-08-24 07:30:42 +00:00
kssenii
b536653851
Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into disk-over-web-server
2021-08-24 07:29:50 +00:00
kssenii
962f415740
Add test and settings
2021-08-23 22:18:04 +00:00
Vitaly Baranov
63e8bc1f20
Added new commands BACKUP and RESTORE.
2021-08-23 23:41:45 +03:00
Alexander Tokmakov
cc9c2fd63b
make code better
2021-08-23 15:57:50 +03:00
Vitaly Baranov
89166a655a
Init SettingFieldBool with true or false, not with 1 or 0.
2021-08-23 09:47:36 +03:00
alexey-milovidov
4922fb791e
Merge pull request #27882 from azat/enable-tcp_keep_alive_timeout
...
RFC: Enable tcp_keep_alive_timeout by default
2021-08-21 22:39:12 +03:00
Kseniia Sumarokova
19afb22b4d
Merge pull request #27932 from amosbird/constkeys
...
Add a setting to bring back the old behavior of grouping by constant keys on empty set.
2021-08-21 08:02:30 +03:00
Kseniia Sumarokova
38a35c1d9e
Merge pull request #27530 from kssenii/col-identifier-as-col-number
...
Allow positional arguments for group by, order by, limit by
2021-08-20 21:08:58 +03:00
kssenii
945e2c4ce5
Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into disk-over-web-server
2021-08-20 18:01:23 +00:00
Amos Bird
5708ed42ec
Add setting.
...
empty_result_for_aggregation_by_constant_keys_on_empty_set
2021-08-20 22:34:32 +08:00
Anton Popov
61239343e3
Merge remote-tracking branch 'origin/sparse-serialization' into HEAD
2021-08-20 16:33:30 +03:00
Alexander Tokmakov
59eb3aa9a9
avoid too long waiting for inactive replicas
2021-08-20 15:59:57 +03:00
alexey-milovidov
6be085ed17
Update Settings.h
2021-08-20 09:05:48 +03:00
Azat Khuzhin
9aecb27913
Decrease tcp_keep_alive_timeout default (to avoid overlaps with receive_timeout)
2021-08-20 07:16:17 +03:00
Azat Khuzhin
d610974c4c
Set tcp_keep_alive_timeout to 300 by default
...
This may fix possible issues with remote queries, when remote server
abnormaly terminates and the initiator does not have proper timeout.
This should not harm anything, since the timeout is pretty huge (300
seconds).
2021-08-19 09:06:41 +03:00
alexey-milovidov
eb3bbdfab5
Merge pull request #27680 from ClickHouse/decimal-no-trailing-zeros
...
Remove trailing zeros from Decimal serialization #15794
2021-08-18 05:24:13 +03:00
Pavel Kruglov
7c98fc11b9
Fix performance, make only one setting
2021-08-16 14:30:56 +03:00
Alexey Milovidov
8adaef7c8e
Make text format for Decimal tuneable
2021-08-16 11:03:23 +03:00
Alexey Milovidov
d184b79bba
Progress on async reads.
2021-08-16 03:00:32 +03:00
kssenii
daac6323fa
Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into disk-over-web-server
2021-08-14 13:15:04 +00:00
mergify[bot]
319e5af6eb
Merge branch 'master' into short-circuit
2021-08-13 13:01:46 +00:00
Pavel Kruglov
36bea6abb4
Add setting optimize_short_circuit_function_evaluation
2021-08-13 14:48:32 +03:00
kssenii
37554014aa
Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into col-identifier-as-col-number
2021-08-13 05:28:22 +00:00
Nikita Mikhaylov
8c06abee73
Merge pull request #25902 from Avogar/arrow-nested
...
Refactor ArrowColumnToCHColumn, support inserting Nested as Array(Struct) in Arrow/ORC/Parquet
2021-08-12 20:02:01 +03:00
Kseniia Sumarokova
c50294fda8
Update Settings.h
2021-08-10 17:40:06 +03:00
kssenii
503a5edc59
Fix
2021-08-10 14:01:59 +00:00
kssenii
554231c6fc
Support positional arguments for GROUP BY, ORDER BY, LIMIT BY
2021-08-10 13:38:42 +00:00
Raúl Marín
d1d47658f5
Merge remote-tracking branch 'blessed/master' into materialization_log
2021-08-10 10:49:05 +02:00
Pavel Kruglov
a95d45a157
Some clean up
2021-08-09 17:57:02 +03:00
Pavel Kruglov
50d4192126
Implement short circuit function evaluation, first attempt
2021-08-09 17:43:10 +03:00
kssenii
d767f6704f
Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into disk-over-web-server
2021-08-09 12:14:23 +00:00
Nikita Mikhaylov
73d3f2c60f
Merge pull request #26313 from fastio/control_execution_period_of_clearOldTemporaryDirectories
...
Control the execution period of clear old temporary directories by parameter
2021-08-09 14:29:24 +03:00
alexey-milovidov
5f84564207
Merge pull request #27378 from amosbird/hyperscansanitizer
...
Add settings to check hyperscan regexp length.
2021-08-09 02:48:14 +03:00
alexey-milovidov
677fddaa37
Merge pull request #27104 from azat/enable-distributed_push_down_limit
...
Enable distributed_push_down_limit by default
2021-08-09 02:45:52 +03:00
Alexey Milovidov
e45a09e2f5
Fix wrong PR #27184
2021-08-08 21:09:39 +03:00
mergify[bot]
bd313279e8
Merge branch 'master' into hyperscansanitizer
2021-08-08 17:03:05 +00:00
Azat Khuzhin
0677a6c6cb
Enable distributed_push_down_limit by default
2021-08-08 19:30:50 +03:00
alexey-milovidov
5523e5e153
Update Settings.h
2021-08-07 18:48:52 +03:00
Amos Bird
5ef59d4828
Add setting to log formatted query into system.query_log
2021-08-07 14:26:38 +08:00
Amos Bird
aa33a7add1
Add settings to check hyperscan regexp length.
2021-08-07 13:07:41 +08:00
kssenii
073d7fdd5e
Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into disk-over-web-server
2021-08-06 19:42:29 +00:00
mergify[bot]
c696817a79
Merge branch 'master' into control_execution_period_of_clearOldTemporaryDirectories
2021-08-06 16:16:22 +00:00
Anton Popov
3a0d4807a5
Merge branch 'async-insert' of git://github.com/abyss7/ClickHouse into merging-20557
2021-08-06 16:20:02 +03:00
Raúl Marín
479f053f2e
Merge remote-tracking branch 'blessed/master' into materialization_log
2021-08-05 17:24:10 +02:00
Alexander Kuzmenkov
4bc652699f
Merge pull request #27184 from ClickHouse/aku/window-functions
...
mark window functions as ready for general use
2021-08-05 14:18:28 +03:00
Pavel Kruglov
e4c5d7e3b1
Support inserting nested as Array of structs, add some refactoring
2021-08-05 14:10:27 +03:00
Alexander Kuzmenkov
0730e685b0
Mark window functions ready for general use.
2021-08-04 17:45:32 +03:00
Anton Popov
e36736b50c
Merge remote-tracking branch 'origin/sparse-serialization' into HEAD
2021-08-02 22:52:02 +03:00
Raúl Marín
9f32ecca89
Merge remote-tracking branch 'blessed/master' into materialization_log
2021-08-02 16:21:10 +02:00
alesapin
181f93c60a
Merge pull request #24997 from evillique/nlp
...
NLP functions
2021-08-02 10:50:40 +03:00
alexey-milovidov
d2b7e23899
Merge pull request #26961 from Enmk/fix/extractAllGroupsHorizontal_max_matches_per_row
...
Updated extractAllGroupsHorizontal - flexible limit on number of matches
2021-07-31 04:54:24 +03:00
alesapin
02176fb4c7
Add experimental flag
2021-07-30 18:25:51 +03:00
alexey-milovidov
582fa31b18
Update Settings.h
2021-07-30 12:30:36 +03:00
Vasily Nemkov
a1fb16df52
setting regexp_max_matches_per_row instead of 3rd argument
2021-07-30 12:28:21 +03:00
Raúl Marín
6b9ec2a62e
WIP
2021-07-27 16:28:28 +02:00
Raúl Marín
efe1938437
WIP: Slow improvements
2021-07-27 16:26:29 +02:00
Raúl Marín
ea5c02a605
WIP
2021-07-27 16:26:27 +02:00
Alexander Tokmakov
63ab38ee09
rename MaterializeMySQL to MaterializedMySQL
2021-07-26 21:17:28 +03:00
hexiaoting
6b73fa5307
Fix style check errors
2021-07-23 10:57:34 +08:00
Maksim Kita
46fd046f11
Setting min_count_to_compile_aggregate_expression fix
2021-07-23 00:22:04 +03:00
hexiaoting
de30962ebd
Fuse multi quantile funcs with same arguments to one function.
2021-07-21 14:43:40 +08:00
Anton Popov
f99374cca6
Merge remote-tracking branch 'origin/sparse-serialization' into HEAD
2021-07-20 18:20:21 +03:00
Amos Bird
dbfb699690
Asynchronously drain connections.
2021-07-19 21:53:29 +08:00
alexey-milovidov
f481a5a28e
Merge pull request #26380 from ClickHouse/use-hedged-requests-again
...
Use hedged requests, again
2021-07-17 01:16:32 +03:00
alexey-milovidov
4103c22310
Merge pull request #26245 from arenadata/ADQM-322
...
Avro string for ClickHouse String
2021-07-16 12:23:50 +03:00
Alexey Milovidov
2d42b1ebf6
Use hedged requests, again
2021-07-15 19:43:42 +03:00
Peng Jian
4bc07771ee
Fix the clearOldTemporaryDirectories is executed too frequently
2021-07-14 19:26:46 +08:00
Alexey Milovidov
9dd0a76220
Add a setting "function_range_max_elements_in_block" and increase it 5 times
2021-07-14 11:31:08 +03:00
Ilya Golshtein
16532658c2
Avro string for ClickHouse string
2021-07-13 20:03:00 +03:00
Anton Popov
5d175bf557
dynamic columns: support distributed tables
2021-07-12 17:54:02 +03:00
mergify[bot]
b7ae4e4ced
Merge branch 'master' into async-insert
2021-07-12 09:21:37 +00:00
Maksim Kita
dc81ae7c6e
Compile AggregateFunctionBitwise
2021-07-10 01:51:34 +03:00
Anton Popov
e1afdc1f1e
dynamic subcolumns: add mode for DESCRIBE query to show deduced object types
2021-07-09 17:54:53 +03:00
Maksim Kita
577e69898a
Compile aggregate functions perf tests fix
2021-07-05 12:17:01 +03:00
alexey-milovidov
fef7c557f6
Merge pull request #24789 from kitaisreal/compile-aggregation-functions
...
Compile aggregate functions
2021-07-05 02:57:49 +03:00
Kseniia Sumarokova
8351f1db99
Merge pull request #20470 from kssenii/pg-ch-replica
...
MaterializePostgreSQL table engine and database engine
2021-07-04 19:34:54 +03:00
Kseniia Sumarokova
9b4d35ef95
Merge pull request #25940 from kssenii/move-to-prewhere-if-final
...
Add setting optimize_move_to_prewhere_if_final
2021-07-04 11:33:24 +03:00
alexey-milovidov
56d695cd12
Update Settings.h
2021-07-03 22:10:22 +03:00
Alexey Milovidov
127455f15f
Remove experimental ANTLR parser
2021-07-03 18:48:03 +03:00
kssenii
a9a91a4f15
Setting move to prewhere if final
2021-07-03 11:37:50 +00:00
Maksim Kita
da8c957167
Aggregator added CompiledExpressionCache
2021-07-01 22:56:36 +03:00
Maksim Kita
d24d3ae992
Added second variant of compilation
2021-07-01 22:56:36 +03:00
Maksim Kita
3fe559b31f
Compile aggregate functions
2021-07-01 22:56:35 +03:00
kssenii
9d5847a1a8
Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into pg-ch-replica
2021-06-29 21:30:31 +00:00
Ivan Lezhankin
1bb41593d1
Merge remote-tracking branch 'upstream/master' into async-insert
2021-06-28 22:55:56 +03:00
Maksim Kita
352e1f27ff
Update using Map datatyle in system log tables before merge
2021-06-28 14:42:21 +03:00
Maksim Kita
294b937a39
Merge branch 'system-query-log-map-type-merge' into system-querylog-map-continue
2021-06-28 11:27:59 +03:00
kssenii
aa7133c239
Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into pg-ch-replica
2021-06-27 20:08:00 +00:00
kssenii
c3a2fc0584
Review fixes
2021-06-27 19:17:17 +00:00
alexey-milovidov
0a26687115
Merge pull request #23864 from azat/dist-split-batch-and-retry
...
Add ability to split distributed batch on failures (i.e. due to memory limits)
2021-06-27 19:28:26 +03:00
