avogar
8112a71233
Implement schema inference for most input formats
2021-12-29 12:18:56 +03:00
Denny Crane
12763976b1
Update Settings.h
...
obsolete max_alter_threads
2021-12-28 16:35:46 -04:00
mergify[bot]
1e0642065b
Merge branch 'master' into deduplication_token_7461
2021-12-22 15:27:28 +00:00
taiyang-li
2597925724
merge master
2021-12-21 15:55:39 +08:00
Antonio Andelic
25f88356e4
Add hints for SET query and HTTP request param settings
2021-12-20 16:57:09 +01:00
taiyang-li
7192458601
fix code typo
2021-12-20 18:10:15 +08:00
kreuzerkrieg
f06c37d206
Stop reading incomplete stripes and skip rows.
2021-12-19 18:41:32 +02:00
Igor Nikonov
100ee92c64
insert_deduplication_token setting for INSERT statement
...
The setting allows a user to provide own deduplication semantic in Replicated*MergeTree
If provided, it's used instead of data digest to generate block ID
So, for example, by providing a unique value for the setting in each INSERT statement,
user can avoid the same inserted data being deduplicated
Inserting data within the same INSERT statement are split into blocks
according to the *insert_block_size* settings
(max_insert_block_size, min_insert_block_size_rows, min_insert_block_size_bytes).
Each block with the same INSERT statement will get an ordinal number.
The ordinal number is added to insert_deduplication_token to get block dedup token
i.e. <token>_0, <token>_1, ... Deduplication is done per block
So, to guarantee deduplication for two same INSERT queries,
dedup token and number of blocks to have to be the same
Issue: #7461
2021-12-19 13:15:45 +00:00
Anton Popov
99ebabd822
Merge remote-tracking branch 'upstream/master' into HEAD
2021-12-17 19:02:29 +03:00
Kseniia Sumarokova
77b3ebe44e
Merge pull request #32734 from kssenii/mysql-fix-timeouts
...
Allow to control connection timeouts for mysql
2021-12-17 10:13:33 +03:00
taiyang-li
d033fc4c24
merge master and fix conflict
2021-12-17 15:11:21 +08:00
kssenii
2e813fe3cd
Update defaults
2021-12-15 08:18:43 +00:00
Azat Khuzhin
33ffd343f3
Add ability to drain connections synchronously
...
This is mostly for testing, to avoid hiding errors.
2021-12-14 10:18:57 +03:00
kssenii
f0d0714e47
Pass timeouts for mysql
2021-12-13 22:12:33 +00:00
mergify[bot]
b81d600c1e
Merge branch 'master' into memory-overcommit
2021-12-12 23:01:56 +00:00
李扬
8675086104
Merge branch 'master' into hive_table
2021-12-12 09:01:46 -06:00
Nikita Mikhaylov
dbf5091016
Parallel reading from replicas ( #29279 )
2021-12-09 13:39:28 +03:00
mergify[bot]
600dcb749a
Merge branch 'master' into memory-overcommit
2021-12-07 00:40:20 +00:00
leosunli
8d04495840
set hdfs_replication default value 0
...
Signed-off-by: leosunli <lisheng.sun08@gmail.com>
2021-12-06 14:32:32 +08:00
leosunli
5be58a8839
Make HDFS replication configurable in WriteBufferFromHDFSImpl#WriteBufferFromHDFSImpl
...
Signed-off-by: leosunli <lisheng.sun08@gmail.com>
2021-12-06 14:32:31 +08:00
Kruglov Pavel
049b2c0c14
Merge pull request #31072 from MaxWk/feature-support-bool-type
...
Feature support bool type
2021-12-02 14:50:29 +03:00
taiyang-li
2f4e7e1d4e
merge master
2021-12-02 19:48:21 +08:00
taiyang-li
9ec8272186
refactor hive text input format
2021-12-02 16:14:25 +08:00
Kseniia Sumarokova
87574e8bf6
Merge pull request #31053 from kssenii/rabbit-kafka-select-commit
...
rabbitmq/kafka allow to commit on select only under setting
2021-12-01 18:23:08 +03:00
Anton Popov
6f4d9a53b2
Merge remote-tracking branch 'origin/sparse-serialization' into HEAD
2021-12-01 15:54:33 +03:00
Kseniia Sumarokova
e879cf75e3
Update Settings.h
2021-11-30 22:06:36 +03:00
kssenii
2ea4e7c4e7
Better
2021-11-29 15:05:02 +00:00
mergify[bot]
8d5460b469
Merge branch 'master' into feature-support-bool-type
2021-11-29 11:50:18 +00:00
taiyang-li
c7a0fe467f
fix code stylke
2021-11-29 16:22:43 +08:00
kssenii
223048d395
Merge branch 'master' of github.com:ClickHouse/ClickHouse into vxider-window-view
2021-11-26 01:06:06 +03:00
Kseniia Sumarokova
93cf66df12
Merge pull request #30936 from kssenii/seekable-read-buffers
...
Reduce memory usage for some formats when reading with s3/url/hdfs
2021-11-25 11:19:24 +03:00
Anton Popov
ccd78e3838
Merge remote-tracking branch 'upstream/master' into HEAD
2021-11-22 17:19:35 +03:00
Anton Popov
43cfa4467b
Merge pull request #31476 from CurtizJ/merging-constraints
...
Merging #18787 (Constraints)
2021-11-22 15:57:59 +03:00
Kruglov Pavel
814a36ba69
Merge pull request #31434 from Avogar/custom-with-names-and-types
...
Add formats CustomSeparatedWithNames/WithNamesAndTypes
2021-11-22 13:24:00 +03:00
kssenii
6c8867a719
Fix style check
2021-11-20 16:21:43 +03:00
kssenii
ff969b4605
Merge branch 'master' of github.com:ClickHouse/ClickHouse into seekable-read-buffers
2021-11-20 15:03:13 +03:00
kevin wan
fc6b01749f
Update src/Core/Settings.h
...
Co-authored-by: Kruglov Pavel <48961922+Avogar@users.noreply.github.com>
2021-11-19 20:24:39 +08:00
vdimir
2e0d3efba0
disable partial_merge_join_left_table_buffer_bytes due to bug
2021-11-19 12:59:23 +03:00
vdimir
f3d0e6d999
remove partial_merge_join_optimizations
...
this option is redundant because optimization is controlled by partial_merge_join_left_table_buffer_bytes
2021-11-19 12:58:46 +03:00
MaxWk
f17d5b02e4
use bool representation
2021-11-19 14:30:22 +08:00
kssenii
6a39d871b2
Merge branch 'master' of github.com:ClickHouse/ClickHouse into vxider-window-view
2021-11-18 17:29:11 +03:00
avogar
73d1918410
tmp
2021-11-16 17:10:30 +03:00
Alexander Tokmakov
416a82b99a
Merge branch 'master' into check_dependencies_on_drop
2021-11-15 13:35:45 +03:00
Kseniia Sumarokova
59d4eb99c2
Merge pull request #31291 from kssenii/update-async-reads-setting
...
Make remote_filesystem_read_method=threadpool by default
2021-11-13 19:19:35 +03:00
kssenii
f18dcd2287
Merge branch 'master' of github.com:ClickHouse/ClickHouse into seekable-read-buffers
2021-11-13 14:38:57 +03:00
tavplubix
de6a6f3227
Merge pull request #31180 from ClickHouse/merge_selecting_backoff
...
Slightly better backoff for merge selecting task
2021-11-11 20:57:40 +03:00
Kseniia Sumarokova
b3bacac021
Merge pull request #29894 from kssenii/retriable-http
...
Make http read buffer retriable
2021-11-11 19:50:50 +03:00
Alexander Tokmakov
108b5a70e2
mark settings as obsolete
2021-11-11 14:21:42 +03:00
Alexander Tokmakov
627dde7aba
Merge branch 'master' into merge_selecting_backoff
2021-11-11 13:43:10 +03:00
tavplubix
dd720ec9b4
Merge pull request #31252 from ClickHouse/warning_for_obsolete_settings
...
Show warning if some obsolete setting changed
2021-11-11 13:41:49 +03:00
kssenii
0dda1f280b
Update setting remote_filesystem_read_method
2021-11-11 13:19:49 +03:00
Kseniia Sumarokova
e20cb0c10a
Merge branch 'master' into retriable-http
2021-11-11 11:52:06 +03:00
MaxWk
d42a454837
support some bool format
2021-11-11 16:01:32 +08:00
kssenii
62c70ce5cf
Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into retriable-http
2021-11-10 21:16:11 +00:00
kssenii
175f903624
Fix
2021-11-10 21:14:17 +00:00
Anton Popov
833652e8f4
Merge branch 'nikvas0/simple_optimizations' of git://github.com/nikvas0/ClickHouse into merging-constraints
2021-11-10 19:35:28 +03:00
Alexander Tokmakov
9d83832bde
show warning if some obsolete setting changed
2021-11-10 18:49:13 +03:00
kssenii
618c332f9c
Rename read_threadpool to threadpool
2021-11-10 07:46:18 +00:00
Dmitry Novik
9464dc2fd3
Add waiting timeout
2021-11-09 16:02:36 +03:00
Dmitry Novik
0816dedaea
Introduce memory overcommit
2021-11-09 16:02:36 +03:00
Anton Popov
a20922b2d3
Merge remote-tracking branch 'origin/sparse-serialization' into HEAD
2021-11-09 15:36:25 +03:00
Alexander Tokmakov
51bd98294e
better merge selecting backoff
2021-11-09 15:26:51 +03:00
vdimir
2fb21906de
Disable optimize_syntax_fuse_functions by default
2021-11-08 15:25:56 +03:00
kssenii
4bc2a29345
Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into retriable-http
2021-11-04 14:41:24 +00:00
vdimir
08545795b5
Separate option for enabling fuse syntax for sum, avg, count
2021-11-03 15:13:09 +03:00
kssenii
ec11179f91
Merge branch 'master' of github.com:ClickHouse/ClickHouse into seekable-read-buffers
2021-11-03 14:33:31 +03:00
kssenii
45ea820297
Reduce memory usage for some formats
2021-11-03 14:30:03 +03:00
Kruglov Pavel
327a34e9da
Merge pull request #30497 from Avogar/null-deserialization
...
Add custom null representation support for TSV/CSV input formats, fix Nullable(String) deserializing in some formats
2021-11-03 11:30:25 +03:00
Alexander Tokmakov
56aeff734a
Merge branch 'master' into check_dependencies_on_drop
2021-11-02 16:15:30 +03:00
Alexander Tokmakov
598dbe04db
fix tests, support rename
2021-11-02 15:58:45 +03:00
Kseniia Sumarokova
4c675f0151
Merge pull request #30970 from kssenii/add-setting-for-remote-reads
...
Add settings for remote async reads
2021-11-02 15:28:09 +03:00
avogar
42ab57f0e5
Set output_format_avro_rows_in_file default to 1
2021-11-02 14:06:10 +03:00
Kruglov Pavel
901ebcede6
Merge pull request #30351 from arenadata/ADQM-335
...
output_format_avro_rows_in_file
2021-11-02 12:25:27 +03:00
Kruglov Pavel
1f8535c02b
Merge branch 'master' into null-deserialization
2021-11-02 12:15:21 +03:00
kssenii
53c0e1ae61
Add setting for remote reads
2021-11-01 18:14:18 +03:00
kssenii
2940d9fd19
Squashed commit of the following:
...
commit a1acc7ed3485bd158cf42f26b2d2a1bca84b7269
Author: kssenii <sumarokovakseniia@mail.ru>
Date: Sun Oct 31 14:47:25 2021 +0000
Fix
commit 12a27d445bf17e321a7355f1ba857d11b70a285chttps://github.com/ClickHouse/ClickHouse into retriable-http
commit 55f1ba857daeba8104d182f3754b8a2647b88a667024f51b552bb586bed3https://github.com/ClickHouse/ClickHouse into retriable-http
commit 7024f51b557de5fca0751ecb6ad05d855b10261chttps://github.com/ClickHouse/ClickHouse into retriable-http
commit 1ecb6ad05d710ee9687828d2485716158b4c26b7https://github.com/ClickHouse/ClickHouse into retriable-http
commit 28d24857167c20ca07b7ccb02cac569e4fe0f3c8d1138a8a25https://github.com/ClickHouse/ClickHouse into retriable-http
commit 9e4fe0f3c89814cb1b45daed77038bhttps://github.com/ClickHouse/ClickHouse into retriable-http
commit 9814cb1b451c8b1b1133969999ff10https://github.com/ClickHouse/ClickHouse into retriable-http
commit 1c8b1b1133e7dbfff5d23329b668d6198adc7ecdhttps://github.com/ClickHouse/ClickHouse into retriable-http
2021-10-31 17:53:08 +03:00
Kruglov Pavel
7d4f211d5b
Merge branch 'master' into tsv-csv
2021-10-29 16:38:06 +03:00
kssenii
f17e321a73
Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into retriable-http
2021-10-29 08:03:25 +00:00
kssenii
55f1ba857d
Small fixes
2021-10-29 07:38:42 +00:00
kssenii
4f3433b4e1
Some clean up before merging
2021-10-29 01:04:52 +03:00
kssenii
7e2ea97e3c
Merge branch 'master' of github.com:ClickHouse/ClickHouse into disk-async-read
2021-10-28 18:46:21 +03:00
Kseniia Sumarokova
acdcb53f18
Update Settings.h
2021-10-28 09:25:34 +03:00
Kseniia Sumarokova
afc0b2068c
Update Settings.h
2021-10-28 01:04:16 +03:00
kssenii
82f3754b8a
Slightly better
2021-10-27 20:20:15 +00:00
Kruglov Pavel
0715566cc0
Merge branch 'master' into tsv-csv
2021-10-27 17:52:49 +03:00
avogar
d1ef96a5ef
Add test, avoid unnecessary allocations, use PeekableReadBuffer only in corner case
2021-10-27 17:29:15 +03:00
kssenii
52296e8b04
Merge branch 'master' of github.com:ClickHouse/ClickHouse into disk-async-read
2021-10-25 00:22:32 +03:00
kssenii
7de5fca075
Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into retriable-http
2021-10-24 17:04:24 +00:00
kssenii
39b9e9c258
Merge branch 'master' of github.com:ClickHouse/ClickHouse into disk-async-read
2021-10-22 15:40:41 +03:00
avogar
d5c5a3213b
Add custom null representation support for TSV/CSV input formats, fix bugs in deserializing NULLs in some cases
2021-10-21 16:52:27 +03:00
Ilya Golshtein
9f9f4a561c
output_format_avro_rows_in_file - fixes
2021-10-19 23:26:55 +03:00
Anton Popov
82bff416f6
Merge remote-tracking branch 'upstream/master' into HEAD
2021-10-19 16:48:47 +03:00
Anton Popov
c547ffa313
improve performance of aggregation in order primary key with function with heavy states
2021-10-19 16:36:31 +03:00
Kruglov Pavel
5052ec3ab0
Merge branch 'master' into tsv-csv
2021-10-19 12:03:52 +03:00
Ilya Golshtein
d90302aa3b
output_format_avro_rows_in_file
2021-10-18 19:01:06 +03:00
kssenii
ccb02cac56
Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into retriable-http
2021-10-15 12:36:30 +00:00
kssenii
881ae8617e
Merge branch 'master' of github.com:ClickHouse/ClickHouse into disk-async-read
2021-10-15 15:09:56 +03:00
avogar
ce22f534c4
Add CapnProto output format, refactor CapnProto input format
2021-10-14 16:43:22 +03:00
avogar
2979c0dee7
Support columns mapping and types checking in RowBinaryWithNamesAndTypes format
2021-10-14 15:05:49 +03:00
avogar
324dfd4f81
Refactor and improve TSV, CSV and JSONCompactEachRow formats, fix some bugs in formats
2021-10-14 13:32:49 +03:00
tavplubix
7742b96497
Remove metadata leftovers on drop database ( #30054 )
...
* remove metadata leftovers on drop database
* Update InterpreterDropQuery.cpp
* Update DatabaseCatalog.cpp
2021-10-13 13:34:18 +03:00
kssenii
1c8b1b1133
Better
2021-10-12 09:33:07 +00:00
kssenii
e7dbfff5d2
Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into retriable-http
2021-10-12 06:19:15 +00:00
Azat Khuzhin
063f9cffab
Allow memory profiler under sanitizers
...
Only query profiler cannot work reliably with sanitizers (due to
unwinding from signal handler), but memory profiler should be fine.
Plus sometimes the problem appears only on build with sanitizers, so it
will be useful to have memory related profiling in trace_log.
Also there is a flaky check for stateless tests, that uses build with
ASan, and now trace_log there is empty, which sometimes does not allow
to debug further.
2021-10-11 10:21:26 +03:00
kssenii
fde6f0507d
Merge remote-tracking branch 'origin/retriable-http' into disk-async-read
2021-10-10 20:23:44 +03:00
kssenii
f3f820c6e0
HTTP read buffer retries
2021-10-08 15:41:55 +03:00
kssenii
d6e1d0503d
Merge branch 'master' of github.com:ClickHouse/ClickHouse into disk-async-read
2021-10-07 16:21:00 +03:00
Nikita Mikhaylov
b31d11478b
Merge pull request #29680 from azat/defines
...
Cleanup common defines
2021-10-04 20:13:29 +03:00
Maksim Kita
8eda58acfb
Merge pull request #29516 from lingtaolf/feature/support-HSTS
...
Support HSTS in Clickhouse HTTP server
2021-10-04 12:49:51 +03:00
Azat Khuzhin
0b83345560
Remove macros for distributed connection timeouts
2021-10-03 14:34:03 +03:00
Azat Khuzhin
f6e3583ffa
Remove macros for hedged request timeouts
2021-10-03 14:34:03 +03:00
Azat Khuzhin
0a6885d806
Remove DEFAULT_LIVE_VIEW_HEARTBEAT_INTERVAL_SEC
2021-10-03 14:34:03 +03:00
Azat Khuzhin
dc2cb6d996
Remove DBMS_DEFAULT_DISTRIBUTED_CONNECTIONS_POOL_SIZE
2021-10-03 14:34:03 +03:00
Nikita Mikhaylov
9756b8dc33
Added an ability to execute more merges and mutations than threads, added new settings ( #29140 )
2021-10-01 00:26:24 +03:00
凌涛
a13d6b0aea
Check all requests
2021-09-30 13:40:48 +08:00
Azat Khuzhin
a218c3a28c
Enable per-query memory profiler (set to memory_profiler_step=4MiB) globally
...
Let's see at performance tests. And yes, they should show the
difference, if any, since they uses clickhouse python driver, which does
not knows about default settings, so new server will have this setting
set, while old server - upstream/master, will not.
2021-09-27 22:46:35 +03:00
Maksim Kita
d0f53cfc31
Added setting use_skip_indexes
2021-09-27 12:17:00 +03:00
Kruglov Pavel
55553026ee
Merge pull request #29206 from azat/strict-external-queries
...
Add ability to disable converting expressions to local filter for external queries
2021-09-23 13:22:12 +03:00
kssenii
1b9565dfa8
Merge branch 'master' of github.com:ClickHouse/ClickHouse into disk-async-read
2021-09-22 22:08:44 +03:00
Kseniia Sumarokova
17b1dd4bc6
Merge branch 'master' into better-retries-2
2021-09-21 13:55:53 +03:00
Anton Popov
ea4fd19e28
Merge pull request #29087 from CurtizJ/asyn-inserts-follow-up
...
Minor enhancements in async inserts
2021-09-21 13:38:52 +03:00
kssenii
975033e6e3
Fix
2021-09-21 09:44:54 +00:00
Vladimir C
bc7c41efff
Merge pull request #26657 from hexiaoting/fuse_quantile
2021-09-21 12:33:07 +03:00
Vladimir C
9abd8aea6d
Merge pull request #29123 from depressed-pho/csv-custom-null
2021-09-21 11:35:21 +03:00
Azat Khuzhin
9c20519f33
Add ability to disable converting expressions to local filter for external queries
...
Sometimes it is undesirable to remove any expressions from WHERE, since
this may lead to reading the whole table, and this is pretty heavy job
for MySQL and PostgreSQL (even if you read only one column).
So external_table_strict_query had been introduced to prohibit this and
fail the query instead.
2021-09-21 02:41:07 +03:00
Anton Popov
83e45adad6
Merge remote-tracking branch 'upstream/master' into HEAD
2021-09-20 20:04:50 +03:00
kssenii
f312760dca
Better
2021-09-20 19:57:15 +03:00
kssenii
12b90da5de
Better retries
2021-09-19 20:50:50 +00:00
PHO
3c4b1ea9c5
New setting: output_format_csv_null_representation
...
This is the same as output_format_tsv_null_representation but is for CSV output.
2021-09-17 17:58:23 +09:00
Anton Popov
99175f7acc
minor enhancements in async inserts
2021-09-16 20:55:34 +03:00
Anton Popov
f6191b98e7
Merge remote-tracking branch 'upstream/master' into HEAD
2021-09-15 17:47:22 +03:00
Anton Popov
9646edf3dc
fix possible race in AsynchronousInsertQueue
2021-09-15 02:54:10 +03:00
Anton Popov
fc17936c12
Merge remote-tracking branch 'upstream/master' into HEAD
2021-09-14 23:02:30 +03:00
mergify[bot]
fa903ac255
Merge branch 'master' into describe-with-subcolumns
2021-09-14 14:43:29 +00:00
vdimir
a3304a87a4
Rename optimize_syntax_fuse_aggregate -> optimize_syntax_fuse_functions
2021-09-14 15:27:12 +03:00
vdimir
a1463d5719
Merge remote-tracking branch 'origin/master' into fuse_quantile
2021-09-14 15:23:06 +03:00
vdimir
5a1aeeb044
Use optimize_syntax_fuse_aggregate instead of optimize_fuse_sum_count_avg and optimize_fuse_quantile
2021-09-14 15:21:16 +03:00
Anton Popov
02a7edf902
allow to include subccolumns in describe query
2021-09-12 00:07:33 +03:00
Pavel Kruglov
9c756fc4b2
Fix bug with LowCardinality in short-curcuit function evaluation
2021-09-11 12:56:25 +03:00
Anton Popov
8e5b3b2f6c
Merge remote-tracking branch 'upstream/master' into HEAD
2021-09-09 15:12:34 +03:00
Anton Popov
4c388e3d84
Merge remote-tracking branch 'origin/sparse-serialization' into HEAD
2021-09-09 14:10:16 +03:00
tavplubix
341a6c51d6
Merging #24866 ( #28691 )
...
* Add StorageSystemISTables.cpp/.h
* Another attempt
* Columns and Views
* Add information schema db and fix information schema 'tables' table
* fix build
* remove copy-paste, add views to system tables
* add test
* fix
* fix_tests
Co-authored-by: Damir Petrov <petrovdamir2235@gmail.com>
Co-authored-by: Damir Petrov <0442a403@verstehen.sas.yp-c.yandex.net>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2021-09-09 12:37:51 +03:00
Anton Popov
1f41f4541f
change timeouts in async insert to milliseconds
2021-09-08 18:30:04 +03:00
Anton Ivashkin
5ff99314b1
Reduce default settings for S3 multipart upload part size
2021-09-07 12:51:00 +03:00
Anton Popov
5e421ab272
Merge remote-tracking branch 'upstream/master' into HEAD
2021-09-02 02:42:50 +03:00
alexey-milovidov
77d085f264
Merge pull request #27527 from evillique/log_queries_probability
...
Add log_queries_probability setting
2021-09-01 00:51:23 +03:00
Alexey Milovidov
ca6f6306f3
Merge branch 'master' into async-reads
2021-08-31 02:52:58 +03:00
Kseniia Sumarokova
00bea71610
Merge pull request #25251 from kssenii/disk-over-web-server
...
ClickHouse over web server with static files
2021-08-30 16:18:59 +03:00
Nikolay Degterinsky
2433d88b82
Merge branch 'master' into log_queries_probability
2021-08-30 12:55:33 +03:00
Alexey Milovidov
e4f3d97b52
Merge branch 'master' of github.com:yandex/ClickHouse into async-reads
2021-08-29 21:42:14 +03:00
Alexey Milovidov
79e0433ba7
Merge branch 'master' of github.com:yandex/ClickHouse into async-reads
2021-08-28 01:19:16 +03:00
Anton Popov
9e67943878
add waiting for async inserts
2021-08-28 00:29:10 +03:00
tavplubix
c36fe210b8
Revert "Add test for #13398 "
2021-08-27 21:07:10 +03:00
tavplubix
703101fe4d
Merge pull request #27931 from ClickHouse/wait_for_all_replicas_timeouts
...
Avoid too long waiting for inactive replicas
2021-08-27 14:31:36 +03:00
Alexey Milovidov
46732e781f
Merge branch 'master' of github.com:yandex/ClickHouse into async-reads
2021-08-27 01:57:48 +03:00
Kruglov Pavel
5bc332c40c
Merge pull request #28054 from kssenii/mysql
...
Add test for #13398
2021-08-26 16:39:43 +03:00
Anton Popov
6d3274c22c
Merge remote-tracking branch 'upstream/master' into HEAD
2021-08-26 03:31:46 +03:00
Alexey Milovidov
3cb9cf7242
Merge branch 'master' of github.com:yandex/ClickHouse into async-reads
2021-08-26 01:55:46 +03:00
Alexey Milovidov
d8250ab3d6
Preparation
2021-08-26 01:14:42 +03:00
Nikolay Degterinsky
2c81a35b4e
Add setting
2021-08-25 17:41:21 +03:00
Alexey Milovidov
8f57216180
Progress on development
2021-08-25 00:45:58 +03:00
Alexey Milovidov
4d9ad3725d
Merge branch 'master' into async-reads
2021-08-25 00:45:40 +03:00
Azat Khuzhin
37043b74bf
Enable optimize_distributed_group_by_sharding_key by default
...
Since it requires optimize_skip_unused_shards this should be safe.
2021-08-24 23:49:50 +03:00
Vitaly Baranov
64f69462c6
Merge pull request #27921 from vitlibar/add-tests-for-field-init
...
Allow implicit cast bool to Field
2021-08-24 17:15:44 +03:00
kssenii
0d5000f917
Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into mysql
2021-08-24 07:30:42 +00:00
kssenii
b536653851
Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into disk-over-web-server
2021-08-24 07:29:50 +00:00
kssenii
962f415740
Add test and settings
2021-08-23 22:18:04 +00:00
Vitaly Baranov
63e8bc1f20
Added new commands BACKUP and RESTORE.
2021-08-23 23:41:45 +03:00
Alexander Tokmakov
cc9c2fd63b
make code better
2021-08-23 15:57:50 +03:00
Vitaly Baranov
89166a655a
Init SettingFieldBool with true or false, not with 1 or 0.
2021-08-23 09:47:36 +03:00
alexey-milovidov
4922fb791e
Merge pull request #27882 from azat/enable-tcp_keep_alive_timeout
...
RFC: Enable tcp_keep_alive_timeout by default
2021-08-21 22:39:12 +03:00
Kseniia Sumarokova
19afb22b4d
Merge pull request #27932 from amosbird/constkeys
...
Add a setting to bring back the old behavior of grouping by constant keys on empty set.
2021-08-21 08:02:30 +03:00
Kseniia Sumarokova
38a35c1d9e
Merge pull request #27530 from kssenii/col-identifier-as-col-number
...
Allow positional arguments for group by, order by, limit by
2021-08-20 21:08:58 +03:00
kssenii
945e2c4ce5
Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into disk-over-web-server
2021-08-20 18:01:23 +00:00
Amos Bird
5708ed42ec
Add setting.
...
empty_result_for_aggregation_by_constant_keys_on_empty_set
2021-08-20 22:34:32 +08:00
Anton Popov
61239343e3
Merge remote-tracking branch 'origin/sparse-serialization' into HEAD
2021-08-20 16:33:30 +03:00
Alexander Tokmakov
59eb3aa9a9
avoid too long waiting for inactive replicas
2021-08-20 15:59:57 +03:00
alexey-milovidov
6be085ed17
Update Settings.h
2021-08-20 09:05:48 +03:00
Azat Khuzhin
9aecb27913
Decrease tcp_keep_alive_timeout default (to avoid overlaps with receive_timeout)
2021-08-20 07:16:17 +03:00
Azat Khuzhin
d610974c4c
Set tcp_keep_alive_timeout to 300 by default
...
This may fix possible issues with remote queries, when remote server
abnormaly terminates and the initiator does not have proper timeout.
This should not harm anything, since the timeout is pretty huge (300
seconds).
2021-08-19 09:06:41 +03:00
alexey-milovidov
eb3bbdfab5
Merge pull request #27680 from ClickHouse/decimal-no-trailing-zeros
...
Remove trailing zeros from Decimal serialization #15794
2021-08-18 05:24:13 +03:00
Pavel Kruglov
7c98fc11b9
Fix performance, make only one setting
2021-08-16 14:30:56 +03:00
Alexey Milovidov
8adaef7c8e
Make text format for Decimal tuneable
2021-08-16 11:03:23 +03:00
Alexey Milovidov
d184b79bba
Progress on async reads.
2021-08-16 03:00:32 +03:00
kssenii
daac6323fa
Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into disk-over-web-server
2021-08-14 13:15:04 +00:00
mergify[bot]
319e5af6eb
Merge branch 'master' into short-circuit
2021-08-13 13:01:46 +00:00
Pavel Kruglov
36bea6abb4
Add setting optimize_short_circuit_function_evaluation
2021-08-13 14:48:32 +03:00
kssenii
37554014aa
Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into col-identifier-as-col-number
2021-08-13 05:28:22 +00:00
Nikita Mikhaylov
8c06abee73
Merge pull request #25902 from Avogar/arrow-nested
...
Refactor ArrowColumnToCHColumn, support inserting Nested as Array(Struct) in Arrow/ORC/Parquet
2021-08-12 20:02:01 +03:00
Kseniia Sumarokova
c50294fda8
Update Settings.h
2021-08-10 17:40:06 +03:00
kssenii
503a5edc59
Fix
2021-08-10 14:01:59 +00:00
kssenii
554231c6fc
Support positional arguments for GROUP BY, ORDER BY, LIMIT BY
2021-08-10 13:38:42 +00:00
Raúl Marín
d1d47658f5
Merge remote-tracking branch 'blessed/master' into materialization_log
2021-08-10 10:49:05 +02:00
Pavel Kruglov
a95d45a157
Some clean up
2021-08-09 17:57:02 +03:00
Pavel Kruglov
50d4192126
Implement short circuit function evaluation, first attempt
2021-08-09 17:43:10 +03:00
kssenii
d767f6704f
Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into disk-over-web-server
2021-08-09 12:14:23 +00:00
Nikita Mikhaylov
73d3f2c60f
Merge pull request #26313 from fastio/control_execution_period_of_clearOldTemporaryDirectories
...
Control the execution period of clear old temporary directories by parameter
2021-08-09 14:29:24 +03:00
alexey-milovidov
5f84564207
Merge pull request #27378 from amosbird/hyperscansanitizer
...
Add settings to check hyperscan regexp length.
2021-08-09 02:48:14 +03:00
alexey-milovidov
677fddaa37
Merge pull request #27104 from azat/enable-distributed_push_down_limit
...
Enable distributed_push_down_limit by default
2021-08-09 02:45:52 +03:00
Alexey Milovidov
e45a09e2f5
Fix wrong PR #27184
2021-08-08 21:09:39 +03:00
mergify[bot]
bd313279e8
Merge branch 'master' into hyperscansanitizer
2021-08-08 17:03:05 +00:00
Azat Khuzhin
0677a6c6cb
Enable distributed_push_down_limit by default
2021-08-08 19:30:50 +03:00
alexey-milovidov
5523e5e153
Update Settings.h
2021-08-07 18:48:52 +03:00
Amos Bird
5ef59d4828
Add setting to log formatted query into system.query_log
2021-08-07 14:26:38 +08:00
Amos Bird
aa33a7add1
Add settings to check hyperscan regexp length.
2021-08-07 13:07:41 +08:00
kssenii
073d7fdd5e
Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into disk-over-web-server
2021-08-06 19:42:29 +00:00
mergify[bot]
c696817a79
Merge branch 'master' into control_execution_period_of_clearOldTemporaryDirectories
2021-08-06 16:16:22 +00:00
Anton Popov
3a0d4807a5
Merge branch 'async-insert' of git://github.com/abyss7/ClickHouse into merging-20557
2021-08-06 16:20:02 +03:00
Raúl Marín
479f053f2e
Merge remote-tracking branch 'blessed/master' into materialization_log
2021-08-05 17:24:10 +02:00
Alexander Kuzmenkov
4bc652699f
Merge pull request #27184 from ClickHouse/aku/window-functions
...
mark window functions as ready for general use
2021-08-05 14:18:28 +03:00
Pavel Kruglov
e4c5d7e3b1
Support inserting nested as Array of structs, add some refactoring
2021-08-05 14:10:27 +03:00
Alexander Kuzmenkov
0730e685b0
Mark window functions ready for general use.
2021-08-04 17:45:32 +03:00
Anton Popov
e36736b50c
Merge remote-tracking branch 'origin/sparse-serialization' into HEAD
2021-08-02 22:52:02 +03:00
Raúl Marín
9f32ecca89
Merge remote-tracking branch 'blessed/master' into materialization_log
2021-08-02 16:21:10 +02:00
alesapin
181f93c60a
Merge pull request #24997 from evillique/nlp
...
NLP functions
2021-08-02 10:50:40 +03:00
alexey-milovidov
d2b7e23899
Merge pull request #26961 from Enmk/fix/extractAllGroupsHorizontal_max_matches_per_row
...
Updated extractAllGroupsHorizontal - flexible limit on number of matches
2021-07-31 04:54:24 +03:00
alesapin
02176fb4c7
Add experimental flag
2021-07-30 18:25:51 +03:00
alexey-milovidov
582fa31b18
Update Settings.h
2021-07-30 12:30:36 +03:00
Vasily Nemkov
a1fb16df52
setting regexp_max_matches_per_row instead of 3rd argument
2021-07-30 12:28:21 +03:00
Raúl Marín
6b9ec2a62e
WIP
2021-07-27 16:28:28 +02:00
Raúl Marín
efe1938437
WIP: Slow improvements
2021-07-27 16:26:29 +02:00
Raúl Marín
ea5c02a605
WIP
2021-07-27 16:26:27 +02:00
Alexander Tokmakov
63ab38ee09
rename MaterializeMySQL to MaterializedMySQL
2021-07-26 21:17:28 +03:00
hexiaoting
6b73fa5307
Fix style check errors
2021-07-23 10:57:34 +08:00
Maksim Kita
46fd046f11
Setting min_count_to_compile_aggregate_expression fix
2021-07-23 00:22:04 +03:00
hexiaoting
de30962ebd
Fuse multi quantile funcs with same arguments to one function.
2021-07-21 14:43:40 +08:00
Anton Popov
f99374cca6
Merge remote-tracking branch 'origin/sparse-serialization' into HEAD
2021-07-20 18:20:21 +03:00
Amos Bird
dbfb699690
Asynchronously drain connections.
2021-07-19 21:53:29 +08:00
alexey-milovidov
f481a5a28e
Merge pull request #26380 from ClickHouse/use-hedged-requests-again
...
Use hedged requests, again
2021-07-17 01:16:32 +03:00
alexey-milovidov
4103c22310
Merge pull request #26245 from arenadata/ADQM-322
...
Avro string for ClickHouse String
2021-07-16 12:23:50 +03:00
Alexey Milovidov
2d42b1ebf6
Use hedged requests, again
2021-07-15 19:43:42 +03:00
Peng Jian
4bc07771ee
Fix the clearOldTemporaryDirectories is executed too frequently
2021-07-14 19:26:46 +08:00
Alexey Milovidov
9dd0a76220
Add a setting "function_range_max_elements_in_block" and increase it 5 times
2021-07-14 11:31:08 +03:00
Ilya Golshtein
16532658c2
Avro string for ClickHouse string
2021-07-13 20:03:00 +03:00
Anton Popov
5d175bf557
dynamic columns: support distributed tables
2021-07-12 17:54:02 +03:00
mergify[bot]
b7ae4e4ced
Merge branch 'master' into async-insert
2021-07-12 09:21:37 +00:00
Maksim Kita
dc81ae7c6e
Compile AggregateFunctionBitwise
2021-07-10 01:51:34 +03:00
Anton Popov
e1afdc1f1e
dynamic subcolumns: add mode for DESCRIBE query to show deduced object types
2021-07-09 17:54:53 +03:00
Maksim Kita
577e69898a
Compile aggregate functions perf tests fix
2021-07-05 12:17:01 +03:00
alexey-milovidov
fef7c557f6
Merge pull request #24789 from kitaisreal/compile-aggregation-functions
...
Compile aggregate functions
2021-07-05 02:57:49 +03:00
Kseniia Sumarokova
8351f1db99
Merge pull request #20470 from kssenii/pg-ch-replica
...
MaterializePostgreSQL table engine and database engine
2021-07-04 19:34:54 +03:00
Kseniia Sumarokova
9b4d35ef95
Merge pull request #25940 from kssenii/move-to-prewhere-if-final
...
Add setting optimize_move_to_prewhere_if_final
2021-07-04 11:33:24 +03:00
alexey-milovidov
56d695cd12
Update Settings.h
2021-07-03 22:10:22 +03:00
Alexey Milovidov
127455f15f
Remove experimental ANTLR parser
2021-07-03 18:48:03 +03:00
kssenii
a9a91a4f15
Setting move to prewhere if final
2021-07-03 11:37:50 +00:00
Maksim Kita
da8c957167
Aggregator added CompiledExpressionCache
2021-07-01 22:56:36 +03:00
Maksim Kita
d24d3ae992
Added second variant of compilation
2021-07-01 22:56:36 +03:00
Maksim Kita
3fe559b31f
Compile aggregate functions
2021-07-01 22:56:35 +03:00
kssenii
9d5847a1a8
Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into pg-ch-replica
2021-06-29 21:30:31 +00:00
Ivan Lezhankin
1bb41593d1
Merge remote-tracking branch 'upstream/master' into async-insert
2021-06-28 22:55:56 +03:00
Maksim Kita
352e1f27ff
Update using Map datatyle in system log tables before merge
2021-06-28 14:42:21 +03:00
Maksim Kita
294b937a39
Merge branch 'system-query-log-map-type-merge' into system-querylog-map-continue
2021-06-28 11:27:59 +03:00
kssenii
aa7133c239
Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into pg-ch-replica
2021-06-27 20:08:00 +00:00
kssenii
c3a2fc0584
Review fixes
2021-06-27 19:17:17 +00:00
alexey-milovidov
0a26687115
Merge pull request #23864 from azat/dist-split-batch-and-retry
...
Add ability to split distributed batch on failures (i.e. due to memory limits)
2021-06-27 19:28:26 +03:00
kssenii
3d90f0710c
Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into pg-ch-replica
2021-06-26 22:04:47 +00:00
Azat Khuzhin
a0209178cc
Add ability to split distributed batch on failures
...
Add distributed_directory_monitor_split_batch_on_failure setting (OFF by
default), that will split the batch and send files one by one in case of
retriable errors.
v2: more error codes
2021-06-23 02:48:47 +03:00
Anton Popov
c2754c34f4
Merge remote-tracking branch 'upstream/master' into HEAD
2021-06-21 12:42:48 +03:00
Kruglov Pavel
a54cbef5b7
Merge pull request #24341 from Avogar/arrow
...
Support complex types in Arrow/Parquet/ORC
2021-06-21 11:05:57 +03:00
Anton Popov
e409ead64a
fix tests
2021-06-20 23:18:05 +03:00
Anton Popov
d8b6f15ef4
Merge pull request #23027 from azat/distributed-push-down-limit
...
Add ability to push down LIMIT for distributed queries
2021-06-20 23:08:50 +03:00
kssenii
f33387837e
Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into disk-over-web-server
2021-06-18 14:27:48 +00:00
mergify[bot]
c723dd7d40
Merge branch 'master' into arrow
2021-06-18 12:18:57 +00:00
Ivan Lezhankin
37365589ed
Merge branch 'master' into async-insert
2021-06-17 16:57:45 +03:00
Amos Bird
31815f4a68
Proper documentation of the setting
2021-06-17 14:27:33 +08:00
Amos Bird
c8ea6527cb
Add prefer_global_in_and_join setting
2021-06-17 14:27:29 +08:00
Anton Popov
8bd7cbd925
add compatibility setting for name of columns
2021-06-16 21:10:07 +03:00
Ivan Lezhankin
ba08a580f8
Add test
2021-06-16 17:33:14 +03:00
Ivan Lezhankin
b182d87d9c
Add settings for HTTP header limitations
2021-06-15 17:33:46 +03:00
Pavel Kruglov
a4decd0848
Support Map type, fix and add tests
2021-06-15 16:15:27 +03:00
Pavel Kruglov
c8b37977da
Fix bugs, support dictionary for Arrow format
2021-06-15 16:15:27 +03:00
kssenii
2cfcc9980c
Better
2021-06-13 19:38:31 +00:00
Ivan Lezhankin
2c7cb41a69
Merge remote-tracking branch 'upstream/master' into async-insert
2021-06-11 20:04:26 +03:00
Anton Popov
bb6f0dfbb8
Merge pull request #24406 from CurtizJ/rewrite-functions-to-subcolumns
...
Optimize some functions to subcolumns
2021-06-09 11:07:09 +03:00
Azat Khuzhin
18e8f0eb5e
Add ability to push down LIMIT for distributed queries
...
This way the remote nodes will not need to send all the rows, so this
will decrease network io and also this will make queries w/
optimize_aggregation_in_order=1/LIMIT X and w/o ORDER BY faster since it
initiator will not need to read all the rows, only first X (but note
that for this you need to your data to be sharded correctly or you may
get inaccurate results).
Note, that having lots of processing stages will increase the complexity
of interpreter (it is already not that clean and simple right now).
Although using separate QueryProcessingStage looks pretty natural.
Another option is to make WithMergeableStateAfterAggregation always, but
in this case you will not be able to disable only this optimization,
i.e. if there will be some issue with it.
v2: fix OFFSET
v3: convert 01814_distributed_push_down_limit test to .sh and add retries
v4: add test with OFFSET
v5: add new query stage into the bash completion
v6/tests: use LIMIT O,L syntax over LIMIT L OFFSET O since it is broken in ANTLR parser
https://clickhouse-test-reports.s3.yandex.net/23027/a18a06399b7aeacba7c50b5d1e981ada5df19745/functional_stateless_tests_(antlr_debug).html#fail1
v7/tests: set use_hedged_requests to 0, to avoid excessive log entries on retries
https://clickhouse-test-reports.s3.yandex.net/23027/a18a06399b7aeacba7c50b5d1e981ada5df19745/functional_stateless_tests_flaky_check_(address).html#fail1
2021-06-09 02:29:50 +03:00
Ivan Lezhankin
973cea73b7
Merge branch 'master' into async-insert
2021-06-08 15:10:30 +03:00
alesapin
5736eaf8fd
Increase background schedule pool default size
2021-06-08 13:55:14 +03:00
Alexey Milovidov
8d85145725
Remove experimental compression codecs
2021-06-06 02:26:52 +03:00
Alexey Milovidov
17962459f5
Merge branch 'master' into issue-16775
2021-06-06 02:18:28 +03:00
kssenii
e23bc14582
Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into pg-ch-replica
2021-06-03 19:44:55 +00:00
Vladimir
17f0900c31
Merge pull request #19766 from achimbab/pr_sequenceNextNode
2021-06-03 13:16:42 +03:00
alesapin
4a1bf51ad1
Merge branch 'master' into limited_fetches
2021-06-02 23:01:47 +03:00
Ivan Lezhankin
791cbcf0b1
Merge remote-tracking branch 'upstream/master' into async-insert
2021-06-02 18:50:37 +03:00
Ivan Lezhankin
84c23dc060
Merge branch 'master' into async-insert
2021-06-02 18:06:21 +03:00
vdimir
ec09dfe635
Set allow_experimental_funnel_functions = false by default (not used before)
2021-06-02 09:16:31 +03:00
vdimir
1b936c8af6
Remove example usage of allow_experimental_funnel_functions from windowFunnel
2021-06-02 09:16:21 +03:00
kssenii
12ea45e956
Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into pg-ch-replica
2021-06-01 17:43:34 +00:00
alesapin
c3321bef30
Merge branch 'master' into limited_fetches
2021-06-01 13:09:02 +03:00
Anton Popov
b24f65e1ad
Merge remote-tracking branch 'upstream/master' into HEAD
2021-05-31 23:04:52 +03:00
Alexey Milovidov
3791c1c99d
Someone added useful settings to the section with obsolete settings
2021-05-31 22:26:34 +03:00
Alexey Milovidov
4187aa444b
Fix typo. Remove "allow_experimental_bigint_types" setting.
2021-05-31 22:21:28 +03:00
Vxider
ac0468d389
Merged with master
2021-05-28 09:14:55 +00:00
Vxider
ad05f4f303
Merged with master
2021-05-28 07:36:19 +00:00
alesapin
42b2383e01
Basic throttler implementation
2021-05-26 23:37:44 +03:00
Vladimir
fc15cad7e0
Pass Settings to aggregate function creator
2021-05-26 14:58:31 +03:00
Vladimir
7224e25156
Revert "Pass Settings to aggregate function creator"
2021-05-26 14:46:42 +03:00
Vladimir
6650c67b01
Merge pull request #22762 from vdimir/create-aggregate-func-settings
2021-05-26 14:32:14 +03:00
Anton Popov
a36c1793d0
Merge remote-tracking branch 'upstream/master' into HEAD
2021-05-24 15:57:43 +03:00
Alexey Milovidov
6f70feed2f
Merge branch 'master' into issue-16775
2021-05-24 05:56:57 +03:00
kssenii
a78c9e63e7
Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into pg-ch-replica
2021-05-23 12:07:26 +00:00
Alexey Milovidov
e000b994e5
Add missing whitespace
2021-05-23 03:26:31 +03:00
alexey-milovidov
1ed30f7246
Merge branch 'master' into issue-16775
2021-05-22 17:14:23 +03:00
Anton Popov
13cfedd188
optimize some functions to subcolumns
2021-05-21 21:48:19 +03:00
Nikita Vasilev
9f2bcacb46
Merge remote-tracking branch 'upstream/master' into nikvas0/simple_optimizations
2021-05-20 19:34:11 +03:00
Maksim Kita
25fe0e88f8
Compile expressions added partition by test
2021-05-20 11:16:15 +03:00
Maksim Kita
b0476c1fa2
Merge pull request #24273 from kitaisreal/expression-actions-compile-only-necessary-places
...
ExpressionActions compile only necessary places
2021-05-20 10:53:30 +03:00
Maksim Kita
c50909468f
Updated ExpressionActionSettings
2021-05-19 17:32:07 +03:00
alesapin
301dc848f5
Merge branch 'master' into nvartolomei-parts-move
2021-05-19 17:17:01 +03:00
Alexander Kuzmenkov
e9b69bbd70
Merge pull request #23906 from azat/fix-distributed_group_by_no_merge
...
distributed_group_by_no_merge fixes
2021-05-19 16:16:08 +03:00
alesapin
17f229857c
Merge branch 'master' into nvartolomei-parts-move
2021-05-17 13:52:48 +03:00
kssenii
8a4711b716
Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into pg-ch-replica
2021-05-16 20:55:18 +00:00
Nikita Vasilev
6102ea643a
Merge remote-tracking branch 'upstream/master' into nikvas0/simple_optimizations
2021-05-16 19:51:41 +03:00
Azat Khuzhin
a44ddd2064
Update distributed_group_by_no_merge description
2021-05-15 15:03:13 +03:00
Alexander Kuzmenkov
5ed6a273d3
Merge pull request #24058 from ClickHouse/aku/uniq-two-level
...
lower two-level aggregation threshold for uniq test to avoid jitter
2021-05-14 15:50:48 +03:00
Alexander Kuzmenkov
6f16d92cfe
Update Settings.h
2021-05-14 15:50:30 +03:00
Alexander Kuzmenkov
220f5b512e
try even smaller value
2021-05-13 06:15:44 +03:00
kssenii
407db17e2e
Remove setting, use native transaction
2021-05-12 22:33:15 +00:00
kssenii
0955e5f0be
Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into pg-ch-replica
2021-05-12 15:11:15 +00:00
Alexander Kuzmenkov
f6cb9f95df
lower two-level aggregation threshold for uniq test to avoid jitter
2021-05-12 16:01:48 +03:00
alesapin
46e136b5c4
Merge branch 'master' into nv/parts-uuid-move-shard
2021-05-11 15:36:40 +03:00
Amos Bird
264cff6415
Projections
...
TODO (suggested by Nikolai)
1. Build query plan fro current query (inside storage::read) up to WithMergableState
2. Check, that plan is simple enough: Aggregating - Expression - Filter - ReadFromStorage (or simplier)
3. Check, that filter is the same as filter in projection, and also expression calculates the same aggregation keys as in projection
4. Return WithMergableState if projection applies
3 will be easier to do with ActionsDAG, cause it sees all functions, and dependencies are direct (but it is possible with ExpressionActions also)
Also need to figure out how prewhere works for projections, and
row_filter_policies.
wip
2021-05-11 18:12:23 +08:00
vdimir
905e54a0af
Merge branch 'master' into create-aggregate-func-settings
2021-05-11 11:18:24 +03:00
Nikita Vasilev
af9f811ab5
Merge remote-tracking branch 'upstream/master' into nikvas0/simple_optimizations
2021-05-10 22:08:58 +03:00
kssenii
5c24f0943c
Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into pg-ch-replica
2021-05-08 14:54:44 +00:00
Maksim Kita
9daf5b8308
Updated Settings
2021-05-08 17:39:34 +03:00
kssenii
912878ad7f
Review fixes
2021-05-07 12:05:34 +00:00
kssenii
8662078b35
Review fixes
2021-05-07 09:55:18 +00:00
hexiaoting
a1d521902c
Merge remote-tracking branch 'origin/master' into dev-continue-sundyli
2021-05-07 14:22:53 +08:00
fibersel
cb53bbb7b0
add experimental codecs flag, add integration test for experimental codecs
2021-05-06 14:57:22 +03:00
kssenii
7643d84095
Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into pg-ch-replica
2021-04-30 22:02:51 +00:00
Nikita Vasilev
e565bc47a8
settings off
2021-04-30 12:34:00 +03:00
Nicolae Vartolomei
1fa5871ff7
Fix bad rebase and introduce part_moves_between_shards_enable setting
2021-04-27 14:20:13 +01:00
Nicolae Vartolomei
53d57ffb52
Part movement between shards
...
Integrate query deduplication from #17348
2021-04-27 14:20:12 +01:00
Nikolai Kochetov
29fd51e37d
Enable async_socket_for_remote
2021-04-27 13:30:12 +03:00
Nikita Vasilev
0ec2726bf3
Merge remote-tracking branch 'upstream/master' into nikvas0/simple_optimizations
2021-04-26 17:33:32 +03:00
Vladimir
fd777bcd4b
Merge branch 'master' into create-aggregate-func-settings
2021-04-26 11:12:09 +03:00
kssenii
459612c895
Use a separate setting
2021-04-22 22:14:14 +00:00
Ivan Lezhankin
484528ba2c
Fix problem with use-after-free inside shared_ptr
2021-04-21 16:19:28 +03:00
Nikolai Kochetov
44112587d4
Merge pull request #23309 from ClickHouse/try-fix-crash-with-unknown-packet
...
Fix crash in case of unknown packet
2021-04-21 08:47:17 +03:00
alexey-milovidov
a311a5c0b5
Merge pull request #23322 from azat/disable-min_bytes_to_use_mmap_io
...
Disable min_bytes_to_use_mmap_io by default
2021-04-20 19:27:47 +03:00
Ivan
10c5ba3022
Merge branch 'master' into async-insert
2021-04-20 17:58:15 +03:00
Nikolai Kochetov
ecb2a96af8
Revert "Enable async_socket_for_remote"
...
This reverts commit ff908baa06
2021-04-20 17:14:54 +03:00
Nikita Mikhaylov
f55eacee7d
Merge pull request #22988 from excitoon-favorites/s3connectionresetretries
...
Retries on HTTP connection drops during reads from S3
2021-04-20 14:59:21 +03:00
Kseniia Sumarokova
b43656bf89
Merge pull request #22697 from TCeason/feature/add_MaterializeMySQL_sync_bytes_judgment
...
Add MySQL read history data bytes judgment
2021-04-20 10:26:42 +03:00
Azat Khuzhin
6fba6f7ddd
Disable min_bytes_to_use_mmap_io by default
...
Reading files using mmap() does not have any significant benefits over
plain read() [1].
[1]: https://gist.github.com/azat/3d6c8d82bdd91e7a38d997fd6bcfd574
And not only it does not have significant benefits, it also has some
issues, due to max_server_memory_usage (default to 90% of available
RAM), since when you read files with mmap() eventually process RSS may
exceed max_server_memory_usage, and in this case any allocation will
fail (with "Memory limit exceeded (total)") error (yes kernel will
unload pages, but likely it will happens after queries will starting to
fail), like in this test [2].
[2]: https://gist.github.com/azat/4813489828162e6c2ce131963c6a1acb
TL;DR;
Note that there was also an idea to take those mmap()'ed regions in
memory tracking (#23211 ), but there are some drawbacks (since accounting
mmap() is tricky, first of all you need to account only once per inode
for file and plus kernel can unload some pages and those memory will not
be used by the server anymore).
And as an adddition to #23211 there was #23212 , that adds
max_bytes_to_use_mmap_io, but since mmap is not a subject for memory
accounting there is no need in it.
2021-04-20 00:25:16 +03:00
Ivan Lezhankin
a36596e303
Add settings
2021-04-19 22:16:34 +03:00
Ivan Lezhankin
7a88ca31cc
Merge branch 'master' into async-insert
2021-04-19 18:33:43 +03:00
Nikolai Kochetov
ff908baa06
Enable async_socket_for_remote
2021-04-19 17:31:46 +03:00
Nikolai Kochetov
0c23d44b99
Add test.
2021-04-19 17:12:08 +03:00
Alexander Kuzmenkov
2a4bcb6e3f
Merge pull request #23159 from ClickHouse/aku/merge-fusecount
...
merging sumCount fusion PR #21337
2021-04-19 16:47:13 +03:00
