vdimir
33a9189151
Merge remote-tracking branch 'upstream/master' into create-aggregate-func-settings
2021-04-15 13:41:21 +03:00
Vladimir Chebotarev
10bf56e540
Attempt to add retries to S3 reads.
2021-04-15 09:47:19 +03:00
Ivan
2b78765957
Merge branch 'master' into postgresql-protocol-with-row-policy
2021-04-14 14:50:28 +03:00
Nikita Mikhaylov
024374a2ec
review fixes
2021-04-13 22:39:43 +03:00
Nikita Mikhaylov
a743442a17
build fixes
2021-04-13 22:39:43 +03:00
Nikita Mikhaylov
c333c3dedb
review fixes
2021-04-13 22:39:42 +03:00
Nikita Mikhaylov
8a4b5a586e
fixed uuid
2021-04-13 22:39:42 +03:00
Nikita Mikhaylov
4843f86329
use only one connection between initiator and worker
2021-04-13 22:39:42 +03:00
Nikita Mikhaylov
31b4f9b17f
save
2021-04-13 22:39:41 +03:00
Nikita Mikhaylov
44ca65a9a4
save
2021-04-13 22:39:41 +03:00
alexey-milovidov
1945d01719
Merge pull request #21972 from kssenii/nanodbc
...
Switch to nanodbc
2021-04-13 12:23:57 +03:00
Maksim Kita
e687fc320f
Merge pull request #22997 from ClickHouse/increase-max-uri-size
...
Increase `max_uri_size` to 1 MiB by default
2021-04-13 11:26:23 +03:00
hexiaoting
77c460e8d1
Merge remote-tracking branch 'origin/master' into dev-sumcount
2021-04-13 11:14:14 +08:00
alexey-milovidov
d239c66fd3
Merge pull request #21511 from azat/optimize_skip_unused_shards-improvement
...
Rewrite IN in query for remote shards to exclude values that do not belong to the shard
2021-04-13 01:18:11 +03:00
alesapin
56f0e290de
Merge pull request #22945 from ClickHouse/increase-fetches-pool-size
...
More conservative value of `background_fetches_pool_size` setting
2021-04-12 22:41:04 +03:00
Alexey Milovidov
e260b2a60a
Increase max_uri_size to 1 MiB by default
2021-04-12 21:06:47 +03:00
vdimir
f2c109cc86
Merge branch 'master' into create-aggregate-func-settings
2021-04-12 11:38:20 +03:00
vdimir
f022f0744b
Add setting allow_experimental_funnel_functions and use in windowFunnel
2021-04-12 11:35:07 +03:00
Azat Khuzhin
fbb386dca5
Rewrite IN in query for remote shards to exclude values that does not belongs to shard
...
v2: fix optimize_skip_unused_shards_rewrite_in for sharding_key wrapped into function
v3: fix column name for optimize_skip_unused_shards_rewrite_in
v4: fix optimize_skip_unused_shards_rewrite_in with Null
v5:
- squash with Remove query argument for IStreamFactory::createForShard()
- use proper column after function execution (using sharding_key_column_name)
- update the test reference since (X) now is tuple(X)
2021-04-12 10:37:28 +03:00
kssenii
7a287e6fe9
Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into nanodbc
2021-04-11 21:36:08 +00:00
kssenii
792d57d630
Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into postgresql-protocol-with-row-policy
2021-04-11 21:10:33 +00:00
Ivan
495c6e03aa
Replace all Context references with std::weak_ptr ( #22297 )
...
* Replace all Context references with std::weak_ptr
* Fix shared context captured by value
* Fix build
* Fix Context with named sessions
* Fix copy context
* Fix gcc build
* Merge with master and fix build
* Fix gcc-9 build
2021-04-11 02:33:54 +03:00
Alexey Milovidov
173c0e5c43
More conservative value of background_fetches_pool_size
setting
2021-04-09 23:45:14 +03:00
Alexander Kuzmenkov
e44b3822e3
Merge pull request #21850 from fastio/handle_errors_for_kafka_engine
...
Handle errors for Kafka engine
2021-04-09 22:59:40 +03:00
Alexander Kuzmenkov
0264124146
Merge pull request #21942 from ucasFL/distributed_depth
...
Add settings max_distributed_depth
2021-04-09 15:52:58 +03:00
kssenii
72d89bc933
Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into nanodbc
2021-04-09 11:13:01 +00:00
kssenii
15ae912b56
Fix postgresql protocol with row policy
2021-04-07 12:56:09 +00:00
feng lv
78afb5b23c
fix
2021-04-07 01:58:57 +00:00
kssenii
0b39480d51
Better
2021-04-06 20:01:23 +00:00
Nikolai Kochetov
6102652c99
Merge branch 'master' into better-filter-push-down
2021-04-06 13:38:03 +03:00
Nikolai Kochetov
44700d97e9
Add setting to disable query plan optimization. Fix perftest.
2021-04-06 11:25:54 +03:00
kssenii
dc42d5189d
Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into replicas-shards-for-mysql-and-postgres
2021-04-05 15:36:35 +00:00
feng lv
f6e4e13f89
fix conflict
2021-04-05 14:08:30 +00:00
feng lv
56073db22d
max distributed depth
...
Add settings max_distributed_depth
fix style
fix
fix
fix
fix test
fix
fix
2021-04-05 14:00:54 +00:00
Alexey Milovidov
e50d82ab45
Merge branch 'master' into change-accurate-comparison
2021-04-05 01:38:55 +03:00
Alexey Milovidov
6e93d936d3
Highlight potential bugs in code
2021-04-05 01:38:47 +03:00
Alexey Milovidov
32f9a407ff
More precise and safe accurate comparison of int vs. float
2021-04-04 14:49:48 +03:00
Alexey Milovidov
d67ced585a
Fix engrish
2021-04-04 13:09:39 +03:00
kssenii
13d1f17d3e
Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into replicas-shards-for-mysql-and-postgres
2021-04-03 08:00:09 +00:00
kssenii
2de6b99f84
Better names
2021-04-02 16:12:14 +00:00
kssenii
99f0b08ac3
Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into replicas-shards-for-mysql-and-postgres
2021-04-01 13:48:33 +00:00
Ivan Lezhankin
cc1c439ad8
Merge remote-tracking branch 'upstream/master' into poco-http2
2021-04-01 16:20:15 +03:00
kssenii
2c70183652
Fix settings
2021-04-01 11:41:22 +00:00
Alexey Milovidov
e67d93d165
Merge branch 'master' into stress-oom
2021-04-01 01:43:40 +03:00
Peng Jian
86a76bbfe4
fix compilation error
2021-03-31 17:38:46 +08:00
Peng Jian
278d2d7df0
fix typo
2021-03-31 17:16:51 +08:00
Peng Jian
85cfb927e6
move HandleKafkaErrorMode to KafkaSettings
2021-03-31 17:16:51 +08:00
Peng Jian
909d5ad2b5
Handle errors for Kafka engine
2021-03-31 17:15:57 +08:00
alexey-milovidov
6ed78827a5
Merge pull request #22326 from ClickHouse/test-mmap-io
...
Run performance tests with enabled mmap IO
2021-03-31 06:33:56 +03:00
Alexey Milovidov
7b1890f0b3
Fix some OOMs in stress tests
2021-03-31 06:19:34 +03:00
kssenii
ce05087b1b
Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into replicas-shards-for-mysql-and-postgres
2021-03-30 17:27:10 +00:00
Amos Bird
69204e1d21
Add prefer_column_name_to_alias settings ( #22044 )
2021-03-30 16:51:45 +03:00
Ivan Lezhankin
873a98b33b
Add test
2021-03-30 16:19:05 +03:00
Alexey Milovidov
85e4cfa731
Run performance tests with enabled mmap IO
2021-03-30 00:04:03 +03:00
alexey-milovidov
25f02f13b0
Merge pull request #22238 from ClickHouse/remove-harmful-code
...
Remove harmful default parameters
2021-03-29 23:46:18 +03:00
tavplubix
3c0f5a57ec
Merge pull request #21535 from ClickHouse/distributed_ddl_improvements
...
Distributed DDL improvements
2021-03-29 22:40:11 +03:00
alexey-milovidov
9d84f3113a
Merge pull request #21512 from azat/optimize_skip_unused_shards_limit
...
Add optimize_skip_unused_shards_limit
2021-03-29 21:13:18 +03:00
Anton Popov
ea82e7725f
Merge pull request #21562 from CurtizJ/serialization-refactoring-4
...
Refactoring of data types serialization
2021-03-29 16:36:44 +03:00
alexey-milovidov
f90a328568
Merge pull request #22109 from azat/nested-epoll-wait
...
Disable async_socket_for_remote/use_hedged_requests for buggy linux kernels
2021-03-29 05:29:10 +03:00
Alexey Milovidov
003bd1a3c1
Whitespace
2021-03-29 04:08:21 +03:00
Alexey Milovidov
a0a3380d91
Remove useless headers
2021-03-28 22:46:45 +03:00
kssenii
c17748a0ba
Add proper settings
2021-03-27 21:57:35 +00:00
Azat Khuzhin
8e445c5e55
Disable async_socket_for_remote/use_hedged_requests for buggy linux kernels
...
async_socket_for_remote/use_hedged_requests uses nested epolls, which
may not be reliable in 5.5+ [1], but it has been fixed in shortly in
5.7+ [2] or
5.6.13+.
[1]: https://git.kernel.org/pub/scm/linux/kernel/git/torvalds/linux.git/commit/?id=339ddb53d373
[2]: https://git.kernel.org/pub/scm/linux/kernel/git/torvalds/linux.git/commit/?id=0c54a6a44bf3
2021-03-25 23:39:30 +03:00
Alexander Kuzmenkov
0675f9403c
Merge pull request #21895 from ClickHouse/aku/laglead
...
float RANGE OFFSET and lag/lead_in_frame
2021-03-25 23:00:22 +03:00
Anton Popov
6a15431be7
Merge remote-tracking branch 'upstream/master' into HEAD
2021-03-25 15:57:35 +03:00
tavplubix
48b89a0ace
Merge pull request #21998 from Avogar/hedged-test
...
Update tests for hedged requests
2021-03-23 18:18:49 +03:00
Alexander Kuzmenkov
c9facd631c
Merge remote-tracking branch 'origin/master' into HEAD
2021-03-23 17:40:13 +03:00
Alexander Kuzmenkov
d40f781b9a
Merge origin/master into tmp (using imerge)
2021-03-22 23:27:18 +03:00
Alexander Kuzmenkov
77a2f03d3b
prevent accidental reinterpret_cast in Field::get<>
2021-03-22 23:23:44 +03:00
Pavel Kruglov
dbc5018000
Update tests for hedged requests
2021-03-22 22:18:06 +03:00
Alexander Kuzmenkov
b0284f20c3
Merge branch 'master' into aku/laglead
2021-03-22 21:16:27 +03:00
Alexander Kuzmenkov
2f5dbf57b6
Merge pull request #21839 from kssenii/add-postgres-connection-pool
...
Add connection pool for postgres engine
2021-03-22 19:49:51 +03:00
tavplubix
5dfd0045a6
Merge branch 'master' into distributed_ddl_improvements
2021-03-22 18:13:19 +03:00
kssenii
3b32c8fe9a
Block on empty connection pool
2021-03-19 21:00:45 +00:00
Alexander Kuzmenkov
78c56b8913
Merge pull request #21886 from Avogar/hedged
...
Add profile event in hedged requests and change timeout from sec to ms.
2021-03-19 15:50:33 +03:00
Alexander Kuzmenkov
1beba597ca
Merge remote-tracking branch 'origin/master' into HEAD
2021-03-19 02:11:08 +03:00
Alexander Kuzmenkov
6aa9039f7d
float frames and lag/lead_in_frame
2021-03-19 02:05:43 +03:00
Pavel Kruglov
d380454044
Change read_data_timeout from sec to ms, add profile event for hedged requests and better process receiving packets
2021-03-18 20:16:17 +03:00
Alexander Kuzmenkov
f85b089292
Merge pull request #21466 from ClickHouse/aku/frame-formatting
...
add query formatting idempotence check to fuzzer
2021-03-18 17:57:11 +03:00
Anton Popov
173d2ea1f4
Merge remote-tracking branch 'upstream/master' into HEAD
2021-03-16 02:50:14 +03:00
Alexey Milovidov
eaeb4a3bf0
Merge branch 'master' into DateTime64_extended_range
2021-03-15 16:59:32 +03:00
tavplubix
6a265f468e
Merge branch 'master' into distributed_ddl_improvements
2021-03-15 11:24:14 +03:00
Alexey Milovidov
bbd6ac2d3a
Merge branch 'master' into add_postgresql_engine_docs
2021-03-14 14:22:56 +03:00
alexey-milovidov
53e21443eb
Merge branch 'master' into DateTime64_extended_range
2021-03-14 12:27:17 +03:00
Anton Popov
ed42437219
Merge remote-tracking branch 'upstream/master' into HEAD
2021-03-13 01:41:26 +03:00
Alexander Kuzmenkov
ec19b69d8c
Merge remote-tracking branch 'origin/master' into HEAD
2021-03-12 23:53:48 +03:00
Nikita Mikhaylov
e234990cf6
Merge pull request #19257 from nikitamikhaylov/geometry_functions
...
Merging geometry functions
2021-03-12 17:05:24 +03:00
Denis Glazachev
290a6d273e
Add Kerberos support for authenticating existing users when accessing over HTTP
2021-03-11 23:41:10 +03:00
Nikita Mikhailov
bf07c098a6
more checks of input type
2021-03-11 15:08:18 +03:00
tavplubix
26ebd54eaf
Merge pull request #20961 from havardk/reconnect
...
MaterializeMySQL: Attempt to reconnect to MySQL if the connection is lost
2021-03-10 20:07:11 +03:00
Vladimir
33dce1296b
Merge pull request #20392 from vdimir/cross-to-inner-join-rewrite
2021-03-10 09:53:55 +03:00
Alexander Tokmakov
4d19c84d90
Merge branch 'master' into distributed_ddl_improvements
2021-03-09 20:06:41 +03:00
Alexander Tokmakov
83b3e4e0f5
allow to use Cluster from Replicated db
2021-03-09 20:05:24 +03:00
Anton Popov
bc417cf54a
refactoring of serializations
2021-03-09 17:46:52 +03:00
vdimir
36006a7e96
Merge branch 'master' into cross-to-inner-join-rewrite
2021-03-09 09:36:15 +03:00
Alexander Tokmakov
163e27b299
support query and session settings for distributed DDL
2021-03-09 01:57:53 +03:00
Alexander Tokmakov
5070b5b85b
detach permanently setting for Replicated db
2021-03-09 00:34:52 +03:00
Alexander Tokmakov
2022b90919
configurable output mode for distributed DDL
2021-03-08 23:35:09 +03:00
Azat Khuzhin
16f4c02d42
Add optimize_skip_unused_shards_limit
...
Limit for number of sharding key values, turns off
optimize_skip_unused_shards if the limit is reached
2021-03-26 06:09:00 +03:00
Slach
5791cf5f2b
fix review comments https://github.com/ClickHouse/ClickHouse/pull/21078#discussion_r580413875 and https://github.com/ClickHouse/ClickHouse/pull/21078#discussion_r580410204
...
Signed-off-by: Slach <bloodjazman@gmail.com>
2021-03-08 03:39:24 +03:00
Anton Popov
562065732d
Merge remote-tracking branch 'upstream/master' into HEAD
2021-03-05 17:30:05 +03:00
Alexander Kuzmenkov
6b9d1f67a3
make NULL case consistent w/FieldVisitorToString
2021-03-05 10:05:27 +03:00
Ivan Lezhankin
5cfeedb1e0
Add setting http_max_uri_size
2021-03-04 15:21:23 +03:00
Haavard Kvaalen
641b1b249e
Attempt to reconnect to MySQL
...
For MaterializeMySQL databases, attempt to reconnect if the connection
to MySQL is lost. The existing setting
`max_wait_time_when_mysql_unavailable` is used to control how often we
attempt to reconnect. This setting can now be set to a negative value
to disable reconnects.
2021-03-04 08:49:06 +01:00
Haavard Kvaalen
11c9c8cb10
Reset sequence number on disconnect
...
Reestablishing the connection for an existing MySQLClient object would
never work because the sequence number would be wrong on the new
connection.
2021-03-04 08:49:06 +01:00
Alexey Milovidov
4e8239e098
Merge branch 'master' into DateTime64_extended_range
2021-03-03 23:43:20 +03:00
Pavel Kruglov
dc9dd8ccdc
Fix typo
2021-03-03 16:16:17 +03:00
hexiaoting
4fe75ad168
fix error
2021-03-03 17:18:53 +08:00
Pavel Kruglov
82a6be44cf
Disable changing replica when we have made progress
2021-03-03 01:03:03 +03:00
Pavel Kruglov
153bfbfc28
Merge branch 'master' of github.com:ClickHouse/ClickHouse into hedged-requests
2021-03-02 11:59:32 +03:00
hexiaoting
e116346cbb
Merge remote-tracking branch 'origin/master' into dev-sumcount
2021-03-02 10:11:50 +08:00
hexiaoting
16333e9f3a
Suppport fuse aggregate functions:sum/avg/count to sumCount
2021-03-01 18:04:34 +08:00
Pavel Kruglov
197058dc12
Merge branch 'master' of github.com:ClickHouse/ClickHouse into hedged-requests
2021-02-27 00:36:33 +03:00
Nikolai Kochetov
d91b8a3acb
Merge branch 'master' into filter-push-down
2021-02-26 19:33:27 +03:00
Nikolai Kochetov
d328bfa41f
Review fixes. Add setting max_optimizations_to_apply.
2021-02-26 19:29:56 +03:00
Vasily Nemkov
4fcc23ec9a
Fixed build for GCC-10
2021-02-24 17:08:43 +02:00
Vasily Nemkov
2d03d330bc
Extended range of DateTime64 to years 1925 - 2238
...
The Year 1925 is a starting point because most of the timezones
switched to saner (mostly 15-minutes based) offsets somewhere
during 1924 or before. And that significantly simplifies implementation.
2238 is to simplify arithmetics for sanitizing LUT index access;
there are less than 0x1ffff days from 1925.
* Extended DateLUTImpl internal LUT to 0x1ffff items, some of which
represent negative (pre-1970) time values.
As a collateral benefit, Date now correctly supports dates up to 2149
(instead of 2106).
* Added a new strong typedef ExtendedDayNum, which represents dates
pre-1970 and post 2149.
* Functions that used to return DayNum now return ExtendedDayNum.
* Refactored DateLUTImpl to untie DayNum from the dual role of being
a value and an index (due to negative time). Index is now a different
type LUTIndex with explicit conversion functions from DatNum, time_t,
and ExtendedDayNum.
* Updated DateLUTImpl to properly support values close to epoch start
(1970-01-01 00:00), including negative ones.
* Reduced resolution of DateLUTImpl::Values::time_at_offset_change
to multiple of 15-minutes to allow storing 64-bits of time_t in
DateLUTImpl::Value while keeping same size.
* Minor performance updates to DateLUTImpl when building month LUT
by skipping non-start-of-month days.
* Fixed extractTimeZoneFromFunctionArguments to work correctly
with DateTime64.
* New unit-tests and stateless integration tests for both DateTime
and DateTime64.
2021-02-24 17:08:35 +02:00
alexey-milovidov
50639b7dba
Merge pull request #21052 from ClickHouse/file-engine-settings
...
Merging #20620
2021-02-22 13:10:31 +03:00
Alexey Milovidov
46ac365629
Merge branch 'master' into topvisor/file-engine-settings
2021-02-21 23:10:26 +03:00
Alexey Milovidov
0a62f95bbe
Merge branch 'master' into distributed_aggregation_memory_efficient_by_default
2021-02-21 23:06:49 +03:00
Kruglov Pavel
815b4ff0d9
Merge branch 'master' into hedged-requests
2021-02-21 17:10:24 +03:00
alexey-milovidov
20a7ccf5b1
Merge pull request #20174 from amosbird/alias
...
Normalized function names (lower-case case-insensitive names)
2021-02-21 16:23:51 +03:00
Alexey Milovidov
64e76a4a8d
Minor changes in Decimal
2021-02-20 21:13:36 +03:00
tavplubix
a697b578bc
Merge pull request #16193 from ClickHouse/database_replicated
...
DatabaseReplicated: continuation of #10485
2021-02-20 19:39:34 +03:00
alexey-milovidov
b4196c8e68
Merge pull request #20168 from ClickHouse/in-memory-compression
...
Compression for Memory tables
2021-02-20 09:49:37 +03:00
Alexey Milovidov
1eb6f4743d
Merge branch 'master' into distributed_aggregation_memory_efficient_by_default
2021-02-20 09:40:31 +03:00
tavplubix
3509fe88d8
Merge pull request #20878 from ClickHouse/fix_18926
...
Fix COM_FIELD_LIST response in MySQL protocol
2021-02-19 19:25:54 +03:00
Ivan
414f470c79
Make Poco HTTP Server zero-copy again ( #19516 )
...
* Refactoring: part 1
* Refactoring: part 2
* Handle request using ReadBuffer interface
* Struggles with ReadBuffer's
* Fix URI parsing
* Implement parsing of multipart/form-data
* Check HTTP_LENGTH_REQUIRED before eof() or will hang
* Fix HTTPChunkedReadBuffer
* Fix build and style
* Fix test
* Resist double-eof
* Fix arcadian build
2021-02-19 15:51:26 +03:00
vdimir
e052a5a05e
Revert "Support old cross to inner join rewrite behaviour"
...
This reverts commit 527210b5e4
.
2021-02-19 15:14:24 +03:00
Alexander Tokmakov
97f4c457ec
fix MySQL COMM_FIELD_LIST response
2021-02-18 16:27:51 +03:00
Amos Bird
2c4bc43014
Backward compatible
2021-02-18 20:20:29 +08:00
Pavel Kruglov
1b78de2142
Use fibers in HedgedRequests
2021-02-17 20:34:52 +03:00
vdimir
527210b5e4
Support old cross to inner join rewrite behaviour
2021-02-17 12:44:53 +03:00
Alexey Milovidov
fa20016091
Enable distributed_aggregation_memory_efficient by default
2021-02-17 09:53:18 +03:00
vdimir
1680c8e73e
Merge remote-tracking branch 'upstream/master' into cross-to-inner-join-rewrite
2021-02-16 20:17:54 +03:00
M0r64n
75117389ec
Add a couple of QOL file engine settings
2021-02-16 18:50:11 +04:00
Alexander Tokmakov
bf6f64a3fb
Merge branch 'master' into database_replicated
2021-02-16 01:28:19 +03:00
vdimir
9afa6b5b1b
Add option cross_to_inner_join_rewrite
2021-02-15 22:40:32 +03:00
Kruglov Pavel
598576ce70
Merge branch 'master' into hedged-requests
2021-02-15 16:51:45 +03:00
Alexander Tokmakov
9c7cf9e92e
remove some debug code
2021-02-15 13:26:34 +03:00
Alexey Milovidov
ddb2cbcf6d
Merge branch 'master' into in-memory-compression
2021-02-14 04:32:41 +03:00
Ilya Yatsishin
8ff458a2bf
Merge pull request #20459 from ClickHouse/decimal-comparison-ubsan
2021-02-13 12:34:40 +03:00
Alexey Milovidov
1546f5bcb9
Suppress UBSan report in Decimal comparison
2021-02-13 03:54:38 +03:00
alesapin
5f32f65211
Merge branch 'master' into in_memory_raft
2021-02-11 23:09:29 +03:00
Alexey Milovidov
4d650a2a56
Adjust config
2021-02-11 16:41:21 +03:00
alexey-milovidov
263d751d64
Merge pull request #20169 from ClickHouse/no-excessive-squash-memory
...
Disable excessive squashing of blocks for StorageMemory #13052
2021-02-11 16:38:24 +03:00
Alexey Milovidov
d3dba0e52a
Merge branch 'master' into no-excessive-squash-memory
2021-02-10 23:45:12 +03:00
Amos Bird
fc6c57f8e0
Fix
2021-02-10 12:48:41 +08:00
Amos Bird
565a148da9
Normalize count() variants
2021-02-10 12:48:41 +08:00
alesapin
9667bdcbd2
Merge branch 'master' into in_memory_raft
2021-02-09 16:06:31 +03:00