Commit Graph

537 Commits

Author SHA1 Message Date
Yakov Olkhovskiy
3f3305a63a fix server settings 2024-06-26 04:33:52 +00:00
Yakov Olkhovskiy
6112ef710c fix style 2024-06-26 03:43:28 +00:00
Yakov Olkhovskiy
9eec834427 better chunked protocol negotiation, comments, review suggestions 2024-06-26 03:19:16 +00:00
Yakov Olkhovskiy
4240cb98fd
Merge branch 'master' into ft-chunked-protocol 2024-06-23 14:27:45 -04:00
avogar
785f3ac5c9 Revert unrelated changes 2024-06-21 18:40:49 +00:00
Arthur Passos
f55d15d9b9 Merge branch 'master' into multi_auth_methods 2024-06-21 15:39:02 -03:00
avogar
b9fbbbb284 Update settings changes history 2024-06-21 18:23:52 +00:00
avogar
3dfab50408 Merge branch 'master' of github.com:ClickHouse/ClickHouse into data-types-binary-encoding 2024-06-21 18:21:19 +00:00
avogar
b1f45da3eb Implement binary encoding for ClickHouse data types 2024-06-21 18:20:35 +00:00
Arthur Passos
179d54505a make progress, seems functional 2024-06-20 15:07:16 -03:00
Yarik Briukhovetskyi
a08f77850c
Merge pull request #61047 from yariks5s/balancing_transform
Implementing `BalancingTransform` for inserts
2024-06-19 11:37:17 +00:00
kssenii
fb32a99578 Initialize global trace collector for Poco::ThreadPool 2024-06-13 19:20:58 +02:00
yariks5s
4a72b36f28 Revert "Revert "roll back some changes""
This reverts commit 66a714e3ee.
2024-06-11 23:26:23 +00:00
yariks5s
66a714e3ee Revert "roll back some changes"
This reverts commit a54d679357.
2024-06-11 22:45:02 +00:00
yariks5s
a54d679357 roll back some changes 2024-06-11 18:46:09 +00:00
yariks5s
7b239f1102 fixes due to review 2024-06-11 17:36:49 +00:00
yariks5s
f5137c351c Merge branch 'balancing_transform' of https://github.com/yariks5s/ClickHouse into balancing_transform 2024-06-10 18:09:33 +00:00
yariks5s
68e1d8701c fixes due to review 2024-06-10 18:09:07 +00:00
Yakov Olkhovskiy
30a6b36395 Merge branch 'master' into ft-chunked-protocol 2024-06-09 21:39:48 +00:00
Yakov Olkhovskiy
a562118d2a major refactoring of chunked write buffer - more buffering, some bugs fixed 2024-06-07 01:45:56 +00:00
Yarik Briukhovetskyi
34d5c64900
Merge branch 'ClickHouse:master' into balancing_transform 2024-06-04 21:12:06 +02:00
Yakov Olkhovskiy
eaeabd8d37 fix typos 2024-06-02 13:03:48 +00:00
Yakov Olkhovskiy
f11f414910 fix special case of testing feature for chunked protocol 2024-06-02 07:25:48 +00:00
Yakov Olkhovskiy
fdccba97a3 set chunked for testing 2024-05-31 06:35:04 +00:00
yariks5s
84c8c4ca48 try to assign header unconditionally 2024-05-30 18:28:24 +00:00
yariks5s
5a09dce95d adding header in TCPHandler 2024-05-30 18:06:11 +00:00
yariks5s
826bec2575 added move constructor and removed unused parts 2024-05-30 16:33:48 +00:00
Sema Checherinda
3dbd290f21 Merge branch 'master' into chesema-dedup-matview 2024-05-28 18:33:00 +02:00
yariks5s
00b07bba14 remove squashing 2024-05-27 16:23:01 +00:00
yariks5s
e6f8338666 memory optimizations and removed unused parts 2024-05-24 20:38:45 +00:00
Yakov Olkhovskiy
94bc0a1e96 add config parameters and client arguments, make default notchunked_optional 2024-05-23 22:01:32 +00:00
yariks5s
d4ec6138c5 Merge branch 'yariks5s-balancing_transform' into balancing_transform 2024-05-23 13:47:28 +00:00
yariks5s
f3c4a25f3f Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into yariks5s-balancing_transform 2024-05-23 13:43:24 +00:00
Yakov Olkhovskiy
7ea6eb98b2 Merge branch 'master' into ft-chunked-protocol 2024-05-21 20:54:58 +00:00
Sema Checherinda
7fe1fe11b9 fixing tests 2024-05-21 17:07:52 +02:00
kssenii
7b225ab59c Merge remote-tracking branch 'origin/master' into use-iobject-storage-for-table-engines-1 2024-05-21 16:58:25 +02:00
Yakov Olkhovskiy
5308256c67 enable chunked before processing defaul database 2024-05-20 16:25:19 +00:00
yariks5s
8d235a4a39 remove trash from the code 2024-05-17 15:11:21 +00:00
Alexey Milovidov
26501178e6 Fix analyzer 2024-05-17 10:23:32 +02:00
yariks5s
fed6c65858 add setting to enable planning 2024-05-16 17:57:01 +00:00
Yakov Olkhovskiy
ee74d0de8c
Merge branch 'master' into ft-chunked-protocol 2024-05-15 16:56:10 -04:00
Yakov Olkhovskiy
05e823a1e9 add chunked wrapper to native protocol 2024-05-14 15:37:20 +00:00
kssenii
9ce465bb88 Merge remote-tracking branch 'origin/master' into use-iobject-storage-for-table-engines-1 2024-05-13 16:14:58 +02:00
yariks5s
a66a81efa3 merge 2024-05-10 11:21:40 +00:00
Alexey Milovidov
426a51b624 Useless changes 2024-05-10 04:53:29 +02:00
Alexey Milovidov
1d69518c4d Useless changes 2024-05-09 02:07:04 +02:00
yariks5s
e1ed0af3d2 Added pointer check, Chunk as argument to PlanSquashingTransform, fully refactored names of functions 2024-05-08 14:28:09 +00:00
kssenii
e9d9f2bc25 Merge remote-tracking branch 'origin/master' into use-iobject-storage-for-table-engines-1 2024-05-03 13:55:12 +02:00
Konstantin Bogdanov
273464c963
Merge pull request #63046 from ClickHouse/support-user-expiration
Check user expiration date before query execution
2024-04-30 17:42:58 +00:00
Konstantin Bogdanov
fccb463222
Rename 2024-04-30 16:07:51 +02:00
Konstantin Bogdanov
36014f739a
Rename 2024-04-30 14:52:43 +02:00
Nikita Taranov
8fd38f2abc
Merge pull request #62752 from ClickHouse/log_profile_events_send_timings
Log profile events send timings
2024-04-29 15:41:28 +00:00
kssenii
7a416f2e76 Merge remote-tracking branch 'origin/master' into use-iobject-storage-for-table-engines-1 2024-04-28 12:19:32 +02:00
Alexey Milovidov
58792a1935
Merge pull request #60302 from azat/INSERT-receive-timeout
Change back how receive_timeout is handled for INSERTs
2024-04-27 14:55:28 +00:00
Konstantin Bogdanov
822a57cb83
Fix integration tests 2024-04-26 19:56:24 +02:00
Konstantin Bogdanov
466633729f
Support user expiration 2024-04-26 17:03:40 +02:00
Alexander Gololobov
25cfd48f87
Only log if it took longer than 100 ms 2024-04-18 14:39:23 +01:00
Alexander Gololobov
01b80e754a Log profile events send timings 2024-04-18 11:37:09 +01:00
kssenii
27672e1dfc Merge remote-tracking branch 'origin/master' into use-iobject-storage-for-table-engines-1 2024-04-15 11:28:14 +01:00
Robert Schulze
9d8f643f5b
Cleanup SSH-based authentication code 2024-04-05 08:43:23 +00:00
kssenii
e0c02bf3af Merge remote-tracking branch 'origin/master' into use-iobject-storage-for-table-engines-1 2024-03-27 19:27:07 +01:00
Azat Khuzhin
b9469e2729 Do not try to INSERT into readonly replicas for Distributed engine
Sometimes replica may be readonly for a long time, and this will make
some INSERT queries fail, but it does not make sense to INSERT into
readonly replica, so let's ignore them.

But note, that this will require to extend TableStatus (not extend, but
introduce new version), that will have is_readonly field.

Also before background INSERT into Distributed does not uses
getManyChecked() which means that they do not request TableStatus
packet, while now they would, though this is minor (just a note).

v2: Add a note about max_replica_delay_for_distributed_queries for INSERT
v3: Skip read-only replicas for async INSERT into Distributed
v4: Remove extra @insert parameter for ConnectionPool*::get*
    It make sense only when the table name had passed --
    ConnectionPoolWithFailover::getManyChecked()
v5: rebase on top LoggerPtr
v6: rebase
v7: rebase
v8: move TryResult::is_readonly into the end

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-03-26 11:21:38 +01:00
kssenii
46941e7243 Merge remote-tracking branch 'origin/master' into use-iobject-storage-for-table-engines-1 2024-03-25 15:10:11 +01:00
Alexey Milovidov
d249d53de6 Remove DataStreams 2024-03-24 02:07:41 +01:00
Alexander Tokmakov
5d7e5e5a72 Merge branch 'master' into fix_race_async_inserts_queue 2024-03-19 19:39:25 +01:00
kssenii
bfc4f5e1d3 Merge remote-tracking branch 'origin/master' into use-iobject-storage-for-table-engines-1 2024-03-11 14:57:15 +01:00
Anton Popov
61859ee865
Merge pull request #61055 from CurtizJ/fix-async-insert-deadlock
Fix deadlock in async inserts to `Log` tables via native protocol
2024-03-08 11:36:49 +01:00
Nikita Mikhaylov
8e3fc1044f
Reject INSERT if async_insert=1 + deduplicate_blocks_in_dependent_materialized_views=1 (#60888) 2024-03-07 20:39:56 +01:00
Anton Popov
b9d6f4b3ed fix deadlock in async inserts via native protocol 2024-03-07 17:42:50 +00:00
kssenii
0c293bce11 Merge remote-tracking branch 'origin/master' into use-iobject-storage-for-table-engines-1 2024-03-06 12:06:19 +08:00
Alexey Milovidov
b0ab0b37db
Merge pull request #60434 from ClickHouse/revert-60216-revert-59697-check-stack-size-in-parser
Revert "Revert "Check stack size in Parser""
2024-02-28 19:20:49 +03:00
Alexey Milovidov
c192a448d0 Update to clang-19 2024-02-27 14:37:21 +01:00
Alexey Milovidov
0b90076a36
Revert "Revert "Check stack size in Parser"" 2024-02-27 01:34:50 +03:00
Azat Khuzhin
87fb8d187b Change back how receive_timeout is handled for INSERTs
Right now the receive_timeout for INSERT works as a timeout for
receiving data block, however this is not very convenient, since
sometimes server may not send data for quite some time (i.e. due to in
order aggregation), Ping packets is there for a reason (also Progress
and ProfileEvents as well, though the purpose is different).

Initially this special handling of receive_timeout had been added in
6a5ef9be83 ("dbms: fixed error with
hanging INSERTs [#METR-16514]"), but the behaviour was different, since
that time the receivePacket() was outside loop, only poll() was there,
and that was the workaround for poll() timeout (which does not triggers
the socket timeout).

But in fabd7193bd ("Code cleanups and
improvements"), receivePacket() had been moved into the loop, and so
this changed the behaviour of the timeout to current one.

Though all of this will not help for INSERT queries anyway, since there
are no Ping packets for them. Yet.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-02-22 14:26:21 +01:00
Antonio Andelic
fee1565780
Revert "Check stack size in Parser" 2024-02-21 11:33:08 +01:00
kssenii
e23b929e18 Merge remote-tracking branch 'origin/master' into use-iobject-storage-for-table-engines-1 2024-02-19 19:55:47 +01:00
Alexey Milovidov
6fd563df52 Miscellaneous 2024-02-19 02:58:51 +01:00
kssenii
1cccb3ccdf Merge remote-tracking branch 'origin/master' into use-iobject-storage-for-table-engines-1 2024-02-16 15:21:10 +01:00
Kruglov Pavel
4d6f167e0c
Merge pull request #59092 from Avogar/auto-format-detection
Try to detect file format automatically during schema inference if it's unknown
2024-02-16 14:32:18 +01:00
Julia Kartseva
b1b58ef9a3
Revert "Insert synchronously if dependent MV deduplication is enabled" 2024-02-14 12:54:42 -08:00
Kruglov Pavel
1dbfeafb42
Merge branch 'master' into auto-format-detection 2024-02-13 19:08:33 +01:00
kssenii
3cca841038 Unite s3/hdfs/azure storage implementations into a single class on top of IObjectStorage 2024-02-09 21:32:04 +01:00
Julia Kartseva
ece4febe32 Insert synchronously if dependent MV deduplication is enabled 2024-02-08 08:42:04 +00:00
Igor Nikonov
8c60c6b669 Use always host_name for profile events block 2024-02-02 14:27:09 +00:00
Igor Nikonov
4c75b4bc7c Return display name 2024-02-02 14:04:27 +00:00
Igor Nikonov
d8a6e53d0b Use FQDN as host name by default for TCP
- instead of display_name setting value
2024-01-30 20:27:30 +00:00
Kruglov Pavel
46a6b84a5a
Merge branch 'master' into auto-format-detection 2024-01-25 22:11:07 +01:00
Maksim Kita
2a327107b6 Updated implementation 2024-01-25 14:31:49 +03:00
avogar
617cc514b7 Try to detect file format automatically during schema inference if it's unknown 2024-01-23 18:59:39 +00:00
Alexander Tokmakov
4cfc8d1a34 better method name 2024-01-23 00:30:42 +01:00
Yakov Olkhovskiy
2e124b19b8
Merge branch 'master' into revert-58450-revert-56064-feature-server-iface-metrics 2024-01-10 09:05:18 -05:00
Robert Schulze
53965bb9f1
Merge remote-tracking branch 'rschu1ze/master' into qatzstd_main 2024-01-07 14:11:22 +00:00
Yakov Olkhovskiy
85f03478ef
Revert "Revert "Use CH Buffer for HTTP out stream, add metrics for interfaces"" 2024-01-03 11:47:15 -05:00
Raúl Marín
d491758939
Revert "Use CH Buffer for HTTP out stream, add metrics for interfaces" 2024-01-03 10:42:15 +01:00
Alexey Milovidov
aa462fa7cd
Merge branch 'master' into feature-server-iface-metrics 2023-12-29 22:37:52 +01:00
Azat Khuzhin
3be3b0a280 Fix incorrect Exceptions
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-12-24 21:26:32 +01:00
jinjunzh
aaf98f0ed7 refine setting with enable_zstd_qat_codec 2023-12-22 14:24:15 -05:00
Yakov Olkhovskiy
001a38048f use ProfileEvents instead of CurrentMetrics 2023-12-15 19:17:42 +00:00
Yakov Olkhovskiy
b92030b485
Merge branch 'master' into feature-server-iface-metrics 2023-11-27 15:44:25 -05:00
Antonio Andelic
c43b84c68d
Typo 2023-11-23 13:12:16 +01:00