Vitaly Baranov
1341b4b4de
Rename QueryInfo's field result_compression -> transport_compression_type and change its type for better consistency.
...
Make the previous field obsolete.
2022-02-10 02:46:05 +07:00
Alexey Milovidov
742620209a
static-files-disk-uploader: add mode to create symlinks
2022-02-09 03:50:50 +03:00
DF5HSE
e657219e01
Delete not used include
2022-02-08 12:40:44 +03:00
DF5HSE
c08bc7ad65
Merge branch 'master' of github.com:ClickHouse/ClickHouse into client-fault-tolerant-connection
2022-02-08 11:37:31 +03:00
Maksim Kita
1c461e9ed1
Merge pull request #34349 from bigo-sg/format_parse_options
...
Add options for clickhouse-format.
2022-02-08 00:50:04 +01:00
DF5HSE
b035ad7843
Fix error with IPv6 in host param and impove HostPort reading from input stream
2022-02-08 02:03:39 +03:00
DF5HSE
3cb433762b
Fix errors in build check
2022-02-08 02:03:39 +03:00
DF5HSE
3343a22788
Merge branch 'client-fault-tolerant-connection' of github.com:ManagedDatabases/ClickHouse into client-fault-tolerant-connection
2022-02-08 02:03:38 +03:00
Filippov Denis
226759b674
Update programs/client/Client.cpp
...
Fix `--host` parameter description
Co-authored-by: Kruglov Pavel <48961922+Avogar@users.noreply.github.com>
2022-02-08 02:03:38 +03:00
DF5HSE
18a777cc8b
Add function which gets port from configuration
2022-02-08 02:03:37 +03:00
DF5HSE
a9ff296960
Fix codestyle
2022-02-08 02:03:36 +03:00
DF5HSE
69e535fcb2
Merge branch 'master' of github.com:ClickHouse/ClickHouse into client-fault-tolerant-connection
2022-02-08 02:03:36 +03:00
DF5HSE
e780c1292d
Add tests, remove saving host in config
2022-02-08 02:03:35 +03:00
DF5HSE
19cf4e6dec
round robin connection on fail
2022-02-08 02:03:25 +03:00
Kruglov Pavel
f63455b7a2
Merge pull request #34117 from Avogar/local
...
Small improvement in schema inference from stdin in local
2022-02-07 10:47:14 +03:00
taiyang-li
26f2a0ef51
move clickhouse-format code from settings to format.cpp
2022-02-07 13:34:13 +08:00
taiyang-li
0c47dd4ec2
format override input-format
2022-02-06 12:17:03 +08:00
taiyang-li
caed1898b0
add options for clickhouse-format
2022-02-06 11:22:05 +08:00
alexey-milovidov
665fdc9187
Merge pull request #31257 from FArthur-cmd/merge_15765
...
Merge #15765
2022-02-04 00:39:57 +03:00
FArthur-cmd
73f579d71c
Comment dhParamsFile. It should be uncommented only if it has correct path
2022-02-03 13:31:52 +00:00
FArthur-cmd
f327e67232
correct config
2022-02-02 20:01:25 +00:00
Anton Popov
5bb1b3ce77
support async inserts in clickhouse-client for queries with inlined data
2022-02-02 20:59:37 +03:00
Azat Khuzhin
3b3635c6d5
Fix formatting error in logging messages
...
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-02-01 14:30:04 +03:00
Azat Khuzhin
bedf208cbd
Use fmt::runtime() for LOG_* for non constexpr
...
Here is oneliner:
$ gg 'LOG_\(DEBUG\|TRACE\|INFO\|TEST\|WARNING\|ERROR\|FATAL\)([^,]*, [a-zA-Z]' -- :*.cpp :*.h | cut -d: -f1 | sort -u | xargs -r sed -E -i 's#(LOG_[A-Z]*)\(([^,]*), ([A-Za-z][^,)]*)#\1(\2, fmt::runtime(\3)#'
Note, that I tried to do this with coccinelle (tool for semantic
patchin), but it cannot parse C++:
$ cat fmt.cocci
@@
expression log;
expression var;
@@
-LOG_DEBUG(log, var)
+LOG_DEBUG(log, fmt::runtime(var))
I've also tried to use some macros/templates magic to do this implicitly
in logger_useful.h, but I failed to do so, and apparently it is not
possible for now.
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
v2: manual fixes
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-02-01 14:30:03 +03:00
Amos Bird
ec7d367814
DiskLocal checker
...
Add DiskLocal checker so that ReplicatedMergeTree can recover data when some of its disks are broken.
2022-02-01 05:55:27 +08:00
FArthur-cmd
f20f2f6beb
fix test
2022-01-31 13:39:39 +00:00
FArthur-cmd
7811f5d599
try uncomment config
2022-01-31 11:18:57 +00:00
FArthur-cmd
cb4ad97d45
add test
2022-01-28 17:37:52 +00:00
avogar
8858b6bf86
Small improvement in schema inference from stdin in local
2022-01-28 19:17:35 +03:00
Kruglov Pavel
efa8775ea6
Merge pull request #33960 from Avogar/autodetect-format
...
Detect format and schema from stdin in clickhouse-local
2022-01-28 12:02:15 +03:00
Alexey Milovidov
ff31a2c9e0
Add symlinks to keeper
2022-01-27 01:23:18 +03:00
Filatenkov Artur
fcac77b918
Merge branch 'ClickHouse:master' into merge_15765
2022-01-25 23:21:24 +03:00
alesapin
b8c6481d4c
Fix clickhouse server start when replicated access storage depend on keeper
2022-01-25 16:40:12 +03:00
Filatenkov Artur
b5be9cbb0d
Merge branch 'ClickHouse:master' into merge_15765
2022-01-25 15:10:40 +03:00
Kruglov Pavel
b54bf18b27
Merge branch 'master' into stress-test
2022-01-25 14:35:42 +03:00
Kruglov Pavel
aa49a826b5
Try to fix tests
2022-01-25 14:11:02 +03:00
avogar
a82cdd4fb5
Fix tests
2022-01-25 10:55:09 +03:00
avogar
fed54e0204
Fix
2022-01-25 10:25:37 +03:00
Azat Khuzhin
4a0facd341
Remove MAKE_STATIC_LIBRARIES (in favor of USE_STATIC_LIBRARIES)
...
There is no more MAKE_*, so remove this alias.
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-01-24 17:28:33 +03:00
Filatenkov Artur
82b0fc0bd0
Merge branch 'master' into merge_15765
2022-01-24 13:38:53 +03:00
avogar
a20fdc210a
Add format autodetect in clickhouse-local
2022-01-20 15:55:28 +03:00
Azat Khuzhin
a6d482d3e1
Cleanup jemalloc contrib
2022-01-20 10:02:03 +03:00
Azat Khuzhin
e0e81b340d
Fix w/o ODBC build
2022-01-20 10:02:02 +03:00
Azat Khuzhin
a773e7ff01
Remove unbundled libpqxx support
2022-01-20 10:01:59 +03:00
Azat Khuzhin
b51bbde713
Remove unbundled odbc support
2022-01-20 10:01:59 +03:00
Azat Khuzhin
887af0a7e9
Remove unbundled nanodbc support
2022-01-20 10:01:59 +03:00
Azat Khuzhin
126aa4b65c
Remove unbundled base64 support
2022-01-20 10:01:58 +03:00
Azat Khuzhin
7496ed7fde
Remove unbundled gtest support
...
v2: Fix unit tests (do not rely on USE_GTEST)
2022-01-20 10:01:54 +03:00
Azat Khuzhin
5c32f6dd3e
Remove unbundled nuraft support
2022-01-20 08:47:16 +03:00
DF5HSE
fb2a45009a
Fix formatting
2022-01-20 00:44:37 +03:00
DF5HSE
c126afa93b
Fix formatting
2022-01-20 00:44:12 +03:00
DF5HSE
76769ac133
Fix formatting
2022-01-20 00:43:40 +03:00
DF5HSE
aa328fa4d8
Fix formatting
2022-01-20 00:42:29 +03:00
DF5HSE
a4a46be697
Revert changes in Client.h
2022-01-20 00:37:42 +03:00
DF5HSE
0d7e853614
Delete extra includes
2022-01-20 00:36:18 +03:00
DF5HSE
b46af3e0c4
Add list of '<host>:[<port>]' reading in --host param
2022-01-20 00:36:18 +03:00
DF5HSE
f6d50f6fd3
Add list of hosts reading
2022-01-20 00:15:11 +03:00
Dmitry Novik
4e612d0e1a
Merge branch 'master' into memory-overcommit
2022-01-18 23:33:29 +03:00
Kruglov Pavel
2295a07066
Merge pull request #33534 from azat/fwd-decl
...
RFC: Split headers, move SystemLog into module, more forward declarations
2022-01-18 17:22:49 +03:00
Dmitry Novik
c0970b75ee
Merge branch 'master' into memory-overcommit
2022-01-18 15:30:24 +03:00
Dmitry Novik
83c663e2d6
Cleanup after code review
2022-01-18 12:21:59 +00:00
alesapin
b2271cc2d9
Merge pull request #33288 from JackyWoo/add_lower_bound_session_timeout_to_keeper
...
Add lower bound session timeout to keeper
2022-01-17 14:06:15 +03:00
Kseniia Sumarokova
5da673c3a5
Merge pull request #31104 from bigo-sg/hive_table
...
Implement hive table engine
2022-01-14 09:39:17 +03:00
mergify[bot]
085492614b
Merge branch 'master' into add_lower_bound_session_timeout_to_keeper
2022-01-13 12:21:46 +00:00
taiyang-li
66813a3aa9
merge master
2022-01-12 16:56:29 +08:00
avogar
0ae0aa712b
Don't print exception twice in client in case of exception in parallel parsing
2022-01-11 18:37:07 +03:00
Azat Khuzhin
aee034a597
Use explicit template instantiation for SystemLog
...
- Move some code into module part to avoid dependency from IStorage in SystemLog
- Remove extra headers from SystemLog.h
- Rewrite some code that was relying on headers that was included by SystemLog.h
v2: rebase
v3: squash move into module part with explicit template instantiation
(to make each commit self compilable after rebase)
2022-01-10 22:01:41 +03:00
tavplubix
376709b249
Merge pull request #33305 from nvartolomei/nv/test-odbc
...
Add test for broken connection
2022-01-10 14:23:38 +03:00
Alexey Milovidov
f41f7b6b92
Fix error
2022-01-06 05:21:03 +03:00
Alexey Milovidov
75116c69c6
Better messages
2022-01-06 04:26:02 +03:00
Alexey Milovidov
5e6f1f1f5f
Add support for start
2022-01-06 04:08:56 +03:00
Alexey Milovidov
dba9bf0f29
Support for creating users
2022-01-06 02:30:41 +03:00
Alexey Milovidov
269aa9404b
Maybe better
2022-01-05 22:59:22 +03:00
Alexey Milovidov
0139820ac4
Improve install on FreeBSD #33384
2022-01-05 22:33:02 +03:00
Nicolae Vartolomei
50e6f729d1
Try ping connection on unexpected errors
...
Workaround for
https://www.postgresql.org/message-id/CAC5UznEsaG75-Q89z4Ypz1q48UT7O%2B1U7drUPt6Xs%2Bma9_hEGQ%40mail.gmail.com
2022-01-05 16:26:28 +00:00
taiyang-li
8e675e9e0a
fix building
2022-01-04 15:06:19 +08:00
taiyang-li
1e102bc1b2
merge master
2022-01-01 09:01:06 +08:00
Azat Khuzhin
0685fd9985
clickhouse-local: track memory under --max_memory_usage_in_client option
2021-12-31 11:06:15 +03:00
JackyWoo
569ce62e8d
use session_timeout as session timeout uper bound
2021-12-30 17:18:51 +08:00
JackyWoo
19b5394be8
fix tests
2021-12-30 15:49:48 +08:00
Alexey Milovidov
7067fafd76
Reimplement #33054
2021-12-29 22:09:07 +03:00
Kruglov Pavel
489a30859f
Merge pull request #32455 from Avogar/schema-inference
...
Automatic schema inference for input formats
2021-12-29 21:03:48 +03:00
Mikhail f. Shiryaev
272ea7fc5b
Merge pull request #32609 from cmsxbc/query-kind-concurent_restriction
...
add settings: max_concurrent_select_queries and max_concurrent_insert_queries
2021-12-29 15:23:45 +01:00
JackyWoo
d35e5f8319
add lower bound session timeout to keeper
2021-12-29 20:59:01 +08:00
mergify[bot]
5070784282
Merge branch 'master' into memory-overcommit
2021-12-29 10:35:32 +00:00
avogar
8112a71233
Implement schema inference for most input formats
2021-12-29 12:18:56 +03:00
taiyang-li
aa97634d9b
merge master
2021-12-28 18:38:50 +08:00
Vladimir C
bb6fc853e3
Merge pull request #31442 from vdimir/cluster-discovery
2021-12-28 10:53:30 +03:00
alesapin
2f9d5af14e
Fix clang tidy
2021-12-27 19:54:14 +03:00
vdimir
fbdb5c60bd
initial initialization of cluster discovery in main thread
2021-12-27 15:26:10 +03:00
vdimir
7404205f37
fix cluster discovery startup race
2021-12-27 15:26:09 +03:00
vdimir
e7d3dbeebd
cluster discovery init only with zookeeper
2021-12-27 15:26:08 +03:00
vdimir
94bb7cba62
cluster discovery wip
2021-12-27 15:26:05 +03:00
Vitaly Baranov
f80a3e3247
Merge pull request #30549 from aiven/kmichel-server-reload
...
Start/stop servers when `listen_host`/`*_port` changes
2021-12-27 14:51:00 +03:00
taiyang-li
dd882085d0
Merge branch 'hive_table' of https://github.com/bigo-sg/ClickHouse into bigo_hive_table
2021-12-27 15:14:43 +08:00
taiyang-li
9036b18c2f
merge master
2021-12-27 15:12:48 +08:00
kssenii
38ca791465
Fix
2021-12-25 22:00:28 +03:00
Alexey Milovidov
d4debd115d
Remove unused code
2021-12-24 15:37:40 +03:00
Alexey Milovidov
29d28c531f
Move code around to avoid dlsym on Musl
2021-12-24 12:25:27 +03:00
Kevin Michel
ffc1fca296
Start/stop servers when listen_host/*_port changes
...
This allows starting and stopping separately each protocol server
without restarting ClickHouse.
This also allows adding or removing `listen_host` entries, which
start and stops servers for all enabled ports.
When stopping a server, the listening socket is immediately closed
(and available for another server).
Protocols with persistent connections try to wait for any currently
running query to finish before closing the connection, but idle
connection are closed quickly (depending on how often the protocol
is polled).
An extra ProfileEvent is added, `MainConfigLoads`, it is
incremented every time the configuration is reloaded. This helps
when trying to assess whether the new configuration was applied.
2021-12-24 08:26:02 +01:00
mergify[bot]
d4ec469ed1
Merge branch 'master' into query-kind-concurent_restriction
2021-12-24 07:02:00 +00:00
Kruglov Pavel
ffb6c5b37b
Merge branch 'master' into stress-test
2021-12-23 20:14:15 +03:00
lgbo-ustc
ccc39bad80
move IRemoteFileMetadata info Storages/Cache
2021-12-23 15:56:33 +08:00
lgbo-ustc
d205f9ecab
codes refactor
2021-12-23 11:50:26 +08:00
taiyang-li
2597925724
merge master
2021-12-21 15:55:39 +08:00
lgbo-ustc
71353ceede
refactor metadata class factory
2021-12-20 20:33:41 +08:00
alesapin
6bd7e425c6
Merge pull request #22535 from CurtizJ/sparse-serialization
...
Sparse serialization and ColumnSparse
2021-12-17 15:26:17 +03:00
taiyang-li
d033fc4c24
merge master and fix conflict
2021-12-17 15:11:21 +08:00
alexey-milovidov
6cb54b4092
Merge pull request #31965 from azat/connection-drain-pull
...
Add ability to drain connections synchronously
2021-12-16 23:40:31 +03:00
mergify[bot]
cc3176d437
Merge branch 'master' into memory-overcommit
2021-12-16 12:44:50 +00:00
Kseniia Sumarokova
b5472d6d99
Update LocalServer.cpp
2021-12-15 12:42:07 +03:00
Anton Popov
16312e7e4a
Merge remote-tracking branch 'upstream/master' into HEAD
2021-12-14 18:58:17 +03:00
taiyang-li
ca3f7425a4
fix code
2021-12-14 17:37:31 +08:00
cmsxbc
b30e250eed
add max_concurrent_select_queries and max_concurrent_insert_queries
2021-12-14 07:37:38 +00:00
Azat Khuzhin
15bc4c0ca8
Add max_threads_for_connection_collector example and description into config
2021-12-14 10:18:57 +03:00
mergify[bot]
b81d600c1e
Merge branch 'master' into memory-overcommit
2021-12-12 23:01:56 +00:00
李扬
8675086104
Merge branch 'master' into hive_table
2021-12-12 09:01:46 -06:00
Azat Khuzhin
57c027be0e
Remove arcadia build support
2021-12-11 21:25:23 +03:00
Azat Khuzhin
fa6090f588
Fix processing initial table (--table/stdin) in clickhouse-local
...
This patch will:
- fix the issue when table had been tried to create multiple times for
--queries-files
- create these table for --interactive mode (before it works only if you
had some queries already, i.e. when it run interactive after
non-interactive)
This will also make ClientBase interface a little bit cleaner, by
removing one abstract method getQueryTextPrefix()
2021-12-10 22:08:03 +03:00
taiyang-li
02b877c978
move remote buffer from src/IO to src/Storages
2021-12-10 10:27:53 +08:00
Kruglov Pavel
ef42cd6821
Merge pull request #32138 from Avogar/fix-apply-lambda
...
Fix 'APPLY lambda' parsing
2021-12-09 17:09:11 +03:00
Nikita Mikhaylov
dbf5091016
Parallel reading from replicas ( #29279 )
2021-12-09 13:39:28 +03:00
avogar
81d45dbf66
Fix possible crash in fuzzer
2021-12-08 21:29:50 +03:00
Anton Popov
d8367334a3
Merge remote-tracking branch 'upstream/master' into HEAD
2021-12-08 18:26:19 +03:00
Nikita Mikhaylov
c7f0a400d8
Typo
2021-12-07 10:31:48 +00:00
lgbo-ustc
5a8c56bd55
fixed erros on creating dir on startup
2021-12-07 16:35:08 +08:00
lgbo-ustc
b6c230606e
fixed config error in server startup
2021-12-07 14:46:17 +08:00
mergify[bot]
600dcb749a
Merge branch 'master' into memory-overcommit
2021-12-07 00:40:20 +00:00
Nikita Mikhaylov
80a146816c
More comments and style
2021-12-06 21:34:52 +00:00
Nikita Mikhaylov
fb24e7181f
Better
2021-12-06 18:27:06 +00:00
Nikita Mikhaylov
fa22fdc097
Merge branch 'master' of github.com:ClickHouse/ClickHouse into get_fuzz_data
2021-12-06 14:30:49 +00:00
taiyang-li
2f4e7e1d4e
merge master
2021-12-02 19:48:21 +08:00
Anton Popov
54f51444c0
Merge remote-tracking branch 'upstream/master' into HEAD
2021-12-01 15:49:02 +03:00
mergify[bot]
b4f43c59a2
Merge branch 'master' into stress-test
2021-12-01 10:12:22 +00:00
lgbo-ustc
aaa5d8f002
rewrite thread pool in remote file cache
2021-12-01 10:45:25 +08:00
alexey-milovidov
42787cfa60
Merge pull request #31802 from pkit/fix_setcap
...
fix setcap in docker
2021-11-30 05:49:03 +03:00
alexey-milovidov
a7de366741
Merge pull request #31957 from traceon/macos-fixes
...
Give some love to macOS platform
2021-11-30 04:15:32 +03:00
alesapin
525011db81
Merge pull request #31799 from ClickHouse/fix_default_keeper_port
...
Fix default keeper port
2021-11-29 16:31:36 +03:00
mergify[bot]
e6f5792ba3
Merge branch 'master' into stress-test
2021-11-29 09:01:33 +00:00
taiyang-li
c7a0fe467f
fix code stylke
2021-11-29 16:22:43 +08:00
Raúl Marín
b2cfa70541
Reduce dependencies on ASTFunction.h
...
481 -> 230
2021-11-26 18:21:54 +01:00
Denis Glazachev
b591cf49a3
Set permissions on config files under config.d/
...
Do not create config files under config.d/ if already exist
2021-11-26 19:21:29 +03:00
Raúl Marín
051dddd8df
Reduce dependencies on ASTIdentifier.h
...
Goes from rebuilding 483 objects to 165 when it's modified
2021-11-26 16:49:40 +01:00
taiyang-li
d35e2a1c83
Merge branch 'master' into hive_table
2021-11-26 11:44:50 +08:00
Denis Glazachev
e41ed7cc6e
Fix GCC compilation in macOS
2021-11-26 02:03:04 +03:00
Constantine Peresypkin
2f50642be9
fix setcap in docker
...
Fixes #31784
2021-11-25 16:24:24 +02:00
mergify[bot]
ce0c112586
Merge branch 'master' into stress-test
2021-11-25 11:09:26 +00:00
alesapin
dc6afadea3
Fix default keeper port
2021-11-25 14:01:30 +03:00
Kruglov Pavel
f28130193a
Merge branch 'master' into fix-whole-text-serialization
2021-11-25 14:00:20 +03:00
taiyang-li
72f60cceb9
Merge branch 'master' into hive_table
2021-11-25 17:33:26 +08:00
