János Benjamin Antal
7cad0050c0
Disambiguate alter commands list ( #59532 )
...
* Add optional parentheses to TTL element and alter command
* Add some basic tests
* Extend tests with more test cases
* Add one more test case
* Add server setting to control new formatting behavior
* Automatic style fix
* Fix segfault in `clickhouse-format` related to new server setting
* Remove format_ttl_expressions_with_parentheses
* Fix unit test compilation failures
* Introduce global flag to control the new formatting behavior
* Revert "Fix segfault in `clickhouse-format` related to new server setting"
This reverts commit d7131a3145
2024-02-22 19:17:15 +01:00
Kruglov Pavel
4d6f167e0c
Merge pull request #59092 from Avogar/auto-format-detection
...
Try to detect file format automatically during schema inference if it's unknown
2024-02-16 14:32:18 +01:00
Alexey Milovidov
2b4949bd18
Cleanups
2024-02-14 00:21:13 +01:00
Kruglov Pavel
1dbfeafb42
Merge branch 'master' into auto-format-detection
2024-02-13 19:08:33 +01:00
Azat Khuzhin
7fb31fe160
Remove ability to disable generic clickhouse components
...
Components like client/server/... are very generic, and there is no
point in disabling them, since it does not reduce amount of compiled
code a lot anyway (just a few modules for entrypoints, everything else
is already included in the clickhouse binary), and eventually they are
just symlinks to the clickhouse binary.
But there are few, that requires extra libraries, like ODBC bridge or
keeper components (and there is also standalone keeper binary compiled
with musl), those had been kept.
Also add some descriptions for some utils and change exit code to 0 for
--help.
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-02-12 11:10:00 +01:00
Kruglov Pavel
46a6b84a5a
Merge branch 'master' into auto-format-detection
2024-01-25 22:11:07 +01:00
Maksim Kita
2a327107b6
Updated implementation
2024-01-25 14:31:49 +03:00
avogar
48609d3c9f
Fix tests
2024-01-23 18:59:40 +00:00
avogar
617cc514b7
Try to detect file format automatically during schema inference if it's unknown
2024-01-23 18:59:39 +00:00
Kruglov Pavel
79b3e19eb1
Fix style
2024-01-17 14:54:18 +01:00
Kruglov Pavel
63ac1c784f
Fix possible crash in clickhouse-local during loading suggestions
2024-01-17 14:28:10 +01:00
Bharat Nallan
ee37f551a2
independent registration of interpreters ( #58443 )
...
* make interpreter factory an instance
* add registerInterpreter
* register interpreters individually
* try wire everything up
* fix style
* fix test
2024-01-08 22:33:48 -08:00
Kruglov Pavel
474d7abfda
Merge pull request #57774 from Avogar/local-default-database-name
...
Change default database name in clickhouse-local to 'default'
2024-01-02 15:29:45 +01:00
Alexey Milovidov
b752a1c62e
Merge pull request #58365 from bharatnc/ncb/refactor-db-factory
...
independent registration of database engines
2023-12-31 00:56:24 +01:00
Bharat Nallan Chakravarthy
6c4a4991e2
few more fixes
2023-12-30 09:26:53 -08:00
Bharat Nallan Chakravarthy
906745feaa
validation and left over fixes
2023-12-29 20:06:07 -08:00
Alexey Milovidov
39b239683c
Attach all system tables in clickhouse-local
2023-12-29 21:25:22 +01:00
Raúl Marín
e1b353d19e
Merge remote-tracking branch 'blessed/master' into local-default-database-name
2023-12-27 15:27:42 +01:00
Pradeep Chhetri
5899ee99bd
Add support for specifying query parameters in the command line in clickhouse-local
2023-12-24 18:07:26 +08:00
Raúl Marín
b840022d5a
Merge remote-tracking branch 'blessed/master' into local-default-database-name
2023-12-19 13:28:31 +01:00
Natalya Chizhonkova
3d51192bad
Refactoring for UserDefinedSQLObjectsLoader
2023-12-12 17:03:49 +03:00
avogar
6088536f3c
Remove outdated comment
2023-12-12 13:31:12 +00:00
avogar
6405bb4086
Change default database name in clickhouse-local to 'default'
2023-12-12 13:30:26 +00:00
Alexey Milovidov
02439eee58
Merge pull request #49351 from ClickHouse/async-loader-integration
...
Asynchronous loading of tables
2023-12-04 17:16:12 +01:00
Alexey Milovidov
b62e9d3a1a
Address review comments
2023-11-23 18:13:12 +01:00
serxa
0fc25fbda8
Merge branch 'master' into async-loader-integration
2023-11-23 09:32:43 +00:00
Nikolay Degterinsky
fd26fab07f
Merge remote-tracking branch 'upstream/master' into local-send-fatal-log
2023-11-19 17:59:51 +00:00
Nikolay Degterinsky
cf46214440
Always send fatal level logs
2023-11-19 15:09:52 +00:00
serxa
9023f61349
Merge branch 'master' into async-loader-integration
2023-11-19 13:05:58 +00:00
Nikolay Degterinsky
d1c56e3dab
Send fatal logs by default in clickhouse-local
2023-11-18 17:40:15 +00:00
Sema Checherinda
b9cc1580e0
Merge pull request #56367 from canhld94/ch_table_reinit_new_disk
...
Adding new disk to storage configuration without restart
2023-11-14 15:54:22 +01:00
Pradeep Chhetri
be1e061764
Use SSL port for clickhouse-client for hostnames pointing to clickhouse cloud
2023-11-13 10:31:56 +08:00
serxa
d50747847d
rework AsyncLoaderPoolId.h to match settings and metrics
2023-11-06 13:08:27 +00:00
Duc Canh Le
4c21ba7b6f
tables auto initialize new disks without restart
...
Signed-off-by: Duc Canh Le <duccanh.le@ahrefs.com>
2023-11-06 10:26:48 +00:00
serxa
749cdb9954
Merge branch 'master' into async-loader-integration
2023-10-24 10:09:49 +00:00
Azat Khuzhin
4cb3de3110
Add pager property into ClientBase
...
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-10-16 22:31:55 +02:00
Azat Khuzhin
3257d5643d
Move adjusting input_format_values_allow_data_after_semicolon into the client base
...
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-10-16 22:31:55 +02:00
serxa
0e17da22eb
Merge branch 'master' into async-loader-integration
2023-10-16 11:08:29 +00:00
Azat Khuzhin
2cbb069b68
Add ability to ignore data after semicolon in Values format
...
This is required for client, to handle comments in multiquery mode.
v0: separate context for input format
v2: cannot use separate context since params and stuff are changed in global context
v3: do not sent this setting to the server (breaks queries for readonly profiles)
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-10-12 14:55:26 +02:00
Michael Kolupaev
fa51399ede
Make clickhouse-local logging (server_logs_file) prepend timestamps etc
2023-09-19 21:39:59 +00:00
Kruglov Pavel
8d01137d73
Merge pull request #54498 from bakam412/bugfix/local_multiquery_parameter
...
Bugfix/local multiquery parameter
2023-09-15 11:46:08 +02:00
Sergei Trifonov
12c71be9ca
Merge branch 'master' into async-loader-integration
2023-09-14 15:29:07 +02:00
bakam412
7f52704383
Fix local_multiquery_parameter and fix unit tests
2023-09-13 10:02:14 +08:00
vdimir
aea9ac7de2
Merge pull request #54503 from ClickHouse/vdimir/local_database_arg
...
clickhouse-local support --database command line argument
2023-09-12 11:40:40 +02:00
vdimir
5061da4e8a
clickhouse-local support --database command line argument
2023-09-11 12:12:02 +00:00
Robert Schulze
bff06d18aa
Merge pull request #54249 from rschu1ze/multiple_query_arguments
...
Allow multiple `--query` parameters in clickhouse-client/local.
2023-09-07 21:20:07 +02:00
Robert Schulze
11fea581bc
Fix tests
2023-09-04 15:34:42 +00:00
Yakov Olkhovskiy
d513ceaef5
fix
2023-09-04 13:14:12 +00:00
Yakov Olkhovskiy
361b21b416
fix fuzzers, cmake refactor, add target fuzzers
2023-09-01 14:20:50 +00:00
Sergei Trifonov
c10e42ca05
Merge branch 'master' into async-loader-integration
2023-08-28 20:20:31 +02:00
Robert Schulze
b70f3dbe41
Same variable name in LocalServer.cpp as in Server.cpp
2023-08-22 15:44:26 +00:00
Robert Schulze
f2fb7365e6
Add settings for 1. size_ratio (all caches) and 2. policy (index caches)
...
1. is an expert-level setting, default is 0.5, applies only to SLRU.
Also, I noticed that we expose cache policy settings for the mark and
the uncompresed cache but not for the index mark and the index
uncompressed cache. Changed that as well, it simplifies the code a bit.
2023-08-22 11:04:29 +00:00
Robert Schulze
96c8b250ce
Allow to configure cache sizes at runtime
2023-08-21 13:51:10 +00:00
Robert Schulze
8343ebd4ec
Clarify comment
2023-08-15 14:44:13 +00:00
Robert Schulze
ed90463888
Add comment
2023-08-14 15:42:32 +00:00
Robert Schulze
bb53d635df
More consistency: Run same mark cache size check in ch-local
...
Server.cpp had a check that the configured mark cache size is not 0. Run
the same check in LocalServer.cpp.
2023-08-14 15:42:32 +00:00
Robert Schulze
f126e54b0d
Respect max_cache_size for all caches
...
So far, max_cache_size was only respected in Server.cpp, and in this
file only for the mark cache and the uncompressed cache. This commit
respects it also for the other cache types in Server.cpp, as well for
all caches in LocalServer.cpp.
2023-08-14 15:42:32 +00:00
Robert Schulze
54e54aed74
Cosmetics: Introduce constants for default cache sizes and policies
2023-08-14 15:42:32 +00:00
Sergei Trifonov
e4ae2ece7c
Merge branch 'master' into async-loader-integration
2023-08-01 13:04:11 +02:00
Alexey Milovidov
a465dba311
Merge pull request #52628 from ClickHouse/load-suggestion-only-with-clickhouse-dialect
...
Load suggestion only with `clickhouse` dialect
2023-07-28 10:21:53 +03:00
Yakov Olkhovskiy
d35c87c1bd
allow positional options for clickhouse-local and populate global udf settings
2023-07-27 05:06:16 +00:00
János Benjamin Antal
3a6aaa29c9
Do not load suggestions in case not ClickHouse dialects
2023-07-26 15:26:21 +00:00
Sergei Trifonov
8eaf3b6d94
Merge branch 'master' into async-loader-integration
2023-07-21 21:46:06 +02:00
serxa
02fc66db10
avoid using bg pool during non-async start
2023-07-19 17:37:53 +00:00
serxa
6bca79fdff
add auto-resolution for all resolvable deadlock types
2023-07-19 16:19:28 +00:00
Sergei Trifonov
850ab23991
Merge branch 'master' into async-loader-integration
2023-07-17 19:14:54 +02:00
Vitaly Baranov
815a3857de
Remove non-const function Context::getClientInfo().
2023-07-17 15:02:07 +02:00
Alexey Milovidov
1a24bface0
Merge branch 'master' into clickhouse-local-default-settings
2023-07-06 03:30:11 +03:00
Azat Khuzhin
59f11863d7
Simplify settings overrides or clickhouse-local
...
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-06-24 23:42:31 +03:00
kssenii
0efaecab51
Revert "Merge pull request #51149 from ClickHouse/revert-48821-localfilefunction"
...
This reverts commit a09e6bbb8ece38d64c5a
2023-06-21 00:29:46 +02:00
Alexander Tokmakov
caceb7c862
Revert "Added ability to implicitly use file/hdfs/s3 table functions in clickhouse-local"
2023-06-19 13:21:09 +03:00
Alexey Milovidov
df9abccfaa
Merge branch 'master' into localfilefunction
2023-06-17 00:45:54 +03:00
Sergei Trifonov
0cbcff958a
Merge branch 'master' into async-loader-integration
2023-06-07 18:55:04 +02:00
Nikita Mikhaylov
e87348010d
Rework loading and removing of data parts for MergeTree tables. ( #49474 )
...
Co-authored-by: Sergei Trifonov <sergei@clickhouse.com>
2023-06-06 14:42:56 +02:00
Sergei Trifonov
3ee782a0ec
Merge branch 'master' into async-loader-integration
2023-06-02 18:27:19 +02:00
serxa
866c9df70b
fix clickhouse-local
2023-06-02 16:26:55 +00:00
Nikita Mikhaylov
73db383727
Limit the number of in-flight tasks for loading outdated parts ( #50450 )
...
* Done
* Update programs/local/LocalServer.cpp
Co-authored-by: Alexander Tokmakov <tavplubix@clickhouse.com>
* Bump
---------
Co-authored-by: Alexander Tokmakov <tavplubix@clickhouse.com>
2023-06-02 14:10:26 +02:00
Alexey Gerasimchuck
8574559e23
Disallow usage of --query and --queries-file
2023-05-28 22:25:40 +00:00
Sergei Trifonov
fe172f59db
Merge branch 'master' into async-loader-integration
2023-05-26 18:56:08 +02:00
alekseygolub
34fe8ba5cd
Merge branch 'ClickHouse:master' into localfilefunction
2023-05-24 09:49:03 +03:00
Alexey Gerasimchuck
ab5e16a713
Changes after second review iteration
2023-05-23 00:27:17 +00:00
alekseygolub
70b9077bb2
Merge branch 'ClickHouse:master' into localfilefunction
2023-05-21 17:49:29 +03:00
Alexey Gerasimchuck
4a6c7254e8
--multiquery <sql> -> -n -q <sql> syntax sugar
2023-05-17 03:43:35 +00:00
serxa
9bf5292415
refact
2023-05-12 19:49:47 +00:00
Sergei Trifonov
b479637e2c
Merge branch 'master' into async-loader-integration
2023-05-09 13:04:36 +02:00
Nikita Mikhaylov
954e3b724c
Speedup outdated parts loading ( #49317 )
2023-05-03 18:56:45 +02:00
alekseygolub
58cb6c7837
S3, HDFS only for explicit creation
2023-05-02 19:57:36 +00:00
serxa
6eda6e8585
implement async loading interface in database engines
2023-05-02 09:18:50 +00:00
alekseygolub
95522ad7a6
Added DatabaseHDFS
2023-05-01 21:46:17 +00:00
Sergei Trifonov
8dab49f328
Merge branch 'master' into async-loader-integration
2023-05-01 14:04:39 +02:00
serxa
abaf73268b
integrate with Server and TablesLoader
2023-05-01 11:56:00 +00:00
Aleksei Golub
1846b76982
Added DatabaseS3 with test
2023-05-01 11:46:55 +03:00
Aleksei Golub
e20f92ce0f
Fixed exceptions handling; Fixed style;
2023-04-27 21:26:36 +03:00
Aleksei Golub
267bbcab00
Added ability to implicitly use file table function in clickhouse-local
2023-04-16 15:48:55 +03:00
kssenii
599a02ca0d
Fix
2023-04-13 18:53:16 +02:00
Yatsishin Ilya
5786aba5eb
Merge remote-tracking branch 'origin/master' into clickhouse-help
2023-03-22 14:08:22 +00:00
Robert Schulze
657aa65446
Cleanup: Untangle CacheBase's constructors
...
This prepares for the custom TTLCachePolicy which users should not be
able to configure explicitly.
2023-03-13 15:11:12 +00:00
Yatsishin Ilya
d4304d2028
Merge remote-tracking branch 'origin/master' into clickhouse-help
2023-03-02 16:16:18 +00:00
Alexey Milovidov
4134e56ef0
Increase the limit for opened files in clickhouse-local
2023-02-25 03:20:47 +01:00
Yatsishin Ilya
80857638c1
Merge remote-tracking branch 'origin/master' into clickhouse-help
2023-02-22 13:58:17 +00:00
