Alexander Kuzmenkov
6552613118
Merge pull request #16280 from filimonov/clickhouse-local-tmp-folder
...
clickhouse-local can work without tmp directory
2020-10-26 19:10:15 +03:00
Alexander Kuzmenkov
79a6be08d1
Update src/Interpreters/Context.cpp
2020-10-26 19:09:53 +03:00
alesapin
9ed4668dbb
Refactor common part of background list
2020-10-26 15:40:55 +03:00
Alexander Tokmakov
636da1318b
Merge branch 'master' into database_replicated
2020-10-26 15:00:43 +03:00
alesapin
d5d0819698
Merge branch 'master' into no_background_pool_no_more
2020-10-26 12:58:51 +03:00
alesapin
f97e6beb70
Remove message broker pool from context
2020-10-25 15:34:18 +03:00
Mikhail Filimonov
f3a18864d5
After CR fixes - better & simpler. Issue in Context::shutdown fixed
2020-10-23 16:57:06 +02:00
Denny Crane
b310d0abb4
Fix for incorrect error message
...
max_[table/partition]_size_to_drop can be changed without restart since https://github.com/ClickHouse/ClickHouse/pull/7779
2020-10-22 15:22:17 -03:00
Alexander Kuzmenkov
5cbf645de4
Merge remote-tracking branch 'origin/master' into tmp
2020-10-22 19:48:02 +03:00
Alexander Kuzmenkov
145e2b012f
cleanup
2020-10-22 19:47:20 +03:00
alesapin
7a63b373f9
Merge branch 'blind_fix_of_read_in_order' into no_background_pool_no_more
2020-10-22 15:47:11 +03:00
Alexander Tokmakov
72dbb43235
Merge branch 'master' into fork-valbaturin-replication-db-engine
2020-10-20 19:14:54 +03:00
Vladimir Chebotarev
aa5f207fd4
Added disable_merges
option for volumes in multi-disk configuration ( #13956 )
...
Co-authored-by: Alexander Kazakov <Akazz@users.noreply.github.com>
2020-10-20 18:10:24 +03:00
alesapin
7edbe4d276
Add some comments
2020-10-16 13:12:31 +03:00
alesapin
0fb1f74b2e
Trying to schedule better
2020-10-16 11:00:15 +03:00
alesapin
4c1f5cab13
Sleep less in background task
2020-10-15 19:10:22 +03:00
alesapin
60d14352f8
Merge branch 'master' into no_background_pool_no_more
2020-10-15 16:34:14 +03:00
Alexander Kuzmenkov
b4378b004f
Merge remote-tracking branch 'origin/master' into tmp
2020-10-15 16:01:41 +03:00
alesapin
3394c22c03
Fix race and clang-tidy
2020-10-15 10:39:27 +03:00
alesapin
a535a089d1
Some style fixes
2020-10-14 19:09:18 +03:00
alesapin
0b14a31ba9
Get rid of background processing pool
2020-10-14 15:44:10 +03:00
Alexander Tokmakov
72b1339656
Revert "Revert "Write structure of table functions to metadata""
...
This reverts commit c65d1e5c70
.
2020-10-14 15:19:29 +03:00
tavplubix
c65d1e5c70
Revert "Write structure of table functions to metadata"
2020-10-14 13:59:29 +03:00
alexey-milovidov
f60ccb4edf
Merge pull request #14295 from ClickHouse/write_structure_of_table_functions
...
Write structure of table functions to metadata
2020-10-13 23:56:09 +03:00
Alexander Kuzmenkov
6200433e12
Merge origin/master into tmp (using imerge)
2020-10-12 21:15:31 +03:00
alexey-milovidov
a8708338f2
Merge pull request #15809 from amosbird/c1
...
add print_query_id support for native client
2020-10-11 13:29:35 +03:00
Amos Bird
ff665c362f
Add print query id support to client
2020-10-11 10:09:08 +08:00
Alexey Milovidov
9f15daf45c
Remove useless metrics to avoid confusion
2020-10-10 18:52:44 +03:00
Alexander Tokmakov
6b2da861dc
Merge branch 'master' into write_structure_of_table_functions
2020-10-02 20:46:58 +03:00
Alexander Kuzmenkov
218d86de7e
Merge remote-tracking branch 'origin/master' into tmp
2020-09-28 16:29:51 +03:00
tavplubix
ffc0499952
Merge pull request #15243 from ClickHouse/tavplubix-patch-1
...
Try fix race on Context::settings
2020-09-28 11:44:27 +03:00
Alexander Tokmakov
b0d99217fb
Merge branch 'master' into write_structure_of_table_functions
2020-09-27 14:26:47 +03:00
alesapin
97671a1771
Ugly fix for default database race
2020-09-25 14:27:00 +03:00
tavplubix
5ff5ca1fa6
Update Context.cpp
2020-09-24 20:08:15 +03:00
Alexander Kuzmenkov
7b64ca33b1
Merge remote-tracking branch 'origin/master' into tmp
2020-09-22 14:02:20 +03:00
Alexander Kuzmenkov
bfc3be9e43
Merge remote-tracking branch 'origin/aku/tcp-versio' into tmp
2020-09-22 14:02:15 +03:00
alexey-milovidov
3e0509af69
Merge pull request #13573 from amosbird/rms
...
specific ReplicatedMergeTree settings
2020-09-21 01:36:33 +03:00
Vitaly Baranov
46ab2f76cd
Merge pull request #14919 from vitlibar/add-login-function-to-access-storage
...
Add login() function to IAccessStorage
2020-09-20 16:58:22 +03:00
Vitaly Baranov
dbc837c148
IAccessStorage now can override the login() function.
2020-09-19 01:04:20 +03:00
Alexander Tokmakov
1ca9a92b21
Merge branch 'master' into write_structure_of_table_functions
2020-09-18 21:09:23 +03:00
Vitaly Baranov
3356d75b23
Merge pull request #13156 from azat/cluster-secure
...
Secure inter-cluster query execution (with initial_user as current query user) [v3]
2020-09-17 17:11:00 +03:00
Alexander Kuzmenkov
6217dd77b5
Merge remote-tracking branch 'origin/master' into tmp
2020-09-17 12:35:10 +03:00
sundy-li
544b2cb20d
add configChanged method for zookeeper
...
fix logic error && skip reload testkeeper
2020-09-17 13:33:45 +08:00
sundyli
9c2a8ea6d0
dynamic zookeeper config
2020-09-17 13:26:36 +08:00
Azat Khuzhin
a35c1f8ed0
Do not check client's host when user comes from interserver secret
2020-09-16 00:35:49 +03:00
Azat Khuzhin
0159c74f21
Secure inter-cluster query execution (with initial_user as current query user) [v3]
...
Add inter-server cluster secret, it is used for Distributed queries
inside cluster, you can configure in the configuration file:
<remote_servers>
<logs>
<shard>
<secret>foobar</secret> <!-- empty -- works as before -->
...
</shard>
</logs>
</remote_servers>
And this will allow clickhouse to make sure that the query was not
faked, and was issued from the node that knows the secret. And since
trust appeared it can use initial_user for query execution, this will
apply correct *_for_user (since with inter-server secret enabled, the
query will be executed from the same user on the shards as on initator,
unlike "default" user w/o it).
v2: Change user to the initial_user for Distributed queries if secret match
v3: Add Protocol::Cluster package
v4: Drop Protocol::Cluster and use plain Protocol::Hello + user marker
v5: Do not use user from Hello for cluster-secure (superfluous)
2020-09-15 01:36:28 +03:00
Vitaly Baranov
70b0fe88b1
Merge pull request #14604 from vitlibar/no-detach-threads-2
...
Use join() instead of detach() for threads #2
2020-09-12 02:07:46 +03:00
Vitaly Baranov
2a9ab48279
Use join() instead of detach() for the no_users_thread in StorageLiveView.
2020-09-09 22:39:27 +03:00
Alexander Tokmakov
d278d849e4
Merge branch 'master' into write_structure_of_table_functions
2020-09-09 17:12:35 +03:00
Alexander Kuzmenkov
c62bf555d2
Merge origin/master into tmp (using imerge)
2020-09-08 16:26:38 +03:00
Alexander Kuzmenkov
d0a9926e7d
fixes and some docs
2020-09-08 16:19:27 +03:00
alesapin
bea15175d6
Merge pull request #14496 from Jokser/disk-s3-shutdown
...
Disable S3 requests processing during context shutdown to speed up termination process
2020-09-08 15:21:54 +03:00
Peng Jian
fd82272cfe
Fix code style, and update docs for Kafka engine
2020-09-06 11:17:19 +08:00
Peng Jian
e6bfd9d586
1. Add new setting for Kafka engine, named kafka_thread_per_consumer which default value is false. 2. Create separate thread pool for Kafka engine.
2020-09-06 11:17:19 +08:00
Pavel Kovalenko
9d11d4dd44
Variable inline.
2020-09-04 21:45:22 +03:00
Pavel Kovalenko
c933f72adb
Disable S3 requests processing during context shutdown to speed up termination process.
2020-09-04 17:17:27 +03:00
Alexander Tokmakov
56695727b2
Merge branch 'master' into write_structure_of_table_functions
2020-09-01 20:15:13 +03:00
Alexander Tokmakov
3a9779adb4
slightly better code
2020-09-01 17:41:49 +03:00
Alexander Kuzmenkov
c02f9e1dd1
remove some debug output to pass the tests
2020-08-29 01:48:48 +03:00
Alexander Kuzmenkov
063cc386a3
cosmetic fixes
2020-08-28 22:02:50 +03:00
alesapin
1ea00d5e7a
Fix test and better messages
2020-08-28 14:12:51 +03:00
Alexander Kuzmenkov
4612794678
opentelemetry context propagation
2020-08-28 04:21:08 +03:00
Alexander Kuzmenkov
54b3047d19
fixup
2020-08-27 21:44:20 +03:00
Amos Bird
05a5a13e08
specific ReplicatedMergeTree settings
2020-08-27 22:37:41 +08:00
Amos Bird
0c1cf22c00
Allow FETCH PARTITION from other zookeepers
2020-08-27 22:19:18 +08:00
alexey-milovidov
7b53a0ef33
Revert "Added allow_merges
option for volumes in multi-disk configuration ( #13402 )"
...
This reverts commit 1e2616542a
.
2020-08-21 18:44:29 +03:00
Vladimir Chebotarev
1e2616542a
Added allow_merges
option for volumes in multi-disk configuration ( #13402 )
2020-08-21 12:04:13 +03:00
Alexander Kuzmenkov
05ad9b9fff
opentelemetry wip
2020-08-20 23:59:58 +03:00
tavplubix
4aff48dc3f
Merge pull request #10851 from zhang2014/feature/materialize_mysql_database
...
ISSUES-4006 support MaterializeMySQL database engine
2020-08-12 15:59:28 +03:00
Alexey Milovidov
12f66fa82c
Fix 99% of typos
2020-08-08 04:01:47 +03:00
zhang2014
a3bc18bed2
ISSUES-4006 try resolve review comment
2020-08-06 12:03:27 +08:00
zhang2014
035760df9d
ISSUES-4006 refactor for external ddl
2020-08-04 10:31:26 +08:00
Alexey Milovidov
1c039d2cf3
Attempt to fix "Arcadia" build
2020-08-03 04:44:58 +03:00
Alexey Milovidov
6e63a62a65
Attempt to fix "Arcadia" build
2020-08-03 03:14:59 +03:00
Vitaly Baranov
56665a15f7
Rework and rename the template class SettingsCollection => BaseSettings.
2020-07-31 20:54:18 +03:00
Vitaly Baranov
e40a8ac176
Use names of the settings instead of their indices in SettingsConstraints and settings profiles.
2020-07-31 19:11:27 +03:00
Gleb Novikov
aac97957ce
Fixed integration test_tmp_policy
2020-07-26 21:27:36 +03:00
Gleb Novikov
7f5b6fba78
Generic volume is coming...
...
1. SingleDiskVolume for temporary volumes
2. Generic VolumePtr in StoragePolicies
3. Removed max_data_part_size in system.storage_policies, added volume_type
2020-07-26 21:27:36 +03:00
Alexander Kuzmenkov
4398c2daf8
boop the CI
2020-07-23 23:44:30 +03:00
Denis Glazachev
9effacfbc1
Merge branch 'master' into ldap-per-user-authentication
...
* master: (1102 commits)
Update README.md
Update README.md
Update README.md
Update index.md
[docs] add intrdocution for statements page (#12189 )
Revert "Run perf tests with memory sampling (for allocations >1M)"
Sanitize LINK_LIBRARIES property for the directories (#12160 )
[docs] refactor Domains overview (#12186 )
DOCS-647: toStartOfSecond (#12190 )
[docs] add intrdocution for commercial page (#12187 )
DOCSUP-1348 Russian translation for new functions (#133 ) (#12194 )
changelog fixes
Update index.md (#12191 )
Update zh kafka.md title (#12192 )
Added test for #3767
style fix for #12152
Tests for fixed issues #10846 and #7347
changelog fixes
[docs] introduction for special table engines (#12170 )
[docs] introduction for third-party interfaces (#12175 )
...
# Conflicts:
# src/Access/ya.make
# src/Common/ErrorCodes.cpp
2020-07-08 00:42:09 +04:00
Alexey Milovidov
1462a66d1e
Fix typos
2020-06-27 22:05:00 +03:00
Val
cbcd1bea0e
provide better comments and information
2020-06-27 17:00:44 +03:00
Val
5e076b464e
add replicated db snapshot, integration test, repl alter queries, etc
...
add an option to create replicated tables within replicated db without specifying zk path and replica id
add replicated sch pool
disable replication of alter queries for replicated tables in replicated dbs
snapshot prototype. amend of replicated db workflow
add prototype of integration tests for replicated db
2020-06-27 16:58:15 +03:00
Vitaly Baranov
29a9d4187f
Fix using current database while checking access rights.
2020-06-24 17:31:05 +03:00
Denis Glazachev
5db60202b6
Merge branch 'master' into ldap-per-user-authentication
2020-06-19 00:11:08 +04:00
Alexey Milovidov
1ab599b0a0
Remove "current_password" but keep it for Arcadians
2020-06-15 05:17:08 +03:00
Alexey Milovidov
bbe5f4c909
Revert "Remove "current_password" because it is harmful"
...
This reverts commit 66ccb2f6b1
.
2020-06-15 05:13:41 +03:00
Alexey Milovidov
66ccb2f6b1
Remove "current_password" because it is harmful
2020-06-15 04:12:01 +03:00
Alexey Milovidov
6c278fee61
Better exception message
2020-06-14 04:07:47 +03:00
Alexander Kuzmenkov
e354bbc78c
Merge pull request #11588 from ClickHouse/aku/async-log
...
Add system.asynchronous_metric_log
2020-06-11 16:10:35 +03:00
Denis Glazachev
9e3a28a6b8
Merge branch 'master' into ldap-per-user-authentication
...
* master: (414 commits)
Update file.md
Update merge.md
Update dictionary.md
Update external-data.md
Update distributed.md
Update null.md
Update set.md
Update join.md
Update url.md
Update view.md
Update materializedview.md
Update memory.md
Update buffer.md
Update generate.md
removed a sentence about global lock during rename (#11577 )
greatCircleAngle en translation (#11584 )
Update configuration-files.md
try fix flacky test
Update why.html
Update rich.html
...
# Conflicts:
# src/Common/ErrorCodes.cpp
# utils/ci/jobs/quick-build/run.sh
2020-06-11 03:06:17 +04:00
Denis Glazachev
848330b37a
Expect <ldap_servers> in main config.xml
2020-06-11 02:48:15 +04:00
Alexander Kuzmenkov
e4be52f35f
Add system.asynchronous_metric_log
2020-06-10 22:17:54 +03:00
Alexander Tokmakov
08073903ed
fix query_id of http queries
2020-06-10 17:24:42 +03:00
Alexander Kuzmenkov
fafa953ee4
fixup
2020-06-06 04:23:21 +03:00
Alexander Kuzmenkov
eaaf005a03
Merge pull request #11410 from ClickHouse/aku/logical-error-synonyms
...
Remove assorted synonyms of LOGICAL_ERROR
2020-06-05 13:10:40 +03:00
Alexander Kuzmenkov
07e4bb7050
Remove assorted synonyms of LOGICAL_ERROR.
...
We don't need any special handling for them on the client, and, on the
contrary, have to handle them as logical errors in tests.
2020-06-03 16:18:42 +03:00
Denis Glazachev
c427524bc8
Simplefy ExternalAuthenticators exposure to isCorrectPassword()
2020-06-03 01:02:31 +04:00
Pervakov Grigorii
bc9381406f
Add default credentials and custom headers for s3 table functions.
2020-06-02 20:48:49 +03:00
Denis Glazachev
c61cbe8e98
Merge branch 'master' into ldap-per-user-authentication
...
* master: (114 commits)
Update PushingToViewsBlockOutputStream.cpp
Update PushingToViewsBlockOutputStream.cpp
make clang-10 happy
Fix sync_async test (remove timeout)
CLICKHOUSEDOCS-631: temporary_files_codec, join_on_disk_max_files_to_merge settings. (#11242 )
Suppress output of cancelled queries in clickhouse-client #9473
Better log messages in ConfigReloader
fix select from StorageJoin
Fix unit tests under MSan
Added test.
Fix build.
Fix arguments for AggregateFunctionQuantile/
Update style.md
Add a guide on error messages.
Report dictionary name on dictionary load errors.
more types in ASOF JOIN (#11301 )
Fix part_log test
Update test.
Add perftest.
Parallel processing for PushingToViewsBlockOutputStream::writeSuffix
...
2020-06-02 12:42:29 +04:00
Denis Glazachev
e8144976fe
Merge branch 'master' into ldap-per-user-authentication
2020-05-31 15:09:16 +04:00
Alexey Milovidov
25f941020b
Remove namespace pollution
2020-05-31 00:57:37 +03:00
Alexander Tokmakov
c071e0a473
add context to DatabaseCatalog methods
2020-05-29 02:01:18 +03:00
Denis Glazachev
2863de750e
Merge branch 'master' into ldap-per-user-authentication
2020-05-28 01:30:52 +04:00
Denis Glazachev
d74f1357d4
Add LDAP authentication support
2020-05-28 01:06:33 +04:00
Alexey Milovidov
7e1813825b
Return old names of macros
2020-05-24 01:24:01 +03:00
Alexey Milovidov
ee4ffbc332
find {base,src,programs} -name '*.h' -or -name '*.cpp' | xargs grep -l -P 'LOG_\w+\([^,]+, "[^"]+" << [^<]+\);' | xargs sed -i -r -e 's/(LOG_\w+)\(([^,]+), "([^"]+)" << ([^<]+)\);/\1_FORMATTED(\2, "\3{}", \4);/'
2020-05-23 19:47:56 +03:00
alesapin
70fe119426
Add clear names
2020-05-22 13:33:57 +03:00
alesapin
98ffefd90c
Fix bug with return type
2020-05-22 13:09:24 +03:00
alesapin
37fa26971e
boop ci
2020-05-21 21:49:31 +03:00
alesapin
c036af0261
Fix deadlock after clickhouse-server update (with changes in one of system log tables structure) during startup between concurrent merge and table rename.
2020-05-21 17:11:56 +03:00
alesapin
07cb21ccb7
Merge branch 'master' into refactor-reservations
2020-05-18 11:43:48 +03:00
Alexey Milovidov
f4ac1eec04
Merge branch 'master' into quota-key-in-client
2020-05-17 08:15:13 +03:00
Gleb Novikov
1a25ac6e1f
Merge branch 'master' into refactor-reservations
2020-05-16 23:34:45 +03:00
Vitaly Baranov
5b84121d81
Improve system tables for quotas. Remove function currentQuota().
2020-05-13 19:40:48 +03:00
Vitaly Baranov
e64e2ebdf6
Improve system table for row policies. Remove function currentRowPolicies().
2020-05-13 19:40:48 +03:00
Vitaly Baranov
c7213ab607
Use boost::flat_set instead of vector to store current and enabled roles.
2020-05-13 19:40:48 +03:00
Gleb Novikov
390b39b272
VolumePtr instead of DiskPtr in MergeTreeData*
2020-05-10 00:24:15 +03:00
Gleb Novikov
c637d99e07
Volumes and storages refactoring:
...
1. Moved Volume to separate file
2. Created IVolume interface and implemented current behaviour in implementation of new interface — VolumeJBOD
3. Replaced all old volume usages with new VolumeJBOD. Where it is unnecessary to have JBOD — left just IVolume.
4. Removed old Volume completely
5. Moved StoragePolicy to separated files
6. Moved DiskSelector to separated files
7. Removed DiskSpaceMonitor file
2020-05-04 23:15:38 +03:00
alexey-milovidov
378d73d477
Merge pull request #10449 from azat/metrics-for-new-bg-schedule-pools
...
Add tasks/memory metrics for distributed/buffer schedule pools
2020-04-26 20:16:02 +03:00
Alexander Tokmakov
04d6b59ac0
Merge branch 'master' into database_atomic
2020-04-23 17:31:37 +03:00
Azat Khuzhin
4f5ec14f27
Configure thread names for buffer/distributed schedule pools
2020-04-23 03:16:14 +03:00
Azat Khuzhin
d854049d21
Add tasks/memory metrics for distributed/buffer schedule pools
...
Follow-up-for: #10315
Follow-up-for: #10263
2020-04-23 02:18:37 +03:00
Azat Khuzhin
c04c73b4c4
Drop unused MemoryTrackingForMerges from Context
...
It set in src/Storages/MergeTree/MergeList.cpp anyway.
2020-04-23 01:57:33 +03:00
Alexander Tokmakov
fefbbd37df
Merge branch 'master' into database_atomic
2020-04-22 17:02:30 +03:00
Alexey Milovidov
0a7edce036
Checkpoint
2020-04-22 09:01:33 +03:00
alexey-milovidov
8c2839d3c9
Merge pull request #10308 from ClickHouse/shared-context-lifetime
...
Shared context lifetime
2020-04-21 00:12:45 +03:00
Alexander Tokmakov
b29bddac12
Merge branch 'master' into database_atomic
2020-04-20 14:09:09 +03:00
Alexey Milovidov
1d885b3ff9
Merge branch 'master' into quota-key-in-client
2020-04-20 02:15:37 +03:00
Nikolai Kochetov
67b3487207
Try fix build.
2020-04-19 18:46:12 +03:00
Nikolai Kochetov
e969f66aca
Try fix test.
2020-04-19 18:41:35 +03:00
Azat Khuzhin
5d11118cc9
Use thread pool (background_distributed_schedule_pool_size) for distributed sends
...
After #8756 the problem with 1 thread for each (distributed table, disk)
for distributed sends became even worse (since there can be multiple
disks), so use predefined thread pool for this tasks, that can be
controlled with background_distributed_schedule_pool_size knob.
2020-04-19 12:01:56 +03:00
Nikolai Kochetov
ce11662ab1
Fix build.
2020-04-17 15:58:52 +03:00
Nikolai Kochetov
d51a9c551b
Remove shared_ptr to SharedContext from Context.
2020-04-17 12:47:40 +03:00
Azat Khuzhin
a9b1b36907
Use separate pool for buffer flushes (background_buffer_flush_schedule_pool_size)
2020-04-16 20:14:28 +03:00
Nikolai Kochetov
025093d354
Fix build.
2020-04-16 17:51:33 +03:00
Nikolai Kochetov
d6db27e372
Modify context.
2020-04-16 17:37:38 +03:00
Alexey Milovidov
fe59524481
Implemented in a different way
2020-04-15 04:59:14 +03:00
Alexander Tokmakov
d1024e76bd
fix
2020-04-13 18:46:36 +03:00
Alexander Tokmakov
5e6d4b9449
Merge branch 'master' into database_atomic
2020-04-12 16:35:44 +03:00
Vitaly Baranov
ca634f603a
Revert resetting the settings to their defaults after each query in TCPHandler.
2020-04-10 21:09:59 +03:00
Alexander Tokmakov
140cd88c20
fixes
2020-04-09 02:59:39 +03:00
Alexander Tokmakov
dd1590830b
Merge branch 'master' into database_atomic
2020-04-08 22:00:46 +03:00
Vitaly Baranov
42b8ed3ec6
Implement "ON CLUSTER" clause for access control SQL.
2020-04-07 23:31:59 +03:00
Alexander Tokmakov
a2101c9b1c
better code
2020-04-07 02:22:44 +03:00
Alexander Tokmakov
08bae4668d
Merge branch 'master' into database_atomic
2020-04-06 16:18:07 +03:00
Ivan Lezhankin
06446b4f08
dbms/ → src/
2020-04-03 18:14:31 +03:00