lzydmxy
3410082cb2
add columns perform_ttl_move_on_insert, load_balancing for table system.storage_policies
2023-03-29 19:58:25 +08:00
kssenii
4cf2862a0e
Merge remote-tracking branch 'upstream/master' into cache-better-locks
2023-03-29 12:50:36 +02:00
Azat Khuzhin
f38a7aeabe
ThreadPool metrics introspection
...
There are lots of thread pools and simple local-vs-global is not enough
already, it is good to know which one in particular uses threads.
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-03-29 10:46:59 +02:00
Alexander Tokmakov
b01f08ccb8
rename marked_dropped_tables to dropped_tables
2023-03-27 13:23:56 +02:00
Dmitry Novik
3488a4d84b
Improve file includes
2023-03-24 03:44:52 +01:00
Kseniia Sumarokova
a9bcd022d5
Merge pull request #46241 from kssenii/named-collections-granular-access
...
Allow separate grants for every named collection
2023-03-21 12:27:53 +01:00
Robert Schulze
d8493780b2
Query cache: Enable compression and squashing of result blocks
...
ClickHouse reads table data in blocks of 'max_block_size' rows. Due to
filtering, aggregation, etc., result blocks are typically much smaller
than 'max_block_size' but there are also cases where they are much
bigger. Setting 'query_cache_squash_partial_results' (enabled by
default) now controls if result blocks are squashed (if they are tiny)
or split (if they are large) into blocks of 'max_block_size' size before
insertion into the query result cache. This reduces performance of
writes into the query cache but improves compressability of cache
entries and provides more natural block granularity when query results
are later served from the query cache.
Entries in the query cache are now also compressed by default. This
reduces the overall memory consumption at the cost of slower writes into
/ reads from the query cache. To disable compression, use setting
'query_cache_compress_entries'.
2023-03-20 20:11:41 +00:00
kssenii
75624c52f7
Merge remote-tracking branch 'upstream/master' into named-collections-granular-access
2023-03-20 16:38:14 +01:00
Robert Schulze
c4664c70a1
Merge branch 'master' into rs/qc-cachebase
2023-03-19 15:23:24 +01:00
Sema Checherinda
0b641fcead
Merge pull request #47564 from CheSema/remove-redundant
...
remove counters for threads, fix negative counters
2023-03-18 02:23:52 +01:00
kssenii
a2977e373a
Merge remote-tracking branch 'upstream/master' into cache-better-locks
2023-03-17 14:34:04 +01:00
chen
60b7ad819d
Add system.marked_dropped_tables ( #47364 )
...
* add system table marked_dropped_tables
* add test
* add test
* fix
* fix test
* fix style
* fix test
* Update 25400_marked_dropped_tables.sql
* Update 25400_marked_dropped_tables.sql
* Update 25400_marked_dropped_tables.sql
* Update 25400_marked_dropped_tables.sql
* Update 25400_marked_dropped_tables.sql
* fix
* fix test
* Update StorageSystemMarkedDroppedTables.cpp
* fix
* if table_mark_dropped.table is nullptr, engine set empty
2023-03-17 13:48:26 +03:00
Sema Checherinda
3c6deddd1d
work with comments on PR
2023-03-16 19:55:58 +01:00
Mike Kot
511ed93512
Update src/Storages/System/StorageSystemDatabases.cpp
...
Co-authored-by: alesapin <alesapin@gmail.com>
2023-03-15 16:38:59 +03:00
Robert Schulze
73afae2d3f
Introduce TTLCachePolicy
2023-03-14 09:45:20 +00:00
Mike Kot
9920a52c51
use std::lerp, constexpr hex.h
2023-03-07 22:50:17 +00:00
Mike Kot
1fca58b694
Merge branch 'master' into feature/show-secrets-option
2023-03-06 15:46:54 +03:00
kssenii
7b369e516c
Fix stress test
2023-03-03 17:20:27 +01:00
kssenii
0c4bb3c80f
Merge remote-tracking branch 'upstream/master' into named-collections-granular-access
2023-03-02 19:08:29 +01:00
Azat Khuzhin
b5434eac3b
Rename StorageDistributedDirectoryMonitor to DistributedAsyncInsertDirectoryQueue
...
Since #44922 it is not a directory monitor anymore.
v2: Remove unused error codes
v3: Contains some header fixes due to conflicts with master
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-02-28 22:33:36 +01:00
pufit
29296cb004
Merge pull request #46550 from ClickHouse/46231-systerm-server-settings
...
Implement `system.server_settings`
2023-02-28 11:23:15 -05:00
Nikolai Kochetov
738551dbf1
Merge pull request #46624 from CheSema/detached_mt
...
add multitreading for StorageSystemDetachedParts
2023-02-27 20:54:28 +01:00
Mike Kot
c799bd094b
Merge branch 'master' into feature/show-secrets-option
2023-02-27 18:43:14 +03:00
kssenii
5418dd655e
Merge remote-tracking branch 'upstream/master' into cache-better-locks
2023-02-27 14:35:30 +01:00
Mike Kot
62acc7a6cf
setting and some docs
2023-02-27 13:18:21 +00:00
Sema Checherinda
1666527dae
do listing combined with getting size in one thread
2023-02-26 12:09:05 +01:00
Sema Checherinda
0c9643f1ed
make listing in parrallel as well
2023-02-25 16:27:27 +01:00
Nikolai Kochetov
57b5f9e7d7
Fix case with no detached parts for table.
2023-02-25 13:33:20 +01:00
Sema Checherinda
e2bfa83429
cancel workers when exception
2023-02-25 13:33:20 +01:00
Sema Checherinda
08dc874a37
do not run support threads if no tasks left
2023-02-25 13:33:20 +01:00
Sema Checherinda
e5cbe4311e
create limites count of support threads for a block
2023-02-25 13:33:20 +01:00
Sema Checherinda
ef0c1841af
work with comments on review
2023-02-25 13:33:20 +01:00
Sema Checherinda
3b58249320
pack several files in one thread
2023-02-25 13:33:20 +01:00
Sema Checherinda
8abc1f0d5d
fix build and style
2023-02-25 13:33:20 +01:00
Sema Checherinda
dce319e1c5
add multitreading for StorageSystemDetachedParts
2023-02-25 13:33:20 +01:00
kssenii
6224ca9cd6
Fix
2023-02-24 17:08:05 +01:00
kssenii
f2a9109fe1
Merge remote-tracking branch 'upstream/master' into named-collections-granular-access
2023-02-24 15:20:46 +01:00
pufit
2fbe75957d
Add default
column for system.settings
and system.server_settings
2023-02-23 18:24:57 -05:00
Antonio Andelic
1efba8995d
Update version to 23.3.1.2537
2023-02-23 19:35:57 +00:00
Kseniia Sumarokova
7e064ccbd4
Merge pull request #46667 from kssenii/hide-named-collections-under-setting
...
Allow to hide only values from system.named_collections while making collection visible
2023-02-23 11:44:50 +01:00
pufit
8e7533fa57
Merge pull request #46564 from AVMusorin/update-time-distribution-queue
...
Added `last_exception_time` column into distribution_queue table
2023-02-22 10:43:35 -05:00
kssenii
f0ca3ef207
Merge remote-tracking branch 'upstream/master' into named-collections-granular-access
2023-02-22 14:02:29 +01:00
AVMusorin
0bf0fe488e
added last_exception_time column into distribution_queue table
2023-02-21 23:46:57 +01:00
kssenii
9a7c71b78e
Allow to hide only values from system.named_collections
2023-02-21 18:07:57 +01:00
kssenii
9d16205c8a
Load named collections on first access
2023-02-20 16:33:45 +01:00
pufit
4496db66b2
Implement system.server_settings
2023-02-17 23:46:09 -05:00
kssenii
dbbab26167
Merge remote-tracking branch 'upstream/master' into cache-better-locks
2023-02-16 12:29:38 +01:00
Robert Schulze
44815240f5
Exclude internal databases from async metric "NumberOfDatabases"
2023-02-15 12:58:00 +00:00
Antonio Andelic
8d16fe5793
Merge branch 'master' into add-support-for-settings-alias
2023-02-13 08:46:00 +01:00
Alexey Milovidov
5f00bc49f8
Merge branch 'master' into addParts
2023-02-12 05:55:18 +03:00
attack204
7f41173a1f
rename API
2023-02-10 16:24:10 +08:00
attack204
93e92dab3b
rename API
2023-02-10 16:05:50 +08:00
attack204
52960d4e7d
add API to MergeTreeData
2023-02-10 11:00:11 +08:00
kssenii
214ffe0bb0
Remove unused code
2023-02-09 17:44:26 +01:00
kssenii
9e04e57949
Allow to give access only to certain named collections
2023-02-09 17:22:57 +01:00
Antonio Andelic
f96d480563
Merge branch 'master' into add-support-for-settings-alias
2023-02-09 16:07:45 +01:00
attack204
07ea30e6e0
beauty
2023-02-09 20:35:28 +08:00
attack204
a5d7f002ec
beauty
2023-02-09 11:03:04 +08:00
attack204
9ce15279ae
reformat
2023-02-09 10:54:18 +08:00
attack204
f65756c0c8
fix style
2023-02-09 09:34:11 +08:00
Vitaly Baranov
4869d3806c
Add setting check_referential_table_dependencies to check referential dependencies on DROP TABLE.
2023-02-08 23:56:59 +01:00
attack204
ecaa97c5b1
fix style
2023-02-08 23:45:39 +08:00
attack204
1328725054
fix style
2023-02-08 22:58:31 +08:00
attack204
01cac6c49b
fix style
2023-02-08 22:49:10 +08:00
attack204
752d1f81b0
fix style
2023-02-08 22:36:07 +08:00
attack204
1fdf3659da
fix style
2023-02-08 22:29:23 +08:00
attack204
41daf88d64
fix style
2023-02-08 22:20:47 +08:00
attack204
820e5bd9c0
fix style
2023-02-08 22:15:05 +08:00
attack204
7c6e30ebe2
fix pointer bug
2023-02-08 22:02:58 +08:00
attack204
b1fc12c162
delete extra API and use dynamic_cast to compute
2023-02-08 21:52:13 +08:00
attack204
9e1081b79a
add parts, active_parts total_marks to system.tables
2023-02-08 20:23:06 +08:00
Robert Schulze
8840aa9242
Fix build with -DENABLE_LIBURING=0 (or -DENABLE_LIBRARIES=0)
...
Follow-up to #38456
The problem was that code which uses liburing was conditionally build
depending on define OS_LINUX and not based on whether liburing was
enabled/disabled at build time.
2023-02-06 16:57:42 +00:00
Azat Khuzhin
1307e6d323
Fix elapsed column in system.processes (10x error)
...
Fixes : #43455 (cc @Algunenano)
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-02-04 22:37:11 +01:00
Kseniia Sumarokova
80c96f7d3d
Merge branch 'master' into cache-better-locks
2023-02-04 22:31:59 +01:00
Antonio Andelic
60e5ee84c2
Extract common code
2023-02-03 18:44:56 +00:00
Antonio Andelic
3a8ba689f2
Update tests and system.settings
2023-02-03 18:26:31 +00:00
Alexander Tokmakov
7e6f7c79f2
Merge pull request #45457 from FrankChen021/exception_time
...
Add last_exception_time to replication_queue
2023-02-03 20:00:15 +03:00
Vitaly Baranov
45d2d678ab
Merge pull request #45800 from vitlibar/rename-new-columns-in-system-backups
...
Rename new columns in system.backups
2023-02-03 14:00:16 +01:00
Kseniia Sumarokova
24da7f2b54
Merge branch 'master' into cache-better-locks
2023-02-02 16:07:13 +01:00
Alexey Milovidov
62bfdb349a
Merge branch 'master' into fix-trash-query-kind
2023-02-02 04:26:49 +01:00
Alexey Milovidov
9b908a0be0
Fix trash around query kind, part 2
2023-02-01 03:31:31 +01:00
Alexey Milovidov
5c4db119fa
Fix trash around query kind, part 1
2023-02-01 03:11:54 +01:00
Vitaly Baranov
96b140cc95
Rename columns in system.backups: num_files, num_processed_files, processed_files_size
...
num_processed_files -> num_files (BACKUP) / files_read (RESTORE)
processed_files_size -> total_size (BACKUP) / bytes_read (RESTORE)
2023-01-31 22:45:41 +01:00
Robert Schulze
325c6bdf3d
Renaming: "Query Result Cache" --> "Query Cache"
...
Reasons:
- The cache will at some point store intermediate results as opposed to
only query results. We should change the terminology now without
having to worry about backward compat.
- Equivalent caches in MySQL (1) and Starrocks (2) are called "query
cache".
- The new name is ca. 13.8% more catchy.
(1) https://dev.mysql.com/doc/refman/5.6/en/query-cache.html
(2) https://docs.starrocks.io/en-us/2.5/using_starrocks/query_cache
2023-01-31 09:54:34 +00:00
Vitaly Baranov
38910412c4
Merge pull request #42244 from AVMusorin/fix_backup_restore_num_files
...
Added num_processed_files and processed_files_size for backup and restore processes
2023-01-30 09:24:49 +01:00
kssenii
917c49ae44
Fix test
2023-01-30 00:10:34 +01:00
alesapin
716d25c33f
Merge pull request #45619 from CurtizJ/refactoring-merge-tree-parts
...
Refactoring of code near merge tree parts
2023-01-27 13:36:33 +01:00
kssenii
dc3cff9f06
Merge remote-tracking branch 'upstream/master' into cache-better-locks
2023-01-27 12:39:23 +01:00
Mikhail f. Shiryaev
53d89844be
Update version to 23.2.1.1
2023-01-25 23:57:29 +01:00
Anton Popov
8e3698c91f
refactoring of code near merge tree parts
2023-01-25 17:34:09 +00:00
Anton Popov
b987ed5037
Merge pull request #45499 from CurtizJ/add-fields-system-formats
...
Add fields to table `system.formats`
2023-01-23 23:08:35 +01:00
Alexander Tokmakov
70d1adfe4b
Better formatting for exception messages ( #45449 )
...
* save format string for NetException
* format exceptions
* format exceptions 2
* format exceptions 3
* format exceptions 4
* format exceptions 5
* format exceptions 6
* fix
* format exceptions 7
* format exceptions 8
* Update MergeTreeIndexGin.cpp
* Update AggregateFunctionMap.cpp
* Update AggregateFunctionMap.cpp
* fix
2023-01-24 00:13:58 +03:00
Aleksandr
2caeed901b
Merge branch 'master' into fix_backup_restore_num_files
2023-01-23 13:43:20 +01:00
Anton Popov
8a39337c7c
add fields to table system.formats
2023-01-23 02:04:31 +00:00
Robert Schulze
340f406553
Merge branch 'master' into query-result-cache
2023-01-22 13:21:36 +01:00
Aleksandr Musorin
838acb22b7
added num_processed_files and processed_files_size
2023-01-20 10:20:41 +01:00
Frank Chen
fb8452aa49
Add last_exception_time to replication_queue
2023-01-20 15:20:57 +08:00
Aleksei Filatov
afada0ecb3
Fix review notes
2023-01-19 17:02:57 +03:00
Aleksei Filatov
5e9340f682
Add integration test
2023-01-18 17:50:38 +03:00
Aleksei Filatov
7f4a01b903
Add handling of bad dictionary structure
2023-01-18 17:27:03 +03:00
kssenii
4556b516d7
Merge remote-tracking branch 'upstream/master' into cache-better-locks
2023-01-17 14:06:04 +01:00
Robert Schulze
099e30ef2a
Merge remote-tracking branch 'origin/master' into query-result-cache
2023-01-16 08:04:49 +00:00
Alexander Tokmakov
9d5ec474a3
Merge pull request #43998 from evillique/make_system_replicas_parallel
...
Make `system.replicas` parallel
2023-01-13 16:33:36 +03:00
Robert Schulze
0c528fca29
Introduce SourceFromChunks to avoid unnecessary partial result chunk concatenation
2023-01-12 23:01:00 +00:00
kssenii
6499e8e687
Calculate only required column in system.detached_parts
2023-01-11 16:45:38 +01:00
Alexander Tokmakov
5ff4c6228a
Merge pull request #43840 from Algunenano/system_tables_nolock
...
Do not acquire read locks in system.tables if possible
2023-01-10 20:26:21 +03:00
Robert Schulze
923fa2c15a
Fix review comments, pt. II
2023-01-10 10:21:08 +00:00
Robert Schulze
ad4884b394
Fix review comments, pt. I
2023-01-09 21:42:51 +00:00
Robert Schulze
45dbcf88e5
Merge remote-tracking branch 'origin/master' into query-result-cache
2023-01-06 20:42:48 +00:00
Kseniia Sumarokova
573d3283b0
Merge pull request #44327 from kssenii/use-new-named-collections-code-2
...
Replace old named collections code with new (from #43147 ) part 2
2023-01-06 13:06:26 +01:00
kssenii
0a0b46f4c2
Better
2023-01-05 21:52:42 +01:00
Nikolay Degterinsky
673ba769e5
Merge remote-tracking branch 'upstream/master' into make_system_replicas_parallel
2023-01-05 02:36:07 +00:00
kssenii
9014c818ae
Merge remote-tracking branch 'upstream/master' into try-perf
2023-01-04 20:56:32 +01:00
kssenii
25f8e8467a
Rewrite locking in cache - intermediate state
2023-01-04 18:56:45 +01:00
Robert Schulze
27f5aad49e
What happens if I remove 156 lines of code?
2023-01-03 18:51:16 +00:00
kssenii
67509aa2d5
Merge remote-tracking branch 'upstream/master' into use-new-named-collections-code-2
2023-01-03 16:41:30 +01:00
Robert Schulze
814c6a899d
Simplify the code a bit
2023-01-02 11:08:49 +00:00
Robert Schulze
e9e04166d9
Merge remote-tracking branch 'origin/master' into query-result-cache
2023-01-02 08:20:27 +00:00
Alexey Milovidov
3a5cea8281
Fix race in system.parts and system.parts_columns
2022-12-31 15:07:26 +01:00
Alexey Milovidov
26eb2f57e1
Fix race in system.parts and system.parts_columns
2022-12-31 15:06:57 +01:00
Raúl Marín
5de11979ce
Unify query elapsed time measurements ( #43455 )
...
* Unify query elapsed time reporting
* add-test: Make shell tests executable
* Add some tests around query elapsed time
* Style and ubsan
2022-12-28 21:01:41 +01:00
Alexey Milovidov
462e7f76bf
Attempt to fix the "system.stack_trace" test
2022-12-27 13:28:25 +01:00
alesapin
2fecf420cb
Merge pull request #44513 from ClickHouse/small_polishing
...
Minor code polishing
2022-12-23 13:47:26 +01:00
kssenii
8308177361
Merge remote-tracking branch 'upstream/master' into use-new-named-collections-code-2
2022-12-23 12:14:46 +01:00
Raúl Marín
d540b74e1f
Rework the shared lock usage in system.tables
2022-12-22 19:40:29 +01:00
Raúl Marín
f0fe27e9e2
Do not acquire read locks in system.tables when possible
2022-12-22 17:31:34 +01:00
alesapin
fa467b3398
Minor code polishing
2022-12-22 14:31:42 +01:00
vdimir
d30d25dbbe
Temporary files evict fs cache
2022-12-22 10:22:49 +00:00
Robert Schulze
b93c56323c
Merge remote-tracking branch 'origin/master' into query-result-cache
2022-12-19 09:18:36 +00:00
Robert Schulze
c7d97d60b0
Resolve lock inversion
2022-12-18 12:37:53 +00:00
Robert Schulze
a4e58908ff
Add "shared" field to system.queryresult_cache
2022-12-17 18:18:37 +00:00
Robert Schulze
bc6bcdfd7b
Allow sharing of cache entries
2022-12-17 18:04:18 +00:00
Robert Schulze
eccd25a24f
The QRC system view must not show other user's queries
2022-12-17 15:16:19 +00:00
kssenii
30547d2dcd
Replace old named collections code for url
2022-12-17 00:24:05 +01:00
Kseniia Sumarokova
8e1e431316
Merge pull request #44204 from kssenii/use-new-named-collections-code
...
Apply new code of named collections (from #43147 ) to external table engines part 1
2022-12-16 10:09:01 +01:00
Mikhail f. Shiryaev
d250b00a60
Merge pull request #44275 from ClickHouse/22.13-prepare
...
Update version after release
2022-12-15 22:15:46 +01:00
Alexander Tokmakov
4588962661
Merge branch 'master' into tavplubix-patch-1
2022-12-15 22:28:01 +03:00
Dmitry Novik
7ad3ff8a9e
Merge pull request #44244 from ClickHouse/part-log-removal-info
...
Add more information about part removal into system.parts table
2022-12-15 18:06:55 +01:00
Mikhail f. Shiryaev
8a145f7000
Update version to 22.13.1.1
2022-12-15 18:00:42 +01:00
Dmitry Novik
b87739d31c
Add HAS_SKIPPED_MUTATION_PARENT state
2022-12-15 16:05:15 +00:00
Alexander Tokmakov
940a608057
Update StorageSystemDatabases.cpp
2022-12-15 18:59:02 +03:00
Robert Schulze
537c64aad2
Merge remote-tracking branch 'origin/master' into query-result-cache
...
Conflicts:
- tests/queries/0_stateless/02117_show_create_table_system.reference
2022-12-15 12:17:58 +00:00
Dmitry Novik
5b7a990425
Add more information about part removal into system.parts table
2022-12-14 22:30:43 +00:00
Yakov Olkhovskiy
adefd4aa19
include logger
2022-12-14 17:01:15 -05:00
Alexander Tokmakov
903780033e
Update StorageSystemDatabases.cpp
2022-12-14 22:30:23 +03:00
Nikolay Degterinsky
2aff560218
Even better thread pool
2022-12-14 12:50:12 +00:00
Nikolay Degterinsky
b2f3b236d8
Slightly better thread pool
2022-12-14 12:23:08 +00:00
Nikolay Degterinsky
fef57b4e3b
Better thread pool
2022-12-14 11:40:26 +00:00
kssenii
9aa6d31bce
Merge remote-tracking branch 'upstream/master' into use-new-named-collections-code
2022-12-13 22:25:10 +01:00
kssenii
fae817863c
Apply new code of named collections to s3
2022-12-13 22:19:09 +01:00
Alexander Tokmakov
f9d63de22f
Merge pull request #43468 from lingtaolf/feature/add_create_database_query
...
Add engine_full column to system.databases
2022-12-13 23:00:42 +03:00
Alexander Tokmakov
dd5aac75f9
Update StorageSystemDatabases.cpp
2022-12-12 18:18:45 +03:00
Robert Schulze
b78652e138
Query result cache
2022-12-12 10:37:10 +00:00
Alexander Tokmakov
3a9456ba40
fix race condition
2022-12-09 18:31:13 +01:00
Alexander Tokmakov
714666e944
Merge branch 'master' into feature/add_create_database_query
2022-12-09 17:47:15 +01:00
Sergei Trifonov
7c37e48092
Merge pull request #43903 from ClickHouse/merge_tree_settings_constraints
...
Constraints on merge tree settings
2022-12-09 14:16:14 +01:00
Nikolay Degterinsky
540f890291
Make system.replicas parallel
2022-12-07 11:04:15 +00:00
serxa
1b5b43ec87
fix checks on CREATE + added resolveSetting.h + improved system table
2022-12-06 19:09:18 +00:00
Guillaume Tassery
3537929f73
Merge branch 'master' into gt/add_expression
2022-12-05 15:46:15 +01:00
Vitaly Baranov
e1f7f04752
Referential dependencies for RESTORE ( #43834 )
...
* Rename DDLDependencyVisitor -> DDLLoadingDependencyVisitor.
* Move building a loading graph to TablesLoader.
* Implement referential dependencies for tables and use them
when restoring tables from a backup.
* Remove StorageID::operator < (because of its inconsistency with ==).
* Add new tests.
* Fix test.
* Fix memory leak.
Co-authored-by: Nikita Mikhaylov <mikhaylovnikitka@gmail.com>
2022-12-02 15:05:46 +01:00
Vladimir C
7d6950d397
Revert "Temporary files evict fs cache"
2022-12-02 14:50:56 +01:00
Vladimir C
117d01f2ac
Merge pull request #43457 from ClickHouse/vdimir/tmp-data-in-fs-cache
2022-12-01 13:41:40 +01:00
vdimir
9bdf01a55c
Do not use in FileSegment::getPathInLocalCache in StorageSystemFilesystemCache
2022-12-01 11:49:26 +00:00
vdimir
35c4e8ac84
wip: temporary files evict fs cache
2022-12-01 11:49:25 +00:00
Antonio Andelic
678958603b
Merge branch 'master' into keeper-prometheus
2022-11-28 09:48:57 +01:00
Alexey Milovidov
a2c894bcfd
Just in case
2022-11-26 01:02:29 +03:00
Anton Popov
c811f34a41
Simplify AsynchronousInsertQueue
and fix race ( #43233 )
2022-11-25 15:02:22 +01:00
凌涛
99632c95c9
code style
2022-11-25 10:12:32 +08:00
Alexander Gololobov
038cac1892
add engine_full to system table databases
2022-11-25 10:11:12 +08:00
Antonio Andelic
a6f38cb1cc
Merge branch 'master' into keeper-prometheus
2022-11-24 12:12:08 +01:00
Guillaume Tassery
58c5422692
cosmetic
2022-11-24 10:19:04 +01:00
Sema Checherinda
3a8024002d
fix race in read full path from deleting part, add more logs in grabOldParts
2022-11-23 15:16:09 +00:00
Alexey Milovidov
c1283a6bb5
Update StorageSystemDataSkippingIndices.cpp
2022-11-22 22:17:20 +03:00
Sergei Trifonov
59f422f10c
Merge branch 'master' into storage-system-moves
2022-11-22 14:46:00 +01:00
Kruglov Pavel
98d6b96c82
Merge pull request #42033 from mark-polokhov/BSONEachRow
...
Add BSONEachRow input/output format
2022-11-22 14:45:21 +01:00
Sergei Trifonov
94a7614c45
Merge branch 'master' into storage-system-moves
2022-11-21 20:10:12 +01:00
serxa
c425da06b2
fix column name
2022-11-21 16:16:53 +00:00
Antonio Andelic
e78761b66c
Merge branch 'master' into keeper-prometheus
2022-11-21 09:10:10 +01:00
Guillaume Tassery
7267473aec
Merge branch 'master' into gt/add_expression
2022-11-21 09:07:12 +01:00
Guillaume Tassery
1f73c8dabd
Merge branch 'gt/add_expression' of github.com:YiuRULE/ClickHouse into gt/add_expression
2022-11-21 09:06:25 +01:00
Guillaume Tassery
702768469b
cosmetic
2022-11-21 09:04:44 +01:00
Alexey Milovidov
81ca8e91e6
Update StorageSystemDataSkippingIndices.cpp
2022-11-20 14:27:52 +03:00
Azat Khuzhin
4f6703c972
Add is_read_only/is_write_once/is_remote/is_broken to system.disks
...
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-11-19 10:11:39 +01:00
serxa
8e65b799c2
fix test + add one more column
2022-11-18 20:04:11 +00:00
serxa
a05a1b0133
Merge branch 'storage-system-moves' of github.com:ClickHouse/ClickHouse into storage-system-moves
2022-11-18 15:35:00 +00:00
Sergei Trifonov
77100896e3
Merge branch 'master' into storage-system-moves
2022-11-18 16:33:43 +01:00
Vitaly Baranov
a348332eab
Merge pull request #43227 from vitlibar/improve-masking-sensitive-info
...
Improve masking sensitive info
2022-11-18 15:37:50 +01:00
Mikhail f. Shiryaev
f942ab1bd2
Update version to 22.12.1.1
2022-11-17 22:15:12 +01:00
Vitaly Baranov
2b9ed89721
Rename formatWithHiddenSecrets() -> formatWithSecretsHidden().
2022-11-17 17:30:37 +01:00
Guillaume Tassery
c47f90d197
add expression index in system.data_skipping_indices
2022-11-16 20:54:55 +01:00
Vitaly Baranov
d365570b27
Hide passwords in SHOW CREATE TABLE and system.tables.
2022-11-16 01:35:11 +01:00
Antonio Andelic
96838f5be7
Merge branch 'master' into keeper-prometheus
2022-11-15 12:00:02 +00:00
Alexey Milovidov
3cab3ce484
Merge pull request #43198 from FArthur-cmd/MySQL_clickhouse_connect
...
add columns to information schema
2022-11-15 01:11:29 +01:00
Kseniia Sumarokova
e58a7140be
Merge pull request #43194 from ClickHouse/async-metrics-documentation
...
Add documentation for `system.asynchronous_metrics`.
2022-11-14 12:21:34 +01:00
Kseniia Sumarokova
79206c6eb0
Merge pull request #43147 from kssenii/named-collections-refactoring
...
Add generic implementation for arbitrary structured named collections, access type and system.named_collections
2022-11-14 11:57:17 +01:00
Alexey Milovidov
3c603c3d8c
Update columns.sql
2022-11-14 02:42:30 +03:00
FArthur-cmd
f6b334fb3a
add columns to information scheme
2022-11-13 12:03:46 +00:00
Alexey Milovidov
ba05b7dd2c
Add documentation for AsynchronousMetrics
2022-11-13 03:36:20 +01:00
kssenii
63de577172
Better, add tests
2022-11-10 22:47:30 +01:00
avogar
9e89af28c6
Refactor BSONEachRow format, fix bugs, support more data types, support parallel parsing and schema inference
2022-11-10 20:15:14 +00:00
kssenii
a5d06cd909
Better Impl
2022-11-10 19:59:52 +01:00
kssenii
a47aac3e2b
Better system table structure
2022-11-10 17:07:17 +01:00
kssenii
bed7ac9442
Support arbitrary structure collections
2022-11-10 17:05:24 +01:00
Antonio Andelic
f2a9b5933d
Merge branch 'master' into keeper-prometheus
2022-11-10 09:28:06 +01:00
Antonio Andelic
c92ae5a385
Add suport for AsyncMetrics in standalone Keeper
2022-11-09 13:46:03 +01:00
SmitaRKulkarni
658036d179
Merge pull request #42708 from ClickHouse/42414_Enable_functions_in_readonly_mode
...
42414 enable functions in readonly mode
2022-11-08 15:22:31 +01:00
Kseniia Sumarokova
92b5ca326c
Merge pull request #42303 from xiedeyantu/system_table_add_column
...
system.detached_parts add column bytes_on_disk and path
2022-11-08 12:00:56 +01:00
Kseniia Sumarokova
4fc7926c16
Merge branch 'master' into system_table_add_column
2022-11-07 23:36:57 +01:00
xiedeyantu
d4cdc38b71
better
2022-11-07 22:49:58 +08:00
Duc Canh Le
bd2bd7149d
fix typo
2022-11-07 18:22:50 +08:00
Duc Canh Le
69d6d42443
NOT LIKE only work for 'prefix%'
2022-11-06 15:26:19 +08:00
SmitaRKulkarni
54035270b2
Merge branch 'master' into 42414_Enable_functions_in_readonly_mode
2022-10-31 14:15:29 +01:00
serxa
acc00218d9
fix build
2022-10-28 11:23:49 +00:00
Sergei Trifonov
836595c7ae
Merge branch 'master' into storage-system-moves
2022-10-28 11:39:38 +02:00
SmitaRKulkarni
e860ecc80c
Merge branch 'master' into 42414_Enable_functions_in_readonly_mode
2022-10-27 08:26:44 +02:00
Smita Kulkarni
6a8fa2d4a5
Added new field allow_readonly in system.table_functions to allow using table functions in readonly mode.
...
Implementation:
* Added a new field allow_readonly to table system.table_functions.
* Updated to use new field allow_readonly to allow using table functions in readonly mode.
* Added TableFunctionProperties similar to AggregateFunctionProperties.
* The functions allowed in readonly mode are in this set table_functions_allowed_in_readonly_mode.
Testing:
* Added a test for filesystem tests/queries/0_stateless/02473_functions_in_readonly_mode.sh
Documentation:
* Updated the english documentation for Table Functions.
2022-10-26 18:45:23 +02:00
Anton Popov
ca4df62e37
Merge branch 'master' into refactor-data-part
2022-10-26 17:49:20 +02:00
Mikhail f. Shiryaev
fdecac65b8
Merge pull request #42699 from ClickHouse/22.11-prepare
...
Update version after release
2022-10-26 16:31:48 +02:00
Mikhail f. Shiryaev
d3461abd1f
Update version to 22.11.1.1
2022-10-26 15:27:09 +02:00
Kruglov Pavel
219553df8d
Merge pull request #42580 from hanfei1991/fei/limit_max_rows
...
fix behaviour of max_rows_to_read for trival limit queries
2022-10-26 14:09:59 +02:00
Sergei Trifonov
34b43f8b4b
Merge branch 'master' into storage-system-moves
2022-10-25 22:56:45 +02:00
serxa
55a86bc2de
Add active moves system table
2022-10-25 13:56:46 +00:00
Anton Popov
c8199bc125
Merge branch 'master' into refactor-data-part
2022-10-25 14:31:05 +02:00
xiedeyantu
61563d4f19
better
2022-10-24 11:52:20 +08:00
Anton Popov
b40d9200d2
better semantic of constsness of DataPartStorage
2022-10-23 15:24:20 +00:00
Han Fei
2fc91fd338
fix behaviour of max_rows_to_read for trival limit queries
2022-10-22 18:27:24 +02:00
Azat Khuzhin
4e76629aaf
Fixes for -Wshorten-64-to-32
...
- lots of static_cast
- add safe_cast
- types adjustments
- config
- IStorage::read/watch
- ...
- some TODO's (to convert types in future)
P.S. That was quite a journey...
v2: fixes after rebase
v3: fix conflicts after #42308 merged
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-10-21 13:25:19 +02:00
xiedeyantu
32ad28cbe5
optimize code
2022-10-19 17:37:26 +08:00
xiedeyantu
b26361c647
fix test
2022-10-17 23:02:39 +08:00
xiedeyantu
9e62570d61
fix test
2022-10-17 22:57:11 +08:00
chen
0e86976e2b
Merge branch 'master' into system_table_add_column
2022-10-16 13:17:45 +08:00
Vitaly Baranov
91c438eebe
Merge pull request #42263 from vitlibar/refactor-udf
...
Refactor the implementation of user-defined functions
2022-10-15 12:33:10 +02:00
xiedeyantu
8ebe01d9cf
system.detached_parts add column bytes_on_disk and path
2022-10-14 11:43:42 +08:00
Vitaly Baranov
2e59d671fc
Split UserDefinedSQLObjectsLoader to interface and implementation.
2022-10-13 10:32:32 +02:00
Sergei Trifonov
a313aa4ede
Merge pull request #41908 from AlfVII/remove-table-is-dropped-exception-when-not-needed
...
Don't report TABLE_IS_DROPPED exception in order to skip table in case is was just dropped
2022-10-07 18:40:08 +02:00
Robert Schulze
78be400ac0
Merge remote-tracking branch 'origin/master' into generated-file-cleanup
2022-10-06 12:22:43 +00:00
Kseniia Sumarokova
3cff776109
Merge pull request #41254 from filimonov/system_disks_unreserved_space
...
Add unreserved_space column to system.disks
2022-10-06 12:28:23 +02:00
Robert Schulze
da5a2e2db0
Merge remote-tracking branch 'origin/master' into generated-file-cleanup
...
Physical merge conflicts:
- src/Common/ZooKeeper/ZooKeeperImpl.cpp
- src/Core/config_core.h.in
- src/Functions/FunctionsAES.h
- src/Functions/config_functions.h.in
- src/configure_config.cmake
Logical merge conflicts:
- Functions/tryDecrypt.cpp
2022-10-06 08:43:25 +00:00
Anton Popov
f61e98f0e8
Merge pull request #40668 from ClickHouse/async-insert-max-data-size-fix
...
Use settings from query context for async INSERTs
2022-10-05 15:15:19 +02:00
Kseniia Sumarokova
0bfbb5c38a
Merge branch 'master' into system_disks_unreserved_space
2022-10-03 14:25:47 +02:00
Alfonso Martinez
65b161341c
Replaced changed functions for tryLockForShare
2022-09-28 18:08:10 +02:00
Alfonso Martinez
6bb166b79b
exception replaced by nullptr
2022-09-28 17:41:51 +02:00
Robert Schulze
fd86829824
Consolidate config_core.h into config.h
...
Less duplication, less confusion ...
2022-09-28 13:31:57 +00:00
Robert Schulze
09c62f6728
Consolidate config_formats.h into config.h
...
Less duplication, less confusion ...
2022-09-28 12:59:05 +00:00
Robert Schulze
0753fd1c77
Consolidate config_functions.h into config.h
...
Less duplication, less confusion ...
2022-09-28 12:48:26 +00:00
Robert Schulze
78fc36ca49
Generate config.h into ${CONFIG_INCLUDE_PATH}
...
This makes the target location consistent with other auto-generated
files like config_formats.h, config_core.h, and config_functions.h and
simplifies the build of clickhouse_common.
2022-09-28 12:48:26 +00:00
Robert Schulze
1885bb0524
Make comment consistent accross generated files
2022-09-28 08:11:09 +00:00
Robert Schulze
588a5e5a42
Simplify a bit
2022-09-27 07:47:18 +00:00
Robert Schulze
ec35ff9cd6
Log git hash during startup
...
We currently only log a compiler-generated "build id" at startup which
is different for each build. That makes it useless to determine the
exact source code state in tests (e.g. BC test) and from user log files
(e.g. if someone compiled an intermediate version of ClickHouse).
Current log message:
Starting ClickHouse 22.10.1.1 with revision 54467, build id: 6F35820328F89C9F36E91C447FF9E61CAF0EF019, PID 42633
New log message:
Starting ClickHouse 22.10.1.1 (revision 54467, git hash: b6b1f7f763f94ffa12133679a6f80342dd1c3afe, build id: 47B12BE61151926FBBD230DE42F3B7A6652AC482), PID 981813
2022-09-26 14:12:36 +00:00
Nikita Mikhaylov
852d084950
Save
2022-09-26 10:24:39 +00:00