Commit Graph

1765 Commits

Author SHA1 Message Date
slvrtrn
d91a656dd4 Revert schemata.sql format 2023-09-18 22:33:16 +02:00
slvrtrn
ad7b707658 Update information_schema.tables sql and docs 2023-09-18 22:30:27 +02:00
slvrtrn
9a0d07c682 Update information_schema docs 2023-09-18 22:14:53 +02:00
slvrtrn
54f902f0b7 Adjust information_schema for Tableau Online 2023-09-18 19:50:05 +02:00
Robert Schulze
4373ed0f98
Added field "is_deterministic" to system.functions 2023-09-18 17:27:53 +00:00
Robert Schulze
f5e8028bb1
Merge pull request #54642 from rschu1ze/broken-re2st
Remove broken lockless variant of re2
2023-09-17 15:30:57 +02:00
Robert Schulze
7b378dbad3
Remove broken lockless variant of re2 2023-09-14 16:40:42 +00:00
Mikhail f. Shiryaev
bf962a8674
Merge pull request #54517 from HarryLeeIBM/hlee-s390x-jemalloc-bins
Fix endian issue in jemalloc_bins for s390x
2023-09-14 15:43:50 +02:00
Sergei Trifonov
12c71be9ca
Merge branch 'master' into async-loader-integration 2023-09-14 15:29:07 +02:00
serxa
09d4bf6930 add IO scheduling node for bandwidth throttling 2023-09-14 08:51:47 +00:00
Tim Windelschmidt
7979090333 use env to find bash 2023-09-13 18:57:11 +02:00
Alexey Milovidov
44a9dbd2b7
Update StorageSystemDetachedParts.cpp 2023-09-12 04:53:51 +03:00
HarryLeeIBM
26b17f88d5 Add comment for the fix 2023-09-11 13:52:58 -07:00
HarryLeeIBM
0a81389359 Fix endian issue in jemalloc_bins for s390x 2023-09-11 12:14:01 -07:00
Azat Khuzhin
8cd6153c83 Add modification_time into system.detached_parts
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-09-11 20:29:55 +02:00
Sergei Trifonov
08bad4d440
Merge pull request #47009 from ClickHouse/disks-and-io-sheduler 2023-09-11 07:22:14 +02:00
serxa
a2f8f6bf29 working on review comments 2023-09-07 13:21:43 +00:00
serxa
77697211cd add docs for system.scheduler + small fix 2023-09-06 19:30:39 +00:00
robot-clickhouse-ci-1
02339a1f22
Merge pull request #54326 from ClickHouse/fix_segfault_system_zookeeper
Fix segfault in system.zookeeper
2023-09-06 02:20:50 +02:00
Alexander Tokmakov
a8489c21da fix segfault in system.zookeeper 2023-09-05 20:23:16 +02:00
serxa
aa8e9c3cbc fix style 2023-09-04 14:18:54 +00:00
Sergei Trifonov
258da91b5f
Merge branch 'master' into disks-and-io-sheduler 2023-09-04 15:14:28 +02:00
serxa
b5233efc20 fix system table and scheduler config reloading 2023-09-04 12:35:17 +00:00
Victor Krasnov
78760639d2 Merge branch 'master' into ADQM-987 2023-09-04 13:59:20 +03:00
Alexey Milovidov
864e66cbf7 Fix TOCTOU 2023-09-04 04:06:24 +02:00
Alexey Milovidov
e618dc993e Fix bad code in the system.filesystem_cache 2023-09-04 03:53:18 +02:00
serxa
8fdd118e0c fix build 2023-09-03 22:40:00 +00:00
serxa
adcab639a4 add system.scheduler table for introspection 2023-09-03 21:48:33 +00:00
Sergei Trifonov
aac5b0386a
Update src/Storages/System/StorageSystemAsyncLoader.h 2023-09-01 20:40:38 +02:00
Alexey Milovidov
f8c2ea986d Update autogenerated version to 23.9.1.1 and contributors 2023-09-01 17:46:49 +02:00
Anton Popov
579ec699bf Merge remote-tracking branch 'upstream/master' into HEAD 2023-08-31 12:59:59 +00:00
Sergei Trifonov
c10e42ca05
Merge branch 'master' into async-loader-integration 2023-08-28 20:20:31 +02:00
Victor Krasnov
921f0c8b5d Merge branch 'master' into ADQM-987 2023-08-25 21:20:23 +03:00
Kseniia Sumarokova
34ac113af6
Merge pull request #53121 from kssenii/fix-cache-logical-error
Fix possible error from cache "Read unexpected size"
2023-08-25 12:16:24 +02:00
Kruglov Pavel
44db5fa992
Merge branch 'master' into cache-count 2023-08-24 17:21:18 +02:00
Kseniia Sumarokova
a4f39fe134
Merge branch 'master' into fix-cache-logical-error 2023-08-24 12:00:18 +02:00
helifu
adfdba4b83 Display reloaded values of server settings 2023-08-24 12:32:30 +08:00
kssenii
325e2d3172 Merge remote-tracking branch 'upstream/master' into system-sync-cache 2023-08-23 11:44:19 +02:00
Victor Krasnov
258f9927b4 Merge branch 'master' into ADQM-987 2023-08-22 16:49:32 +03:00
Kruglov Pavel
c0bdd0e00b
Merge branch 'master' into cache-count 2023-08-22 14:42:22 +02:00
avogar
b4145aeddc Cache number of rows in files for count in file/s3/url/hdfs/azure functions 2023-08-22 11:59:59 +00:00
alesapin
1a5a9fca87
Merge pull request #53605 from irenjj/feat_53538
Add column 'name' to system.clusters as an alias to cluster.
2023-08-22 11:34:21 +02:00
Anton Popov
3e9a182555 better interfaces for getting of stream name in part 2023-08-21 13:52:25 +00:00
Victor Krasnov
a7813260c0 Merge branch 'master' into ADQM-987 2023-08-21 14:45:13 +03:00
Kseniia Sumarokova
404fb0588a
Merge branch 'master' into fix-cache-logical-error 2023-08-20 16:28:13 +02:00
irenjj
a9b65ee929 Add Alias for system.clusters. 2023-08-20 14:47:07 +08:00
irenjj
71459c6d65 Revert 2023-08-20 14:35:59 +08:00
irenjj
e64a1fc26d Add column 'name' to system.clusters as an alias to cluster. 2023-08-20 11:52:14 +08:00
Kseniia Sumarokova
aeebedfa0d
Merge branch 'master' into system-sync-cache 2023-08-19 13:32:48 +04:00
Kseniia Sumarokova
c0b8d7eddf
Merge pull request #50999 from ilejn/system_kafka_consumers
system.kafka_consumers table to monitor kafka consumers
2023-08-19 13:31:18 +04:00
kssenii
247abe0a2a Merge remote-tracking branch 'upstream/master' into system-sync-cache 2023-08-19 08:43:53 +04:00
Alexey Milovidov
7ad8ea78bb
Merge pull request #48990 from incfly/partition
Add partition to the system part_log and merge table.
2023-08-18 21:38:53 +03:00
Alexander Tokmakov
89c365803f
Merge pull request #53424 from ClickHouse/exception_message_patterns6
Less exceptions with runtime format string
2023-08-17 17:58:04 +03:00
Anton Popov
0865c0794e Merge remote-tracking branch 'upstream/master' into HEAD 2023-08-17 14:08:59 +00:00
Jianfei Hu
bd4df60df6 fix merges
Signed-off-by: Jianfei Hu <hujianfei258@gmail.com>
2023-08-16 17:49:28 +00:00
Jianfei Hu
59a81b82bc wip the merge partition
Signed-off-by: Jianfei Hu <hujianfei258@gmail.com>
2023-08-16 17:49:28 +00:00
kssenii
2d74472ffb Merge remote-tracking branch 'upstream/master' into system-sync-cache 2023-08-15 20:31:26 +04:00
Anton Popov
5e90a6f88a Merge remote-tracking branch 'upstream/master' into HEAD 2023-08-15 00:27:35 +00:00
Alexander Tokmakov
894ec8e0d0 less exceptions with runtime format string 2023-08-14 21:45:59 +02:00
ltrk2
2846ea49b4
Merge branch 'master' into feature/mergetree-checksum-big-endian-support 2023-08-14 13:02:30 -04:00
Victor Krasnov
247cd63ca1 Merge branch 'master' into ADQM-987
# Conflicts:
#	src/Interpreters/Context.cpp
#	src/Interpreters/InterpreterSystemQuery.cpp
2023-08-14 10:33:56 +03:00
Smita Kulkarni
c25bb44e55 Fixed style check 2023-08-13 21:45:33 +02:00
Smita Kulkarni
ee772b7376 Avoid loading tables from lazy database when not needed 2023-08-13 20:15:58 +02:00
kssenii
8535e23f95 Merge remote-tracking branch 'upstream/master' into system-sync-cache 2023-08-13 21:10:42 +04:00
ltrk2
1dc1b54c68
Merge branch 'master' into feature/mergetree-checksum-big-endian-support 2023-08-11 07:48:49 -04:00
Ilya Golshtein
ade9c3d970 system_kafka_consumers: per consumer librdkafka stat 2023-08-10 22:35:05 +00:00
Ilya Golshtein
3bced2f08c system_kafka_consumers: tidy fix, one partition for stable test 2023-08-10 22:35:05 +00:00
Ilya Golshtein
978d8bf9a6 system_kafka_consumers: cleanup with exceptions 2023-08-10 22:35:05 +00:00
Ilya Golshtein
7dab2dc041 system_kafka_consumers: exceptions seem to work 2023-08-10 22:35:05 +00:00
Ilya Golshtein
80829a6bf7 system_kafka_consumers: no offset_committed, new test with MV 2023-08-10 22:35:05 +00:00
Ilya Golshtein
6d6aae24f8 system_kafka_consumers: no friendship with StorageKafka 2023-08-10 22:35:05 +00:00
Ilya Golshtein
b325ddceb4 system_kafka_consumers: small thing to make clang tidy happy 2023-08-10 22:35:05 +00:00
Ilya Golshtein
803a80b098 system_kafka_consumers: refactored with getStat, test passed 2023-08-10 22:35:05 +00:00
Ilya Golshtein
bba4dcacc7 system_kafka_consumers: small code cleanup 2023-08-10 22:35:05 +00:00
Ilya Golshtein
3f205f4997 system_kafka_consumers: tiny doc changes 2023-08-10 22:35:05 +00:00
Ilya Golshtein
b71c2bedfc system_kafka_consumers: rebalance test is ok, statistics_interval_ms 2023-08-10 22:35:05 +00:00
Ilya Golshtein
83566e132a system_kafka_consumers: all_consumers introduced, offsets work 2023-08-10 22:35:05 +00:00
Ilya Golshtein
c821c7788a system_kafka_consumers: json commented out 2023-08-10 22:35:05 +00:00
Ilya Golshtein
ae6e0469ad system_kafka_consumers: rdfakfa stat with attempt to use json 2023-08-10 22:35:05 +00:00
Ilya Golshtein
6258ab6cb4 system_kafka_consumers: doc link fix, USE_RDKAFKA 2023-08-10 22:35:05 +00:00
Ilya Golshtein
40fd53c3e3 system_kafka_consumers: style check 2023-08-10 22:35:05 +00:00
Ilya Golshtein
88f5dd5db8 system_kafka_consumers: integration tests passed 2023-08-10 22:35:05 +00:00
Ilya Golshtein
957787d96a system_kafka_consumers: kind of works, test added 2023-08-10 22:35:05 +00:00
Ilya Golshtein
36fb330811 system_kafka_consumers: assignments 2023-08-10 22:35:05 +00:00
Ilya Golshtein
a947c7a91e system_kafka_consumers: start integrating with real kafka 2023-08-10 22:35:05 +00:00
Ilya Golshtein
2304f342c9 system_kafka_consumers: table populated by fake data 2023-08-10 22:35:05 +00:00
Ilya Golshtein
9d68d50ae7 system_kafka_consumers: initial 2023-08-10 22:35:04 +00:00
ltrk2
a2054c04dd
Merge branch 'master' into feature/mergetree-checksum-big-endian-support 2023-08-10 10:21:34 -04:00
Alexey Milovidov
f35df23974
Merge branch 'master' into better-ccache 2023-08-10 16:52:32 +03:00
Victor Krasnov
a89d711113 Move BackupsWorker::Info to a separate file BackupOperationInfo.h 2023-08-10 13:29:20 +03:00
ltrk2
139e9433a8
Merge branch 'master' into feature/mergetree-checksum-big-endian-support 2023-08-09 09:48:00 -04:00
Kseniia Sumarokova
944e85d4e5
Merge branch 'master' into fix-cache-logical-error 2023-08-09 12:08:53 +02:00
Alexey Milovidov
fa9abc5038 Better usage of ccache 2023-08-09 05:02:50 +02:00
kssenii
43ed765231 Fix 2023-08-08 18:43:01 +02:00
kssenii
2c485e78db Merge remote-tracking branch 'upstream/master' into system-sync-cache 2023-08-08 16:27:21 +02:00
pufit
2f46ae850e
Merge branch 'master' into pufit/role-from-storage 2023-08-07 17:57:41 -04:00
kssenii
9cdd886fde Fix 2023-08-07 16:46:42 +02:00
Anton Popov
76b279ddb4 Merge remote-tracking branch 'upstream/master' into HEAD 2023-08-07 13:56:17 +00:00
Sergei Trifonov
432d359a2b
Merge branch 'master' into async-loader-integration 2023-08-04 18:51:06 +02:00
Alexander Tokmakov
968c79cf3f
Merge pull request #52956 from ClickHouse/fixes_for_databases
Fix some issues with databases
2023-08-03 19:13:41 +03:00
ltrk2
a29b36612b
Merge branch 'master' into feature/mergetree-checksum-big-endian-support 2023-08-03 09:41:25 -04:00
Nikolai Kochetov
5d64e036ba
Merge pull request #52695 from yariks5s/in_schema_case_sensitiveness
Information_schema case sensitiveness
2023-08-03 12:15:31 +02:00
Kseniia Sumarokova
0ec11a2d79
Merge branch 'master' into system-sync-cache 2023-08-03 12:02:18 +02:00
Alexander Tokmakov
48d736f8fd select only required columns from system.databases 2023-08-02 23:23:52 +02:00
Azat Khuzhin
cd74da4c03 Remove unused code in StorageSystemStackTrace
This columns mask is actually useless, since the main thing is done
without out, in particular:
- detect does the signal should be sent to thread
- does the thread name should be read for this thread

And this cannot be done with columns mask, because multiple columns
depends on signals and thread names.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-08-02 21:25:00 +02:00
ltrk2
27a2d4d1c7
Merge branch 'master' into feature/mergetree-checksum-big-endian-support 2023-08-02 11:36:43 -04:00
Yarik Briukhovetskyi
e811d5c4e9
Update attachInformationSchemaTables.cpp 2023-08-02 14:06:20 +02:00
Yarik Briukhovetskyi
dab77b044b
Update attachInformationSchemaTables.cpp 2023-08-02 13:23:18 +02:00
yariks5s
0174244fe1 fixed tests 2023-08-02 11:21:47 +00:00
yariks5s
6db7eaf4d8 fixed ast 2023-08-01 19:14:11 +00:00
Sergei Trifonov
e4ae2ece7c
Merge branch 'master' into async-loader-integration 2023-08-01 13:04:11 +02:00
yariks5s
964e4311c3 reviewed changes 2023-07-31 13:03:56 +00:00
kssenii
5d167b4f03 Merge remote-tracking branch 'upstream/master' into system-sync-cache 2023-07-31 12:44:11 +02:00
Kseniia Sumarokova
8daeeedc8f
Merge pull request #52315 from xiedeyantu/add-alias
system.events and system.metrics tables add column name as an alias to event and metric
2023-07-30 22:37:31 +02:00
Kseniia Sumarokova
08ef4d015c
Minor change 2023-07-30 13:36:52 +02:00
ltrk2
6c9a1b14ef
Merge branch 'master' into feature/mergetree-checksum-big-endian-support 2023-07-28 16:18:46 -04:00
pufit
6211845ef0
Merge pull request #51303 from ClickHouse/deprecate-metadata-cache
Deprecate the `metadata_cache` feature
2023-07-28 10:31:02 -04:00
yariks5s
96df21bbf5 implemented for all tables, fixed style and fast test 2023-07-28 13:35:13 +00:00
yariks5s
da53bca6e4 added tests 2023-07-27 18:29:50 +00:00
Alexey Milovidov
671128140d Update autogenerated version to 23.8.1.1 and contributors 2023-07-27 15:34:05 +02:00
Alexander Tokmakov
f3dc6dd061
Revert "Added field refcount to system.remote_data_paths table" 2023-07-27 15:23:57 +03:00
Alexey Milovidov
17b647f6b1
Merge pull request #52518 from CurtizJ/add-refcount-to-system-table
Added field `refcount` to `system.remote_data_paths` table
2023-07-27 12:13:24 +03:00
Anton Popov
568afbbec3 added field with refcount to system.remote_data_paths table 2023-07-25 12:33:15 +00:00
Kseniia Sumarokova
265e1437a3
Merge branch 'master' into add-alias 2023-07-24 21:52:41 +02:00
Alexey Milovidov
a17652a422 Merge branch 'master' into incbin 2023-07-24 05:33:52 +02:00
Alexey Milovidov
1e467867e6 Attempt to fix LTO 2023-07-24 00:03:40 +02:00
Alexey Milovidov
c8f8a23c71 Fix errors 2023-07-23 06:11:03 +02:00
Alexey Milovidov
4170d1458b Use incbin for resources, part 2 2023-07-23 06:11:03 +02:00
Alexey Milovidov
00d6f2ee08 Use incbin for resources, part 1 2023-07-23 06:11:03 +02:00
Kseniia Sumarokova
234a0fa7bc
Merge branch 'master' into add-alias 2023-07-22 14:48:49 +02:00
Alexey Milovidov
9dc988981e
Merge branch 'master' into is_obsolete 2023-07-22 04:59:26 +03:00
Sergei Trifonov
8eaf3b6d94
Merge branch 'master' into async-loader-integration 2023-07-21 21:46:06 +02:00
robot-ch-test-poll4
62e01df545
Merge pull request #52104 from filimonov/last_removal_attempt_time_typo
Fix typo last_removal_attemp_time
2023-07-21 14:49:36 +02:00
ltrk2
90a2c460c6
Merge branch 'master' into feature/mergetree-checksum-big-endian-support 2023-07-21 08:07:18 -04:00
Alexander Gololobov
03a890f91c
Merge branch 'master' into filter_system_databases 2023-07-20 12:38:15 +02:00
ltrk2
ba4072f049 Adapt changes around SipHash 2023-07-19 10:01:58 -07:00
Robert Schulze
3eb23d899f
Merge remote-tracking branch 'rschu1ze/master' into beautify-system-query-cache 2023-07-19 12:55:09 +00:00
xiedeyantu
d0e886070c system.events and system.metrics tables add column name as an alias to event and metric 2023-07-19 17:39:00 +08:00
Robert Schulze
f22452c78c
Beautify pretty-printing of the query string in SYSTEM.QUERY_CACHE.
Output of SYSTEM.QUERY_CACHE

- before this PR:

    SELECT * FROM system.query_cache

    Query id: 4989008b-b84c-4e57-bfe5-7fb551814812

    Row 1:
    ──────
    query:   	   SELECT 1 SETTINGS
    [...]

- after this PR:

    SELECT * FROM system.query_cache

    Query id: 4989008b-b84c-4e57-bfe5-7fb551814812

    Row 1:
    ──────
    query:   	   SELECT 1 SETTINGS use_query_cache = 1
    [...]
2023-07-19 09:10:26 +00:00
Sema Checherinda
ed5310ce48
Merge branch 'master' into last_removal_attempt_time_typo 2023-07-19 10:23:25 +02:00
Alexander Gololobov
44595b98d0 Update src/Storages/System/StorageSystemDatabases.cpp
Co-authored-by: Nikolay Degterinsky <43110995+evillique@users.noreply.github.com>
2023-07-18 08:25:38 +02:00
Alexander Gololobov
2f6bf4590b Filter databases list before querying potentially slow fields 2023-07-18 08:25:37 +02:00
Sergei Trifonov
850ab23991
Merge branch 'master' into async-loader-integration 2023-07-17 19:14:54 +02:00
Nikita Mikhaylov
d5b97e4cc1
Merge branch 'master' into deprecate-metadata-cache 2023-07-17 15:00:27 +02:00
Mikhail Filimonov
575de8d497 Fix typo last_removal_attemp_time 2023-07-14 07:04:17 +02:00
Yarik Briukhovetskyi
9afafa9554
Merge branch 'master' into add-index-bytes-to-system-parts 2023-07-11 14:51:46 +02:00
pufit
77e45e5669 Add DROP ROLE ... FROM and CREATE ROLE ... AT syntax 2023-07-10 20:23:03 -04:00
Alexey Milovidov
4c20d482ba
Merge branch 'master' into is_obsolete 2023-07-09 08:49:00 +03:00
Alexey Milovidov
612a785fd0
Merge pull request #51674 from ClickHouse/system_jemalloc
System table with jemalloc stats
2023-07-09 08:48:05 +03:00
Azat Khuzhin
a10aa9ad50 Force libunwind usage (removes gcc_eh support)
libunwind is reentrant and signal safe, and works faster then then
gcc_eh (plus it has some custom patches for problems that have been
found during it's usage in ClickHouse).

gcc_eh may be missing in the system (if gcc was not installed), and
even if it exists clickhouse uses -nodefaultlibs, so some care should be
made to make it work.

Also this library is tiny and there shouln't be any problem to require
it always (there is already tendency to require some contrib libraries,
i.e. poco).

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-07-08 20:55:50 +02:00
Alexander Gololobov
05649c7b38 Removed duplicate header 2023-07-07 13:22:52 +02:00
Alexander Gololobov
1336a9ec67 Better naming 2023-07-06 09:09:55 +02:00
Alexander Gololobov
5512c307db system.jemalloc_bins table 2023-07-05 14:34:03 +02:00
kssenii
80dabd1346 Merge remote-tracking branch 'upstream/master' into system-sync-cache 2023-07-05 12:58:11 +02:00
Alexey Milovidov
31f68c2c67 Merge branch 'master' into deprecate-metadata-cache 2023-07-04 22:28:14 +02:00
Alexey Milovidov
4e8405cbda Merge branch 'master' into disks-space-improvement 2023-07-04 22:00:40 +02:00
flynn
69d20c0458
Merge branch 'master' into is_obsolete 2023-07-04 16:46:25 +08:00
yariks5s
ad0bff919c
Merge branch 'master' into add-index-bytes-to-system-parts 2023-07-04 00:26:03 +02:00
Anton Popov
fd4a14d56b
Merge branch 'master' into system.parts_column_modification_time 2023-07-03 23:28:03 +02:00
Sergei Trifonov
bbb5850dec
Merge branch 'master' into async-loader-integration 2023-07-03 20:21:26 +02:00
serxa
a9c9acf42d fix prioritization/schedule race 2023-07-03 18:21:02 +00:00
Vitaly Baranov
8dd1b7b8b9
Merge branch 'master' into add-hex-functions-for-cityhash 2023-07-03 18:00:33 +02:00
yariks5s
b4bc8fe353
Merge branch 'master' into add-index-bytes-to-system-parts 2023-07-03 16:03:05 +02:00
Azat Khuzhin
22e44ced8a Add column modification time into system.parts_columns
This can be useful to obtain at least some time for the part after
mutations, since mutations will change the modification time of all
parts.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-07-03 13:34:05 +02:00
Vitaly Baranov
35d1b8448b
Merge branch 'master' into add-hex-functions-for-cityhash 2023-07-02 01:32:54 +02:00
yariks5s
e0b581d418
Merge branch 'master' into add-index-bytes-to-system-parts 2023-07-01 23:23:09 +02:00
Alexander Gololobov
f36f981f15 Move adding CreateSets to the end of optimizations, after applying key conditions and indexes 2023-07-01 20:05:18 +02:00
Alexey Milovidov
5ee7f47b03 Update autogenerated version to 23.7.1.1 and contributors 2023-06-30 17:09:56 +02:00
kssenii
c8ab68a5c3 Add test 2023-06-30 16:13:34 +02:00
Alexey Milovidov
2f8118fef9
Merge branch 'master' into is_obsolete 2023-06-30 12:08:38 +03:00
Antonio Andelic
3b7f6a4324
Merge pull request #50796 from ClickHouse/keeper-add-api-version-config
Add feature flags for Keeper API
2023-06-30 09:20:52 +02:00
flynn
be2bd989db
Merge branch 'master' into is_obsolete 2023-06-30 10:35:04 +08:00
kssenii
72d1834bbd system sync filesystem cache 2023-06-29 18:13:54 +02:00
yariks5s
2c3440be41
Merge branch 'master' into add-index-bytes-to-system-parts 2023-06-29 16:59:43 +02:00
Vitaly Baranov
0cccba62cf Support getHexUIntLowercase() with CityHash_v1_0_2::uint128 parameter. 2023-06-29 15:29:37 +02:00
Antonio Andelic
6e1aec6e0b
Merge branch 'master' into keeper-add-api-version-config 2023-06-29 11:36:49 +02:00
Vitaly Baranov
5570863676
Merge branch 'master' into reorder-part-checksum-halves 2023-06-28 17:25:34 +02:00
Antonio Andelic
be852d554b Use magic_enum for values 2023-06-28 07:45:20 +00:00
yariks5s
34094da1c4
Merge branch 'master' into add-index-bytes-to-system-parts 2023-06-28 00:19:13 +02:00
Sergei Trifonov
b9b007691c
Merge branch 'master' into async-loader-integration 2023-06-27 19:44:52 +02:00
yariks5s
f3f604ace4 added table with pk size 2023-06-27 17:06:09 +00:00
Antonio Andelic
efbe01b6bb Merge branch 'master' into keeper-add-api-version-config 2023-06-27 10:11:04 +00:00
Alexey Milovidov
b5635887c3 Merge remote-tracking branch 'origin/refactor-subqueries-for-in' into many-fixes 2023-06-27 05:39:44 +02:00
Sergei Trifonov
e2798b5221
Merge branch 'master' into async-loader-integration 2023-06-26 19:18:23 +02:00
Robert Schulze
fae545ae5c
Merge pull request #51132 from rschu1ze/inefficient-query-cache
Fix ineffective query cache for SELECTs with subqueries
2023-06-26 16:54:54 +02:00
Alexey Milovidov
b8e6bd3299
Merge branch 'master' into refactor-subqueries-for-in 2023-06-26 06:05:12 +03:00
Vitaly Baranov
f1f0daa654 Show halves of checksums in "system.parts", "system.projection_parts" and error messages in the correct order. 2023-06-25 17:17:56 +02:00
flynn
0243542587
Merge branch 'master' into is_obsolete 2023-06-25 16:54:54 +08:00
Vitaly Baranov
3711430d9f Rename member fields of CityHash_v1_0_2::uint128: "first" -> "low64", "second" -> "high64". 2023-06-24 12:25:56 +02:00
Alexey Milovidov
f0563ae719 Remove the system.metadata_cache table 2023-06-23 02:32:28 +02:00
Nikolai Kochetov
22e49748b5 Cleanup. 2023-06-22 14:23:04 +00:00
Nikolai Kochetov
a940031878 Merge branch 'master' into refactor-subqueries-for-in 2023-06-22 12:18:48 +02:00
kssenii
78ea4feca0 Merge remote-tracking branch 'upstream/master' into delete-non-evictable-feature 2023-06-21 20:52:08 +02:00
kssenii
9aa4647f4f Delete feature 2023-06-21 20:48:12 +02:00
Alexander Gololobov
a23caab98c
Merge branch 'master' into sys_zookeep_more_parallel_get 2023-06-21 12:16:57 +02:00
Robert Schulze
dcfcbd8345
Merge remote-tracking branch 'rschu1ze/master' into inefficient-query-cache 2023-06-21 09:23:31 +00:00
Robert Schulze
9b959eb1fb
Merge pull request #49577 from tpanetti/mysql_compatible_types
Change SHOW COLUMNS query to display MySQL types in MySQL Compatibility mode
2023-06-21 11:04:22 +02:00
Robert Schulze
bc7df2baca
Merge branch 'master' into non-experimental-qpl-deflate 2023-06-20 20:06:01 +02:00
Alexander Gololobov
7a1f8547f3 Simplify the code 2023-06-20 17:18:05 +02:00
Alexander Gololobov
816c6cdeb1 Simplify the code by using tryGetChildren 2023-06-20 16:56:50 +02:00
郭小龙
154d19ce72
The time format (connected_time field) is incorrect (#51026)
* The time format (connected_time field) is incorrect

* Change the description and increase the field list display

* Update 02735_system_zookeeper_connection.reference

* Update 02735_system_zookeeper_connection.sql

* Update 02735_system_zookeeper_connection.sql

* Update 02735_system_zookeeper_connection.reference

* fix test

---------

Co-authored-by: Alexander Tokmakov <tavplubix@gmail.com>
Co-authored-by: Alexander Tokmakov <tavplubix@clickhouse.com>
2023-06-20 16:57:55 +03:00
Sergei Trifonov
02e0d7e204
Merge branch 'master' into async-loader-integration 2023-06-20 12:03:29 +02:00
Alexander Gololobov
44f1f036e8 Use multi-read requests for list and get 2023-06-19 16:47:17 +02:00
Anton Popov
c8316837e3 Merge remote-tracking branch 'upstream/master' into HEAD 2023-06-19 13:16:10 +00:00
Alexander Gololobov
59c11cb150 Make more parallel get requests to ZooKeeper 2023-06-18 08:26:37 +02:00
Robert Schulze
5311ebe1d2
Make query cache work effective with nested queries. 2023-06-17 20:27:25 +00:00
Nikolai Kochetov
afa74f697c Refactor a bit. 2023-06-16 19:38:50 +00:00
Alexander Gololobov
f08fd758fa Make multiple parallel list requests 2023-06-15 18:45:10 +02:00
Azat Khuzhin
e9c9db9335 Disable parallelize_output_from_storages for all system tables
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-06-14 19:11:23 +03:00
Azat Khuzhin
3c4f638bd7 Disable parallelize_output_from_storages for storages with only one block
$ clickhouse-benchmark -i 10000 -d 0 --parallelize_output_from_storages=0 -q "select * from values('foo')"
    Loaded 1 queries.

    Queries executed: 10000.

    localhost:9000, queries 10000, QPS: 2800.490, RPS: 2800.490, MiB/s: 0.032, result RPS: 2800.490, result MiB/s: 0.032.

    0.000%          0.000 sec.
    10.000%         0.000 sec.
    20.000%         0.000 sec.
    30.000%         0.000 sec.
    40.000%         0.000 sec.
    50.000%         0.000 sec.
    60.000%         0.000 sec.
    70.000%         0.000 sec.
    80.000%         0.000 sec.
    90.000%         0.000 sec.
    95.000%         0.000 sec.
    99.000%         0.001 sec.
    99.900%         0.001 sec.
    99.990%         0.001 sec.

    $ clickhouse-benchmark -i 10000 -d 0 --parallelize_output_from_storages=1 -q "select * from values('foo')"
    Loaded 1 queries.

    Queries executed: 10000.

    localhost:9000, queries 10000, QPS: 1259.805, RPS: 1259.805, MiB/s: 0.014, result RPS: 1259.805, result MiB/s: 0.014.

    0.000%          0.001 sec.
    10.000%         0.001 sec.
    20.000%         0.001 sec.
    30.000%         0.001 sec.
    40.000%         0.001 sec.
    50.000%         0.001 sec.
    60.000%         0.001 sec.
    70.000%         0.001 sec.
    80.000%         0.001 sec.
    90.000%         0.001 sec.
    95.000%         0.001 sec.
    99.000%         0.001 sec.
    99.900%         0.001 sec.
    99.990%         0.003 sec.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-06-14 19:11:23 +03:00
Antonio Andelic
4ac090b122 Fix tests 2023-06-13 11:01:44 +00:00
Antonio Andelic
a7e6264d56 Add backward compatibility 2023-06-12 13:12:05 +00:00
Antonio Andelic
b634012feb Add feature flags for Keeper API 2023-06-12 10:57:03 +00:00
Robert Schulze
8222861f2e
Merge remote-tracking branch 'rschu1ze/master' into non-experimental-qpl-deflate 2023-06-11 14:39:30 +00:00
tpanetti
cb8c20722b Rename setting and description for MySQL compatible types
This renames the setting for MySQL compatible types from output_format_mysql_types to use_mysql_types_in_show_columns
2023-06-10 08:38:10 -07:00
flynn
4a7761c162 Add column is_obsolete for system.settings table and related system tables 2023-06-10 08:26:32 +00:00
Thomas Panetti
5769d7feca
Merge branch 'master' into mysql_compatible_types 2023-06-09 13:52:16 -07:00
Nikolai Kochetov
6ce8329bda Merge branch 'master' into refactor-subqueries-for-in 2023-06-09 20:04:27 +02:00
Robert Schulze
1f928f2d3d
Update StorageSystemBuildOptions.cpp.in 2023-06-09 12:43:30 +00:00
jinjunzh
cbdb408ec8
add USE_QPL for buildoptions 2023-06-09 12:43:12 +00:00
Alexey Milovidov
bc2af59278 Update autogenerated version to 23.6.1.1 and contributors 2023-06-09 13:38:30 +02:00
Robert Schulze
172dd4af73
Show correct staleness value in system.query_cache 2023-06-08 21:05:05 +00:00
Antonio Andelic
b11f744252
Correctly disable async insert with deduplication when it's not needed (#50663)
* Correctly disable async insert when it's not used

* Better

* Add comment

* Better

* Fix tests

---------

Co-authored-by: Nikita Mikhaylov <mikhaylovnikitka@gmail.com>
2023-06-07 20:33:08 +02:00
Sergei Trifonov
0cbcff958a
Merge branch 'master' into async-loader-integration 2023-06-07 18:55:04 +02:00
Thomas Panetti
016e30c376
Merge branch 'master' into mysql_compatible_types 2023-06-07 08:26:58 -07:00
Nikita Mikhaylov
e87348010d
Rework loading and removing of data parts for MergeTree tables. (#49474)
Co-authored-by: Sergei Trifonov <sergei@clickhouse.com>
2023-06-06 14:42:56 +02:00
Anton Popov
b30544a6ab allow to replace long file names to hashes 2023-06-06 01:39:45 +00:00
tpanetti
495482cdb2 Refactor ClickHouse->MySQL Type conversion and add configuration setting to trigger type conversion 2023-06-05 15:22:29 -07:00
Sergei Trifonov
cb37506421
Merge branch 'master' into async-loader-integration 2023-06-05 21:33:44 +02:00
János Benjamin Antal
e140cad10c Clean up includes 2023-06-05 10:18:36 +00:00
serxa
443ec12f66 introduce unique job_id in async_loader 2023-06-03 15:16:21 +00:00
János Benjamin Antal
5e17adc9c0 Add system.user_processes table 2023-06-02 14:08:14 +00:00
serxa
d364cd067f fix system.async_loader 2023-05-31 18:08:03 +00:00
tpanetti
38634cc5c5 Convert Clickhouse Types to MySQL types in Compatibility mode
This changes MySQL compatibility mode to display MySQL compatible types
2023-05-30 13:29:17 -07:00
Nikolai Kochetov
6ed7a3b73f Fixing more tests. 2023-05-26 19:25:33 +00:00
Sergei Trifonov
fe172f59db
Merge branch 'master' into async-loader-integration 2023-05-26 18:56:08 +02:00
Nikolai Kochetov
b5b261b22c Merge branch 'master' into refactor-subqueries-for-in 2023-05-25 21:22:06 +02:00
Nikolai Kochetov
30ff5113d9 Fixing more tests. 2023-05-25 13:33:52 +00:00
何李夫
e4c8c4cecf
Add zookeeper name in endpoint id (#49780)
* Add zookeeper name in endpoint id

When we migrate a replicated table from one zookeeper cluster to
another (the reason why we migration is that zookeeper's load is
too high), we will create a new table with the same zpath, but it
will fail and the old table will be in trouble.

Here is some infomation:
1.old table:
  CREATE TABLE a1 (`id` UInt64)
  ENGINE = ReplicatedMergeTree('/clickhouse/tables/default/a1/{shard}', '{replica}')
  ORDER BY (id);
2.new table:
  CREATE TABLE a2 (`id` UInt64)
  ENGINE = ReplicatedMergeTree('aux1:/clickhouse/tables/default/a1/{shard}', '{replica}')
  ORDER BY (id);
3.error info:
  <Error> executeQuery: Code: 220. DB::Exception: Duplicate interserver IO endpoint:
          DataPartsExchange:/clickhouse/tables/default/a1/01/replicas/02.
          (DUPLICATE_INTERSERVER_IO_ENDPOINT)
  <Error> InterserverIOHTTPHandler: Code: 221. DB::Exception: No interserver IO endpoint
          named DataPartsExchange:/clickhouse/tables/default/a1/01/replicas/02.
          (NO_SUCH_INTERSERVER_IO_ENDPOINT)

* Revert "Add zookeeper name in endpoint id"

This reverts commit 9deb75b249619b7abdd38e3949ca8b3a76c9df8e.

* Add zookeeper name in endpoint id

When we migrate a replicated table from one zookeeper cluster to
another (the reason why we migration is that zookeeper's load is
too high), we will create a new table with the same zpath, but it
will fail and the old table will be in trouble.

* Fix incompatible with a new setting

* add a test, fix other issues

* Update 02442_auxiliary_zookeeper_endpoint_id.sql

* Update 02735_system_zookeeper_connection.reference

* Update 02735_system_zookeeper_connection.sql

* Update run.sh

* Remove the 'no-fasttest' tag

* Update 02442_auxiliary_zookeeper_endpoint_id.sql

---------

Co-authored-by: Alexander Tokmakov <tavplubix@clickhouse.com>
Co-authored-by: Alexander Tokmakov <tavplubix@gmail.com>
2023-05-25 12:50:14 +03:00
Sergei Trifonov
994cfaf15b
Merge branch 'master' into async-loader-integration 2023-05-22 19:03:11 +02:00
Nikolai Kochetov
ff6400f91a Merge branch 'master' into refactor-subqueries-for-in 2023-05-22 13:07:51 +02:00
mateng915
5237dd0245
New system table zookeeper connection (#45245)
* Feature: Support new system table to show which zookeeper node be connected

Description:
============
Currently we have no place to check which zk node be connected otherwise using
lsof command. It not convenient

Solution:
=========
Implemented a new system table, system.zookeeper_host when CK Server has zk
this table will show the zk node dir which connected by current CK server

Noted: This table can support multi-zookeeper cluster scenario.

* fixed review comments

* added test case

* update test cases

* remove unused code

* fixed review comments and removed unused code

* updated test cases for print host, port and is_expired

* modify the code comments

* fixed CI Failed

* fixed code style check failure

* updated test cases by added Tags

* update test reference

* update test cases

* added system.zookeeper_connection doc

* Update docs/en/operations/system-tables/zookeeper_connection.md

* Update docs/en/operations/system-tables/zookeeper_connection.md

* Update docs/en/operations/system-tables/zookeeper_connection.md

---------

Co-authored-by: Alexander Tokmakov <tavplubix@gmail.com>
2023-05-19 17:06:43 +03:00
Vitaly Baranov
801cacc13f
Merge pull request #49831 from vitlibar/fix-setting-null-in-profile-def
Fix setting NULL in profile definition
2023-05-15 22:24:49 +02:00
Sergei Trifonov
e2c1581fd0
Merge branch 'master' into async-loader-integration 2023-05-14 15:20:03 +02:00
Alexey Milovidov
5a44dc26e7 Fixes for clang-17 2023-05-13 02:57:31 +02:00
Sergei Trifonov
426184ef73
Merge branch 'master' into async-loader-integration 2023-05-12 19:55:24 +02:00
Robert Schulze
922420420c
Merge pull request #49300 from ClickHouse/rs/functdocs
Introduce more fields for in-source function documentation
2023-05-12 11:36:04 +02:00
Vitaly Baranov
eb62030fa4 Fix assigning a setting to NULL in settings profile's definition. 2023-05-12 11:04:30 +02:00
Sergei Trifonov
b479637e2c
Merge branch 'master' into async-loader-integration 2023-05-09 13:04:36 +02:00
Alexey Milovidov
6b742bb1d1
Merge branch 'master' into system-stack-trace-fix 2023-05-07 06:05:47 +03:00