thevar1able/ClickHouse
1
0
Fork 0
mirror of https://github.com/ClickHouse/ClickHouse.git synced 2024-12-14 10:22:10 +00:00
Code Issues Packages Projects Releases Wiki Activity
117,803 Commits 9,328 Branches 1,783 Tags 2.1 GiB
71678f64b1
Commit Graph

13198 Commits

Author SHA1 Message Date
Nikita Taranov
90ced1aebc use int64 2023-06-19 13:48:52 +02:00
Sema Checherinda
a2d5c91a28 cancel temp part with exception context when deduplication triggered 2023-06-19 12:52:20 +02:00
Alexander Tokmakov
a00842498e Merge branch 'master' into rmt_better_background_tasks_scheduling 2023-06-19 12:37:17 +02:00
Sema Checherinda
e3f892f84a fix gtest with MemoryWriteBuffer, do not mute exception in ReplicatedMergeMutateTaskBase 2023-06-19 00:10:42 +02:00
Sema Checherinda
2bbfa279ec fix gtest_lru_file_cache, fix remove from pending 2023-06-18 21:05:00 +02:00
Sema Checherinda
ce7cd67981 finalize CascadeWriteBuffer 2023-06-18 17:35:12 +02:00
Alexander Gololobov
59c11cb150 Make more parallel get requests to ZooKeeper 2023-06-18 08:26:37 +02:00
Alexey Milovidov
ce38d64c5a
Merge pull request #50856 from ClickHouse/relax-too-many-parts 
Relax "too many parts" further
 2023-06-18 01:49:46 +03:00
Alexander Tokmakov
b4e455430c
Merge branch 'master' into rmt_better_background_tasks_scheduling 2023-06-17 22:19:21 +03:00
Alexey Milovidov
c7a18c640e Slightly better diagnostics 2023-06-17 17:20:44 +02:00
Alexey Milovidov
61e423c5df Fix typo 2023-06-17 17:14:49 +02:00
Alexey Milovidov
98bc124317 Fix typo 2023-06-17 17:13:19 +02:00
Alexey Milovidov
a18dc73271 Fix error 2023-06-16 23:12:01 +02:00
Alexey Milovidov
688d5d59af Merge branch 'master' into relax-too-many-parts 2023-06-16 23:08:29 +02:00
Alexey Milovidov
ec952d401d
Merge pull request #51114 from ClickHouse/clang-17-3 
Compatibility with clang-17
 2023-06-17 00:07:45 +03:00
Alexey Milovidov
d94e47a930 Compatibility with clang-17 2023-06-16 23:07:19 +02:00
Alexey Milovidov
4e45e39e25
Merge pull request #51099 from ClickHouse/fix_use_local_vars_after_exception 
Fix for part_names_mutex used after destruction
 2023-06-16 23:52:50 +03:00
Alexey Milovidov
782889a051
Merge pull request #51042 from ClickHouse/sys_zookeep_parallel_list 
Make multiple parallel list requests when reading from system.zookeeper
 2023-06-16 23:46:53 +03:00
Sema Checherinda
e8d4dedbcc fix build and tests 2023-06-16 19:52:52 +02:00
Alexander Gololobov
8289d8fefa Fix for part_names_mutex used after destruction 2023-06-16 18:46:07 +02:00
avogar
56789af0fa Remove loggig 2023-06-16 15:55:05 +00:00
avogar
3209ebe34b Improve progress bar for file/s3/hdfs/url table functions. Step 1 2023-06-16 15:51:18 +00:00
Nikita Taranov
841d58f6ba
Small fix in MergeTreePrefetchedReadPool 2023-06-16 16:58:01 +02:00
Sema Checherinda
47484faace do abort/cancel/deletion merge/mutate task with exception context 2023-06-16 16:48:21 +02:00
Sema Checherinda
b428f88f22 finalize hashing buffer 2023-06-16 16:38:18 +02:00
Sema Checherinda
1cb02e2710 do call finalize for all buffers 2023-06-16 16:38:18 +02:00
Nikolai Kochetov
df1ea0b572
Merge pull request #50489 from ClickHouse/vdimir/alter_moving_garbage 
Cleanup moving parts
 2023-06-16 15:39:32 +02:00
Kruglov Pavel
dcc3efe4b7
Merge pull request #50364 from Avogar/allow-skip-empty-files 
Allow to skip empty files in file/s3/url/hdfs table functions
 2023-06-16 14:59:49 +02:00
Alexander Tokmakov
9260a1bf2e
Merge pull request #51006 from ClickHouse/followup_50448 
Follow-up to #50448
 2023-06-16 15:32:12 +03:00
Kruglov Pavel
f8ddfb1fd8
Merge branch 'master' into allow-skip-empty-files 2023-06-16 13:23:41 +02:00
zvonand
4155d13d69 merge master and resolve conflict 2023-06-16 02:20:32 +02:00
Alexander Gololobov
f08fd758fa Make multiple parallel list requests 2023-06-15 18:45:10 +02:00
Alexander Tokmakov
b248ba730a
Merge pull request #50997 from vitlibar/use-hash_of_all_files-for-parts 
Use hash_of_all_files to check identity of parts during on-cluster backups
 2023-06-15 16:54:55 +03:00
Alexander Tokmakov
dc0a224f52 fix 2023-06-15 15:05:17 +02:00
avogar
870f3d1270 Fix comments 2023-06-15 12:59:46 +00:00
Kseniia Sumarokova
c15e7b93cb
Merge pull request #50976 from kssenii/fix-data-lakes-too-many-head-requests 
Fix data lakes slowness because of synchronous head requests
 2023-06-15 13:33:09 +02:00
Igor Nikonov
1113a7c524
Merge pull request #50214 from azat/parallelize_output_from_storages-fix 
Disable parallelize_output_from_storages for processing MATERIALIZED VIEWs and storages with one block only
 2023-06-15 12:48:54 +02:00
Alexander Tokmakov
a018d9ca11 try to fix false-positive 'part is lost forever' 2023-06-15 12:25:16 +02:00
Kruglov Pavel
7aea4a1f10
Merge branch 'master' into allow-skip-empty-files 2023-06-15 12:07:24 +02:00
Kseniia Sumarokova
c786fbf8bd
Add comment 2023-06-15 10:22:02 +02:00
Kseniia Sumarokova
c8619ee6e4
Merge pull request #50974 from kssenii/iceberg-metadata-fix 
Fix iceberg V2 optional metadata parsing
 2023-06-15 09:31:36 +02:00
Vitaly Baranov
6366940a37 Use hash_of_all_files from system.parts to check identity of parts during on-cluster backups. 2023-06-14 20:39:50 +02:00
Azat Khuzhin
e9c9db9335 Disable parallelize_output_from_storages for all system tables 
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-06-14 19:11:23 +03:00
Azat Khuzhin
3c4f638bd7 Disable parallelize_output_from_storages for storages with only one block 
$ clickhouse-benchmark -i 10000 -d 0 --parallelize_output_from_storages=0 -q "select * from values('foo')"
    Loaded 1 queries.

    Queries executed: 10000.

    localhost:9000, queries 10000, QPS: 2800.490, RPS: 2800.490, MiB/s: 0.032, result RPS: 2800.490, result MiB/s: 0.032.

    0.000%          0.000 sec.
    10.000%         0.000 sec.
    20.000%         0.000 sec.
    30.000%         0.000 sec.
    40.000%         0.000 sec.
    50.000%         0.000 sec.
    60.000%         0.000 sec.
    70.000%         0.000 sec.
    80.000%         0.000 sec.
    90.000%         0.000 sec.
    95.000%         0.000 sec.
    99.000%         0.001 sec.
    99.900%         0.001 sec.
    99.990%         0.001 sec.

    $ clickhouse-benchmark -i 10000 -d 0 --parallelize_output_from_storages=1 -q "select * from values('foo')"
    Loaded 1 queries.

    Queries executed: 10000.

    localhost:9000, queries 10000, QPS: 1259.805, RPS: 1259.805, MiB/s: 0.014, result RPS: 1259.805, result MiB/s: 0.014.

    0.000%          0.001 sec.
    10.000%         0.001 sec.
    20.000%         0.001 sec.
    30.000%         0.001 sec.
    40.000%         0.001 sec.
    50.000%         0.001 sec.
    60.000%         0.001 sec.
    70.000%         0.001 sec.
    80.000%         0.001 sec.
    90.000%         0.001 sec.
    95.000%         0.001 sec.
    99.000%         0.001 sec.
    99.900%         0.001 sec.
    99.990%         0.003 sec.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-06-14 19:11:23 +03:00
kssenii
827ac17dc2 Fix 2023-06-14 12:59:06 +02:00
kssenii
47a6db596e Better 2023-06-14 11:37:57 +02:00
kssenii
2a3ef3941e Fix 2023-06-14 11:31:28 +02:00
Thomas Panetti
a502967e1a
Merge branch 'master' into mysql_compatible_types 2023-06-13 20:30:16 -07:00
pufit
91d794cf0a
Merge pull request #50150 from JackyWoo/support_redis 
Add Redis table Engine/Function
 2023-06-13 21:34:14 -04:00
Kruglov Pavel
39ba925f8b
Merge branch 'master' into allow-skip-empty-files 2023-06-13 17:17:26 +02:00
Thomas Panetti
fa4bc6b7c5
Merge branch 'master' into mysql_compatible_types 2023-06-13 08:13:15 -07:00
Dmitry Novik
23c478f8b5
Merge branch 'master' into parallel_replicas_analyzer 2023-06-13 17:09:18 +02:00
avogar
2e1f56ae33 Address comments 2023-06-13 14:43:50 +00:00
Anton Popov
79f3300709
Merge pull request #50726 from CurtizJ/enable-mutations-throttling 
Enable settings for mutations throttling by default
 2023-06-13 14:57:36 +02:00
Dmitry Novik
f4ed10c0a2
Update src/Storages/StorageReplicatedMergeTree.cpp 2023-06-13 14:44:39 +02:00
Sema Checherinda
2c018f5261 do not call finalize after exception 2023-06-13 10:48:31 +02:00
JackyWoo
9d548315e8
Merge branch 'master' into support_redis 2023-06-13 09:34:32 +08:00
JackyWoo
959fde4491 add notifications in docs 2023-06-13 09:33:38 +08:00
Alexey Milovidov
4e7cd2da01
Merge pull request #50811 from ClickHouse/tavplubix-patch-6 
Don't mark a part as broken on `Poco::TimeoutException`
 2023-06-12 23:17:37 +03:00
Robert Schulze
7745f7da73
Merge branch 'master' into annoy-misc 2023-06-12 21:46:27 +02:00
Kruglov Pavel
e4838725e3
Merge branch 'master' into allow-skip-empty-files 2023-06-12 20:03:23 +02:00
Dmitry Novik
d05f89f8f5 Fix style 2023-06-12 17:33:15 +00:00
Dmitry Novik
326a3a3e8d Use query tree to rewrite the query 2023-06-12 16:51:40 +00:00
Dmitry Novik
d606e2190c
Merge branch 'master' into parallel_replicas_analyzer 2023-06-12 18:49:54 +02:00
Thomas Panetti
8683f5e48d
Merge branch 'master' into mysql_compatible_types 2023-06-12 08:19:59 -07:00
Robert Schulze
3617316026
Merge branch 'master' into non-experimental-qpl-deflate 2023-06-12 16:01:45 +02:00
Anton Popov
d45f07743c fix getting number of mutations 2023-06-12 13:54:07 +00:00
Alexander Tokmakov
01c7d2fe71
Prostpone check of outdated parts (#50676) 
* prostpone check of outdated parts

* Update ReplicatedMergeTreePartCheckThread.cpp
 2023-06-12 16:53:26 +03:00
Alexander Tokmakov
5db3b393d8
Update MergeTreeData.cpp 2023-06-12 16:22:33 +03:00
Anton Popov
32caf87163
Merge pull request #50104 from amosbird/fix_43107_47549 
Proper mutation of skip indices and projections
 2023-06-12 15:09:18 +02:00
Kruglov Pavel
873cee9451
Merge pull request #49626 from alekseygolub/renamefile 
Added option to rename files, loaded via TableFunctionFile, after successful processing
 2023-06-12 15:01:22 +02:00
Alexander Tokmakov
676ba2fbde
Update MergeTreeData.cpp 2023-06-12 12:30:38 +03:00
JackyWoo
ef40c029a5 fix style 2023-06-12 11:54:42 +08:00
JackyWoo
7bcaf8b233 fix build error 2023-06-12 10:15:32 +08:00
JackyWoo
a1641aa25d
Merge branch 'master' into support_redis 2023-06-12 09:53:06 +08:00
Alexander Tokmakov
3797a4202c
Update MergeTreeData.cpp 2023-06-11 23:38:31 +03:00
Alexey Milovidov
598501011f Relax "too many parts" further 2023-06-11 17:51:54 +02:00
Robert Schulze
8222861f2e
Merge remote-tracking branch 'rschu1ze/master' into non-experimental-qpl-deflate 2023-06-11 14:39:30 +00:00
Nikolay Degterinsky
dc9001a969
Merge pull request #50061 from evillique/update-mongo 
Update MongoDB protocol & fix inserts
 2023-06-10 22:52:15 +02:00
Alexey Milovidov
ed9c7c9841
Merge pull request #50711 from kssenii/get-rid-of-uneeded-code 
Refactor reading from object storages
 2023-06-10 19:10:25 +03:00
tpanetti
cb8c20722b Rename setting and description for MySQL compatible types 
This renames the setting for MySQL compatible types from output_format_mysql_types to use_mysql_types_in_show_columns
 2023-06-10 08:38:10 -07:00
Nikolay Degterinsky
9ad8e022a8
Merge branch 'master' into update-mongo 2023-06-10 10:58:02 +02:00
Thomas Panetti
5769d7feca
Merge branch 'master' into mysql_compatible_types 2023-06-09 13:52:16 -07:00
Robert Schulze
c538506f2e
More fixes 2023-06-09 20:50:17 +00:00
Alexander Tokmakov
13798f8b07
Update MergeTreeData.cpp 2023-06-09 19:52:49 +03:00
pufit
55d228e78e
Merge branch 'master' into support_redis 2023-06-09 11:45:12 -04:00
Sergei Trifonov
8710154510
Merge pull request #50677 from ClickHouse/unify-priorities-executable-tasks 
Unify priorities: `IExecutableTask`s
 2023-06-09 17:19:46 +02:00
Robert Schulze
1aa158909e
enable_qpl_deflate_codec --> enable_deflate_qpl_codec 2023-06-09 12:43:33 +00:00
Robert Schulze
1f928f2d3d
Update StorageSystemBuildOptions.cpp.in 2023-06-09 12:43:30 +00:00
jinjunzh
f1192d59af
refine patch according to comments 2023-06-09 12:43:15 +00:00
jinjunzh
cbdb408ec8
add USE_QPL for buildoptions 2023-06-09 12:43:12 +00:00
jinjunzh
056ca4f555
Add extensive testing cases for deflate qpl codec 2023-06-09 12:42:59 +00:00
Alexey Milovidov
d4602f7e1f
Merge pull request #50772 from ClickHouse/23.6-prepare 
Update version after release
 2023-06-09 14:39:39 +03:00
Alexey Milovidov
bc2af59278 Update autogenerated version to 23.6.1.1 and contributors 2023-06-09 13:38:30 +02:00
flynn
ad74189bc2
Fix Log family table return wrong rows count after truncate (#50585) 
* Fix Log family table return wrong rows count after truncate

* fix test

* update test

* update test
 2023-06-09 14:32:45 +03:00
Alexander Tokmakov
8f9c74debb
Support OPTIMIZE for temporary tables (#50710) 
* Update InterpreterOptimizeQuery.cpp

* Update 02525_different_engines_in_temporary_tables.sql

* Update MergeTreeData.cpp
 2023-06-09 14:31:49 +03:00
alesapin
2fec796e73
Merge pull request #50604 from ClickHouse/azure_table_function 
Azure table function
 2023-06-09 11:44:04 +02:00
Robert Schulze
172dd4af73
Show correct staleness value in system.query_cache 2023-06-08 21:05:05 +00:00
Anton Popov
f34937687e enable settings for mutation throttling by default 2023-06-08 18:00:54 +00:00
Andrey Zvonov
d95be4162f
Merge branch 'master' into zvonand-implicit-tz 2023-06-08 18:34:45 +03:00