thevar1able/ClickHouse
1
0
Fork 0
mirror of https://github.com/ClickHouse/ClickHouse.git synced 2024-11-26 01:22:04 +00:00
Code Issues Packages Projects Releases Wiki Activity
120,784 Commits 9,175 Branches 1,781 Tags 2.1 GiB
e869adf645
Commit Graph

120784 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
ltrk2
e869adf645 Improve function naming 2023-07-31 06:48:50 -07:00
ltrk2
6c9a1b14ef
Merge branch 'master' into feature/mergetree-checksum-big-endian-support 2023-07-28 16:18:46 -04:00
pufit
6211845ef0
Merge pull request #51303 from ClickHouse/deprecate-metadata-cache 
Deprecate the `metadata_cache` feature
 2023-07-28 10:31:02 -04:00
Alexander Tokmakov
39200606ec
Merge pull request #52174 from arenadata/ADQM-988 
Added possibility to save logs on crash and options to configure logs buffer
 2023-07-28 16:55:00 +03:00
Alexander Tokmakov
0160a95266
Merge pull request #52634 from arthurpassos/modify_c_ares_logic 
init and destroy ares channel on demand..
 2023-07-28 16:54:24 +03:00
Alexander Tokmakov
29d9b82954
Merge pull request #52744 from ClickHouse/merging_52640 
Merging #52640
 2023-07-28 16:50:12 +03:00
Alexander Gololobov
bf9504d95d
Move UnlinkMetadataFileOperationOutcome to common header (#52710) 2023-07-28 15:49:55 +02:00
Alexander Tokmakov
139033247c bypass a limitation of github 2023-07-28 15:46:45 +02:00
Yakov Olkhovskiy
61d05aeca4
Merge pull request #51642 from ClickHouse/fix-nullable-ipv4-intdiv 
Fix binary arithmetic for Nullable(IPv4)
 2023-07-28 08:27:37 -04:00
Alexey Milovidov
3ce8dc5503
Merge pull request #52273 from ClickHouse/51844-fix-test_storage_kafkatestpytest_kafka_formats_with_broken_message-test 
Try to make `test_kafka_formats_with_broken_message` and `test_kafka_formats` integration tests stable
 2023-07-28 13:45:12 +03:00
Alexey Milovidov
a1e9a76ead
Merge branch 'master' into 51844-fix-test_storage_kafkatestpytest_kafka_formats_with_broken_message-test 2023-07-28 13:18:10 +03:00
robot-ch-test-poll3
f888a961bb
Merge pull request #52698 from jaijhala/patch-1 
Update default output_format_arrow_compression.md
 2023-07-28 12:17:48 +02:00
robot-clickhouse
bba9a2cd28
Merge pull request #51961 from nickitat/exec_udf_allow_parameters 
Don't throw exception when exec udf has parameters
 2023-07-28 11:52:17 +02:00
Kruglov Pavel
f5e50b8b28
Merge pull request #52310 from xiedeyantu/s3-url 
Fix S3 table function does not work for pre-signed URL
 2023-07-28 11:39:44 +02:00
robot-ch-test-poll
22e5da914c
Merge pull request #52650 from rschu1ze/query-cache-asynchronous_metrics 
Add query cache metrics to SYSTEM.ASYNCHRONOUS_METRICS
 2023-07-28 11:06:55 +02:00
robot-ch-test-poll4
501bf47f19
Merge pull request #52709 from ClickHouse/Improvements_to_backup_restore_concurrency_test 
Improvements to backup restore disallow_concurrency test
 2023-07-28 10:48:50 +02:00
Alexey Gerasimchuck
112058d889 style corrections 2023-07-28 07:32:53 +00:00
robot-ch-test-poll2
32e2861b48
Merge pull request #52609 from rschu1ze/follow-up-to-50986 
Follow-up to "Implement support of encrypted elements in configuration file"
 2023-07-28 09:31:11 +02:00
Alexey Gerasimchuck
63b05da1f2 System logs improvements 2023-07-28 07:23:34 +00:00
Alexey Milovidov
a465dba311
Merge pull request #52628 from ClickHouse/load-suggestion-only-with-clickhouse-dialect 
Load suggestion only with `clickhouse` dialect
 2023-07-28 10:21:53 +03:00
robot-clickhouse-ci-1
ac2de3c79f
Merge pull request #52643 from ClickHouse/fix-local-udf-settings 
UDF: allow positional options for clickhouse-local and populate global udf settings
 2023-07-28 09:21:04 +02:00
robot-ch-test-poll3
d6e2e8b92c
Merge pull request #52653 from azat/virtual-columns-or 
RFC: Fix filtering by virtual columns with OR expression
 2023-07-28 09:18:36 +02:00
Alexey Gerasimchuck
b3351bb547 partially fixed 01747_system_session_log_long test 2023-07-28 03:36:23 +00:00
pufit
6573ba5378
Temporary returning metadata_cache.xml into tests config 2023-07-27 19:37:28 -04:00
Yakov Olkhovskiy
565204f491
Merge branch 'master' into fix-nullable-ipv4-intdiv 2023-07-27 17:34:53 -04:00
chen
0c3118c9af
Merge branch 'master' into s3-url 2023-07-28 05:26:10 +08:00
robot-clickhouse
7d8dc92ed0 Automatic style fix 2023-07-27 21:07:54 +00:00
Robert Schulze
0b0ad7d45d
Merge branch 'master' into follow-up-to-50986 2023-07-27 22:08:26 +02:00
Yakov Olkhovskiy
9448d42aea
Merge pull request #51756 from ClickHouse/fix-ip-dict 
Support IPv4 and IPv6 as dictionary attributes
 2023-07-27 15:59:21 -04:00
Jai Jhala
dba8b445bd
Update default output_format_arrow_compression.md 
Updates the default parameter of output_format_arrow_compression_method from "none" to "lz4_frame".
 2023-07-27 12:32:53 -07:00
Alexey Milovidov
f7d8930906
Merge pull request #52664 from ClickHouse/auto/v23.7.1.2470-stable 
Update version_date.tsv and changelogs after v23.7.1.2470-stable
 2023-07-27 22:14:36 +03:00
Yakov Olkhovskiy
5942c80fae fix test: '--option' now is allowed after terminating '--' 2023-07-27 19:11:44 +00:00
Han Fei
4f9075e819
Merge pull request #52623 from hanfei1991/hanfei/MergeTreeDeduplicationLog 
Fix stress test: check if storage shutdown before we operate MergeTreeDeduplicationLog
 2023-07-27 20:50:17 +02:00
Robert Schulze
9340f02d26
Silence spell check 2023-07-27 18:33:07 +00:00
Yakov Olkhovskiy
b95745d916 fix: check positional options 2023-07-27 17:52:44 +00:00
Smita Kulkarni
380da31512 Improvements to backup restore disallow_concurrency test 2023-07-27 19:03:44 +02:00
Robert Schulze
c2ee774350
Add query cache metrics to system.asynchronous_metrics 
Cf. https://github.com/ClickHouse/ClickHouse/pull/52384#issuecomment-1653241216
 2023-07-27 15:19:01 +00:00
Robert Schulze
d48b1cadb0
Merge pull request #52384 from rschu1ze/query_cache_usage_in_query_log 
Include query cache usage in SYSTEM.QUERY_LOG
 2023-07-27 17:16:54 +02:00
Azat Khuzhin
68aed0d16e RFC: Fix filtering by virtual columns with OR expression 
Virtual columns did not supports queries with OR, for example query like
this (here `m` is the `Merge` table, see the test):

    select key from m where (value = 10 and _table = 'v1') or (value = 20 and _table = 'v1');

Will always leads to:

    Cannot find column `value` in source stream, there are only columns ...

The reason for this is that it actually executes the following queries:

    SELECT key, value FROM default.d1 WHERE ((value = 10) AND ('v1' = 'v1')) OR ((value = 20) AND ('v1' = 'v1'));
    SELECT key FROM default.d2 WHERE 0;

And this kind of filtering is used not only for `Merge` table but also:
- `_table` for `Merge` (already mentioned)
- `_file` for `File`
- `_idx` for `S3`
- and as well as filtering `system.*` tables by `database`/`table`/...

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-07-27 16:35:17 +02:00
Azat Khuzhin
5611b2fff4 Add a note about not working _table filter for Merge with analyzer 
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-07-27 16:35:17 +02:00
Han Fei
9488567bf6
Update src/Storages/MergeTree/MergeTreeDeduplicationLog.cpp 2023-07-27 16:28:08 +02:00
Han Fei
f6ca013c53
Update src/Storages/MergeTree/MergeTreeDeduplicationLog.cpp 2023-07-27 16:28:00 +02:00
Han Fei
0d44d527ef
Update src/Storages/MergeTree/MergeTreeDeduplicationLog.cpp 
Co-authored-by: Alexander Tokmakov <tavplubix@gmail.com>
 2023-07-27 16:27:04 +02:00
Han Fei
f5dfb70f5c
Update src/Storages/MergeTree/MergeTreeDeduplicationLog.cpp 2023-07-27 16:12:20 +02:00
Han Fei
ce38d3c5ea address comment 2023-07-27 16:11:08 +02:00
robot-clickhouse
28c49e3f20 Update version_date.tsv and changelogs after v23.7.1.2470-stable 2023-07-27 13:47:11 +00:00
Alexey Milovidov
8d0a201468
Merge pull request #52661 from ClickHouse/23.8-prepare 
Update version after release
 2023-07-27 16:35:10 +03:00
Alexey Milovidov
671128140d Update autogenerated version to 23.8.1.1 and contributors 2023-07-27 15:34:05 +02:00
Jiebin Sun
78f3a575f9
Convert hashSets in parallel before merge (#50748) 
* Convert hashSets in parallel before merge

Before merge, if one of the lhs and rhs is singleLevelSet and the other is twoLevelSet,
then the SingleLevelSet will call convertToTwoLevel(). The convert process is not in parallel
and it will cost lots of cycle if it cosume all the singleLevelSet.

The idea of the patch is to convert all the singleLevelSets to twoLevelSets in parallel if
the hashsets are not all singleLevel or not all twoLevel.

I have tested the patch on Intel 2 x 112 vCPUs SPR server with clickbench and latest upstream
ClickHouse.
Q5 has got a big 264% performance improvement and 24 queries have got at least 5% performance
gain. The overall geomean of 43 queries has gained 7.4% more than the base code.

Signed-off-by: Jiebin Sun <jiebin.sun@intel.com>

* add resize() for the data_vec in parallelizeMergePrepare()

Signed-off-by: Jiebin Sun <jiebin.sun@intel.com>

* Add the performance test prepare_hash_before_merge.xml

Signed-off-by: Jiebin Sun <jiebin.sun@intel.com>

* Fit the CI to rename the data set from hits_v1 to test.hits.

Signed-off-by: Jiebin Sun <jiebin.sun@intel.com>

* remove the redundant branch in UniqExactSet

Co-authored-by: Nikita Taranov <nickita.taranov@gmail.com>

* Remove the empty methods and add throw exception in parallelizeMergePrepare()

Signed-off-by: Jiebin Sun <jiebin.sun@intel.com>

---------

Signed-off-by: Jiebin Sun <jiebin.sun@intel.com>
Co-authored-by: Nikita Taranov <nickita.taranov@gmail.com>
 2023-07-27 15:06:34 +02:00
Alexey Milovidov
33300a978e
Update CHANGELOG (#52655) 2023-07-27 14:38:53 +02:00