Commit Graph

108060 Commits

Author SHA1 Message Date
Alexey Milovidov
45b1eabd36
Merge pull request #46420 from evillique/replace-transformer-fix-parameters
Fix parameterized queries with REPLACE transformer
2023-02-17 18:25:57 +03:00
Alexey Milovidov
ecf893ea0d
Merge pull request #46518 from mdelapenya/tc-go-0.18.0
chore: bump testcontainers-go to 0.18.0
2023-02-17 18:23:23 +03:00
Vladimir C
0f182f6164
Merge pull request #46454 from azat/merge-alias-prewhere 2023-02-17 14:10:52 +01:00
Alexey Milovidov
a1cf3f78f6
Merge pull request #46497 from ClickHouse/alexey-milovidov-patch-6
Update monitoring.md
2023-02-17 16:03:22 +03:00
Alexey Milovidov
3b406d1244
Merge pull request #46526 from ClickHouse/CurtizJ-patch-7
Add myrrc to trusted contributors
2023-02-17 15:59:35 +03:00
Kseniia Sumarokova
094a03b4c8
Merge pull request #46480 from azat/client-connections
Allow to override host for client connection credentials
2023-02-17 13:40:39 +01:00
Anton Popov
5bcea2e8f5
Add myrrc to trusted contributors 2023-02-17 13:19:45 +01:00
Alexey Milovidov
937bd6dd4f
Merge pull request #46520 from ClickHouse/rollout-42891
Rollback unnecessary sync because of checking exit code
2023-02-17 15:13:06 +03:00
Mikhail f. Shiryaev
3edfb62066
Rollback unnecessary sync because of checking exit code 2023-02-17 12:28:04 +01:00
Sema Checherinda
b551b9fb3a
Merge pull request #46452 from CheSema/resolve-race-get-csn
resolve race in getCSNAndAssert
2023-02-17 11:31:58 +01:00
Nikolai Kochetov
cd70809a21
Merge pull request #45282 from azat/union-fixup
Revert code in TreeRewriter for proper column order for UNION
2023-02-17 11:21:56 +01:00
Han Fei
30f2f3c95f
Merge pull request #46499 from azat/tests/fix-01161_all_system_tables
Fix 01161_all_system_tables test flakiness
2023-02-17 11:15:56 +01:00
Manuel de la Peña
79781aa024 chore: bump testcontainers-go to 0.18.0 2023-02-17 11:03:26 +01:00
Antonio Andelic
4e6587b34b
Merge pull request #46488 from ClickHouse/Avogar-patch-1
Try fix flaky test test_parallel_distributed_insert_select_with_schema_inference
2023-02-17 10:19:18 +01:00
Nikolay Degterinsky
3b19823960
Merge branch 'master' into replace-transformer-fix-parameters 2023-02-17 02:02:54 +01:00
Mikhail f. Shiryaev
8cd967446c
Merge pull request #46490 from ClickHouse/fix-ccache
Fix the downloading of the recent ccache archives
2023-02-17 00:06:23 +01:00
Robert Schulze
b2fe7bf5c7
Merge pull request #46498 from ClickHouse/rs/docs-catboostevaluate
Document that catboostEvaluate() is not available in ClickHouse Cloud
2023-02-16 21:07:53 +01:00
Azat Khuzhin
5af2967f65 Revert code in TreeRewriter for proper column order for UNION
It is not required after #44920, which has a proper fix that does this
in ExpressionAnalyzer.

This reverts commit d98336ad83.
Reverts: #37887

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-02-16 20:46:39 +01:00
Azat Khuzhin
61f27c9dab Fix 01161_all_system_tables test flakiness
CI: https://s3.amazonaws.com/clickhouse-test-reports/45282/e8cdb5e1c52791fb7e96a71df9c6a7bca15b5a59/fast_test.html
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-02-16 20:45:47 +01:00
Robert Schulze
18cbc7b511
Docs: catboostEvaluate() is unavailable in Cloud 2023-02-16 19:19:25 +00:00
Alexey Milovidov
993a39e2a1
Merge pull request #46360 from genzgd/http_client_version
Allow to provide the protocol version by HTTP clients to tune the compatibility of the Native output format.
2023-02-16 22:17:04 +03:00
Alexey Milovidov
e66c05e008
Merge pull request #38750 from azat/revert-no-stress
Revert "Merge pull request #38212 from azat/no-stress"
2023-02-16 22:13:17 +03:00
Alexey Milovidov
2cd9fd5698
Update monitoring.md 2023-02-16 22:09:10 +03:00
Alexey Milovidov
4eda5d19b5
Merge pull request #46492 from myrrc/patch-2
Add --shallow-submodules version for developer instruction
2023-02-16 22:07:47 +03:00
Alexey Milovidov
43275a3d3d
Merge pull request #46491 from myrrc/patch-1
Add --shallow-submodules version
2023-02-16 22:07:11 +03:00
Sema Checherinda
73a506b996
Update src/Interpreters/TransactionLog.cpp
Co-authored-by: Alexander Tokmakov <tavplubix@gmail.com>
2023-02-16 19:01:02 +01:00
Sema Checherinda
0511f5e635
Update src/Interpreters/TransactionLog.cpp
Co-authored-by: Alexander Tokmakov <tavplubix@gmail.com>
2023-02-16 19:00:55 +01:00
Sema Checherinda
bc661442c3
Update src/Interpreters/TransactionLog.cpp
Co-authored-by: Alexander Tokmakov <tavplubix@gmail.com>
2023-02-16 19:00:46 +01:00
Mike Kot
f4600bc805
Add --shallow-submodules version for developer instruction
On modern git that can speed up clone time
2023-02-16 20:46:59 +03:00
Mike Kot
444f3aa2ac
Add --shallow-submodules version
For recent Git, this options changes checkout time drastically
2023-02-16 20:44:01 +03:00
robot-ch-test-poll1
300dfbbef6
Merge pull request #46460 from ClickHouse/group-by-use-nulls-docs
Add documentation for `group_by_use_nulls` setting
2023-02-16 18:41:34 +01:00
Mikhail f. Shiryaev
b349cda25c
Fix the downloading of the recent ccache archives 2023-02-16 18:26:06 +01:00
Robert Schulze
0ff404da9c
Merge pull request #46302 from JakeBamrah/master
Expand date formatters and add `DATE_FORMAT` function for better MySQL compatibility
2023-02-16 17:54:12 +01:00
Azat Khuzhin
c1d1d95236 Update tests references after PREWHERE changes
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-02-16 17:21:53 +01:00
Azat Khuzhin
beff5ac795 Fix PREWHERE for Merge with different default types
In case of underlying table has an ALIAS for this column, while in Merge
table it is not marked as an alias, there will NOT_FOUND_COLUMN_IN_BLOCK
error.

Further more, when underlying tables has different default type for the
column, i.e. one has ALIAS and another has real column, then you will
also get NOT_FOUND_COLUMN_IN_BLOCK, because Merge engine should take
care of this.

Also this patch reworks how PREWHERE is handled for Merge table, and now
if you use PREWHERE on the column that has the same type and default
type (ALIAS, ...) then it will be possible, and only if the type
differs, it will be prohibited and throw ILLEGAL_PREWHERE error.

And last, but not least, also respect this restrictions for
optimize_move_to_prewhere.

v2: introduce IStorage::supportedPrewhereColumns()
v3: Remove excessive condition for PREWHERE in StorageMerge::read()
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-02-16 17:21:53 +01:00
Dmitry Novik
c95df21324 Review fixes 2023-02-16 15:38:25 +00:00
Kruglov Pavel
0ed6ddd7ab
Try fix flaky test test_parallel_distributed_insert_select_with_schema_inference 2023-02-16 16:28:47 +01:00
Vladimir C
3f424301cd
Merge pull request #45484 from azat/clickhouse-test-bin-fix 2023-02-16 14:31:11 +01:00
Azat Khuzhin
2dbcfdbe15 Allow to override host for client connection credentials
Introduce new `--connection` option, by default as a connection name
`--host` will be used.

And using --connection you also can specify --host and it will be
overwritten.

Follow-up for: #45715
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-02-16 14:26:24 +01:00
Alexander Gololobov
d0f402fa5b
Merge pull request #46391 from ClickHouse/debug-docker
Easy debugging of clickhouse-server in Docker
2023-02-16 14:09:43 +01:00
youennL-cs
6526c2a8ab
[RFC] Replacing merge tree new engine (#41005)
* Add new engine to ReplacingMergeTree corresponding to the ReplacingCollapsingMergeTree

* Add new test for the new ReplacingMergeTree engine

* Limit sign value to -1/1

* Add new engine to ReplacingMergeTree corresponding to the ReplacingCollapsingMergeTree

* Add new test for the new ReplacingMergeTree engine

* Limit sign value to -1/1

* Replace sign column(Int8) by is_deleted(UInt8)

* Add new engine to ReplacingMergeTree corresponding to the ReplacingCollapsingMergeTree

* Add new test for the new ReplacingMergeTree engine

* Limit sign value to -1/1

* Replace sign column(Int8) by is_deleted(UInt8)

* Add new engine to ReplacingMergeTree corresponding to the ReplacingCollapsingMergeTree

* Add new test for the new ReplacingMergeTree engine

* Limit sign value to -1/1

* Replace sign column(Int8) by is_deleted(UInt8)

* Add keyword 'CLEANUP' when OPTIMIZE

* Cleanup uniquely when it's a replacingMergeTree

* Propagate CLEANUP information and change from 'with_cleanup' to 'cleanup'

* Cleanup data flagged as 'is_deleted'

* Fix merge when optimize and add a test

* Fix OPTIMIZE and INSERT + add tests

* New fix for cleanup at the merge

* Cleanup debug logs

* Add the SETTINGS option 'clean_deleted_rows' that can be 'never' or 'always'

* Fix regression bug; Now REplicatedMergeTree can be called as before without 'is_deleted'

* Add Replicated tests

* Disable tag 'long' for our test and cleanup some white spaces

* Update tests

* Fix tests and remove additional useless whitespace

* Fix replica test

* Style clean && add condition check for is_deleted values

* clean_deleted_rows settings is nom an enum

* Add valid default value to the clean_deleted_rows settings

* Update cleanup checkers to use the enum and fix typos in the test

* Fix submodule contrib/AMQP-CPP pointer

* Add missing messages in test reference and remove a print with non derterministic order

* fix replica test reference

* Fix edge case

* Fix a typo for the spell checker

* Fix reference

* Fix a condition to raise an error if is_deleted differ from 0/1 and cleanup

* Change tests file name and update number

* This should fix the ReplacingMergeTree parameter set

* Fix replicated parameters

* Disable allow_deprecated_syntax_for_merge_tree for our new column

* Fix a test

* Remove non deterministic order print in the test

* Test on replicas

* Remove a condition, when checking optional parameters, that should not be sueful since we disabled the deprected_syntaxe

* Revert "Remove a condition, when checking optional parameters, that should not be useful since we disabled the deprected_syntaxe"

This reverts commit b65d64c05e.

* Fix replica management and limit the number of argument to two maximum, due to the possiblity of deprecated table create/attach failing otherwise

* Test a fix for replicated log information error

* Try to add sync to have consistent results

* Change path of replicas that should cause one issue and add few prints in case it's not that

* Get cleanup info on replicas only if information found

* Fix style issues

* Try to avoid replication error 'cannot select parts...' and and replica read/write field order

* Cleanup according to PR reviews
 and add tests on error raised.

* Update src/Storages/MergeTree/registerStorageMergeTree.cpp

Co-authored-by: Alexander Tokmakov <tavplubix@gmail.com>

* Select ... FINAL don't show rows with is_deleted = true

* Update and fix SELECT ... FINAL merge parameter

* Remove is_deleted rows only on the version inserted when merge

* Fix (master) updates issues

* Revert changes that should not be commited

* Add changes according to review

* Revert changes that should not be commited - part 2

---------

Co-authored-by: Alexander Tokmakov <tavplubix@gmail.com>
2023-02-16 16:03:16 +03:00
Mikhail f. Shiryaev
cb5e5b27f2
Merge pull request #46450 from ClickHouse/dont-fetch-submodules
Do not fetch submodules in release.py
2023-02-16 14:00:38 +01:00
alesapin
d08b2753e4
Merge pull request #46367 from ClickHouse/reduce-keeper-build-time
Do not build libclickhouse-keeper-lib.a for standalone keeper
2023-02-16 13:56:27 +01:00
Alexander Gololobov
2145a29cb6
Merge pull request #46461 from cmsxbc/fix-systemd-service
Fix systemd service  file wrong inline comment
2023-02-16 13:02:19 +01:00
cmsxbc
1ad9e217e5 chore: remove starting blank 2023-02-16 19:24:46 +08:00
SuperDJY
7de008a58a Fix systemd service file wrong inline comment
There is no inline comment in systemd unit file.
2023-02-16 19:24:46 +08:00
Alexey Milovidov
a9b4f2ef3a
Merge pull request #46435 from ClickHouse/rs/consistent-db-metric
Exclude internal databases from async metric "NumberOfDatabases"
2023-02-16 14:09:59 +03:00
Kseniia Sumarokova
187f7482e1
Merge pull request #46044 from ucasfl/log-engine
Storage Log family support settings storage_policy
2023-02-16 12:09:47 +01:00
Kseniia Sumarokova
91bbcde97e
Merge pull request #46421 from ClickHouse/make_tests_with_window_view_less_bad
Make tests with window view less bad
2023-02-16 12:07:15 +01:00
vdimir
b64ed8b5d0
fix tests/clickhouse-test file perm 2023-02-16 11:29:17 +01:00