Commit Graph

25228 Commits

Author SHA1 Message Date
Vladimir C
3f424301cd
Merge pull request #45484 from azat/clickhouse-test-bin-fix 2023-02-16 14:31:11 +01:00
youennL-cs
6526c2a8ab
[RFC] Replacing merge tree new engine (#41005)
* Add new engine to ReplacingMergeTree corresponding to the ReplacingCollapsingMergeTree

* Add new test for the new ReplacingMergeTree engine

* Limit sign value to -1/1

* Add new engine to ReplacingMergeTree corresponding to the ReplacingCollapsingMergeTree

* Add new test for the new ReplacingMergeTree engine

* Limit sign value to -1/1

* Replace sign column(Int8) by is_deleted(UInt8)

* Add new engine to ReplacingMergeTree corresponding to the ReplacingCollapsingMergeTree

* Add new test for the new ReplacingMergeTree engine

* Limit sign value to -1/1

* Replace sign column(Int8) by is_deleted(UInt8)

* Add new engine to ReplacingMergeTree corresponding to the ReplacingCollapsingMergeTree

* Add new test for the new ReplacingMergeTree engine

* Limit sign value to -1/1

* Replace sign column(Int8) by is_deleted(UInt8)

* Add keyword 'CLEANUP' when OPTIMIZE

* Cleanup uniquely when it's a replacingMergeTree

* Propagate CLEANUP information and change from 'with_cleanup' to 'cleanup'

* Cleanup data flagged as 'is_deleted'

* Fix merge when optimize and add a test

* Fix OPTIMIZE and INSERT + add tests

* New fix for cleanup at the merge

* Cleanup debug logs

* Add the SETTINGS option 'clean_deleted_rows' that can be 'never' or 'always'

* Fix regression bug; Now REplicatedMergeTree can be called as before without 'is_deleted'

* Add Replicated tests

* Disable tag 'long' for our test and cleanup some white spaces

* Update tests

* Fix tests and remove additional useless whitespace

* Fix replica test

* Style clean && add condition check for is_deleted values

* clean_deleted_rows settings is nom an enum

* Add valid default value to the clean_deleted_rows settings

* Update cleanup checkers to use the enum and fix typos in the test

* Fix submodule contrib/AMQP-CPP pointer

* Add missing messages in test reference and remove a print with non derterministic order

* fix replica test reference

* Fix edge case

* Fix a typo for the spell checker

* Fix reference

* Fix a condition to raise an error if is_deleted differ from 0/1 and cleanup

* Change tests file name and update number

* This should fix the ReplacingMergeTree parameter set

* Fix replicated parameters

* Disable allow_deprecated_syntax_for_merge_tree for our new column

* Fix a test

* Remove non deterministic order print in the test

* Test on replicas

* Remove a condition, when checking optional parameters, that should not be sueful since we disabled the deprected_syntaxe

* Revert "Remove a condition, when checking optional parameters, that should not be useful since we disabled the deprected_syntaxe"

This reverts commit b65d64c05e.

* Fix replica management and limit the number of argument to two maximum, due to the possiblity of deprecated table create/attach failing otherwise

* Test a fix for replicated log information error

* Try to add sync to have consistent results

* Change path of replicas that should cause one issue and add few prints in case it's not that

* Get cleanup info on replicas only if information found

* Fix style issues

* Try to avoid replication error 'cannot select parts...' and and replica read/write field order

* Cleanup according to PR reviews
 and add tests on error raised.

* Update src/Storages/MergeTree/registerStorageMergeTree.cpp

Co-authored-by: Alexander Tokmakov <tavplubix@gmail.com>

* Select ... FINAL don't show rows with is_deleted = true

* Update and fix SELECT ... FINAL merge parameter

* Remove is_deleted rows only on the version inserted when merge

* Fix (master) updates issues

* Revert changes that should not be commited

* Add changes according to review

* Revert changes that should not be commited - part 2

---------

Co-authored-by: Alexander Tokmakov <tavplubix@gmail.com>
2023-02-16 16:03:16 +03:00
Mikhail f. Shiryaev
cb5e5b27f2
Merge pull request #46450 from ClickHouse/dont-fetch-submodules
Do not fetch submodules in release.py
2023-02-16 14:00:38 +01:00
Kseniia Sumarokova
187f7482e1
Merge pull request #46044 from ucasfl/log-engine
Storage Log family support settings storage_policy
2023-02-16 12:09:47 +01:00
Kseniia Sumarokova
91bbcde97e
Merge pull request #46421 from ClickHouse/make_tests_with_window_view_less_bad
Make tests with window view less bad
2023-02-16 12:07:15 +01:00
vdimir
b64ed8b5d0
fix tests/clickhouse-test file perm 2023-02-16 11:29:17 +01:00
Kseniia Sumarokova
4303ee9114
Merge pull request #46404 from kssenii/fix-rabbit-test-4
Fix test test_rabbitmq_overloaded_insert
2023-02-16 11:28:18 +01:00
Kseniia Sumarokova
947753bd4c
Merge pull request #46409 from kssenii/follow-up-to-46168
Follow-up to #46168
2023-02-16 11:26:54 +01:00
Nikolay Degterinsky
e61947bf47
Merge pull request #44662 from evillique/ulid
Add generateULID function
2023-02-16 11:21:23 +01:00
Mikhail f. Shiryaev
c5105e2e85
Merge pull request #46458 from ClickHouse/fix-install-check
Improve install_check.py
2023-02-16 11:12:30 +01:00
Vitaly Baranov
7dabd18e8d
Merge pull request #46449 from vitlibar/fix-backup-tests
Fix a backup test
2023-02-16 10:55:01 +01:00
Mikhail f. Shiryaev
346c3e3c49
Preserve logs for failed installation tests, retry 3 times 2023-02-15 22:51:43 +01:00
Mikhail f. Shiryaev
9dba4e7cc9
Replace format with f-strings 2023-02-15 22:51:42 +01:00
Mikhail f. Shiryaev
f39d9b09b0
Preserve clickhouse binary to not redownload it 2023-02-15 22:51:41 +01:00
Mikhail f. Shiryaev
3bcd049d18
Improve download filter, group keeper mntr command 2023-02-15 22:51:41 +01:00
Mikhail f. Shiryaev
0c5648a5a6
Use OK and FAIL for tests status 2023-02-15 22:51:39 +01:00
Alexander Tokmakov
b167b8344b
Update 01055_window_view_proc_hop_to.sh 2023-02-16 00:45:03 +03:00
Azat Khuzhin
810a624f71 Fix parse_args() in clickhouse-test 2023-02-15 22:20:18 +01:00
Alexander Tokmakov
05eb877c5c
Update 01055_window_view_proc_hop_to.sh 2023-02-16 00:10:33 +03:00
Alexander Tokmakov
c89e30814c
Update 01054_window_view_proc_tumble_to.sh 2023-02-16 00:09:53 +03:00
Han Fei
5458d4216f
Merge branch 'master' into dev-prewhere 2023-02-15 17:59:44 +01:00
Vitaly Baranov
4a3ad7da85 Fix test test_backup_restore_new/test.py::test_async_backups_to_same_destination[http]. 2023-02-15 17:27:05 +01:00
Mikhail f. Shiryaev
fecadfab3e
Do not fetch submodules in release.py 2023-02-15 16:05:07 +01:00
Vladimir C
3e77463125
Merge pull request #46256 from bigo-sg/window_functions 2023-02-15 15:36:41 +01:00
Kruglov Pavel
4f380370a9
Fix s3Cluster schema inference in parallel distributed insert select (#46381)
* Fix s3Cluster schema inference in parallel distributed insert select
* Try fix flaky test
* Try SYSTEM SYNC REPLICA to avoid test flakiness
2023-02-15 15:30:43 +01:00
Alexey Milovidov
556d5cbeb3
Merge branch 'master' into clickhouse-test-bin-fix 2023-02-15 17:13:40 +03:00
Kseniia Sumarokova
299861621e
Update 01053_window_view_proc_hop_to_now.sh 2023-02-15 14:36:54 +01:00
Kseniia Sumarokova
3aa96953f6
Update 01075_window_view_proc_tumble_to_now_populate.sh 2023-02-15 14:34:24 +01:00
flynn
63c3c07347 fix test 2023-02-15 11:25:22 +00:00
kssenii
d7bfe494b2 Fix test 2023-02-15 12:02:24 +01:00
Han Fei
051f551b6e change tests 2023-02-15 11:42:15 +01:00
Vladimir C
645fee3d94
Merge pull request #46009 from ClickHouse/vdimir/fix_read_in_order_final_desc 2023-02-15 11:23:07 +01:00
Kseniia Sumarokova
6ae26e220a
Merge branch 'master' into make_tests_with_window_view_less_bad 2023-02-15 11:05:36 +01:00
flynn
42103e0d08 udpate test 2023-02-15 07:45:24 +00:00
Nikolay Degterinsky
494fd472f0
Merge branch 'master' into ulid 2023-02-15 07:24:32 +01:00
Yakov Olkhovskiy
1167d2ce8d
Merge pull request #45379 from wujunfu/fix-unsorted-array
Fix: return unsorted array element in quantile function
2023-02-15 00:24:11 -05:00
flynn
22a3439eec Merge branch 'master' of github.com:ClickHouse/ClickHouse into log-engine 2023-02-15 03:57:11 +00:00
flynn
26e7b3463a fix 2023-02-15 03:56:38 +00:00
flynn
4eacbecc16 update test 2023-02-15 02:38:35 +00:00
Alexander Tokmakov
67096d25d5
Merge pull request #46359 from ClickHouse/remove_trash_from_move_partition
Remove trash from `MOVE PARTITION` command
2023-02-15 01:32:43 +03:00
Alexander Tokmakov
6158d9e85f make tests with window view less bad 2023-02-14 23:27:18 +01:00
Han Fei
32050acde5 Merge branch 'master' into dev-prewhere 2023-02-14 18:39:13 +01:00
Anton Popov
ecc6ff707b
Merge pull request #46387 from CurtizJ/fix-update-from-empty-nested
Fix `ALTER UPDATE` of empty `Nested` columns
2023-02-14 16:28:32 +01:00
Yakov Olkhovskiy
eb89d0f2f9
Create 02560_quantile_min_max.reference 2023-02-14 09:39:45 -05:00
Yakov Olkhovskiy
c8529da226
Create 02560_quantile_min_max.sql 2023-02-14 09:37:05 -05:00
Vladimir C
726fb4bebc
Merge pull request #46368 from ClickHouse/vdimir/bugfix-validate-fix 2023-02-14 14:54:07 +01:00
Nikolay Degterinsky
09da5575e3 Merge remote-tracking branch 'upstream/master' into ulid 2023-02-14 13:41:17 +00:00
Nikita Taranov
cbd10c4493
Fix mbm with aio on top of query plan (#45892) 2023-02-14 14:02:54 +01:00
kssenii
bead024ecb Fix test 2023-02-14 12:45:57 +01:00
Vladimir C
47cd5f8e9d
Merge pull request #46361 from azat/clickhouse-test-logs 2023-02-14 12:35:07 +01:00