Commit Graph

4162 Commits

Author SHA1 Message Date
Alexander Tokmakov
1e061ac39e fix formatting 2022-04-14 15:31:49 +02:00
alesapin
c74b6c547b Black 2022-04-14 14:40:56 +02:00
alesapin
428753a4a7 Fix integration tests parser 2022-04-14 14:39:36 +02:00
Kruglov Pavel
0bae44abf0
Merge pull request #36209 from Avogar/check-magic-bytes
Check ORC/Parquet/Arrow format magic bytes before loading file in memory
2022-04-14 11:32:38 +02:00
avogar
ca14a29dbe Revert reverting "Fix crash in ParallelReadBuffer" 2022-04-13 20:39:12 +00:00
tavplubix
b2cd23658a
Revert "Fix crash in ParallelReadBuffer" 2022-04-13 22:45:34 +03:00
avogar
42726639f3 Check ORC/Parquet/Arrow format magic bytes before loading file in memory 2022-04-13 19:27:38 +00:00
avogar
1c065f8c7a Some refactoring around schema inference with globs 2022-04-13 17:02:48 +00:00
Alexander Tokmakov
40fea2b833 do not unfold {uuid} macro 2022-04-13 16:51:59 +02:00
Alexander Tokmakov
f2c4f88295 avoid moving replicated tables to Ordinary db 2022-04-13 14:38:20 +02:00
avogar
de9c9462e5 Fix crash in ParallelReadBuffer 2022-04-12 13:54:53 +00:00
tavplubix
090506a572
Merge pull request #36161 from ClickHouse/fix_mongo_test
Fix mongodb test with new cert
2022-04-12 15:48:08 +03:00
alesapin
8f822af358 Fix mongodb test with new cert 2022-04-12 11:47:22 +02:00
Nikolay Degterinsky
3547e3a376
Merge pull request #35978 from nic11/pr/runner-typo
Remove arg duplication and fix a typo
2022-04-12 11:45:52 +02:00
Kruglov Pavel
972357ebf6
Merge pull request #35748 from bigo-sg/s3_cluster_join
Fixed : elimate AMBIGUOUS_COLUMN_NAME exception in hdfs/s3 cluster join query
2022-04-11 16:22:53 +02:00
Nikolai Kochetov
ac74757f92
Merge pull request #35973 from filimonov/kafka_read_consumers_in_parallel
Make parallel reading from several kafka consumers work again
2022-04-11 15:30:52 +02:00
Roman Nikonov
daceac5c0b Merge branch 'master' into pr/content-type 2022-04-10 01:21:28 +03:00
Roman Nikonov
7cd46bf2cb Merge branch 'master' into pr/runner-typo 2022-04-10 01:20:46 +03:00
tavplubix
faae540a85
Merge pull request #24258 from ClickHouse/mvcc_prototype
MVCC prototype for MergeTree
2022-04-08 22:02:13 +03:00
Kseniia Sumarokova
1e54c5c57b
Merge pull request #35885 from kssenii/fix-postgres-test-2
fix postgres test
2022-04-08 19:55:05 +02:00
kssenii
fc3e3251b9 Fix 2022-04-08 13:50:24 +02:00
Alexander Tokmakov
141fbc6980 Merge branch 'master' into mvcc_prototype 2022-04-08 13:38:11 +02:00
lgbo-ustc
759e4a9a05 Merge remote-tracking branch 'ck/master' into s3_cluster_join 2022-04-08 09:25:30 +08:00
Azat Khuzhin
c5ffbc688e Do not allow SETTINGS after FORMAT for INSERT queries
Parsing SETTINGS after FORMAT, that has been introduced in [1], can
interpret SETTING as some values, which is misleading.

  [1]: https://github.com/ClickHouse/ClickHouse/pull/4174/files#diff-ba7bd0657630b1cd94cf6ed364bd857338096f49f66dc82918438d6745753775R106

Note, that we are touching only INSERT queries, not SELECT, since this
is a backward incompatible change, and in case of modifying SELECT it
can break too much.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
Fixes: #35100
Fixes: #20343
2022-04-07 16:29:36 +03:00
Alexander Tokmakov
7f54e7b422 Merge branch 'master' into mvcc_prototype 2022-04-07 15:14:06 +02:00
Nikolai Kochetov
ebfdadd6f8 Fix firmatting. 2022-04-07 12:05:21 +00:00
Alexander Tokmakov
8290ffa88d Merge branch 'master' into mvcc_prototype 2022-04-07 13:50:42 +02:00
Kseniia Sumarokova
18a594a22e
Merge pull request #34631 from bigo-sg/use_minmax_index
Use minmax index for orc/parquet file in Hive Engine
2022-04-07 12:22:19 +02:00
tavplubix
6e9c028bbb
Merge pull request #35956 from Algunenano/limit_dns_retries
DNS cache: Add option to drop elements after several consecutive failures
2022-04-07 13:20:36 +03:00
Nikolai Kochetov
3e1b3f14c0
Merge pull request #34355 from azat/processors-profiling
Profiling on Processors level
2022-04-07 12:13:14 +02:00
lgbo-ustc
dbdc632243 fixed code style 2022-04-07 18:11:49 +08:00
taiyang-li
2ef316801c Merge branch 'master' into use_minmax_index 2022-04-07 10:53:25 +08:00
mergify[bot]
585cff1e95
Merge branch 'master' into limit_dns_retries 2022-04-06 18:23:17 +00:00
tavplubix
00137eaa34
Update test.py 2022-04-06 19:13:56 +03:00
taiyang-li
59e47472f1 fix integration tests 2022-04-06 20:51:31 +08:00
taiyang-li
acbd11ccbc add integration tests 2022-04-06 18:59:17 +08:00
taiyang-li
5d8a1a4465 add integration tests 2022-04-06 18:50:39 +08:00
kssenii
06ff47f72f Add drops 2022-04-06 10:36:54 +02:00
Kseniia Sumarokova
0e1637dfaf
Merge pull request #35354 from kssenii/enable-testmode-by-default
Remove testmode option, enable it unconditionally
2022-04-06 10:06:08 +02:00
Alexey Milovidov
bad2e9dc06
Merge pull request #35936 from DevTeamBK/MARIANA-62
Move credentials for integration tests into a separate file (The ticket name in IBM's JIRA is MARIANA-62)
2022-04-06 03:27:27 +03:00
Kseniia Sumarokova
f4bfa0fea3 Update test.py 2022-04-06 02:13:22 +02:00
Roman Nikonov
a34d9f9cc3 Remove arg duplication and fix a typo 2022-04-06 02:40:56 +03:00
Azat Khuzhin
acd48ebe2d Disable processors_profile_log for test_input_format_parallel_parsing_memory_tracking
This should fix memory usage, like in [1].

  [1]: https://s3.amazonaws.com/clickhouse-test-reports/34355/e5a837e574fac93e01d985f55d069fe522abc182/integration_tests__thread__actions__[3/4].html

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-04-05 23:23:05 +03:00
Mikhail Filimonov
f9a4cd12d4
Make parallel reading of kafka consumers work again (issue #35153) 2022-04-05 21:46:56 +02:00
LAL2211
acaeaf2842 black check formatted 2022-04-05 12:46:54 -04:00
Raúl Marín
dce0c9f059 Python format 2022-04-05 17:19:56 +02:00
Raúl Marín
8a05cf3927 DNS cache: Add option to drop elements after several consecutive failures 2022-04-05 13:00:27 +02:00
kssenii
4bfac4ec99 Remove more testmode mentions 2022-04-05 12:17:34 +02:00
LAL2211
3ecdad9d4b updated 2022-04-04 14:49:30 -04:00
LAL2211
0340932d57 updated hard coded/ default credentials 2022-04-04 14:35:21 -04:00
Alexander Tokmakov
a2167f12b8 Merge branch 'master' into mvcc_prototype 2022-04-04 14:24:23 +02:00
mergify[bot]
2251df4582
Merge branch 'master' into fix-postgres-test-2 2022-04-03 22:06:52 +00:00
Roman Nikonov
d81a8cd317 Merge branch 'master' into pr/content-type 2022-04-03 20:53:51 +03:00
kssenii
93fc604223 Fix 2022-04-03 18:39:14 +02:00
Alexey Milovidov
5a47958744
Merge pull request #35736 from CurtizJ/quota-written-bytes
Add quota for written bytes
2022-04-03 05:26:49 +03:00
Anton Popov
687942ce70 more strict quota for written bytes 2022-04-01 15:02:49 +00:00
Alexander Tokmakov
6591d1ceb7 Merge branch 'master' into mvcc_prototype 2022-04-01 15:38:46 +02:00
alesapin
87b15d350f
Merge pull request #35808 from ClickHouse/fix_some_integration_tests
Try to fix some integration tests
2022-04-01 10:44:49 +02:00
Alexey Milovidov
5c6b84c398
Merge pull request #35586 from kssenii/fix-virtual-columns-s3
Fix s3 engine getting virtual columns
2022-04-01 04:43:32 +03:00
Alexander Tokmakov
418070c012 try to fix some integration tests 2022-03-31 15:56:07 +02:00
Alexander Tokmakov
5a50ad9de3 Merge branch 'master' into mvcc_prototype 2022-03-31 11:35:04 +02:00
kssenii
f17a320635 Fix test 2022-03-31 11:13:38 +02:00
lgbo-ustc
d0e5b3571c fixed code style 2022-03-31 09:28:07 +08:00
Dmitry Novik
597c1a6523
Merge pull request #35719 from ClickHouse/memory-overcommit-test-fix
Try to fix test_global_overcommit_tracker flakyness
2022-03-30 18:15:40 +02:00
kssenii
d810853b78 Fix path in test 2022-03-30 17:35:59 +02:00
kssenii
099fa0e668 Merge master 2022-03-30 17:33:32 +02:00
Kruglov Pavel
771f34d793
Merge pull request #35691 from Avogar/fix-matview
Fix creating materialized view with subquery after server restart
2022-03-30 14:57:14 +02:00
lgbo-ustc
08e1fdc6b8 Fixed :a elimate AMBIGUOUS_COLUMN_NAME exception
elimate AMBIGUOUS_COLUMN_NAME exception in hdfs/s3 cluster when run a query with join
2022-03-30 17:06:38 +08:00
Antonio Andelic
03a09dc914
Merge pull request #35571 from ClickHouse/parallel-s3-downloading
Parallel S3 downloading
2022-03-30 08:14:49 +02:00
Alexander Tokmakov
287d858fda Merge branch 'master' into mvcc_prototype 2022-03-29 16:24:12 +02:00
Antonio Andelic
c9feb7f751 Format test file 2022-03-29 13:40:14 +00:00
Dmitry Novik
0cc9c82124 Try to fix test_global_overcommit_tracker flakyness 2022-03-29 13:09:37 +00:00
tavplubix
3246261da8
Fix logging in test_distributed_respect_user_timeouts (#35575)
* Update test.py

* Update test.py

* Update test.py

Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2022-03-29 15:43:42 +03:00
Kruglov Pavel
fe60560c03
Merge pull request #35619 from Avogar/check-remote-url-allow-hosts
Check remote_url_allow_hosts before schema inference in URL engine
2022-03-29 14:08:02 +02:00
Kruglov Pavel
a2aab8ffac
Fix test 2022-03-29 14:07:19 +02:00
Anton Popov
d42632dc13
Merge pull request #32928 from bigo-sg/rocksdb_metacache
Speed up parts loading process of MergeTree by metadata cache
2022-03-29 14:05:22 +02:00
Ilya Yatsishin
45babe48bc
Merge pull request #35543 from qoega/azure-integration-test-better
Slightly better integration tests: test_backup_with_other_granularity test_azure_blob_storage_zero_copy_replication
2022-03-29 13:58:31 +02:00
taiyang-li
834ac3a1b9 Merge remote-tracking branch 'ck/master' into rocksdb_metacache 2022-03-29 18:32:06 +08:00
Antonio Andelic
362e877529 Merge branch 'master' into parallel-s3-downloading 2022-03-29 07:05:26 +00:00
taiyang-li
ddd5bebe55 fix integration test 2022-03-29 11:53:51 +08:00
kssenii
c6b1f86306 Merge with master 2022-03-29 02:03:28 +02:00
Nikita Mikhaylov
85282f1b4d
Made schema inference work with s3Cluster table function (#35544) 2022-03-29 00:46:35 +02:00
kssenii
1d49a85963 Merge master 2022-03-28 22:51:56 +02:00
kssenii
a2013ebe2b Better 2022-03-28 22:40:27 +02:00
Kruglov Pavel
c066593595
Update test.py 2022-03-28 22:02:28 +02:00
avogar
36ea9ef11f Fix creating materialized view with subquery after server restart 2022-03-28 19:52:10 +00:00
alesapin
f9c1a44cae Fix black 2022-03-28 21:32:53 +02:00
Alexander Tokmakov
4baccf9d81 fix formatting 2022-03-28 20:24:18 +02:00
Alexander Tokmakov
208b242188 Merge branch 'master' into mvcc_prototype 2022-03-28 19:58:06 +02:00
Kruglov Pavel
933eaeae94
Fix black test 2022-03-28 16:26:20 +02:00
taiyang-li
38702be40c Merge remote-tracking branch 'ck/master' into rocksdb_metacache 2022-03-28 21:03:22 +08:00
mergify[bot]
b928d8391e
Merge branch 'master' into azure-integration-test-better 2022-03-28 09:51:35 +00:00
kssenii
c6706b8bfa Better 2022-03-25 19:30:13 +01:00
avogar
ecc57b436c Check remote_url_allow_hosts before schema inference in URL engine 2022-03-25 13:30:45 +00:00
Antonio Andelic
394682b983 Merge branch 'master' into parallel-s3-downloading 2022-03-25 13:00:44 +00:00
kssenii
edf0436f5c Fix style check 2022-03-25 10:14:14 +01:00
tavplubix
805220e658
Merge pull request #35574 from ClickHouse/tavplubix-patch-2
Fix test `test_s3_zero_copy_replication`
2022-03-24 23:50:46 +03:00
tavplubix
d910357e69
Update test.py 2022-03-24 20:25:16 +03:00
kssenii
e91e30aaa4 Fix 2022-03-24 17:10:27 +01:00
Alexey Milovidov
31420615c0
Merge pull request #35553 from ClickHouse/kostik-consistent-hash
Rename `yandexConsistentHash` to `kostikConsistentHash`
2022-03-24 17:56:59 +03:00
tavplubix
7b96d61057
Merge pull request #35478 from ClickHouse/merging_30325
Merging #30325
2022-03-24 14:53:20 +03:00
Alexander Tokmakov
4ad4d4b38c apply formatter 2022-03-24 12:23:14 +01:00
mergify[bot]
d782aef36f
Merge branch 'master' into azure-integration-test-better 2022-03-24 11:18:02 +00:00
tavplubix
b3c021ec97
Update test.py 2022-03-24 13:53:06 +03:00
Antonio Andelic
62a495a5fc Small refactor 2022-03-24 09:45:30 +00:00
Antonio Andelic
e0d7b6dc3e Add tests for S3 multithreaded download 2022-03-24 09:30:06 +00:00
taiyang-li
db34ca57c2 reformat test.py 2022-03-24 14:58:45 +08:00
Alexey Milovidov
d54138425f Rename yandexConsistentHash to kostikConsistentHash 2022-03-24 02:18:25 +01:00
Maksim Kita
97b5cb96f2 Fixed style check 2022-03-23 20:41:28 +01:00
Alexander Tokmakov
9aed0507b7 Merge branch 'master' into mvcc_prototype 2022-03-23 18:07:22 +01:00
Alexander Tokmakov
3c6a10237c Merge branch 'master' into merging_30325 2022-03-23 18:07:04 +01:00
Yatsishin Ilya
abd587cb23 Better tests 2022-03-23 16:17:44 +00:00
Maksim Kita
da235f9cda
Merge pull request #34536 from kitaisreal/system-log-tables-comment-fix
System log tables allow to specify COMMENT in ENGINE declaration
2022-03-23 15:06:05 +01:00
Alexander Tokmakov
cd058699e9 fix test 2022-03-23 13:39:07 +01:00
Alexander Tokmakov
94d32c6b80 Merge branch 'master' into merging_30325 2022-03-23 11:58:57 +01:00
Alexander Tokmakov
bcec53aadc Merge branch 'master' into mvcc_prototype 2022-03-23 11:28:43 +01:00
Antonio Andelic
9829f2d051 Merge branch 'master' into parallel-downloading-url-engine 2022-03-23 07:41:14 +00:00
taiyang-li
8dbf1c60e7 merge master and fix conflict 2022-03-23 11:36:50 +08:00
Maksim Kita
1a096a87da Added support for SystemLog to specify COMMENT in ENGINE section 2022-03-22 22:44:46 +01:00
Alexander Tokmakov
7e904ac789 more logs 2022-03-22 19:05:37 +01:00
Mikhail f. Shiryaev
e6f5a3f98b
Apply black formatter to all *.py files in the repo 2022-03-22 17:39:58 +01:00
Vladimir C
ac6fef5c70
Merge pull request #35124 from vdimir/ci-bugfix-validation 2022-03-22 17:34:15 +01:00
Alexander Tokmakov
bc5a689899 add debug logging 2022-03-22 15:34:20 +01:00
Antonio Andelic
5da3058368 Merge branch 'master' into parallel-downloading-url-engine 2022-03-22 12:20:36 +00:00
Antonio Andelic
246c66bf3e
Merge pull request #35393 from bigo-sg/hive_column_pruning_bug
Fix erasing nonexistent column
2022-03-22 08:59:33 +01:00
Alexander Tokmakov
3c762f566d Merge branch 'master' into mvcc_prototype 2022-03-21 20:16:29 +01:00
Alexander Tokmakov
3cca5fb181 minor fixes 2022-03-21 15:55:01 +01:00
Alexander Tokmakov
d0217a0025 make tests more compact 2022-03-21 14:22:15 +01:00
Alexander Tokmakov
94f616b48e Merge branch 'master' into merging_30325 2022-03-21 13:23:45 +01:00
lgbo-ustc
967d5a8055 Merge remote-tracking branch 'ck/master' into hive_column_pruning_bug 2022-03-21 19:52:06 +08:00
Vitaly Baranov
7a46e7a0d1
Merge branch 'master' into improve-backup-and-restore 2022-03-21 11:49:26 +01:00
Vitaly Baranov
51fc556fcd Implement BACKUP and RESTORE for MatViews. 2022-03-21 11:45:21 +01:00
Antonio Andelic
b8c43ff2f2 Merge branch 'master' into parallel-downloading-url-engine 2022-03-21 09:11:01 +00:00
Alexey Milovidov
0ce4696c49
Revert "[WIP] New row policies" 2022-03-21 08:41:33 +03:00
Alexander Tokmakov
9e05b12d2c Merge branch 'master' into mvcc_prototype 2022-03-20 22:42:26 +01:00
Vitaly Baranov
18173d71fb A corresponding file in base backup can be searched by checksum too, not only by name. 2022-03-20 20:02:15 +01:00
Vitaly Baranov
5f195d6ead Implement writing backups as zip archive. 2022-03-20 20:02:15 +01:00
Vitaly Baranov
e72a343994 Implement BACKUP & RESTORE for the Memory table engine. 2022-03-20 20:02:15 +01:00
Vitaly Baranov
fd1d24f624 Add settings "throw_if_database_exists" and "throw_if_table_exists". 2022-03-20 20:02:15 +01:00
Vitaly Baranov
9fb50422ce
Merge pull request #35345 from vitlibar/new-row-policies
[WIP] New row policies
2022-03-20 20:00:25 +01:00
Vitaly Baranov
afe6a1003a Add new row policy kind: simple 2022-03-20 17:34:59 +01:00
alesapin
2484a63d00
Merge pull request #35431 from ClickHouse/rename_list_option
Rename some variables in keeper
2022-03-20 15:25:04 +01:00
alesapin
1da0f11496
Merge pull request #35428 from zhangyuli1/fix_test_keeper_back_to_back_duplicate
Fix test_keeper_back_to_back duplicate error
2022-03-19 22:00:35 +01:00
alesapin
ac3c607ed4 Merge branch 'master' into rename_list_option 2022-03-19 20:16:57 +01:00
zhangyuli1
152b949adf fix duplicate error 2022-03-20 00:42:16 +08:00
alesapin
95ca06f4e2 Fix names 2022-03-19 17:41:52 +01:00
vdimir
2551adc416
Bugfix validate meta check 2022-03-18 16:31:19 +01:00
kssenii
1b06a2033e Support uuid 2022-03-18 12:24:50 +01:00
Vitaly Baranov
98e48d7b54 SHOW CREATE ROW POLICY now always shows AS permissive/restrictive if there is TO section. 2022-03-17 15:28:53 +01:00
Vitaly Baranov
470582e262 Change type of RowPolicyKind: bool -> enum. 2022-03-17 15:28:05 +01:00