Commit Graph

12029 Commits

Author SHA1 Message Date
Azat Khuzhin
9eb400bc16 Fix 01656_test_query_log_factories_info flakiness 2021-09-27 22:31:48 +03:00
Azat Khuzhin
e44ade9281 Update test references in 01293_show_settings 2021-09-27 22:31:36 +03:00
Azat Khuzhin
dcde7fc945 Enable memory profiler in tests
This is to catch possible allocations for mutations, for
01200_mutations_memory_consumption
2021-09-27 22:31:36 +03:00
Azat Khuzhin
2378491c04 Transform isNull/isNotNull to IS NULL/IS NOT NULL (for external dbs)
This is required to support queries (like `foo IS NULL`) to external
databases (i.e. MySQL).

This patch had been submitted separately, due to:
- avoid mixing patches
- run CI (and update tests references)
2021-09-27 22:24:09 +03:00
alexey-milovidov
2902f52e1b
Merge pull request #29392 from den-crane/test/issue_23634
test for #23634 ( nullable PK and negate cond )
2021-09-27 22:20:42 +03:00
Maksim Kita
d4e19190ea
Merge pull request #29443 from kitaisreal/dictionary-view-different-databases-added-test
Dictionary view different database added test
2021-09-27 22:04:05 +03:00
Maksim Kita
7861c26eaf
Merge pull request #29431 from kitaisreal/map-bloom-filter-index-map-values-equals-support
Map bloom filter index mapValues equals function support
2021-09-27 22:03:53 +03:00
Maksim Kita
342756fe00
Merge pull request #29432 from kitaisreal/dictionary-array-nested-map-added-test
Dictionary Array nested Map added test
2021-09-27 21:55:28 +03:00
Nikolai Kochetov
236d71ea94
Merge pull request #28582 from ClickHouse/rewrite-pushing-to-views
Rewrite PushingToViews
2021-09-27 21:19:11 +03:00
Azat Khuzhin
985e8ee061 clickhouse-test: fix shared list object (by fixing manager lifetime)
Right now it is possible to get the following error:

    Having 20 errors! 0 tests passed. 0 tests skipped. 57.37 s elapsed (MainProcess).
    Won't run stateful tests because test data wasn't loaded.
    Traceback (most recent call last):
      File "/usr/lib/python3.9/multiprocessing/managers.py", line 802, in _callmethod
        conn = self._tls.connection
    AttributeError: 'ForkAwareLocal' object has no attribute 'connection'

    During handling of the above exception, another exception occurred:

    Traceback (most recent call last):
      File "/src/ch/clickhouse/.cmake/../tests/clickhouse-test", line 1462, in <module>
        main(args)
      File "/src/ch/clickhouse/.cmake/../tests/clickhouse-test", line 1261, in main
        if len(restarted_tests) > 0:
      File "<string>", line 2, in __len__
      File "/usr/lib/python3.9/multiprocessing/managers.py", line 806, in _callmethod
        self._connect()
      File "/usr/lib/python3.9/multiprocessing/managers.py", line 793, in _connect
        conn = self._Client(self._token.address, authkey=self._authkey)
      File "/usr/lib/python3.9/multiprocessing/connection.py", line 507, in Client
        c = SocketClient(address)
      File "/usr/lib/python3.9/multiprocessing/connection.py", line 635, in SocketClient
        s.connect(address)
    ConnectionRefusedError: [Errno 111] Connection refused

The reason behind this is that manager's thread got terminated:

    ipdb> p restarted_tests._manager._process
    <ForkProcess name='SyncManager-1' pid=25125 parent=24939 stopped exitcode=-SIGTERM>

Refs: #29259 (cc: @vdimir)
Follow-up for: #29197 (cc: @tavplubix)
2021-09-27 21:10:59 +03:00
Azat Khuzhin
8be6a59e65 clickhouse-test: fix long tag check for flaky check (--test-runs > 1)
Otherwise it will mark the test as failed, like in [1].

  [1]: https://clickhouse-test-reports.s3.yandex.net/29369/2320be204397bbb9f9a673cf093b7967fd37a107/functional_stateless_tests_flaky_check_(address).html#fail1

Follow-up for: #28909 (Cc: @vitlibar)
2021-09-27 21:10:14 +03:00
tavplubix
23d899fb60
Update 01158_zookeeper_log_long.sql 2021-09-27 19:54:59 +03:00
Anton Popov
9a58e4a8ba fix deadlock in concurrent async inserts and truncates 2021-09-27 19:39:32 +03:00
Maksim Kita
17f1a3910b Fixed test 2021-09-27 19:20:58 +03:00
Maksim Kita
2b8931523f Dictionary view different database added test 2021-09-27 19:19:38 +03:00
tavplubix
e9749b0027
Merge pull request #29323 from ClickHouse/fix_assertion_ddl_dependency
Fix assertion in DDLDependencyVisitor
2021-09-27 18:06:32 +03:00
alesapin
ddd80c8e72
Merge pull request #29264 from Enmk/governance/table_comment_update
Implemented modifying table comments with `ALTER TABLE t MODIFY COMMENT 'value'`
2021-09-27 18:02:14 +03:00
Maksim Kita
e290f19957 Merge branch 'master' into full-text-bloom-filter-index-map-data-type 2021-09-27 17:50:07 +03:00
Maksim Kita
bd499e5b7d Dictionary Array nested Map added test 2021-09-27 17:44:34 +03:00
Maksim Kita
b28d6e76cc Map bloom filter full text index added support for mapKeys, mapValues 2021-09-27 17:26:25 +03:00
Maksim Kita
cd9c796e6f Map bloom filter index mapValues equals function support 2021-09-27 17:23:56 +03:00
Nikita Mikhaylov
3741b8a17e
Merge pull request #29337 from amosbird/projection-fix18
Fix projection merges and mutations.
2021-09-27 13:45:13 +03:00
tavplubix
1c9778603f
Update clickhouse-test 2021-09-27 11:43:00 +03:00
Maksim Kita
f7aed5aab8
Merge pull request #29393 from azat/rocksdb-fix-data-race
rocksdb: fix race condition during multiple DB opening
2021-09-27 11:32:59 +03:00
Nikolai Kochetov
78a7665f43 Merge branch 'master' into rewrite-pushing-to-views 2021-09-27 10:56:50 +03:00
Nikolai Kochetov
841ef13dee
Merge pull request #29338 from ClickHouse/less-sleeps-in-integratin-tests
Less sleeps in integration tests.
2021-09-27 10:35:31 +03:00
Azat Khuzhin
ccf5050f7b Increase async_insert_busy_timeout_ms to avoid 02015_async_inserts_2 flakiness
It failed few times on CI [1], and it seems that 200ms is not enough:

    2021.09.26 02:43:16.063992 [ 706 ] {d5144a51-f217-48f9-8630-29492f81aae5} <Trace> ContextAccess (default): Access granted: INSERT(id, s) ON test_fptde5.async_inserts
    2021.09.26 02:43:16.069188 [ 706 ] {d5144a51-f217-48f9-8630-29492f81aae5} <Trace> AsynchronousInsertQueue: Have 1 pending inserts with total 11 bytes of data for query 'INSERT INTO test_fptde5.async_inserts FORMAT CSV'
    2021.09.26 02:43:16.209661 [ 1940 ] {} <Trace> DynamicQueryHandler: Request URI: /?database=test_fptde5&log_comment=/usr/share/clickhouse-test/queries/0_stateless/02015_async_inserts_2.sh&async_insert=1&wait_for_async_insert=1
    2021.09.26 02:43:16.340496 [ 1938 ] {e01d640f-90a8-4306-808f-d732fb144a11} <Trace> ContextAccess (default): Access granted: INSERT(id, s) ON test_fptde5.async_inserts
    2021.09.26 02:43:16.401966 [ 1938 ] {e01d640f-90a8-4306-808f-d732fb144a11} <Trace> AsynchronousInsertQueue: Have 1 pending inserts with total 11 bytes of data for query 'INSERT INTO test_fptde5.async_inserts FORMAT CSV'
    2021.09.26 02:43:16.667513 [ 1940 ] {5c059e03-397f-4f9a-95ca-0fcb3c479235} <Trace> ContextAccess (default): Access granted: INSERT(id, s) ON test_fptde5.async_inserts
    2021.09.26 02:43:16.707577 [ 1392 ] {} <Error> AsynchronousInsertQueue: Failed parsing for query 'INSERT INTO test_fptde5.async_inserts FORMAT CSV' with query id d5144a51-f217-48f9-8630-29492f81aae5. DB::ParsingException: Cannot parse input: expected ','
    before: 'qqqqqqqqqqq':
    2021.09.26 02:43:16.789697 [ 1392 ] {} <Information> AsynchronousInsertQueue: Flushed 0 rows, 0 bytes for query 'INSERT INTO test_fptde5.async_inserts FORMAT CSV'
    2021.09.26 02:43:16.872731 [ 1940 ] {5c059e03-397f-4f9a-95ca-0fcb3c479235} <Trace> AsynchronousInsertQueue: Have 1 pending inserts with total 11 bytes of data for query 'INSERT INTO test_fptde5.async_inserts FORMAT CSV'
    2021.09.26 02:43:17.472223 [ 1392 ] {} <Trace> test_fptde5.async_inserts (b877377f-9706-488b-b877-377f9706f88b): Renaming temporary part tmp_insert_all_1_1_0 to all_1_1_0.
    2021.09.26 02:43:17.527828 [ 1392 ] {} <Information> AsynchronousInsertQueue: Flushed 2 rows, 28 bytes for query 'INSERT INTO test_fptde5.async_inserts FORMAT CSV'
    2021.09.26 02:43:18.344135 [ 1859 ] {} <Trace> test_fptde5.async_inserts (b877377f-9706-488b-b877-377f9706f88b): Renaming temporary part tmp_insert_all_2_2_0 to all_2_2_0.
    2021.09.26 02:43:18.373230 [ 1859 ] {} <Information> AsynchronousInsertQueue: Flushed 2 rows, 28 bytes for query 'INSERT INTO test_fptde5.async_inserts FORMAT CSV'

  [1]: https://clickhouse-test-reports.s3.yandex.net/29364/fb584715e175fef3a4c4373d1bbcebecab1db6d8/functional_stateless_tests_(thread).html#fail1
2021-09-27 10:09:06 +03:00
Yatsishin Ilya
650de10dea Merge remote-tracking branch 'origin/master' into improve-integration-1 2021-09-27 09:47:49 +03:00
alexey-milovidov
5a7f30171a
Merge pull request #29355 from ClickHouse/remove-trash-db-regexp
Fix assert in table function `merge` with database regexp
2021-09-27 05:50:13 +03:00
alexey-milovidov
3609d4adad
Merge pull request #29164 from azat/test_send_crash_reports-fix
test_send_crash_reports: suppress Fatal messages check (due to explicit SIGSEGV)
2021-09-27 03:54:10 +03:00
alexey-milovidov
319e0c1f91
Merge pull request #29229 from azat/send-UNKNOWN_DATABASE-to-client
Send UNKNOWN_DATABASE to the client (via TCP)
2021-09-27 02:46:01 +03:00
Alexey Milovidov
8493b014cd Improve test 2021-09-27 02:16:58 +03:00
Alexey Milovidov
16f0f0af7f Merge remote-tracking branch 'origin/master' into remove-trash-db-regexp 2021-09-27 02:12:13 +03:00
alexey-milovidov
1c1e2e6b28
Merge pull request #29289 from vdimir/issue-29227-rocksdb-truncate
Fix race in StorageSystemRocksDB
2021-09-27 01:55:07 +03:00
Azat Khuzhin
b3d1bfc67a Send UNKNOWN_DATABASE to the client (via TCP)
Before this patch:

    $ clickhouse-client --database foo -q 'select 1'
    Code: 32. DB::Exception: Attempt to read after eof: while receiving packet from localhost:9000. (ATTEMPT_TO_READ_AFTER_EOF)

After:

    $ clickhouse-client --database foo -q 'select 1'
    Received exception from server (version 21.11.1):
    Code: 81. DB::Exception: Received from localhost:9000. DB::Exception: Database foo doesn't exist. (UNKNOWN_DATABASE)
    (query: select 1)

Fixes: #26864 (cc @vitlibar)
2021-09-26 23:45:29 +03:00
Denis Zhuravlev
e06115d77f test for #23634 2021-09-26 17:24:05 -03:00
alexey-milovidov
aa48698613
Merge pull request #29368 from bharatnc/ncb/fix-name-h3isResClassIII
Fix H3 function name (h3ResIsClassIII to h3IsResClassIII)
2021-09-26 20:36:36 +03:00
Nikolai Kochetov
3c9e6a04bf A little bit better 2021-09-26 18:06:32 +03:00
Anton Popov
01757a85a7
temporarily fix tests 2021-09-26 14:59:39 +03:00
Anton Popov
332a2ac990
temporarily fix tests 2021-09-26 14:58:55 +03:00
Azat Khuzhin
ad1e9e42fc Restore test_rocksdb_options::test_table_invalid_column_family_options test
This reverts commit e40a13bd1f.
2021-09-26 08:24:22 +03:00
Azat Khuzhin
d9e3419197 Restore test_rocksdb_options::test_invalid_column_family_options test
This reverts commit 1881c67eff.
2021-09-26 08:24:18 +03:00
alexey-milovidov
07eef92c16
Merge pull request #29364 from azat/benchmark-fix-query_id
Pass through initial query_id for clickhouse-benchmark
2021-09-26 03:27:27 +03:00
mergify[bot]
15e5204a7c
Merge branch 'master' into issue-29227-rocksdb-truncate 2021-09-26 00:10:30 +00:00
alexey-milovidov
0bd962630e
Merge pull request #29341 from ClickHouse/fix-rocksdb-test
Fix integration test for RocksDB
2021-09-26 01:06:55 +03:00
alexey-milovidov
6107e262aa
Merge pull request #29361 from ClickHouse/remove-useless-files
Remove useless files related to pytest
2021-09-26 01:06:20 +03:00
alexey-milovidov
9261498e2b
Merge pull request #29375 from azat/tests-purge-unused-conf
RFC: tests: purge unused configs
2021-09-26 00:29:40 +03:00
bharatnc
cd17849607 fix test - rename reference file 2021-09-25 13:11:23 -07:00
Azat Khuzhin
7ec4f3339f tests: purge unused configs 2021-09-25 21:04:40 +03:00
bharatnc
59dfc87113 Merge remote-tracking branch 'upstream/master' into ncb/fix-name-h3isResClassIII 2021-09-25 10:19:00 -07:00
bharatnc
79473f2edc Fix tests 2021-09-25 10:13:42 -07:00
alexey-milovidov
e40a13bd1f
Remove trash 2021-09-25 19:47:29 +03:00
alexey-milovidov
87d9506bb0
Merge pull request #29348 from ClickHouse/remove-nth-value
Remove window function 'nth_value'
2021-09-25 19:43:02 +03:00
mergify[bot]
4bfc82d00e
Merge branch 'master' into remove-useless-files 2021-09-25 16:41:03 +00:00
alexey-milovidov
7eddf2664e
Merge pull request #29362 from ClickHouse/remove-obsolete-non-automated-tests
Remove obsolete non-automated tests
2021-09-25 19:40:03 +03:00
Azat Khuzhin
fb584715e1 Pass through initial query_id for clickhouse-benchmark 2021-09-25 18:05:55 +03:00
Amos Bird
3022092a36
Make long test no parallel 2021-09-25 16:16:43 +08:00
Kseniia Sumarokova
9f1dea9acb
Merge pull request #29325 from lingtaolf/feature/add-query-option
Clickhouse-format support option '--query'
2021-09-25 11:02:23 +03:00
Alexey Milovidov
29feb3309b Remove obsolete non-automated tests 2021-09-25 07:09:41 +03:00
Alexey Milovidov
eaba6a7f59 Remove useless files related to pytest 2021-09-25 07:02:05 +03:00
Alexey Milovidov
fe44be522e Fix assert in table function merge with database regexp 2021-09-25 05:48:24 +03:00
alexey-milovidov
1881c67eff
Remove trash 2021-09-25 04:44:06 +03:00
Alexey Milovidov
06fc466438 Remove window function 'nth_value' 2021-09-25 04:39:38 +03:00
Anton Popov
7628273df4
Merge pull request #29266 from CurtizJ/normalize-asts
Normalize ASTs in ColumnsDescription
2021-09-25 04:01:54 +03:00
Alexey Milovidov
2b2bec3679 Make some changes to Python code that I don't understand 2021-09-25 02:04:53 +03:00
Maksim Kita
830eae6d1f
Merge pull request #29310 from kitaisreal/parser-number-binary-literal-update
Parser number binary literal update
2021-09-25 01:35:22 +03:00
凌涛
08983e432b clickhouse-format support option --query 2021-09-25 00:34:33 +08:00
Nikolai Kochetov
48bdabbc26 Less sleeps in integration tests. 2021-09-24 18:25:19 +03:00
Amos Bird
23d3d894e6
Fix projection merges and mutations. 2021-09-24 22:45:50 +08:00
alesapin
3614fb9e37
Merge pull request #29223 from ClickHouse/compressed_logs
Compressed logs for keeper
2021-09-24 16:03:26 +03:00
Vladimir C
908ae1dc12
Merge pull request #29075 from vdimir/quantile-overflow 2021-09-24 15:03:15 +03:00
Nikolai Kochetov
193f566568 Fix exception message. 2021-09-24 14:54:39 +03:00
Yatsishin Ilya
e3610dec92 do not lose docker.log if dependencies failed to start before clickhouse up called 2021-09-24 13:46:55 +03:00
Nikolai Kochetov
24dac111b7 Try fix kafka test. 2021-09-24 13:30:57 +03:00
Alexander Tokmakov
165765659d fix assertion in DDLDependencyVisitor 2021-09-24 13:22:22 +03:00
Vasily Nemkov
1d20014d5d Fixed clang12 build and updated tests 2021-09-24 13:11:00 +03:00
vdimir
152942aedf
Update 02029_quantile_sanitizer.sql 2021-09-24 13:08:46 +03:00
vdimir
241e66cd2d
Add new test 02029_quantile_sanitizer, restore 01779_quantile_deterministic_msan 2021-09-24 13:08:46 +03:00
vdimir
58a756da9e
Handle overflow in quantileTDigest 2021-09-24 13:08:45 +03:00
Nikolai Kochetov
e617aeb7a5
Merge pull request #29139 from amosbird/projection-fix17
Disable projections when ARRAY JOIN is used.
2021-09-24 11:15:23 +03:00
bharatnc
52289fa41e Merge remote-tracking branch 'upstream/master' into ncb/complete-h3-inspection-funcs 2021-09-23 14:51:13 -07:00
Maksim Kita
5047e1a452 Parser number binary literal update 2021-09-24 00:35:41 +03:00
Maksim Kita
1ebb49d939 Revert parse number binary literal 2021-09-24 00:23:15 +03:00
bharatnc
de65461158 Merge remote-tracking branch 'upstream/master' into ncb/complete-h3-inspection-funcs 2021-09-23 13:44:36 -07:00
Maksim Kita
d766fc47c4 Updated tests 2021-09-23 20:54:35 +03:00
bharatnc
f02d81be24 Merge remote-tracking branch 'upstream/master' into ncb/complete-h3-inspection-funcs 2021-09-23 08:59:39 -07:00
Yatsishin Ilya
bbac70693e Merge remote-tracking branch 'origin' into improve-integration-1 2021-09-23 17:35:06 +03:00
Yatsishin Ilya
ad4f7498ad add comment 2021-09-23 17:35:04 +03:00
vdimir
9af2e4891d
Cleanup test rocksdb_race_long.sh 2021-09-23 16:19:39 +03:00
Nikita Mikhaylov
e8ab9feb94
Merge pull request #29265 from ClickHouse/fix_yaml_test
Fix YAML integration tests
2021-09-23 15:12:38 +03:00
vdimir
1bb48cbe72
Add test for segfault in StorageEmbeddedRocksDB, issue #29227 2021-09-23 13:54:12 +03:00
Nikolai Kochetov
28d1938ac4 Remote 01200_mutations_memory_consumption from fast 2021-09-23 13:44:00 +03:00
Nikolai Kochetov
998d29ebc7 Merge branch 'master' into rewrite-pushing-to-views 2021-09-23 13:10:27 +03:00
Kruglov Pavel
6461391387
Merge pull request #29077 from Avogar/fix-msgpack
Improve MsgPack input/output format
2021-09-23 12:46:36 +03:00
Maksim Kita
3d79812427 Merge branch 'master' into full-text-bloom-filter-index-map-data-type 2021-09-23 12:38:03 +03:00
Maksim Kita
0341b99c69
Merge pull request #29280 from kitaisreal/full-text-bloom-filter-added-support-for-array-data-type
FullText bloom filter index added support for Array data type
2021-09-23 12:34:06 +03:00
alesapin
941724bc11 Fix test rocksdb 2021-09-23 12:19:30 +03:00
Maksim Kita
d59986f224
Merge pull request #29278 from kitaisreal/bloom-filter-map-added-support-for-has-function
Bloom filter map added support for has function
2021-09-23 12:03:56 +03:00
alesapin
d1bb8d666e Move all yaml tests to clickhouse config 2021-09-23 11:08:40 +03:00
Vasily Nemkov
3b762f10a0 Fixed test 2021-09-23 10:31:59 +03:00