Commit Graph

14509 Commits

Author SHA1 Message Date
Azat Khuzhin
63eac4b0cf tests/integration/test_storage_kafka: cover CustomSeparated 2021-12-31 12:02:21 +03:00
Azat Khuzhin
f1c726a675 tests/integration/test_storage_kafka: cover Template format 2021-12-31 11:25:08 +03:00
alexey-milovidov
42b8678785
Merge pull request #33271 from ClickHouse/always-display-resource-usage-in-client
Always display resource usage in client
2021-12-30 23:36:49 +03:00
Vladimir C
794e906ffd
Merge pull request #33218 from amosbird/betternullablekey 2021-12-30 17:13:44 +03:00
Azat Khuzhin
52ad7a4538 Fix test_storage_kafka failures by adjusting retention.ms
This test uses predefined timestamps, and default retention.ms is too
small:

    kafka1_1           | [2021-12-28 21:40:21,842] INFO Created log for partition virt2_0-0 in /var/lib/kafka/data with properties {compression.type -> producer, message.format.version -> 2.2-IV1, file.delete.delay.ms -> 60000, max.message.bytes -> 1000012, min.compaction.lag.ms -> 0, message.timestamp.type -> CreateTime, message.downconversion.enable -> true, min.insync.replicas -> 1, segment.jitter.ms -> 0, preallocate -> false, min.cleanable.dirty.ratio -> 0.5, index.interval.bytes -> 4096, unclean.leader.election.enable -> false, retention.bytes -> -1, delete.retention.ms -> 86400000, cleanup.policy -> [delete], flush.ms -> 9223372036854775807, segment.ms -> 604800000, segment.bytes -> 1073741824, retention.ms -> 604800000, message.timestamp.difference.max.ms -> 9223372036854775807, segment.index.bytes -> 10485760, flush.messages -> 9223372036854775807}. (kafka.log.LogManager)

    kafka1_1           | [2021-12-28 21:40:24,540] INFO [Log partition=virt2_0-0, dir=/var/lib/kafka/data] Found deletable segments with base offsets [0] due to retention time 604800000ms breach (kafka.log.Log)

v2: fix tests with 0 timestamp_ms
    and this should be all tests that was left:

    $ fgrep 'Found deletable segments with base offsets' test_storage_kafka/_instances_0/docker.log
    kafka1_1           | [2021-12-29 09:46:15,610] INFO [Log partition=avro1-0, dir=/var/lib/kafka/data] Found deletable segments with base offsets [0] due to retention time 604800000ms breach (kafka.log.Log)
    kafka1_1           | [2021-12-29 09:51:15,609] INFO [Log partition=virt1-0, dir=/var/lib/kafka/data] Found deletable segments with base offsets [0] due to retention time 604800000ms breach (kafka.log.Log)
2021-12-30 10:25:10 +03:00
Nikolai Kochetov
11f64d6e1f
Merge pull request #33286 from vdimir/issue_31979
Disable FunctionConvertFromString::canBeExecutedOnDefaultArguments
2021-12-30 07:19:42 +03:00
alexey-milovidov
e879aca58b
Update run_check.py 2021-12-29 23:21:47 +03:00
alesapin
4a1819c4d2 Fix jepsen check 2021-12-29 22:44:41 +03:00
Kruglov Pavel
489a30859f
Merge pull request #32455 from Avogar/schema-inference
Automatic schema inference for input formats
2021-12-29 21:03:48 +03:00
alexey-milovidov
aa4044f14e
Merge pull request #33265 from den-crane/test/create_table_w_timezone
test for #24410
2021-12-29 20:21:26 +03:00
Kseniia Sumarokova
3bb9da0286
Merge pull request #33266 from kssenii/rabbit-wait-container
Wait for RabbitMQ container to actually start when it was restarted in test on purpose
2021-12-29 18:45:34 +03:00
Mikhail f. Shiryaev
272ea7fc5b
Merge pull request #32609 from cmsxbc/query-kind-concurent_restriction
add settings: max_concurrent_select_queries and max_concurrent_insert_queries
2021-12-29 15:23:45 +01:00
Vladimir C
f31f0578fd
Merge pull request #33276 from benbiti/improve_parseDateTime64BestEffort 2021-12-29 16:42:05 +03:00
Denny Crane
d19de98f07 Update 02155_create_table_w_timezone.sql 2021-12-29 13:21:50 +00:00
Denny Crane
e75e4b77e7 test for #24410 2021-12-29 13:21:50 +00:00
Nikolai Kochetov
c715204e18
Merge pull request #32271 from Algunenano/kill_scalar_github
Be able to KILL scalar queries
2021-12-29 16:00:59 +03:00
tavplubix
65a2b5aeb8
Merge pull request #33228 from amosbird/nullablekeytests
More nullable primary key tests.
2021-12-29 15:28:48 +03:00
vdimir
c8a79d61e8
Simplify case in test parse_date_lowcard_default_throw 2021-12-29 15:06:27 +03:00
vdimir
b78f5c70b5
Add test parse_date_lowcard_default_throw, issue #31979 2021-12-29 13:41:13 +03:00
alesapin
7e1767542c
Merge pull request #33249 from nicelulu/fix_acl
clickhouse-keeper acl consistent with zookeeper, accept generated digest
2021-12-29 13:21:10 +03:00
kssenii
2279dd0c7f Reuse check_rabbitmq_is_available 2021-12-29 13:14:21 +03:00
alesapin
24df9dedd3
Merge pull request #33272 from den-crane/test/26920
Test for #26920
2021-12-29 13:02:58 +03:00
alesapin
739297b169
Merge pull request #33268 from den-crane/patch-53
Mark max_alter_threads as obsolete
2021-12-29 13:01:57 +03:00
Kruglov Pavel
dd7f61b337
Merge branch 'master' into schema-inference 2021-12-29 12:59:05 +03:00
Maksim Kita
a5256e5b6e
Merge pull request #30957 from kitaisreal/executable-refactoring
Executable refactoring
2021-12-29 12:43:41 +03:00
Maksim Kita
c3c8af747d
Merge pull request #33261 from kitaisreal/dictionaries-fix-comment
Dictionaries fix comment
2021-12-29 12:43:24 +03:00
avogar
26abf7aa62 Remove code duplication, use simdjson and rapidjson instead of Poco 2021-12-29 12:21:01 +03:00
avogar
e3dbfe6bf6 Better test url engine 2021-12-29 12:18:56 +03:00
avogar
bc5f428f97 Fix tests 2021-12-29 12:18:56 +03:00
avogar
622a013b7b Fix tests 2021-12-29 12:18:56 +03:00
avogar
9f30c17777 Fix tests 2021-12-29 12:18:56 +03:00
avogar
8a65c265e9 Fix shellcheck 2021-12-29 12:18:56 +03:00
avogar
74f09d6476 Fix tests 2021-12-29 12:18:56 +03:00
avogar
3d38e466b1 Fix tests 2021-12-29 12:18:56 +03:00
avogar
aaf9f85c67 Add more tests and fixes 2021-12-29 12:18:56 +03:00
avogar
dd994aa761 Add some tests and some fixes 2021-12-29 12:18:56 +03:00
benbiti
a954de4560 fix missing ; in tests 2021-12-29 16:50:27 +08:00
Azat Khuzhin
c541ee386b Mark some expect tests as long
CI: https://s3.amazonaws.com/clickhouse-test-reports/33263/765c7980b84ef6a7851a5fe2846a06f08382f03a/stateless_tests_flaky_check__address__actions_.html
2021-12-29 10:02:38 +03:00
Azat Khuzhin
06ac2cd6cd tests: fix 02112_delayed_clickhouse_*_with_queries_file
- fix variables inside prepare.sh
- fix variables for invoking prepare.sh
- fix path to queries file
- wait for eof on client (exiting client is required to catch all
  possible issues, that can be reported by i.e. ASan on exit)
- fix spawning of clean.sh by replace with system

Cc: @kssenii
2021-12-29 10:02:38 +03:00
Azat Khuzhin
a424b4ad56 Do not ignore eof in expect tests
expect_after that adjusts default timeout handler, reseted eof handler,
and this tell expect that it can ignore eof from read, consider the
following example:

<details>

    ```expect
    #!/usr/bin/expect -f

    exp_internal 1
    log_user 1
    set timeout 4
    match_max 100000

    expect_after {
        # eof { exp_continue }
        timeout {
            exit 1
        }
    }

    spawn bash -c "sleep 1; echo ':) '"
    expect ":) "
    ```

    ```
    $ ./expect.expect < /dev/null
    spawn bash -c sleep 1; echo ':) '
    parent: waiting for sync byte
    parent: telling child to go ahead
    parent: now unsynchronized from child
    spawn: returns {6614}

    expect: does "" (spawn_id exp4) match glob pattern ":) "? no
    expect: read eof
                 ^^^
    expect: set expect_out(spawn_id) "exp0"
    expect: set expect_out(buffer) ""
    ```

And with uncommented eof handler:

    ```
    $ ./expect.expect < /dev/null
    spawn bash -c sleep 1; echo ':) '
    parent: waiting for sync byte
    parent: telling child to go ahead
    parent: now unsynchronized from child
    spawn: returns {17959}

    expect: does "" (spawn_id exp4) match glob pattern ":) "? no
    expect: read eof
    expect: set expect_out(spawn_id) "exp0"
    expect: set expect_out(buffer) ""
    expect: continuing expect after update

    expect: does "" (spawn_id exp4) match glob pattern ":) "? no

    expect: does ":) \r\n" (spawn_id exp4) match glob pattern ":) "? yes
    expect: set expect_out(0,string) ":) "
    expect: set expect_out(spawn_id) "exp4"
    expect: set expect_out(buffer) ":) "
    ```

</details>
2021-12-29 10:02:38 +03:00
Kseniia Sumarokova
004e199af0
Merge pull request #33269 from kssenii/azure-tests-improve
Fix azure tests flackyness because of azure server closing connection
2021-12-29 09:34:57 +03:00
Kseniia Sumarokova
9b63fa6949
Merge pull request #33239 from CurtizJ/async-insert-query-log
Add asynchronous inserts to query log
2021-12-29 09:34:08 +03:00
benbiti
9004e98992 parseDateTimeBestEffort support Unix Timestamp with Milliseconds 2021-12-29 13:43:54 +08:00
Denny Crane
464b30d954 test for csv strings started with slach #26920 2021-12-28 21:21:39 -04:00
Denny Crane
a4fe8e52ed test for csv strings started with slach #26920 2021-12-28 21:20:23 -04:00
Denny Crane
8b46053e8a
fix test. Output is in another order 2021-12-28 19:50:55 -04:00
Alexey Milovidov
422061ce71 Update tests 2021-12-29 01:43:43 +03:00
Anton Popov
8ca12bb2e8
fix style check 2021-12-29 00:43:33 +03:00
kssenii
c8dcde7843 Fix 2021-12-28 23:57:36 +03:00
Maksim Kita
df95a40bbf Fixed tests 2021-12-28 23:50:48 +03:00