Commit Graph

80371 Commits

Author SHA1 Message Date
alexey-milovidov
57011b5001
Merge pull request #33175 from Alex-Burmak/clickhouse-diagnostics
ClickHouse diagnostics tool
2021-12-29 10:12:55 +03:00
Azat Khuzhin
c541ee386b Mark some expect tests as long
CI: https://s3.amazonaws.com/clickhouse-test-reports/33263/765c7980b84ef6a7851a5fe2846a06f08382f03a/stateless_tests_flaky_check__address__actions_.html
2021-12-29 10:02:38 +03:00
Azat Khuzhin
06ac2cd6cd tests: fix 02112_delayed_clickhouse_*_with_queries_file
- fix variables inside prepare.sh
- fix variables for invoking prepare.sh
- fix path to queries file
- wait for eof on client (exiting client is required to catch all
  possible issues, that can be reported by i.e. ASan on exit)
- fix spawning of clean.sh by replace with system

Cc: @kssenii
2021-12-29 10:02:38 +03:00
Azat Khuzhin
a424b4ad56 Do not ignore eof in expect tests
expect_after that adjusts default timeout handler, reseted eof handler,
and this tell expect that it can ignore eof from read, consider the
following example:

<details>

    ```expect
    #!/usr/bin/expect -f

    exp_internal 1
    log_user 1
    set timeout 4
    match_max 100000

    expect_after {
        # eof { exp_continue }
        timeout {
            exit 1
        }
    }

    spawn bash -c "sleep 1; echo ':) '"
    expect ":) "
    ```

    ```
    $ ./expect.expect < /dev/null
    spawn bash -c sleep 1; echo ':) '
    parent: waiting for sync byte
    parent: telling child to go ahead
    parent: now unsynchronized from child
    spawn: returns {6614}

    expect: does "" (spawn_id exp4) match glob pattern ":) "? no
    expect: read eof
                 ^^^
    expect: set expect_out(spawn_id) "exp0"
    expect: set expect_out(buffer) ""
    ```

And with uncommented eof handler:

    ```
    $ ./expect.expect < /dev/null
    spawn bash -c sleep 1; echo ':) '
    parent: waiting for sync byte
    parent: telling child to go ahead
    parent: now unsynchronized from child
    spawn: returns {17959}

    expect: does "" (spawn_id exp4) match glob pattern ":) "? no
    expect: read eof
    expect: set expect_out(spawn_id) "exp0"
    expect: set expect_out(buffer) ""
    expect: continuing expect after update

    expect: does "" (spawn_id exp4) match glob pattern ":) "? no

    expect: does ":) \r\n" (spawn_id exp4) match glob pattern ":) "? yes
    expect: set expect_out(0,string) ":) "
    expect: set expect_out(spawn_id) "exp4"
    expect: set expect_out(buffer) ":) "
    ```

</details>
2021-12-29 10:02:38 +03:00
Azat Khuzhin
a23bb79479 Fix parsing symbols from resources (for shared builds)
In case of shared builds the symbol can be represented in multiple
shared objects, and so if one SO contains _end symbol firstly, then it
it's address can subtracted from the symbol from another SO, and this
give overflow.

Here is an example of such symbol:

    $ llvm-readelf -a programs/server/libclickhouse-server-libd.so | fgrep schemata_sql
       552: 000000000010b869     0 NOTYPE  GLOBAL DEFAULT    22 _binary_schemata_sql_size
      1271: 000000000010b869     0 NOTYPE  GLOBAL DEFAULT    22 _binary_schemata_sql_end
      3627: 000000000010b480     0 NOTYPE  GLOBAL DEFAULT    22 _binary_schemata_sql_start
      5822: 000000000010b869     0 NOTYPE  GLOBAL DEFAULT    22 _binary_schemata_sql_end
      5828: 000000000010b869     0 NOTYPE  GLOBAL DEFAULT    22 _binary_schemata_sql_size
      5831: 000000000010b480     0 NOTYPE  GLOBAL DEFAULT    22 _binary_schemata_sql_start

    $ llvm-readelf -W -a src/TableFunctions/libclickhouse_table_functionsd.* | fgrep schemata_sql
      1709: 00000000001fc5a1     0 NOTYPE  GLOBAL DEFAULT    22 _binary_schemata_sql_end
      5107: 00000000001fc5a1     0 NOTYPE  GLOBAL DEFAULT    22 _binary_schemata_sql_size
      6090: 00000000001fc1b8     0 NOTYPE  GLOBAL DEFAULT    22 _binary_schemata_sql_start
     10975: 00000000001fc1b8     0 NOTYPE  GLOBAL DEFAULT    22 _binary_schemata_sql_start
     10976: 00000000001fc5a1     0 NOTYPE  GLOBAL DEFAULT    22 _binary_schemata_sql_end
     10977: 00000000001fc5a1     0 NOTYPE  GLOBAL DEFAULT    22 _binary_schemata_sql_size

To address this, add base address of the Elf into the resources to
compare with.

Follow-up for: #33134 (cc @alexey-milovidov)
2021-12-29 09:56:59 +03:00
Kseniia Sumarokova
004e199af0
Merge pull request #33269 from kssenii/azure-tests-improve
Fix azure tests flackyness because of azure server closing connection
2021-12-29 09:34:57 +03:00
Kseniia Sumarokova
9b63fa6949
Merge pull request #33239 from CurtizJ/async-insert-query-log
Add asynchronous inserts to query log
2021-12-29 09:34:08 +03:00
benbiti
9004e98992 parseDateTimeBestEffort support Unix Timestamp with Milliseconds 2021-12-29 13:43:54 +08:00
Denny Crane
464b30d954 test for csv strings started with slach #26920 2021-12-28 21:21:39 -04:00
Denny Crane
a4fe8e52ed test for csv strings started with slach #26920 2021-12-28 21:20:23 -04:00
Denny Crane
8b46053e8a
fix test. Output is in another order 2021-12-28 19:50:55 -04:00
Anton Popov
8ca12bb2e8
fix style check 2021-12-29 00:43:33 +03:00
Anton Popov
d25560d37a fix queries without table name 2021-12-29 00:14:22 +03:00
kssenii
c8dcde7843 Fix 2021-12-28 23:57:36 +03:00
Maksim Kita
df95a40bbf Fixed tests 2021-12-28 23:50:48 +03:00
Maksim Kita
9ef359ce2c Dictionaries fix comment 2021-12-28 23:50:48 +03:00
Denny Crane
031451ed17 replace obsolete max_alter_threads with max_final_threads in documentation examples 2021-12-28 16:48:34 -04:00
Denny Crane
12763976b1
Update Settings.h
obsolete max_alter_threads
2021-12-28 16:35:46 -04:00
Maksim Kita
49d4619890 Updated docs 2021-12-28 22:55:31 +03:00
Maksim Kita
b5698ea134 Updated test_executable_table_function tests 2021-12-28 22:55:31 +03:00
Maksim Kita
d1db3c9f42 Updated ShellCommandSource 2021-12-28 22:55:31 +03:00
Maksim Kita
41437b72f1 Fixed integration tests 2021-12-28 22:55:31 +03:00
Maksim Kita
3386378050 Updated test_executable_table_function tests 2021-12-28 22:55:31 +03:00
Maksim Kita
61b36f22b8 Fixed style check 2021-12-28 22:55:31 +03:00
Maksim Kita
fbe65658a1 Fixed tests 2021-12-28 22:55:31 +03:00
Maksim Kita
c2977dbf58 Updated test_executable_table_function integration tests 2021-12-28 22:55:30 +03:00
Maksim Kita
de49a25185 Fixed build 2021-12-28 22:55:30 +03:00
Maksim Kita
cda8bd7f44 Added test_executable_dictionary source tests 2021-12-28 22:55:30 +03:00
Maksim Kita
04f5763f69 Added test_executable_dictionary tests 2021-12-28 22:55:30 +03:00
Maksim Kita
72909c67c2 Fix executable function tests 2021-12-28 22:55:30 +03:00
Maksim Kita
5590cfa3aa Updated executable function integration tests 2021-12-28 22:55:30 +03:00
Maksim Kita
d3e507b9ef Added executable function integrations tests 2021-12-28 22:55:30 +03:00
Maksim Kita
2ffd83ee83 Fix shell command source start 2021-12-28 22:55:30 +03:00
Maksim Kita
eb4e400c54 Executable refactoring 2021-12-28 22:55:30 +03:00
kssenii
67c5b41a58 Fix 2021-12-28 22:16:16 +03:00
alexey-milovidov
f18223f51e
Merge pull request #33262 from den-crane/patch-52
Doc. fix typos
2021-12-28 22:07:07 +03:00
Kseniia Sumarokova
0c41b46e75
Merge pull request #33187 from kssenii/materialized-postgresql-fix-cleanup
materialized postgresql make sure temporary replication slots are deleted
2021-12-28 22:04:32 +03:00
alexey-milovidov
934c1b3e83
Merge pull request #33238 from kssenii/some-killing
Allow to cancel some sources which failed to cancel
2021-12-28 22:00:44 +03:00
Denny Crane
9de3fd082e
Update grant.md 2021-12-28 14:14:32 -04:00
Denny Crane
035d757cc1
Update grant.md 2021-12-28 14:13:41 -04:00
Denny Crane
6e70d690c8
Update grant.md 2021-12-28 14:12:13 -04:00
alexey-milovidov
c046c6e08d
Merge pull request #33258 from ClickHouse/hardware-benchmark-lorenzo
Add benchmark results from Lorenzo
2021-12-28 21:02:49 +03:00
alexey-milovidov
0fe657e808
Merge pull request #33198 from azat/tests-event_date_time-today
Fix tests with event_time/event_date = today(), and add a style check
2021-12-28 20:34:33 +03:00
alexey-milovidov
5ef717e5e1
Merge pull request #33196 from meoww-bot/patch-1
Update several docs for zh translation
2021-12-28 20:34:01 +03:00
alexey-milovidov
ca17b0dcd2
Merge pull request #33229 from amosbird/nullableprimarykeyrisk
Document the risk of enabling allow_nullable_key
2021-12-28 20:32:58 +03:00
Amos Bird
a1dfebd728
More nullable primary key tests. 2021-12-29 01:11:13 +08:00
Amos Bird
b668691f6a
Fix broken tests 2021-12-29 01:06:21 +08:00
alesapin
66f6d8bcf5
Merge pull request #33256 from ClickHouse/add_retries_to_ast
Add retries to AST fuzzer download and fix flaky test.
2021-12-28 19:11:51 +03:00
Anton Popov
a6e90a046d add more info to query log in async inserts 2021-12-28 17:53:25 +03:00
pdv-ru
4956981e36 fix anchors 2021-12-28 16:51:59 +03:00