Commit Graph

80489 Commits

Author SHA1 Message Date
Kruglov Pavel
dd7f61b337
Merge branch 'master' into schema-inference 2021-12-29 12:59:05 +03:00
alesapin
396cbbd6b7
Update docs/ru/operations/settings/settings.md 2021-12-29 12:57:08 +03:00
alesapin
475fdb7beb
Update docs/ru/operations/settings/settings.md 2021-12-29 12:56:46 +03:00
alesapin
28835757f9
Update docs/ru/operations/settings/settings.md 2021-12-29 12:56:32 +03:00
zhoubintao
8690cf082f remove redundant judge to make heavy map iter operation faster 2021-12-29 17:48:39 +08:00
alesapin
dcdaa31c7d
Update docs/ru/operations/clickhouse-keeper.md 2021-12-29 12:43:54 +03:00
alesapin
ace477b6e6
Update docs/ru/operations/clickhouse-keeper.md 2021-12-29 12:43:48 +03:00
Maksim Kita
a5256e5b6e
Merge pull request #30957 from kitaisreal/executable-refactoring
Executable refactoring
2021-12-29 12:43:41 +03:00
alesapin
bc5c4057fd
Update docs/ru/operations/clickhouse-keeper.md 2021-12-29 12:43:41 +03:00
alesapin
73af23e323
Update docs/ru/operations/clickhouse-keeper.md 2021-12-29 12:43:34 +03:00
alesapin
a2e330e271
Update docs/ru/operations/clickhouse-keeper.md 2021-12-29 12:43:29 +03:00
Maksim Kita
c3c8af747d
Merge pull request #33261 from kitaisreal/dictionaries-fix-comment
Dictionaries fix comment
2021-12-29 12:43:24 +03:00
alesapin
4dd890ed17
Update docs/ru/development/developer-instruction.md 2021-12-29 12:43:24 +03:00
alesapin
e90003f050
Update docs/ru/operations/clickhouse-keeper.md 2021-12-29 12:43:19 +03:00
alesapin
e62a8de46b
Update docs/ru/development/developer-instruction.md 2021-12-29 12:43:12 +03:00
Kruglov Pavel
062f14cb57
Merge pull request #33263 from azat/fix-expect-tests
Do not ignore eof in expect tests
2021-12-29 12:42:57 +03:00
avogar
364b4f5d36 Fix special build 2021-12-29 12:21:01 +03:00
Kruglov Pavel
cb0ed7fcb7 Fix typo 2021-12-29 12:21:01 +03:00
avogar
78b522fd51 Fix fasttest build 2021-12-29 12:21:01 +03:00
avogar
8436638a89 Fix style 2021-12-29 12:21:01 +03:00
avogar
d718a2e220 Clean up 2021-12-29 12:21:01 +03:00
avogar
26abf7aa62 Remove code duplication, use simdjson and rapidjson instead of Poco 2021-12-29 12:21:01 +03:00
avogar
e3dbfe6bf6 Better test url engine 2021-12-29 12:18:56 +03:00
avogar
bc5f428f97 Fix tests 2021-12-29 12:18:56 +03:00
avogar
622a013b7b Fix tests 2021-12-29 12:18:56 +03:00
avogar
9f30c17777 Fix tests 2021-12-29 12:18:56 +03:00
avogar
8a65c265e9 Fix shellcheck 2021-12-29 12:18:56 +03:00
avogar
74f09d6476 Fix tests 2021-12-29 12:18:56 +03:00
avogar
3d38e466b1 Fix tests 2021-12-29 12:18:56 +03:00
avogar
aaf9f85c67 Add more tests and fixes 2021-12-29 12:18:56 +03:00
avogar
dd994aa761 Add some tests and some fixes 2021-12-29 12:18:56 +03:00
avogar
8112a71233 Implement schema inference for most input formats 2021-12-29 12:18:56 +03:00
benbiti
a954de4560 fix missing ; in tests 2021-12-29 16:50:27 +08:00
Ivan Blinkov
e671252131
[docs/faq] Does ClickHouse support multi-region replication? (#32700)
* [docs/faq] Does ClickHouse support multi-region replication?

* Update index.md

* add i18n symlinks

* fix symlinks
2021-12-29 11:40:12 +03:00
Chun-Sheng, Li
6784838047 Adding cURL installation message to notice users 2021-12-29 16:05:12 +08:00
lgbo-ustc
5a3b215f24 fixed code style 2021-12-29 16:00:57 +08:00
lgbo-ustc
6aaeb285b0 update destructor 2021-12-29 15:44:24 +08:00
lgbo-ustc
0d474069b5 add a new test case 2021-12-29 15:38:58 +08:00
lgbo-ustc
5f85f77266 add a new test case 2021-12-29 15:34:20 +08:00
lgbo-ustc
5a419a356b fix a bug 2021-12-29 15:29:59 +08:00
lgbo-ustc
59cbd76880 Add LRUResourceCache
1. add LRUResourceCache for managing resource cache in lru policy
2. rollback LRUCache to the original version
3. add remove() in LRUCache
4. add unit tests for LRUResourceCache and LRUCache
2021-12-29 15:25:33 +08:00
alexey-milovidov
57011b5001
Merge pull request #33175 from Alex-Burmak/clickhouse-diagnostics
ClickHouse diagnostics tool
2021-12-29 10:12:55 +03:00
Azat Khuzhin
c541ee386b Mark some expect tests as long
CI: https://s3.amazonaws.com/clickhouse-test-reports/33263/765c7980b84ef6a7851a5fe2846a06f08382f03a/stateless_tests_flaky_check__address__actions_.html
2021-12-29 10:02:38 +03:00
Azat Khuzhin
06ac2cd6cd tests: fix 02112_delayed_clickhouse_*_with_queries_file
- fix variables inside prepare.sh
- fix variables for invoking prepare.sh
- fix path to queries file
- wait for eof on client (exiting client is required to catch all
  possible issues, that can be reported by i.e. ASan on exit)
- fix spawning of clean.sh by replace with system

Cc: @kssenii
2021-12-29 10:02:38 +03:00
Azat Khuzhin
a424b4ad56 Do not ignore eof in expect tests
expect_after that adjusts default timeout handler, reseted eof handler,
and this tell expect that it can ignore eof from read, consider the
following example:

<details>

    ```expect
    #!/usr/bin/expect -f

    exp_internal 1
    log_user 1
    set timeout 4
    match_max 100000

    expect_after {
        # eof { exp_continue }
        timeout {
            exit 1
        }
    }

    spawn bash -c "sleep 1; echo ':) '"
    expect ":) "
    ```

    ```
    $ ./expect.expect < /dev/null
    spawn bash -c sleep 1; echo ':) '
    parent: waiting for sync byte
    parent: telling child to go ahead
    parent: now unsynchronized from child
    spawn: returns {6614}

    expect: does "" (spawn_id exp4) match glob pattern ":) "? no
    expect: read eof
                 ^^^
    expect: set expect_out(spawn_id) "exp0"
    expect: set expect_out(buffer) ""
    ```

And with uncommented eof handler:

    ```
    $ ./expect.expect < /dev/null
    spawn bash -c sleep 1; echo ':) '
    parent: waiting for sync byte
    parent: telling child to go ahead
    parent: now unsynchronized from child
    spawn: returns {17959}

    expect: does "" (spawn_id exp4) match glob pattern ":) "? no
    expect: read eof
    expect: set expect_out(spawn_id) "exp0"
    expect: set expect_out(buffer) ""
    expect: continuing expect after update

    expect: does "" (spawn_id exp4) match glob pattern ":) "? no

    expect: does ":) \r\n" (spawn_id exp4) match glob pattern ":) "? yes
    expect: set expect_out(0,string) ":) "
    expect: set expect_out(spawn_id) "exp4"
    expect: set expect_out(buffer) ":) "
    ```

</details>
2021-12-29 10:02:38 +03:00
Azat Khuzhin
a23bb79479 Fix parsing symbols from resources (for shared builds)
In case of shared builds the symbol can be represented in multiple
shared objects, and so if one SO contains _end symbol firstly, then it
it's address can subtracted from the symbol from another SO, and this
give overflow.

Here is an example of such symbol:

    $ llvm-readelf -a programs/server/libclickhouse-server-libd.so | fgrep schemata_sql
       552: 000000000010b869     0 NOTYPE  GLOBAL DEFAULT    22 _binary_schemata_sql_size
      1271: 000000000010b869     0 NOTYPE  GLOBAL DEFAULT    22 _binary_schemata_sql_end
      3627: 000000000010b480     0 NOTYPE  GLOBAL DEFAULT    22 _binary_schemata_sql_start
      5822: 000000000010b869     0 NOTYPE  GLOBAL DEFAULT    22 _binary_schemata_sql_end
      5828: 000000000010b869     0 NOTYPE  GLOBAL DEFAULT    22 _binary_schemata_sql_size
      5831: 000000000010b480     0 NOTYPE  GLOBAL DEFAULT    22 _binary_schemata_sql_start

    $ llvm-readelf -W -a src/TableFunctions/libclickhouse_table_functionsd.* | fgrep schemata_sql
      1709: 00000000001fc5a1     0 NOTYPE  GLOBAL DEFAULT    22 _binary_schemata_sql_end
      5107: 00000000001fc5a1     0 NOTYPE  GLOBAL DEFAULT    22 _binary_schemata_sql_size
      6090: 00000000001fc1b8     0 NOTYPE  GLOBAL DEFAULT    22 _binary_schemata_sql_start
     10975: 00000000001fc1b8     0 NOTYPE  GLOBAL DEFAULT    22 _binary_schemata_sql_start
     10976: 00000000001fc5a1     0 NOTYPE  GLOBAL DEFAULT    22 _binary_schemata_sql_end
     10977: 00000000001fc5a1     0 NOTYPE  GLOBAL DEFAULT    22 _binary_schemata_sql_size

To address this, add base address of the Elf into the resources to
compare with.

Follow-up for: #33134 (cc @alexey-milovidov)
2021-12-29 09:56:59 +03:00
Kseniia Sumarokova
004e199af0
Merge pull request #33269 from kssenii/azure-tests-improve
Fix azure tests flackyness because of azure server closing connection
2021-12-29 09:34:57 +03:00
Kseniia Sumarokova
9b63fa6949
Merge pull request #33239 from CurtizJ/async-insert-query-log
Add asynchronous inserts to query log
2021-12-29 09:34:08 +03:00
benbiti
9004e98992 parseDateTimeBestEffort support Unix Timestamp with Milliseconds 2021-12-29 13:43:54 +08:00
Denny Crane
464b30d954 test for csv strings started with slach #26920 2021-12-28 21:21:39 -04:00