Commit Graph

80210 Commits

Author SHA1 Message Date
vdimir
94bb7cba62
cluster discovery wip 2021-12-27 15:26:05 +03:00
alesapin
8bb6205293 Fix keeper log messages 2021-12-27 15:23:44 +03:00
alexey-milovidov
3284f4d631
Merge pull request #33217 from ClickHouse/remove-trash-utils
Remove old trash
2021-12-27 15:19:49 +03:00
Vitaly Baranov
f80a3e3247
Merge pull request #30549 from aiven/kmichel-server-reload
Start/stop servers when `listen_host`/`*_port` changes
2021-12-27 14:51:00 +03:00
alesapin
48f0cee798 Merge branch 'master' into fix_flaky_integration_tests 2021-12-27 14:38:26 +03:00
alesapin
4eb8c11bb0
Merge pull request #33163 from azat/fix-test_input_format_parallel_parsing_memory_tracking
Make test_input_format_parallel_parsing_memory_tracking less flaky
2021-12-27 14:36:32 +03:00
alexey-milovidov
cecfa36cf6
Update website/blog/en/2021/tests-visualization.md
Co-authored-by: alesapin <alesapin@clickhouse.com>
2021-12-27 14:10:06 +03:00
Alexey Milovidov
79e50a9ff6 Update benchmark info 2021-12-27 13:58:53 +03:00
alesapin
d188771c05
Merge pull request #33222 from ClickHouse/fix_cancell_lambda
Fix cancel lambda
2021-12-27 13:27:40 +03:00
alesapin
33fd1a44ac Fix cancel lambda 2021-12-27 13:26:16 +03:00
alexey-milovidov
493f71470b
Update client-libraries.md 2021-12-27 13:14:29 +03:00
Alexey Milovidov
8ec4547c17 Remove old trash 2021-12-27 12:50:21 +03:00
tavplubix
0d87fa3c04
Merge pull request #32698 from ClickHouse/blinkov-patch-25
[docs/faq] How do I contribute code to ClickHouse?
2021-12-27 12:49:02 +03:00
alesapin
caad89b7cf
Merge pull request #33207 from ClickHouse/more_debug
More debug in jepsen test
2021-12-27 12:46:04 +03:00
alesapin
593dc6cf90 Fix some flaky integration tests 2021-12-27 12:24:19 +03:00
kssenii
a1aab3a82d Fix 2021-12-27 11:59:33 +03:00
Alexey Milovidov
46dc07310f Add a blog post about flaky tests 2021-12-27 11:52:17 +03:00
Vladimir C
11ad2b0fca
Merge pull request #32924 from ka1bi4/romanzhukov-DOCSUP-17856-cread-remotefs 2021-12-27 11:50:46 +03:00
Vladimir C
ea5f867289
Merge pull request #33179 from kssenii/materialized-postgresql-fix-detach-with-schema 2021-12-27 11:42:59 +03:00
Vladimir C
211a5a8d6b
Merge pull request #33159 from xuyatian/master 2021-12-27 11:40:59 +03:00
Ivan Blinkov
6324d2fb31 add i18n symlinks 2021-12-27 11:25:37 +03:00
kssenii
1bd4936961 Add retry for postgres query 2021-12-27 11:03:04 +03:00
alesapin
342c8231fa Better 2021-12-27 10:33:44 +03:00
alesapin
e683fa146b More debug info in jepsen check 2021-12-27 10:33:25 +03:00
Ilya Yatsishin
a7cf7b4d6f
Merge pull request #33124 from bigo-sg/inject_gitinfo 2021-12-27 10:21:12 +03:00
kssenii
568aeec0b3 Review fix 2021-12-27 09:51:29 +03:00
Azat Khuzhin
dc76817329 Fix 01370_client_autocomplete_word_break_characters test logic
AFAICS right now it works only because completion loaded too quickly,
since `expect "_"` will block for 60 seconds if completion is not
available.
2021-12-26 22:25:49 +03:00
Yatian Xu
8dc07dff4a add Clarification for test case 2021-12-26 11:24:47 -08:00
kssenii
5b15b2be2d Merge remote-tracking branch 'upstream/master' into materialized-postgresql-fix-detach-with-schema 2021-12-26 21:06:08 +03:00
Azat Khuzhin
906ebc9fd4 test_input_format_parallel_parsing_memory_tracking: increase max_server_memory_usage
Even after disabling all system tables TSan build still not passed,
since it uses 2.8Gi of RAM just after start, so let's increase this
memory limit a little.
2021-12-26 16:50:35 +03:00
Azat Khuzhin
3f752c3acb Make test_input_format_parallel_parsing_memory_tracking less flaky
By disabling system tables, that may consume memory too.

Also note, that failures with "curl: (56) Recv failure: Connection reset
by peer" like [1] is due to memory, since the server was under memory
pressure, and was not able even to accept the connection:

<details>

    2021.12.25 00:22:02.957658 [ 54 ] {} <Error> ThreadStatus: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 2.81 GiB (attempt to allocate chunk of 2097182 bytes), maximum: 2.79 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

    0. ./obj-x86_64-linux-gnu/../contrib/libcxx/include/exception:0: Poco::Exception::Exception(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&, int) @ 0x1addca1b in /usr/bin/clickhouse
    1. ./obj-x86_64-linux-gnu/../src/Common/Exception.cpp:57: DB::Exception::Exception(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&, int, bool) @ 0xa0e993c in /usr/bin/clickhouse
    2. ./obj-x86_64-linux-gnu/../contrib/libcxx/include/string:1444: DB::Exception::Exception<char const*, char const*, std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> >, long&, std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > >(int, std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&, char const*&&, char const*&&, std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> >&&, long&, std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> >&&) @ 0xa11344b in /usr/bin/clickhouse
    3. ./obj-x86_64-linux-gnu/../src/Common/MemoryTracker.cpp:226: MemoryTracker::allocImpl(long, bool) @ 0xa11220c in /usr/bin/clickhouse
    4. ./obj-x86_64-linux-gnu/../src/Common/MemoryTracker.cpp:258: MemoryTracker::allocImpl(long, bool) @ 0xa111faa in /usr/bin/clickhouse
    5. ./obj-x86_64-linux-gnu/../src/Common/MemoryTracker.cpp:264: MemoryTracker::alloc(long) @ 0xa112bc6 in /usr/bin/clickhouse
    6. ./obj-x86_64-linux-gnu/../src/Common/ThreadStatus.cpp:152: DB::ThreadStatus::~ThreadStatus() @ 0xa10e182 in /usr/bin/clickhouse
    7. ./obj-x86_64-linux-gnu/../src/Server/TCPHandler.cpp:518: DB::TCPHandler::runImpl() @ 0x17c4192d in /usr/bin/clickhouse
    8. ./obj-x86_64-linux-gnu/../src/Server/TCPHandler.cpp:1909: DB::TCPHandler::run() @ 0x17c55328 in /usr/bin/clickhouse
    9. ./obj-x86_64-linux-gnu/../contrib/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x1ac19f03 in /usr/bin/clickhouse
    10. ./obj-x86_64-linux-gnu/../contrib/libcxx/include/memory:1397: Poco::Net::TCPServerDispatcher::run() @ 0x1ac1a773 in /usr/bin/clickhouse
    11. ./obj-x86_64-linux-gnu/../contrib/poco/Foundation/src/ThreadPool.cpp:213: Poco::PooledThread::run() @ 0x1ae7e796 in /usr/bin/clickhouse
    12. ./obj-x86_64-linux-gnu/../contrib/poco/Foundation/src/Thread.cpp:56: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x1ae7c930 in /usr/bin/clickhouse
    13. ./obj-x86_64-linux-gnu/../contrib/poco/Foundation/include/Poco/SharedPtr.h:277: Poco::ThreadImpl::runnableEntry(void*) @ 0x1ae7afa8 in /usr/bin/clickhouse
    14. __tsan_thread_start_func @ 0xa039dfd in /usr/bin/clickhouse
    15. ? @ 0x7f4c565cf609 in ?
    16. clone @ 0x7f4c564f6293 in ?
     (version 21.13.1.1305)

</details>

  [1]: https://s3.amazonaws.com/clickhouse-test-reports/33140/b4420cfa3e834ab9026914978697ded3180122a0/integration_tests__thread__actions__[3/4].html
2021-12-26 16:50:34 +03:00
Azat Khuzhin
bcce1d70b2 tests: update tests with event_time/event_date = today() to >= yesterday()
This will fix failures like in [1], from query_log from artifacts:

    SELECT
        query,
        event_time
    FROM system.query_log
    WHERE (NOT is_initial_query) AND (query NOT LIKE '%system%query_log%') AND (query LIKE concat('WITH%', 'test_84qkvq', '%AS `id_no` %')) AND (type = 'QueryFinish')

    Query id: c5d70aba-b0aa-4f92-bdb3-29547b9aabb1

    ┌─query──────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┬──────────event_time─┐
    │ WITH _CAST('test_84qkvq', 'Nullable(String)') AS `id_no` SELECT `one`.`dummy`, ignore(`id_no`) FROM `system`.`one` WHERE `dummy` IN (0, 2) │ 2021-12-25 23:59:59 │
    │ WITH _CAST('test_84qkvq', 'Nullable(String)') AS `id_no` SELECT `one`.`dummy`, ignore(`id_no`) FROM `system`.`one` WHERE `dummy` IN (0, 2) │ 2021-12-25 23:59:59 │
    └────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┴─────────────────────┘

    2 rows in set. Elapsed: 0.032 sec.

  [1]: https://s3.amazonaws.com/clickhouse-test-reports/33175/465a9bf615e1b233606460f956c09f71931c99a2/stateless_tests__debug__actions__[2/3].html
2021-12-26 16:35:15 +03:00
Azat Khuzhin
6d9d7df9d6 check-style: check for event_time/event_date = today() queries 2021-12-26 16:25:15 +03:00
Azat Khuzhin
78f66c6d72 check-style: remove absolete filters
Follow-up for: eaba6a7f59
2021-12-26 16:13:03 +03:00
Tatiana Kirillova
a4d364ab03 update text 2021-12-26 14:03:49 +03:00
Tatiana Kirillova
e3e1fe74c1 update 2021-12-26 13:55:49 +03:00
Tatiana Kirillova
05a33abf26 OR operator in ON section for JOIN 2021-12-26 13:38:22 +03:00
meoww-bot
717b9a2286
Update contributors.md 2021-12-26 17:33:58 +08:00
alexey-milovidov
454207a9a2
Merge pull request #33176 from kssenii/postgres-update-doc
Update postgres doc
2021-12-26 12:31:21 +03:00
alexey-milovidov
a5824cb3e0
Merge pull request #33195 from ClickHouse/hardware-benchmark-results-2
Hardware benchmark results 2
2021-12-26 12:25:42 +03:00
meoww-bot
c61609c4b9
Update columns.md 2021-12-26 17:23:12 +08:00
Alexey Milovidov
26aedf247c Add one more result 2021-12-26 12:23:09 +03:00
Alexey Milovidov
9e7a80f581 Add RockPi4 2021-12-26 12:18:06 +03:00
meoww-bot
975b8211b5
Remove duplicates
The duplicates was introduced by this [commit](00a2dfb1bf)
2021-12-26 16:25:45 +08:00
meoww-bot
d2e0984702
Update detached_parts.md 2021-12-26 16:15:36 +08:00
taiyang-li
8daeefeebe inject gitinfo 2021-12-26 15:46:38 +08:00
Kseniia Sumarokova
495faad49f
Update materialized-postgresql.md 2021-12-26 10:20:43 +03:00
kssenii
2bcb122cd0 Clean up unused replication slots 2021-12-26 10:15:03 +03:00
alexey-milovidov
bd39ced0e4
Merge pull request #33185 from ClickHouse/tests-visualizer
Add a simple tool to visualize flaky tests
2021-12-26 08:43:21 +03:00
alexey-milovidov
f5891d1cc7
Merge pull request #33189 from kssenii/fix-clickhouse-local-exception
Fix possible uncaught exception in clickhouse-local
2021-12-26 08:42:45 +03:00