thevar1able/ClickHouse
1
0
Fork 0
mirror of https://github.com/ClickHouse/ClickHouse.git synced 2024-09-27 20:20:49 +00:00
Code Issues Packages Projects Releases Wiki Activity
59,464 Commits 8,958 Branches 1,767 Tags 2.1 GiB
03cb0299a9
Commit Graph

7140 Commits

Author SHA1 Message Date
alexey-milovidov
53e21443eb
Merge branch 'master' into DateTime64_extended_range 2021-03-14 12:27:17 +03:00
kssenii
8eea6a87e9 Support replicas priority for postgres dictionary source 2021-03-14 08:51:24 +00:00
Pavel Kruglov
e116e75d2c Fix style 2021-03-14 02:36:40 +03:00
Pavel Kruglov
3e3b5c64bf add init file 2021-03-14 02:34:32 +03:00
Maksim Kita
98192f1234
Update 01280_ssd_complex_key_dictionary.sql 2021-03-14 01:28:53 +03:00
Pavel Kruglov
d83b4d3ab6 Try fix flacky test 2021-03-13 23:44:06 +03:00
Maksim Kita
b1398e6ffa Updated test 2021-03-13 23:26:01 +03:00
Maksim Kita
084bd03672
Merge pull request #21692 from azat/dict-ip_trie-access_to_key_from_attributes 
Fix SIGSEGV on not existing attributes from ip_trie with access_to_key_from_attributes
 2021-03-13 23:13:26 +03:00
alesapin
06eb2d8dfd
Merge branch 'master' into s3_zero_copy_replication 2021-03-13 22:32:54 +03:00
Azat Khuzhin
334520557c Fix log_comment for *.sh in clickhouse-test 
setdefault will set it only once
 2021-03-13 18:15:16 +03:00
alexey-milovidov
38c068725d
Merge pull request #21691 from azat/clickhouse-test-fix 
Fix error message in clickhouse-test
 2021-03-13 15:20:31 +03:00
alexey-milovidov
36935a335f
Merge pull request #21102 from Enmk/governance/query_log 
Added Grant, Revoke and System query_kind for system.query_log
 2021-03-13 15:16:32 +03:00
Maksim Kita
ee8c51f65e Fixed tests 2021-03-13 14:58:31 +03:00
Maksim Kita
add444f71c Fixed broken test 2021-03-13 14:58:31 +03:00
Maksim Kita
854bfaf366 RangeHashed dictionary support has function 2021-03-13 14:57:56 +03:00
Azat Khuzhin
833dbf1225 Mark 01294_lazy_database_concurrent_recreate_reattach_and_show_tables as long 2021-03-13 13:43:17 +03:00
Maksim Kita
79b061ac3c
Merge pull request #21668 from kitaisreal/dictionary-attributes-unique-names 
DictionaryStructure fix non unique attribute names
 2021-03-13 12:31:33 +03:00
Azat Khuzhin
2d66a5c393 Fix hang check for 00966_live_view_watch_events_http 
If INSERT was failed then WATCH EVENTS will hang:

    2021.03.12 23:45:33.666223 [ 1901 ] {} <Trace> DynamicQueryHandler: Request URI: /?allow_experimental_live_view=1&query=WATCH%20test.lv%20EVENTS
    ...
    2021.03.12 23:45:34.119465 [ 35492 ] {55f2c8ec-df9f-4e97-9acc-385ed5b5fde2} <Error> executeQuery: Code: 241, e.displayText() = DB::Exception: Memory limit (for user) exceeded: would use 153.99 MiB (attempt to allocate chunk of 4194729 bytes), maximum: 150.00 MiB (version 21.4.1.6239) (from [::1]:43910) (in query: INSERT INTO test.mt VALUES ), Stack trace (when copying this message, always include the lines below):
    ...

Hung check:

    elapsed:              597.835824299
    is_cancelled:         0
    query:                WATCH test.lv EVENTS
    thread_ids:           [1901]

gdb:

    Thread 133 (Thread 0x7f26ac95b700 (LWP 1901)):
    0  0x00007f2793d447b1 in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib/x86_64-linux-gnu/libpthread.so.0
    1  0x0000000008cbd5c5 in __tsan::call_pthread_cancel_with_cleanup(int (*)(void*, void*, void*), void*, void*, void*, void (*)(void*), void*) ()
    2  0x0000000008c4f134 in cond_wait(__tsan::ThreadState*, unsigned long, __tsan::ScopedInterceptor*, int (*)(void*, void*, void*), void*, void*, void*) ()
    3  0x0000000008c4f339 in pthread_cond_timedwait ()
    4  0x000000001831c8b6 in std::__1::__libcpp_condvar_timedwait (__cv=0x7b5801053520, __m=0x189, __ts=0x7f26ac9132b8) at ../contrib/libcxx/include/__threading_support:442
    5  std::__1::condition_variable::__do_timed_wait (this=0x7b5801053520, lk=..., tp=...) at ../contrib/libcxx/src/condition_variable.cpp:74
    6  0x00000000134fe7f2 in std::__1::condition_variable::wait_for<long long, std::__1::ratio<1l, 1000000l> > (this=this@entry=0x7b5801053520, __lk=..., __d=...) at ../contrib/libcxx/include/__mutex_base:462
    7  0x00000000134fe2c9 in DB::LiveViewEventsBlockInputStream::tryReadImpl (this=this@entry=0x7b5c0070ff98, blocking=false) at ../src/Storages/LiveView/LiveViewEventsBlockInputStream.h:180
    8  0x00000000134fd6e4 in DB::LiveViewEventsBlockInputStream::readImpl (this=0x189) at ../src/Storages/LiveView/LiveViewEventsBlockInputStream.h:115
    9  0x0000000012285593 in DB::IBlockInputStream::read (this=0x7b5c0070ff98) at ../src/DataStreams/IBlockInputStream.cpp:58
    10 0x00000000122afc7e in DB::copyDataImpl<std::__1::function<bool ()> const&, std::__1::function<void (DB::Block const&)> const&>(DB::IBlockInputStream&, DB::IBlockOutputStream&, std::__1::function<bool ()> const&, std::__1::function<void (DB::Block const&)> const&) (from=..., to=..., is_cancelled=..., progress=...) at ../src/DataStreams/copyData.cpp:26
    11 0x00000000122af8e1 in DB::copyData(DB::IBlockInputStream&, DB::IBlockOutputStream&, std::__1::function<bool ()> const&, std::__1::function<void (DB::Block const&)> const&) (from=..., to=..., is_cancelled=..., progress=...) at ../src/DataStreams/copyData.cpp:73
    12 0x0000000012cfc5e2 in DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, DB::Context&, std::__1::function<void (std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&, std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&, std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&, std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&)>) (istr=..., ostr=..., allow_into_outfile=false, context=..., set_result_details=...) at ../src/Interpreters/executeQuery.cpp:1033
    13 0x000000001357941d in DB::HTTPHandler::processQuery (this=this@entry=0x7b1c006f41b0, context=..., request=..., params=..., response=..., used_output=..., query_scope=...) at ../src/Server/HTTPHandler.cpp:772
    14 0x000000001357c507 in DB::HTTPHandler::handleRequest (this=<optimized out>, request=..., response=...) at ../src/Server/HTTPHandler.cpp:910
    15 0x00000000135f3081 in DB::HTTPServerConnection::run (this=<optimized out>) at ../src/Server/HTTP/HTTPServerConnection.cpp:48
    16 0x00000000161f9e73 in Poco::Net::TCPServerConnection::start (this=0x7b8c01554000) at ../contrib/poco/Net/src/TCPServerConnection.cpp:43
    17 0x00000000161fa59f in Poco::Net::TCPServerDispatcher::run (this=<optimized out>) at ../contrib/poco/Net/src/TCPServerDispatcher.cpp:113
    18 0x0000000016361732 in Poco::PooledThread::run (this=<optimized out>) at ../contrib/poco/Foundation/src/ThreadPool.cpp:199
    19 0x000000001635fcd0 in Poco::(anonymous namespace)::RunnableHolder::run (this=<optimized out>) at ../contrib/poco/Foundation/src/Thread.cpp:55
    20 0x000000001635e4d8 in Poco::ThreadImpl::runnableEntry (pThread=0x7b5400082538) at ../contrib/poco/Foundation/src/Thread_POSIX.cpp:345
    21 0x0000000008c4e36d in __tsan_thread_start_func ()
    22 0x00007f2793d3d609 in start_thread () from /lib/x86_64-linux-gnu/libpthread.so.0
    23 0x00007f2793c64293 in clone () from /lib/x86_64-linux-gnu/libc.so.6

Cc: @vzakaznikov
 2021-03-13 11:32:55 +03:00
Azat Khuzhin
68dff2d954 Mark 01018_ip_dictionary as long 
https://clickhouse-test-reports.s3.yandex.net/21692/481d897cadb6b1a309478f24a46efe506b7108d6/functional_stateless_tests_flaky_check_(address).html#fail1
 2021-03-13 11:06:49 +03:00
Azat Khuzhin
a301aa64da Do not use system-wide SYSTEM STOP TTL MERGES, use per-table instead 
Fixes 01294_lazy_database_concurrent_recreate_reattach_and_show_tables
 2021-03-13 10:37:26 +03:00
Azat Khuzhin
1ce9293e97 Fix 01035_lc_empty_part_bug under stress tests 
Found in [1]:

    2021.03.12 23:32:58.897190 [ 436606 ] {97a08a8f-4630-44f8-ba18-a94c6fabbded} <Information> test_13.lc_empty_part_bug: Waiting mutation: mutation_3.txt
    ...
    2021.03.12 23:32:58.900444 [ 374 ] {} <Debug> test_13.lc_empty_part_bug: Current max source part size for mutation is 0 but part size 1. Will not mutate part all_1_1_0_2. Max size depends not only on available space, but also on settings 'number_of_free_entries_in_pool_to_execute_mutation' and 'background_pool_size'
    ...

Hang check:

    query:                alter table lc_empty_part_bug modify column s LowCardinality(String);
    elapsed:              2156.396613506

  [1]: https://clickhouse-test-reports.s3.yandex.net/21511/d7d9638ceb6bd702f34a88ee54f8f83197e90af5/stress_test_(address).html#fail1
 2021-03-13 10:31:19 +03:00
Azat Khuzhin
481d897cad Fix SIGSEGV on not existing attributes from ip_trie with access_to_key_from_attributes 
Found with fuzzer [1]:

  [1]: https://clickhouse-test-reports.s3.yandex.net/21674/2e99dad56213413a72969d47650050b42cbcc073/fuzzer_asan/report.html#fail1
 2021-03-13 09:08:45 +03:00
Azat Khuzhin
eb3710c164 Fix error message in clickhouse-test 
{} was not replaced:

    Cannot get server pid with {}, got {}: {} lsof -i tcp:9000 -s tcp:LISTEN -Fp | awk '/^p[0-9]+$/{print substr($0, 2)}' b'306\n1025011\n' invalid literal for int() with base 10: b'306\n1025011\n'
 2021-03-13 08:43:41 +03:00
Pavel Kruglov
58e415c7d4 Update clusters only if their configs were updated 2021-03-13 00:17:19 +03:00
alexey-milovidov
f6bedf55e9
Merge pull request #21642 from azat/fsync_part_directory-horizontal-merge-fix 
Fix fsync_part_directory for horizontal merge
 2021-03-12 21:22:55 +03:00
Azat Khuzhin
2e99dad562 Tiny "machine" cleanup of test_replace_partition 2021-03-12 21:10:16 +03:00
Azat Khuzhin
5af5c90b8b Fix test_replace_partition flakiness 
test_replace_partition/test.py::test_replace_after_replace_failover
statistics:

```sql
┌──────ymd─┬─success─┬─failure─┐
│ 20200613 │      40 │       2 │
│ 20200614 │      98 │       2 │
│ 20200615 │     126 │       9 │
│ 20200616 │     141 │      10 │
│ 20200617 │     119 │       7 │
│ 20200618 │      87 │      12 │
│ 20200619 │      81 │       9 │
...
│ 20210305 │      60 │      28 │
│ 20210306 │      69 │       7 │
│ 20210307 │      42 │       0 │
│ 20210308 │      53 │       8 │
│ 20210309 │     137 │      23 │
│ 20210310 │      84 │      14 │
│ 20210311 │      81 │      20 │
└──────────┴─────────┴─────────┘
```
 2021-03-12 21:10:16 +03:00
Vasily Nemkov
f4246e7be5
Merge branch 'master' into governance/query_log 2021-03-12 18:31:08 +03:00
Pavel Kruglov
7f2d03b128 Change test 2021-03-12 18:24:59 +03:00
Nikita Mikhaylov
e234990cf6
Merge pull request #19257 from nikitamikhaylov/geometry_functions 
Merging geometry functions
 2021-03-12 17:05:24 +03:00
Maksim Kita
97a58777b8 DictionaryStructure fix non unique attribute names 2021-03-12 16:36:42 +03:00
Alexander Kuzmenkov
122790efd1
Merge pull request #21629 from ucasFL/errorcode 
redefine some errorcode
 2021-03-12 16:25:13 +03:00
tavplubix
e3141124fd
Merge pull request #20946 from ClickHouse/stress_test_results 
Move some CI-related scripts to github
 2021-03-12 15:54:15 +03:00
Pavel Kruglov
b83564bdad Add test for path as a query parameter in system.zookeeper 2021-03-12 15:08:00 +03:00
Kruglov Pavel
2e7f756d7c
Merge pull request #21494 from ucasFL/format 
add --backslash option for clickhouse-format
 2021-03-12 14:31:58 +03:00
Nikita Mikhaylov
e4b4665ff5 better 2021-03-12 13:58:03 +03:00
feng lv
1eba096f2a fix conflict 2021-03-12 10:28:04 +00:00
Anton Ivashkin
ace628d565 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into s3_zero_copy_replication 2021-03-12 12:58:32 +03:00
Nikita Mikhaylov
339c12f510
suppress boost geometry UBSan 2021-03-12 12:39:40 +03:00
Vasily Nemkov
2cf39d3ac4 Excluded 01702_system_query_log from arcadia runs 2021-03-12 11:25:01 +02:00
tavplubix
2acbfd834a
Merge branch 'master' into stress_test_results 2021-03-12 12:11:33 +03:00
alexey-milovidov
87368befea
Merge pull request #21646 from azat/storage-join-type-conversion 
Add type conversion for StorageJoin (previously led to SIGSEGV)
 2021-03-12 11:21:56 +03:00
alexey-milovidov
9e0d53c0e6
Merge pull request #20058 from excitoon-favorites/remotehostfilterdisallowall 
Fixed open behavior of remote host filter in case when there is `remote_url_allow_hosts` section in configuration but no entries there
 2021-03-12 11:14:15 +03:00
alesapin
cca05da7fa
Merge pull request #16481 from amosbird/jbodbalance 
Auto-balance big parts in JBOD array
 2021-03-12 11:07:47 +03:00
alesapin
b98e27ba82
Merge branch 'master' into s3_zero_copy_replication 2021-03-12 11:07:20 +03:00
Denis Glazachev
290a6d273e
Add Kerberos support for authenticating existing users when accessing over HTTP 2021-03-11 23:41:10 +03:00
Azat Khuzhin
c2372420ee Add type conversion for StorageJoin (previously led to SIGSEGV) 
Found with fuzzer under UBsan [1]:

  [1]: https://clickhouse-test-reports.s3.yandex.net/21579/61d40c3600ba6a1c6d6c0cf4919a3cdaebb3a31f/fuzzer_ubsan/report.html#fail1
 2021-03-11 23:28:32 +03:00
Azat Khuzhin
69b2b2a159 Fix fsync_part_directory for horizontal merge 2021-03-11 21:41:27 +03:00
Alexander Kuzmenkov
ae8585a183
Merge pull request #21580 from azat/git--arcadia_skip_list-union-merge 
[RFC] Union merge for arcadia_skip_list.txt to avoid frequent conflicts
 2021-03-11 21:10:38 +03:00
Nikita Mikhaylov
8e68edebea better test 2021-03-11 18:22:24 +03:00
Nikita Mikhaylov
87eb2592de add input_format_skip_unknown_fields 2021-03-11 18:22:24 +03:00
Nikita Mikhaylov
b434a2f0bd disable parallel parsing for grpc tests 2021-03-11 18:22:24 +03:00
Nikita Mikhailov
369c9da161 better 2021-03-11 18:22:24 +03:00
Nikita Mikhailov
138dedf2df done 2021-03-11 18:22:24 +03:00
Alexander Kuzmenkov
a2bedd592e
Merge pull request #21436 from azat/optimize_aggregation_in_order-log-fix 
Fix logging for optimize_aggregation_in_order=1 (with small max_block_size)
 2021-03-11 17:46:48 +03:00
Alexander Kuzmenkov
3303371b64
Merge pull request #21526 from azat/optimize_skip_unused_shards-once 
Avoid processing optimize_skip_unused_shards twice
 2021-03-11 17:31:37 +03:00
Alexander Kuzmenkov
3e5447ccec
Merge pull request #21480 from Avogar/slowdown_count 
Add slowdown_count and show actual errors_count in system.clusters
 2021-03-11 17:18:05 +03:00
feng lv
083299e549 redefine some errorcode 2021-03-11 13:54:11 +00:00
Nikita Mikhaylov
5ac5ae3b27
Merge pull request #21157 from CurtizJ/fix-type-map 
Improve support of integer keys in data type Map
 2021-03-11 15:49:57 +03:00
Vasily Nemkov
03bff5c3b5 Fixed test flakkiness 2021-03-11 14:47:20 +02:00
vdimir
1194d50e48
Try to fix test_storage_s3: crash in WriteBufferFromS3 2021-03-11 15:21:13 +03:00
Nikita Mikhaylov
b219b7626e better 2021-03-11 15:19:15 +03:00
Vladimir
08f312b1c4
Merge pull request #21457 from GrigoryPervakov/master 
recreate S3 client if credentials changed
 2021-03-11 15:18:39 +03:00
Nikita Mikhaylov
934b5bc487 Update 01700_point_in_polygon_ubsan.sql 2021-03-11 15:09:03 +03:00
Nikita Mikhaylov
eecc12ff6a suppress warnings and skip tests in arcadia 2021-03-11 15:09:03 +03:00
Nikita Mikhaylov
35d0b3d3ec better 2021-03-11 15:08:20 +03:00
Nikita Mikhaylov
7ecc78e014 fix tests after revert 2021-03-11 15:08:20 +03:00
Nikita Mikhaylov
c81c742877 Revert "more mercator" 
This reverts commit d4258922d1543211cf8b62f7c827a927712dca42.
 2021-03-11 15:08:20 +03:00
Nikita Mikhaylov
a6779df0ae more tests 2021-03-11 15:08:20 +03:00
Nikita Mikhaylov
7e6d1d43fe more mercator 2021-03-11 15:08:20 +03:00
Nikita Mikhailov
a6c8d50cc2 review fix 2021-03-11 15:08:19 +03:00
Nikita Mikhailov
0e1b2d8fcf geographic -> spherical 2021-03-11 15:08:19 +03:00
Nikita Mikhailov
ac03ba31bf move to spherical point 2021-03-11 15:08:19 +03:00
Nikita Mikhailov
928641aae4 perimeter test 2021-03-11 15:08:19 +03:00
Nikita Mikhailov
a7427a9cdf better 2021-03-11 15:08:19 +03:00
Nikita Mikhailov
4430322edc add some test + style 2021-03-11 15:08:19 +03:00
Nikita Mikhailov
681b0b63f1 return back all functions 2021-03-11 15:08:18 +03:00
Nikita Mikhailov
557fa7c5c8 fix ubsan 2021-03-11 15:08:18 +03:00
Nikita Mikhailov
e78fc3109c better ubsan testing 2021-03-11 15:08:18 +03:00
Nikita Mikhailov
05cf1b5bc5 better 2021-03-11 15:08:18 +03:00
Nikita Mikhailov
6a51ad425e add tests + improvements 2021-03-11 15:08:18 +03:00
Nikita Mikhailov
10d22e9db1 fix empty polygon 2021-03-11 15:08:17 +03:00
Nikita Mikhailov
2475143ed3 fix style 2021-03-11 15:08:17 +03:00
Nikita Mikhailov
155d392d31 fix tests 2021-03-11 15:08:17 +03:00
Nikita Mikhailov
cfee417ce0 better 2021-03-11 15:08:17 +03:00
Nikita Mikhaylov
db9dbfa528 Update 01304_polygons_sym_difference.sql 2021-03-11 15:08:17 +03:00
Nikita Mikhailov
0425d566d3 better 2021-03-11 15:08:17 +03:00
Alexey Ilyukhov
373b429e61 Add more tests 2021-03-11 15:08:17 +03:00
DoomzD
f7019cf589 Add tests 2021-03-11 15:08:17 +03:00
Maksim Kita
583b25b68e
Merge pull request #21513 from kitaisreal/direct-dictionary-fix 
DirectDictionary updated
 2021-03-11 00:01:01 +03:00
Nikita Mikhaylov
39b59e86b0
Merge pull request #21456 from nikitamikhaylov/zookeeper-secure-race 
Fix race in SecureSocket
 2021-03-10 20:49:56 +03:00
tavplubix
26ebd54eaf
Merge pull request #20961 from havardk/reconnect 
MaterializeMySQL: Attempt to reconnect to MySQL if the connection is lost
 2021-03-10 20:07:11 +03:00
alexey-milovidov
87313d5da7
Merge pull request #21354 from MyroTk/tfs_rbac_row_policy 
Testflows RBAC tests - ALL, NONE, and ROW POLICY.
 2021-03-10 19:25:42 +03:00
Vitaly Baranov
7364fe4d4c
Merge pull request #21190 from vitlibar/quota-test-more-cases 
Add more tests for quota consumption by the SHOW statement
 2021-03-10 16:41:38 +03:00
Anton Ivashkin
cef0dda933 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into s3_zero_copy_replication 2021-03-10 14:10:29 +03:00
Pervakov Grigorii
eb87afc4d4 recreate S3 client if credentials changed 2021-03-10 13:36:57 +03:00
Vladimir
33dce1296b
Merge pull request #20392 from vdimir/cross-to-inner-join-rewrite 2021-03-10 09:53:55 +03:00
Azat Khuzhin
61d40c3600 Fix optimize_skip_unused_shards for zero shards case 
v2: move check to the beginning of the StorageDistributed::read()
 2021-03-10 09:05:14 +03:00
Azat Khuzhin
2099e5a661 Fix syntax in arcadia_skip_list 2021-03-10 08:50:32 +03:00
alexey-milovidov
2159fb8481
Merge branch 'master' into governance/query_log 2021-03-10 05:29:56 +03:00