thevar1able/ClickHouse
1
0
Fork 0
mirror of https://github.com/ClickHouse/ClickHouse.git synced 2024-11-18 05:32:52 +00:00
Code Issues Packages Projects Releases Wiki Activity
71,714 Commits 9,136 Branches 1,774 Tags 2 GiB
5a4d554c15
Commit Graph

17237 Commits

Author SHA1 Message Date
Nikita Mikhaylov
0615bf27d6
Merge pull request #27990 from nikitamikhaylov/fix-clang-tidy 
Build fuzzers in CI
 2021-08-25 18:33:41 +03:00
Artur Filatenkov
31c7e22bd6 correct style 2021-08-25 18:29:25 +03:00
lthaooo
eecd5b21c9 fix total_size_of_queried_columns bug 2021-08-25 23:02:13 +08:00
Nikolay Degterinsky
2c81a35b4e Add setting 2021-08-25 17:41:21 +03:00
Amos Bird
a6b2a6ee36
Get rid of useless projection columns during merge 2021-08-25 20:54:27 +08:00
Nikolay Degterinsky
99a26b3a9a Small fix 2021-08-25 15:35:53 +03:00
zhongyuankai
3e18e22cfb update api 2021-08-25 20:20:05 +08:00
Nikolay Degterinsky
f722132f23 Merge branch 'master' into ncb/import-export-lz4 2021-08-25 14:59:17 +03:00
Filatenkov Artur
884b51116d
Merge branch 'master' into master 2021-08-25 14:34:39 +03:00
Maksim Kita
df1fe27791
Merge pull request #28105 from azat/enable-optimize_distributed_group_by_sharding_key 
Enable optimize_distributed_group_by_sharding_key by default
 2021-08-25 14:07:33 +03:00
zhongyuankai
64efa917d8 review system.views 2021-08-25 18:11:40 +08:00
alesapin
dc576e952a
Update KeeperStorage.cpp 2021-08-25 12:31:02 +03:00
zhongyuankai
52570b1c80 Merge branch 'master' into add-system-of-table_views 2021-08-25 15:59:23 +08:00
Maksim Kita
dc852568c0
Merge pull request #27796 from ClickHouse/create-user-defined-lambda-function 
Merging #23978
 2021-08-25 10:08:20 +03:00
Azat Khuzhin
e8d87053c0 Fix data-race between setConnectionFD() and setTimer() from cancellation path 
TSan report [1]:

    ==================
    WARNING: ThreadSanitizer: data race (pid=7)
      Write of size 8 at 0x7b5000d83768 by thread T539:
        0 Poco::Timespan::operator=(Poco::Timespan const&) obj-x86_64-linux-gnu/../contrib/poco/Foundation/src/Timespan.cpp:61:8 (clickhouse+0x18e2da08)
        1 DB::RemoteQueryExecutorReadContext::setConnectionFD(int, Poco::Timespan, std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&) obj-x86_64-linux-gnu/../src/DataStreams/RemoteQueryExecutorReadContext.cpp:103:21 (clickhouse+0x142c4f41)
        2 DB::RemoteQueryExecutorRoutine::ReadCallback::operator()(int, Poco::Timespan, std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> >) obj-x86_64-linux-gnu/../src/DataStreams/RemoteQueryExecutorReadContext.cpp:26:30 (clickhouse+0x142c7dae)
        3 decltype(std::__1::forward<DB::RemoteQueryExecutorRoutine::ReadCallback&>(fp)(std::__1::forward<int>(fp0), std::__1::forward<Poco::Timespan>(fp0), std::__1::forward<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&>(fp0))) std::__1::__invoke<DB::RemoteQueryExecutorRoutine::ReadCallback&, int, Poco::Timespan, std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&>(DB::RemoteQueryExecutorRoutine::ReadCallback&, int&&, Poco::Timespan&&, std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&) obj-x86_64-linux-gnu/../contrib/libcxx/include/type_traits:3676:1 (clickhouse+0x142c7cf7)
        4 void std::__1::__invoke_void_return_wrapper<void>::__call<DB::RemoteQueryExecutorRoutine::ReadCallback&, int, Poco::Timespan, std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&>(DB::RemoteQueryExecutorRoutine::ReadCallback&, int&&, Poco::Timespan&&, std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&) obj-x86_64-linux-gnu/../contrib/libcxx/include/__functional_base:348:9 (clickhouse+0x142c7cf7)
        5 std::__1::__function::__default_alloc_func<DB::RemoteQueryExecutorRoutine::ReadCallback, void (int, Poco::Timespan, std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&)>::operator()(int&&, Poco::Timespan&&, std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&) obj-x86_64-linux-gnu/../contrib/libcxx/include/functional:1608:12 (clickhouse+0x142c7c21)
        6 void std::__1::__function::__policy_invoker<void (int, Poco::Timespan, std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&)>::__call_impl<std::__1::__function::__default_alloc_func<DB::RemoteQueryExecutorRoutine::ReadCallback, void (int, Poco::Timespan, std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&)> >(std::__1::__function::__policy_storage const*, int, Poco::Timespan&&, std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&) obj-x86_64-linux-gnu/../contrib/libcxx/include/functional:2089:16 (clickhouse+0x142c7c21)
        7 std::__1::__function::__policy_func<void (int, Poco::Timespan, std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&)>::operator()(int&&, Poco::Timespan&&, std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&) const obj-x86_64-linux-gnu/../contrib/libcxx/include/functional:2221:16 (clickhouse+0x1589a8c1)
        8 std::__1::function<void (int, Poco::Timespan, std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&)>::operator()(int, Poco::Timespan, std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&) const obj-x86_64-linux-gnu/../contrib/libcxx/include/functional:2560:12 (clickhouse+0x1589a8c1)
        9 DB::HedgedConnections::getReadyFileDescriptor(std::__1::function<void (int, Poco::Timespan, std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&)>) obj-x86_64-linux-gnu/../src/Client/HedgedConnections.cpp:379:13 (clickhouse+0x1589a8c1)
        10 DB::HedgedConnections::getReadyReplicaLocation(std::__1::function<void (int, Poco::Timespan, std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&)>) obj-x86_64-linux-gnu/../src/Client/HedgedConnections.cpp:317:20 (clickhouse+0x1589a8c1)
        11 DB::HedgedConnections::receivePacketUnlocked(std::__1::function<void (int, Poco::Timespan, std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&)>, bool) obj-x86_64-linux-gnu/../src/Client/HedgedConnections.cpp:298:32 (clickhouse+0x1589b531)
        12 DB::RemoteQueryExecutorRoutine::operator()(boost::context::fiber&&) const obj-x86_64-linux-gnu/../src/DataStreams/RemoteQueryExecutorReadContext.cpp:46:51 (clickhouse+0x142c7013)
        13 std::__1::enable_if<!(std::is_member_pointer<std::__1::decay<DB::RemoteQueryExecutorRoutine&>::type>::value), std::__1::result_of<DB::RemoteQueryExecutorRoutine& (boost::context::fiber&&)>::type>::type boost::context::detail::invoke<DB::RemoteQueryExecutorRoutine&, boost::context::fiber>(DB::RemoteQueryExecutorRoutine&, boost::context::fiber&&) obj-x86_64-linux-gnu/../contrib/boost/boost/context/detail/invoke.hpp:41:12 (clickhouse+0x142c6be1)
        14 boost::context::detail::fiber_capture_record<boost::context::fiber, FiberStack&, DB::RemoteQueryExecutorRoutine>::run() obj-x86_64-linux-gnu/../contrib/boost/boost/context/fiber_ucontext.hpp:291:17 (clickhouse+0x142c6be1)
        15 void boost::context::detail::fiber_entry_func<boost::context::detail::fiber_capture_record<boost::context::fiber, FiberStack&, DB::RemoteQueryExecutorRoutine> >(void*) obj-x86_64-linux-gnu/../contrib/boost/boost/context/fiber_ucontext.hpp:72:13 (clickhouse+0x142c5f79)
        16 <null> <null> (libc.so.6+0x5e65f)

      Previous read of size 8 at 0x7b5000d83768 by thread T321 (mutexes: write M861449115349678976, write M1059607378698108960, write M747733173224015304):
        0 Poco::Timespan::totalMicroseconds() const obj-x86_64-linux-gnu/../contrib/poco/Foundation/include/Poco/Timespan.h:213:9 (clickhouse+0x142c54b3)
        1 DB::RemoteQueryExecutorReadContext::setTimer() const obj-x86_64-linux-gnu/../src/DataStreams/RemoteQueryExecutorReadContext.cpp:160:25 (clickhouse+0x142c54b3)
        2 DB::RemoteQueryExecutor::tryCancel(char const*, std::__1::unique_ptr<DB::RemoteQueryExecutorReadContext, std::__1::default_delete<DB::RemoteQueryExecutorReadContext> >*) obj-x86_64-linux-gnu/../src/DataStreams/RemoteQueryExecutor.cpp:538:26 (clickhouse+0x142be3a5)
        3 DB::RemoteQueryExecutor::cancel(std::__1::unique_ptr<DB::RemoteQueryExecutorReadContext, std::__1::default_delete<DB::RemoteQueryExecutorReadContext> >*) obj-x86_64-linux-gnu/../src/DataStreams/RemoteQueryExecutor.cpp:462:5 (clickhouse+0x142bdd8a)
        4 DB::RemoteSource::onCancel() obj-x86_64-linux-gnu/../src/Processors/Sources/RemoteSource.cpp:112:21 (clickhouse+0x15bf52c6)
        5 DB::IProcessor::cancel() obj-x86_64-linux-gnu/../src/Processors/IProcessor.h:237:9 (clickhouse+0x159db37e)
        6 DB::PipelineExecutor::cancel() obj-x86_64-linux-gnu/../src/Processors/Executors/PipelineExecutor.cpp:376:20 (clickhouse+0x159db37e)
        7 DB::PullingAsyncPipelineExecutor::cancel() obj-x86_64-linux-gnu/../src/Processors/Executors/PullingAsyncPipelineExecutor.cpp:175:25 (clickhouse+0x159e9748)
        8 DB::TCPHandler::processOrdinaryQueryWithProcessors() obj-x86_64-linux-gnu/../src/Server/TCPHandler.cpp:700:26 (clickhouse+0x1594f554)
        9 DB::TCPHandler::runImpl() obj-x86_64-linux-gnu/../src/Server/TCPHandler.cpp:329:17 (clickhouse+0x15949a2e)
        10 DB::TCPHandler::run() obj-x86_64-linux-gnu/../src/Server/TCPHandler.cpp:1658:9 (clickhouse+0x15959007)
        11 Poco::Net::TCPServerConnection::start() obj-x86_64-linux-gnu/../contrib/poco/Net/src/TCPServerConnection.cpp:43:3 (clickhouse+0x18cb2e42)
        12 Poco::Net::TCPServerDispatcher::run() obj-x86_64-linux-gnu/../contrib/poco/Net/src/TCPServerDispatcher.cpp:115:20 (clickhouse+0x18cb35cf)
        13 Poco::PooledThread::run() obj-x86_64-linux-gnu/../contrib/poco/Foundation/src/ThreadPool.cpp:199:14 (clickhouse+0x18e29c21)
        14 Poco::(anonymous namespace)::RunnableHolder::run() obj-x86_64-linux-gnu/../contrib/poco/Foundation/src/Thread.cpp:55:11 (clickhouse+0x18e280af)
        15 Poco::ThreadImpl::runnableEntry(void*) obj-x86_64-linux-gnu/../contrib/poco/Foundation/src/Thread_POSIX.cpp:345:27 (clickhouse+0x18e26827)

  [1]: https://clickhouse-test-reports.s3.yandex.net/27881/b328d9687238617e89c0806c9fa2dd7dd44b5fd7/integration_tests_(thread).htmlfail1
 2021-08-25 09:42:30 +03:00
Azat Khuzhin
2df0411b3f Add TimerDescriptor::setRelative(uint64_t usec) 2021-08-25 09:42:30 +03:00
Azat Khuzhin
225f44248c Fix remote query cancelation (in case of remote server abnormaly terminated) 
In case the remote server abnormally terminated, neither FIN nor RST
packet will be sent, and the initiator will not know that the connection
died (unless tcp_keep_alive_timeout > 0).

Fix this, using default timeouts.
 2021-08-25 09:42:30 +03:00
lthaooo
314ba1e682
Merge branch 'master' into materialize_ttl_recalculate_only 2021-08-25 10:56:24 +08:00
Alexey Milovidov
53ca1ebca6 Be in style 2021-08-25 03:58:49 +03:00
Alexey Milovidov
c03dc92dd1 Fix excessive logging in ReadBufferFromS3 2021-08-25 03:28:15 +03:00
Alexey Milovidov
da4865a5d8 Remove excessive logging from DiskS3 2021-08-25 03:22:26 +03:00
Alexey Milovidov
5243315227 Improve performance in case without prefetch by avoiding swapping of memory buffers 2021-08-25 03:13:05 +03:00
Alexey Milovidov
384b4304c0 Minor change 2021-08-25 02:56:14 +03:00
Alexey Milovidov
848c2ec23e Tuneable prefetch 2021-08-25 02:38:08 +03:00
Alexey Milovidov
183891eb0a Add IDisk::isRemote method 2021-08-25 02:27:20 +03:00
Alexey Milovidov
fd27a2faef Remove imperfect code 2021-08-25 02:05:55 +03:00
Alexey Milovidov
7c1d0a3baf Progress on development 2021-08-25 01:24:47 +03:00
Alexey Milovidov
f7ca674b0c Progress on development 2021-08-25 01:07:06 +03:00
Alexey Milovidov
8f57216180 Progress on development 2021-08-25 00:45:58 +03:00
Alexey Milovidov
4d9ad3725d Merge branch 'master' into async-reads 2021-08-25 00:45:40 +03:00
Azat Khuzhin
37043b74bf Enable optimize_distributed_group_by_sharding_key by default 
Since it requires optimize_skip_unused_shards this should be safe.
 2021-08-24 23:49:50 +03:00
Alexey Milovidov
a3ecc2b705 Remove unused include 2021-08-24 23:47:13 +03:00
Maksim Kita
5545959581 Updated StorageExecutable 2021-08-24 22:38:42 +03:00
Maksim Kita
016c7c74f8
Merge branch 'executable-table-function' into add-executable-table-function 2021-08-24 21:45:43 +03:00
kssenii
3cd56266c7 Merge branch 'pg-conflict' of github.com:kssenii/ClickHouse into pg-conflict 2021-08-24 18:29:05 +00:00
kssenii
8613d89001 Fix build 2021-08-24 18:28:38 +00:00
Anton Popov
47bb5eb330 support implicit conversions between index in operator [] and key of Map 2021-08-24 21:16:06 +03:00
Dmitry Novik
2da3893b1f refactor isCompatibleEnumTypes to remove PVS warning 2021-08-24 21:11:47 +03:00
Maksim Kita
dce3fc60ad Fixed build 2021-08-24 19:13:38 +03:00
Maksim Kita
82ba24cd10 Merge branch 'master' into create-user-defined-lambda-function 2021-08-24 19:12:32 +03:00
tavplubix
0602d74a11
Merge pull request #28035 from ClickHouse/fix_replace_ranges_may_stuck 
Fix race between REPLACE PARTITION and MOVE PARTITION
 2021-08-24 17:49:57 +03:00
Vitaly Baranov
64f69462c6
Merge pull request #27921 from vitlibar/add-tests-for-field-init 
Allow implicit cast bool to Field
 2021-08-24 17:15:44 +03:00
alesapin
916e6cc9f2 Fix style 2021-08-24 17:06:10 +03:00
Nikolay Degterinsky
7630180fe7
Merge pull request #28078 from excitoon/patch-12 
Fixed a typo in comments to `SinkToStorage`
 2021-08-24 16:25:24 +03:00
Nikolay Degterinsky
8295d8f2d7
Update src/Processors/Sinks/SinkToStorage.h 2021-08-24 16:25:01 +03:00
Nikolai Kochetov
0f3133e22e Use old error code. 2021-08-24 16:14:45 +03:00
Kseniia Sumarokova
5bbf5dacc5
Update src/Storages/StoragePostgreSQL.cpp 
Co-authored-by: Nikolay Degterinsky <43110995+evillique@users.noreply.github.com>
 2021-08-24 16:13:57 +03:00
Kseniia Sumarokova
ee7f710e35
Update TableFunctionPostgreSQL.cpp 2021-08-24 16:13:41 +03:00
kssenii
0ec716292c Postgres ON CONFLICT 2021-08-24 12:37:32 +00:00
alesapin
95cf0634dc Clickhouse-keeper: renames and comments 2021-08-24 15:30:31 +03:00
alexey-milovidov
739caf86d5
Merge pull request #27484 from excitoon/patch-10 
Don't silently ignore errors and don't count delays in `ReadBufferFromS3`
 2021-08-24 15:26:39 +03:00
OnePiece
17ba4c620e
Merge branch 'ClickHouse:master' into add-system-of-table_views 2021-08-24 20:20:24 +08:00
OnePiece
e9edabc3cb
Update attachSystemTables.cpp 2021-08-24 20:09:36 +08:00
OnePiece
d2919e98c7
Update attachSystemTables.cpp 2021-08-24 20:09:04 +08:00
OnePiece
29aa41577f
Create StorageSystemTableViews.h 2021-08-24 20:07:48 +08:00
OnePiece
ba594f41b9
Create StorageSystemTableViews.cpp 2021-08-24 20:07:08 +08:00
OnePiece
40673aa1f5
Update DatabaseCatalog.cpp 2021-08-24 20:05:29 +08:00
OnePiece
01f4e2e0e0
Update DatabaseCatalog.h 2021-08-24 20:03:49 +08:00
Dmitry Novik
1984940eb6 Update all StorageInMemoryMetadata::check overloads 2021-08-24 14:59:35 +03:00
Vladimir Chebotarev
82ef8a2b7b
Fixed a typo in comments to SinkToStorage. 2021-08-24 14:59:29 +03:00
Kseniia Sumarokova
d78e551de9
Update src/Disks/DiskWebServer.cpp 
Co-authored-by: Kruglov Pavel <48961922+Avogar@users.noreply.github.com>
 2021-08-24 12:24:54 +03:00
mergify[bot]
ae22bab2c4
Merge branch 'master' into materialize_ttl_recalculate_only 2021-08-24 08:49:19 +00:00
Nikolay Degterinsky
d60f128a9a Merge branch 'master' into ncb/import-export-lz4 2021-08-24 11:47:10 +03:00
Vladimir C
5f4ca42d15
Merge pull request #23051 from excitoon-favorites/s3partitionedwrite 2021-08-24 10:58:43 +03:00
kssenii
0d5000f917 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into mysql 2021-08-24 07:30:42 +00:00
kssenii
14b87feb27 Fix build 2021-08-24 07:30:33 +00:00
kssenii
b536653851 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into disk-over-web-server 2021-08-24 07:29:50 +00:00
Vladimir C
0858fdf113
Merge pull request #27036 from nickitat/nickitat_select_filter 2021-08-24 10:18:55 +03:00
Nikolai Kochetov
3db619cffc
Merge pull request #28027 from ClickHouse/fix-throw-without-exception-in-mysql 
Fix throw without exception in MySQL source.
 2021-08-24 10:13:12 +03:00
Vladimir C
98acccbdcc
Merge branch 'master' into s3partitionedwrite 2021-08-24 10:03:57 +03:00
Vitaly Baranov
1efed59d84
Update Field.h 2021-08-24 08:53:21 +03:00
kssenii
5307d31924 Throw for alter and silence for drop 2021-08-23 23:48:53 +00:00
Nikolai Kochetov
2a0e45a595 Fix throw without exception in MySQL source. 2021-08-23 22:20:30 +00:00
kssenii
962f415740 Add test and settings 2021-08-23 22:18:04 +00:00
Dmitry Novik
e78f9b3d4b code cleanup 2021-08-24 00:42:03 +03:00
Vitaly Baranov
63e8bc1f20 Added new commands BACKUP and RESTORE. 2021-08-23 23:41:45 +03:00
Vitaly Baranov
139199ac66 Add trimLeft() and trimRight() overloads for strings. 2021-08-23 23:41:45 +03:00
Vitaly Baranov
4c9d9aadd4 Add owning ConcatReadBuffer. 2021-08-23 23:41:45 +03:00
Vitaly Baranov
2ac97c7fc3 Make IDatabase::getTablesIterator() const. 2021-08-23 23:41:45 +03:00
Anton Popov
0db8b524f0
Merge pull request #27984 from BraulioVM/optimize/has-all-bloom-filter 
Make `hasAll` filter condition leverage bloom filters
 2021-08-23 22:19:50 +03:00
Alexander Tokmakov
d95131dd4a better check for alter partition version 2021-08-23 20:51:20 +03:00
Nikolay Degterinsky
8cce9285d3 Fix gcc build 2021-08-23 20:09:59 +03:00
Dmitry Novik
6dad70a1fb Add check whether enums have the same underlying type or not 2021-08-23 17:55:21 +03:00
Maksim Kita
010d72593f Fixed integration tests 2021-08-23 17:31:58 +03:00
Alexander Tokmakov
4a4a0b4823 fix 2021-08-23 16:32:07 +03:00
Nikita Mikhaylov
fb6462d70a
Merge pull request #27886 from vitlibar/add-separate-constants-for-interfaces 
Add separate constants for interfaces LOCAL and TCP_INTERSERVER.
 2021-08-23 16:25:01 +03:00
Dmitry Novik
ac2e9a27e6 Fixes #26672. Lower restrictions in StorageInMemoryMetadata::check. 2021-08-23 16:08:23 +03:00
Alexander Tokmakov
cc9c2fd63b make code better 2021-08-23 15:57:50 +03:00
Nikolai Kochetov
5842d3573d Fix throw without exception in MySQL source. 2021-08-23 15:49:41 +03:00
Ilya Yatsishin
315a835c95
Merge pull request #28020 from qoega/fix-style 2021-08-23 15:48:41 +03:00
Yatsishin Ilya
17bb938541 fix style 2021-08-23 13:59:01 +03:00
mergify[bot]
95e9d517ff
Merge branch 'master' into fix-clang-tidy 2021-08-23 10:54:36 +00:00
alexey-milovidov
a461f30d1a
Merge pull request #27758 from RedClusive/feature-quantileBfloat16 
Fix unknown quantile bfloat16 weighted
 2021-08-23 13:16:52 +03:00
Vladimir C
bce6d092ea
Merge pull request #27858 from ianton-ru/MDB-14264 
Use Multipart copy upload for large S3 objects
 2021-08-23 11:32:19 +03:00
Maksim Kita
2a6aa50d49 Merge branch 'master' into create-user-defined-lambda-function 2021-08-23 11:08:49 +03:00
alesapin
31b12b5240
Merge pull request #27787 from kafka1991/master 
modify column datatype to Nullable(datatype) or Nullable(datatype) to Nullable(datatype) donot allways need mutations.
 2021-08-23 10:35:39 +03:00
Vitaly Baranov
89166a655a Init SettingFieldBool with true or false, not with 1 or 0. 2021-08-23 09:47:36 +03:00
Kseniia Sumarokova
e4a46eaac8
Merge pull request #27991 from kssenii/fix-progress 
Fix file progress for local
 2021-08-23 09:36:29 +03:00
vdimir
6fe63a80bc Fix validateKey/Bucket for S3 2021-08-23 09:22:15 +03:00
vdimir
295c8d5686 Remove unused Error Code from IO/S3Common.cpp 2021-08-23 09:22:15 +03:00
vdimir
2907c86c2a Generate ya.make for isValidUTF8.cpp 2021-08-23 09:22:15 +03:00
vdimir
6ba6577978 Do not allow slashes in bucket formatted from PARTITION BY 2021-08-23 09:22:15 +03:00
vdimir
c4c42b61c4 Validate uft8 in partition key from PARTITION BY for s3 2021-08-23 09:22:15 +03:00
vdimir
2c725a19fa Move isValidUTF8Naive from Functions to Common 2021-08-23 09:22:15 +03:00
Vladimir Chebotarev
925c496b6c Rolled back changes in Functions. 2021-08-23 09:22:15 +03:00
Vladimir Chebotarev
6e600df160 Rolled back changes in Functions. 2021-08-23 09:22:15 +03:00
Vladimir Chebotarev
3c08a4a23b Rolled back changes in Functions. 2021-08-23 09:22:15 +03:00
Vladimir Chebotarev
f6cb82aba5 Minor fix. 2021-08-23 09:22:15 +03:00
Vladimir Chebotarev
e203c330c2 Validation. 2021-08-23 09:22:14 +03:00
Vladimir Chebotarev
3c2e090b6b Build and style fix. 2021-08-23 09:22:14 +03:00
Vladimir Chebotarev
a2bbf98253 Update. 2021-08-23 09:22:14 +03:00
Vladimir Chebotarev
0479edd47e Improved validation of S3 buckets and keys. 2021-08-23 09:22:14 +03:00
Vladimir Chebotarev
6e10d28c78 Fix. 2021-08-23 09:22:14 +03:00
Vladimir Chebotarev
ea67849fd9 Typo. 2021-08-23 09:22:14 +03:00
Vladimir Chebotarev
119172543b Better fix. 2021-08-23 09:22:14 +03:00
Vladimir Chebotarev
0b75c66378 Revert "Update src/Storages/StorageS3.cpp " 
This reverts commit bbbfe1891bfdc868878cfc8d52c254babd4ca181.
 2021-08-23 09:22:14 +03:00
Vladimir C
067cc763cc Update src/Storages/StorageS3.cpp 
StringRef in fmt::format throws `fmt::v7::format_error: cannot switch from manual to automatic argument indexing`
 2021-08-23 09:22:14 +03:00
Vladimir Chebotarev
d8bc601dbf Minor. 2021-08-23 09:22:14 +03:00
Vladimir Chebotarev
4b1cc38056 Fixes. 2021-08-23 09:22:14 +03:00
Vladimir Chebotarev
cebe1e7123 Style fix. 2021-08-23 09:22:14 +03:00
Vladimir Chebotarev
b34f60ad46 Fixed find. 2021-08-23 09:22:14 +03:00
Vladimir Chebotarev
be343766a6 Update src/Storages/StorageS3.cpp 
Co-authored-by: Vladimir C <vdimir@yandex-team.ru>
 2021-08-23 09:22:14 +03:00
Vladimir Chebotarev
24fcf152ed Minor fix. 2021-08-23 09:22:13 +03:00
Vladimir Chebotarev
5ce9e266b4 Less strict validation. 2021-08-23 09:22:13 +03:00
vdimir
4c9fb7ff58 Fix error code in StorageS3.cpp 2021-08-23 09:22:13 +03:00
vdimir
eb31b194b9 Add validation to insert partition by key to s3 2021-08-23 09:22:13 +03:00
Vladimir Chebotarev
c008eab31a Review fixes. 2021-08-23 09:22:13 +03:00
Vladimir Chebotarev
d1efe3afa7 Review fixes. 2021-08-23 09:22:13 +03:00
Vladimir Chebotarev
e99433e094 Better functionality. 2021-08-23 09:22:13 +03:00
Vladimir Chebotarev
328213f5d9 Fixes. 2021-08-23 09:22:13 +03:00
Vladimir Chebotarev
1146efacff Partitioned writes for S3. 2021-08-23 09:22:13 +03:00
Vladimir Chebotarev
a6e246b9ba Parsing. 2021-08-23 09:22:12 +03:00
Vladimir Chebotarev
441958f590 Proper parser. 2021-08-23 09:22:12 +03:00
Vitaly Baranov
ff1fad8521 Use setSetting() with implicit conversion true/false -> Field. 2021-08-23 08:57:00 +03:00
Vitaly Baranov
05247c7eef Add test. 2021-08-23 08:34:03 +03:00
Vitaly Baranov
38571079ed Fix implicit cast bool to Field. 2021-08-23 08:33:16 +03:00
Vladimir Chebotarev
21d4d26f20 Final fix ReadBufferFromS3. 2021-08-23 05:05:49 +00:00
Vitaly Baranov
ba80e1c8cd
Merge pull request #27983 from vitlibar/fix-checking-grant-option-for-grant-with-replace-option-2 
Fix checking access rights when executing GRANT WITH REPLACE OPTION on cluster
 2021-08-22 21:59:06 +03:00
kssenii
c5ee335c68 Fix tests 2021-08-22 21:41:09 +03:00
kssenii
14afb3c509 File progress for local fix 2021-08-22 20:33:55 +03:00
mergify[bot]
1f38be4c99
Merge branch 'master' into fix-clang-tidy 2021-08-22 17:28:18 +00:00
alexey-milovidov
c8e0be6343
Merge pull request #27982 from vitlibar/function-get-setting-get-rid-of-mutable 
Get rid of mutable value in FunctionGetSetting.
 2021-08-22 20:10:38 +03:00
Nikita Mikhaylov
80ebc6ccea Done 2021-08-22 15:09:49 +00:00
RedClusive
1b7fe54f45 Merge branch 'master' of github.com:ClickHouse/ClickHouse into feature-quantileBfloat16 2021-08-22 12:41:11 +00:00
Vitaly Baranov
8e9173c21d Fix checking access rights when executing GRANT WITH REPLACE OPTION on cluster. 2021-08-22 12:14:23 +03:00
Braulio Valdivielso
d48f6122e3 clean up implementation a bit 2021-08-22 10:06:30 +01:00
Vitaly Baranov
d18cf0eb51 Get rid of mutable value in FunctionGetSetting. 2021-08-22 10:29:56 +03:00
alexey-milovidov
e620ea15bd
Merge pull request #27900 from amosbird/newf 
getServerPort function
 2021-08-21 22:40:25 +03:00
alexey-milovidov
4922fb791e
Merge pull request #27882 from azat/enable-tcp_keep_alive_timeout 
RFC: Enable tcp_keep_alive_timeout by default
 2021-08-21 22:39:12 +03:00
alexey-milovidov
40a4a6663e
Merge pull request #27830 from zhanglistar/master 
Add sha512 hash functions
 2021-08-21 22:38:06 +03:00
alexey-milovidov
fef442ba34
Merge pull request #27939 from amosbird/jsonextractstring 
Fix JSONExtract String with null value.
 2021-08-21 22:37:28 +03:00
Alexey Boykov
e49d0c4533
Merge pull request #27563 from achimbab/bugfix_wf_strict 
Bugfix for windowFunnel's "strict" mode.
 2021-08-21 22:37:21 +03:00
Braulio Valdivielso
e95563fb82 leverage bloom filter index for 'hasAll' 
Fixes #26151. For now, this is a draft implementation. There is some
cleanup that can be done, but the new test is passing
 2021-08-21 20:14:56 +01:00
RedClusive
fd7002fcd5 fix weighted 2021-08-21 18:09:42 +00:00
Nikita Mikhaylov
cfa571cac4
Merge pull request #27895 from nikitamikhaylov/temporary_remove_yaml_fuzzer 
Build fuzzers with clang-tidy
 2021-08-21 16:51:31 +03:00
Nikita Mikhaylov
64821c41d9 Style 2021-08-21 13:00:15 +00:00
Amos Bird
997acdc39e
getPort function 2021-08-21 20:33:36 +08:00
Amos Bird
4d3db821bb
Fix JSONExtract String with null value. 2021-08-21 17:03:16 +08:00
alexey-milovidov
5ac6a99542
Merge pull request #27927 from ClickHouse/fix_27832 
Сheck cluster name before creating Distributed
 2021-08-21 10:40:23 +03:00
alexey-milovidov
adc63ce279
Merge pull request #27918 from vitlibar/fix-low-cardinality-uuid-with-extremes 
Fix selecting with extremes from LowCardinality(UUID)
 2021-08-21 10:34:33 +03:00
Kseniia Sumarokova
19afb22b4d
Merge pull request #27932 from amosbird/constkeys 
Add a setting to bring back the old behavior of grouping by constant keys on empty set.
 2021-08-21 08:02:30 +03:00
Nikita Mikhaylov
9d5cab4d9f Better 2021-08-21 02:30:28 +00:00
Nikita Mikhaylov
3cd689c168 Moved fuzzers to another directory 2021-08-21 02:27:27 +00:00
Nikita Mikhaylov
f72457fa98 Lower the size of the binaries 2021-08-21 02:20:23 +00:00
bharatnc
5de6d19da8 Merge remote-tracking branch 'upstream/master' into ncb/import-export-lz4 2021-08-20 17:19:36 -07:00
Nikita Mikhaylov
0abcc5b18a Fix build 2021-08-20 21:27:34 +00:00
Kseniia Sumarokova
f3f44ec8fb
Merge pull request #27901 from amosbird/applylambda 
APPLY with lambda.
 2021-08-21 00:26:03 +03:00
Kseniia Sumarokova
38a35c1d9e
Merge pull request #27530 from kssenii/col-identifier-as-col-number 
Allow positional arguments for group by, order by, limit by
 2021-08-20 21:08:58 +03:00
kssenii
945e2c4ce5 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into disk-over-web-server 2021-08-20 18:01:23 +00:00
achimbab
e4aaa5c52d
Update src/AggregateFunctions/AggregateFunctionWindowFunnel.h 
Co-authored-by: Alexey Boykov <33257111+mathalex@users.noreply.github.com>
 2021-08-21 02:38:27 +09:00
Nikolay Degterinsky
f2852d1a08 Fix algorithm 2021-08-20 19:40:18 +03:00
Ilya Yatsishin
e146afec79
Merge pull request #27905 from kitaisreal/dictionary-empty-attribute-list 
Dictionary empty attribute list
 2021-08-20 19:28:06 +03:00
Anton Ivashkin
0e0e07ef46 Allow Multi Part Upload for small objects 2021-08-20 19:13:48 +03:00
Anton Ivashkin
51b543fb5c Call AbortMultipartUpload when Multipart Upload Copy failed 2021-08-20 18:57:03 +03:00
Ilya Yatsishin
624cb43f7f
Merge pull request #27885 from azat/kafka-write-assert 
Fix incorrect assertion during writing to StorageKafka
 2021-08-20 18:53:22 +03:00
achimbab
a516b8e843
Merge branch 'master' into bugfix_wf_strict 2021-08-21 00:00:13 +09:00
achimbab
f371151e18 Fix docs and comments for windowFunnel and remove strict option 2021-08-20 23:56:28 +09:00
Amos Bird
5708ed42ec
Add setting. 
empty_result_for_aggregation_by_constant_keys_on_empty_set
 2021-08-20 22:34:32 +08:00
Alexander Tokmakov
42378b5913 fix 2021-08-20 17:05:53 +03:00
Alexander Tokmakov
59eb3aa9a9 avoid too long waiting for inactive replicas 2021-08-20 15:59:57 +03:00
Amos Bird
452602dadb
APPLY with lambda. 2021-08-20 20:38:09 +08:00
Alexander Tokmakov
8c6dd18917 check cluster name before creating Distributed 2021-08-20 14:55:04 +03:00
mergify[bot]
66c6a85211
Merge branch 'master' into master 2021-08-20 11:50:30 +00:00
alesapin
3bf412c656
Merge pull request #26843 from nvartolomei/nv/last-queue-update-exception 
Store exception generated when we tried to update the queue last time
 2021-08-20 14:46:45 +03:00
vdimir
e77ff2740a
Add common/unit.h 2021-08-20 13:57:05 +03:00
Nikita Mikhaylov
ea3f7bee97
Merge pull request #27743 from nikitamikhaylov/lz4-checks 
Better code around decompression [2]
 2021-08-20 13:25:07 +03:00
Vitaly Baranov
cbc1b2e72d Fix selecting with extremes from LowCardinality(UUID) 2021-08-20 13:10:41 +03:00
Alexey Milovidov
c3c31e2895 Move function to appropriate place to make code more readable 2021-08-20 12:56:39 +03:00
kssenii
c6f456b241 Fix build 2021-08-20 09:09:46 +00:00
Maksim Kita
9831995fd8 Dictionary empty attribute list 2021-08-20 12:09:05 +03:00
Maksim Kita
5f2b28639f Merge branch 'master' into create-user-defined-lambda-function 2021-08-20 11:53:08 +03:00
Kruglov Pavel
5a282e8947
Merge pull request #27875 from vitlibar/fix-shutdown-named-session-storage 
Fix shutdown of NamedSessionStorage.
 2021-08-20 11:50:43 +03:00
Kseniia Sumarokova
74ebc5c75c
Merge pull request #27876 from CurtizJ/cast-with-minus 
Fix postgres-like cast with negative numbers
 2021-08-20 10:55:42 +03:00
Kseniia Sumarokova
273b8b9bc1
Merge pull request #27704 from jasine/master 
feat: add conversions  between snowflake id and  dateTime(dateTime64)
 2021-08-20 10:48:40 +03:00
alexey-milovidov
6be085ed17
Update Settings.h 2021-08-20 09:05:48 +03:00
Azat Khuzhin
9aecb27913 Decrease tcp_keep_alive_timeout default (to avoid overlaps with receive_timeout) 2021-08-20 07:16:17 +03:00
Azat Khuzhin
b60e5ac801 Fix incorrect assertion during writing to StorageRabbitMQ 2021-08-20 07:14:20 +03:00
Nikita Mikhaylov
06a0580db1 done 2021-08-19 23:02:01 +00:00
Kseniia Sumarokova
78b0b21ccc
Merge pull request #27869 from kssenii/fix-bad-cast 
Fix bad cast in insertPostgreSQLValue
 2021-08-20 00:41:43 +03:00
Alexander Kuzmenkov
2f0d5c6f21
Merge pull request #27880 from ClickHouse/aku/window-case-insensitive 
make the sql-standard window functions case insensitive
 2021-08-20 00:20:30 +03:00
Vitaly Baranov
3ab1177d7e Add separate constants for interface LOCAL and TCP_INTERSERVER. 2021-08-19 23:04:36 +03:00
Vitaly Baranov
c257cd61e5
Merge pull request #27817 from vitlibar/use-sessions-more 
Use sessions more
 2021-08-19 22:51:08 +03:00
Vitaly Baranov
c263523f50 Remove unused declaration. 2021-08-19 22:45:40 +03:00
Azat Khuzhin
5947e54c1b Fix incorrect assertion during writing to StorageKafka 
The problem it does not triggered in CI always because buffers was not
destroyed by that time.

Fixes: #26547
 2021-08-19 22:07:20 +03:00
Kseniia Sumarokova
87f607faf9
Merge pull request #27815 from kssenii/fix-symlinks0in-bridge 
Allow symlinks to library dictionary path
 2021-08-19 21:34:13 +03:00
Alexander Kuzmenkov
9013892a96 make the sql-standard window functions case insensitive 2021-08-19 20:56:16 +03:00
Kruglov Pavel
7fe7103e53
Merge pull request #27299 from vdimir/issue-27091-v2 
Refactor NotJoined
 2021-08-19 19:16:32 +03:00
kssenii
ec9323f4bd Fix review comment 2021-08-19 15:55:45 +00:00
kssenii
512d66a088 Fix 2021-08-19 15:19:11 +00:00
Anton Popov
a9d83c1eec fix postgres like cast with negative numbers 2021-08-19 18:16:57 +03:00
Vitaly Baranov
9fecda940d Fix shutdown of NamedSessionStorage. 2021-08-19 17:27:03 +03:00
Nikita Mikhaylov
2272c9896c
Update LZ4_decompress_faster.cpp 2021-08-19 16:53:39 +03:00
Nikolai Kochetov
094ad9468b Fix style. 2021-08-19 16:09:56 +03:00
kssenii
1697a6fa22 Fix 2021-08-19 15:10:55 +03:00
tavplubix
9ef45d92c2
Merge pull request #27755 from ClickHouse/ncb/server_uuid 
Merging  #20089
 2021-08-19 14:59:18 +03:00
Nikita Mikhaylov
1e195cbacf
Update LZ4_decompress_faster.cpp 2021-08-19 14:48:10 +03:00
Nikolay Degterinsky
7825f792ef Improve CMake 2021-08-19 13:48:46 +03:00
alesapin
09df5018f9
Merge pull request #27125 from nicelulu/fix_create_znode 
The behavior of clickhouse-keeper to create znode is consistent with zookeeper
 2021-08-19 13:38:52 +03:00
Nikolay Degterinsky
ecb985c4b5 Refactor WriteBuffer 2021-08-19 13:34:23 +03:00
Nikolay Degterinsky
24046d6ecc Refactor ReadBuffer 2021-08-19 13:29:58 +03:00
tavplubix
f94b0b8d3f
Update DDLWorker.cpp 2021-08-19 13:19:48 +03:00
Anton Ivashkin
b3737afe04 Use Multipart copy upload for large S3 objects 2021-08-19 13:09:58 +03:00
Kseniia Sumarokova
3d05014da1
Update FunctionSnowflake.h 2021-08-19 12:54:03 +03:00
nvartolomei
c09c90125f
Merge branch 'master' into nv/last-queue-update-exception 2021-08-19 10:29:16 +01:00
Kseniia Sumarokova
c68793cd12
Update filesystemHelpers.cpp 2021-08-19 12:14:41 +03:00
Nikolai Kochetov
7dcff5c90e
Merge pull request #27742 from amosbird/projection-improvement3 
Improve projection analysis.
 2021-08-19 12:11:20 +03:00
Nikolai Kochetov
c3ee3fde0d Fix some tests. 2021-08-19 11:41:58 +03:00
Kseniia Sumarokova
b03f851cba
Update filesystemHelpers.cpp 2021-08-19 11:39:50 +03:00
alexey-milovidov
528f73eebf
Merge pull request #27753 from azat/osx-jemalloc-fix 
Fix jemalloc under osx (zone_register() had been optimized out again)
 2021-08-19 11:31:05 +03:00
alexey-milovidov
86af58f54f
Merge pull request #27774 from amosbird/distributed-fix 
Fix some leftover TODO when asynchronous connection draining is enabled
 2021-08-19 11:26:31 +03:00
Kseniia Sumarokova
34f5787f0a
Merge pull request #27824 from den-crane/patch-25 
Fix setting name "allow_experimental_database_materialized_postgresql" in the error message
 2021-08-19 11:25:54 +03:00
alexey-milovidov
215385e4d0
Merge pull request #27794 from filimonov/kafka_null_messages 
Avoid nullptr dereference during processing of NULL messages in Kafka for some formats
 2021-08-19 11:25:07 +03:00
Alexey Milovidov
ba45bd834f Close #27816 2021-08-19 11:22:57 +03:00
Kseniia Sumarokova
df0303f9ba
Update filesystemHelpers.cpp 2021-08-19 11:19:23 +03:00
alexey-milovidov
a27808be98
Revert "Do not miss exceptions from the ThreadPool" 2021-08-19 11:17:47 +03:00
Nikolai Kochetov
3e44ef437e
Merge pull request #26639 from ClickHouse/fix-bad-cast 
Fix bad cast
 2021-08-19 11:17:26 +03:00
Nikolay Degterinsky
7a5c5b4208 Fix encoding/decoding 2021-08-19 11:10:56 +03:00
alexey-milovidov
190ea327e9
Merge pull request #27826 from Avogar/fix-short-circuit-fuzz 
Fix bug in short-circuit found by fuzzer
 2021-08-19 11:06:22 +03:00
listar
fae6ae1c7b 1. add tests and fix a length bug. 2021-08-19 07:56:47 +00:00
alesapin
0aec151719
Merge pull request #27808 from ClickHouse/fix_replicas_may_diverge 
Fix a couple of bugs that may cause replicas to diverge
 2021-08-19 09:58:07 +03:00
Vladimir C
781b8123a5 Remove logging from NotJoinedBlocks 2021-08-19 09:55:18 +03:00
alesapin
4e9bc06fcf
Merge pull request #27807 from ClickHouse/fix_bug_checking_drop_range 
Fix `Unexpected merged part intersects drop range`
 2021-08-19 09:53:21 +03:00
Azat Khuzhin
d610974c4c Set tcp_keep_alive_timeout to 300 by default 
This may fix possible issues with remote queries, when remote server
abnormaly terminates and the initiator does not have proper timeout.

This should not harm anything, since the timeout is pretty huge (300
seconds).
 2021-08-19 09:06:41 +03:00
listar
75f47725e2 1. add header of sha512 hash functions. 2021-08-19 02:57:20 +00:00
listar
74bfb006da 1. add sha512 hash functions 2021-08-19 02:49:35 +00:00
Vitaly Baranov
3b09640d94 Use sessions more. 2021-08-19 02:22:09 +03:00
Vitaly Baranov
65ee9a1272
Merge pull request #26864 from vitlibar/refactor-sessions 
Introduce sessions
 2021-08-19 01:38:51 +03:00
Maksim Kita
4b8aa69e04 Fixed style check 2021-08-19 01:02:00 +03:00
Maksim Kita
01682a86b3 Updated user defined functions implementation 2021-08-19 00:54:55 +03:00
Kseniia Sumarokova
f5a91e5e5f
Fix style check 2021-08-18 23:17:00 +03:00