Commit Graph

2445 Commits

Author SHA1 Message Date
alexey-milovidov
a70a9e5383
Update WeakHash.h 2020-03-25 08:27:43 +03:00
Nikolai Kochetov
c4370886b0 Update weak hash. 2020-03-23 23:59:36 +03:00
Nikolai Kochetov
6d63d4bc88 Update weak hash. 2020-03-23 23:48:46 +03:00
Nikolai Kochetov
ee907da84d Update weak hash. 2020-03-23 23:45:12 +03:00
Nikolai Kochetov
ad56da8961 Added comments. 2020-03-23 23:03:52 +03:00
Nikolai Kochetov
4cfdef4403 Fix style and suppress pvs varnings.] 2020-03-23 22:38:53 +03:00
Nikolai Kochetov
9e105b877c Update intHash. 2020-03-23 22:21:15 +03:00
Nikolai Kochetov
1d94b8bfbd Merge branch 'master' into weak-hash 2020-03-23 19:22:46 +03:00
alexey-milovidov
c7863e1ac6
Clang Tidy, part 7 (#9799)
* Attempt to enable identifier naming check

* Attempt to enable identifier naming check, continue

* Progress on identifier names

* Adopt identifier names check

* Fixed error

* Merge with master

* Fixed build

* Fixed build

* Fixed build

* Fixed build

* Fixed build

* Fixed error

* Fixed error

* Fixed error
2020-03-23 05:12:31 +03:00
alexey-milovidov
06a8a421a2
Merge pull request #9739 from 4ertus2/ast
Rewrite multiple JOINs v2
2020-03-22 19:54:38 +03:00
alexey-milovidov
2fd4439e5f
Merge pull request #9761 from ClickHouse/remove-unused-code-thread-pool
Remove unused (obsolete) code from ThreadPool
2020-03-22 06:34:40 +03:00
Alexey Milovidov
a0f2940cb1 Fixed error 2020-03-20 21:53:35 +03:00
Alexey Milovidov
a5e3d4efb7 Added most of clang-static-analyzer checks 2020-03-20 21:53:35 +03:00
Alexey Milovidov
3f13464e3d clang-tidy, part 5 2020-03-20 21:53:35 +03:00
Nikolai Kochetov
75192d44aa Fix weakHash 2020-03-20 20:05:04 +03:00
Nikolai Kochetov
33db7f3988 Fix weakHash 2020-03-20 18:48:09 +03:00
Nikolai Kochetov
c4e73c10c9 Fix weakHash 2020-03-20 16:54:43 +03:00
Nikolai Kochetov
c9d808e509 Fix weakHash 2020-03-20 16:03:51 +03:00
Alexander Kuzmenkov
d5822e7ebe
Merge pull request #6892 from ClickHouse/aku/poco-1.9.3
Update Poco to 1.9.3.
2020-03-20 06:03:48 +03:00
Alexey Milovidov
344ad7afd5 Extra initialization for MSan 2020-03-20 05:32:28 +03:00
Alexey Milovidov
64a45e32d8 Remove unused (obsolete) code from ThreadPool #9154 2020-03-19 21:45:28 +03:00
Alexey Milovidov
8d9aba4fc3 Merge branch 'ParallelInputsProcessor-GlobalThreadPool-shutdown-fix' of https://github.com/azat/ClickHouse into azat-ParallelInputsProcessor-GlobalThreadPool-shutdown-fix 2020-03-19 21:29:17 +03:00
Pavel Kovalenko
f2dca656f9
MergeTree full support for S3 (#9646)
* IMergeDataPart full S3 support.

* MergeTreeData full S3 support.

* Compilation fixes.

* Mutations and merges S3 support.

* Fixed removing data part.

* MergeTree for S3 integration tests and fixes.

* Code style issues.

* Enable AWS logging.

* Fixed hardlink creation for DiskLocal.

* Fixed localBackup.cpp compilation.

* Fixed attaching partition.

* Get rid of extra methods in IDisk.

* Fixed storage config reloading.

* More tests with table manipulations.

* Remove unused error codes.

* Move localBackup to MergeTree folder.

* Minor fixes.
2020-03-19 19:37:55 +03:00
Alexander Kuzmenkov
9d9ae00956 Relax a test due to Poco regression.
Poco 1.9.3 has one second precision for mtime, because of this we can
miss an update of a dictionary file if it happens in the same second
we've read the file.

Should probably be fixed by switching to std::filesystem.

Also add some logs because finding out what's going on with dictionary
reloading is borderline impossible.
2020-03-19 19:05:41 +03:00
Alexander Kuzmenkov
486c061d34 Remove global scope from sigprocmask etc.
These functions may be macros on some platforms e.g. Mac OS
2020-03-19 19:05:41 +03:00
Alexander Kuzmenkov
dac83d2f9a Reset signal mask before calling exec().
It might be non-empty and the child process might not expect this. For
example, in one case we started clickhouse-odbc-bridge with blocked
SIGTERM and then it didn't shutdown properly along with the server.
2020-03-19 19:05:41 +03:00
Alexander Kuzmenkov
42c59af127 Remove trailing whitespace. 2020-03-19 19:05:41 +03:00
alexey-milovidov
47738615e6 Update ShellCommand.h 2020-03-19 19:05:41 +03:00
alexey-milovidov
f716fb66f9 Update ShellCommand.cpp 2020-03-19 19:05:41 +03:00
Alexander Kuzmenkov
e864b6f338 More logs + build fix. 2020-03-19 19:05:41 +03:00
Alexander Kuzmenkov
2918324807 More logs to catch the ODBC bridge shutdown error.
Also increase a potentially flappy timeout in another test.
2020-03-19 19:05:41 +03:00
Ivan
571d0d541c
Improve CCTZ contrib (#9687)
* common/Types.h → common/types.h
  Also split Core/Defines.h and merge with common/likely.h
* Improve cctz contrib
* Fix ALWAYS_INLINE and unbundled build
* Update Dockerfile from master
* Fix test for unbundled library
2020-03-19 13:38:34 +03:00
Artem Zuikov
67d711e78c Merge branch 'master' into ast 2020-03-19 12:28:11 +03:00
Artem Zuikov
88782b4dce Rewrite multiple JOINs v2 (set multiple_joins_rewriter_version = 2) 2020-03-19 00:38:27 +03:00
Alexey Milovidov
9cc463b1af Merge branch 'master' of github.com:yandex/ClickHouse into clang-tidy-4 2020-03-18 22:16:07 +03:00
Ivan
38b2dec354
Arcadia (#9729)
* Move getFQDNOrHostName to base/common/
* Add argsToConfig to ya.make
* Add coverage.cpp to ya.make
  Also remove WITH_COVERAGE from config file
2020-03-18 21:54:27 +03:00
Nikolai Kochetov
7246f819cd Fix build. 2020-03-18 20:08:27 +03:00
Alexey Milovidov
1ced2550d0 Fixed clang-tidy check 2020-03-18 19:51:20 +03:00
Alexey Milovidov
93466ce097 Added even more clang-tidy checks 2020-03-18 19:51:20 +03:00
Alexey Milovidov
c20853eecc Added most of bugprone checks 2020-03-18 19:51:20 +03:00
Nikolai Kochetov
e6f518154b Fix build. 2020-03-18 19:46:07 +03:00
Nikolai Kochetov
e76877c5ed Fix build. 2020-03-18 19:18:37 +03:00
Nikolai Kochetov
e26eac4649 Implement updateWeakHash32 for other columns. 2020-03-18 19:03:55 +03:00
Alexey Milovidov
cf1a8bc36e Fixed error 2020-03-18 15:14:10 +03:00
Alexey Milovidov
1bd7e594b0 clang-tidy, part 2 2020-03-18 03:57:00 +03:00
Alexander Kuzmenkov
04bed5f032 Add high-precision timestamp to trace_log 2020-03-17 05:16:04 +03:00
Alexey Milovidov
32b3e7946c Fix flacky test, take two 2020-03-16 15:32:07 +03:00
Hui Wang
c1ff111146 remove warnings under MacOS 2020-03-15 21:02:06 +01:00
Azat Khuzhin
a15b2daf6d Do not shutdown global thread pool on exception
Otherwise GlobalThreadPool can be terminated (for example due to an
exception from the ParallelInputsHandler::onFinish/onFinishThread, from
ParallelAggregatingBlockInputStream::Handler::onFinish/onFinishThread,
since writeToTemporaryFile() can definitelly throw) and the server will
not accept new connections (or/and execute queries) anymore.

Here is possible stacktrace (it is a bit inaccurate, due to
optimizations I guess, and it had been obtained with the
DB::tryLogCurrentException() in the catch block of the
ThreadPoolImpl::worker()):

    2020.02.16 22:30:40.415246 [ 45909 ] {} <Error> ThreadPool: Unhandled exception in the ThreadPool(10000,1000,10000) the loop will be shutted down: Code: 241, e.displayText() = DB::Exception: Memory limit (total) exceeded: would use 279.40 GiB (attempt to allocate chunk of 4205536 bytes), maximum: 279.40 GiB, Stack trace (when copying this message, always include the lines below):

    1.  Common/Exception.cpp:35: DB::Exception::Exception(...)
    ...
    6.  Common/Allocator.h:102: void DB::PODArrayBase<8ul, 4096ul, Allocator<false, false>, 15ul, 16ul>::reserve<>(unsigned long) (.part.0)
    7.  Interpreters/Aggregator.cpp:1040: void DB::Aggregator::writeToTemporaryFileImpl<...>(...)
    8.  Interpreters/Aggregator.cpp:719: DB::Aggregator::writeToTemporaryFile(...)
    9.  include/memory:4206: DB::Aggregator::writeToTemporaryFile(...)
    10. DataStreams/ParallelInputsProcessor.h:223: DB::ParallelInputsProcessor<DB::ParallelAggregatingBlockInputStream::Handler>::thread(...)

Refs: https://github.com/ClickHouse/ClickHouse/issues/6833#issuecomment-579221732
(Reference to particular comment, since I'm not sure about the initial issue)
2020-03-15 13:13:10 +03:00
Alexey Milovidov
93ea73ae0f Fix flacky test 01017_uniqCombined_memory_usage #7236 2020-03-15 03:22:06 +03:00