Nikita Mikhaylov
2c04b0a8e6
comment added
2020-09-07 19:07:34 +03:00
Nikolai Kochetov
382ebc700e
Added comment.
2020-09-07 12:47:59 +03:00
Alexey Milovidov
4a336e3814
More consistent invocation of skipBOMIfExists
2020-09-07 07:21:55 +03:00
Nikolai Kochetov
29918c9411
Update IAccumulatingTransform.
2020-09-04 23:44:15 +03:00
Nikolai Kochetov
499405504f
Merge branch 'master' into pipes-and-creating-sets
2020-09-04 23:41:20 +03:00
Nikolai Kochetov
01d0f6e5c5
Merge pull request #14402 from ClickHouse/stop-threads-if-exception-in-pipeline-executor
...
Stop query execution if exception happened in PipelineExecutor itself.
2020-09-04 23:40:22 +03:00
Nikolai Kochetov
d7be761484
Try fix test.
2020-09-04 20:14:36 +03:00
Nikolai Kochetov
7f88e3de1f
Review fix.
2020-09-04 15:54:31 +03:00
Nikolai Kochetov
41a3fad1ea
Allow many rows in totals.
2020-09-04 15:34:36 +03:00
Nikolai Kochetov
c761970bc5
Merge branch 'master' into pipes-and-creating-sets
2020-09-04 11:38:35 +03:00
Nikolai Kochetov
b7e53208d1
Fix tests.
2020-09-04 11:36:47 +03:00
Matwey V. Kornilov
9b4da1e82f
Add missed #include <atomic>
...
std::atomic<Data*> at line 199 requires including <atomic>
2020-09-02 23:40:27 +03:00
Nikolai Kochetov
acfd35a908
Update QueryPipeline::addCreatingSetsTransform
2020-09-02 16:04:54 +03:00
Nikolai Kochetov
811e44a937
Merge pull request #14315 from azat/EXPLAIN-SIGSEGV-fix
...
[RFC] Fix QueryPlan lifetime (for EXPLAIN PIPELINE graph=1) for queries with nested interpreter
2020-09-02 12:46:59 +03:00
Nikolai Kochetov
13e0464138
Stop query execution if exception happened in PipelineExecutor itself.
2020-09-02 12:39:49 +03:00
hcz
a80c1adee8
Add JSONCompactStrings formats
2020-09-02 12:15:58 +08:00
Nikolai Kochetov
f82b799f12
Update CreatingSetsTransform.
2020-09-01 16:53:11 +03:00
Nikolai Kochetov
8fac595428
Stop query execution if exception happened in PipelineExecutor itself.
2020-09-01 13:29:10 +03:00
hcz
86fa185bb6
Add JSONStrings formats
2020-09-01 17:06:36 +08:00
Azat Khuzhin
d04cda0367
Fix QueryPlan lifetime (for EXPLAIN PIPELINE graph=1) for queries with nested interpreter
...
Example of such queries are distributed queries, which creates local
InterpreterSelectQuery, which will have it's own QueryPlan but returns
Pipes that has that IQueryPlanStep attached.
After EXPLAIN PIPELINE graph=1 tries to use them, and will get SIGSEGV.
- TSAN:
<details>
```
==2782113==ERROR: AddressSanitizer: heap-use-after-free on address 0x6120000223c0 at pc 0x00002b8f3f3e bp 0x7fff18cfbff0 sp 0x7fff18cfbfe8
READ of size 8 at 0x6120000223c0 thread T22 (TCPHandler)
#0 0x2b8f3f3d in DB::printPipelineCompact(std::__1::vector<std::__1::shared_ptr<DB::IProcessor>, std::__1::allocator<std::__1::shared_ptr<DB::IProcessor> > > const&, DB::WriteBuffer&, bool) /build/obj-x86_64-linux-gnu/../src/Processors/printPipeline.cpp:116:53
#1 0x29ee698c in DB::InterpreterExplainQuery::executeImpl() /build/obj-x86_64-linux-gnu/../src/Interpreters/InterpreterExplainQuery.cpp:275:17
#2 0x29ee2e40 in DB::InterpreterExplainQuery::execute() /build/obj-x86_64-linux-gnu/../src/Interpreters/InterpreterExplainQuery.cpp:73:14
#3 0x2a7b44a2 in DB::executeQueryImpl(char const*, char const*, DB::Context&, bool, DB::QueryProcessingStage::Enum, bool, DB::ReadBuffer*) /build/obj-x86_64-linux-gnu/../src/Interpreters/executeQuery.cpp:389:28
#4 0x2a7b1cb3 in DB::executeQuery(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&, DB::Context&, bool, DB::QueryProcessingStage::Enum, bool) /build/obj-x86_64-linux-gnu/../src/Interpreters/executeQuery.cpp:675:30
#5 0x2b7993b2 in DB::TCPHandler::runImpl() /build/obj-x86_64-linux-gnu/../src/Server/TCPHandler.cpp:253:24
#6 0x2b7b649a in DB::TCPHandler::run() /build/obj-x86_64-linux-gnu/../src/Server/TCPHandler.cpp:1217:9
#7 0x31d9c57e in Poco::Net::TCPServerConnection::start() /build/obj-x86_64-linux-gnu/../contrib/poco/Net/src/TCPServerConnection.cpp:43:3
#8 0x31d9d281 in Poco::Net::TCPServerDispatcher::run() /build/obj-x86_64-linux-gnu/../contrib/poco/Net/src/TCPServerDispatcher.cpp:114:20
#9 0x3206b5d5 in Poco::PooledThread::run() /build/obj-x86_64-linux-gnu/../contrib/poco/Foundation/src/ThreadPool.cpp:199:14
#10 0x320657ad in Poco::ThreadImpl::runnableEntry(void*) /build/obj-x86_64-linux-gnu/../contrib/poco/Foundation/src/Thread_POSIX.cpp:345:27
#11 0x7ffff7f853e8 in start_thread (/usr/lib/libpthread.so.0+0x93e8)
#12 0x7ffff7ea2292 in clone (/usr/lib/libc.so.6+0x100292)
0x6120000223c0 is located 0 bytes inside of 272-byte region [0x6120000223c0,0x6120000224d0)
freed by thread T22 (TCPHandler) here:
#0 0x122f3b62 in operator delete(void*, unsigned long) (/src/ch/tmp/master-20200831/clickhouse+0x122f3b62)
#1 0x2bd9e9fa in std::__1::default_delete<DB::IQueryPlanStep>::operator()(DB::IQueryPlanStep*) const /build/obj-x86_64-linux-gnu/../contrib/libcxx/include/memory:2363:5
#2 0x2bd9e9fa in std::__1::unique_ptr<DB::IQueryPlanStep, std::__1::default_delete<DB::IQueryPlanStep> >::reset(DB::IQueryPlanStep*) /build/obj-x86_64-linux-gnu/../contrib/libcxx/include/memory:2618:7
#3 0x2bd9e9fa in std::__1::unique_ptr<DB::IQueryPlanStep, std::__1::default_delete<DB::IQueryPlanStep> >::~unique_ptr() /build/obj-x86_64-linux-gnu/../contrib/libcxx/include/memory:2572:19
#4 0x2bd9e9fa in DB::QueryPlan::Node::~Node() /build/obj-x86_64-linux-gnu/../src/Processors/QueryPlan/QueryPlan.h:66:12
#5 0x2bd9e9fa in void std::__1::allocator_traits<std::__1::allocator<std::__1::__list_node<DB::QueryPlan::Node, void*> > >::__destroy<DB::QueryPlan::Node>(std::__1::integral_constant<bool, false>, std::__1::allocator<std::__1::__list_node<DB::QueryPlan::Node, void*> >&,
DB::QueryPlan::Node*) /build/obj-x86_64-linux-gnu/../contrib/libcxx/include/memory:1798:23
#6 0x2bd9e9fa in void std::__1::allocator_traits<std::__1::allocator<std::__1::__list_node<DB::QueryPlan::Node, void*> > >::destroy<DB::QueryPlan::Node>(std::__1::allocator<std::__1::__list_node<DB::QueryPlan::Node, void*> >&, DB::QueryPlan::Node*) /build/obj-x86_64-lin
ux-gnu/../contrib/libcxx/include/memory:1630:14
#7 0x2bd9e9fa in std::__1::__list_imp<DB::QueryPlan::Node, std::__1::allocator<DB::QueryPlan::Node> >::clear() /build/obj-x86_64-linux-gnu/../contrib/libcxx/include/list:762:13
#8 0x29fece08 in DB::InterpreterSelectQuery::execute() /build/obj-x86_64-linux-gnu/../src/Interpreters/InterpreterSelectQuery.cpp:492:1
#9 0x2abf7484 in DB::ClusterProxy::(anonymous namespace)::createLocalStream(std::__1::shared_ptr<DB::IAST> const&, DB::Block const&, DB::Context const&, DB::QueryProcessingStage::Enum) /build/obj-x86_64-linux-gnu/../src/Interpreters/ClusterProxy/SelectStreamFactory.cpp:
78:33
#10 0x2abea85d in DB::ClusterProxy::SelectStreamFactory::createForShard(DB::Cluster::ShardInfo const&, std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&, std::__1::shared_ptr<DB::IAST> const&, DB::Context const&, std::__1::shar
ed_ptr<DB::Throttler> const&, DB::SelectQueryInfo const&, std::__1::vector<DB::Pipe, std::__1::allocator<DB::Pipe> >&)::$_0::operator()() const /build/obj-x86_64-linux-gnu/../src/Interpreters/ClusterProxy/SelectStreamFactory.cpp:133:51
#11 0x2abea85d in DB::ClusterProxy::SelectStreamFactory::createForShard(DB::Cluster::ShardInfo const&, std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&, std::__1::shared_ptr<DB::IAST> const&, DB::Context const&, std::__1::shar
ed_ptr<DB::Throttler> const&, DB::SelectQueryInfo const&, std::__1::vector<DB::Pipe, std::__1::allocator<DB::Pipe> >&) /build/obj-x86_64-linux-gnu/../src/Interpreters/ClusterProxy/SelectStreamFactory.cpp:189:13
#12 0x2abe6d99 in DB::ClusterProxy::executeQuery(DB::ClusterProxy::IStreamFactory&, std::__1::shared_ptr<DB::Cluster> const&, Poco::Logger*, std::__1::shared_ptr<DB::IAST> const&, DB::Context const&, DB::Settings const&, DB::SelectQueryInfo const&) /build/obj-x86_64-lin
ux-gnu/../src/Interpreters/ClusterProxy/executeQuery.cpp:107:24
#13 0x2abc4b74 in DB::StorageDistributed::read(std::__1::vector<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> >, std::__1::allocator<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > > > const&, s
td::__1::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::SelectQueryInfo const&, DB::Context const&, DB::QueryProcessingStage::Enum, unsigned long, unsigned int) /build/obj-x86_64-linux-gnu/../src/Storages/StorageDistributed.cpp:514:12
#14 0x2bda1c5a in DB::ReadFromStorageStep::ReadFromStorageStep(std::__1::shared_ptr<DB::RWLockImpl::LockHolderImpl>, std::__1::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::SelectQueryOptions, std::__1::shared_ptr<DB::IStorage>, std::__1::vector<std::__1::basic_st
ring<char, std::__1::char_traits<char>, std::__1::allocator<char> >, std::__1::allocator<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > > > const&, DB::SelectQueryInfo const&, std::__1::shared_ptr<DB::Context>, DB::QueryProcessingStage
::Enum, unsigned long, unsigned long) /build/obj-x86_64-linux-gnu/../src/Processors/QueryPlan/ReadFromStorageStep.cpp:39:26
#15 0x2a01ca70 in std::__1::__unique_if<DB::ReadFromStorageStep>::__unique_single std::__1::make_unique<DB::ReadFromStorageStep, std::__1::shared_ptr<DB::RWLockImpl::LockHolderImpl>&, std::__1::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::SelectQueryOptions&, std
::__1::shared_ptr<DB::IStorage>&, std::__1::vector<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> >, std::__1::allocator<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > > >&, DB::SelectQueryInfo&, st
d::__1::shared_ptr<DB::Context>&, DB::QueryProcessingStage::Enum&, unsigned long&, unsigned long&>(std::__1::shared_ptr<DB::RWLockImpl::LockHolderImpl>&, std::__1::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::SelectQueryOptions&, std::__1::shared_ptr<DB::IStorage>&,
std::__1::vector<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> >, std::__1::allocator<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > > >&, DB::SelectQueryInfo&, std::__1::shared_ptr<DB::Context>&,
DB::QueryProcessingStage::Enum&, unsigned long&, unsigned long&) /build/obj-x86_64-linux-gnu/../contrib/libcxx/include/memory:3028:32
#16 0x29ff556a in DB::InterpreterSelectQuery::executeFetchColumns(DB::QueryProcessingStage::Enum, DB::QueryPlan&, std::__1::shared_ptr<DB::PrewhereInfo> const&, std::__1::vector<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> >, std::
__1::allocator<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > > > const&) /build/obj-x86_64-linux-gnu/../src/Interpreters/InterpreterSelectQuery.cpp:1383:26
#17 0x29fe6b83 in DB::InterpreterSelectQuery::executeImpl(DB::QueryPlan&, std::__1::shared_ptr<DB::IBlockInputStream> const&, std::__1::optional<DB::Pipe>) /build/obj-x86_64-linux-gnu/../src/Interpreters/InterpreterSelectQuery.cpp:795:9
#18 0x29fe5771 in DB::InterpreterSelectQuery::buildQueryPlan(DB::QueryPlan&) /build/obj-x86_64-linux-gnu/../src/Interpreters/InterpreterSelectQuery.cpp:473:5
#19 0x2a47d370 in DB::InterpreterSelectWithUnionQuery::buildQueryPlan(DB::QueryPlan&) /build/obj-x86_64-linux-gnu/../src/Interpreters/InterpreterSelectWithUnionQuery.cpp:182:38
#20 0x29ee5bff in DB::InterpreterExplainQuery::executeImpl() /build/obj-x86_64-linux-gnu/../src/Interpreters/InterpreterExplainQuery.cpp:265:21
#21 0x29ee2e40 in DB::InterpreterExplainQuery::execute() /build/obj-x86_64-linux-gnu/../src/Interpreters/InterpreterExplainQuery.cpp:73:14
#22 0x2a7b44a2 in DB::executeQueryImpl(char const*, char const*, DB::Context&, bool, DB::QueryProcessingStage::Enum, bool, DB::ReadBuffer*) /build/obj-x86_64-linux-gnu/../src/Interpreters/executeQuery.cpp:389:28
#23 0x2a7b1cb3 in DB::executeQuery(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&, DB::Context&, bool, DB::QueryProcessingStage::Enum, bool) /build/obj-x86_64-linux-gnu/../src/Interpreters/executeQuery.cpp:675:30
#24 0x2b7993b2 in DB::TCPHandler::runImpl() /build/obj-x86_64-linux-gnu/../src/Server/TCPHandler.cpp:253:24
#25 0x2b7b649a in DB::TCPHandler::run() /build/obj-x86_64-linux-gnu/../src/Server/TCPHandler.cpp:1217:9
#26 0x31d9c57e in Poco::Net::TCPServerConnection::start() /build/obj-x86_64-linux-gnu/../contrib/poco/Net/src/TCPServerConnection.cpp:43:3
#27 0x31d9d281 in Poco::Net::TCPServerDispatcher::run() /build/obj-x86_64-linux-gnu/../contrib/poco/Net/src/TCPServerDispatcher.cpp:114:20
#28 0x3206b5d5 in Poco::PooledThread::run() /build/obj-x86_64-linux-gnu/../contrib/poco/Foundation/src/ThreadPool.cpp:199:14
#29 0x320657ad in Poco::ThreadImpl::runnableEntry(void*) /build/obj-x86_64-linux-gnu/../contrib/poco/Foundation/src/Thread_POSIX.cpp:345:27
#30 0x7ffff7f853e8 in start_thread (/usr/lib/libpthread.so.0+0x93e8)
```
</details>
2020-09-01 10:04:08 +03:00
Mark Papadakis
ff76790a59
Update AggregatingTransform.cpp
...
Replaced redundant call to chunk.getNumRows() with local var.
2020-08-28 16:08:06 +03:00
alexey-milovidov
65ee7dcb18
Merge pull request #13941 from gervarela/avro_confluent_skip_missing_magic_or_schema_id
...
Skip abnormaly small messages in AvroConfluent format
2020-08-26 19:34:42 +03:00
alexey-milovidov
3c6675f7f4
Update AvroRowInputFormat.cpp
2020-08-26 02:26:27 +03:00
alexey-milovidov
5d4507907d
Update AvroRowInputFormat.cpp
2020-08-26 00:19:51 +03:00
alexey-milovidov
efa5b76605
Update AvroRowInputFormat.cpp
2020-08-26 00:17:39 +03:00
Alexander Kuzmenkov
e3c919ec19
Merge pull request #13847 from hexiaoting/dev_rmcode
...
Deprecate ODBCDriver format
2020-08-24 22:34:52 +03:00
alexey-milovidov
b71ef6db22
Update AvroRowInputFormat.cpp
2020-08-21 18:34:15 +03:00
alexey-milovidov
84db9a3a66
Merge pull request #13906 from tomjiang1987/optimize_error_msg_for_null
...
optimize error msg for null value of TabSeparatedRow format
2020-08-21 16:06:16 +03:00
Gervasio Varela
a6a18b62f9
AvroConfluent + Kafla: Skip malformed messages that do not contain at least the AvroConfluent magic number and the schema id definition.
2020-08-21 11:11:41 +02:00
tao jiang
294aa985e0
fix typo exception name
2020-08-21 08:53:00 +08:00
alexey-milovidov
c5a7b1c456
Update RowInputFormatWithDiagnosticInfo.cpp
2020-08-20 20:34:55 +03:00
alexey-milovidov
911946b517
Update TabSeparatedRowInputFormat.cpp
2020-08-20 20:32:49 +03:00
Nikolai Kochetov
7c0fcb2039
Merge pull request #13611 from ClickHouse/array-join-processor
...
Refactor ARRAY JOIN
2020-08-20 17:56:37 +03:00
tao jiang
189c284597
fix if statement code style check
2020-08-20 18:42:14 +08:00
tao jiang
70ef84ee4b
fix code style check
2020-08-20 18:06:41 +08:00
Jiang Tao
613e3f7247
optimize error msg for null value
2020-08-20 11:25:28 +08:00
hexiaoting
e9be2f14ea
fix implementation for \n separated lines
2020-08-19 11:50:43 +08:00
Mark Papadakis
734f57462b
Update PipelineExecutor.cpp
...
Should have used back_edges instead of direct_edges
2020-08-18 15:09:23 +03:00
hexiaoting
ddbfe0ce21
Deprecate ODBCDriver format
2020-08-18 11:29:40 +08:00
hexiaoting
0451d57293
Add new feature: LineAsString Format
2020-08-18 10:35:08 +08:00
hexiaoting
405a6fb08f
New feature: LineAsString format. #13630
2020-08-17 18:20:23 +08:00
Alexey Milovidov
09846a92cd
Fix typos
2020-08-16 15:09:41 +03:00
tavplubix
18ef911fe8
Merge pull request #13672 from zhang2014/refactor/materialize_mysql_database
...
ISSUES-4006 split mysql protocol to multiple packets
2020-08-16 13:55:11 +03:00
alexey-milovidov
c5c79e9408
Merge pull request #13590 from azat/TSV-fix-CR-assertion
...
Fix assertion for carriage return in TSV format header
2020-08-15 11:15:23 +03:00
alexey-milovidov
d95b9f73a4
Update TabSeparatedRowInputFormat.cpp
2020-08-15 11:11:10 +03:00
Nikolai Kochetov
8e631a98ea
Refactor ActionsChain.
2020-08-14 21:24:58 +03:00
Nikolai Kochetov
6934974fc5
Lift up ARRAY JOIN step.
2020-08-14 21:24:31 +03:00
Nikolai Kochetov
85d0f1a480
Add ARRAY JOIN to ActionsChain
2020-08-14 21:24:19 +03:00
Nikolai Kochetov
95bbda3667
Specify columns after ARRAY JOIN and JOIN.
...
Add ArrayJoinTransform and ArrayJoinStep.
2020-08-14 21:24:03 +03:00
zhang2014
4199baf69d
Merge branch 'master' of github.com:yandex/ClickHouse into refactor/materialize_mysql_database
2020-08-14 13:30:12 +08:00
alexey-milovidov
eeefcd6493
Merge pull request #13337 from ClickHouse/refactor-pipes-3
...
Refactor Pipe
2020-08-14 04:12:22 +03:00
alexey-milovidov
3b05c315e4
Update Pipe.h
2020-08-14 04:10:10 +03:00
zhang2014
96bd3ac34b
ISSUES-4006 split mysql protocol
2020-08-13 20:41:36 +08:00
zhang2014
34f4c8972e
ISSUES-4006 split replication packets
2020-08-13 20:07:02 +08:00
zhang2014
c76d7e3121
ISSUES-4006 split generic packets
2020-08-13 18:17:13 +08:00
zhang2014
c0d42b764e
ISSUES-4006 split protocol text packet
2020-08-13 17:20:45 +08:00
zhang2014
4fcc178deb
ISSUES-4006 split mysql protocol
2020-08-13 16:17:33 +08:00
zhang2014
688836cdc4
ISSUES-4006 split msql protocol & fix build
2020-08-13 14:30:29 +08:00
Azat Khuzhin
6097f769c7
Fix assertion for carriage return in the header in TSVWithNames* format.
...
TabSeparatedRowInputFormat::readPrefix() tries to check for carriage
return (via checkForCarriageReturn()), however it does the check after
checking the column is exists, reorder the codepath a little bit to
run checkForCarriageReturn() before.
2020-08-12 11:13:19 +03:00
Azat Khuzhin
72205cd326
Call writePrefix() from ctor in SinkToOutputStream
...
This will fix lack of headers for the following formats if there are
zero rows:
- TSVWithNames
- CSVWithNames
- TSVWithNamesAndTypes
2020-08-11 00:52:35 +03:00
Azat Khuzhin
d5a2e1e61c
Call doWritePrefix() if IOutputFormat works as Processor (i.e. clickhouse-local)
...
This fixes the *WithNames output format (lack of header before this
patch).
2020-08-11 00:52:35 +03:00
Azat Khuzhin
ba92213d21
Write header only once in TSVWithNames*
2020-08-11 00:52:35 +03:00
Nikolai Kochetov
9b67cd9faf
Merge branch 'master' into refactor-pipes-3
2020-08-10 10:50:17 +03:00
Alexey Milovidov
edd89a8610
Fix half of typos
2020-08-08 03:47:03 +03:00
Anton Popov
35d0328462
Merge pull request #13396 from CurtizJ/fix-13198
...
Fix assertion in FinishSortingTransform.
2020-08-07 15:36:17 +03:00
Nikolai Kochetov
79f30f9446
Merge pull request #13399 from hczhcz/patch-0806
...
Fix empty output of arrow related formats
2020-08-07 15:31:45 +03:00
Nikolai Kochetov
cb879f4cf5
Push ci
2020-08-07 11:28:12 +03:00
hcz
898e19e18d
Fix function names
2020-08-07 15:40:05 +08:00
Nikolai Kochetov
d83c7cc0e6
Merge branch 'master' into refactor-pipes-3
2020-08-06 17:32:50 +03:00
Nikolai Kochetov
20e63d2271
Refactor Pipe [part 6]
2020-08-06 15:24:05 +03:00
Nikolai Kochetov
539be71635
Fix tests.
2020-08-06 13:05:27 +03:00
Azat Khuzhin
15be6a0dd5
Fix quirks for PrettyCompactMonoBlock
...
- Fix PrettyCompactMonoBlock for clickhouse-local (broken in 20.3+,
fails with an error `Unknown format PrettyCompactMonoBlock`, after #6239 )
- Fix extremes/totals with PrettyCompactMonoBlock (even before 20.3
breakage they were simply ignored)
2020-08-06 11:59:45 +03:00
hcz
dadcca6c08
Fix empty output of arrow related formats
2020-08-06 16:32:31 +08:00
Anton Popov
e7d3154d38
fix queries with order by prefix of primary key and constant columns
2020-08-06 02:37:39 +03:00
Alexander Kuzmenkov
4417fb80e6
Merge pull request #13203 from oandrew/avro-confluent-skip-tombstone
...
AvroConfluent: skip Kafka tombstone records/skip broken records
2020-08-05 02:47:42 +03:00
Nikolai Kochetov
a153f05e10
Refactor Pipe [part 5].
2020-08-04 18:51:56 +03:00
Nikolai Kochetov
9385f3de0e
Refactor Pipe [part 4].
2020-08-04 16:06:59 +03:00
Nikolai Kochetov
09fbce1b1e
Merge branch 'master' into refactor-pipes-3
2020-08-04 11:32:34 +03:00
Andrew Onyshchuk
2883831564
AvroConfluent: skip broken messages
2020-08-04 02:43:42 -05:00
Andrew Onyshchuk
99c183da0f
AvroConfluent: skip tombstone records
2020-08-04 02:43:42 -05:00
alexey-milovidov
2c4a494440
Update DelayedSource.cpp
2020-08-03 21:50:02 +03:00
Nikolai Kochetov
b6f04cac47
Fix totals and extremes for delayed replica.
2020-08-03 21:47:13 +03:00
Nikolai Kochetov
42c5248611
Fix totals and extremes for delayed replica.
2020-08-03 20:41:56 +03:00
Nikolai Kochetov
d9ca3d8d40
Refactor Pipe [part 3].
2020-08-03 18:54:53 +03:00
Nikolai Kochetov
2cca4d5fcf
Refactor Pipe [part 2].
2020-08-03 16:54:14 +03:00
Nikolai Kochetov
e411916bde
Refactor Pipe [part 1].
2020-08-03 14:33:11 +03:00
Alexey Milovidov
6f690b7c0d
Normalize ya.make files, fix "Arcadia" build
2020-08-02 16:57:38 +03:00
alexey-milovidov
344925fbdd
Merge pull request #13151 from ClickHouse/refactor-pipeline-executor
...
Refactor pipeline executor
2020-08-02 01:30:33 +03:00
alexey-milovidov
1f19d7e9bd
Merge pull request #13016 from ClickHouse/limit-push-down
...
Limit push down
2020-08-02 01:23:06 +03:00
alexey-milovidov
b0b27e687f
Update ITransformingStep.h
2020-08-02 01:21:50 +03:00
alexey-milovidov
bb25cff7b9
Update ITransformingStep.h
2020-08-02 01:21:15 +03:00
Nikolai Kochetov
c786f05388
Merge pull request #13189 from ClickHouse/refactor-pipes-2
...
Remove TreeExecutorBIS
2020-08-01 11:56:50 +03:00
Nikolai Kochetov
2ae94f4570
Refactor Pipes part 1.
2020-07-31 19:54:54 +03:00
Nikolai Kochetov
39530f837e
Remove TreeExecutorBlockInputStream.
2020-07-31 16:23:19 +03:00
Nikolai Kochetov
14af7208a0
Update ExecutingGraph.h
2020-07-31 15:57:21 +03:00
alexey-milovidov
91156bef54
Merge pull request #13075 from ClickHouse/fix-11327
...
Fix 11327
2020-07-31 14:53:07 +03:00
Nikolai Kochetov
191dd81963
Check header for totals and extremes.
2020-07-31 14:47:33 +03:00
Nikolai Kochetov
3306a24273
Update ConvertingTransform.h
2020-07-31 14:11:03 +03:00
Nikolai Kochetov
a337d2e2bc
Merge branch 'master' into refactor-pipeline-executor
2020-07-31 14:02:58 +03:00
alexey-milovidov
065db05665
Merge pull request #12638 from ianton-ru/selected_rows_event
...
Add SelectedRows and SelectedBytes events
2020-07-31 12:48:46 +03:00
alesapin
2eb01fd655
Merge pull request #13104 from ClickHouse/volumes-refactorings
...
Merging #12670
2020-07-31 11:21:30 +03:00
alexey-milovidov
c2a1b4c08b
Merge pull request #13058 from markpapadakis/master
...
Minor perf. improvement
2020-07-31 02:32:19 +03:00
alexey-milovidov
158587c0d1
Update PipelineExecutor.cpp
2020-07-31 02:31:49 +03:00
Nikolai Kochetov
41ef8a9191
Fix style.
2020-07-30 22:30:06 +03:00
Nikolai Kochetov
6ecd412023
Fix build.
2020-07-30 21:28:36 +03:00
Nikolai Kochetov
aa961149f7
Fix build.
2020-07-30 21:23:57 +03:00
Nikolai Kochetov
13c121e46b
Fix build.
2020-07-30 21:18:30 +03:00
Nikolai Kochetov
ee9a46fb33
Fix build.
2020-07-30 20:00:38 +03:00
Nikolai Kochetov
aa51f7170c
Fix build.
2020-07-30 19:27:11 +03:00
Nikolai Kochetov
dde7a80987
Extract ExecutingGraph from PipelineExecutor.
2020-07-30 19:24:50 +03:00
alesapin
724b7be555
Merge branch 'volumes-related-refactorings' of https://github.com/excitoon-favorites/ClickHouse into volumes-refactorings
2020-07-30 12:20:48 +03:00
alesapin
7a806eb90f
Merge pull request #13017 from ClickHouse/freeze_partition_with_name
...
Alter table freeze with verbose output
2020-07-29 18:42:48 +03:00
Nikolai Kochetov
59d543ca1c
Ignore constants for remote query from local replica.
2020-07-29 17:30:03 +03:00
Nikolai Kochetov
be24184deb
Ignore constants for remote query from local replica.
2020-07-29 17:27:37 +03:00
Nikolai Kochetov
fdc49cadb7
Ignore constants for remote query from local replica.
2020-07-29 15:51:59 +03:00
Nikolai Kochetov
54c6785b36
Try fix tests.
2020-07-29 15:29:20 +03:00
Nikolai Kochetov
d9c78cde6b
Try fix tests.
2020-07-29 15:19:50 +03:00
alexey-milovidov
c5d76dac69
Update PipelineExecutor.cpp
2020-07-29 14:38:57 +03:00
Nikolai Kochetov
bf8f28a788
Try fix tests.
2020-07-29 14:06:00 +03:00
Alexander Kuzmenkov
80fcbfb1eb
Merge pull request #13034 from ClickHouse/aku/block-structure-mismatch
...
Block structure mismatch is a program error
2020-07-29 13:01:11 +03:00
Mark Papadakis
c26cc85142
Minor perf. improvement
...
break-ing out of a loop because it makes sense to do so
2020-07-29 10:26:08 +03:00
Alexander Kuzmenkov
f6f2812f73
Block structure mismatch is a program error
2020-07-28 21:35:18 +03:00
Nikolai Kochetov
f9d7cacf53
Merge pull request #12989 from ClickHouse/fix-12602
...
Fix `Block structure mismatch` error for queries with UNION and JOIN
2020-07-28 21:15:33 +03:00
Nikolai Kochetov
2ea998c139
Try fix gcc build.
2020-07-28 19:50:29 +03:00
Nikolai Kochetov
0743922177
Add limit to explain for MergingSortedStep and PartialSortingStep.
2020-07-28 18:11:00 +03:00
alesapin
c75830e878
Alter table freeze with verbose output
2020-07-28 18:10:36 +03:00
Nikolai Kochetov
9c6627a7eb
Limit push down.
2020-07-28 17:13:31 +03:00
Nikolai Kochetov
e6508db4f0
Split traits of ITransformingStep to DataStreamTraits and TransformTraits.
2020-07-28 16:10:48 +03:00
Nikolai Kochetov
eebb0233d9
Fix header for totals and extremes in QueryPipeline::unitePipelines.
2020-07-28 13:41:32 +03:00
Nikolai Kochetov
1f2390b65e
Merge pull request #12840 from ClickHouse/remove-wrong-threads-limiting
...
Remove thread limiting.
2020-07-28 12:03:07 +03:00
Nikolai Kochetov
09b8cb0e5f
Add sort_description to QueryPlan DataStream.
2020-07-27 18:37:43 +03:00
Anton Ivashkin
89a59d43f2
Merge
2020-07-27 17:59:12 +03:00
Nikolai Kochetov
2f0f1aa5bc
Remove thread limiting.
2020-07-27 16:20:31 +03:00
Nikolai Kochetov
fb3a50024d
Added preserves_number_of_rows trait.
2020-07-27 15:48:33 +03:00
Gleb Novikov
7f5b6fba78
Generic volume is coming...
...
1. SingleDiskVolume for temporary volumes
2. Generic VolumePtr in StoragePolicies
3. Removed max_data_part_size in system.storage_policies, added volume_type
2020-07-26 21:27:36 +03:00
Nikolai Kochetov
bfe039fc0c
Update SourceFromInputStream.h
...
Added comment.
2020-07-24 16:38:07 +03:00
Nikolai Kochetov
b4852e4c69
Limit push down.
2020-07-23 13:20:38 +03:00
Artem Zuikov
2afd123eda
Refactoring: extract TreeOptimizer from SyntaxAnalyzer ( #12645 )
2020-07-22 20:13:05 +03:00
Anton Ivashkin
742793be54
Add SelectedRows and SelectedBytes events
2020-07-21 17:50:02 +03:00
Nikolai Kochetov
cc7ebfac78
Fix Pipeline stuck for external sort.
2020-07-21 12:23:54 +03:00
alesapin
21d3a79794
Fix arcadia build for msgpack
2020-07-16 14:08:26 +03:00
alesapin
0740b88d6b
Merge branch 'master' into fasttest
2020-07-14 15:19:05 +03:00
alexey-milovidov
7e679b731d
Merge pull request #12477 from azat/arrow-deprecated-fixes
...
arrow deprecated API usage build fixes
2020-07-14 09:23:52 +03:00
alexey-milovidov
1893d89ce3
Merge pull request #12448 from ClickHouse/fix-trash-rabbitmq
...
Fix trash from RabbitMQ
2020-07-14 01:11:37 +03:00
Azat Khuzhin
4ec5e79ade
Do not suppress -Wdeprecated* for arrow
2020-07-13 21:25:51 +03:00
Azat Khuzhin
5f6fdb89bb
Fix arrow deprecated API usage
...
And also use fmt-style for exceptions
2020-07-13 21:25:49 +03:00
Alexey Milovidov
6edf43d112
Fix build
2020-07-13 19:51:37 +03:00
tavplubix
3314a97b99
Merge pull request #12009 from hczhcz/patch-0628
...
Allow TabSeparatedRaw as an input format
2020-07-13 19:43:31 +03:00
hcz
3683891ebc
Fix TSVRaw on long text
2020-07-13 12:51:43 +08:00
Alexey Milovidov
8f2055b0a0
Fix trash from RabbitMQ
2020-07-13 04:11:48 +03:00