Commit Graph

39302 Commits

Author SHA1 Message Date
Andrew Onyshchuk
e7ba75ce98 Avro nested fields - support complex types 2020-04-25 17:42:49 -05:00
alexey-milovidov
8b1e504b19
Merge pull request #10497 from azat/kafka
Tiny kafka fixes
2020-04-25 23:50:22 +03:00
alexey-milovidov
092efc53ba
Merge pull request #10496 from ClickHouse/fix-visible-drift-memory-tracking
Fix visible drift of MemoryTracking metric
2020-04-25 23:50:08 +03:00
alexey-milovidov
1e25991c62
Merge pull request #10494 from kyprizel/master
Split fuzzers and sanitizers
2020-04-25 23:49:45 +03:00
alexey-milovidov
21fb686e4a
Merge pull request #10499 from GoToCoding/patch-1
Update developer_instruction.md
2020-04-25 23:49:10 +03:00
alexey-milovidov
23cd6bec5f
Merge pull request #10500 from sofakingworld/another_one_elixir_third_party_client
Elixir 3rd-party client - Pillar
2020-04-25 23:48:26 +03:00
alexey-milovidov
c9334d3fde
Merge pull request #10491 from azat/dist-shutdown
Proper Distributed shutdown (fixes UAF, avoid waiting for sending all batches)
2020-04-25 23:47:59 +03:00
Dmitry
07664ec514 Documentation, add info about Elixit client Pillar 2020-04-25 20:34:46 +03:00
Ruzal Ibragimov
524284c123
Update developer_instruction.md
Fix creating testing databases.
2020-04-25 20:02:32 +03:00
alexey-milovidov
c1e8dd0ad6
Merge pull request #10492 from Felixoid/patch-2
Add link to clickhouse-plantuml
2020-04-25 15:57:20 +03:00
Alexey Milovidov
c75c2fac29 Fix visible drift of MemoryTracking metric 2020-04-25 15:36:01 +03:00
Azat Khuzhin
40c65f7bee IRowInputFormat: omit "Skipped 0 rows with errors while reading the input stream"
This will just pollute the output log.

And this is significant for kafka streaming, since it will print this
message for each message (due to how
ReadBufferFromKafkaConsumer/KafkaBlockInputStream works).

You can see this in the server log of the test_storage_kafka
(integration test), for the table with kafka_skip_broken_messages > 0,
it will have 52 lines of such message, 2 with "Skipped 1 rows" and 50
with "Skipped 0 rows" (since there are 52 messages in summary, 2
malformed and 50 correct).
2020-04-25 15:16:29 +03:00
Mikhail f. Shiryaev
97253eb4cf
Add link to clickhouse-plantuml 2020-04-25 12:05:59 +02:00
Eldar Zaitov
d7a037c26b split fuzzers and sanitizers 2020-04-25 10:12:38 +03:00
Azat Khuzhin
83ab91f1ad docs/kafka: use ATTACH TABLE over ATTACH MATERIALIZED VIEW (all langs)
Since later requires full specification (engine and so on).
2020-04-25 03:08:00 +03:00
Azat Khuzhin
747a74215f Avoid processing all batches before Distributed shutdown 2020-04-25 02:03:27 +03:00
Azat Khuzhin
8ad6b37913 Proper StorageDistributed shutdown to avoid UAF in DistributedMonitor
StorageDistributed::shutdown() does not acquire the lock, that controls
access to the cluster_nodes_data, thus it does not synced with the
requireDirectoryMonitor(), hence some monitors can be untracked that
will trigger UAF (use-after-free) after DROP TABLE dist:

This is for the SIGSEGV from the DirectoryMonitor (with already destroyed storage):
    0  0x0000000008e9f760 in std::__1::__cxx_atomic_load<int> (__order=std::__1::memory_order::seq_cst, __a=0x0)
    1  std::__1::__atomic_base<int, false>::load (__m=std::__1::memory_order::seq_cst, this=0x0) <-- this is nullptr
    2  std::__1::__atomic_base<int, false>::operator int (this=0x0)
    3  DB::ActionBlocker::isCancelled (this=0x7f85e31c9bb8) at ../src/Common/ActionBlocker.h:18
    4  DB::StorageDistributedDirectoryMonitor::run (this=0x7f85f93b2a00) at ../src/Storages/Distributed/DirectoryMonitor.cpp:140
2020-04-25 02:03:26 +03:00
alexey-milovidov
519751232e
Merge pull request #10490 from CurtizJ/fix-doc
Fix docs of 'generateRandom' function
2020-04-25 01:42:24 +03:00
Anton Popov
f937cf99a6 fix docs of 'generateRandom' function 2020-04-25 00:47:27 +03:00
Ivan Blinkov
77b9696193
Update README.md 2020-04-24 23:29:32 +03:00
tavplubix
7928f2eaa1
Merge pull request #7512 from ClickHouse/database_atomic
DatabaseAtomic
2020-04-24 22:28:18 +03:00
Alexander Tokmakov
04d4130b0d update yamake 2020-04-24 20:14:10 +03:00
Ivan Blinkov
8201693efe
Remove remnants of old MkDocs theme 2020-04-24 19:50:13 +03:00
Anton Popov
fa2385b26b
Merge pull request #10476 from ClickHouse/filimonov-docker-ca-certificates
add CA certificates to clickhouse-server docker image
2020-04-24 15:09:17 +03:00
Ivan Blinkov
886fb86ec2
Create 044_xeon_silver_4114.json (#10478) 2020-04-24 15:05:23 +03:00
Ivan Blinkov
388bcffec9
Rearrange includes at docs+changelog and move description templates (#10472)
* temp commit

* rearrange includes
2020-04-24 12:50:22 +03:00
filimonov
db689843e1
add CA certificates to clickhouse-docker image 2020-04-24 10:52:47 +02:00
alesapin
a2cb67c542
Merge pull request #10459 from ClickHouse/refactor_istorage
Remove virtuals from IStorage as separate column
2020-04-24 11:42:04 +03:00
Ivan Blinkov
f645a5beca
some non-breaking spaces 2020-04-24 10:52:07 +03:00
Ivan Blinkov
86d9eae195
restore lost word 2020-04-24 10:50:05 +03:00
alexey-milovidov
dfe55fc35c
Merge pull request #10456 from CurtizJ/no-backport-tag
Support 'no-backport' tags in list_backports script
2020-04-24 10:40:41 +03:00
alexey-milovidov
79d531af87
Merge pull request #10466 from ClickHouse/aku/arena-infinite-loop
Work around a bug leading to an infinite loop in addressToLine
2020-04-24 10:38:07 +03:00
alexey-milovidov
378107cd3f
Update ansi.md 2020-04-24 10:30:31 +03:00
Alexander Kuzmenkov
93e49ae10f performance comparison 2020-04-24 10:19:50 +03:00
Ivan Blinkov
3e8fc9478b
remove excessive css class 2020-04-24 10:04:47 +03:00
Ivan Blinkov
54e09dc20a
Draft of ANSI SQL compatibility article (#10457) 2020-04-24 10:02:44 +03:00
Alexander Kuzmenkov
79c5b7cc9f performance comparison 2020-04-24 06:23:38 +03:00
Anton Popov
a415540019 skip pr with no-backport 2020-04-24 03:36:37 +03:00
Alexander Kuzmenkov
2bedc82c18 Work around a bug leading to an infinite loop in addressToLine.
Fixing this is hopeless and would entail rewriting the entire
WriteBuffer thing, and also this hack is something we can backport.
2020-04-24 02:42:04 +03:00
tavplubix
7d6ab32eb6
Update DatabaseCatalog.cpp 2020-04-24 01:08:26 +03:00
Alexander Kuzmenkov
1bf02d459c performance comparison 2020-04-23 23:19:04 +03:00
Alexander Tokmakov
8be4d51111 fix build 2020-04-23 22:50:05 +03:00
Alexey Milovidov
2b569cf260 Added clarification in exception message #10405 2020-04-23 21:31:37 +03:00
Alexander Tokmakov
15e7ce0053 fixes 2020-04-23 21:00:43 +03:00
Alexander Tokmakov
f413061e0d remove Context from some IDatabase methods 2020-04-23 19:51:48 +03:00
alesapin
5ae25b68e4 Remove redundant virtual from function 2020-04-23 18:18:33 +03:00
alesapin
b0a73589b0 Remove virtual columns as separate field from IStorage 2020-04-23 18:09:00 +03:00
Alexander Tokmakov
04d6b59ac0 Merge branch 'master' into database_atomic 2020-04-23 17:31:37 +03:00
Anton Popov
8a084cc476
Update __main__.py 2020-04-23 16:47:19 +03:00
Anton Popov
26cf6306ac support 'no-backport' tags in list_backports script 2020-04-23 16:10:34 +03:00