Commit Graph

762 Commits

Author SHA1 Message Date
Sergey Tulentsev
f3195e10d0 use html entities for < / > in markdown tables 2022-04-21 13:40:25 +01:00
Sergey Tulentsev
ce4428d41e replace html entities (&lt; / &gt;) with < and > in code snippets 2022-04-21 13:32:07 +01:00
rfraposa
6576fd88c1 EOL fixes 2022-04-19 13:50:45 -06:00
rfraposa
fb08c5b7e1 Merge branch 'master' into docs-staging 2022-04-15 07:25:27 -06:00
Kruglov Pavel
fead4c184f
Merge pull request #35237 from olejeglejeg/patch-1
Kafka engine kafka_num_consumers prop upper bound doc update
2022-04-12 17:09:42 +02:00
rfraposa
d9e6f780db Fixed broken links 2022-04-10 23:01:34 -06:00
rfraposa
8f01fe9c49 Revised /en folder 2022-04-09 07:34:21 -06:00
rfraposa
5250d9ad11 Removed /ja folder, cleaned up /ru markdown 2022-04-09 07:29:05 -06:00
Alexey Milovidov
9854b55835
Revert "Format changes for new docs" 2022-04-04 02:05:35 +03:00
rfraposa
72a00e2c62 Fixed broken links 2022-04-02 17:38:54 -06:00
rfraposa
c33a6ced7b Fixed category links 2022-04-02 10:16:20 -06:00
rfraposa
c0a791a784 Fixing conflicts with source repo 2022-04-01 11:15:41 -06:00
rfraposa
560471f991 Update /sql-reference docs 2022-03-29 22:06:21 -06:00
rfraposa
00ddb72eea Update /engines docs 2022-03-29 17:43:34 -06:00
rfraposa
33e28bcb18 Updated /development folder 2022-03-29 08:26:35 -06:00
rfraposa
a5c7a947ad Merge branch 'master' of github.com:rfraposa/ClickHouse 2022-03-28 23:09:52 -06:00
rfraposa
c05bf7beb4 Testing new /en folder 2022-03-28 23:09:17 -06:00
taiyang-li
6a8bb34b41 update doc of hive 2022-03-24 17:17:25 +08:00
Kseniia Sumarokova
58a2d2b458
Merge pull request #35118 from zzsmdfj/issue/#31469_MaterializedMysql_mysqlDate2CkDate32
to #31469_MaterializedMysql_mysqlDate2CkDate32
2022-03-14 10:32:33 +01:00
rfraposa
ecbdfdea08 Incorporated feedback 2022-03-12 10:04:51 -06:00
Oleg Taizov
2ce6571968
kafka_num_consumers prop upper bound doc update
Add clarification about the upper bound of `kafka_num_consumers` property that was added in [#26640](https://github.com/ClickHouse/ClickHouse/pull/26642)
2022-03-12 11:09:12 +03:00
rfraposa
5a4466cec7 Update references in docs 2022-03-12 00:24:31 -06:00
Ivan Blinkov
d77da1f98f
[docs] update distributed.md (#35220)
* Update distributed.md

* Update distributed.md

* Update distributed.md

* Update distributed.md
2022-03-11 23:49:24 +03:00
Denny Crane
46bc88a5cb
Update custom-partitioning-key.md 2022-03-10 17:35:46 -04:00
zzsmdfj
00794fd4a4 to #31469_MaterializedMysql_mysqlDate2CkDate32-add MySQLDataTypesSupport setting 2022-03-09 15:58:43 +08:00
zzsmdfj
67b9f81104 to #31469_MaterializedMysql_mysqlDate2CkDate32 2022-03-08 18:17:22 +08:00
tavplubix
b7d4c78f13
Merge pull request #34487 from zzsmdfj/issue/32977_MaterializedMySQL_add_table_list_settings
MaterializedMySQL add materialized_mysql_tables_list settings
2022-03-03 12:44:51 +01:00
zzsmdfj
4d9bdfa58c to 32977_MaterializedMySQL_add_table_list_settings 2022-03-01 10:21:58 +08:00
Jakub Kuklis
dcdb95a898 Links to working configurations 2022-02-23 13:20:37 +00:00
Jakub Kuklis
f361696417 Add documentation for Azure Blob Storage choice as storage_policy for MergeTree 2022-02-23 12:39:08 +00:00
Xudong Zhang
9c4cc70dae update document: add _timestamp_ms of kafka 2022-02-19 23:49:37 +08:00
Maksim Kita
2cfe8578b7
Merge pull request #34321 from gauravphoenix/patch-2
reference to  distributed queries processing
2022-02-13 16:01:28 +01:00
Maksim Kita
bce821ae52
Update distributed.md 2022-02-13 15:17:20 +01:00
Maksim Kita
c4f1d7c40f
Update url.md 2022-02-13 14:38:43 +01:00
mergify[bot]
3d7bb71997
Merge branch 'master' into patch-2 2022-02-11 14:43:18 +00:00
mergify[bot]
f099048dd1
Merge branch 'master' into urlengine 2022-02-11 11:03:21 +00:00
Frank Chen
032c7ea758 Add description of compression in the doc 2022-02-11 17:46:33 +08:00
Denny Crane
80e1100813
Virtual Columns MergeTree engine 2022-02-10 10:45:27 -04:00
Gaurav Kumar
fc800bf191
reference to distributed queries processing
The reading section is missing important link to how distributed queries `in` queries are processed
2022-02-04 10:02:05 -08:00
Dmitry Novik
3a0ed0f8f5
Merge pull request #33324 from azat/buffer-different-structure
Simplify different block structure (i.e. after ALTER) support for Buffer
2022-02-01 02:19:49 +03:00
Mikhail f. Shiryaev
678dd6b3f2
Merge pull request #33596 from msaf1980/rollup_rules_type_doc
Update GraphiteMergeTree documentation (splitted GraphiteMergeTree rollup rules)
2022-01-31 22:06:51 +01:00
Mikhail f. Shiryaev
b4d26a4695
Add English documentation for GMT tagged rules 2022-01-31 14:22:12 +01:00
Azat Khuzhin
1fc29d704d Update documentation regardless ALTER for Buffer
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-01-28 11:07:57 +03:00
zzsmdfj
411f43ec4d to MaterializeMySQL_support_set_and_other_dataType 2022-01-21 12:24:12 +08:00
zzsmdfj
e380e59b16 MaterializeMySQL support SET YEAR TIME GEOMETRY dataType 2022-01-21 12:24:11 +08:00
zkun
bb9f9874af Update materialized-postgresql.md 2022-01-18 00:19:07 +08:00
taiyang-li
82a3024712 Merge remote-tracking branch 'ck/master' into bigo_hive_table 2022-01-13 18:11:23 +08:00
Kseniia Sumarokova
5d2324368f
Update mongodb.md 2022-01-13 09:37:57 +03:00
taiyang-li
66813a3aa9 merge master 2022-01-12 16:56:29 +08:00
kssenii
c94f4163f7 Merge remote-tracking branch 'upstream/master' into fix-materialized-postgresql-ddl-validation 2022-01-08 15:56:46 +03:00
freedomDR
af601f98d3 doc fix bloomfilter 2022-01-05 03:37:54 +00:00
李扬
2df2442ad0
Merge branch 'master' into hive_table 2022-01-04 01:26:16 -06:00
taiyang-li
1e102bc1b2 merge master 2022-01-01 09:01:06 +08:00
Ilya Yatsishin
f967bcdee9
Merge pull request #33143 from VitalyArt/patch-1 2021-12-31 21:28:40 +03:00
alesapin
9e83e5f7f4
Merge pull request #33121 from karnevil13/karnevil-DOCSUP-20367
DOCSUP-20367: Edit and translate to Russian (insert_quorum_parallel)
2021-12-29 13:31:36 +03:00
taiyang-li
9036b18c2f merge master 2021-12-27 15:12:48 +08:00
kssenii
9f17e7bad0 Fix ddl validation 2021-12-26 20:56:31 +03:00
Kseniia Sumarokova
495faad49f
Update materialized-postgresql.md 2021-12-26 10:20:43 +03:00
kssenii
c4db4309c2 Better 2021-12-25 21:47:16 +03:00
kssenii
688cffb8be Update postgres doc 2021-12-25 16:37:44 +03:00
Vitaly Artemyev
1772795d43
Fix for example request with settings 2021-12-24 18:28:29 +03:00
karnevil13
c5a22e6799
Merge branch 'master' into karnevil-DOCSUP-20367 2021-12-24 02:57:28 +03:00
karnevil13
c6f6630627 insert_quorum_parallel-EdTranRus 2021-12-24 02:28:39 +03:00
Kseniia Sumarokova
764bb1181f
Merge pull request #33017 from stigsb/table-overrides-drop-add-column-support
Remove the possibility of adding columns with table overrides
2021-12-22 22:30:21 +03:00
tavplubix
d8fb293d57
Merge pull request #32900 from zzsmdfj/issue/#15182_MaterializeMySQL_support_bit_type
Add support for BIT data type in MaterializedMySQL
2021-12-22 15:58:29 +03:00
Stig Bakken
1cc70ad524 Remove the possibility of adding columns with table overrides
(except ALIAS columns)

Supporting this properly requires more comprehensive changes.
2021-12-22 08:20:14 +01:00
taiyang-li
2597925724 merge master 2021-12-21 15:55:39 +08:00
mergify[bot]
c3a4e0ddcb
Merge branch 'master' into andrc1901-DOCSUP-18084 2021-12-20 13:00:43 +00:00
taiyang-li
d033fc4c24 merge master and fix conflict 2021-12-17 15:11:21 +08:00
zzsmdfj
e9eed1f927 to #15182_MaterializeMySQL_support_bit_type 2021-12-17 15:03:24 +08:00
alexey-milovidov
0e5cf9749a
Merge pull request #32852 from melvynator/patch-1
Update some broken links
2021-12-16 23:57:22 +03:00
Christoph Wurm
a65dd4824c Docs: Fix formatting in HDFS engine 2021-12-16 14:46:12 +00:00
Peignon Melvyn
d593f94d3c
Update some broken links
The links were linking to the page itself. The information probably has been moved to the SQL reference page.
2021-12-16 14:27:38 +01:00
Nikolay Degterinsky
b0330d8801
Merge pull request #32847 from cwurm/docs_distributed_sections
Docs: Fix list formatting in Distributed
2021-12-16 15:46:49 +03:00
Christoph Wurm
0b1b4fe9ad Fix list formatting in Distributed docs. 2021-12-16 12:31:28 +00:00
mergify[bot]
8ee8283395
Merge branch 'master' into andrc1901-DOCSUP-18084 2021-12-15 08:29:04 +00:00
taiyang-li
a0b90fa9ec fix bugs and add some docs 2021-12-14 18:44:15 +08:00
taiyang-li
8234d1176f merge master 2021-12-14 10:39:21 +08:00
Kseniia Sumarokova
a9ca84ff7d
Merge pull request #32325 from stigsb/table-overrides
Add TABLE OVERRIDE feature for MaterializedMySQL databases
2021-12-13 20:39:42 +03:00
Stig Bakken
ada16f6ebe Add warning about easily breaking replication 2021-12-13 11:35:41 +01:00
李扬
8675086104
Merge branch 'master' into hive_table 2021-12-12 09:01:46 -06:00
Andrei Ch
61a1eb2828 Update RabbitMQ 2021-12-12 00:21:05 +03:00
Christoph Wurm
3e5a6c8730 Add sections to Distributed documentation. 2021-12-10 18:29:15 +00:00
Stig Bakken
215865930f Add TABLE OVERRIDE docs 2021-12-10 11:44:16 +01:00
Peignon Melvyn
ee2655b704
Update mergetree.md
The link did not had the correct anchor
2021-12-06 12:46:19 +01:00
Kseniia Sumarokova
9093ad6596
Update materialized-postgresql.md 2021-12-03 09:27:22 +03:00
taiyang-li
2f4e7e1d4e merge master 2021-12-02 19:48:21 +08:00
Federico Ceratto
04a8730c91
Fix syntax error: drop comma 2021-12-01 20:12:10 +00:00
Vladimir C
37cd3b9aaa
Merge pull request #31608 from sevirov/sevirov-DOCSUP-14783-document_the_mysql_settings 2021-12-01 12:04:53 +03:00
Vladimir C
2214748afb
Apply suggestions from code review 2021-12-01 12:04:34 +03:00
kssenii
0e24eebc80 Merge branch 'master' of github.com:ClickHouse/ClickHouse into materialized-postgresql-fix 2021-11-30 12:26:10 +03:00
alexey-milovidov
b5f44de8f0
Merge pull request #31948 from ramazanpolat/patch-2
fix some broken links
2021-11-30 05:59:45 +03:00
Ramazan Polat
daed39d000
fix some broken links
max_insert_block_size and stream-flush-interval-ms links fixed.
2021-11-29 14:34:46 +03:00
Dmitriy
94d43d9520 Translate to Russian
Выполнил перевод на русский язык.
2021-11-25 19:59:14 +03:00
khamadiev
df23893f69
Update kafka.md
Updated See Also section, since number of kafka consumers controlled by background_message_broker_schedule_pool_size setting
2021-11-25 17:20:16 +05:00
taiyang-li
e8644807fe merge master and solve conflict 2021-11-19 15:01:58 +08:00
olgarev
1cd1677b0c
DOCSUP-14532: Support SETTINGS clause for S3 engine (#30982) 2021-11-16 16:25:12 +03:00
taiyang-li
26988ab757
Merge branch 'master' into hive_table 2021-11-10 11:01:03 +08:00
taiyang-li
c5bc968140 Merge remote-tracking branch 'ck/master' into bigo_hive_table 2021-11-08 18:38:14 +08:00
vdimir
b51d3d8ceb
Doc dynamically adding/deleting tables to MaterializedPostgreSQL and h3ToGeoBoundary function
Co-authored-by: Andrei Ch <andrc1901@yandex-team.ru>
Co-authored-by: Kseniia Sumarokova <54203879+kssenii@users.noreply.github.com>
2021-11-08 12:23:02 +03:00
Kseniia Sumarokova
eb546406de
Merge pull request #30954 from olgarev/revolg-DOCSUP-12852-argument_for_StorageMerge_supports_regular_expression
DOCSUP-12852: Database argument for Merge table engine supports regular expression
2021-11-08 09:34:08 +03:00
taiyang-li
36ca0b296b implement hive table engine 2021-11-05 19:55:30 +08:00
kssenii
26f6a697b5 Merge branch 'master' of github.com:ClickHouse/ClickHouse into materialized-postgresql-fix 2021-11-04 13:25:48 +03:00
olgarev
dd2698ed98 Possible values for db name 2021-11-02 14:29:20 +00:00
olgarev
da0f231a5f
Apply suggestions from code review
Co-authored-by: gyuton <40863448+gyuton@users.noreply.github.com>
2021-11-02 12:01:01 +03:00
Dmitriy
3b501ffb3e Translate to Russian
Выполнил перевод на русский язык.
2021-11-01 20:15:46 +03:00
olgarev
c17bf072fe Initial 2021-11-01 10:39:25 +00:00
Dmitriy
3e36edd5d2 Document the min_bytes_to_rebalance_partition_over_jbod setting
Задокументировал настройку min_bytes_to_rebalance_partition_over_jbod.
2021-10-29 21:35:11 +03:00
tavplubix
d7c69f6c02
Merge pull request #29202 from aiven/kmichel-replicated-database-alter-attach
Allow non-replicated ALTER TABLE FETCH/ATTACH in Replicated databases
2021-10-27 16:42:54 +03:00
alexey-milovidov
7023423f66
Merge pull request #28705 from gyuton/gyuton-DOCSUP-14093-Edit-and-translate-to-Russian
DOCSUP-14093: Edited and translated to Russian (external dicts)
2021-10-21 23:33:41 +03:00
João Figueiredo
360ec76c29
Grammar suggestions to distributed.md
* fixed some typos.
* improved wording of some statements.
2021-10-20 22:35:17 +02:00
michon470
3c8e963420
DOCSUP-15198: output_format_csv_null_representation setting translation (#29977)
* Перевод без изменений содержания

* в ру-версию добавлены ngrambf_v1 и tokenbf_v1

* Update mergetree.md

* Update docs/ru/operations/settings/settings.md

Co-authored-by: olgarev <56617294+olgarev@users.noreply.github.com>

* Update docs/ru/operations/settings/settings.md

Co-authored-by: olgarev <56617294+olgarev@users.noreply.github.com>

* Update docs/ru/operations/settings/settings.md

Co-authored-by: olgarev <56617294+olgarev@users.noreply.github.com>

* Update docs/ru/operations/settings/settings.md

Co-authored-by: olgarev <56617294+olgarev@users.noreply.github.com>

* Update docs/ru/operations/settings/settings.md

Co-authored-by: olgarev <56617294+olgarev@users.noreply.github.com>

* Update docs/ru/engines/table-engines/mergetree-family/mergetree.md

Co-authored-by: olgarev <56617294+olgarev@users.noreply.github.com>

* Update docs/ru/engines/table-engines/mergetree-family/mergetree.md

Co-authored-by: olgarev <56617294+olgarev@users.noreply.github.com>

* Update docs/ru/engines/table-engines/mergetree-family/mergetree.md

Co-authored-by: olgarev <56617294+olgarev@users.noreply.github.com>

* Corrections and translation

* in EN ver. lines 349-351 were included into the codeblock -- moved them to the proper place
* ...

Co-authored-by: olgarev <56617294+olgarev@users.noreply.github.com>
2021-10-18 15:40:26 +03:00
Nikita Mikhaylov
b17aba0e5b
Merge pull request #29793 from lehasm/alexey-sm-DOCSUP-14057-document-shardNum-shardCount
DOCSUP-14057-document-shardNum-shardCount
2021-10-12 19:15:34 +03:00
Denny Crane
f1791ddc44
explanation for volume/max_data_part_size_bytes 2021-10-11 15:49:30 -03:00
Alexey
2b272f5781 Virtual column in Distributed updated, link fixed, links added
Translated that part
2021-10-09 19:17:02 +00:00
Alexey
7f5852a711 New buildId variant
Links from Distributed
2021-10-09 18:37:28 +00:00
Kseniia Sumarokova
fbcb2b0624
Update materialized-postgresql.md 2021-10-03 20:20:16 +03:00
olgarev
68090f3074
Apply suggestions from code review 2021-10-03 18:19:39 +03:00
kssenii
e4d1d43a34 Fixes 2021-10-03 08:55:50 +00:00
olgarev
5f1def135a
Apply suggestions from code review
Co-authored-by: gyuton <40863448+gyuton@users.noreply.github.com>
2021-10-03 07:31:53 +03:00
kssenii
28aeb30d4a Support full schema list 2021-10-02 11:15:24 +00:00
kssenii
c601db109f Correct nerge 2021-10-02 08:39:15 +00:00
kssenii
3bc3a01f09 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into materialized-postgresql-fix 2021-10-01 15:53:27 +00:00
olgarev
6297bdc618 Example 2021-10-01 06:51:44 +00:00
olgarev
d3ab76771c Initial 2021-10-01 05:55:17 +00:00
Kevin Michel
045d4f2d32
Don't replicate DROP/DETACH/DROP DETACHED on Replicated database 2021-09-27 10:10:46 +02:00
Maksim Kita
d5a7e92b97 Bloom filter map added support for has function 2021-09-23 01:10:14 +03:00
Kevin Michel
008c3c812b
Allow non-replicated ALTER TABLE FETCH/ATTACH in Replicated databases
`ALTER TABLE ... FETCH` and `ALTER TABLE ... ATTACH` queries were
disabled in the Replicated database engine, because it could cause
accidental duplication of data.

This enables these queries but without replicating them.

In the case of `FETCH`, the part will only be fetched on the server
where the query is issued.

Similarly, in the case of `ATTACH`, the attached part only needs to
be available on the server where the query is issued.

If the table itself is using one of the Replicated MergeTree engines,
the attached data is then replicated by the table engine itself,
without intervention of the database engine.

This change is meant to help with live backup/restore when using the
Replicated database engine, using FREEZE for backup and ATTACH for
restore.
2021-09-21 17:45:23 +02:00
alesapin
a249dcc5f5
Merge pull request #28301 from kssenii/materialized-postgresql
MaterializedPostgreSQL: allow dynamically adding/deleting tables, altering settings
2021-09-20 14:16:29 +03:00
Ivan Blinkov
f429db1ee9 find . -type f -name '*.md'| xargs -I{} perl -pi -e 's|https://clickhouse.tech|https://clickhouse.com|g' {} 2021-09-19 23:05:54 +03:00
kssenii
710c8d12dd Merge branch 'master' of github.com:ClickHouse/ClickHouse into materialized-postgresql 2021-09-15 12:28:09 +03:00
alesapin
55a6769e19
Merge pull request #28488 from gyuton/gyuton-DOCSUP-10285-Document-the-ReplicatedMergeTree-settings
DOCSUP-10285: Documented the ReplicatedMergeTree settings
2021-09-13 10:12:50 +03:00
kssenii
fa933f6f8c Full support for non-default schema 2021-09-12 12:59:23 +00:00
Vladimir C
5b967d91ba
Merge pull request #28716 from olgarev/revolg-DOCSUP-13742-partitions_in_s3_table_function 2021-09-10 17:57:58 +03:00
kssenii
797f858bc6 Merge branch 'master' of github.com:ClickHouse/ClickHouse into materialized-postgresql 2021-09-08 22:52:48 +03:00
Olga Revyakina
cd038979d4 Initial (en) 2021-09-08 05:32:02 +03:00
George
3ce7331211 Edited and translated to Russian 2021-09-07 20:07:27 +03:00
Maksim Kita
7a4a0b0ede
Merge pull request #28474 from azat/mysql-connection_no_block
Introduce connection_wait_timeout for MySQL engine.
2021-09-07 12:28:02 +03:00
kssenii
d0113743c9 Merge branch 'master' of github.com:ClickHouse/ClickHouse into materialized-postgresql 2021-09-05 01:07:31 +03:00
kssenii
ac2d9a73a8 User managed slots 2021-09-04 14:49:40 +03:00
Kseniia Sumarokova
8c5acc371a
Merge pull request #28365 from kssenii/rabbitmq-ssl
Allow ssl connection for rabbitmq
2021-09-03 16:53:28 +03:00
kssenii
f17d1bc7a5 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into materialized-postgresql 2021-09-03 09:03:48 +00:00
Azat Khuzhin
ed70ed6f71 Introduce connection_no_wait setting for MySQL engine.
This will allow to avoid superfluous sleep during query execution, since
this not only not desired behavoiur, but also may hang the server, since
if you will execute enough queries that will use MySQL database but will
not allow enough connections (or your MySQL server is too slow) then you
may run out of threads in the global thread pool.

Also note that right now it is possible to get deadlock when the mysql
pool is full, consider the following scenario:

- you have m1 and m2 mysql tables
- you have q1 and q2 queries, bot queries join m1 and m2
- q1 allocated connection for m1 but cannot allocate connection for m2
- q2 allocated connection for m2 but cannot allocate connection for m1
- but to resolve the lock one should give up on the locking while it is not possible right now...

And then you got no free threads and this:

    # grep -h ^202 /proc/$(pgrep clickhouse-serv)/task/*/syscall  | cut -d' ' -f2 | sort | uniq -c | sort -nr | head
       1554 0x7ffb60b92fe8 # mutex in mysqlxx::PoolWithFailover::get
       1375 0x7ffb9f1c4748 # mutex in ::PoolEntryHelper::~PoolEntryHelper from DB::MultiplexedConnections::invalidateReplica
       1160 0x7ffb612918b8 # mutex in mysqlxx::PoolWithFailover::get
         42 0x7ffb9f057984 # mutex in ThreadPoolImpl<std::__1::thread>::worker

    *NOTE: 202 is a `futex` with WAIT*

(Went with `syscall` because debugging 10k+ threads is not easy, and
eventually it may TRAP)
2021-09-02 22:23:37 +03:00
George
c4839e28d3 Added documentation 2021-09-02 03:48:47 +03:00
alexey-milovidov
ff0b332c24
Update custom-partitioning-key.md 2021-09-01 20:53:06 +03:00
alexey-milovidov
4699386470
Update mergetree.md 2021-09-01 20:52:05 +03:00
kssenii
335b6f12fd Fix 2021-08-30 20:59:03 +03:00
kssenii
378e1f74aa Fix tests 2021-08-28 19:51:04 +03:00
kssenii
cc90d787f8 Slightly better 2021-08-28 17:45:15 +03:00
Zhichang Yu
ef1994f420 set env LIBHDFS3_CONF, refers to ClickHouse#8159 2021-08-28 09:16:48 +08:00