Commit Graph

653 Commits

Author SHA1 Message Date
kssenii
688cffb8be Update postgres doc 2021-12-25 16:37:44 +03:00
Vitaly Artemyev
1772795d43
Fix for example request with settings 2021-12-24 18:28:29 +03:00
karnevil13
c5a22e6799
Merge branch 'master' into karnevil-DOCSUP-20367 2021-12-24 02:57:28 +03:00
karnevil13
c6f6630627 insert_quorum_parallel-EdTranRus 2021-12-24 02:28:39 +03:00
Kseniia Sumarokova
764bb1181f
Merge pull request #33017 from stigsb/table-overrides-drop-add-column-support
Remove the possibility of adding columns with table overrides
2021-12-22 22:30:21 +03:00
tavplubix
d8fb293d57
Merge pull request #32900 from zzsmdfj/issue/#15182_MaterializeMySQL_support_bit_type
Add support for BIT data type in MaterializedMySQL
2021-12-22 15:58:29 +03:00
Stig Bakken
1cc70ad524 Remove the possibility of adding columns with table overrides
(except ALIAS columns)

Supporting this properly requires more comprehensive changes.
2021-12-22 08:20:14 +01:00
taiyang-li
2597925724 merge master 2021-12-21 15:55:39 +08:00
mergify[bot]
c3a4e0ddcb
Merge branch 'master' into andrc1901-DOCSUP-18084 2021-12-20 13:00:43 +00:00
taiyang-li
d033fc4c24 merge master and fix conflict 2021-12-17 15:11:21 +08:00
zzsmdfj
e9eed1f927 to #15182_MaterializeMySQL_support_bit_type 2021-12-17 15:03:24 +08:00
alexey-milovidov
0e5cf9749a
Merge pull request #32852 from melvynator/patch-1
Update some broken links
2021-12-16 23:57:22 +03:00
Christoph Wurm
a65dd4824c Docs: Fix formatting in HDFS engine 2021-12-16 14:46:12 +00:00
Peignon Melvyn
d593f94d3c
Update some broken links
The links were linking to the page itself. The information probably has been moved to the SQL reference page.
2021-12-16 14:27:38 +01:00
Nikolay Degterinsky
b0330d8801
Merge pull request #32847 from cwurm/docs_distributed_sections
Docs: Fix list formatting in Distributed
2021-12-16 15:46:49 +03:00
Christoph Wurm
0b1b4fe9ad Fix list formatting in Distributed docs. 2021-12-16 12:31:28 +00:00
mergify[bot]
8ee8283395
Merge branch 'master' into andrc1901-DOCSUP-18084 2021-12-15 08:29:04 +00:00
taiyang-li
a0b90fa9ec fix bugs and add some docs 2021-12-14 18:44:15 +08:00
taiyang-li
8234d1176f merge master 2021-12-14 10:39:21 +08:00
Kseniia Sumarokova
a9ca84ff7d
Merge pull request #32325 from stigsb/table-overrides
Add TABLE OVERRIDE feature for MaterializedMySQL databases
2021-12-13 20:39:42 +03:00
Stig Bakken
ada16f6ebe Add warning about easily breaking replication 2021-12-13 11:35:41 +01:00
李扬
8675086104
Merge branch 'master' into hive_table 2021-12-12 09:01:46 -06:00
Andrei Ch
61a1eb2828 Update RabbitMQ 2021-12-12 00:21:05 +03:00
Christoph Wurm
3e5a6c8730 Add sections to Distributed documentation. 2021-12-10 18:29:15 +00:00
Stig Bakken
215865930f Add TABLE OVERRIDE docs 2021-12-10 11:44:16 +01:00
Peignon Melvyn
ee2655b704
Update mergetree.md
The link did not had the correct anchor
2021-12-06 12:46:19 +01:00
Kseniia Sumarokova
9093ad6596
Update materialized-postgresql.md 2021-12-03 09:27:22 +03:00
taiyang-li
2f4e7e1d4e merge master 2021-12-02 19:48:21 +08:00
Federico Ceratto
04a8730c91
Fix syntax error: drop comma 2021-12-01 20:12:10 +00:00
Vladimir C
37cd3b9aaa
Merge pull request #31608 from sevirov/sevirov-DOCSUP-14783-document_the_mysql_settings 2021-12-01 12:04:53 +03:00
Vladimir C
2214748afb
Apply suggestions from code review 2021-12-01 12:04:34 +03:00
kssenii
0e24eebc80 Merge branch 'master' of github.com:ClickHouse/ClickHouse into materialized-postgresql-fix 2021-11-30 12:26:10 +03:00
alexey-milovidov
b5f44de8f0
Merge pull request #31948 from ramazanpolat/patch-2
fix some broken links
2021-11-30 05:59:45 +03:00
Ramazan Polat
daed39d000
fix some broken links
max_insert_block_size and stream-flush-interval-ms links fixed.
2021-11-29 14:34:46 +03:00
Dmitriy
94d43d9520 Translate to Russian
Выполнил перевод на русский язык.
2021-11-25 19:59:14 +03:00
khamadiev
df23893f69
Update kafka.md
Updated See Also section, since number of kafka consumers controlled by background_message_broker_schedule_pool_size setting
2021-11-25 17:20:16 +05:00
taiyang-li
e8644807fe merge master and solve conflict 2021-11-19 15:01:58 +08:00
olgarev
1cd1677b0c
DOCSUP-14532: Support SETTINGS clause for S3 engine (#30982) 2021-11-16 16:25:12 +03:00
taiyang-li
26988ab757
Merge branch 'master' into hive_table 2021-11-10 11:01:03 +08:00
taiyang-li
c5bc968140 Merge remote-tracking branch 'ck/master' into bigo_hive_table 2021-11-08 18:38:14 +08:00
vdimir
b51d3d8ceb
Doc dynamically adding/deleting tables to MaterializedPostgreSQL and h3ToGeoBoundary function
Co-authored-by: Andrei Ch <andrc1901@yandex-team.ru>
Co-authored-by: Kseniia Sumarokova <54203879+kssenii@users.noreply.github.com>
2021-11-08 12:23:02 +03:00
Kseniia Sumarokova
eb546406de
Merge pull request #30954 from olgarev/revolg-DOCSUP-12852-argument_for_StorageMerge_supports_regular_expression
DOCSUP-12852: Database argument for Merge table engine supports regular expression
2021-11-08 09:34:08 +03:00
taiyang-li
36ca0b296b implement hive table engine 2021-11-05 19:55:30 +08:00
kssenii
26f6a697b5 Merge branch 'master' of github.com:ClickHouse/ClickHouse into materialized-postgresql-fix 2021-11-04 13:25:48 +03:00
olgarev
dd2698ed98 Possible values for db name 2021-11-02 14:29:20 +00:00
olgarev
da0f231a5f
Apply suggestions from code review
Co-authored-by: gyuton <40863448+gyuton@users.noreply.github.com>
2021-11-02 12:01:01 +03:00
Dmitriy
3b501ffb3e Translate to Russian
Выполнил перевод на русский язык.
2021-11-01 20:15:46 +03:00
olgarev
c17bf072fe Initial 2021-11-01 10:39:25 +00:00
Dmitriy
3e36edd5d2 Document the min_bytes_to_rebalance_partition_over_jbod setting
Задокументировал настройку min_bytes_to_rebalance_partition_over_jbod.
2021-10-29 21:35:11 +03:00
tavplubix
d7c69f6c02
Merge pull request #29202 from aiven/kmichel-replicated-database-alter-attach
Allow non-replicated ALTER TABLE FETCH/ATTACH in Replicated databases
2021-10-27 16:42:54 +03:00
alexey-milovidov
7023423f66
Merge pull request #28705 from gyuton/gyuton-DOCSUP-14093-Edit-and-translate-to-Russian
DOCSUP-14093: Edited and translated to Russian (external dicts)
2021-10-21 23:33:41 +03:00
João Figueiredo
360ec76c29
Grammar suggestions to distributed.md
* fixed some typos.
* improved wording of some statements.
2021-10-20 22:35:17 +02:00
michon470
3c8e963420
DOCSUP-15198: output_format_csv_null_representation setting translation (#29977)
* Перевод без изменений содержания

* в ру-версию добавлены ngrambf_v1 и tokenbf_v1

* Update mergetree.md

* Update docs/ru/operations/settings/settings.md

Co-authored-by: olgarev <56617294+olgarev@users.noreply.github.com>

* Update docs/ru/operations/settings/settings.md

Co-authored-by: olgarev <56617294+olgarev@users.noreply.github.com>

* Update docs/ru/operations/settings/settings.md

Co-authored-by: olgarev <56617294+olgarev@users.noreply.github.com>

* Update docs/ru/operations/settings/settings.md

Co-authored-by: olgarev <56617294+olgarev@users.noreply.github.com>

* Update docs/ru/operations/settings/settings.md

Co-authored-by: olgarev <56617294+olgarev@users.noreply.github.com>

* Update docs/ru/engines/table-engines/mergetree-family/mergetree.md

Co-authored-by: olgarev <56617294+olgarev@users.noreply.github.com>

* Update docs/ru/engines/table-engines/mergetree-family/mergetree.md

Co-authored-by: olgarev <56617294+olgarev@users.noreply.github.com>

* Update docs/ru/engines/table-engines/mergetree-family/mergetree.md

Co-authored-by: olgarev <56617294+olgarev@users.noreply.github.com>

* Corrections and translation

* in EN ver. lines 349-351 were included into the codeblock -- moved them to the proper place
* ...

Co-authored-by: olgarev <56617294+olgarev@users.noreply.github.com>
2021-10-18 15:40:26 +03:00
Nikita Mikhaylov
b17aba0e5b
Merge pull request #29793 from lehasm/alexey-sm-DOCSUP-14057-document-shardNum-shardCount
DOCSUP-14057-document-shardNum-shardCount
2021-10-12 19:15:34 +03:00
Denny Crane
f1791ddc44
explanation for volume/max_data_part_size_bytes 2021-10-11 15:49:30 -03:00
Alexey
2b272f5781 Virtual column in Distributed updated, link fixed, links added
Translated that part
2021-10-09 19:17:02 +00:00
Alexey
7f5852a711 New buildId variant
Links from Distributed
2021-10-09 18:37:28 +00:00
Kseniia Sumarokova
fbcb2b0624
Update materialized-postgresql.md 2021-10-03 20:20:16 +03:00
olgarev
68090f3074
Apply suggestions from code review 2021-10-03 18:19:39 +03:00
kssenii
e4d1d43a34 Fixes 2021-10-03 08:55:50 +00:00
olgarev
5f1def135a
Apply suggestions from code review
Co-authored-by: gyuton <40863448+gyuton@users.noreply.github.com>
2021-10-03 07:31:53 +03:00
kssenii
28aeb30d4a Support full schema list 2021-10-02 11:15:24 +00:00
kssenii
c601db109f Correct nerge 2021-10-02 08:39:15 +00:00
kssenii
3bc3a01f09 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into materialized-postgresql-fix 2021-10-01 15:53:27 +00:00
olgarev
6297bdc618 Example 2021-10-01 06:51:44 +00:00
olgarev
d3ab76771c Initial 2021-10-01 05:55:17 +00:00
Kevin Michel
045d4f2d32
Don't replicate DROP/DETACH/DROP DETACHED on Replicated database 2021-09-27 10:10:46 +02:00
Maksim Kita
d5a7e92b97 Bloom filter map added support for has function 2021-09-23 01:10:14 +03:00
Kevin Michel
008c3c812b
Allow non-replicated ALTER TABLE FETCH/ATTACH in Replicated databases
`ALTER TABLE ... FETCH` and `ALTER TABLE ... ATTACH` queries were
disabled in the Replicated database engine, because it could cause
accidental duplication of data.

This enables these queries but without replicating them.

In the case of `FETCH`, the part will only be fetched on the server
where the query is issued.

Similarly, in the case of `ATTACH`, the attached part only needs to
be available on the server where the query is issued.

If the table itself is using one of the Replicated MergeTree engines,
the attached data is then replicated by the table engine itself,
without intervention of the database engine.

This change is meant to help with live backup/restore when using the
Replicated database engine, using FREEZE for backup and ATTACH for
restore.
2021-09-21 17:45:23 +02:00
alesapin
a249dcc5f5
Merge pull request #28301 from kssenii/materialized-postgresql
MaterializedPostgreSQL: allow dynamically adding/deleting tables, altering settings
2021-09-20 14:16:29 +03:00
Ivan Blinkov
f429db1ee9 find . -type f -name '*.md'| xargs -I{} perl -pi -e 's|https://clickhouse.tech|https://clickhouse.com|g' {} 2021-09-19 23:05:54 +03:00
kssenii
710c8d12dd Merge branch 'master' of github.com:ClickHouse/ClickHouse into materialized-postgresql 2021-09-15 12:28:09 +03:00
alesapin
55a6769e19
Merge pull request #28488 from gyuton/gyuton-DOCSUP-10285-Document-the-ReplicatedMergeTree-settings
DOCSUP-10285: Documented the ReplicatedMergeTree settings
2021-09-13 10:12:50 +03:00
kssenii
fa933f6f8c Full support for non-default schema 2021-09-12 12:59:23 +00:00
Vladimir C
5b967d91ba
Merge pull request #28716 from olgarev/revolg-DOCSUP-13742-partitions_in_s3_table_function 2021-09-10 17:57:58 +03:00
kssenii
797f858bc6 Merge branch 'master' of github.com:ClickHouse/ClickHouse into materialized-postgresql 2021-09-08 22:52:48 +03:00
Olga Revyakina
cd038979d4 Initial (en) 2021-09-08 05:32:02 +03:00
George
3ce7331211 Edited and translated to Russian 2021-09-07 20:07:27 +03:00
Maksim Kita
7a4a0b0ede
Merge pull request #28474 from azat/mysql-connection_no_block
Introduce connection_wait_timeout for MySQL engine.
2021-09-07 12:28:02 +03:00
kssenii
d0113743c9 Merge branch 'master' of github.com:ClickHouse/ClickHouse into materialized-postgresql 2021-09-05 01:07:31 +03:00
kssenii
ac2d9a73a8 User managed slots 2021-09-04 14:49:40 +03:00
Kseniia Sumarokova
8c5acc371a
Merge pull request #28365 from kssenii/rabbitmq-ssl
Allow ssl connection for rabbitmq
2021-09-03 16:53:28 +03:00
kssenii
f17d1bc7a5 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into materialized-postgresql 2021-09-03 09:03:48 +00:00
Azat Khuzhin
ed70ed6f71 Introduce connection_no_wait setting for MySQL engine.
This will allow to avoid superfluous sleep during query execution, since
this not only not desired behavoiur, but also may hang the server, since
if you will execute enough queries that will use MySQL database but will
not allow enough connections (or your MySQL server is too slow) then you
may run out of threads in the global thread pool.

Also note that right now it is possible to get deadlock when the mysql
pool is full, consider the following scenario:

- you have m1 and m2 mysql tables
- you have q1 and q2 queries, bot queries join m1 and m2
- q1 allocated connection for m1 but cannot allocate connection for m2
- q2 allocated connection for m2 but cannot allocate connection for m1
- but to resolve the lock one should give up on the locking while it is not possible right now...

And then you got no free threads and this:

    # grep -h ^202 /proc/$(pgrep clickhouse-serv)/task/*/syscall  | cut -d' ' -f2 | sort | uniq -c | sort -nr | head
       1554 0x7ffb60b92fe8 # mutex in mysqlxx::PoolWithFailover::get
       1375 0x7ffb9f1c4748 # mutex in ::PoolEntryHelper::~PoolEntryHelper from DB::MultiplexedConnections::invalidateReplica
       1160 0x7ffb612918b8 # mutex in mysqlxx::PoolWithFailover::get
         42 0x7ffb9f057984 # mutex in ThreadPoolImpl<std::__1::thread>::worker

    *NOTE: 202 is a `futex` with WAIT*

(Went with `syscall` because debugging 10k+ threads is not easy, and
eventually it may TRAP)
2021-09-02 22:23:37 +03:00
George
c4839e28d3 Added documentation 2021-09-02 03:48:47 +03:00
alexey-milovidov
ff0b332c24
Update custom-partitioning-key.md 2021-09-01 20:53:06 +03:00
alexey-milovidov
4699386470
Update mergetree.md 2021-09-01 20:52:05 +03:00
kssenii
335b6f12fd Fix 2021-08-30 20:59:03 +03:00
kssenii
378e1f74aa Fix tests 2021-08-28 19:51:04 +03:00
kssenii
cc90d787f8 Slightly better 2021-08-28 17:45:15 +03:00
Zhichang Yu
ef1994f420 set env LIBHDFS3_CONF, refers to ClickHouse#8159 2021-08-28 09:16:48 +08:00
Kseniia Sumarokova
31afd7d09c
Merge pull request #28081 from kssenii/pg-conflict
Support `on conflict` for postgres engine
2021-08-26 16:30:30 +03:00
Nikolai Kochetov
11d79ec24f
Merge pull request #27725 from olgarev/revolg-DOCSUP-12894-projections_translated
DOCSUP-12894: Projections settings
2021-08-26 11:26:58 +03:00
olgarev
89a4ca27ae
Apply suggestions from code review
Co-authored-by: Alexey Boykov <33257111+mathalex@users.noreply.github.com>
2021-08-25 15:15:39 +03:00
kssenii
0ec716292c Postgres ON CONFLICT 2021-08-24 12:37:32 +00:00
Kruglov Pavel
86f89af4d2
Merge pull request #28077 from Avogar/fix-typo-in-docks
Fix typo in docs
2021-08-24 13:50:52 +03:00
Pavel Kruglov
f31b67238d Fix typo 2021-08-24 13:49:59 +03:00
alesapin
80085bd988
Merge pull request #27989 from olgarev/revolg-DOCSUP-13334-Recompression_TTL
DOCSUP-13334: Recompression TTL and Settings
2021-08-24 10:14:45 +03:00
olgarev
2aaa5eb584 Removed 2021-08-23 14:31:42 +00:00
olgarev
7d8436e690
Update docs/en/engines/table-engines/mergetree-family/mergetree.md
Co-authored-by: alesapin <alesapin@gmail.com>
2021-08-23 17:14:30 +03:00