Commit Graph

316 Commits

Author SHA1 Message Date
DanRoscigno
5cde7762ad WIP 2023-01-05 15:54:44 -05:00
Kruglov Pavel
c5b2e4cc23
Merge branch 'master' into improve-streaming-engines 2022-12-15 18:44:35 +01:00
Sergei Trifonov
f2f0676bcc
Revert "Revert "S3 request per second rate throttling"" 2022-11-17 17:35:04 +01:00
Alexander Tokmakov
9011a18234
Revert "S3 request per second rate throttling" 2022-11-16 22:33:48 +03:00
Sergei Trifonov
159743edd6
Merge pull request #43014 from ClickHouse/disk-s3-throttler
S3 request per second rate throttling
2022-11-16 18:51:06 +01:00
serxa
7448d1bb5d add docs 2022-11-09 14:58:41 +00:00
DanRoscigno
34f90ff6ef update pages that refer to dictionaries 2022-11-07 09:26:50 -05:00
Kruglov Pavel
b124875257
Merge branch 'master' into improve-streaming-engines 2022-11-03 13:22:06 +01:00
Alexander Yakovlev
70eaf69df1
Fix a typo in table-engines/integrations/s3.md 2022-11-01 02:57:55 +03:00
avogar
8e13d1f1ec Improve and refactor Kafka/StorageMQ/NATS and data formats 2022-10-28 16:41:10 +00:00
Lloyd-Pottiger
5a6b2106b5 Merge branch 'master' of github.com:ClickHouse/ClickHouse into feat/support-read-only-for-embeddedrocksdb 2022-09-02 18:10:00 +08:00
Lloyd-Pottiger
59dccd6e49 fix test
Signed-off-by: Lloyd-Pottiger <yan1579196623@gamil.com>
2022-09-02 11:14:49 +08:00
DanRoscigno
c4b8137d31 replace symlinks 2022-08-29 12:19:50 -04:00
DanRoscigno
5b5fcc56aa add slugs 2022-08-28 10:53:34 -04:00
Lloyd-Pottiger
ac3cf0beb4 add read_only option
Signed-off-by: Lloyd-Pottiger <yan1579196623@gamil.com>
2022-08-23 20:58:57 +08:00
Antonio Andelic
0765495be1
Merge pull request #39986 from Lloyd-Pottiger/feat/support-ttl-for-embeddedrocksdb
Support TTL for EmbeddedRocksDB
2022-08-23 08:27:47 +02:00
Lloyd-Pottiger
85a1a36167 remove read_only option
Signed-off-by: Lloyd-Pottiger <yan1579196623@gamil.com>
2022-08-22 23:31:55 +08:00
DanRoscigno
23b054617e update for setting change 2022-08-18 16:05:44 -04:00
Lloyd-Pottiger
c5d81e160c add functionality test
Signed-off-by: Lloyd-Pottiger <yan1579196623@gamil.com>
2022-08-10 23:10:52 +08:00
Lloyd-Pottiger
5488a392ab address comments
Signed-off-by: Lloyd-Pottiger <yan1579196623@gamil.com>
2022-08-10 21:20:25 +08:00
Lloyd-Pottiger
7ecaf58981 revise docs
Signed-off-by: Lloyd-Pottiger <yan1579196623@gamil.com>
2022-08-09 21:48:49 +08:00
Dan Roscigno
2a6765ce8c
Merge pull request #38603 from den-crane/patch-17
Doc. More settings / mysql
2022-07-06 15:24:13 -04:00
Kseniia Sumarokova
6c3d648f49
Merge branch 'master' into nats-integration 2022-07-04 21:06:07 +02:00
Denny Crane
394a15a792
Update mysql.md 2022-06-29 16:52:32 -03:00
Yakov Olkhovskiy
d5f65ece9b
Merge pull request #38105 from arenadata/ADQM-419
Add kerberosInit function as a replacement for kinit executable calls in Kafka and HDFS
2022-06-27 14:19:24 -04:00
Roman Vasin
3cfea6e76f Cleanup code in KerberosInit, HDFSCommon and StorageKafka; update English and Russian documentation. 2022-06-08 17:57:45 +03:00
rfraposa
869967de41 Remove H1 anchor tags from docs 2022-06-02 04:55:18 -06:00
tchepavel
87217ce6cc NATS. Add new setting to doc; clean up code. 2022-05-23 14:57:39 +03:00
tchepavel
a3af94d49e Documentation; integration tests; subscribe on startup 2022-05-17 16:58:09 +03:00
Mark Andreev
ebb9694920
Add Kafka headers virtual columns
Add documentation for https://github.com/ClickHouse/ClickHouse/pull/11283
2022-05-11 18:38:09 +04:00
rfraposa
e7b7b7ecd3 Various docs fixes 2022-04-29 05:33:51 -06:00
rfraposa
fb08c5b7e1 Merge branch 'master' into docs-staging 2022-04-15 07:25:27 -06:00
Kruglov Pavel
fead4c184f
Merge pull request #35237 from olejeglejeg/patch-1
Kafka engine kafka_num_consumers prop upper bound doc update
2022-04-12 17:09:42 +02:00
rfraposa
8f01fe9c49 Revised /en folder 2022-04-09 07:34:21 -06:00
rfraposa
5250d9ad11 Removed /ja folder, cleaned up /ru markdown 2022-04-09 07:29:05 -06:00
Alexey Milovidov
9854b55835
Revert "Format changes for new docs" 2022-04-04 02:05:35 +03:00
rfraposa
72a00e2c62 Fixed broken links 2022-04-02 17:38:54 -06:00
rfraposa
00ddb72eea Update /engines docs 2022-03-29 17:43:34 -06:00
rfraposa
33e28bcb18 Updated /development folder 2022-03-29 08:26:35 -06:00
taiyang-li
6a8bb34b41 update doc of hive 2022-03-24 17:17:25 +08:00
rfraposa
ecbdfdea08 Incorporated feedback 2022-03-12 10:04:51 -06:00
Oleg Taizov
2ce6571968
kafka_num_consumers prop upper bound doc update
Add clarification about the upper bound of `kafka_num_consumers` property that was added in [#26640](https://github.com/ClickHouse/ClickHouse/pull/26642)
2022-03-12 11:09:12 +03:00
rfraposa
5a4466cec7 Update references in docs 2022-03-12 00:24:31 -06:00
Xudong Zhang
9c4cc70dae update document: add _timestamp_ms of kafka 2022-02-19 23:49:37 +08:00
taiyang-li
82a3024712 Merge remote-tracking branch 'ck/master' into bigo_hive_table 2022-01-13 18:11:23 +08:00
Kseniia Sumarokova
5d2324368f
Update mongodb.md 2022-01-13 09:37:57 +03:00
taiyang-li
1e102bc1b2 merge master 2022-01-01 09:01:06 +08:00
alesapin
9e83e5f7f4
Merge pull request #33121 from karnevil13/karnevil-DOCSUP-20367
DOCSUP-20367: Edit and translate to Russian (insert_quorum_parallel)
2021-12-29 13:31:36 +03:00
taiyang-li
9036b18c2f merge master 2021-12-27 15:12:48 +08:00
kssenii
688cffb8be Update postgres doc 2021-12-25 16:37:44 +03:00
karnevil13
c5a22e6799
Merge branch 'master' into karnevil-DOCSUP-20367 2021-12-24 02:57:28 +03:00
karnevil13
c6f6630627 insert_quorum_parallel-EdTranRus 2021-12-24 02:28:39 +03:00
taiyang-li
2597925724 merge master 2021-12-21 15:55:39 +08:00
mergify[bot]
c3a4e0ddcb
Merge branch 'master' into andrc1901-DOCSUP-18084 2021-12-20 13:00:43 +00:00
taiyang-li
d033fc4c24 merge master and fix conflict 2021-12-17 15:11:21 +08:00
Christoph Wurm
a65dd4824c Docs: Fix formatting in HDFS engine 2021-12-16 14:46:12 +00:00
taiyang-li
a0b90fa9ec fix bugs and add some docs 2021-12-14 18:44:15 +08:00
Andrei Ch
61a1eb2828 Update RabbitMQ 2021-12-12 00:21:05 +03:00
taiyang-li
2f4e7e1d4e merge master 2021-12-02 19:48:21 +08:00
Federico Ceratto
04a8730c91
Fix syntax error: drop comma 2021-12-01 20:12:10 +00:00
Vladimir C
37cd3b9aaa
Merge pull request #31608 from sevirov/sevirov-DOCSUP-14783-document_the_mysql_settings 2021-12-01 12:04:53 +03:00
Vladimir C
2214748afb
Apply suggestions from code review 2021-12-01 12:04:34 +03:00
alexey-milovidov
b5f44de8f0
Merge pull request #31948 from ramazanpolat/patch-2
fix some broken links
2021-11-30 05:59:45 +03:00
Ramazan Polat
daed39d000
fix some broken links
max_insert_block_size and stream-flush-interval-ms links fixed.
2021-11-29 14:34:46 +03:00
Dmitriy
94d43d9520 Translate to Russian
Выполнил перевод на русский язык.
2021-11-25 19:59:14 +03:00
khamadiev
df23893f69
Update kafka.md
Updated See Also section, since number of kafka consumers controlled by background_message_broker_schedule_pool_size setting
2021-11-25 17:20:16 +05:00
taiyang-li
e8644807fe merge master and solve conflict 2021-11-19 15:01:58 +08:00
olgarev
1cd1677b0c
DOCSUP-14532: Support SETTINGS clause for S3 engine (#30982) 2021-11-16 16:25:12 +03:00
taiyang-li
36ca0b296b implement hive table engine 2021-11-05 19:55:30 +08:00
alexey-milovidov
7023423f66
Merge pull request #28705 from gyuton/gyuton-DOCSUP-14093-Edit-and-translate-to-Russian
DOCSUP-14093: Edited and translated to Russian (external dicts)
2021-10-21 23:33:41 +03:00
Ivan Blinkov
f429db1ee9 find . -type f -name '*.md'| xargs -I{} perl -pi -e 's|https://clickhouse.tech|https://clickhouse.com|g' {} 2021-09-19 23:05:54 +03:00
Vladimir C
5b967d91ba
Merge pull request #28716 from olgarev/revolg-DOCSUP-13742-partitions_in_s3_table_function 2021-09-10 17:57:58 +03:00
Olga Revyakina
cd038979d4 Initial (en) 2021-09-08 05:32:02 +03:00
George
3ce7331211 Edited and translated to Russian 2021-09-07 20:07:27 +03:00
Maksim Kita
7a4a0b0ede
Merge pull request #28474 from azat/mysql-connection_no_block
Introduce connection_wait_timeout for MySQL engine.
2021-09-07 12:28:02 +03:00
Azat Khuzhin
ed70ed6f71 Introduce connection_no_wait setting for MySQL engine.
This will allow to avoid superfluous sleep during query execution, since
this not only not desired behavoiur, but also may hang the server, since
if you will execute enough queries that will use MySQL database but will
not allow enough connections (or your MySQL server is too slow) then you
may run out of threads in the global thread pool.

Also note that right now it is possible to get deadlock when the mysql
pool is full, consider the following scenario:

- you have m1 and m2 mysql tables
- you have q1 and q2 queries, bot queries join m1 and m2
- q1 allocated connection for m1 but cannot allocate connection for m2
- q2 allocated connection for m2 but cannot allocate connection for m1
- but to resolve the lock one should give up on the locking while it is not possible right now...

And then you got no free threads and this:

    # grep -h ^202 /proc/$(pgrep clickhouse-serv)/task/*/syscall  | cut -d' ' -f2 | sort | uniq -c | sort -nr | head
       1554 0x7ffb60b92fe8 # mutex in mysqlxx::PoolWithFailover::get
       1375 0x7ffb9f1c4748 # mutex in ::PoolEntryHelper::~PoolEntryHelper from DB::MultiplexedConnections::invalidateReplica
       1160 0x7ffb612918b8 # mutex in mysqlxx::PoolWithFailover::get
         42 0x7ffb9f057984 # mutex in ThreadPoolImpl<std::__1::thread>::worker

    *NOTE: 202 is a `futex` with WAIT*

(Went with `syscall` because debugging 10k+ threads is not easy, and
eventually it may TRAP)
2021-09-02 22:23:37 +03:00
kssenii
335b6f12fd Fix 2021-08-30 20:59:03 +03:00
Zhichang Yu
ef1994f420 set env LIBHDFS3_CONF, refers to ClickHouse#8159 2021-08-28 09:16:48 +08:00
kssenii
0ec716292c Postgres ON CONFLICT 2021-08-24 12:37:32 +00:00
Anna
ad5ca57c7f
Update docs/en/engines/table-engines/integrations/sqlite.md
Co-authored-by: olgarev <56617294+olgarev@users.noreply.github.com>
2021-08-19 07:30:43 +03:00
Anna
a871916153
Update docs/en/engines/table-engines/integrations/sqlite.md
Co-authored-by: olgarev <56617294+olgarev@users.noreply.github.com>
2021-08-19 07:29:26 +03:00
Anna
b9f2ed45a2
Update docs/en/engines/table-engines/integrations/sqlite.md
Co-authored-by: olgarev <56617294+olgarev@users.noreply.github.com>
2021-08-19 07:29:21 +03:00
Anna
2644f7a48e
Update docs/en/engines/table-engines/integrations/sqlite.md
Co-authored-by: olgarev <56617294+olgarev@users.noreply.github.com>
2021-08-19 07:29:12 +03:00
Anna
842d520967
Update docs/en/engines/table-engines/integrations/sqlite.md
Co-authored-by: olgarev <56617294+olgarev@users.noreply.github.com>
2021-08-19 07:29:02 +03:00
Anna
77da21a1ba
Update docs/en/engines/table-engines/integrations/sqlite.md
Co-authored-by: olgarev <56617294+olgarev@users.noreply.github.com>
2021-08-19 07:28:41 +03:00
adevyatova
fcf3413ac9 Small fixes 2021-08-18 13:40:09 +00:00
adevyatova
4fb4387180 Added examples 2021-08-18 13:32:34 +00:00
adevyatova
a54060dd02 Add en description 2021-08-15 16:34:10 +00:00
adevyatova
346def3666 Update 2021-08-15 14:11:37 +00:00
adevyatova
be8d87029c Add templates 2021-08-15 13:53:49 +00:00
Kseniia Sumarokova
f6cabb6e08
Merge pull request #27055 from olgarev/revolg-DOCSUP-12003-S3_and_HDFS_zero_copy_replication
DOCSUP-12003: S3 and HDFS zero copy replication
2021-08-10 08:57:35 +03:00
Kseniia Sumarokova
a966a440b0
Merge pull request #26677 from sevirov/sevirov-DOCSUP-11550-edit_and_translate_to_russian_materializedpostgresql
DOCSUP-11550: Edit and translate to Russian (MaterializePostgreSQL)
2021-08-09 08:27:18 +03:00
olgarev
06e48f39b0 New page - External Disks for Storing Data 2021-08-08 23:19:00 +00:00
olgarev
7673247b4e Quotes and link fixed for s3, section headings for hdfs 2021-08-04 05:19:31 +00:00
Dmitriy
ad4d05d7ca Fix links
Поправил ссылки.
2021-08-03 21:44:30 +03:00
Dmitriy
612f42e301 Add the brief description
Добавил краткое описание, параметры движка.
2021-08-03 21:09:58 +03:00
Kseniia Sumarokova
5d3abc14c7
Merge pull request #22045 from OmarBazaraa/mongo-ssl
Support SSL connection in MongoDB engine
2021-08-03 08:29:34 +03:00
olgarev
f9658d2205 Wrong backticks 2021-08-02 22:52:01 +00:00
Dmitriy
d6b5838282 Delete the introductory sentence
Удалил неверное предложение.
2021-08-02 23:16:23 +03:00
Dmitriy
387136dc84 Add settings
Добавил настройки, перевел табличный движок MaterializedPostgreSQL.
2021-08-02 22:45:01 +03:00