thevar1able/ClickHouse
1
0
Fork 0
mirror of https://github.com/ClickHouse/ClickHouse.git synced 2024-11-18 05:32:52 +00:00
Code Issues Packages Projects Releases Wiki Activity
125,968 Commits 9,136 Branches 1,774 Tags 2 GiB
21afc422dd
Commit Graph

375 Commits

Author SHA1 Message Date
Dan Roscigno
02261b0e2a
Update docs/en/engines/table-engines/integrations/hudi.md 2023-01-11 07:42:15 -05:00
Dan Roscigno
73ef2657dd
Update docs/en/engines/table-engines/integrations/hudi.md 2023-01-11 07:40:10 -05:00
Dan Roscigno
21573028ea
Update docs/en/engines/table-engines/integrations/deltalake.md 2023-01-11 07:38:41 -05:00
DanRoscigno
563e0e76f9 init 2023-01-10 16:59:34 -05:00
DanRoscigno
5cf1b1f61d feedback 2023-01-10 16:09:59 -05:00
DanRoscigno
879ee05218 fix case of names 2023-01-10 11:18:33 -05:00
Dan Roscigno
f8a5d5cb18
Merge branch 'ClickHouse:master' into add-deltalake-docs 2023-01-09 15:45:08 -05:00
Ivan Blinkov
61c2f23713 Remove leftover empty lines at the end of markdown files 2023-01-09 15:15:18 +01:00
Ivan Blinkov
b7e082d033 Remove "Original article links" 2023-01-09 15:13:36 +01:00
DanRoscigno
5cde7762ad WIP 2023-01-05 15:54:44 -05:00
Kruglov Pavel
c5b2e4cc23
Merge branch 'master' into improve-streaming-engines 2022-12-15 18:44:35 +01:00
Sergei Trifonov
f2f0676bcc
Revert "Revert "S3 request per second rate throttling"" 2022-11-17 17:35:04 +01:00
Alexander Tokmakov
9011a18234
Revert "S3 request per second rate throttling" 2022-11-16 22:33:48 +03:00
Sergei Trifonov
159743edd6
Merge pull request #43014 from ClickHouse/disk-s3-throttler 
S3 request per second rate throttling
 2022-11-16 18:51:06 +01:00
serxa
7448d1bb5d add docs 2022-11-09 14:58:41 +00:00
DanRoscigno
34f90ff6ef update pages that refer to dictionaries 2022-11-07 09:26:50 -05:00
Kruglov Pavel
b124875257
Merge branch 'master' into improve-streaming-engines 2022-11-03 13:22:06 +01:00
Alexander Yakovlev
70eaf69df1
Fix a typo in table-engines/integrations/s3.md 2022-11-01 02:57:55 +03:00
avogar
8e13d1f1ec Improve and refactor Kafka/StorageMQ/NATS and data formats 2022-10-28 16:41:10 +00:00
Lloyd-Pottiger
5a6b2106b5 Merge branch 'master' of github.com:ClickHouse/ClickHouse into feat/support-read-only-for-embeddedrocksdb 2022-09-02 18:10:00 +08:00
Lloyd-Pottiger
59dccd6e49 fix test 
Signed-off-by: Lloyd-Pottiger <yan1579196623@gamil.com>
 2022-09-02 11:14:49 +08:00
DanRoscigno
c4b8137d31 replace symlinks 2022-08-29 12:19:50 -04:00
DanRoscigno
5b5fcc56aa add slugs 2022-08-28 10:53:34 -04:00
Lloyd-Pottiger
ac3cf0beb4 add read_only option 
Signed-off-by: Lloyd-Pottiger <yan1579196623@gamil.com>
 2022-08-23 20:58:57 +08:00
Antonio Andelic
0765495be1
Merge pull request #39986 from Lloyd-Pottiger/feat/support-ttl-for-embeddedrocksdb 
Support TTL for EmbeddedRocksDB
 2022-08-23 08:27:47 +02:00
Lloyd-Pottiger
85a1a36167 remove read_only option 
Signed-off-by: Lloyd-Pottiger <yan1579196623@gamil.com>
 2022-08-22 23:31:55 +08:00
DanRoscigno
23b054617e update for setting change 2022-08-18 16:05:44 -04:00
Lloyd-Pottiger
c5d81e160c add functionality test 
Signed-off-by: Lloyd-Pottiger <yan1579196623@gamil.com>
 2022-08-10 23:10:52 +08:00
Lloyd-Pottiger
5488a392ab address comments 
Signed-off-by: Lloyd-Pottiger <yan1579196623@gamil.com>
 2022-08-10 21:20:25 +08:00
Lloyd-Pottiger
7ecaf58981 revise docs 
Signed-off-by: Lloyd-Pottiger <yan1579196623@gamil.com>
 2022-08-09 21:48:49 +08:00
Dan Roscigno
2a6765ce8c
Merge pull request #38603 from den-crane/patch-17 
Doc. More settings / mysql
 2022-07-06 15:24:13 -04:00
Kseniia Sumarokova
6c3d648f49
Merge branch 'master' into nats-integration 2022-07-04 21:06:07 +02:00
Denny Crane
394a15a792
Update mysql.md 2022-06-29 16:52:32 -03:00
Yakov Olkhovskiy
d5f65ece9b
Merge pull request #38105 from arenadata/ADQM-419 
Add kerberosInit function as a replacement for kinit executable calls in Kafka and HDFS
 2022-06-27 14:19:24 -04:00
Roman Vasin
3cfea6e76f Cleanup code in KerberosInit, HDFSCommon and StorageKafka; update English and Russian documentation. 2022-06-08 17:57:45 +03:00
rfraposa
869967de41 Remove H1 anchor tags from docs 2022-06-02 04:55:18 -06:00
tchepavel
87217ce6cc NATS. Add new setting to doc; clean up code. 2022-05-23 14:57:39 +03:00
tchepavel
a3af94d49e Documentation; integration tests; subscribe on startup 2022-05-17 16:58:09 +03:00
Mark Andreev
ebb9694920
Add Kafka headers virtual columns 
Add documentation for https://github.com/ClickHouse/ClickHouse/pull/11283
 2022-05-11 18:38:09 +04:00
rfraposa
e7b7b7ecd3 Various docs fixes 2022-04-29 05:33:51 -06:00
rfraposa
fb08c5b7e1 Merge branch 'master' into docs-staging 2022-04-15 07:25:27 -06:00
Kruglov Pavel
fead4c184f
Merge pull request #35237 from olejeglejeg/patch-1 
Kafka engine kafka_num_consumers prop upper bound doc update
 2022-04-12 17:09:42 +02:00
rfraposa
8f01fe9c49 Revised /en folder 2022-04-09 07:34:21 -06:00
rfraposa
5250d9ad11 Removed /ja folder, cleaned up /ru markdown 2022-04-09 07:29:05 -06:00
Alexey Milovidov
9854b55835
Revert "Format changes for new docs" 2022-04-04 02:05:35 +03:00
rfraposa
72a00e2c62 Fixed broken links 2022-04-02 17:38:54 -06:00
rfraposa
00ddb72eea Update /engines docs 2022-03-29 17:43:34 -06:00
rfraposa
33e28bcb18 Updated /development folder 2022-03-29 08:26:35 -06:00
taiyang-li
6a8bb34b41 update doc of hive 2022-03-24 17:17:25 +08:00
rfraposa
ecbdfdea08 Incorporated feedback 2022-03-12 10:04:51 -06:00
Oleg Taizov
2ce6571968
kafka_num_consumers prop upper bound doc update 
Add clarification about the upper bound of `kafka_num_consumers` property that was added in [#26640](https://github.com/ClickHouse/ClickHouse/pull/26642)
 2022-03-12 11:09:12 +03:00
rfraposa
5a4466cec7 Update references in docs 2022-03-12 00:24:31 -06:00
Xudong Zhang
9c4cc70dae update document: add _timestamp_ms of kafka 2022-02-19 23:49:37 +08:00
taiyang-li
82a3024712 Merge remote-tracking branch 'ck/master' into bigo_hive_table 2022-01-13 18:11:23 +08:00
Kseniia Sumarokova
5d2324368f
Update mongodb.md 2022-01-13 09:37:57 +03:00
taiyang-li
1e102bc1b2 merge master 2022-01-01 09:01:06 +08:00
alesapin
9e83e5f7f4
Merge pull request #33121 from karnevil13/karnevil-DOCSUP-20367 
DOCSUP-20367: Edit and translate to Russian (insert_quorum_parallel)
 2021-12-29 13:31:36 +03:00
taiyang-li
9036b18c2f merge master 2021-12-27 15:12:48 +08:00
kssenii
688cffb8be Update postgres doc 2021-12-25 16:37:44 +03:00
karnevil13
c5a22e6799
Merge branch 'master' into karnevil-DOCSUP-20367 2021-12-24 02:57:28 +03:00
karnevil13
c6f6630627 insert_quorum_parallel-EdTranRus 2021-12-24 02:28:39 +03:00
taiyang-li
2597925724 merge master 2021-12-21 15:55:39 +08:00
mergify[bot]
c3a4e0ddcb
Merge branch 'master' into andrc1901-DOCSUP-18084 2021-12-20 13:00:43 +00:00
taiyang-li
d033fc4c24 merge master and fix conflict 2021-12-17 15:11:21 +08:00
Christoph Wurm
a65dd4824c Docs: Fix formatting in HDFS engine 2021-12-16 14:46:12 +00:00
taiyang-li
a0b90fa9ec fix bugs and add some docs 2021-12-14 18:44:15 +08:00
Andrei Ch
61a1eb2828 Update RabbitMQ 2021-12-12 00:21:05 +03:00
taiyang-li
2f4e7e1d4e merge master 2021-12-02 19:48:21 +08:00
Federico Ceratto
04a8730c91
Fix syntax error: drop comma 2021-12-01 20:12:10 +00:00
Vladimir C
37cd3b9aaa
Merge pull request #31608 from sevirov/sevirov-DOCSUP-14783-document_the_mysql_settings 2021-12-01 12:04:53 +03:00
Vladimir C
2214748afb
Apply suggestions from code review 2021-12-01 12:04:34 +03:00
alexey-milovidov
b5f44de8f0
Merge pull request #31948 from ramazanpolat/patch-2 
fix some broken links
 2021-11-30 05:59:45 +03:00
Ramazan Polat
daed39d000
fix some broken links 
max_insert_block_size and stream-flush-interval-ms links fixed.
 2021-11-29 14:34:46 +03:00
Dmitriy
94d43d9520 Translate to Russian 
Выполнил перевод на русский язык.
 2021-11-25 19:59:14 +03:00
khamadiev
df23893f69
Update kafka.md 
Updated See Also section, since number of kafka consumers controlled by background_message_broker_schedule_pool_size setting
 2021-11-25 17:20:16 +05:00
taiyang-li
e8644807fe merge master and solve conflict 2021-11-19 15:01:58 +08:00
olgarev
1cd1677b0c
DOCSUP-14532: Support SETTINGS clause for S3 engine (#30982) 2021-11-16 16:25:12 +03:00
taiyang-li
36ca0b296b implement hive table engine 2021-11-05 19:55:30 +08:00
alexey-milovidov
7023423f66
Merge pull request #28705 from gyuton/gyuton-DOCSUP-14093-Edit-and-translate-to-Russian 
DOCSUP-14093: Edited and translated to Russian (external dicts)
 2021-10-21 23:33:41 +03:00
Ivan Blinkov
f429db1ee9 find . -type f -name '*.md'| xargs -I{} perl -pi -e 's|https://clickhouse.tech|https://clickhouse.com|g' {} 2021-09-19 23:05:54 +03:00
Vladimir C
5b967d91ba
Merge pull request #28716 from olgarev/revolg-DOCSUP-13742-partitions_in_s3_table_function 2021-09-10 17:57:58 +03:00
Olga Revyakina
cd038979d4 Initial (en) 2021-09-08 05:32:02 +03:00
George
3ce7331211 Edited and translated to Russian 2021-09-07 20:07:27 +03:00
Maksim Kita
7a4a0b0ede
Merge pull request #28474 from azat/mysql-connection_no_block 
Introduce connection_wait_timeout for MySQL engine.
 2021-09-07 12:28:02 +03:00
Azat Khuzhin
ed70ed6f71 Introduce connection_no_wait setting for MySQL engine. 
This will allow to avoid superfluous sleep during query execution, since
this not only not desired behavoiur, but also may hang the server, since
if you will execute enough queries that will use MySQL database but will
not allow enough connections (or your MySQL server is too slow) then you
may run out of threads in the global thread pool.

Also note that right now it is possible to get deadlock when the mysql
pool is full, consider the following scenario:

- you have m1 and m2 mysql tables
- you have q1 and q2 queries, bot queries join m1 and m2
- q1 allocated connection for m1 but cannot allocate connection for m2
- q2 allocated connection for m2 but cannot allocate connection for m1
- but to resolve the lock one should give up on the locking while it is not possible right now...

And then you got no free threads and this:

    # grep -h ^202 /proc/$(pgrep clickhouse-serv)/task/*/syscall  | cut -d' ' -f2 | sort | uniq -c | sort -nr | head
       1554 0x7ffb60b92fe8 # mutex in mysqlxx::PoolWithFailover::get
       1375 0x7ffb9f1c4748 # mutex in ::PoolEntryHelper::~PoolEntryHelper from DB::MultiplexedConnections::invalidateReplica
       1160 0x7ffb612918b8 # mutex in mysqlxx::PoolWithFailover::get
         42 0x7ffb9f057984 # mutex in ThreadPoolImpl<std::__1::thread>::worker

    *NOTE: 202 is a `futex` with WAIT*

(Went with `syscall` because debugging 10k+ threads is not easy, and
eventually it may TRAP)
 2021-09-02 22:23:37 +03:00
kssenii
335b6f12fd Fix 2021-08-30 20:59:03 +03:00
Zhichang Yu
ef1994f420 set env LIBHDFS3_CONF, refers to ClickHouse#8159 2021-08-28 09:16:48 +08:00
kssenii
0ec716292c Postgres ON CONFLICT 2021-08-24 12:37:32 +00:00
Anna
ad5ca57c7f
Update docs/en/engines/table-engines/integrations/sqlite.md 
Co-authored-by: olgarev <56617294+olgarev@users.noreply.github.com>
 2021-08-19 07:30:43 +03:00
Anna
a871916153
Update docs/en/engines/table-engines/integrations/sqlite.md 
Co-authored-by: olgarev <56617294+olgarev@users.noreply.github.com>
 2021-08-19 07:29:26 +03:00
Anna
b9f2ed45a2
Update docs/en/engines/table-engines/integrations/sqlite.md 
Co-authored-by: olgarev <56617294+olgarev@users.noreply.github.com>
 2021-08-19 07:29:21 +03:00
Anna
2644f7a48e
Update docs/en/engines/table-engines/integrations/sqlite.md 
Co-authored-by: olgarev <56617294+olgarev@users.noreply.github.com>
 2021-08-19 07:29:12 +03:00
Anna
842d520967
Update docs/en/engines/table-engines/integrations/sqlite.md 
Co-authored-by: olgarev <56617294+olgarev@users.noreply.github.com>
 2021-08-19 07:29:02 +03:00
Anna
77da21a1ba
Update docs/en/engines/table-engines/integrations/sqlite.md 
Co-authored-by: olgarev <56617294+olgarev@users.noreply.github.com>
 2021-08-19 07:28:41 +03:00
adevyatova
fcf3413ac9 Small fixes 2021-08-18 13:40:09 +00:00
adevyatova
4fb4387180 Added examples 2021-08-18 13:32:34 +00:00
adevyatova
a54060dd02 Add en description 2021-08-15 16:34:10 +00:00
adevyatova
346def3666 Update 2021-08-15 14:11:37 +00:00
adevyatova
be8d87029c Add templates 2021-08-15 13:53:49 +00:00
Kseniia Sumarokova
f6cabb6e08
Merge pull request #27055 from olgarev/revolg-DOCSUP-12003-S3_and_HDFS_zero_copy_replication 
DOCSUP-12003: S3 and HDFS zero copy replication
 2021-08-10 08:57:35 +03:00
Kseniia Sumarokova
a966a440b0
Merge pull request #26677 from sevirov/sevirov-DOCSUP-11550-edit_and_translate_to_russian_materializedpostgresql 
DOCSUP-11550: Edit and translate to Russian (MaterializePostgreSQL)
 2021-08-09 08:27:18 +03:00
olgarev
06e48f39b0 New page - External Disks for Storing Data 2021-08-08 23:19:00 +00:00
olgarev
7673247b4e Quotes and link fixed for s3, section headings for hdfs 2021-08-04 05:19:31 +00:00
Dmitriy
ad4d05d7ca Fix links 
Поправил ссылки.
 2021-08-03 21:44:30 +03:00
Dmitriy
612f42e301 Add the brief description 
Добавил краткое описание, параметры движка.
 2021-08-03 21:09:58 +03:00
Kseniia Sumarokova
5d3abc14c7
Merge pull request #22045 from OmarBazaraa/mongo-ssl 
Support SSL connection in MongoDB engine
 2021-08-03 08:29:34 +03:00
olgarev
f9658d2205 Wrong backticks 2021-08-02 22:52:01 +00:00
Dmitriy
d6b5838282 Delete the introductory sentence 
Удалил неверное предложение.
 2021-08-02 23:16:23 +03:00
Dmitriy
387136dc84 Add settings 
Добавил настройки, перевел табличный движок MaterializedPostgreSQL.
 2021-08-02 22:45:01 +03:00
olgarev
b1320ead65 Replication is supported now 2021-08-02 17:19:21 +00:00
olgarev
6c05a0c8dc Docs for S3 2021-08-01 03:10:31 +00:00
olgarev
f86829ebf4 Docs for HDFS 2021-08-01 02:55:24 +00:00
Alexey Milovidov
df3be36758 Remove trailing whitespaces from docs 2021-07-29 18:27:50 +03:00
Alexey Milovidov
d87d833691 Remove trailing whitespaces from docs 2021-07-29 18:20:55 +03:00
OmarBazaraa
fea1a5d321 Refactor 2021-07-28 09:38:34 +00:00
OmarBazaraa
7e785d6b12 Docs 2021-07-28 09:38:34 +00:00
Azat Khuzhin
8ef677b15f Add ability to set any rocksdb option via config.xml 
v2: Cover rocksdb options in ClickHouse config
v3: add missing __init__.py
v4: Rework rocksdb options from config
v5: add column_family_options support
 2021-07-27 08:40:50 +03:00
Azat Khuzhin
c7d2a5aad8 Add system.rocksdb table (with various rocksdb internals) 
v2: fix USE_ROCKSDB check (there is #cmakedefine01 so it is either 0/1,
so we should not check with #ifdef)
 2021-07-26 23:13:59 +03:00
Jeffrey Dang
c09fa0b843
Update materialized-postgresql.md 
Spelling
 2021-07-13 10:56:07 -05:00
kssenii
4c8d82001f Fix checks 2021-07-01 17:52:21 +00:00
kssenii
4ad0f45f0e Some more tests 2021-07-01 08:35:28 +00:00
kssenii
9d5847a1a8 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into pg-ch-replica 2021-06-29 21:30:31 +00:00
Dmitriy
375965fb7a Update ExternalDistributed.md 
Убрал поддержку запросов на вставку.
 2021-06-27 23:45:05 +03:00
kssenii
c3a2fc0584 Review fixes 2021-06-27 19:17:17 +00:00
Dmitriy
253f249f3d Add links 
Добавил ссылку на настройку external_table_functions_use_nulls.
 2021-06-27 20:57:46 +03:00
Dmitriy
7a95569d90 Merge remote-tracking branch 'remotes/clickhouse/master' into sevirov-DOCSUP-8324-document_the_support_of_replicas_and_shards_in_mysql_postgresql 2021-06-27 20:44:12 +03:00
Dmitriy
c379a0b226 Update mysql and postgresql engines 
Внес небольшие поправки.
 2021-06-27 20:35:53 +03:00
Dmitriy
07afd0746b Replace links 
Заменил линки в cast.
 2021-06-27 14:07:24 +03:00
Dmitriy
45a4ea7a68 Delete the external_table_functions_use_nulls setting 
Удалил настройку external_table_functions_use_nulls из описания движка ExternalDistributed.
 2021-06-27 14:01:51 +03:00
sevirov
6efe22d67e
Update docs/en/engines/table-engines/integrations/postgresql.md 
Co-authored-by: olgarev <56617294+olgarev@users.noreply.github.com>
 2021-06-27 12:26:03 +03:00
sevirov
775454bfe0
Update docs/en/engines/table-engines/integrations/mysql.md 
Co-authored-by: olgarev <56617294+olgarev@users.noreply.github.com>
 2021-06-27 12:25:52 +03:00
sevirov
020a82b96f
Update docs/en/engines/table-engines/integrations/ExternalDistributed.md 
Co-authored-by: olgarev <56617294+olgarev@users.noreply.github.com>
 2021-06-27 12:25:34 +03:00
sevirov
e87c2c3147
Update docs/en/engines/table-engines/integrations/ExternalDistributed.md 
Co-authored-by: olgarev <56617294+olgarev@users.noreply.github.com>
 2021-06-27 12:25:16 +03:00
kssenii
3d90f0710c Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into pg-ch-replica 2021-06-26 22:04:47 +00:00
Dmitriy
8062884323 Translate to Russian 
Выполнил перевод на русский язык.
 2021-06-25 21:25:25 +03:00
Dmitriy
b9b45d61e9 Fix See Also 
Поправил ссылки.
 2021-06-24 23:40:43 +03:00
Dmitriy
5154f78249 Update ExternalDistributed.md 
Внес небольшие поправки.
 2021-06-24 22:49:04 +03:00
Dmitriy
48e19f0c39 Create ExternalDistributed.md 
Задокументировал новый табличный движок ExternalDistributed.
 2021-06-24 22:29:57 +03:00
Zhichun Wu
f1417adfaf Update JDBC bridge related docs 2021-06-11 17:37:38 +08:00
presto53
e9bd18ebfb
Update s3.md 2021-06-04 17:35:15 +03:00
Nikita Mikhaylov
cf8782faf3
Merge pull request #24311 from nikitamikhaylov/merging-s3-backoff 
Merging #23461
 2021-06-04 14:41:21 +03:00
Vladimir Goncharov
bea934f40c
Update mysql.md 
The MySQL engine also allows to perform `INSERT`
 2021-06-03 20:12:19 +03:00
kssenii
12ea45e956 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into pg-ch-replica 2021-06-01 17:43:34 +00:00
Nikita Mikhaylov
0055a924f6 better 2021-06-01 14:23:46 +00:00
Nikita Mikhaylov
0d8ede15a9
Merge branch 'master' into merging-s3-backoff 2021-05-31 21:07:00 +03:00
Romain Neutron
7b515c7235
Avoid short syntax 2021-05-27 21:44:11 +02:00
mergify[bot]
400b74d186
Merge branch 'master' into merging-s3-backoff 2021-05-25 14:02:38 +00:00
kssenii
a78c9e63e7 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into pg-ch-replica 2021-05-23 12:07:26 +00:00
Azat Khuzhin
4f41ebcae3 Add settings (for connections) for MySQL storage engine 
Default settings are not very efficient, since they do not even reuse
connections.
And when each query requires connection you can have only ~80 QPS, while
by simply enabling connection reuse (connection_auto_close=false) you
can have ~500 QPS (and by increasing connection_pool_size you can have
better QPS throughput).

So this patch allows to pass through some connection related settings
for the StorageMySQL engine, like:
- connection_pool_size=16
- connection_max_tries=3
- connection_auto_close=true

v2: remove connection_pool_default_size
v3: remove num_tries_on_connection_loss
 2021-05-20 22:44:52 +03:00
Nikita Mikhaylov
f33b70c54a better 2021-05-20 00:42:25 +03:00