thevar1able/ClickHouse
1
0
Fork 0
mirror of https://github.com/ClickHouse/ClickHouse.git synced 2024-12-13 18:02:24 +00:00
Code Issues Packages Projects Releases Wiki Activity
99,674 Commits 9,328 Branches 1,783 Tags 2.1 GiB
3d400068fd
Commit Graph

256 Commits

Author SHA1 Message Date
Vladimir C
37cd3b9aaa
Merge pull request #31608 from sevirov/sevirov-DOCSUP-14783-document_the_mysql_settings 2021-12-01 12:04:53 +03:00
Vladimir C
2214748afb
Apply suggestions from code review 2021-12-01 12:04:34 +03:00
alexey-milovidov
b5f44de8f0
Merge pull request #31948 from ramazanpolat/patch-2 
fix some broken links
 2021-11-30 05:59:45 +03:00
Ramazan Polat
daed39d000
fix some broken links 
max_insert_block_size and stream-flush-interval-ms links fixed.
 2021-11-29 14:34:46 +03:00
Dmitriy
94d43d9520 Translate to Russian 
Выполнил перевод на русский язык.
 2021-11-25 19:59:14 +03:00
khamadiev
df23893f69
Update kafka.md 
Updated See Also section, since number of kafka consumers controlled by background_message_broker_schedule_pool_size setting
 2021-11-25 17:20:16 +05:00
taiyang-li
e8644807fe merge master and solve conflict 2021-11-19 15:01:58 +08:00
olgarev
1cd1677b0c
DOCSUP-14532: Support SETTINGS clause for S3 engine (#30982) 2021-11-16 16:25:12 +03:00
taiyang-li
36ca0b296b implement hive table engine 2021-11-05 19:55:30 +08:00
alexey-milovidov
7023423f66
Merge pull request #28705 from gyuton/gyuton-DOCSUP-14093-Edit-and-translate-to-Russian 
DOCSUP-14093: Edited and translated to Russian (external dicts)
 2021-10-21 23:33:41 +03:00
Ivan Blinkov
f429db1ee9 find . -type f -name '*.md'| xargs -I{} perl -pi -e 's|https://clickhouse.tech|https://clickhouse.com|g' {} 2021-09-19 23:05:54 +03:00
Vladimir C
5b967d91ba
Merge pull request #28716 from olgarev/revolg-DOCSUP-13742-partitions_in_s3_table_function 2021-09-10 17:57:58 +03:00
Olga Revyakina
cd038979d4 Initial (en) 2021-09-08 05:32:02 +03:00
George
3ce7331211 Edited and translated to Russian 2021-09-07 20:07:27 +03:00
Maksim Kita
7a4a0b0ede
Merge pull request #28474 from azat/mysql-connection_no_block 
Introduce connection_wait_timeout for MySQL engine.
 2021-09-07 12:28:02 +03:00
Azat Khuzhin
ed70ed6f71 Introduce connection_no_wait setting for MySQL engine. 
This will allow to avoid superfluous sleep during query execution, since
this not only not desired behavoiur, but also may hang the server, since
if you will execute enough queries that will use MySQL database but will
not allow enough connections (or your MySQL server is too slow) then you
may run out of threads in the global thread pool.

Also note that right now it is possible to get deadlock when the mysql
pool is full, consider the following scenario:

- you have m1 and m2 mysql tables
- you have q1 and q2 queries, bot queries join m1 and m2
- q1 allocated connection for m1 but cannot allocate connection for m2
- q2 allocated connection for m2 but cannot allocate connection for m1
- but to resolve the lock one should give up on the locking while it is not possible right now...

And then you got no free threads and this:

    # grep -h ^202 /proc/$(pgrep clickhouse-serv)/task/*/syscall  | cut -d' ' -f2 | sort | uniq -c | sort -nr | head
       1554 0x7ffb60b92fe8 # mutex in mysqlxx::PoolWithFailover::get
       1375 0x7ffb9f1c4748 # mutex in ::PoolEntryHelper::~PoolEntryHelper from DB::MultiplexedConnections::invalidateReplica
       1160 0x7ffb612918b8 # mutex in mysqlxx::PoolWithFailover::get
         42 0x7ffb9f057984 # mutex in ThreadPoolImpl<std::__1::thread>::worker

    *NOTE: 202 is a `futex` with WAIT*

(Went with `syscall` because debugging 10k+ threads is not easy, and
eventually it may TRAP)
 2021-09-02 22:23:37 +03:00
kssenii
335b6f12fd Fix 2021-08-30 20:59:03 +03:00
Zhichang Yu
ef1994f420 set env LIBHDFS3_CONF, refers to ClickHouse#8159 2021-08-28 09:16:48 +08:00
kssenii
0ec716292c Postgres ON CONFLICT 2021-08-24 12:37:32 +00:00
Anna
ad5ca57c7f
Update docs/en/engines/table-engines/integrations/sqlite.md 
Co-authored-by: olgarev <56617294+olgarev@users.noreply.github.com>
 2021-08-19 07:30:43 +03:00
Anna
a871916153
Update docs/en/engines/table-engines/integrations/sqlite.md 
Co-authored-by: olgarev <56617294+olgarev@users.noreply.github.com>
 2021-08-19 07:29:26 +03:00
Anna
b9f2ed45a2
Update docs/en/engines/table-engines/integrations/sqlite.md 
Co-authored-by: olgarev <56617294+olgarev@users.noreply.github.com>
 2021-08-19 07:29:21 +03:00
Anna
2644f7a48e
Update docs/en/engines/table-engines/integrations/sqlite.md 
Co-authored-by: olgarev <56617294+olgarev@users.noreply.github.com>
 2021-08-19 07:29:12 +03:00
Anna
842d520967
Update docs/en/engines/table-engines/integrations/sqlite.md 
Co-authored-by: olgarev <56617294+olgarev@users.noreply.github.com>
 2021-08-19 07:29:02 +03:00
Anna
77da21a1ba
Update docs/en/engines/table-engines/integrations/sqlite.md 
Co-authored-by: olgarev <56617294+olgarev@users.noreply.github.com>
 2021-08-19 07:28:41 +03:00
adevyatova
fcf3413ac9 Small fixes 2021-08-18 13:40:09 +00:00
adevyatova
4fb4387180 Added examples 2021-08-18 13:32:34 +00:00
adevyatova
a54060dd02 Add en description 2021-08-15 16:34:10 +00:00
adevyatova
346def3666 Update 2021-08-15 14:11:37 +00:00
adevyatova
be8d87029c Add templates 2021-08-15 13:53:49 +00:00
Kseniia Sumarokova
f6cabb6e08
Merge pull request #27055 from olgarev/revolg-DOCSUP-12003-S3_and_HDFS_zero_copy_replication 
DOCSUP-12003: S3 and HDFS zero copy replication
 2021-08-10 08:57:35 +03:00
Kseniia Sumarokova
a966a440b0
Merge pull request #26677 from sevirov/sevirov-DOCSUP-11550-edit_and_translate_to_russian_materializedpostgresql 
DOCSUP-11550: Edit and translate to Russian (MaterializePostgreSQL)
 2021-08-09 08:27:18 +03:00
olgarev
06e48f39b0 New page - External Disks for Storing Data 2021-08-08 23:19:00 +00:00
olgarev
7673247b4e Quotes and link fixed for s3, section headings for hdfs 2021-08-04 05:19:31 +00:00
Dmitriy
ad4d05d7ca Fix links 
Поправил ссылки.
 2021-08-03 21:44:30 +03:00
Dmitriy
612f42e301 Add the brief description 
Добавил краткое описание, параметры движка.
 2021-08-03 21:09:58 +03:00
Kseniia Sumarokova
5d3abc14c7
Merge pull request #22045 from OmarBazaraa/mongo-ssl 
Support SSL connection in MongoDB engine
 2021-08-03 08:29:34 +03:00
olgarev
f9658d2205 Wrong backticks 2021-08-02 22:52:01 +00:00
Dmitriy
d6b5838282 Delete the introductory sentence 
Удалил неверное предложение.
 2021-08-02 23:16:23 +03:00
Dmitriy
387136dc84 Add settings 
Добавил настройки, перевел табличный движок MaterializedPostgreSQL.
 2021-08-02 22:45:01 +03:00
olgarev
b1320ead65 Replication is supported now 2021-08-02 17:19:21 +00:00
olgarev
6c05a0c8dc Docs for S3 2021-08-01 03:10:31 +00:00
olgarev
f86829ebf4 Docs for HDFS 2021-08-01 02:55:24 +00:00
Alexey Milovidov
df3be36758 Remove trailing whitespaces from docs 2021-07-29 18:27:50 +03:00
Alexey Milovidov
d87d833691 Remove trailing whitespaces from docs 2021-07-29 18:20:55 +03:00
OmarBazaraa
fea1a5d321 Refactor 2021-07-28 09:38:34 +00:00
OmarBazaraa
7e785d6b12 Docs 2021-07-28 09:38:34 +00:00
Azat Khuzhin
8ef677b15f Add ability to set any rocksdb option via config.xml 
v2: Cover rocksdb options in ClickHouse config
v3: add missing __init__.py
v4: Rework rocksdb options from config
v5: add column_family_options support
 2021-07-27 08:40:50 +03:00
Azat Khuzhin
c7d2a5aad8 Add system.rocksdb table (with various rocksdb internals) 
v2: fix USE_ROCKSDB check (there is #cmakedefine01 so it is either 0/1,
so we should not check with #ifdef)
 2021-07-26 23:13:59 +03:00
Jeffrey Dang
c09fa0b843
Update materialized-postgresql.md 
Spelling
 2021-07-13 10:56:07 -05:00
kssenii
4c8d82001f Fix checks 2021-07-01 17:52:21 +00:00
kssenii
4ad0f45f0e Some more tests 2021-07-01 08:35:28 +00:00
kssenii
9d5847a1a8 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into pg-ch-replica 2021-06-29 21:30:31 +00:00
Dmitriy
375965fb7a Update ExternalDistributed.md 
Убрал поддержку запросов на вставку.
 2021-06-27 23:45:05 +03:00
kssenii
c3a2fc0584 Review fixes 2021-06-27 19:17:17 +00:00
Dmitriy
253f249f3d Add links 
Добавил ссылку на настройку external_table_functions_use_nulls.
 2021-06-27 20:57:46 +03:00
Dmitriy
7a95569d90 Merge remote-tracking branch 'remotes/clickhouse/master' into sevirov-DOCSUP-8324-document_the_support_of_replicas_and_shards_in_mysql_postgresql 2021-06-27 20:44:12 +03:00
Dmitriy
c379a0b226 Update mysql and postgresql engines 
Внес небольшие поправки.
 2021-06-27 20:35:53 +03:00
Dmitriy
07afd0746b Replace links 
Заменил линки в cast.
 2021-06-27 14:07:24 +03:00
Dmitriy
45a4ea7a68 Delete the external_table_functions_use_nulls setting 
Удалил настройку external_table_functions_use_nulls из описания движка ExternalDistributed.
 2021-06-27 14:01:51 +03:00
sevirov
6efe22d67e
Update docs/en/engines/table-engines/integrations/postgresql.md 
Co-authored-by: olgarev <56617294+olgarev@users.noreply.github.com>
 2021-06-27 12:26:03 +03:00
sevirov
775454bfe0
Update docs/en/engines/table-engines/integrations/mysql.md 
Co-authored-by: olgarev <56617294+olgarev@users.noreply.github.com>
 2021-06-27 12:25:52 +03:00
sevirov
020a82b96f
Update docs/en/engines/table-engines/integrations/ExternalDistributed.md 
Co-authored-by: olgarev <56617294+olgarev@users.noreply.github.com>
 2021-06-27 12:25:34 +03:00
sevirov
e87c2c3147
Update docs/en/engines/table-engines/integrations/ExternalDistributed.md 
Co-authored-by: olgarev <56617294+olgarev@users.noreply.github.com>
 2021-06-27 12:25:16 +03:00
kssenii
3d90f0710c Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into pg-ch-replica 2021-06-26 22:04:47 +00:00
Dmitriy
8062884323 Translate to Russian 
Выполнил перевод на русский язык.
 2021-06-25 21:25:25 +03:00
Dmitriy
b9b45d61e9 Fix See Also 
Поправил ссылки.
 2021-06-24 23:40:43 +03:00
Dmitriy
5154f78249 Update ExternalDistributed.md 
Внес небольшие поправки.
 2021-06-24 22:49:04 +03:00
Dmitriy
48e19f0c39 Create ExternalDistributed.md 
Задокументировал новый табличный движок ExternalDistributed.
 2021-06-24 22:29:57 +03:00
Zhichun Wu
f1417adfaf Update JDBC bridge related docs 2021-06-11 17:37:38 +08:00
presto53
e9bd18ebfb
Update s3.md 2021-06-04 17:35:15 +03:00
Nikita Mikhaylov
cf8782faf3
Merge pull request #24311 from nikitamikhaylov/merging-s3-backoff 
Merging #23461
 2021-06-04 14:41:21 +03:00
Vladimir Goncharov
bea934f40c
Update mysql.md 
The MySQL engine also allows to perform `INSERT`
 2021-06-03 20:12:19 +03:00
kssenii
12ea45e956 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into pg-ch-replica 2021-06-01 17:43:34 +00:00
Nikita Mikhaylov
0055a924f6 better 2021-06-01 14:23:46 +00:00
Nikita Mikhaylov
0d8ede15a9
Merge branch 'master' into merging-s3-backoff 2021-05-31 21:07:00 +03:00
Romain Neutron
7b515c7235
Avoid short syntax 2021-05-27 21:44:11 +02:00
mergify[bot]
400b74d186
Merge branch 'master' into merging-s3-backoff 2021-05-25 14:02:38 +00:00
kssenii
a78c9e63e7 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into pg-ch-replica 2021-05-23 12:07:26 +00:00
Azat Khuzhin
4f41ebcae3 Add settings (for connections) for MySQL storage engine 
Default settings are not very efficient, since they do not even reuse
connections.
And when each query requires connection you can have only ~80 QPS, while
by simply enabling connection reuse (connection_auto_close=false) you
can have ~500 QPS (and by increasing connection_pool_size you can have
better QPS throughput).

So this patch allows to pass through some connection related settings
for the StorageMySQL engine, like:
- connection_pool_size=16
- connection_max_tries=3
- connection_auto_close=true

v2: remove connection_pool_default_size
v3: remove num_tries_on_connection_loss
 2021-05-20 22:44:52 +03:00
Nikita Mikhaylov
f33b70c54a better 2021-05-20 00:42:25 +03:00
Vladimir Chebotarev
914116d759 Added documentation. 2021-05-17 10:38:34 +03:00
kssenii
8a4711b716 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into pg-ch-replica 2021-05-16 20:55:18 +00:00
kssenii
85bbfd54e8 Fix bug 2021-05-13 08:53:48 +00:00
kssenii
0955e5f0be Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into pg-ch-replica 2021-05-12 15:11:15 +00:00
Dmitriy
10eaa83a48 Merge remote-tracking branch 'remotes/clickhouse/master' into sevirov-DOCSUP-8940-edit_and_translate_to_russian_deltasumtimestamp 2021-05-10 23:16:58 +03:00
Dmitriy
32cfb29edf Edit and translate to Russian 
Выполнил перевод на русский язык.
 2021-05-10 23:04:35 +03:00
kssenii
ed5c2321cc Some fixes 2021-05-04 10:57:05 +00:00
Vladimir Chebotarev
bc509066ba Added S3 region to documentation. 2021-05-01 20:45:37 +03:00
kssenii
7643d84095 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into pg-ch-replica 2021-04-30 22:02:51 +00:00
Anna
7c5a58304e
Update s3.md 2021-04-25 22:01:38 +03:00
adevyatova
6ae461d766 update 2021-04-25 19:00:19 +00:00
adevyatova
aa1c92f32c update 2021-04-25 08:11:19 +00:00
adevyatova
2504939ed7 fix s3 2021-04-22 19:57:33 +00:00
alexey-milovidov
022b2e918b
Merge pull request #21319 from ka1bi4/romanzhukov-DOCSUP-7086-add-s3-translation-ru 
DOCSUP-7086: Edit and translate to Russian (s3 and updating ClickHouse)
 2021-04-20 23:37:42 +03:00
kssenii
88b50621d4 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into pg-ch-replica 2021-04-18 14:40:37 +00:00
Roman Bug
0dbc167cb3
Merge branch 'master' into romanzhukov-DOCSUP-7086-add-s3-translation-ru 2021-04-15 15:47:12 +03:00
Vladimir Chebotarev
c0ea3ce08a Removed STS client. 2021-04-15 10:01:43 +03:00
Vladimir Chebotarev
3a467ffc50 Attempt to make credentials provider which uses internal credentials provider chain. 2021-04-15 10:01:13 +03:00
Vladimir Chebotarev
037a4de854 Added STS GetCallerIdentity credentials provider. 2021-04-15 10:00:18 +03:00