Commit Graph

273 Commits

Author SHA1 Message Date
Alexey Milovidov
a4d1cacea8 Fixed weird behaviour of system logs [#CLICKHOUSE-4275] 2019-02-04 17:08:39 +03:00
Nikita Lapkov
5c54bbb750 write traces to trace_log 2019-02-03 21:30:45 +00:00
Nikita Lapkov
89582cfef2 Merge branch 'master' into query-poor-mans-profiler 2019-02-03 10:06:05 +00:00
Nikita Lapkov
df3db1bff2 basic pipe 2019-02-03 09:57:12 +00:00
Nicolae Vartolomei
3fdc04428e
Cancel http read only queries if client socket goes away
To check the socket status, try to read one byte from socket in a
non-blocking way:
      0 - client closed the connection
   >= 1 - client send more data, we are ignoring this case for now
timeout - normal case, client is waiting for response
    ... - socket broken?

Dirty, but should do the job. Limiting to readonly queries as I don't
want to mess with alter queries / insert select and others.
2019-02-02 12:14:52 +00:00
Alexey Milovidov
65f8e4d4a8 Merge branch 'master' into global-thread-pool 2019-01-25 16:33:50 +03:00
Ivan Lezhankin
05ab15cc84 Merge IBlockInputStream and IProfilingBlockInputStream into one 2019-01-23 17:48:50 +03:00
Alexey Milovidov
f6b9b06307 Attempt to implemnt global thread pool #4018 2019-01-14 22:22:09 +03:00
Alexey Milovidov
abcd5a2a49 Attempt to implemnt global thread pool #4018 2019-01-11 22:12:36 +03:00
Alexey Milovidov
1d4701b0bc Added some warnings from clang's -Weverything 2019-01-04 15:10:00 +03:00
alesapin
7c11455bd3 Remove compression settings 2018-12-21 15:17:30 +03:00
Alexey Milovidov
e9a3c93ef0 Merged with master #2609 2018-12-14 18:39:48 +03:00
alexey-milovidov
7cc867de0a
Merge branch 'master' into background-processing-pool-backoff 2018-12-14 17:41:55 +03:00
chertus
3db00b7b98 Merge branch 'master' into issue-3578 2018-12-05 14:43:14 +03:00
alesapin
1e879850bb Kill odbc-bridge with clickhouse-server 2018-11-22 18:59:00 +03:00
chertus
65d34ca231 do not override current_database in context [CLICKHOUSE-3578] 2018-11-15 18:03:13 +03:00
chertus
2fe3cdb3f5 restore lost commits [CLICKHOUSE-3578] 2018-11-12 17:52:30 +03:00
chertus
9819c10628 fix build with libcxx 2018-11-07 14:46:39 +03:00
chertus
458e20c31f fix tests/integration over ssl by alesapin@ 2018-11-06 17:42:30 +03:00
chertus
480bee07db hotfix for distributed DDLs over secure port [CLICKHOUSE-4089] 2018-10-25 14:35:19 +03:00
CurtizJ
d0ed96aa04 better code 2018-09-24 22:08:11 +03:00
Alexey Milovidov
5f6328646a utils/check-style/check-style -n #3101 2018-09-24 21:02:25 +03:00
CurtizJ
8f7daa75d1 update comments 2018-09-19 12:34:07 +03:00
CurtizJ
3177f3f6a9 update ddl guard 2018-09-18 21:33:15 +03:00
Anton Popov
8ea2e558b5
Update Context.h 2018-09-11 17:39:01 +03:00
CurtizJ
4ac59b471a fix race while parallel create database 2018-09-11 17:33:06 +03:00
alesapin
16eaeefc6e Fix naming 2018-09-05 15:42:37 +03:00
alesapin
2647c13c6b CLICKHOUSE-3800: Fix naming, move compiled cache size setting to config.xml 2018-09-05 14:37:41 +03:00
alesapin
a7bd2b42e8 CLICKHOUSE-3800: Review fixes 2018-09-03 13:14:05 +03:00
alesapin
6e64067a70 CLICKHOUSE-3800: Move cache to context, change hashing algorithm, add drop instruction for compiled expressions cache 2018-08-30 19:31:20 +03:00
Alexey Milovidov
acb99b49df Merge branch 'master' into CLICKHOUSE-2910 2018-08-14 23:29:42 +03:00
zhang2014
e51264c3a5 Add check access database for system tables 2018-08-14 11:28:32 +08:00
zhang2014
59b25812e7 Add check access database for system tables 2018-08-13 17:35:40 +08:00
Kirill Shvakov
a3ace87046 Add new system table "merge_tree_settings" (#2841)
* #2249 allow macros while creating kafka engine

* Update Macros.cpp

* Update Macros.h

* Add system table: merge_tree_settings
2018-08-10 20:42:12 +03:00
VadimPE
af9b288969 CLICKHOUSE-3714 add function in Context 2018-08-06 12:09:45 +03:00
VadimPE
d0f587bfc9 CLICKHOUSE-3714 fix 2018-08-06 11:58:30 +03:00
VadimPE
6142d9ae6a CLICKHOUSE-3714 fix function names and get partition size 2018-08-03 11:33:57 +03:00
VadimPE
08fe108ba8 CLICKHOUSE-3714 fix methods name 2018-08-02 11:48:57 +03:00
Vadim
034a88a504
Merge branch 'master' into CLICKHOUSE-3714 2018-08-01 20:42:56 +03:00
VadimPE
66d9ba3eb7 CLICKHOUSE-3714 add max_partition_size_to_drop 2018-08-01 20:41:18 +03:00
alesapin
2db2d208e1 CLICKHOUSE-3863: Add HTTPS support for interserver replication 2018-08-01 00:29:47 +03:00
alesapin
6abbfbce87 CLICKHOUSE-3832: Add HTTP Basic authentification in replication protocol 2018-07-26 18:10:57 +03:00
chertus
2cddb4b840 send metadata only for affected table 2018-07-16 17:52:02 +03:00
Alexey Milovidov
0947c7808d Avoid locking while reading config to check part_log #2281 2018-07-08 07:54:37 +03:00
Alexey Milovidov
21508df7c2 Fixed extremely bad code #2313 2018-07-06 03:27:47 +03:00
Vitaliy Lyudvichenko
4cd230f85c Merge remote-tracking branch 'origin/master' into CLICKHOUSE-2910 2018-06-14 16:04:00 +03:00
Vitaliy Lyudvichenko
95b42afcb9 Add test for profile events logging. [#CLICKHOUSE-2910] 2018-06-14 14:56:12 +03:00
proller
01a31414eb
Build fixes (#2474) 2018-06-06 21:41:39 +03:00
Alexey Milovidov
8cb65277e2 Non significant changes according to clang's -Weverything, part 5 [#CLICKHOUSE-2] 2018-06-04 01:11:50 +03:00
Alexey Milovidov
1c2b024c39 Non significant changes according to clang's -Weverything, part 2 [#CLICKHOUSE-2] 2018-06-03 20:43:56 +03:00
Vitaliy Lyudvichenko
2b179b560b Initialize external tables after enqueue query. [#CLICKHOUSE-2910] 2018-06-01 18:32:27 +03:00
Vitaliy Lyudvichenko
0355f81f20 [WIP] Introduced query_thread_log. [#CLICKHOUSE-2910] 2018-05-31 18:54:08 +03:00
proller
dc721ed721 Try make cache for getSampleBlock (#2313)
* Cache for getSampleBlock

* Update InterpreterSelectWithUnionQuery.cpp

* Update 00632_get_sample_block_cache.sql

* Add tests
2018-05-30 22:23:15 +03:00
Vitaliy Lyudvichenko
aa40931824 Merge remote-tracking branch 'origin/master' into CLICKHOUSE-2910 2018-05-28 20:22:27 +03:00
Vitaliy Lyudvichenko
c888903488
Add query ALTER TABLE t1 [REPLACE|ATTACH] PARTITION FROM t2
* Add ATTACH PARTITION FROM table for MergeTree. [#CLICKHOUSE-3546]

* Implemented replicated case on non-leader replica. [#CLICKHOUSE-3546]

* Disable merges in the dropping range. [#CLICKHOUSE-3546]

* DROP PARTITION is atomic and simpler now. [#CLICKHOUSE-3546]

* Implemented more SYSTEM queries. [#CLICKHOUSE-2931] [#CLICKHOUSE-3546]

SYSTEM queries:
RESTART REPLICAS
SYNC REPLICA db.name
STOP MERGES [db.name]
START MERGES [db.name]
STOP FETCHES [db.name]
START FETCHES [db.name]
STOP REPLICATED SENDS [db.name]
START REPLICATED SENDS [db.name]
STOP REPLICATION QUEUES [db.name]
START REPLICATION QUEUES [db.name]

* Fixed a bunch of bugs in REPLACE PARTITION. [#CLICKHOUSE-3546]

* Add tests for REPLACE PARTITION and SYSTEM. [#CLICKHOUSE-3546]

* Add system.part_log logging. [#CLICKHOUSE-3546]

* Fixed long wait in SYNC REPLICA. [#CLICKHOUSE-3546]

* Add requested changes. [#CLICKHOUSE-3546]

Fixed clickhouse-client bad return code.

* Add requested chenges. [#CLICKHOUSE-3546]

* Add requested chenges. [#CLICKHOUSE-3546]
2018-05-21 16:49:54 +03:00
Vitaliy Lyudvichenko
de6c48f4df Merge remote-tracking branch 'origin/master' into CLICKHOUSE-2910 2018-05-14 19:09:00 +03:00
Silviu Caragea
1dd5a704fc Merge remote-tracking branch 'origin/master' into background-schedule-pool-fix
# Conflicts:
#	dbms/src/Common/ZooKeeper/LeaderElection.h
#	dbms/src/Storages/MergeTree/ReplicatedMergeTreeAlterThread.cpp
#	dbms/src/Storages/MergeTree/ReplicatedMergeTreeCleanupThread.cpp
#	dbms/src/Storages/MergeTree/ReplicatedMergeTreePartCheckThread.cpp
#	dbms/src/Storages/StorageReplicatedMergeTree.cpp
2018-04-24 20:11:59 +03:00
Alexey Milovidov
499b67642f Allow to startup with replicated tables in readonly mode when there is no ZooKeeper configured [#CLICKHOUSE-2] 2018-04-21 21:41:06 +03:00
Silviu Caragea
32dd4554da Merge remote-tracking branch 'github/master' into background-schedule-pool-fix
# Conflicts:
#	dbms/src/Storages/StorageReplicatedMergeTree.cpp
2018-04-19 09:29:49 +03:00
Alexey Milovidov
41428e4a11 Allowed to read files by table function "file" inside "user_files_path" #2164 2018-04-19 08:32:09 +03:00
Vitaliy Lyudvichenko
400ad55754 Support allow_databases in distributed DDL. [#CLICKHOUSE-3]
Resolves #2189
2018-04-17 22:33:58 +03:00
Silviu Caragea
c547c5a7b0 Merge remote-tracking branch 'origin/background-schedule-pool-fix'
# Conflicts:
#	dbms/src/Common/ZooKeeper/LeaderElection.h
#	dbms/src/Common/ZooKeeper/ZooKeeper.cpp
#	dbms/src/Storages/MergeTree/ReplicatedMergeTreeAlterThread.cpp
#	dbms/src/Storages/MergeTree/ReplicatedMergeTreeCleanupThread.cpp
#	dbms/src/Storages/MergeTree/ReplicatedMergeTreeCleanupThread.h
#	dbms/src/Storages/MergeTree/ReplicatedMergeTreePartCheckThread.cpp
#	dbms/src/Storages/MergeTree/ReplicatedMergeTreeRestartingThread.cpp
#	dbms/src/Storages/StorageReplicatedMergeTree.cpp
2018-04-10 16:20:14 +03:00
Alexey Milovidov
f5652b4477 Modifications after removing libzookeeper; initialize ZooKeeper session lazily [#CLICKHOUSE-2] 2018-04-03 22:43:33 +03:00
alexey-milovidov
ca5fd1e9de
Merge pull request #2033 from yandex/show-create-database
Show create database
2018-03-28 05:29:36 +03:00
Silviu Caragea
b24a4b2111 Add back the buggy BackgroundSchedulePool 2018-03-22 17:07:12 +02:00
Nikolai Kochetov
d6e9d08d5e getCreateTableQuery and getCreateDatabaseQuery [#CLICKHOUSE-3590] 2018-03-14 15:37:38 +03:00
Alexey Milovidov
8b59db58c3 Fixed uneven code #2032 2018-03-14 02:44:23 +03:00
Nikolai Kochetov
632a2ecabc added SYSTEM RELOAD CONFIG query [#CLICKHOUSE-3591] 2018-03-13 13:41:47 +03:00
Nikolai Kochetov
4dd7f47ad5 reload macros with config [#CLICKHOUSE-3591] 2018-03-12 21:16:51 +03:00
Alexey Milovidov
5ff433b670 Merged Limits to Settings [#CLICKHOUSE-2021] 2018-03-11 03:15:26 +03:00
Alexey Milovidov
afbbd780e3 Fixed error with initialization of PartLog [#CLICKHOUSE-3354] 2018-03-10 22:57:13 +03:00
Alexey Milovidov
8ff0c520d0 Removed the possibility to use queries with empty query_id; better semantics #245 2018-03-10 02:04:26 +03:00
alexey-milovidov
1ecb9dac72
Merge pull request #1901 from zhang2014/fix/ISSUES-117
ISSUES-117 add show create & exist temporary table
2018-03-07 22:53:11 +03:00
Vitaliy Lyudvichenko
efdda9cc9b Introduced ThreadStatus. [#CLICKHOUSE-2910] 2018-03-07 14:35:10 +03:00
zhang2014
361a220743 Merge branch 'master' into fix/ISSUES-117 2018-03-02 19:06:11 +08:00
Alexey Milovidov
7e7fe3c441 Execute table functions once for a query [#CLICKHOUSE-3615] 2018-03-02 08:44:17 +03:00
Alexey Milovidov
280b4663c1 Caching table functions in query context #1947 2018-03-01 04:49:36 +03:00
zhang2014
b89268ceb8 ISSUES-117 add show create & exist temporary table 2018-02-14 12:00:37 +08:00
Vitaliy Lyudvichenko
118b17253e Add system_profile config. [#CLICKHOUSE-3558] 2018-02-01 16:53:44 +03:00
Vitaliy Lyudvichenko
1000328571 Merge remote-tracking branch 'origin/master' into CLICKHOUSE-3346 2018-01-22 20:31:08 +03:00
Vitaliy Lyudvichenko
f20f3f21c4 Update clusters in SYSTEM DROP DNS query. [#CLICKHOUSE-3478] 2018-01-15 17:57:47 +03:00
Vitaliy Lyudvichenko
388d47bbbc Merge branch 'CLICKHOUSE-3346-v310' into CLICKHOUSE-3346 2018-01-11 23:51:30 +03:00
Vitaliy Lyudvichenko
c818beedcb Make data_path creation for Databases optional. [#CLICKHOUSE-2] 2018-01-11 21:55:43 +03:00
Vitaliy Lyudvichenko
ac17c59108 Updated describe query, cluster copier draft. [#CLICKHOUSE-3346] 2018-01-11 21:55:08 +03:00
Alexey Milovidov
fcdd5de47d Revert "Removed questionable code (2) [#CLICKHOUSE-2]."
This reverts commit fcabe8b888.
2017-12-28 07:39:19 +03:00
Alexey Milovidov
c89041ce63 Removed questionable code (2) [#CLICKHOUSE-2]. 2017-12-26 01:51:04 +03:00
Alexey Milovidov
ec71908b00 Revert "Removed questionable code (2) [#CLICKHOUSE-2]."
This reverts commit fcabe8b888.
2017-12-26 00:57:29 +03:00
Alexey Milovidov
fcabe8b888 Removed questionable code (2) [#CLICKHOUSE-2]. 2017-12-26 00:32:33 +03:00
Alexey Zatelepin
6d5ce3fa9a revert BackgroundSchedulePool usage in Replicated tables 2017-12-22 21:25:54 +03:00
alexey-milovidov
1879fe93f1 Update Context.h 2017-11-28 04:12:57 +03:00
alexey-milovidov
7819424e2a Update Context.h 2017-11-28 04:12:57 +03:00
Roman Lipovsky
cf6dd4e73b abstractions: runtime components factory + security manager 2017-11-28 04:12:57 +03:00
Silviu Caragea
dfecd0b2f2 Merge with master 2017-11-18 10:16:06 +02:00
Alexey Milovidov
729b114c15 Removed unsupported functionality [#CLICKHOUSE-2]. 2017-11-18 05:34:00 +03:00
Silviu Caragea
64619c614f Basic idea is :
- We add BackgroundSchedulePool which can execute a function at a specific point in time. Basically all tasks are added in a queue and precessed by worker threads.
- The most important difference between this and BackgroundProcessingPool is that we have the guarantee that the same function is not executed from many workers in the same time
- Each of the following classes instead starting a thread will register a task in BackgroundSchedulePool and when they need to run will call schedule or scheduleAfter(duration) functions

This commit is moving all threads created by ReplicatedMergeTree to BackgroundSchedulePool tasks

NOTE: I did a minimum number of changes to be much simple to review the code
2017-11-17 10:58:35 +02:00
Marek Vavruša
64a892c0e6 DataStreams: CapnProto uses <format_schema_path> config option
This addresses one of the remarks in the PR.

All format schemas are required to be in the <format_schema_path> directory.
This makes loading schema files less tedious, as the path can be omitted.
2017-11-15 23:17:22 +03:00
Nikolai Kochetov
74a4c7508a merged with master 2017-10-20 19:18:09 +03:00
Nikolai Kochetov
fdf258f8ed added ExternalModels to Context [#CLICKHOUSE-3305]
fix build [#CLICKHOUSE-3305]

fix build [#CLICKHOUSE-3305]

fix build [#CLICKHOUSE-3305]

fix build [#CLICKHOUSE-3305]

fix build [#CLICKHOUSE-3305]
2017-10-20 19:13:25 +03:00
Vladimir Chebotarev
1e0241e262 dbms: CompressionSettingsSelector. [#METR-21516] 2017-10-13 04:08:23 +03:00
Alexey Milovidov
d29c77adea Implemented some suggestions from clang-tidy (part 3) [#CLICKHOUSE-3301]. 2017-09-08 06:47:27 +03:00
Vitaliy Lyudvichenko
d55d5eca46 Remove extra Context reference and add required ones. Part 2. [#CLICKHOUSE-3117] 2017-09-06 04:18:07 +03:00
alexey-milovidov
5d14855989 Merge branch 'master' into CLICKHOUSE-2931 2017-08-31 00:23:39 +03:00
Vitaliy Lyudvichenko
1e68d10ce0 Add max_network_bandwidth_for_user limit setting. [#CLICKHOUSE-3139] 2017-08-29 23:23:54 +03:00
Vadim Skipin
4dc36893d3 Keep config in context to avoid Application singleton usages 2017-08-28 22:19:06 +03:00
Vitaliy Lyudvichenko
8fa3364e4e Add SYSTEM RELOAD DICTIONARY(IES) implementation. [#CLICKHOUSE-2931] 2017-08-28 20:27:16 +03:00
Vitaliy Lyudvichenko
48f5d8f1a3 Add SYSTEM DROP DNS CACHE. [#CLICKHOUSE-2931] 2017-08-28 20:27:16 +03:00
Nikolai Kochetov
f8513b932f removed ability to select from external temporary table by query_id 2017-08-15 22:31:40 +03:00
Nikolai Kochetov
9c6f1a1e4b supported drop query for temporary tables [#CLICKHOUSE-3219] 2017-08-15 22:31:40 +03:00
Alexey Milovidov
3e3af1cff4 Misc [#CLICKHOUSE-2]. 2017-07-11 23:12:15 +03:00
Alexey Milovidov
d51245809f Fixed error in SessionCleaner [#CLICKHOUSE-2949]. 2017-06-23 08:53:04 +03:00
Vitaliy Lyudvichenko
2167e4efdd Removed SET GLOBAL query. [#MTRSADMIN-3068]
It even was not supported properly in console client.
2017-06-20 22:26:59 +03:00
Vitaliy Lyudvichenko
a098fb170a Avoid creating multiple global Context. [#CLICKHOUSE-3083] 2017-06-20 10:49:18 +03:00
Vitaliy Lyudvichenko
67fdd0f544 Load the system database first. [#CLICKHOUSE-3044] 2017-06-16 19:08:24 +03:00
alexey-milovidov
a669136ac2 Merge branch 'master' into CLICKHOUSE-5 2017-06-13 07:30:36 +03:00
Alexey Milovidov
45c76803a9 Moved table functions to separate library; fixed errors; improved testability [#CLICKHOUSE-31]. 2017-06-10 12:04:31 +03:00
Alexey Milovidov
9593119a64 Fixed error after merge; tiny modification [#CLICKHOUSE-2]. 2017-06-05 17:40:44 +03:00
Vitaliy Lyudvichenko
1e4906816c Avoid SIGSEGV in SystemLog destructors. [#CLICKHOUSE-3023] 2017-06-05 17:25:10 +03:00
f1yegor
8e261e34c5 translate comments: Interpreters 2017-06-03 19:21:00 +03:00
Alexey Milovidov
efc12f2334 Sessions in HTTP interface: modifications after merge [#CLICKHOUSE-2949]. 2017-06-03 00:01:17 +03:00
Sergey V. Galtsev
07f14e05ee Implement sessions in HTTP interface [#CLICKHOUSE-2949]. 2017-06-02 22:35:05 +03:00
Vitaliy Lyudvichenko
aa7504a7f5 Distributed DDL PR rebase. [#CLICKHOUSE-5] 2017-06-01 13:49:19 +03:00
proller
fac00792f9 Move most AggregateFunctions to separate lib, use AggregateFunctionFactory as singletone, rename lib storages_system->clickhouse_storages_system 2017-05-05 16:59:18 -07:00
Alexey Milovidov
310736cd7e Moved headers and sources to same place [#CLICKHOUSE-3]. 2017-04-01 12:22:42 +03:00