thevar1able/ClickHouse
1
0
Fork 0
mirror of https://github.com/ClickHouse/ClickHouse.git synced 2024-09-30 05:30:51 +00:00
Code Issues Packages Projects Releases Wiki Activity
21,806 Commits 8,961 Branches 1,767 Tags 1.8 GiB
11223939e5
Commit Graph

314 Commits

Author SHA1 Message Date
Vitaliy Lyudvichenko
0355f81f20 [WIP] Introduced query_thread_log. [#CLICKHOUSE-2910] 2018-05-31 18:54:08 +03:00
proller
dc721ed721 Try make cache for getSampleBlock (#2313) 
* Cache for getSampleBlock

* Update InterpreterSelectWithUnionQuery.cpp

* Update 00632_get_sample_block_cache.sql

* Add tests
 2018-05-30 22:23:15 +03:00
Vitaliy Lyudvichenko
c888903488
Add query ALTER TABLE t1 [REPLACE|ATTACH] PARTITION FROM t2 
* Add ATTACH PARTITION FROM table for MergeTree. [#CLICKHOUSE-3546]

* Implemented replicated case on non-leader replica. [#CLICKHOUSE-3546]

* Disable merges in the dropping range. [#CLICKHOUSE-3546]

* DROP PARTITION is atomic and simpler now. [#CLICKHOUSE-3546]

* Implemented more SYSTEM queries. [#CLICKHOUSE-2931] [#CLICKHOUSE-3546]

SYSTEM queries:
RESTART REPLICAS
SYNC REPLICA db.name
STOP MERGES [db.name]
START MERGES [db.name]
STOP FETCHES [db.name]
START FETCHES [db.name]
STOP REPLICATED SENDS [db.name]
START REPLICATED SENDS [db.name]
STOP REPLICATION QUEUES [db.name]
START REPLICATION QUEUES [db.name]

* Fixed a bunch of bugs in REPLACE PARTITION. [#CLICKHOUSE-3546]

* Add tests for REPLACE PARTITION and SYSTEM. [#CLICKHOUSE-3546]

* Add system.part_log logging. [#CLICKHOUSE-3546]

* Fixed long wait in SYNC REPLICA. [#CLICKHOUSE-3546]

* Add requested changes. [#CLICKHOUSE-3546]

Fixed clickhouse-client bad return code.

* Add requested chenges. [#CLICKHOUSE-3546]

* Add requested chenges. [#CLICKHOUSE-3546]
 2018-05-21 16:49:54 +03:00
alexey-milovidov
517318334a
Merge pull request #1722 from silviucpp/background-schedule-pool-fix 
Background schedule pool fixed
 2018-05-19 19:00:43 +03:00
Vitaliy Lyudvichenko
1f05000c2c Better naming. [#CLICKHOUSE-3645] 2018-05-09 07:55:08 +03:00
Vitaliy Lyudvichenko
8fd72a6777 Add automatic DROP DNS CACHE, update of SYSTEM queries. [#CLICKHOUSE-3645] 2018-05-09 07:55:08 +03:00
Silviu Caragea
1dd5a704fc Merge remote-tracking branch 'origin/master' into background-schedule-pool-fix 
# Conflicts:
#	dbms/src/Common/ZooKeeper/LeaderElection.h
#	dbms/src/Storages/MergeTree/ReplicatedMergeTreeAlterThread.cpp
#	dbms/src/Storages/MergeTree/ReplicatedMergeTreeCleanupThread.cpp
#	dbms/src/Storages/MergeTree/ReplicatedMergeTreePartCheckThread.cpp
#	dbms/src/Storages/StorageReplicatedMergeTree.cpp
 2018-04-24 20:11:59 +03:00
Alexey Milovidov
499b67642f Allow to startup with replicated tables in readonly mode when there is no ZooKeeper configured [#CLICKHOUSE-2] 2018-04-21 21:41:06 +03:00
Silviu Caragea
32dd4554da Merge remote-tracking branch 'github/master' into background-schedule-pool-fix 
# Conflicts:
#	dbms/src/Storages/StorageReplicatedMergeTree.cpp
 2018-04-19 09:29:49 +03:00
Alexey Milovidov
41428e4a11 Allowed to read files by table function "file" inside "user_files_path" #2164 2018-04-19 08:32:09 +03:00
alexey-milovidov
089e71d9a5
Merge pull request #2235 from yandex/small-enhancements 
Small enhancements
 2018-04-17 22:45:01 +03:00
Vitaliy Lyudvichenko
400ad55754 Support allow_databases in distributed DDL. [#CLICKHOUSE-3] 
Resolves #2189
 2018-04-17 22:33:58 +03:00
proller
157067b127 CLICKHOUSE-3700: Fix empty password on replica query 2018-04-10 17:49:52 +03:00
Silviu Caragea
c547c5a7b0 Merge remote-tracking branch 'origin/background-schedule-pool-fix' 
# Conflicts:
#	dbms/src/Common/ZooKeeper/LeaderElection.h
#	dbms/src/Common/ZooKeeper/ZooKeeper.cpp
#	dbms/src/Storages/MergeTree/ReplicatedMergeTreeAlterThread.cpp
#	dbms/src/Storages/MergeTree/ReplicatedMergeTreeCleanupThread.cpp
#	dbms/src/Storages/MergeTree/ReplicatedMergeTreeCleanupThread.h
#	dbms/src/Storages/MergeTree/ReplicatedMergeTreePartCheckThread.cpp
#	dbms/src/Storages/MergeTree/ReplicatedMergeTreeRestartingThread.cpp
#	dbms/src/Storages/StorageReplicatedMergeTree.cpp
 2018-04-10 16:20:14 +03:00
Alexey Milovidov
76e822274a Better exception messages [#CLICKHOUSE-2] 2018-04-04 00:29:11 +03:00
Alexey Milovidov
f5652b4477 Modifications after removing libzookeeper; initialize ZooKeeper session lazily [#CLICKHOUSE-2] 2018-04-03 22:43:33 +03:00
alexey-milovidov
a220a43b8e
Merge branch 'master' into fix-detach-database 2018-03-29 03:01:07 +03:00
alexey-milovidov
ca5fd1e9de
Merge pull request #2033 from yandex/show-create-database 
Show create database
 2018-03-28 05:29:36 +03:00
Nikolai Kochetov
d63d9a4ffb fix test [#CLICKHOUSE-3590] 2018-03-26 18:48:19 +03:00
Alexey Zatelepin
cf3c24d07d break cycle of ptrs to StorageReplicatedMergeTree [#CLICKHOUSE-3664] 2018-03-23 23:30:04 +03:00
Silviu Caragea
b24a4b2111 Add back the buggy BackgroundSchedulePool 2018-03-22 17:07:12 +02:00
Nikolai Kochetov
d6e9d08d5e getCreateTableQuery and getCreateDatabaseQuery [#CLICKHOUSE-3590] 2018-03-14 15:37:38 +03:00
Alexey Milovidov
8b59db58c3 Fixed uneven code #2032 2018-03-14 02:44:23 +03:00
alexey-milovidov
165de1bc36
Update Context.cpp 2018-03-14 02:03:00 +03:00
Nikolai Kochetov
632a2ecabc added SYSTEM RELOAD CONFIG query [#CLICKHOUSE-3591] 2018-03-13 13:41:47 +03:00
Nikolai Kochetov
4dd7f47ad5 reload macros with config [#CLICKHOUSE-3591] 2018-03-12 21:16:51 +03:00
Alexey Milovidov
5ff433b670 Merged Limits to Settings [#CLICKHOUSE-2021] 2018-03-11 03:15:26 +03:00
Alexey Milovidov
afbbd780e3 Fixed error with initialization of PartLog [#CLICKHOUSE-3354] 2018-03-10 22:57:13 +03:00
Alexey Milovidov
65b95580f3 Removed useless code [#CLICKHOUSE-2] 2018-03-09 21:39:14 +03:00
alexey-milovidov
1ecb9dac72
Merge pull request #1901 from zhang2014/fix/ISSUES-117 
ISSUES-117 add show create & exist temporary table
 2018-03-07 22:53:11 +03:00
alexey-milovidov
4ce15695d7
Update Context.cpp 2018-03-07 22:43:13 +03:00
alexey-milovidov
2bb80baae5
Update Context.cpp 2018-03-07 22:33:40 +03:00
zhang2014
361a220743 Merge branch 'master' into fix/ISSUES-117 2018-03-02 19:06:11 +08:00
Alexey Milovidov
7e7fe3c441 Execute table functions once for a query [#CLICKHOUSE-3615] 2018-03-02 08:44:17 +03:00
Alexey Milovidov
651a312896 Added ProfileEvent for table function executions [#CLICKHOUSE-3615] 2018-03-02 08:03:28 +03:00
Alexey Milovidov
0213071683 Merge remote-tracking branch 'origin/master' into better-union-all-try2 2018-03-01 09:18:59 +03:00
Alexey Milovidov
280b4663c1 Caching table functions in query context #1947 2018-03-01 04:49:36 +03:00
proller
d6a1f8470f CLICKHOUSE-3553 Rebuild loggers on every config change (#1973) 
* Macos test fix

* Fix freebsd build

* CLICKHOUSE-3553 Rebuild loggers on every config change

* rename clickhouse_common_configprocessor -> clickhouse_common_config; move Server/ConfigReloader.cpp -> Common/Config/

* CLICKHOUSE-3553 Set new level to all loggers on reload

* Dont use hash

* Update BaseDaemon.h
 2018-02-28 23:34:25 +03:00
Alexey Milovidov
c86fd31097 Addition to prev. revision [#CLICKHOUSE-2] 2018-02-25 05:23:04 +03:00
zhang2014
01261181ae ISSUES-117 use reference 2018-02-23 10:15:09 +08:00
alexey-milovidov
3844b129f4
Update Context.cpp 2018-02-22 03:38:05 +03:00
Kirill Shvakov
ddb618b1d7 Use custom expr for query log 2018-02-14 10:01:41 +02:00
Kirill Shvakov
034566fff3 Use custom partition key for the query logs table 2018-02-14 09:24:26 +02:00
zhang2014
b89268ceb8 ISSUES-117 add show create & exist temporary table 2018-02-14 12:00:37 +08:00
Vitaliy Lyudvichenko
118b17253e Add system_profile config. [#CLICKHOUSE-3558] 2018-02-01 16:53:44 +03:00
Vitaliy Lyudvichenko
1000328571 Merge remote-tracking branch 'origin/master' into CLICKHOUSE-3346 2018-01-22 20:31:08 +03:00
alexey-milovidov
7a25b441f4
Merge pull request #1773 from yandex/small-enhancements 
Small enhancements
 2018-01-16 22:07:43 +03:00
proller
d97b2edc7c Make separate libs Common/ZooKeeper and Common/ConfigProcessor (#1749) 
* Make separate libs Common/ZooKeeper and Common/ConfigProcessor
renamed:    dbms/src/Common/StringUtils.h -> dbms/src/Common/StringUtils/StringUtils.h

* Fix space

* Fix data in system.build_options

* merge

* merge
 2018-01-15 22:07:47 +03:00
Vitaliy Lyudvichenko
f20f3f21c4 Update clusters in SYSTEM DROP DNS query. [#CLICKHOUSE-3478] 2018-01-15 17:57:47 +03:00
Vitaliy Lyudvichenko
388d47bbbc Merge branch 'CLICKHOUSE-3346-v310' into CLICKHOUSE-3346 2018-01-11 23:51:30 +03:00
Vitaliy Lyudvichenko
c818beedcb Make data_path creation for Databases optional. [#CLICKHOUSE-2] 2018-01-11 21:55:43 +03:00
Vitaliy Lyudvichenko
ac17c59108 Updated describe query, cluster copier draft. [#CLICKHOUSE-3346] 2018-01-11 21:55:08 +03:00
Alexey Zatelepin
6d5ce3fa9a revert BackgroundSchedulePool usage in Replicated tables 2017-12-22 21:25:54 +03:00
Alexey Milovidov
431da20d99 Better [#CLICKHOUSE-2]. 2017-12-01 23:21:35 +03:00
alexey-milovidov
0ac2f5b479
Merge pull request #1559 from rlipovsky/geodata 
[clickhouse-yt] separate geo dictionaries from data providers
 2017-12-01 19:54:08 +03:00
alexey-milovidov
493e7a4976
Merge pull request #1571 from rlipovsky/get_user_by_ptr 
[clickhouse-yt] more consistent ISecurityManager interface
 2017-12-01 19:43:00 +03:00
alexey-milovidov
66fdecf6ec
Merge branch 'master' into geodata 2017-12-01 19:25:27 +03:00
Roman Lipovsky
430837706c more consistent ISecurityManager interface: return shared pointer to User to prevent race conditions with loadFromConfig 2017-11-30 17:53:12 +03:00
Roman Lipovsky
9ed1ba2441 separate geo dictionaries from geo data providers 2017-11-29 01:15:06 +03:00
Roman Lipovsky
639d850d97 abstract config repository of user-defined objects (dictionaries, models) 2017-11-28 14:00:07 +03:00
Roman Lipovsky
cf6dd4e73b abstractions: runtime components factory + security manager 2017-11-28 04:12:57 +03:00
Alexey Milovidov
60825748d4 Merge branch 'fix11' of https://github.com/proller/ClickHouse into proller-fix11 2017-11-19 22:57:28 +03:00
Alexey Milovidov
f497b0c63c BackgroundSchedulePool: miscellaneous; added TODO [#CLICKHOUSE-2]. 2017-11-19 03:08:37 +03:00
Silviu Caragea
dfecd0b2f2 Merge with master 2017-11-18 10:16:06 +02:00
Alexey Milovidov
729b114c15 Removed unsupported functionality [#CLICKHOUSE-2]. 2017-11-18 05:34:00 +03:00
proller
5ba7e20c03 fixes 2017-11-17 22:40:27 +03:00
Silviu Caragea
64619c614f Basic idea is : 
- We add BackgroundSchedulePool which can execute a function at a specific point in time. Basically all tasks are added in a queue and precessed by worker threads.
- The most important difference between this and BackgroundProcessingPool is that we have the guarantee that the same function is not executed from many workers in the same time
- Each of the following classes instead starting a thread will register a task in BackgroundSchedulePool and when they need to run will call schedule or scheduleAfter(duration) functions

This commit is moving all threads created by ReplicatedMergeTree to BackgroundSchedulePool tasks

NOTE: I did a minimum number of changes to be much simple to review the code
 2017-11-17 10:58:35 +02:00
Marek Vavruša
64a892c0e6 DataStreams: CapnProto uses <format_schema_path> config option 
This addresses one of the remarks in the PR.

All format schemas are required to be in the <format_schema_path> directory.
This makes loading schema files less tedious, as the path can be omitted.
 2017-11-15 23:17:22 +03:00
alexey-milovidov
56ef2e9196
Merge pull request #1380 from yandex/catboost-models 
Catboost models
 2017-10-30 19:16:41 +03:00
Alexey Zatelepin
f130d2df65 fix creation of system log tables [#CLICKHOUSE-2] 2017-10-26 15:44:47 +03:00
Nikolai Kochetov
74a4c7508a merged with master 2017-10-20 19:18:09 +03:00
Nikolai Kochetov
fdf258f8ed added ExternalModels to Context [#CLICKHOUSE-3305] 
fix build [#CLICKHOUSE-3305]

fix build [#CLICKHOUSE-3305]

fix build [#CLICKHOUSE-3305]

fix build [#CLICKHOUSE-3305]

fix build [#CLICKHOUSE-3305]
 2017-10-20 19:13:25 +03:00
alexey-milovidov
9ccdb5420b Merge branch 'master' into upstream-add-kafka 2017-10-13 23:52:42 +03:00
alexey-milovidov
3a1ce26764 Update Context.cpp 2017-10-13 21:46:32 +03:00
proller
c0e9813b90 Fix access for inserting into temporary table (#CLICKHOUSE-3360) 2017-10-13 21:46:32 +03:00
Vladimir Chebotarev
1e0241e262 dbms: CompressionSettingsSelector. [#METR-21516] 2017-10-13 04:08:23 +03:00
Marek Vavruša
4fb570fa5e IStorage: allow notification on dependency change 
This allows sending notifications to supported
table engines when their dependencies change.
For example, a table can be notified when a
MATERIALIZED VIEW is attached to it.

This is a building block for building pipelines.
 2017-10-10 08:33:00 -07:00
Vadim Skipin
e0a1e6982b Context parameter added to the IDatabase methods 2017-09-11 21:29:26 +03:00
Alexey Milovidov
cd540c2674 Replaced Mersenne Twister to PCG-Random [#CLICKHOUSE-2]. 2017-09-10 02:17:38 +03:00
Alexey Milovidov
d29c77adea Implemented some suggestions from clang-tidy (part 3) [#CLICKHOUSE-3301]. 2017-09-08 06:47:27 +03:00
Alexey Milovidov
8b313ab99e Fixed warnings found by cppcheck [#CLICKHOUSE-3300]. 2017-09-08 00:04:48 +03:00
Vitaliy Lyudvichenko
d55d5eca46 Remove extra Context reference and add required ones. Part 2. [#CLICKHOUSE-3117] 2017-09-06 04:18:07 +03:00
alexey-milovidov
aa2d29f5f9 Update ReadWriteBufferFromHTTP.cpp, Context.cpp, etc 
Update ASTSystemQuery.cpp

Update ASTSystemQuery.h

Update dictionary_clickhouse_cache.xml

Update dictionary_clickhouse_flat.xml
 2017-08-31 13:26:02 +03:00
alexey-milovidov
5d14855989 Merge branch 'master' into CLICKHOUSE-2931 2017-08-31 00:23:39 +03:00
Vitaliy Lyudvichenko
1e68d10ce0 Add max_network_bandwidth_for_user limit setting. [#CLICKHOUSE-3139] 2017-08-29 23:23:54 +03:00
Vadim Skipin
4dc36893d3 Keep config in context to avoid Application singleton usages 2017-08-28 22:19:06 +03:00
Vitaliy Lyudvichenko
8fa3364e4e Add SYSTEM RELOAD DICTIONARY(IES) implementation. [#CLICKHOUSE-2931] 2017-08-28 20:27:16 +03:00
Vitaliy Lyudvichenko
48f5d8f1a3 Add SYSTEM DROP DNS CACHE. [#CLICKHOUSE-2931] 2017-08-28 20:27:16 +03:00
Alberto
727ca81998 Fixed typo 2017-08-16 14:08:02 +03:00
Nikolai Kochetov
f8513b932f removed ability to select from external temporary table by query_id 2017-08-15 22:31:40 +03:00
Nikolai Kochetov
9c6f1a1e4b supported drop query for temporary tables [#CLICKHOUSE-3219] 2017-08-15 22:31:40 +03:00
Alexey Milovidov
86eb4d2d06 Renamed Singleton to avoid conflicts with Arcadia* codebase [#DEVTOOLS-3343]. 
* - "Arcadia" is the name of Yandex's monorepo.
 2017-07-10 07:34:14 +03:00
Vitaliy Lyudvichenko
2167e4efdd Removed SET GLOBAL query. [#MTRSADMIN-3068] 
It even was not supported properly in console client.
 2017-06-20 22:26:59 +03:00
Vitaliy Lyudvichenko
353dba545d Correct cascade of user setting calculation. [#MTRSADMIN-3068] [#CLICKHOUSE-2906] 2017-06-20 22:26:59 +03:00
Vitaliy Lyudvichenko
534b766250 CREATE of MergeTree checks that data dir is empty. [#CLICKHOUSE-3083] 2017-06-20 10:49:18 +03:00
Vitaliy Lyudvichenko
515ffa5262 Add extra check. [#CLICKHOUSE-3083] 2017-06-20 10:49:18 +03:00
Vitaliy Lyudvichenko
a098fb170a Avoid creating multiple global Context. [#CLICKHOUSE-3083] 2017-06-20 10:49:18 +03:00
Alexey Milovidov
05accbdcbe Removed cyclic dependency [#DEVTOOLS-3381]. 2017-06-19 23:06:35 +03:00
Vitaliy Lyudvichenko
67fdd0f544 Load the system database first. [#CLICKHOUSE-3044] 2017-06-16 19:08:24 +03:00
alexey-milovidov
a669136ac2 Merge branch 'master' into CLICKHOUSE-5 2017-06-13 07:30:36 +03:00