Commit Graph

553 Commits

Author SHA1 Message Date
Vitaly Baranov
6d96443440 Resolve correctly when dictionary depends on dictionary 2019-04-15 20:40:45 +03:00
Nikita Lapkov
fbdf2c3525 Merge remote-tracking branch 'upstream/master' into query-poor-mans-profiler 2019-04-06 06:58:40 +00:00
Igor Mineev
563ab2a5ec Merge remote-tracking branch 'upstream/master' into feature_multiple_disks 2019-04-05 23:07:24 +03:00
Igor Mineev
968b7286e2 Stylefixes. 2019-04-05 20:37:27 +03:00
Igor Mineev
0b1a33c722 Format file moved to default. Add default Storage configuration 2019-04-05 15:30:26 +03:00
Igor Mineev
7824aa528f Add Schemes to config. Parse scheme as default on MergeTreeData init 2019-04-04 20:19:11 +03:00
Nikolai Kochetov
5e39ec610c Merged with master 2019-04-03 14:21:38 +03:00
Nikolai Kochetov
94ff7f694a QueryPipeline [in progress]. 2019-04-03 13:14:36 +03:00
Ivan
957d23267b
Minimal implementation of row-level security CLICKHOUSE-4315 (#4792)
For detailed description see the related PR
2019-03-29 23:31:06 +03:00
Nikita Lapkov
4a4ff8d5bf Merge remote-tracking branch 'upstream/master' into query-poor-mans-profiler 2019-03-23 18:45:22 +00:00
alexey-milovidov
efc2d91507
Merge pull request #4764 from proller/fix23
Move Interpreters/Settings* -> Core/Settings*
2019-03-22 17:49:19 +03:00
proller
fce9db12b9 Move Interpreters/Settings* -> Core/Settings* 2019-03-22 15:08:30 +03:00
Alexey Milovidov
41fede9c6b Fixed TSan report on shutdown 2019-03-21 22:22:38 +03:00
Ivan
8ac3e89628
Merge pull request #4649 from abyss7/iast-as
Implement and use method IAST::as<Derived>()
2019-03-15 23:22:46 +03:00
Alexey Milovidov
aea3bd2cc9 Fixed potential deadlock in ExternalDictionaries 2019-03-15 03:29:53 +03:00
Ivan Lezhankin
d1ead22073 Rename As<…> → as<…> 2019-03-11 16:22:51 +03:00
Nikita Lapkov
1ea971ddd2 Merge remote-tracking branch 'upstream/master' into query-poor-mans-profiler 2019-03-10 01:56:41 +00:00
Ivan Lezhankin
0e325c7a4a Replace const typeid_casts with As<Derived>() method invocations 2019-03-08 12:48:20 +03:00
Maxim Akhmedov
9a56294fdf CHYT-67: introduce host context for using CH as a library. 2019-03-06 19:47:47 +03:00
Nikita Lapkov
ce4e48d6f4 Merge branch 'master' into query-poor-mans-profiler 2019-03-01 14:22:38 +00:00
alexey-milovidov
9d8b91b97a
Merge pull request #4483 from yandex/dont-create-part-log-if-not-defined
Do not create part_log if it is not defined in configuration file
2019-02-24 18:27:50 +03:00
Alexey Milovidov
85c0ba1e70 Do not create part_log if it is not defined in configuration file 2019-02-22 19:10:14 +03:00
Alexey Zatelepin
73f852ae82 manually reset DDLWorker in shared context to prevent reference cycles 2019-02-21 19:41:27 +03:00
Alexey Milovidov
0861af12a3 Fixed thread names 2019-02-11 00:15:14 +03:00
alexey-milovidov
0dd618b9ad
Merge pull request #4326 from yandex/duplicate-includes
Removed duplicate includes
2019-02-10 22:31:37 +03:00
Alexey Milovidov
ba3cb83a84 Removed duplicate includes 2019-02-10 20:12:22 +03:00
Alexey Milovidov
58a6accee5 Updated test #4246 2019-02-10 19:55:12 +03:00
Nikita Lapkov
628c282112 fix style 2019-02-09 22:40:47 +00:00
Nikita Lapkov
7c0339bc5e fix unresolved conflicts 2019-02-09 22:26:51 +00:00
Nikita Lapkov
b8d78807fe Merge remote-tracking branch 'parent/master' into query-poor-mans-profiler 2019-02-09 21:45:34 +00:00
Nikita Lapkov
5f585948c1 review fix. stop TraceCollector gracefully 2019-02-09 21:40:10 +00:00
Alexey Milovidov
596234e55c System logs: simplification 2019-02-06 21:33:29 +03:00
Alexey Milovidov
29c3195742 Removed bad code; fixed error 2019-02-05 02:18:04 +03:00
Alexey Milovidov
f4ee9f4db8 Merge branch 'master' of github.com:yandex/ClickHouse into fix-system-log-create-on-shutdown 2019-02-04 22:02:10 +03:00
Alexey Milovidov
a4d1cacea8 Fixed weird behaviour of system logs [#CLICKHOUSE-4275] 2019-02-04 17:08:39 +03:00
Nikita Lapkov
5c54bbb750 write traces to trace_log 2019-02-03 21:30:45 +00:00
Nikita Lapkov
89582cfef2 Merge branch 'master' into query-poor-mans-profiler 2019-02-03 10:06:05 +00:00
Nikita Lapkov
df3db1bff2 basic pipe 2019-02-03 09:57:12 +00:00
Nicolae Vartolomei
3fdc04428e
Cancel http read only queries if client socket goes away
To check the socket status, try to read one byte from socket in a
non-blocking way:
      0 - client closed the connection
   >= 1 - client send more data, we are ignoring this case for now
timeout - normal case, client is waiting for response
    ... - socket broken?

Dirty, but should do the job. Limiting to readonly queries as I don't
want to mess with alter queries / insert select and others.
2019-02-02 12:14:52 +00:00
maiha
6c83beafdd dbms: Fixed misspells in comments 2019-01-23 04:56:53 +09:00
Alexey Milovidov
1d4701b0bc Added some warnings from clang's -Weverything 2019-01-04 15:10:00 +03:00
Alexey Milovidov
e33e5150b7 Miscellaneous [#CLICKHOUSE-2] 2019-01-02 09:44:36 +03:00
alesapin
7c11455bd3 Remove compression settings 2018-12-21 15:17:30 +03:00
Alexey Milovidov
e9a3c93ef0 Merged with master #2609 2018-12-14 18:39:48 +03:00
alexey-milovidov
7cc867de0a
Merge branch 'master' into background-processing-pool-backoff 2018-12-14 17:41:55 +03:00
alesapin
1e879850bb Kill odbc-bridge with clickhouse-server 2018-11-22 18:59:00 +03:00
chertus
458e20c31f fix tests/integration over ssl by alesapin@ 2018-11-06 17:42:30 +03:00
chertus
480bee07db hotfix for distributed DDLs over secure port [CLICKHOUSE-4089] 2018-10-25 14:35:19 +03:00
CurtizJ
d0ed96aa04 better code 2018-09-24 22:08:11 +03:00
Alexey Milovidov
5f6328646a utils/check-style/check-style -n #3101 2018-09-24 21:02:25 +03:00
alexey-milovidov
76cb9ff873
Update Context.cpp 2018-09-22 18:22:54 +03:00
CurtizJ
8f7daa75d1 update comments 2018-09-19 12:34:07 +03:00
CurtizJ
3177f3f6a9 update ddl guard 2018-09-18 21:33:15 +03:00
Anton Popov
5ce76ce12f
Update Context.cpp 2018-09-11 17:38:36 +03:00
CurtizJ
4ac59b471a fix race while parallel create database 2018-09-11 17:33:06 +03:00
alesapin
16eaeefc6e Fix naming 2018-09-05 15:42:37 +03:00
alesapin
2647c13c6b CLICKHOUSE-3800: Fix naming, move compiled cache size setting to config.xml 2018-09-05 14:37:41 +03:00
alesapin
a7bd2b42e8 CLICKHOUSE-3800: Review fixes 2018-09-03 13:14:05 +03:00
alesapin
650d15696f CLICKHOUSE-3800: Add memory comsumption profile_event of compiled expression cache 2018-08-31 15:39:27 +03:00
alesapin
ac6ab62c6f CLICKHOUSE-3800: Remove use after free of context 2018-08-31 13:27:08 +03:00
alesapin
6bfde2825e Fix conflict 2018-08-30 22:23:00 +03:00
alesapin
6e64067a70 CLICKHOUSE-3800: Move cache to context, change hashing algorithm, add drop instruction for compiled expressions cache 2018-08-30 19:31:20 +03:00
VadimPE
81893ae577 Fix error message 2018-08-30 12:33:31 +03:00
Max Akhmedov
d5ccd26348
More verbose access denied error message 2018-08-23 21:44:13 +03:00
proller
159cdbbb3e Try fix build (link order) 2018-08-20 18:34:37 +03:00
Alexey Milovidov
acb99b49df Merge branch 'master' into CLICKHOUSE-2910 2018-08-14 23:29:42 +03:00
zhang2014
e51264c3a5 Add check access database for system tables 2018-08-14 11:28:32 +08:00
zhang2014
59b25812e7 Add check access database for system tables 2018-08-13 17:35:40 +08:00
Kirill Shvakov
a3ace87046 Add new system table "merge_tree_settings" (#2841)
* #2249 allow macros while creating kafka engine

* Update Macros.cpp

* Update Macros.h

* Add system table: merge_tree_settings
2018-08-10 20:42:12 +03:00
VadimPE
af9b288969 CLICKHOUSE-3714 add function in Context 2018-08-06 12:09:45 +03:00
VadimPE
d0f587bfc9 CLICKHOUSE-3714 fix 2018-08-06 11:58:30 +03:00
VadimPE
c30d459168 CLICKHOUSE-3714 fix 2018-08-06 11:43:34 +03:00
VadimPE
93202ca781 CLICKHOUSE-3714 fix code-style and copy-paste 2018-08-06 11:25:29 +03:00
VadimPE
6142d9ae6a CLICKHOUSE-3714 fix function names and get partition size 2018-08-03 11:33:57 +03:00
VadimPE
08fe108ba8 CLICKHOUSE-3714 fix methods name 2018-08-02 11:48:57 +03:00
Vadim
f6736a0e6e
Update Context.cpp 2018-08-01 20:44:23 +03:00
Vadim
034a88a504
Merge branch 'master' into CLICKHOUSE-3714 2018-08-01 20:42:56 +03:00
VadimPE
66d9ba3eb7 CLICKHOUSE-3714 add max_partition_size_to_drop 2018-08-01 20:41:18 +03:00
alesapin
2db2d208e1 CLICKHOUSE-3863: Add HTTPS support for interserver replication 2018-08-01 00:29:47 +03:00
alesapin
6abbfbce87 CLICKHOUSE-3832: Add HTTP Basic authentification in replication protocol 2018-07-26 18:10:57 +03:00
Alexey Milovidov
0947c7808d Avoid locking while reading config to check part_log #2281 2018-07-08 07:54:37 +03:00
Alexey Milovidov
21508df7c2 Fixed extremely bad code #2313 2018-07-06 03:27:47 +03:00
alexey-milovidov
3904ba561f
Merge branch 'master' into CLICKHOUSE-2910 2018-06-28 20:47:25 +03:00
Nikolai Kochetov
ebde528506 Create default macros in global context. [#CLICKHOUSE-3793] 2018-06-28 17:11:09 +03:00
Vitaliy Lyudvichenko
4cd230f85c Merge remote-tracking branch 'origin/master' into CLICKHOUSE-2910 2018-06-14 16:04:00 +03:00
Vitaliy Lyudvichenko
95b42afcb9 Add test for profile events logging. [#CLICKHOUSE-2910] 2018-06-14 14:56:12 +03:00
alexey-milovidov
fafecb3c25
Better modularity of formats. (#2492)
* Formats: better modularity (development) #2447

* Formats: better modularity (development) #2447

* Formats: better modularity (development) #2447

* Formats: better modularity (development) #2447

* Formats: better modularity (development) #2447

* Formats: better modularity (development): removed very old tests #2447

* Formats: better modularity (development) #2447

* Formats: better modularity (development) #2447

* Formats: better modularity (development) #2447

* Formats: better modularity (development) #2447

* Formats: better modularity (development) #2447

* Formats: better modularity (development) #2447

* Formats: better modularity (development) #2447

* Formats: better modularity (development) #2447
2018-06-10 22:22:49 +03:00
Alexey Milovidov
583b9af56f Fixed error: user settings don't apply when using session_id parameter [#CLICKHOUSE-3763] 2018-06-06 20:35:35 +03:00
Vitaliy Lyudvichenko
2b179b560b Initialize external tables after enqueue query. [#CLICKHOUSE-2910] 2018-06-01 18:32:27 +03:00
Vitaliy Lyudvichenko
0355f81f20 [WIP] Introduced query_thread_log. [#CLICKHOUSE-2910] 2018-05-31 18:54:08 +03:00
proller
dc721ed721 Try make cache for getSampleBlock (#2313)
* Cache for getSampleBlock

* Update InterpreterSelectWithUnionQuery.cpp

* Update 00632_get_sample_block_cache.sql

* Add tests
2018-05-30 22:23:15 +03:00
Vitaliy Lyudvichenko
c888903488
Add query ALTER TABLE t1 [REPLACE|ATTACH] PARTITION FROM t2
* Add ATTACH PARTITION FROM table for MergeTree. [#CLICKHOUSE-3546]

* Implemented replicated case on non-leader replica. [#CLICKHOUSE-3546]

* Disable merges in the dropping range. [#CLICKHOUSE-3546]

* DROP PARTITION is atomic and simpler now. [#CLICKHOUSE-3546]

* Implemented more SYSTEM queries. [#CLICKHOUSE-2931] [#CLICKHOUSE-3546]

SYSTEM queries:
RESTART REPLICAS
SYNC REPLICA db.name
STOP MERGES [db.name]
START MERGES [db.name]
STOP FETCHES [db.name]
START FETCHES [db.name]
STOP REPLICATED SENDS [db.name]
START REPLICATED SENDS [db.name]
STOP REPLICATION QUEUES [db.name]
START REPLICATION QUEUES [db.name]

* Fixed a bunch of bugs in REPLACE PARTITION. [#CLICKHOUSE-3546]

* Add tests for REPLACE PARTITION and SYSTEM. [#CLICKHOUSE-3546]

* Add system.part_log logging. [#CLICKHOUSE-3546]

* Fixed long wait in SYNC REPLICA. [#CLICKHOUSE-3546]

* Add requested changes. [#CLICKHOUSE-3546]

Fixed clickhouse-client bad return code.

* Add requested chenges. [#CLICKHOUSE-3546]

* Add requested chenges. [#CLICKHOUSE-3546]
2018-05-21 16:49:54 +03:00
alexey-milovidov
517318334a
Merge pull request #1722 from silviucpp/background-schedule-pool-fix
Background schedule pool fixed
2018-05-19 19:00:43 +03:00
Vitaliy Lyudvichenko
1f05000c2c Better naming. [#CLICKHOUSE-3645] 2018-05-09 07:55:08 +03:00
Vitaliy Lyudvichenko
8fd72a6777 Add automatic DROP DNS CACHE, update of SYSTEM queries. [#CLICKHOUSE-3645] 2018-05-09 07:55:08 +03:00
Silviu Caragea
1dd5a704fc Merge remote-tracking branch 'origin/master' into background-schedule-pool-fix
# Conflicts:
#	dbms/src/Common/ZooKeeper/LeaderElection.h
#	dbms/src/Storages/MergeTree/ReplicatedMergeTreeAlterThread.cpp
#	dbms/src/Storages/MergeTree/ReplicatedMergeTreeCleanupThread.cpp
#	dbms/src/Storages/MergeTree/ReplicatedMergeTreePartCheckThread.cpp
#	dbms/src/Storages/StorageReplicatedMergeTree.cpp
2018-04-24 20:11:59 +03:00
Alexey Milovidov
499b67642f Allow to startup with replicated tables in readonly mode when there is no ZooKeeper configured [#CLICKHOUSE-2] 2018-04-21 21:41:06 +03:00
Silviu Caragea
32dd4554da Merge remote-tracking branch 'github/master' into background-schedule-pool-fix
# Conflicts:
#	dbms/src/Storages/StorageReplicatedMergeTree.cpp
2018-04-19 09:29:49 +03:00
Alexey Milovidov
41428e4a11 Allowed to read files by table function "file" inside "user_files_path" #2164 2018-04-19 08:32:09 +03:00
alexey-milovidov
089e71d9a5
Merge pull request #2235 from yandex/small-enhancements
Small enhancements
2018-04-17 22:45:01 +03:00
Vitaliy Lyudvichenko
400ad55754 Support allow_databases in distributed DDL. [#CLICKHOUSE-3]
Resolves #2189
2018-04-17 22:33:58 +03:00
proller
157067b127 CLICKHOUSE-3700: Fix empty password on replica query 2018-04-10 17:49:52 +03:00
Silviu Caragea
c547c5a7b0 Merge remote-tracking branch 'origin/background-schedule-pool-fix'
# Conflicts:
#	dbms/src/Common/ZooKeeper/LeaderElection.h
#	dbms/src/Common/ZooKeeper/ZooKeeper.cpp
#	dbms/src/Storages/MergeTree/ReplicatedMergeTreeAlterThread.cpp
#	dbms/src/Storages/MergeTree/ReplicatedMergeTreeCleanupThread.cpp
#	dbms/src/Storages/MergeTree/ReplicatedMergeTreeCleanupThread.h
#	dbms/src/Storages/MergeTree/ReplicatedMergeTreePartCheckThread.cpp
#	dbms/src/Storages/MergeTree/ReplicatedMergeTreeRestartingThread.cpp
#	dbms/src/Storages/StorageReplicatedMergeTree.cpp
2018-04-10 16:20:14 +03:00
Alexey Milovidov
76e822274a Better exception messages [#CLICKHOUSE-2] 2018-04-04 00:29:11 +03:00
Alexey Milovidov
f5652b4477 Modifications after removing libzookeeper; initialize ZooKeeper session lazily [#CLICKHOUSE-2] 2018-04-03 22:43:33 +03:00
alexey-milovidov
a220a43b8e
Merge branch 'master' into fix-detach-database 2018-03-29 03:01:07 +03:00
alexey-milovidov
ca5fd1e9de
Merge pull request #2033 from yandex/show-create-database
Show create database
2018-03-28 05:29:36 +03:00
Nikolai Kochetov
d63d9a4ffb fix test [#CLICKHOUSE-3590] 2018-03-26 18:48:19 +03:00
Alexey Zatelepin
cf3c24d07d break cycle of ptrs to StorageReplicatedMergeTree [#CLICKHOUSE-3664] 2018-03-23 23:30:04 +03:00
Silviu Caragea
b24a4b2111 Add back the buggy BackgroundSchedulePool 2018-03-22 17:07:12 +02:00
Nikolai Kochetov
d6e9d08d5e getCreateTableQuery and getCreateDatabaseQuery [#CLICKHOUSE-3590] 2018-03-14 15:37:38 +03:00
Alexey Milovidov
8b59db58c3 Fixed uneven code #2032 2018-03-14 02:44:23 +03:00
alexey-milovidov
165de1bc36
Update Context.cpp 2018-03-14 02:03:00 +03:00
Nikolai Kochetov
632a2ecabc added SYSTEM RELOAD CONFIG query [#CLICKHOUSE-3591] 2018-03-13 13:41:47 +03:00
Nikolai Kochetov
4dd7f47ad5 reload macros with config [#CLICKHOUSE-3591] 2018-03-12 21:16:51 +03:00
Alexey Milovidov
5ff433b670 Merged Limits to Settings [#CLICKHOUSE-2021] 2018-03-11 03:15:26 +03:00
Alexey Milovidov
afbbd780e3 Fixed error with initialization of PartLog [#CLICKHOUSE-3354] 2018-03-10 22:57:13 +03:00
Alexey Milovidov
65b95580f3 Removed useless code [#CLICKHOUSE-2] 2018-03-09 21:39:14 +03:00
alexey-milovidov
1ecb9dac72
Merge pull request #1901 from zhang2014/fix/ISSUES-117
ISSUES-117 add show create & exist temporary table
2018-03-07 22:53:11 +03:00
alexey-milovidov
4ce15695d7
Update Context.cpp 2018-03-07 22:43:13 +03:00
alexey-milovidov
2bb80baae5
Update Context.cpp 2018-03-07 22:33:40 +03:00
zhang2014
361a220743 Merge branch 'master' into fix/ISSUES-117 2018-03-02 19:06:11 +08:00
Alexey Milovidov
7e7fe3c441 Execute table functions once for a query [#CLICKHOUSE-3615] 2018-03-02 08:44:17 +03:00
Alexey Milovidov
651a312896 Added ProfileEvent for table function executions [#CLICKHOUSE-3615] 2018-03-02 08:03:28 +03:00
Alexey Milovidov
0213071683 Merge remote-tracking branch 'origin/master' into better-union-all-try2 2018-03-01 09:18:59 +03:00
Alexey Milovidov
280b4663c1 Caching table functions in query context #1947 2018-03-01 04:49:36 +03:00
proller
d6a1f8470f CLICKHOUSE-3553 Rebuild loggers on every config change (#1973)
* Macos test fix

* Fix freebsd build

* CLICKHOUSE-3553 Rebuild loggers on every config change

* rename clickhouse_common_configprocessor -> clickhouse_common_config; move Server/ConfigReloader.cpp -> Common/Config/

* CLICKHOUSE-3553 Set new level to all loggers on reload

* Dont use hash

* Update BaseDaemon.h
2018-02-28 23:34:25 +03:00
Alexey Milovidov
c86fd31097 Addition to prev. revision [#CLICKHOUSE-2] 2018-02-25 05:23:04 +03:00
zhang2014
01261181ae ISSUES-117 use reference 2018-02-23 10:15:09 +08:00
alexey-milovidov
3844b129f4
Update Context.cpp 2018-02-22 03:38:05 +03:00
Kirill Shvakov
ddb618b1d7 Use custom expr for query log 2018-02-14 10:01:41 +02:00
Kirill Shvakov
034566fff3 Use custom partition key for the query logs table 2018-02-14 09:24:26 +02:00
zhang2014
b89268ceb8 ISSUES-117 add show create & exist temporary table 2018-02-14 12:00:37 +08:00
Vitaliy Lyudvichenko
118b17253e Add system_profile config. [#CLICKHOUSE-3558] 2018-02-01 16:53:44 +03:00
Vitaliy Lyudvichenko
1000328571 Merge remote-tracking branch 'origin/master' into CLICKHOUSE-3346 2018-01-22 20:31:08 +03:00
alexey-milovidov
7a25b441f4
Merge pull request #1773 from yandex/small-enhancements
Small enhancements
2018-01-16 22:07:43 +03:00
proller
d97b2edc7c Make separate libs Common/ZooKeeper and Common/ConfigProcessor (#1749)
* Make separate libs Common/ZooKeeper and Common/ConfigProcessor
renamed:    dbms/src/Common/StringUtils.h -> dbms/src/Common/StringUtils/StringUtils.h

* Fix space

* Fix data in system.build_options

* merge

* merge
2018-01-15 22:07:47 +03:00
Vitaliy Lyudvichenko
f20f3f21c4 Update clusters in SYSTEM DROP DNS query. [#CLICKHOUSE-3478] 2018-01-15 17:57:47 +03:00
Vitaliy Lyudvichenko
388d47bbbc Merge branch 'CLICKHOUSE-3346-v310' into CLICKHOUSE-3346 2018-01-11 23:51:30 +03:00
Vitaliy Lyudvichenko
c818beedcb Make data_path creation for Databases optional. [#CLICKHOUSE-2] 2018-01-11 21:55:43 +03:00
Vitaliy Lyudvichenko
ac17c59108 Updated describe query, cluster copier draft. [#CLICKHOUSE-3346] 2018-01-11 21:55:08 +03:00
Alexey Zatelepin
6d5ce3fa9a revert BackgroundSchedulePool usage in Replicated tables 2017-12-22 21:25:54 +03:00
Alexey Milovidov
431da20d99 Better [#CLICKHOUSE-2]. 2017-12-01 23:21:35 +03:00
alexey-milovidov
0ac2f5b479
Merge pull request #1559 from rlipovsky/geodata
[clickhouse-yt] separate geo dictionaries from data providers
2017-12-01 19:54:08 +03:00
alexey-milovidov
493e7a4976
Merge pull request #1571 from rlipovsky/get_user_by_ptr
[clickhouse-yt] more consistent ISecurityManager interface
2017-12-01 19:43:00 +03:00
alexey-milovidov
66fdecf6ec
Merge branch 'master' into geodata 2017-12-01 19:25:27 +03:00
Roman Lipovsky
430837706c more consistent ISecurityManager interface: return shared pointer to User to prevent race conditions with loadFromConfig 2017-11-30 17:53:12 +03:00
Roman Lipovsky
9ed1ba2441 separate geo dictionaries from geo data providers 2017-11-29 01:15:06 +03:00
Roman Lipovsky
639d850d97 abstract config repository of user-defined objects (dictionaries, models) 2017-11-28 14:00:07 +03:00
Roman Lipovsky
cf6dd4e73b abstractions: runtime components factory + security manager 2017-11-28 04:12:57 +03:00
Alexey Milovidov
60825748d4 Merge branch 'fix11' of https://github.com/proller/ClickHouse into proller-fix11 2017-11-19 22:57:28 +03:00
Alexey Milovidov
f497b0c63c BackgroundSchedulePool: miscellaneous; added TODO [#CLICKHOUSE-2]. 2017-11-19 03:08:37 +03:00
Silviu Caragea
dfecd0b2f2 Merge with master 2017-11-18 10:16:06 +02:00
Alexey Milovidov
729b114c15 Removed unsupported functionality [#CLICKHOUSE-2]. 2017-11-18 05:34:00 +03:00
proller
5ba7e20c03 fixes 2017-11-17 22:40:27 +03:00
Silviu Caragea
64619c614f Basic idea is :
- We add BackgroundSchedulePool which can execute a function at a specific point in time. Basically all tasks are added in a queue and precessed by worker threads.
- The most important difference between this and BackgroundProcessingPool is that we have the guarantee that the same function is not executed from many workers in the same time
- Each of the following classes instead starting a thread will register a task in BackgroundSchedulePool and when they need to run will call schedule or scheduleAfter(duration) functions

This commit is moving all threads created by ReplicatedMergeTree to BackgroundSchedulePool tasks

NOTE: I did a minimum number of changes to be much simple to review the code
2017-11-17 10:58:35 +02:00
Marek Vavruša
64a892c0e6 DataStreams: CapnProto uses <format_schema_path> config option
This addresses one of the remarks in the PR.

All format schemas are required to be in the <format_schema_path> directory.
This makes loading schema files less tedious, as the path can be omitted.
2017-11-15 23:17:22 +03:00
alexey-milovidov
56ef2e9196
Merge pull request #1380 from yandex/catboost-models
Catboost models
2017-10-30 19:16:41 +03:00
Alexey Zatelepin
f130d2df65 fix creation of system log tables [#CLICKHOUSE-2] 2017-10-26 15:44:47 +03:00
Nikolai Kochetov
74a4c7508a merged with master 2017-10-20 19:18:09 +03:00
Nikolai Kochetov
fdf258f8ed added ExternalModels to Context [#CLICKHOUSE-3305]
fix build [#CLICKHOUSE-3305]

fix build [#CLICKHOUSE-3305]

fix build [#CLICKHOUSE-3305]

fix build [#CLICKHOUSE-3305]

fix build [#CLICKHOUSE-3305]
2017-10-20 19:13:25 +03:00
alexey-milovidov
9ccdb5420b Merge branch 'master' into upstream-add-kafka 2017-10-13 23:52:42 +03:00
alexey-milovidov
3a1ce26764 Update Context.cpp 2017-10-13 21:46:32 +03:00
proller
c0e9813b90 Fix access for inserting into temporary table (#CLICKHOUSE-3360) 2017-10-13 21:46:32 +03:00
Vladimir Chebotarev
1e0241e262 dbms: CompressionSettingsSelector. [#METR-21516] 2017-10-13 04:08:23 +03:00
Marek Vavruša
4fb570fa5e IStorage: allow notification on dependency change
This allows sending notifications to supported
table engines when their dependencies change.
For example, a table can be notified when a
MATERIALIZED VIEW is attached to it.

This is a building block for building pipelines.
2017-10-10 08:33:00 -07:00
Vadim Skipin
e0a1e6982b Context parameter added to the IDatabase methods 2017-09-11 21:29:26 +03:00
Alexey Milovidov
cd540c2674 Replaced Mersenne Twister to PCG-Random [#CLICKHOUSE-2]. 2017-09-10 02:17:38 +03:00
Alexey Milovidov
d29c77adea Implemented some suggestions from clang-tidy (part 3) [#CLICKHOUSE-3301]. 2017-09-08 06:47:27 +03:00
Alexey Milovidov
8b313ab99e Fixed warnings found by cppcheck [#CLICKHOUSE-3300]. 2017-09-08 00:04:48 +03:00
Vitaliy Lyudvichenko
d55d5eca46 Remove extra Context reference and add required ones. Part 2. [#CLICKHOUSE-3117] 2017-09-06 04:18:07 +03:00
alexey-milovidov
aa2d29f5f9 Update ReadWriteBufferFromHTTP.cpp, Context.cpp, etc
Update ASTSystemQuery.cpp

Update ASTSystemQuery.h

Update dictionary_clickhouse_cache.xml

Update dictionary_clickhouse_flat.xml
2017-08-31 13:26:02 +03:00
alexey-milovidov
5d14855989 Merge branch 'master' into CLICKHOUSE-2931 2017-08-31 00:23:39 +03:00
Vitaliy Lyudvichenko
1e68d10ce0 Add max_network_bandwidth_for_user limit setting. [#CLICKHOUSE-3139] 2017-08-29 23:23:54 +03:00
Vadim Skipin
4dc36893d3 Keep config in context to avoid Application singleton usages 2017-08-28 22:19:06 +03:00
Vitaliy Lyudvichenko
8fa3364e4e Add SYSTEM RELOAD DICTIONARY(IES) implementation. [#CLICKHOUSE-2931] 2017-08-28 20:27:16 +03:00
Vitaliy Lyudvichenko
48f5d8f1a3 Add SYSTEM DROP DNS CACHE. [#CLICKHOUSE-2931] 2017-08-28 20:27:16 +03:00
Alberto
727ca81998 Fixed typo 2017-08-16 14:08:02 +03:00
Nikolai Kochetov
f8513b932f removed ability to select from external temporary table by query_id 2017-08-15 22:31:40 +03:00
Nikolai Kochetov
9c6f1a1e4b supported drop query for temporary tables [#CLICKHOUSE-3219] 2017-08-15 22:31:40 +03:00
Alexey Milovidov
86eb4d2d06 Renamed Singleton to avoid conflicts with Arcadia* codebase [#DEVTOOLS-3343].
* - "Arcadia" is the name of Yandex's monorepo.
2017-07-10 07:34:14 +03:00
Vitaliy Lyudvichenko
2167e4efdd Removed SET GLOBAL query. [#MTRSADMIN-3068]
It even was not supported properly in console client.
2017-06-20 22:26:59 +03:00
Vitaliy Lyudvichenko
353dba545d Correct cascade of user setting calculation. [#MTRSADMIN-3068] [#CLICKHOUSE-2906] 2017-06-20 22:26:59 +03:00
Vitaliy Lyudvichenko
534b766250 CREATE of MergeTree checks that data dir is empty. [#CLICKHOUSE-3083] 2017-06-20 10:49:18 +03:00
Vitaliy Lyudvichenko
515ffa5262 Add extra check. [#CLICKHOUSE-3083] 2017-06-20 10:49:18 +03:00
Vitaliy Lyudvichenko
a098fb170a Avoid creating multiple global Context. [#CLICKHOUSE-3083] 2017-06-20 10:49:18 +03:00
Alexey Milovidov
05accbdcbe Removed cyclic dependency [#DEVTOOLS-3381]. 2017-06-19 23:06:35 +03:00
Vitaliy Lyudvichenko
67fdd0f544 Load the system database first. [#CLICKHOUSE-3044] 2017-06-16 19:08:24 +03:00
alexey-milovidov
a669136ac2 Merge branch 'master' into CLICKHOUSE-5 2017-06-13 07:30:36 +03:00
Alexey Milovidov
45c76803a9 Moved table functions to separate library; fixed errors; improved testability [#CLICKHOUSE-31]. 2017-06-10 12:04:31 +03:00
Alexey Milovidov
9593119a64 Fixed error after merge; tiny modification [#CLICKHOUSE-2]. 2017-06-05 17:40:44 +03:00
Vitaliy Lyudvichenko
1e4906816c Avoid SIGSEGV in SystemLog destructors. [#CLICKHOUSE-3023] 2017-06-05 17:25:10 +03:00
Alexey Milovidov
efc12f2334 Sessions in HTTP interface: modifications after merge [#CLICKHOUSE-2949]. 2017-06-03 00:01:17 +03:00
Sergey V. Galtsev
07f14e05ee Implement sessions in HTTP interface [#CLICKHOUSE-2949]. 2017-06-02 22:35:05 +03:00
Vitaliy Lyudvichenko
aa7504a7f5 Distributed DDL PR rebase. [#CLICKHOUSE-5] 2017-06-01 13:49:19 +03:00
Alexey Milovidov
9fdd795087 Using more light method of query_id generation [#CLICKHOUSE-3025]. 2017-05-24 22:31:50 +03:00
proller
fac00792f9 Move most AggregateFunctions to separate lib, use AggregateFunctionFactory as singletone, rename lib storages_system->clickhouse_storages_system 2017-05-05 16:59:18 -07:00
Alexey Zatelepin
3ca6efbbd9 substitute parse<size_t>(config.getString()) for config.getUInt64() 2017-04-12 19:37:19 +03:00
f1yegor
b4c23f122a Translated comments 2017-04-02 20:37:49 +03:00
Alexey Milovidov
310736cd7e Moved headers and sources to same place [#CLICKHOUSE-3]. 2017-04-01 12:22:42 +03:00
Alexey Milovidov
137ad95929 Changed tabs to spaces in code [#CLICKHOUSE-3]. 2017-04-01 11:35:09 +03:00
Vitaliy Lyudvichenko
6d1a8c7c97 Consider changes in default profile to initialize default users' settings. [#CLICKHOUSE-2906] 2017-03-23 21:30:22 +04:00
Ravengg
b47cc72701 Fix part log (#591)
* fix_part_log

* fixed language back

* add reset part_log back

* reset part_log when don't need more

* Fix header

* fix
2017-03-14 19:58:34 +04:00
Alexey Milovidov
235dbe6183 Fixed error with PartLog [#CLICKHOUSE-2703]. 2017-03-09 19:46:11 +03:00
Ravengg
b079dacfd1 Added part_log with statistics scripts (#549)
* Added part_log

* first_test

* filter and hits_res

* Add renamer and drawer

* Add columns database and table into PartLog

* Add normal way to get table_name and database_name from part

* improve drawer

* add stats for random size parts

* Merge converter and drawer

* make drawer more informative

* add new data

* add new data

* new data

* add long range stats

* for checking best way

* Add add_parts script

* Good style for global merge

* delete commented code

* Fixed spaces to tabs

* Note that Stopwatch is started automatically.

* Style

* Update StorageMergeTree.cpp

* Update StorageReplicatedMergeTree.cpp

* Switch act_time_ms to duration_ms

* Added ability to disable part_log

* fixed getPartLog

* fix usage getPartLog

* fix
2017-03-07 21:13:54 +04:00
Alexey Zatelepin
93a9e64624 fix usage of possibly invalidated iterator [#CLICKHOUSE-2] 2017-02-15 22:39:18 +03:00
Alexey Milovidov
172b385247 Added missing modification [#CLICKHOUSE-2184]. 2017-02-01 06:10:12 +03:00
Alexey Milovidov
1c8841b04e Fixed error [#CLICKHOUSE-2184]. 2017-02-01 05:35:06 +03:00
Alexey Milovidov
8cabe639f5 Fixed errors in exception message [#CLICKHOUSE-2184]. 2017-02-01 05:31:35 +03:00
Vitaliy Lyudvichenko
abf5066618 Fix spelling errors. [#CLICKHOUSE-3] 2017-01-31 23:28:37 +04:00
Vitaliy Lyudvichenko
c9e52a5cf9 Add requested PR changes. [#CLICKHOUSE-2145] [issue #325] 2017-01-24 22:26:29 +04:00
Vitaliy Lyudvichenko
20a5ae4bc4 Add protection from accidental DROP queries. [#CLICKHOUSE-2184] 2017-01-24 22:26:29 +04:00
alexey-milovidov
ed5b521110 Less dependencies 2 (#378)
* Less dependencies [#CLICKHOUSE-2].

* Less dependencies [#CLICKHOUSE-2].

* Less dependencies [#CLICKHOUSE-2].

* Less dependencies [#CLICKHOUSE-2].

* Less dependencies [#CLICKHOUSE-2].

* Less dependencies [#CLICKHOUSE-2].

* Less dependencies [#CLICKHOUSE-2].

* Less dependencies [#CLICKHOUSE-2].

* Less dependencies [#CLICKHOUSE-2].

* Less dependencies [#CLICKHOUSE-2].

* Less dependencies [#CLICKHOUSE-2].

* Less dependencies [#CLICKHOUSE-2].

* Less dependencies [#CLICKHOUSE-2].

* Less dependencies [#CLICKHOUSE-2].

* Less dependencies [#CLICKHOUSE-2].

* Less dependencies [#CLICKHOUSE-2].

* Less dependencies [#CLICKHOUSE-2].

* Less dependencies [#CLICKHOUSE-2].

* Less dependencies [#CLICKHOUSE-2].

* Less dependencies [#CLICKHOUSE-2].

* Less dependencies [#CLICKHOUSE-2].

* Less dependencies [#CLICKHOUSE-2].

* Less dependencies [#CLICKHOUSE-2].
2017-01-21 08:24:28 +04:00
Alexey Milovidov
a1a6ddd01e Reworking ExpressionAnalyzer (preparations) [#METR-20307]. 2017-01-05 19:34:05 +03:00
Vitaliy Lyudvichenko
07d720565c Added profile events for INSERTs. [#METR-23930]
Added new column and CurrentMetrics data into system.events table.
Removed unnecessary code from Context and Merge list. [#METR-23911]
2016-12-31 02:39:53 +03:00
Vitaliy Lyudvichenko
108bfac17e Added memory tracking events and columns for merges. [#METR-23911] 2016-12-31 02:39:53 +03:00
Vitaliy Lyudvichenko
8398baea85 Fixed getFlagsPath() for clickhouse-local use case. [#METR-23761] 2016-12-19 17:15:45 +03:00
Alexey Milovidov
59da0fd12a Added metrics and events for Context lock [#METR-23763]. 2016-12-08 01:49:42 +03:00
Alexey Milovidov
a2e9359b18 Fixed rare deadlock after startup when structure of query_log was changed [#METR-23594]. 2016-11-23 23:41:39 +03:00
Pavel Kartavyy
631d9ea0a0 add getSessionContext() const 2016-11-16 18:52:35 +03:00
Pavel Kartavyy
bdb7e9745b add hasColumnInTable function [#METR-23248] 2016-11-16 18:52:35 +03:00
Alexey Milovidov
d5155fbe7a Added quota_key to query_log and processlist [#METR-23505]. 2016-11-16 08:09:41 +03:00
Vitaliy Lyudvichenko
107f7b34c7 Added requested PR changes, 2nd iteration. 2016-11-14 02:57:18 +03:00
Vitaliy Lyudvichenko
c05f512637 Merged server, client and local into single binary, more args for local mode. 2016-11-09 22:06:29 +03:00
Vitaliy Lyudvichenko
cf24f6e2d1 Implemented draft version of clickhouse-local service. 2016-11-09 22:03:47 +03:00
Alexey Milovidov
968bcb6f66 Preparation [#METR-2944]. 2016-10-27 20:48:12 +03:00
Alexey Milovidov
daeac24f04 Added ClientInfo: passing original source of query during distributed query execution; improvement of per-user limits in ProcessList [#METR-23279]. 2016-10-25 00:40:39 +03:00
alexey-milovidov
8d7ba10835 Merge pull request #132 from ludv1x/METR-22802
Automatic reload of remote_servers configuration.
2016-10-14 23:32:27 +04:00
Vitaliy Lyudvichenko
a0760a4821 Added requested PR changes. [#METR-22802] 2016-10-14 20:54:18 +03:00
Vitaliy Lyudvichenko
144d9018ba Added port column into system.processes table. [#METR-22966] 2016-10-11 22:01:55 +03:00
Vitaliy Lyudvichenko
ebbc9b9877 Added abilty to automatically update clusters configuration. [#METR-22802] 2016-10-11 17:17:49 +03:00
Alexey Milovidov
6b2755bf2a Non significant change [#METR-2944]. 2016-09-23 23:33:06 +03:00
Alexander Prudaev
d376a81692 columnar-appender-common: fix PoolWithFailOver [#METR-20682]. 2016-09-13 19:00:47 +03:00
Alexey Milovidov
9fd26e381a Less code [#MOBMET-3953]. 2016-08-07 01:31:58 +03:00
Alexey Milovidov
55ed2904f4 Allowed for certain aggregate functions to have case insensitive names for compatibility [#METR-22087]. 2016-07-14 08:22:09 +03:00
Alexey Milovidov
646d70a545 Using std::shared_ptr for data types [#METR-21503]. 2016-05-28 17:14:18 +03:00
Alexey Milovidov
6863e72f3d Using std::shared_ptr for data types [#METR-21503]. 2016-05-28 13:15:36 +03:00
Alexey Milovidov
f538e81c98 Added 'uptime' function [#METR-20819]. 2016-04-09 10:47:08 +03:00
Alexey Milovidov
1f8f6fa06a Allowed concurrent CREATE TABLE IF NOT EXISTS if table exists [#METR-20704]. 2016-04-01 20:41:13 +03:00
Alexey Milovidov
da07716547 Attempt to fix an error [#METR-20397]. 2016-03-22 22:35:23 +03:00
Alexey Milovidov
b5e5de0427 Attempt to fix an error [#METR-20397]. 2016-03-22 05:05:21 +03:00
Alexey Milovidov
5720d9566e Little better [#METR-19997]. 2016-03-22 04:50:19 +03:00
Alexey Milovidov
288fb9dcdf Less wrong [#METR-19997]. 2016-03-22 02:46:24 +03:00
Alexey Milovidov
bbdd0ca4d7 Database engines: development [#METR-19997]. 2016-03-21 15:57:12 +03:00
Alexey Milovidov
5fc44df6b5 Squashed commit of the following:
commit f9b478181cd49224154cc350fb57df7121842f1c
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Sat Mar 19 04:06:36 2016 +0300

    Database engines: development [#METR-19997].

commit f7a10a67761ccfd05f3dac32d6444920cd8d4d60
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Sat Mar 19 03:44:37 2016 +0300

    Database engines: development [#METR-19997].

commit bd98a8558e98bad2bed278e5762c4e0fc66e6f38
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Sat Mar 19 00:33:59 2016 +0300

    Database engines: development [#METR-19997].

commit 19712fd884c22a4e2c2b67474086dea8f44e7c7b
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Sat Mar 19 00:03:11 2016 +0300

    Database engines: development [#METR-19997].

commit 50274d6df7e91fcc34aab8a8c72347daa2c6512f
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Fri Mar 18 23:24:57 2016 +0300

    Database engines: development [#METR-19997].

commit 4a0b99b19b34e90ef8b7be2d199f6232e36ef3f7
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Fri Mar 18 22:50:36 2016 +0300

    Database engines: development [#METR-19997].

commit 44ff3ebba7a3e460a27a89f31ddf199dbea1d182
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Fri Mar 18 15:09:17 2016 +0300

    Database engines: development [#METR-19997].

commit 137c31f3004cfd282473b6acb01cbe1b4ca2aadd
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Fri Mar 18 03:26:34 2016 +0300

    Database engines: development [#METR-19997].

commit aa4c0496d4afe4a691164254be2bd5600542b38a
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Fri Mar 18 03:22:59 2016 +0300

    Database engines: development [#METR-19997].

commit 5a94d1f0607450a2dac28a4d7df8b1393a864c23
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Fri Mar 18 01:02:40 2016 +0300

    Database engines: development [#METR-19997].

commit 50fd5b52ea1141955a5dfba0dcb191f3289ac25b
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Thu Mar 17 23:23:40 2016 +0300

    Database engines: development [#METR-19997].

commit a333d91b058e4f56dd83a6d2878c3c2bd8efc002
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Thu Mar 17 20:29:07 2016 +0300

    Database engines: development [#METR-19997].

commit f81d366e7ac8348436f2698d040f8e341743a024
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Thu Mar 17 01:30:23 2016 +0300

    Database engines: development [#METR-19997].

commit d0696860c9060827896214c08d147c759ea79376
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Wed Mar 16 21:55:31 2016 +0300

    Database engines: development [#METR-19997].

commit 46a168c2ada140a0e95cd8d4b9d8ba9bac855d11
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Wed Mar 16 08:00:58 2016 +0300

    Database engines: development [#METR-19997].

commit 20a2bad161454225fc1b5f9b919b842fbebc3231
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Wed Mar 16 06:51:10 2016 +0300

    Database engines: development [#METR-19997].

commit ca0a77fcc2a8d0b276eb3743c53551ad3fe16314
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Wed Mar 16 06:02:20 2016 +0300

    Reverted erroneous modification [#METR-19997].

commit 1370bdcc4594182f6ef2b146f9afabfe1c295080
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Wed Mar 16 00:41:34 2016 +0300

    Database engines: development [#METR-19997].

commit 16e72c67041cae6471509d3f0f3d4a9aa7b7dc0f
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Tue Mar 15 00:41:48 2016 +0300

    Database engines: development [#METR-19997].
2016-03-19 04:18:49 +03:00
Alexey Milovidov
b92b0660a7 dbms: fixed error [#METR-20301]. 2016-03-10 06:08:09 +03:00
Alexey Milovidov
12363ed329 Added limited support for expressions in INSERT ... VALUES [#METR-20048]. 2016-02-13 09:37:19 +03:00
Alexey Arno
113b592380 Merge 2016-01-28 19:06:57 +03:00
Alexey Milovidov
e5d4149ca4 Merge 2016-01-28 04:00:42 +03:00
Alexey Milovidov
67a07205b7 Merge 2016-01-28 04:00:27 +03:00