Commit Graph

131 Commits

Author SHA1 Message Date
Vitaliy Lyudvichenko
de6c48f4df Merge remote-tracking branch 'origin/master' into CLICKHOUSE-2910 2018-05-14 19:09:00 +03:00
Vitaliy Lyudvichenko
e8b94b89e9 Removed dbg output, fixed test. [#CLICKHOUSE-2] 2018-05-14 17:14:58 +03:00
Vitaliy Lyudvichenko
d25338582d Speedup partition check, add more preformance output. [#CLICKHOUSE-2]
Faster partition check.

Added more debug info.
2018-05-14 17:14:58 +03:00
Alexey Milovidov
956128a67a Fixed style a bit [#CLICKHOUSE-2] 2018-05-07 05:01:11 +03:00
proller
7781492624 Fix user name on distributed queries (#2292)
* Fix user name on distributed queries

* wip

* fix
2018-05-05 00:21:23 +03:00
proller
440b0f33c7 Compile fixes 2018-04-02 15:31:49 +03:00
proller
a6f9df105c Allow use encryption for distributed tables (#2065)
* Allow use encryption for distributed tables

* wip

* fix

* rename encryption to secure

* Fix DirectoryMonitor with +secure

* fix

* fix

* Update DirectoryMonitor.cpp

* Update DirectoryMonitor.cpp
2018-03-29 04:41:06 +03:00
Alexey Zatelepin
aa4f4e62fe mark failed batches as broken [#CLICKHOUSE-3594] 2018-03-28 15:28:15 +03:00
Alexey Zatelepin
00da8a477c report broken files more accurately [#CLICKHOUSE-3594] 2018-03-28 15:28:15 +03:00
Vitaliy Lyudvichenko
190964f98e Avoid extra waits in copier. [#CLICKHOUSE-2] 2018-03-26 21:39:28 +03:00
Vitaliy Lyudvichenko
e41b653f14 Parallelized block split in sync Distributed insert. [#CLICKHOUSE-2] 2018-03-19 21:26:52 +03:00
Vitaliy Lyudvichenko
4011afa399 Parallel SELECT and INSERT in ClusterCopier. [#CLICKHOUSE-2] 2018-03-14 23:49:18 +03:00
alexey-milovidov
9ac2569c65
Merge branch 'master' into refactor-table-declaration 2018-03-14 05:35:50 +03:00
Alexey Milovidov
b7475b1d2c Fixed error: wrong timeouts passed to ConnectionPoolWithFailover [#CLICKHOUSE-3641] 2018-03-12 23:25:18 +03:00
Alexey Zatelepin
71642b0880 use ColumnsDescription everywhere [#CLICKHOUSE-3241] 2018-03-12 22:07:48 +03:00
alexey-milovidov
56deedfe9f
Merge pull request #2027 from yandex/CLICKHOUSE-3346
Sync insert and сluster copier enhancements
2018-03-12 20:58:53 +03:00
Vitaliy Lyudvichenko
32b617e1d6 Fixed extra squashing leaded to too big timeouts. [#CLICKHOUSE-3346] 2018-03-11 21:36:09 +03:00
Alexey Milovidov
5ff433b670 Merged Limits to Settings [#CLICKHOUSE-2021] 2018-03-11 03:15:26 +03:00
Vitaliy Lyudvichenko
96d4e59dab Simplified logic of distributed sync insert. [#CLICKHOUSE-2] 2018-03-07 17:39:02 +03:00
Vitaliy Lyudvichenko
47d1d4c83c More effective retries, fast partition discovering. [#CLICKHOUSE-3346] 2018-03-07 17:39:02 +03:00
Vitaliy Lyudvichenko
efdda9cc9b Introduced ThreadStatus. [#CLICKHOUSE-2910] 2018-03-07 14:35:10 +03:00
alexey-milovidov
b6f3f06ef3
Merge branch 'master' into CLICKHOUSE-3606 2018-02-22 02:13:38 +03:00
Vitaliy Lyudvichenko
369f88f65d Rewritten and improved sync distributed insert. [#CLICKHOUSE-3346] 2018-02-19 20:26:47 +03:00
Alexey Milovidov
fa50fe80a0 Added method "getHeader" in IBlockOutputStream: development [#CLICKHOUSE-2] 2018-02-19 03:45:32 +03:00
Vitaliy Lyudvichenko
d6db480be1 Forward settings through Distributed table. [#CLICKHOUSE-3346] 2018-01-25 19:04:54 +03:00
proller
d97b2edc7c Make separate libs Common/ZooKeeper and Common/ConfigProcessor (#1749)
* Make separate libs Common/ZooKeeper and Common/ConfigProcessor
renamed:    dbms/src/Common/StringUtils.h -> dbms/src/Common/StringUtils/StringUtils.h

* Fix space

* Fix data in system.build_options

* merge

* merge
2018-01-15 22:07:47 +03:00
Nikolai Kochetov
cbeeb84999 added http_*_timeout settings [#CLICKHOUSE-3440] 2018-01-09 21:41:01 +03:00
Alexey Milovidov
c4bbc1c963 Better semantic of sharing columns: development [#CLICKHOUSE-2]. 2017-12-15 23:48:46 +03:00
Alexey Milovidov
acd78e4891 Better [#CLICKHOUSE-2]. 2017-12-02 00:13:25 +03:00
Alexey Milovidov
01e8adbfff Removed "experimental" namespace [#CLICKHOUSE-2]. 2017-11-20 07:15:43 +03:00
Vitaliy Lyudvichenko
a4636f8656 Fixed incorrect INSERT into Distributed table in async mode with local replicas in a shard. #1404 [#CLICKHOUSE-2]
Resolves #1404
2017-11-03 00:32:59 +03:00
Nikolai Kochetov
5966574405 fix timeout lock in DistributedBlockOutputStream 2017-10-23 16:47:00 +03:00
Nikolai Kochetov
3317251e2f fix jobs flags in DistributedBlockOutputStream 2017-10-23 15:00:56 +03:00
Nikolai Kochetov
4262c00122 lock mutex before notifying waiting thread in sync insertion into distributed [#CLICKHOUSE-3379] 2017-10-19 22:52:45 +03:00
Alexey Milovidov
5a8f47a640 Fixed not an issue, shown by TSan [#CLICKHOUSE-2]. 2017-09-10 02:07:32 +03:00
Alexey Milovidov
a6d5e9c7e8 Fixed not an issue, shown by TSan [#CLICKHOUSE-2]. 2017-09-10 02:04:22 +03:00
Alexey Milovidov
04af7a3349 Fixed bad translation [#CLICKHOUSE-2]. 2017-08-29 21:51:48 +03:00
Nikolai Kochetov
c43a13cb81 fixed async insertion into local shard of distributed [#CLICKHOUSE-3245] 2017-08-23 15:44:18 +03:00
Nikolai Kochetov
24b5a59f8c merged with remote [#CLICKHOUSE-3033] 2017-08-11 18:38:46 +03:00
Nikolai Kochetov
90940d8423 Cluster and DistributedBlockOutputStream refactoring [#CLICKHOUSE-3033] 2017-08-11 18:02:07 +03:00
alexey-milovidov
0282d516a4 Update DistributedBlockOutputStream.cpp 2017-08-10 07:10:36 +03:00
alexey-milovidov
2717c94a36 Update DistributedBlockOutputStream.cpp 2017-08-10 07:05:16 +03:00
alexey-milovidov
0285f99c4e Update DistributedBlockOutputStream.cpp 2017-08-10 06:54:02 +03:00
alexey-milovidov
57a9d22b0c Update DistributedBlockOutputStream.cpp 2017-08-10 06:49:03 +03:00
alexey-milovidov
c665c4c4e5 Update DirectoryMonitor.h 2017-08-10 06:46:16 +03:00
alexey-milovidov
5773832979 Update DirectoryMonitor.cpp 2017-08-10 06:45:57 +03:00
Nikolai Kochetov
ea2b486735 added threadpool to DistributedBlockOutputStream 2017-08-07 23:26:28 +03:00
Nikolai Kochetov
63ec81e2e3 added threadpool for sync insertion into distributed 2017-08-03 20:42:31 +03:00
Nikolai Kochetov
2f8f199d08 separated connection pool creation from StorageDistributedDirectoryMonitor in StorageDistributed; fixed bugs from review [#CLICKHOUSE-3033] 2017-07-27 18:24:39 +03:00
Nikolai Kochetov
b3157aebb2 added synchronous insert into distributed table [#CLICKHOUSE-3033] 2017-07-25 22:42:36 +03:00
Alexey Zatelepin
c939d2f96e put Distributed inserts with different block structure into different batches [#CLICKHOUSE-3163] 2017-07-21 20:55:38 +03:00
Nikolai Kochetov
75be0b81d8 removed typeid_cast from IColumn.h 2017-07-13 23:58:19 +03:00
Alexey Zatelepin
57ba50f585 allow batching Distributed inserts [#CLICKHOUSE-3126] 2017-07-11 20:56:17 +03:00
Alexey Milovidov
946c275dfb Added missing case for broken files in StorageDistributed [#CLICKHOUSE-3091]. 2017-06-22 03:56:17 +03:00
Alexey Milovidov
5c322f5756 Loosened threshold on amount of replica inconsistency to refuse server startup [#CLICKHOUSE-3076]. 2017-06-21 22:07:08 +03:00
Alexey Milovidov
acfe3d5028 Improved performance of inserting into StorageDistributed with very high number of shards (not tested) [#CLICKHOUSE-2]. 2017-05-10 02:39:37 -04:00
Alexey Milovidov
27a324b469 Tiny modifications [#CLICKHOUSE-2]. 2017-05-10 00:29:36 -04:00
Alexey Zatelepin
485c58b039 use only ConnectionPoolWithFailover in RemoteBlockInputStream [#CLICKHOUSE-2141] 2017-04-19 20:50:17 +03:00
f1yegor
0b243a8b01 translate comments 2017-04-16 23:17:32 +03:00
Alexey Milovidov
310736cd7e Moved headers and sources to same place [#CLICKHOUSE-3]. 2017-04-01 12:22:42 +03:00
Alexey Milovidov
137ad95929 Changed tabs to spaces in code [#CLICKHOUSE-3]. 2017-04-01 11:35:09 +03:00
proller
930ac5b2ce move ClickHouseRevision to dbms 2017-03-16 13:51:41 +04:00
Alexey Milovidov
26788e3938 Formatting [#CLICKHOUSE-2]. 2017-03-13 21:01:46 +03:00
alexey-milovidov
6d5bfc8c6f Refactoring of numeric DataTypes (#581)
* Better code [#CLICKHOUSE-2].

* Addition to prev. revision [#CLICKHOUSE-2].

* Addition to prev. revision [#CLICKHOUSE-2].

* Addition to prev. revision [#CLICKHOUSE-2].
2017-03-12 14:13:45 +04:00
Alexey Milovidov
8f9b70a1d7 Style [#CLICKHOUSE-2]. 2017-02-13 13:38:50 +03:00
artpaul
f8a0f55335 #360 explicit types 2017-02-12 16:09:55 +05:00
artpaul
0c1dab92a3 #360 ordinary 2017-02-12 15:34:08 +05:00
alexey-milovidov
4593d363d1 Fix poor distributed insertion scalability (#481)
* Fix poor scalability of INSERT into Distributed table [#CLICKHOUSE-2791].

* Fix poor scalability of INSERT into Distributed table (continued) [#CLICKHOUSE-2791].

* Misc [#CLICKHOUSE-2791].

* Fixed error [#CLICKHOUSE-2791].
2017-02-12 00:20:57 +04:00
artpaul
4c57c9731e #437 encode name of default_database so it's can be passed through connection 2017-02-07 20:11:02 +04:00
Artemkin Pavel
06d1509da1 check that sharding_key exists in the table and has numeric type (#392)
* check that sharding_key exists in the table and has numeric type [#CLICKHOUSE-2191]

* style

* infer type of sharding expression [#CLICKHOUSE-2191]
2017-01-27 01:47:33 +04:00
Alexey Milovidov
ca37f28b5f Renamed methods Block::rows and Block::rowsInFirstColumn [#METR-2944]. 2017-01-02 23:45:27 +03:00
Alexey Milovidov
2b4f3b5d34 Renamed method (less confusion) [#METR-2944]. 2017-01-02 23:12:12 +03:00
Alexey Milovidov
54af522de1 Preparation [#METR-2944]. 2016-12-12 10:24:56 +03:00
Alexey Milovidov
fc43827a6c Preparation [#METR-2944]. 2016-12-12 06:33:34 +03:00
Vitaliy Lyudvichenko
ebbc9b9877 Added abilty to automatically update clusters configuration. [#METR-22802] 2016-10-11 17:17:49 +03:00
Alexey Milovidov
4b7f461e46 Using std::shared_ptr for columns [#METR-21503]. 2016-05-28 08:31:36 +03:00
Alexey Milovidov
203cdbe244 Addition [#METR-21287]. 2016-05-13 06:22:53 +03:00
Pavel Kartavyy
eca42536d8 dbms: renamed Revision to ClickHouseRevision. Daemon to BaseDaemon 2016-02-09 20:06:50 +03:00
Alexey Milovidov
e5d4149ca4 Merge 2016-01-28 04:00:42 +03:00
Alexey Milovidov
085dd9f90a Merge 2016-01-26 04:56:42 +03:00
Alexey Arno
ae2f7c7613 Merge 2016-01-26 03:30:18 +03:00