thevar1able/ClickHouse
1
0
Fork 0
mirror of https://github.com/ClickHouse/ClickHouse.git synced 2024-12-02 12:32:04 +00:00
Code Issues Packages Projects Releases Wiki Activity
37,829 Commits 9,194 Branches 1,782 Tags 2.2 GiB
0e9ddb9131
Commit Graph

141 Commits

Author SHA1 Message Date
Nikita Mikhaylov
1b8174b9d0
trigger ci 2020-02-23 17:25:55 +03:00
Nikita Mikhaylov
5e01f348c5 return back alter move 2020-02-21 19:47:43 +03:00
Nikita Mikhaylov
16322b1352 replace partition 2020-02-21 19:18:16 +03:00
Nikita Mikhaylov
0b4d8bdb08 move partition added 2020-02-21 19:00:50 +03:00
Alexander Tokmakov
d5e79153c2 Merge branch 'master' into split_databases_from_context 2020-02-21 18:09:02 +03:00
Nikita Mikhaylov
2869c01571 drop partition piece 2020-02-20 21:58:00 +03:00
Nikita Mikhaylov
1be4a35f15 successful copying 2020-02-20 20:26:20 +03:00
Nikita Mikhaylov
ce16a6e536 Merge branch 'master' of github.com:ClickHouse/ClickHouse into clickhouse-copier 2020-02-20 13:56:39 +03:00
Nikita Mikhaylov
b035dd815b merge finished 2020-02-20 13:01:02 +03:00
Nikita Mikhaylov
23ceddebbc codestyle final 2 2020-02-20 12:06:00 +03:00
Nikita Mikhaylov
6bc23f5eae merging 2020-02-20 12:01:06 +03:00
Nikita Mikhaylov
b08db134c1 merging 2020-02-20 12:00:41 +03:00
nikitamikhaylov
3c1f2b6124 style check final 2020-02-19 23:50:27 +03:00
Nikita Mikhaylov
b0a4956824 Merge branch 'copier-refactoring' of github.com:nikitamikhaylov/ClickHouse into clickhouse-copier 2020-02-19 19:59:59 +03:00
Nikita Mikhaylov
caa4810c5c more codestyle 2020-02-19 18:59:47 +03:00
Nikita Mikhaylov
819a4ad6da codestyle 2020-02-19 18:45:49 +03:00
Nikita Mikhaylov
24cbd0d6d1 squashed commits 2020-02-19 18:01:08 +03:00
Nikita Mikhaylov
6527df83a1 copier split 2020-02-18 16:39:22 +03:00
Nikita Mikhaylov
038c9a889d something works 2020-02-18 16:26:08 +03:00
Alexander Tokmakov
d710bd1812 better get... methods 2020-02-17 16:52:59 +03:00
Nikita Mikhaylov
5795dfa00c remove anonymous namespaces 2020-02-13 17:23:41 +03:00
Nikita Mikhaylov
5f1fd17b7c ShardPartitionPiece path getters 2020-02-13 13:52:46 +03:00
Nikita Mikhaylov
b97aa2074d piece observing + config 2020-02-12 19:15:34 +03:00
Nikita Mikhaylov
22789a3b55 ShardPartitionPiece task added 2020-02-11 21:34:48 +03:00
Nikita Mikhaylov
b481682a1e just comments 2020-02-11 14:19:19 +03:00
Alexander Tokmakov
869e20d207 move databases from Context to DatabaseCatalog 2020-02-10 17:49:44 +03:00
Nikita Mikhaylov
1c41d73d9b small refactoring + comments adding 2020-02-10 12:27:57 +03:00
Pradeep Chhetri
4941fdfe4b Fix some spelling mistakes 2020-01-11 17:51:33 +08:00
kreuzerkrieg
9612bb0e79 More GCC warnings 2019-12-16 23:19:50 +02:00
alexey-milovidov
d354628010
Merge pull request #8088 from dingxiangfei2009/ClusterCopier/refine-zxid-def 
ClusterCopier: refine zxid definition
 2019-12-13 02:25:41 +03:00
alexey-milovidov
d2c7a10340
Update ClusterCopier.cpp 2019-12-13 02:25:12 +03:00
Ding Xiang Fei
21c571c5b5
Add reference to Zookeeper Internals manual 2019-12-12 18:16:14 +08:00
alexey-milovidov
3540dd5c53
Update ClusterCopier.cpp 2019-12-11 04:53:29 +03:00
Ding Xiang Fei
0f22f90ee5
refine zxid definition: it has two warping uint32 counters 2019-12-10 09:44:06 +08:00
Alexander Burmak
3e5ef56644 Filesystem abstraction layer 2019-11-27 14:33:27 +03:00
Ding Xiang Fei
8330a09575
apply style guide and fix CI warnings 2019-11-22 09:48:58 +08:00
Ding Xiang Fei
608aa276ab
add safeguard against contention to check target partition row counts 2019-11-22 09:48:57 +08:00
tavplubix
0046b9f137 Wait for jobs to finish on exception (fixes rare segfaults) (#7350) 2019-10-17 17:41:27 +03:00
Azat Khuzhin
d682a271ff
Missing Poco XML for copier (fixes -DSPLIT_SHARED_LIBRARIES=OFF build) 2019-09-12 02:04:43 +03:00
proller
4f1c9ee197 CLICKHOUSE-3885 copier: use partition_key in check query 2019-08-20 21:05:01 +03:00
kreuzerkrieg
112fc71276 adding -Wshadow for GCC 2019-08-09 23:58:16 +03:00
Alexey Milovidov
f40b70884f Two more fixes for PVS-Studio 2019-07-08 05:14:32 +03:00
Alexey Milovidov
553e6a273e Two more fixes for PVS-Studio 2019-07-08 03:51:43 +03:00
alexey-milovidov
a1cfdf2a60
Merge pull request #5855 from abyss7/no-undefined 
Use --no-undefined linker option for split build
 2019-07-07 01:47:11 +03:00
Nikolai Kochetov
72afe9b842 Fix heap-use-after-free in ClusterCopier caused by watch which try to use already removed copier object. 2019-07-04 17:48:40 +03:00
Ivan Lezhankin
3b995bdb02 Add missing dependecies on sight to enable --no-undefined option 2019-07-04 17:05:55 +03:00
alexey-milovidov
7ce4cd7861
Merge pull request #5745 from nvartolomei/nv/clickhouse-copier-cross-replication 
clickhouse-copier: Allow empty database name
 2019-06-27 21:09:00 +03:00
proller
aeb7eb42d1 clickhouse-copier: Fix use-after free on shutdown (#5752) 
* release script: convert .deb to .rpm and .tgz

* clickhouse-copier: Fix use-after free on shutdown

* Revert "Disable cluster copier tests"

This reverts commit 71872fc3c3.
 2019-06-27 15:29:49 +03:00
Nicolae Vartolomei
59d66bb1d5 clickhouse-copier: Allow empty database name 
This is needed to make clickhouse-copier work with cross-replication
setups (also known as [circular replication][1]).

When database name is not specified we rely on `<default_database>`
element from replica stanza.

Example:

```xml
<source_cluster>
    <shard>
        <replica>
            <host>localhost</host>
            <port>9000</port>
            <default_database>r0</default_database>
        </replica>
        <replica>
            <host>localhost</host>
            <port>666</port>
            <default_database>r1</default_database>
        </replica>
    </shard>
    <shard>
        <replica>
            <host>localhost</host>
            <port>666</port>
            <default_database>r0</default_database>
        </replica>
        <replica>
            <host>localhost</host>
            <port>9000</port>
            <default_database>r1</default_database>
        </replica>
    </shard>
</source_cluster>
```

[1]: https://www.altinity.com/blog/2018/5/10/circular-replication-cluster-topology-in-clickhouse
 2019-06-25 22:09:11 +00:00
alesapin
e45d727e9d
Merge pull request #4558 from podshumok/distributred-timeout 
Distributed and remote timeouts
 2019-06-17 13:58:17 +03:00
proller
09f3d68f6e Use logging in clickhouse-local. Use config options in command line in clickhouse-client (#5540) 
* Try fix macos server run

* Doc macos build
 # Please enter the commit message for your changes. Lines starting

* CLICKHOUSE-3957 start wip

* tests wip

* wip

* wip

* wip

* wip

* wip

* wip

* wip

* fix

* fix

* Making logger for clickhouse-local

* fixes

* wip

* wip

* wip

* wip

* clean

*      cf

* wip

* fix

* Update CMakeLists.txt

* Update argsToConfig.h

* Update argsToConfig.cpp

* Update ExtendedLogChannel.h

* Update OwnPatternFormatter.cpp
 2019-06-14 17:00:37 +03:00
Konstantin Podshumok
d688203029 set timeouts in copier 2019-06-02 12:43:20 +03:00
proller
0da7463a6b
CLICKHOUSE-4519 Support dictionaries in clickhouse-copier (#5270) 2019-05-15 12:16:09 +03:00
Alexey Milovidov
58d7d1e451 Resolved some of PVS-Studio warnings 2019-04-22 19:07:09 +03:00
proller
eaffca28dd Copier: auto upload task configuration from --task-file option (#4876) 
* Copier: auto upload task configuration from --task-file option

* task-upload-force

* doc

* Update ClusterCopier.cpp

* Requested changes
 2019-04-05 19:10:52 +03:00
proller
236f2a4354
clickhouse-copier - fix another segfault (#4900) 2019-04-04 12:22:54 +03:00
proller
edaec2353c
CLICKHOUSE-4421 Fix segfault in copier (#4835) 
* Fix segfault in copier

* add test

* better runner
 2019-04-01 17:58:04 +03:00
Ivan Lezhankin
61954d855d More reverts 2019-03-15 20:09:14 +03:00
Ivan Lezhankin
4f6a494af8 Revert references where they were before refactoring. 2019-03-15 19:14:13 +03:00
Ivan Lezhankin
4c1a0ca255 Merge remote-tracking branch 'upstream/master' into iast-as 2019-03-12 15:51:18 +03:00
Ivan Lezhankin
67eefa7b12 Revert wrong replacements of dynamic_cast. 
dynamic_cast to intermediate type is not equivalent to typeid_cast
 2019-03-12 15:41:57 +03:00
proller
3cbd3ce285
Build fixes (#4655) 2019-03-11 21:03:32 +03:00
Ivan Lezhankin
d1ead22073 Rename As<…> → as<…> 2019-03-11 16:22:51 +03:00
Ivan Lezhankin
a7e838e328 Replace all other casts to method IAST::As<Derived> 
Also remove some redundant methods like IsIdentifier() et. al.
 2019-03-11 15:49:39 +03:00
Ivan Lezhankin
0e325c7a4a Replace const typeid_casts with As<Derived>() method invocations 2019-03-08 12:48:20 +03:00
proller
55cf27da07 Build fix (copier) 2019-03-06 23:07:00 +03:00
proller
d2e18d47fb
Fix link in split mode (#4574) 2019-03-04 20:47:31 +03:00
chertus
ddf0f11e51 fix ClusterCopier crash cause of ThreadStatus not created 2019-02-28 18:49:03 +03:00
Alexey Milovidov
ba3cb83a84 Removed duplicate includes 2019-02-10 20:12:22 +03:00
KochetovNicolai
9f971c276f
Merge pull request #3669 from Enmk/ipv4_and_ipv6_domains 
Ipv4 and ipv6 domains
 2019-02-06 18:16:58 +03:00
Nikita Vasilev
a1b0dede07 Data Skipping Indices (#4143) 
* made index parser

* added index parsing

* some fixes

* added index interface and factory

* fixed compilation

* ptrs

* added indexParts

* indextypes

* index condition

* IndexCondition

* added indexes in selectexecutor

* fix

* changed comment

* fix

* added granularity

* comments

* fix

* fix

* added writing indexes

* removed indexpart class

* fix

* added setSkipIndexes

* add rw for MergeTreeIndexes

* fixes

* upd error

* fix

* fix

* reading

* test index

* fixed nullptr error

* fixed

* fix

* unique names

* asts -> exprlist

* minmax index

* fix

* fixed select

* fixed merging

* fixed mutation

* working minmax

* removed test index

* fixed style

* added indexes to checkDataPart

* added tests for minmax index

* fixed constructor

* fix style

* fixed includes

* fixed setSkipIndexes

* added indexes meta to zookeeper

* added parsing

* removed throw

* alter cmds parse

* fix

* added alter

* fix

* alters fix

* fix alters

* fix "after"

* fixed alter

* alter fix + test

* fixes

* upd setSkipIndexes

* fixed alter bug with drop all indices

* fix metadata editing

* new test and repl fix

* rm test files

* fixed repl alter

* fix

* fix

* indices

* MTReadStream

* upd test for bug

* fix

* added useful parsers and ast classes

* fix

* fix comments

* replaced columns

* fix

* fixed parsing

* fixed printing

* fix err

* basic IndicesDescription

* go to IndicesDescr

* moved indices

* go to indicesDescr

* fix test minmax_index*

* fixed MT alter

* fixed bug with replMT indices storing in zk

* rename

* refactoring

* docs ru

* docs ru

* docs en

* refactor

* rename tests

* fix docs

* refactoring

* fix

* fix

* fix

* fixed style

* unique idx

* unique

* fix

* better minmax calculation

* upd

* added getBlock

* unique_condition

* added termForAST

* unique

* fixed not

* uniqueCondition::mayBeTrueOnGranule

* fix

* fixed bug with double column

* is always true

* fix

* key set

* spaces

* test

* tests

* fix

* unique

* fix

* fix

* fixed bug with duplicate column

* removed unused data

* fix

* fixes

* __bitSwapLastTwo

* fix
 2019-02-05 17:50:25 +03:00
Vasily Nemkov
2716df8ab2 IPv4 and IPv6 Domain implementation. 
Added:
 * IDataTypeDomain interface;
 * method DataTypeFactory::registerDataTypeDomain for registering domains;
 * DataTypeDomainWithSimpleSerialization domain base class with simple serialization/deserialization;
 * Concrete IPv4 and IPv6 domain implementations: DataTypeDomanIPv6 and DataTypeDomanIPv4;

Updated:
 * IDataType text serialization/deserialization methods;
 * IDataType implementation to use domain for text serialization/deserialization;
 * Refactored implementation of the IPv4/IPv6 functions to use formatIPv4/v6 and parseIPv4/v6 from Common/formatIPv6.h;

Tests:
 * Added test cases for IPv4 and IPv6 domains.
 * Updated IPv4/v6 functions tests to validate more cases;
 * Added performance tests for IPv4 and IPv6 related functions;
 2019-02-04 12:37:46 +03:00
proller
5d4c1d9a88 Install fixes 2019-01-28 19:36:39 +03:00
proller
2ab3138eb6 Merge remote-tracking branch 'upstream/master' into fix10 2019-01-28 17:01:06 +03:00
Alexander GQ Gerasiov
aac21c5f57 Fix install of binaries when SPLIT_BINARIES is set. 2019-01-25 23:19:45 +03:00
Alexey Milovidov
abcd5a2a49 Attempt to implemnt global thread pool #4018 2019-01-11 22:12:36 +03:00
proller
497b6ec2ad
Better compile with low memory; Fix macos build, add utils/build/build_debian_unbundled_split.sh test script (#4030) 2019-01-11 15:40:19 +03:00
Alexey Milovidov
19f4652959 Fixed bugs found by PVS-Studio 2019-01-09 18:44:20 +03:00
Daniel Dao
9a676329c2
Fix simple typo in ClusterCopier 
Signed-off-by: Daniel Dao <dqminh89@gmail.com>
 2018-12-17 16:45:44 +00:00
Alexey Milovidov
c77930fe30 Whitespaces [#CLICKHOUSE-2] 2018-11-26 03:56:50 +03:00
Alexey Milovidov
7d6fffff48 More style checks [#CLICKHOUSE-3] 2018-11-24 04:48:06 +03:00
proller
1d40c2c871 Better link and deps (#3631) 
* try fix 1

* Better deps

* fix

* fix

* fix

* Update CMakeLists.txt

* Update CMakeLists.txt

* fix

* fix

* fix

* disable old

* Update find_odbc.cmake
 2018-11-21 22:20:27 +03:00
proller
0047987333 CLICKHOUSE-3885: add partition_key alias (#3166) 
* Allow run integration tests from ctest: cmake .. -DENABLE_TEST_INTEGRATION=1 && ninja && ctest -V -R integration

* CLICKHOUSE-3885: add partition_key alias

* fix

* Update ClusterCopier.cpp

* Better test

* fixing..
 2018-09-21 13:46:58 +03:00
proller
d752d5d62d Prepare to new poco, build fixes (#3072) 
* WIp

* fix

* fix

* test

* fix poco netssl find

* clean

* fixes

* wip

* wip

* new poco

* fixes

* Fixes

* wip

*  clean

* clean

*     clean

* clean

* Update HTTPHandlerFactory.h
 2018-09-14 22:48:51 +03:00
Alexey Milovidov
54ea7b0b20 Fixed error [#CLICKHOUSE-2] 2018-09-09 06:28:45 +03:00
Alexey Milovidov
625f3fea08 Enabling -Wunused-exception-parameter [#CLICKHOUSE-2] 2018-08-26 04:36:41 +03:00
Alexey Milovidov
3475ef5304 Attempt to generalize ZooKeeper interface [#CLICKHOUSE-2] 2018-08-25 04:58:14 +03:00
Vitaliy Lyudvichenko
1a4157f2a9 clickhouse_common_io does not depend on dbms. [#CLICKHOUSE-2910] 
Get rid of extra linking dependencies for clickhouse_common_io. [#CLICKHOUSE-2910]
 2018-06-21 15:13:56 +03:00
alexey-milovidov
fafecb3c25
Better modularity of formats. (#2492) 
* Formats: better modularity (development) #2447

* Formats: better modularity (development) #2447

* Formats: better modularity (development) #2447

* Formats: better modularity (development) #2447

* Formats: better modularity (development) #2447

* Formats: better modularity (development): removed very old tests #2447

* Formats: better modularity (development) #2447

* Formats: better modularity (development) #2447

* Formats: better modularity (development) #2447

* Formats: better modularity (development) #2447

* Formats: better modularity (development) #2447

* Formats: better modularity (development) #2447

* Formats: better modularity (development) #2447

* Formats: better modularity (development) #2447
 2018-06-10 22:22:49 +03:00
Alexey Milovidov
29bd48fc7a Passing settings to ser/de of data types: development #1710 2018-06-08 05:24:27 +03:00
Alexey Milovidov
51044279e5 Squashed #2471 2018-06-05 23:09:51 +03:00