Commit Graph

268 Commits

Author SHA1 Message Date
Alexey Milovidov
755310d6ff Updated LZ4 performance testing tool #1890 2018-06-12 08:06:23 +03:00
Alexey Milovidov
e3d5a2860e Updated LZ4 performance testing tool #1890 2018-06-12 08:04:16 +03:00
alexey-milovidov
17d90fe6da
Merge branch 'master' into lz4_experiments 2018-06-10 23:13:38 +03:00
Alexey Milovidov
64ea1046e1 Using ninja by default: updated instructions [#CLICKHOUSE-2] 2018-06-08 19:18:07 +03:00
proller
01a31414eb
Build fixes (#2474) 2018-06-06 21:41:39 +03:00
Alexey Milovidov
51044279e5 Squashed #2471 2018-06-05 23:09:51 +03:00
proller
4d12a823da Use copy-headers from cmake. (working compiler test without package install) (#2456)
* Try use copy-headers from cmake [WIP]

* Using internal compiler without install

* 32bit Compile fix

* Fixes

* fix

* clean

* fix

* clean
2018-06-04 23:26:17 +03:00
Alexey Zatelepin
c9bb986330 Merge branch 'master' into replicated-mergetree-mutations
Conflicts:
	dbms/src/Storages/MergeTree/AbandonableLockInZooKeeper.h
	dbms/src/Storages/MergeTree/ReplicatedMergeTreePartCheckThread.cpp
	dbms/src/Storages/MergeTree/ReplicatedMergeTreeQueue.cpp
	dbms/src/Storages/MergeTree/ReplicatedMergeTreeQueue.h
	dbms/src/Storages/StorageReplicatedMergeTree.cpp
2018-05-31 18:52:42 +03:00
proller
ba6fc5651b Docker update and improve (#2450)
* Fix user name on distributed queries

* wip

* fix

* Docker update and improve

* Fix
2018-05-30 22:26:36 +03:00
proller
060e965215
Try fix copy_headers (#2435) 2018-05-29 01:17:10 +03:00
proller
895b8e6515
Fix test 00505_secure with random ports (#2433) 2018-05-28 23:38:46 +03:00
Alexey Zatelepin
f6c72f8e56 Merge branch 'master' into replicated-mergetree-mutations
Conflicts:
	dbms/src/Common/ActionBlocker.h
	dbms/src/Storages/MergeTree/ActiveDataPartSet.cpp
	dbms/src/Storages/MergeTree/ActiveDataPartSet.h
	dbms/src/Storages/MergeTree/MergeTreeData.h
	dbms/src/Storages/MergeTree/MergeTreeDataPart.cpp
	dbms/src/Storages/MergeTree/ReplicatedMergeTreeAlterThread.cpp
	dbms/src/Storages/MergeTree/ReplicatedMergeTreeLogEntry.cpp
	dbms/src/Storages/MergeTree/ReplicatedMergeTreeLogEntry.h
	dbms/src/Storages/MergeTree/ReplicatedMergeTreeQueue.cpp
	dbms/src/Storages/MergeTree/ReplicatedMergeTreeQueue.h
	dbms/src/Storages/MergeTree/ReplicatedMergeTreeRestartingThread.cpp
	dbms/src/Storages/StorageMergeTree.cpp
	dbms/src/Storages/StorageReplicatedMergeTree.cpp
	dbms/src/Storages/StorageReplicatedMergeTree.h
2018-05-28 18:37:30 +03:00
proller
ab3ab7f52d clickhouse-test-server: use random ports (#2425)
* Fix internal compiler includes with new clang

* debug copy_headers.sh

* Fix copy_headers.sh

* Use copy-headers from cmake

* Update rules

* pbuildeR: use random ports for testing

* critical fix

* clickhouse-test-server: use random ports

* fix

* fix
2018-05-25 23:52:20 +03:00
Alexey Zatelepin
1147e052e8 select and write part mutations to queue [#CLICKHOUSE-3747] 2018-05-25 23:13:00 +03:00
proller
68ba523b23 Compile and doc fixes (#2410)
* Try fix travis

* fix

* Fix clickhouse-local shared-split link

* fix

* fix

* fix

* Build fixes

* Fix tinfo

* fix

* tinfo -> termcap

* termcap fix

* Better llvm version detect

* fix

* Debian postinst fix
Tests: use /usr/local if exists

* Compile and doc fixes

* fix

* fix

* fix

* macos fixes

* fix

* wip

* Update demangle.h

* Update demangle.cpp
2018-05-25 21:13:48 +03:00
proller
445f8800c3
Build fixes [WIP] (#2374) 2018-05-17 20:55:07 +03:00
Alexey Milovidov
fb91bba279 Miscellaneous [#CLICKHOUSE-2] 2018-05-16 03:34:56 +03:00
alexey-milovidov
589899ac25
Added scripts for various CI tasks (in progress). (#2356)
* Added initial scripts for CI [#CLICKHOUSE-2]

* CI: development [#CLICKHOUSE-2]

* CI: development [#CLICKHOUSE-2]

* CI: development [#CLICKHOUSE-2]

* CI: development [#CLICKHOUSE-2]

* CI: development [#CLICKHOUSE-2]

* CI: development [#CLICKHOUSE-2]

* CI: development [#CLICKHOUSE-2]

* CI: development [#CLICKHOUSE-2]

* CI: development [#CLICKHOUSE-2]

* CI: development [#CLICKHOUSE-2]

* CI: development [#CLICKHOUSE-2]

* CI: development [#CLICKHOUSE-2]

* CI: development [#CLICKHOUSE-2]

* CI: development [#CLICKHOUSE-2]

* CI: development [#CLICKHOUSE-2]

* CI: development [#CLICKHOUSE-2]

* CI: development [#CLICKHOUSE-2]

* CI: development [#CLICKHOUSE-2]

* CI: development [#CLICKHOUSE-2]

* CI: development [#CLICKHOUSE-2]

* CI: development [#CLICKHOUSE-2]

* CI: development [#CLICKHOUSE-2]

* CI: development [#CLICKHOUSE-2]

* CI: development [#CLICKHOUSE-2]

* CI: development [#CLICKHOUSE-2]

* CI: development [#CLICKHOUSE-2]

* CI: development [#CLICKHOUSE-2]

* CI: development [#CLICKHOUSE-2]
2018-05-14 02:12:30 +03:00
proller
efe661b620 Build fixes (#2347)
* Try fix travis

* fix

* Fix clickhouse-local shared-split link

* fix

* fix

* fix

* Build fixes

* Fix tinfo

* fix

* tinfo -> termcap
2018-05-11 17:16:16 +03:00
Alexey Milovidov
5241a81015 Better check #2240 2018-05-11 15:00:02 +03:00
Alexey Milovidov
274704d0df Added a script to validate dependencies on shared libraries #2240 2018-05-11 14:34:02 +03:00
proller
12905f5c6f
Try fix travis (#2340) 2018-05-10 15:31:30 +03:00
proller
eb772b8001 gcc8 fixes (memset, uncaught_exception) 2018-05-08 22:44:54 +03:00
proller
398097d24a Build fixes (#2323)
* Build fixes

* Fixes

* remove libzookeeper-mt-dev

* fix

* fix

* wrong

* try fix

* fix

* Update CMakeLists.txt
2018-05-07 18:59:52 +03:00
Alexey Milovidov
d72740feab Addition to prev. revision [#CLICKHOUSE-2] 2018-05-07 05:30:09 +03:00
Alexey Milovidov
bf3dbe1e86 Added a tool to fix code style [#CLICKHOUSE-2] 2018-05-07 05:27:31 +03:00
Alexey Milovidov
f589149189 Fixed build of embedded compiler with clang 7 [#CLICKHOUSE-2] 2018-05-06 12:04:10 +03:00
proller
634ba89f90 Build fixes 2018-05-05 15:34:17 +03:00
Alexey Milovidov
c9c09a9d13 Fixed Travis [#CLICKHOUSE-2] 2018-04-17 00:13:17 +03:00
proller
8a612c8e93 Better clickhouse-report 2018-04-13 15:34:14 +03:00
proller
3d38e5e477 clickhouse-report: get trace from running clickhouse-server process 2018-04-11 21:28:02 +03:00
proller
0c2ba39978
Debian: Try make compatible package depends (#2194)
* Fix split shared build

* Fix build without system odbc libs

* Move dbms/src/Common/iostream_debug_helpers.h -> libs/libcommon/include/common/iostream_debug_helpers.h

* Fix build with libiodbc

* Fix clickhouse-server.postinst

* Debian: Try make compatible package depends

* Try fix fail on travis tests fail

* Try fix package

* Fix ssl test

* fix

* fix

* wip

* try fix

* clean

* fix
2018-04-10 11:25:08 -07:00
Alexey Milovidov
2310bd7947 Miscellaneous [#CLICKHOUSE-2] 2018-04-03 20:35:48 +03:00
proller
440b0f33c7 Compile fixes 2018-04-02 15:31:49 +03:00
alexey-milovidov
428ee63a04
Merge branch 'master' into libzookeeper-rewrite 2018-04-01 17:31:20 +03:00
proller
5877498c4a Add clickhouse-report script to server package (#2123)
* Add clickhouse-report script to server package

* fix

* fix

* fix

* Revert "fix"

This reverts commit ef3ded0920.
2018-03-28 05:32:54 +03:00
Alexey Milovidov
93307a82e6 Using different ZooKeeper library (development) [#CLICKHOUSE-2] 2018-03-25 07:20:31 +03:00
Alexey Milovidov
24f94d9352 Merge remote-tracking branch 'origin/master' into libzookeeper-rewrite 2018-03-24 23:30:57 +03:00
proller
e7a2f10e2a Fix test build 2018-03-23 19:40:15 +03:00
proller
caf83a650e libs: compiling with msvc2017 (#1996)
* Allow use bundled *ssl library

* fix

* Add submodule

* Fixes

* fix

* fixes

* fixes

* fix

* fix

* update poco

* fix warnings

* fix

* fix

* Build fixes

* Build fixes

* fix

* fix

* fix

* fix

* fix

* fix

* fix

* add bat

* no zookeeper in dbms

* update boost

* fixes

* fixes

* fix

* fix

* fix

* fix

* try fix

* try fix

* fix

* fix

* fix

* fix

* fix

* fix

* fix

* fix

* Better

* fix

* dh verbose

* fix

* dh verbose

* fix

* clean

* Update LocalDate.h

* Update LocalDateTime.h
2018-03-23 19:05:14 +03:00
Alexey Milovidov
76f9e0032d Using different ZooKeeper library (development) [#CLICKHOUSE-2] 2018-03-20 00:34:56 +03:00
proller
56947de18a
Try fix ssl (#2051)
* Revert "Reverted bad modification #2035"

This reverts commit 6d6eca5e23.

* spaces

* fix

* better

* Revert "Disabled ill-formed test #2035"

This reverts commit b28cef9871.

* debug

* fix

* fix

* fix

* fix

* fix

* fix

* clean

* Tests compile fix

* fix

* Try fix ssl

* version

* Test fixes, ./release now uses pbuilder by default

* fix
2018-03-15 02:04:35 +03:00
proller
a4be761f24 rename libboost/boost_1_65_0 -> contrib/boost ; make submodule ; update boost to 1.66.0 (#1988)
* rename libboost/boost_1_65_0 -> contrib/boost ; make submodule ; update boost to 1.66.0

* Update contrib/boost

* Update contrib/boost

* Add comments

* Fix
2018-03-02 23:01:53 +03:00
proller
d6a1f8470f CLICKHOUSE-3553 Rebuild loggers on every config change (#1973)
* Macos test fix

* Fix freebsd build

* CLICKHOUSE-3553 Rebuild loggers on every config change

* rename clickhouse_common_configprocessor -> clickhouse_common_config; move Server/ConfigReloader.cpp -> Common/Config/

* CLICKHOUSE-3553 Set new level to all loggers on reload

* Dont use hash

* Update BaseDaemon.h
2018-02-28 23:34:25 +03:00
proller
cf9a33d04f CLICKHOUSE-3600 Use correct lld version, cmake fixes (#1968)
* Allow build without rt library

* fix

* Cmake misc

* CLICKHOUSE-3600 Use correct lld version

* CLICKHOUSE-3600 Use correct lld version

* Use libllvm same version as clang

* fix

* Fix build with iodbc

* Fix iodbc build

* Fix gold find

* Fix empty lines
2018-02-26 21:34:22 +03:00
proller
d2f1ef686e
Misc build and test fixes (#1905)
* Misc build fixes

* Fix apple tests
2018-02-14 20:27:14 +03:00
proller
38fd75f305
Travis: Try fix ccache (#1900)
* Travis: Try fix ccache
2018-02-13 22:39:21 +03:00
proller
971df7b853 Try fix travis. Use less travis tests (#1897)
* Try fix travis. Use less travis tests

* Disable capnp heavy test

* Travis: add gcc in pbuilder

* Fix

* fix
2018-02-13 21:00:06 +03:00
alexey-milovidov
238eba25c9
Merge branch 'master' into lz4_experiments 2018-02-12 20:05:48 +03:00
proller
a810abf7cd Try fix travis i386 2018-02-09 18:46:30 +03:00
proller
41ad692cef
Pbuilder ccache fixes (#1878)
* Pbuilder ccache fixes
2018-02-08 19:41:30 +03:00
proller
b3c60b4a2e Travis for i386 arch (#1873)
* Update internal compiler clang6.0 to rc1

* Build fixes (ubuntu bionic + clang6.0)

* Debian: Fix package install (old version can't do service clickhouse disable_cron)

* Allow use clang-7 as internal compiler: -DCMAKE_CXX_COMPILER=clang++-7 -DCMAKE_C_COMPILER=clang-7 -DLLVM_VERSION_POSTFIX=-7

* fix

* Travis: dont run tests with gcc7 (too long, does not fit to limit)

* Travis: add clang6 + ubuntu bionic

* fix travis

* todo

* Dont test symbols with gdb

* More tests

* better messag

* add note

* Travis i386

* No test

* Fix

* Fix

* pbuilder: fix ccache
2018-02-08 17:38:36 +03:00
proller
15e77ec688 Build and test fixes:
Dont test symbols with gdb
    Travis: add clang6 + ubuntu bionic (disabled)
    Travis: dont run tests with gcc7 (too long, does not fit to limit)
    Allow use clang-7 as internal compiler: -DCMAKE_CXX_COMPILER=clang++-7 -DCMAKE_C_COMPILER=clang-7 -DLLVM_VERSION_POSTFIX=-7
    Debian: Fix package install (old version can't do service clickhouse disable_cron)
    Build fixes (ubuntu bionic + clang6.0)
    Update internal compiler clang6.0 to rc1
2018-02-07 18:58:48 +03:00
proller
63b3bccb04 Test and build fixes (#1822)
* Fix travis

* try

* try

* Disable macos

* Travis enable macos

* Fix

* fast_finish: true

* fix

*  fxi

* fix openssl

* fix

* fix

* Fix

* try travis

* fix

* fix

* Cmake: dont filter platform-depended files in cmake

* misc

* renamed:    tests/server_wrapper.sh -> tests/clickhouse-test-serve

* install clickhouse-test-server

* clickhouse-test-server wip

* wip
2018-01-26 12:03:38 +03:00
proller
c430af5fb8 Freebsd fixes 2018-01-21 02:23:19 +03:00
proller
ee8272561a
More builder fixes (#1801)
* fix boost

* Fix gtest

* fix gtest

* fix

* fix gtest

* fix
2018-01-20 05:35:16 +03:00
proller
a2c3eae315 Builder fixes. Fix unbundled cctz 2018-01-20 00:33:48 +03:00
proller
3795adcd3f Fix travis 2018-01-19 20:23:07 +03:00
proller
76cf0ba5d0 Better tests (#1785)
* Make separate libs Common/ZooKeeper and Common/ConfigProcessor
renamed:    dbms/src/Common/StringUtils.h -> dbms/src/Common/StringUtils/StringUtils.h

* Fix space

* Fix data in system.build_options

* merge

* merge

* Travis optimize

* optimize

* Fix clickhouse-test --no-long

* no long

* Split too long test

* Better tests

* missing file

* Fix includes

* Added draft [#CLICKHOUSE-2].

* fix

* fix

* fix

* Fix test 281 under asan
2018-01-18 23:33:16 +03:00
proller
d8a92e80d6 Use double-conversion as submodule 2018-01-16 21:58:12 +03:00
proller
e8f2bb2d3b
Travis optimize (#1775)
* Travis optimize
2018-01-16 16:44:45 +03:00
Alexey Milovidov
2fa8992e2c Continued experiments [#CLICKHOUSE-2] 2018-01-16 04:59:51 +03:00
Alexey Milovidov
6d1e68baf9 Experiments continued [#CLICKHOUSE-2] 2018-01-16 00:52:24 +03:00
Alexey Milovidov
9e1e079a34 Experiments continued [#CLICKHOUSE-2] 2018-01-16 00:00:26 +03:00
proller
d97b2edc7c Make separate libs Common/ZooKeeper and Common/ConfigProcessor (#1749)
* Make separate libs Common/ZooKeeper and Common/ConfigProcessor
renamed:    dbms/src/Common/StringUtils.h -> dbms/src/Common/StringUtils/StringUtils.h

* Fix space

* Fix data in system.build_options

* merge

* merge
2018-01-15 22:07:47 +03:00
proller
f6d8436f81 Enable travis (#1772)
* Try travis

* wip

* Try travis

* try

* try

* try

* try

* Revert "try"

This reverts commit 7ecd73c2eb.

* try unbundled

* Try unbundled2

* Try undundled3

* Try unbundled4

* Try5

* try gcc7

* try6

* Try clang

* Try min

* try ccache

* try ccache stats

* no sudo

* try clang

* try ccache

* reset changelog

* Try fix clang

* try limit time

* Faster

* try timeout

* try faster

* Try

* try

* try

* try

* try

* try

* ccache

* Fix

* try test

* try test

* Fix try_listen in some vm's

* fix

* test

* fix

* cache timeout

* packages

* fix

* fix

* fix

* try emb compiler

* Try emb compiler

* Revert "try emb compiler"

This reverts commit 471713cabe.

* try

* Revert "Try emb compiler"

This reverts commit 95e632abf6.

* Skip long

* fix

* fix

* ccache

* fix

* debug

* Fxi test

* test fix

* tes fix

* Fix

* Fix link

* Fix odbc link

* Fxi test

* fix  boost unbundled include

* fix test

* fix test

* test fix

* fix tests

* tests

* Test fail
2018-01-15 21:57:10 +03:00
Alexey Milovidov
844c6d7786 Experiments with LZ4 [#CLICKHOUSE-2] 2018-01-15 08:56:50 +03:00
Alexey Milovidov
53ab52f95c Experiments with LZ4 [#CLICKHOUSE-2] 2018-01-15 08:54:28 +03:00
Alexey Milovidov
ed4c9476ee Added experimental data scrambler; experiments in performance of LZ4_decompress_fast function [#CLICKHOUSE-2] 2018-01-15 02:54:23 +03:00
proller
b026eb7797 Use submodule contrib/capnproto, remove include_directories (#1746)
* Add submodule contrib/capnproto

* Use contrib/capnproto, remove include_directories

* Fix include

* Clean

* Fix werror

* Update doc

* Fix

* Final fix

* Fxi
2018-01-11 21:39:52 +03:00
proller
b0469def79 Remove package clickhouse-compressor, simpler pbuilder test 2018-01-10 02:43:04 +03:00
proller
eb677a33e6 Add system.replicas dum to utils/report/clickhouse_report.sh 2017-12-25 20:17:32 +03:00
proller
46fb94a3e4 Internal compiler: Use libclang-5.0 (#1597)
* Fix std::numeric_limits<__uint128_t>

* clean

* Better fix of std::numeric_limits<__uint128_t>

* Use clang 5.0 (release) as internal compiler

* message

* Fix werror

* fix

* fix

* fixing..

* note

* fix

* fix

* fix

* fix

* multi version

* fix

* fix
2017-12-08 11:28:08 +03:00
proller
4b63d9a4c3 Cmake: fix link of some tests (missing pthread) 2017-11-27 23:39:06 +03:00
Alexey Vasiliev
6cb97b9221 ConfigProcessor: do not create config-preprocessed before setting umask [#MOBMET-7044] 2017-11-25 02:00:10 +03:00
proller
6ff1968196 Compile and likk optimize and fixes 2017-11-24 21:08:01 +03:00
proller
60c5fbdb03 Fix include path contrib/zlib-ng 2017-11-22 22:15:17 +03:00
proller
7a5dd87802 Update build_debian.sh 2017-11-17 16:14:13 +03:00
Alexey Milovidov
35aec21756 Updated instruction [#CLICKHOUSE-2]. 2017-11-14 22:46:11 +03:00
Alexey Milovidov
16358603a9 Updated script [#CLICKHOUSE-2]. 2017-11-12 17:46:33 +03:00
Alexey Milovidov
65d125a96a Tiny modification in script to download and build clang [#CLICKHOUSE-2]. 2017-10-30 02:01:21 +03:00
Alexey Milovidov
a27981b4ef Get rid of double whitespaces [#CLICKHOUSE-2]. 2017-10-26 21:36:23 +03:00
proller
9ccba5fad1 Fix includes 2017-10-26 14:46:57 +03:00
proller
c66228a746 Log query id in executeQuery; Better type mismatch error; change format in report tool (#1372)
* Log query id in executeQuery; Better type mismatch error; change format in report tool

* Better log query_id

* fix message

* Use c++11 thread_local instaed of gcc's __thread

* lock mutex before notifying waiting thread in sync insertion into distributed [#CLICKHOUSE-3379]

* Cmake: fix build without downloaded submodules (#1379)

* fix
2017-10-23 20:32:39 +03:00
Alexey Milovidov
0ec218a853 Merge branch 'master' of github.com:yandex/ClickHouse 2017-10-13 04:09:51 +03:00
proller
16cd8fbda6 clickhouse_report.sh : more info about OS and kernel 2017-10-10 20:55:35 +03:00
Alexey Milovidov
1405415f94 Miscellaneous [#CLICKHOUSE-3]. 2017-10-09 01:53:38 +03:00
Vitaliy Lyudvichenko
48c5382c92 Add 'clickhouse compressor' command. [#CLICKHOUSE-2] 2017-09-24 02:15:56 +03:00
proller
0a0e04f1a5 Fix includes 2017-09-18 21:52:47 +03:00
Alexey Milovidov
02a0317db6 Updated instruction of installation of clang: added useful tool [#CLICKHOUSE-2]. 2017-09-10 06:29:40 +03:00
Alexey Milovidov
cd540c2674 Replaced Mersenne Twister to PCG-Random [#CLICKHOUSE-2]. 2017-09-10 02:17:38 +03:00
Alexey Milovidov
d19d9f8589 Implemented some suggestions from clang-tidy (part 2) [#CLICKHOUSE-3301]. 2017-09-08 05:37:02 +03:00
Alexey Milovidov
1cd09ac12f Updated script to build latest clang [#CLICKHOUSE-2]. 2017-09-08 03:25:25 +03:00
Alexey Milovidov
79f65f4fd5 Addition to prev. revision [#CLICKHOUSE-3300]. 2017-09-08 00:19:43 +03:00
Alexey Milovidov
8b313ab99e Fixed warnings found by cppcheck [#CLICKHOUSE-3300]. 2017-09-08 00:04:48 +03:00
proller
3269b1da57 libmariadb as submodule (CLICKHOUSE-3261) (#1181)
* Use bundled libmariadbclient (CLICKHOUSE-3261)

* wip

* wip

* wip

* Update docs about git clone. move docs/en/development/build_*.sh -> utils/build/build_debian.sh
2017-08-31 20:11:30 +03:00
proller
d6833a0d55 Cmake: remove global include_directories (#1055)
* Fix .h compile

* Cmake: remove global include_directories

* boost include hide

* fix cctz

* add \n
2017-08-03 15:44:39 +03:00
Pawel Rog
3a6c444996 Merge branch 'master' into nocompression 2017-07-31 13:36:58 +02:00
Pawel Rog
a0cc54457e Added compression NONE 2017-07-31 12:44:45 +02:00
proller
3dbde50daa Split ComplexKeyCacheDictionary to use less then 1.5G ram when compile (#1034)
* Split FunctionsArithmetic.cpp to generated functions

* Use ccache if found

* Do not use ccache if ccache defined in CMAKE_CXX_COMPILER_LAUNCHER

* check_include.sh: print memory usage

* Try split CacheDictionary source

* Split ok

* wip

* wip

* wip

* wip

* wip

* wip
2017-07-27 22:05:55 +03:00