Commit Graph

510 Commits

Author SHA1 Message Date
Ivan Blinkov
659b467290
Update produce.py 2019-11-01 19:10:15 +03:00
Ivan Blinkov
ac7fb00849
Update manage.py 2019-11-01 19:09:35 +03:00
Ivan Blinkov
4765b7bee5
[utils/kafka] provide some exit code from main 2019-11-01 19:08:29 +03:00
Ivan Blinkov
9af95b9d7a
[make_changelog] avoid except without specifying class 2019-11-01 19:06:33 +03:00
Ivan Blinkov
9fd7fee9ba
remove unused format argument 2019-11-01 18:57:14 +03:00
Ivan Blinkov
c13e330a1d
fix python issue reported by lgtm.com
`Call to ArgumentError.__init__ with too few arguments; should be no fewer than 2.`
2019-11-01 18:53:14 +03:00
proller
0006f2a370 Fix build without submodules (#7295)
* Build fixes

*            fix

* Fix

* fix

* Fix install(export..

* Freebsd fixes

* Freebsd fixes

* Fix warning

* fix

* More PRIVATE linking

* Fix review

* Timmy

* Timmy

* fix

* Try fix jemalloc link

* style
2019-10-30 23:34:06 +03:00
tavplubix
0046b9f137 Wait for jobs to finish on exception (fixes rare segfaults) (#7350) 2019-10-17 17:41:27 +03:00
Ivan Lezhankin
340705f1ca Fix backporting script
Rename yandex → ClickHouse
2019-10-09 14:37:20 +03:00
alesapin
e31f33bc1c Fix category search in changelog script 2019-10-08 11:59:29 +03:00
proller
594c535bd4 Build fixes (#7063)
* Build fixes

*            fix

* Fix

* fix

* Fix install(export..

* Freebsd fixes

* Freebsd fixes

* Fix warning

* fix

* More PRIVATE linking

* Fix review

* Timmy

* fix

* fix
2019-10-05 22:25:31 +03:00
Alexey Milovidov
abbd451131 Updated default repository. 2019-10-02 00:47:07 +03:00
filimonov
40c9d44a66
rpm: preserve existing configs on package upgrade 2019-09-26 07:10:41 +02:00
alexey-milovidov
d4df1030c9
Merge pull request #7073 from filimonov/patch-4
add obsoletes section to clickhouse-server spec
2019-09-25 21:46:34 +03:00
Alexey Milovidov
ff07ffbbae Merge branch 'merging_redis' of https://github.com/CurtizJ/ClickHouse into CurtizJ-merging_redis 2019-09-25 02:27:05 +03:00
alexey-milovidov
2f195ddb03
Merge pull request #7028 from abyss7/issue-6459
Implement cross-compilation support Linux → Darwin
2019-09-24 02:20:17 +03:00
filimonov
c9252964c3
add obsoletes section to clickhouse-server spec 2019-09-23 23:36:51 +02:00
Alexey Milovidov
8579c26efb Changed repository URL 2019-09-23 19:18:19 +03:00
Ivan Lezhankin
4b143c3e0f Merge remote-tracking branch 'upstream/master' into issue-6459 2019-09-23 16:07:19 +03:00
Ivan Lezhankin
9e46118edd Merge remote-tracking branch 'upstream/master' into issue-6459 2019-09-20 21:25:55 +03:00
Ivan Lezhankin
8cb0e58bc7 Fix build for all targets 2019-09-20 21:13:51 +03:00
Ivan
5526f33a5e
Implement auto-labelling for the backporting script (#7001) 2019-09-19 21:01:47 +03:00
CurtizJ
79a08ef8ea Merge remote-tracking branch 'upstream/master' into merging_redis 2019-09-18 12:58:22 +03:00
alexey-milovidov
fe9e110a6a
Merge pull request #6965 from azat-archive/sparsehash-c11
Replace libsparsehash with sparsehash-c11
2019-09-18 12:46:13 +03:00
Azat Khuzhin
780341060f
Replace libsparsehash with sparsehash-c11
- use sparsehash-c11 over libsparsehash
- fix typos in find_sparsehash and users of the vars (s/SPARCE/SPARSE/)
- drop libsparsehash-dev from docker images (but keep for unbunlded build)
- use ::google over GOOGLE_NAMESPACE
2019-09-18 00:08:20 +03:00
proller
5d08a7b353 Remove gcc-7 from build scripts 2019-09-17 13:37:35 +03:00
proller
bcffa17b92 better 2019-09-14 12:20:17 +03:00
proller
25fdaefcae remove gcc-7 2019-09-14 12:11:52 +03:00
CurtizJ
3b3657ff1e Merge branch 'add-ext-dict-redis' of https://github.com/comunodi/ClickHouse into merging_redis 2019-09-09 13:51:50 +03:00
Ivan Lezhankin
6f1a8c37ab Print API costs in utils/github 2019-09-06 15:42:15 +03:00
Ivan Lezhankin
89a444c4a0 Fix script for releases 2019-09-06 13:37:04 +03:00
Ivan
b4339f266d
Make a better build scheme (#6500)
* Fix shared build
* Major default libs refactor
* Fix build with gcc_eh
* Link all libraries as a big group.
* Use global interface library as a group
* Build capnproto using our cmake
* Use only internal libunwind
2019-08-28 23:49:37 +03:00
Alexey Milovidov
b42f85e16b Added a check for double whitespaces 2019-08-23 21:30:04 +03:00
Alexey Milovidov
5fd649e663 Check for broken symlinks #6625 2019-08-23 18:10:33 +03:00
Alexey Milovidov
dd73996073 Added instruction for "list_backports" script 2019-08-21 01:52:57 +03:00
Ivan
a502424c33
Implement support for insertion into Kafka tables (#6012)
* Add write-callback on each row for RowOutputStream
* Fix build of new rdkafka library
* Poll messages if Kafka outgoing queue is full
* Add test
* Add test producer-consumer
* Truncate delimiter from last row in message
2019-08-20 14:17:57 +03:00
Alexey Milovidov
8ff4c38751 Added option to generate changelog from a list of PRs 2019-08-05 22:24:51 +03:00
Alexey Milovidov
acd6651f60 Better changelog script 2019-08-05 03:23:42 +03:00
Alexey Milovidov
ff1be9755f Removing extra whitespaces 2019-08-05 02:36:02 +03:00
Alexey Milovidov
ea22e8fb09 Allowed unknown authors; substituting links to issues 2019-08-05 02:04:22 +03:00
Alexey Milovidov
39f711d895 Allowed unknown authors; substituting links to issues 2019-08-05 02:02:44 +03:00
Alexey Milovidov
3f2d0dfcec Sorting categories in desired order; skipping documentation fixes 2019-08-05 00:42:32 +03:00
Alexey Milovidov
17766bf141 Make changelog script more sane 2019-08-05 00:31:52 +03:00
Alexey Milovidov
58d5e58eed Avoid finding commits in forks 2019-08-04 23:32:16 +03:00
Alexey Milovidov
95b0ec46b9 Attempt to make changelog generator better 2019-08-04 23:17:51 +03:00
Alexey Milovidov
d4002a7188 Moved "ci" directory to "utils", because we are actually using different CI, but these scripts are still usable 2019-08-04 22:10:14 +03:00
alexey-milovidov
fe3831b6ef
Update build_macos.sh 2019-07-25 23:32:13 +03:00
alexey-milovidov
20a8914858
Merge pull request #6132 from vitlibar/allow-protobuf-message-with-all-fields-by-default
Allow protobuf message with all fields by default
2019-07-25 04:12:23 +03:00
Vitaly Baranov
2068e1f0e0 Add more protobuf IO tests. 2019-07-23 16:57:25 +03:00
Vitaly Baranov
4f91e3e4b7 Fix protobuf format tests. 2019-07-23 16:51:22 +03:00
alesapin
6ff1dce79a Backquote key in debsign 2019-07-23 12:46:54 +03:00
Vitaly Baranov
e6aebb5b13 Fix after review. 2019-07-19 12:19:47 +03:00
Vitaly Baranov
9fb3135c23 Improve utility zookeeper-adjust-block-numbers-to-parts.
Add filter on shards and tables.
Add flag --dry-run.
The utility now checks cversion before doing anything.
2019-07-19 03:39:22 +03:00
alesapin
f32b3975c7 Fix version 2019-07-16 13:02:31 +03:00
alesapin
458a171fef Add dependencies to rpm packages 2019-07-16 12:33:47 +03:00
alesapin
3f0df28109
Merge pull request #5977 from yandex/sign_rpms
Add ability to sign rpm packages
2019-07-11 19:03:21 +03:00
alesapin
a6220e289a Add ability to sign rpm packages 2019-07-11 15:50:41 +03:00
Alexey Milovidov
8abe0990b2 Remove "clickhouse_compression" library because it is not a library (cyclic dependency via IDataType) 2019-07-10 00:43:04 +03:00
alexey-milovidov
3571011a49
Merge pull request #5719 from excitoon-favorites/arch-package
Added Arch linux package generation.
2019-06-28 15:00:15 +03:00
Vladimir Chebotarev
b0b821e5e3 Moved Arch Linux package template to a proper folder. 2019-06-28 07:22:03 +03:00
alesapin
ab8dd1d4e3
Merge pull request #5769 from yandex/add_rpm_build_to_packager
Add ability to build rpm and tgz packages via packager
2019-06-27 23:14:19 +03:00
alesapin
265c18b45f Fix tgz-release in push packages 2019-06-27 19:00:26 +03:00
proller
1bb911f742 release --rpm: Fix redefining version 2019-06-27 18:37:13 +03:00
proller
0bd65f49a2 Better release --rpm 2019-06-27 17:12:53 +03:00
proller
3149b57100
release script: convert .deb to .rpm and .tgz (#5740) 2019-06-25 16:55:31 +03:00
alexey-milovidov
f9cab91447
Merge pull request #5617 from proller/fix15
19.8 build fixes
2019-06-14 17:29:51 +03:00
proller
09f3d68f6e Use logging in clickhouse-local. Use config options in command line in clickhouse-client (#5540)
* Try fix macos server run

* Doc macos build
 # Please enter the commit message for your changes. Lines starting

* CLICKHOUSE-3957 start wip

* tests wip

* wip

* wip

* wip

* wip

* wip

* wip

* wip

* fix

* fix

* Making logger for clickhouse-local

* fixes

* wip

* wip

* wip

* wip

* clean

*      cf

* wip

* fix

* Update CMakeLists.txt

* Update argsToConfig.h

* Update argsToConfig.cpp

* Update ExtendedLogChannel.h

* Update OwnPatternFormatter.cpp
2019-06-14 17:00:37 +03:00
proller
fc7ae399c4 Use system rapidjson; Fix types for macos; 2019-06-14 13:28:30 +03:00
Alexey Milovidov
f38042f006 Check for namespace comments in "check-style" tool #5561 2019-06-13 13:45:32 +03:00
alesapin
d4f474cd19 Add prestable releases to packages pusher 2019-05-31 14:42:36 +03:00
Alexey Milovidov
f406eb17ae Added a tool to calculate checksums caused by bit flips 2019-05-19 01:48:28 +03:00
proller
51ca4cbaa4
Build fixes (#5278) 2019-05-15 20:19:39 +03:00
Ivan
4a5832b18a
Check the time limit every (flush_interval / poll_timeout) number of rows from Kafka (#5249) 2019-05-14 18:52:03 +03:00
proller
cc3de4115f
Build fixes (#5261) 2019-05-14 12:58:33 +03:00
Ivan
1eb835be35
Reduce maximum page size (#5140) 2019-04-29 17:22:04 +03:00
proller
fd63093032 Add gperf to build requirements (for upcoming pull request #5030 ) 2019-04-25 17:31:08 +03:00
alesapin
8d808aedf3 Fix bug in s3uploader 2019-04-23 14:50:43 +03:00
Alexey Milovidov
720f911379 Removed obsolete files 2019-04-22 22:28:10 +03:00
alexey-milovidov
0cf40e0029
Merge pull request #5082 from yandex/pvs-studio-fixes-3
Resolved some of PVS-Studio warnings
2019-04-22 22:06:07 +03:00
alexey-milovidov
b1cf026b5b
Merge pull request #5080 from abyss7/issue-4736
Do not drop Kafka Consumer buffers after deletion of stream
2019-04-22 19:18:33 +03:00
Alexey Milovidov
58d7d1e451 Resolved some of PVS-Studio warnings 2019-04-22 19:07:09 +03:00
Ivan Lezhankin
7723a63d0a Add helper utils to interact with Kafka broker 2019-04-18 17:36:51 +03:00
proller
525726a5e2
Remove pocoext (#5036) 2019-04-17 20:36:58 +03:00
alesapin
ed47aa109d
Merge pull request #4998 from abyss7/release-helpers
Detect backports by PRs to stable branches with `pr-backport` label
2019-04-16 20:05:18 +03:00
alesapin
faeb95cfd7
Merge branch 'master' into adaptive_index_granularity 2019-04-15 19:36:36 +03:00
Ivan Lezhankin
31a566c4f2 Detect backports by PRs to stable branches with pr-backport label
Also add some fancy colors.
2019-04-12 19:08:38 +03:00
alesapin
3accb16cc6
Merge pull request #4949 from abyss7/release-helpers
Add python util to help with releases
2019-04-11 19:28:58 +03:00
Ivan Lezhankin
722e022e54 Allow to filter PRs by login 2019-04-11 19:16:57 +03:00
Ivan Lezhankin
af7ab86ab6 Refactor queries 2019-04-11 18:08:25 +03:00
alesapin
9544784b71 Retry 500-error codes in changelog script 2019-04-11 13:54:19 +03:00
Ivan Lezhankin
1311244203 Detect backports via manually set labels. 2019-04-09 14:57:46 +03:00
Ivan Lezhankin
78d5de9dd3 Respect label color to check for backporting 2019-04-09 12:55:10 +03:00
Ivan Lezhankin
40be310fa0 Prettify output 2019-04-09 12:25:18 +03:00
Ivan Lezhankin
692c5a6ed2 Better filter associated pull-requests 2019-04-08 22:28:08 +03:00
Ivan Lezhankin
5a909b01b0 Print more problems 2019-04-08 19:11:13 +03:00
Ivan Lezhankin
be23dff3b0 Initial implementation.
Prints "good" and "bad" commits.
2019-04-08 18:33:05 +03:00
alesapin
a53b002973 Merge remote-tracking branch 'origin' into adaptive_index_granularity 2019-04-08 14:29:33 +03:00
Danila Kutenin
37d70ac558 MarkCache and UncompressedCache use different allocator to catch segfaults more reliable 2019-04-06 18:27:39 +03:00
alesapin
1291ecbed7 Better logging in adjust block util 2019-04-04 22:44:04 +03:00
alesapin
43ed0a8e7f Style fix 2019-04-04 16:03:20 +03:00
alesapin
ee49252160 Add util for adjust block numbers in zookeper 2019-04-04 16:01:48 +03:00
alesapin
7b67200258 Merge remote-tracking branch 'origin' into adaptive_index_granularity 2019-04-01 11:54:19 +03:00
proller
1584fd4367
Fix hyperscan library find and use (#4798) 2019-03-26 00:31:00 +03:00
alesapin
b5d6813604 Fix vertical merge again 2019-03-20 20:04:34 +03:00
alesapin
2b2a637a38 Simpliest write/merge/select test works 2019-03-18 18:54:58 +03:00
Alexey Milovidov
825f0aab48 Fixed typo 2019-03-15 21:31:36 +03:00
proller
8c70de3bc7
Build fixes (freebsd) (#4696) 2019-03-14 23:52:10 +03:00
proller
cf8001b6a9
Fix includes (#4673) 2019-03-13 16:58:04 +03:00
proller
d2e18d47fb
Fix link in split mode (#4574) 2019-03-04 20:47:31 +03:00
alesapin
11a3a4bf68 Add first version of script for packages push 2019-03-04 15:56:46 +03:00
Amos Bird
26ab5dd7a7 A Proper lookup table that uses HashTable's API
This is the first step of allowing heterogeneous cells in hash tables.

performance test results are

```

1. HashMap<UInt16, UInt8, TrivialHash, HashTableFixedGrower<16>>;
2. NewLookupMap<UInt16, UInt8>

ResolutionWidth 30000 1 .................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................223550276.46
ResolutionWidth 30000 2 .................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................248772721.24
Best: 2 - 24877272124

ResolutionWidth 100000 1 ..........................................................................................................................................................................................................................................................238498413.99
ResolutionWidth 100000 2 ..........................................................................................................................................................................................................................................................261808889.98
Best: 2 - 26180888998

ResolutionWidth 300000 1 ...................................................................................239307348.81
ResolutionWidth 300000 2 ...................................................................................257592761.30
Best: 2 - 25759276130

ResolutionWidth 1000000 1 .........................240144759.26
ResolutionWidth 1000000 2 .........................257093531.91
Best: 2 - 25709353191

ResolutionWidth 5000000 1 .....241573260.35
ResolutionWidth 5000000 2 .....259314162.79
Best: 2 - 25931416279

ResolutionDepth 30000 1 .................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................217108119.84
ResolutionDepth 30000 2 .................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................249459504.41
Best: 2 - 24945950441

ResolutionDepth 100000 1 ..........................................................................................................................................................................................................................................................229065162.17
ResolutionDepth 100000 2 ..........................................................................................................................................................................................................................................................253769105.64
Best: 2 - 25376910564

ResolutionDepth 300000 1 ...................................................................................233079225.18
ResolutionDepth 300000 2 ...................................................................................256316273.78
Best: 2 - 25631627378

ResolutionDepth 1000000 1 .........................234184633.51
ResolutionDepth 1000000 2 .........................261100491.57
Best: 2 - 26110049157

ResolutionDepth 5000000 1 .....233118795.66
ResolutionDepth 5000000 2 .....252436160.41
Best: 2 - 25243616041

```
2019-03-01 16:47:13 +08:00
Vitaly Baranov
2e8669211a Improve test: check input/output with protobuf schema containing nested messages. 2019-02-27 14:37:17 +03:00
Vitaly Baranov
78c808da10 Add a test for checking reading data from protobuf messages. 2019-02-20 07:28:18 +03:00
proller
e20c77e4c6 Add parquet support. Fixes, tests, ... 2019-02-19 23:51:44 +03:00
proller
f5560660be Fix brotli (unbundled, missing, ...) 2019-02-13 18:35:11 +03:00
Alexey Milovidov
57e038c754 Added a script to check for ungrouped includes 2019-02-10 20:40:18 +03:00
Alexey Milovidov
fdf69f38c0 Added a script to check for duplicate includes 2019-02-10 20:00:29 +03:00
proller
e4f3713102 Fix link in split mode 2019-02-06 17:14:16 +03:00
alesapin
1c2087d3b8 Read revision from files only if it was not specified explicitly 2019-02-05 14:07:28 +03:00
alesapin
9d61d09c8c Add ability to set version in release_lib.sh via env variables 2019-02-04 18:14:44 +03:00
alexey-milovidov
012bd5267b
Merge pull request #4195 from yandex/convert-parts-from-old-format
А tool to convert an old month-partition part to the custom-partitioned format
2019-01-31 22:45:44 +03:00
Alexey Zatelepin
8957e73681 a tool to convert an old month-partition part to the custom-partitioned format [#CLICKHOUSE-4231] 2019-01-30 16:51:39 +03:00
alesapin
0531722fc9 Better logging in script 2019-01-29 19:29:03 +03:00
alesapin
b7583337a8 Add s3uploader script in tools 2019-01-29 15:12:28 +03:00
alexey-milovidov
a175c9734a
Merge pull request #4173 from yandex/make-chengelog-script
make_changelog.py review fixes.
2019-01-28 23:37:51 +03:00
Nikolai Kochetov
8263b66510 make_changelog.py review fixes. 2019-01-28 21:06:13 +03:00
alexey-milovidov
25e0f56e39
Merge pull request #4169 from yandex/make-chengelog-script
Added script for changelog.
2019-01-28 19:48:39 +03:00
Nikolai Kochetov
b82c34f0c2 Added script for changelog. 2019-01-28 18:33:34 +03:00
Alexey Milovidov
4e3d9a0f15 Merge branch 'master' of github.com:yandex/ClickHouse into global-thread-pool 2019-01-28 14:20:24 +03:00
proller
5328251ff1
Fix build without protobuf, gtest, cppkafka (#4152) 2019-01-25 23:02:03 +03:00
Vitaly Baranov
ed1136e49e Use more IO/WriteHelpers.h functions in the class ProtobufSimpleWriter,
rename variant=>varint.
2019-01-25 17:15:44 +03:00
Alexey Milovidov
65f8e4d4a8 Merge branch 'master' into global-thread-pool 2019-01-25 16:33:50 +03:00
Vitaly Baranov
2e383bfdeb Added tests for writing protobufs. 2019-01-24 17:54:57 +03:00
proller
0939387514
Build fixes (#4076)
Move copy_headers.sh and formath.sh from root.
Debian: use default build dir (obj-x86_64-linux-gnu)
Debian: add test after build (GLIBC_required_version)
cmake: dont run copy headers if already copied
2019-01-18 18:19:53 +03:00
Alexey Milovidov
a7c468da8e Merge remote-tracking branch 'origin/master' into global-thread-pool 2019-01-17 21:57:01 +03:00
Alexey Zatelepin
0f8e5f8522 Merge branch 'master' into zk-columns-compact-storage
Conflicts:
	dbms/src/Storages/StorageReplicatedMergeTree.cpp
2019-01-16 17:45:16 +03:00
Alexey Milovidov
00a4b2cf8a Removing garbage, part 1 2019-01-13 21:51:57 +03:00
proller
497b6ec2ad
Better compile with low memory; Fix macos build, add utils/build/build_debian_unbundled_split.sh test script (#4030) 2019-01-11 15:40:19 +03:00
alexey-milovidov
a739edc239
Merge pull request #4013 from yandex/pvs-studio-fixes-2
Fixed bugs found by PVS-Studio
2019-01-09 22:55:11 +03:00
proller
64c2c3650c
cmake: Dont cache version; macos: fix build; /release_lib.sh move to utils (#4016) 2019-01-09 21:32:43 +03:00
Alexey Milovidov
19f4652959 Fixed bugs found by PVS-Studio 2019-01-09 18:44:20 +03:00
proller
300bbdfb43 Fix cyclic lib depend ppart 2: clean 2018-12-28 21:15:26 +03:00
proller
0c78ef8573 Fix cyclic lib depend (make clickhouse_compression lib) 2018-12-28 20:27:53 +03:00
Alexey Zatelepin
46621aea32 add util to copy zookeeper trees [#CLICKHOUSE-4024] 2018-12-28 16:20:35 +03:00
alexey-milovidov
d16447c3f4
Merge pull request #3899 from yandex/custom_compression_codecs
Custom compression codecs
2018-12-28 08:29:09 +03:00
proller
1a0a879a51 Build fixes 2018-12-27 18:23:37 +03:00
alesapin
1e771a4aec Fix error codes 2018-12-24 14:34:50 +03:00
proller
bebaf9d861 Fix includes, Faster compile (#3898)
* Fix includes

* Faster compile

* WTFix

* Limit compile and linking jobs according to available memory

* Add comment

* fix

* Remove ALL from copy-headers target

* Freebsd fix

* Better

* cmake: split use libcxx
2018-12-23 17:19:11 +03:00
alesapin
42b9735760 Add LZ4HC 2018-12-21 17:03:53 +03:00
proller
6869771ae4 Fix includes 2018-12-19 20:57:51 +03:00