Commit Graph

426 Commits

Author SHA1 Message Date
Alexey Milovidov
dd73996073 Added instruction for "list_backports" script 2019-08-21 01:52:57 +03:00
Ivan
a502424c33
Implement support for insertion into Kafka tables (#6012)
* Add write-callback on each row for RowOutputStream
* Fix build of new rdkafka library
* Poll messages if Kafka outgoing queue is full
* Add test
* Add test producer-consumer
* Truncate delimiter from last row in message
2019-08-20 14:17:57 +03:00
Alexey Milovidov
8ff4c38751 Added option to generate changelog from a list of PRs 2019-08-05 22:24:51 +03:00
Alexey Milovidov
acd6651f60 Better changelog script 2019-08-05 03:23:42 +03:00
Alexey Milovidov
ff1be9755f Removing extra whitespaces 2019-08-05 02:36:02 +03:00
Alexey Milovidov
ea22e8fb09 Allowed unknown authors; substituting links to issues 2019-08-05 02:04:22 +03:00
Alexey Milovidov
39f711d895 Allowed unknown authors; substituting links to issues 2019-08-05 02:02:44 +03:00
Alexey Milovidov
3f2d0dfcec Sorting categories in desired order; skipping documentation fixes 2019-08-05 00:42:32 +03:00
Alexey Milovidov
17766bf141 Make changelog script more sane 2019-08-05 00:31:52 +03:00
Alexey Milovidov
58d5e58eed Avoid finding commits in forks 2019-08-04 23:32:16 +03:00
Alexey Milovidov
95b0ec46b9 Attempt to make changelog generator better 2019-08-04 23:17:51 +03:00
Alexey Milovidov
d4002a7188 Moved "ci" directory to "utils", because we are actually using different CI, but these scripts are still usable 2019-08-04 22:10:14 +03:00
alexey-milovidov
fe3831b6ef
Update build_macos.sh 2019-07-25 23:32:13 +03:00
alexey-milovidov
20a8914858
Merge pull request #6132 from vitlibar/allow-protobuf-message-with-all-fields-by-default
Allow protobuf message with all fields by default
2019-07-25 04:12:23 +03:00
Vitaly Baranov
2068e1f0e0 Add more protobuf IO tests. 2019-07-23 16:57:25 +03:00
Vitaly Baranov
4f91e3e4b7 Fix protobuf format tests. 2019-07-23 16:51:22 +03:00
alesapin
6ff1dce79a Backquote key in debsign 2019-07-23 12:46:54 +03:00
Vitaly Baranov
e6aebb5b13 Fix after review. 2019-07-19 12:19:47 +03:00
Vitaly Baranov
9fb3135c23 Improve utility zookeeper-adjust-block-numbers-to-parts.
Add filter on shards and tables.
Add flag --dry-run.
The utility now checks cversion before doing anything.
2019-07-19 03:39:22 +03:00
alesapin
f32b3975c7 Fix version 2019-07-16 13:02:31 +03:00
alesapin
458a171fef Add dependencies to rpm packages 2019-07-16 12:33:47 +03:00
alesapin
3f0df28109
Merge pull request #5977 from yandex/sign_rpms
Add ability to sign rpm packages
2019-07-11 19:03:21 +03:00
alesapin
a6220e289a Add ability to sign rpm packages 2019-07-11 15:50:41 +03:00
Alexey Milovidov
8abe0990b2 Remove "clickhouse_compression" library because it is not a library (cyclic dependency via IDataType) 2019-07-10 00:43:04 +03:00
alexey-milovidov
3571011a49
Merge pull request #5719 from excitoon-favorites/arch-package
Added Arch linux package generation.
2019-06-28 15:00:15 +03:00
Vladimir Chebotarev
b0b821e5e3 Moved Arch Linux package template to a proper folder. 2019-06-28 07:22:03 +03:00
alesapin
ab8dd1d4e3
Merge pull request #5769 from yandex/add_rpm_build_to_packager
Add ability to build rpm and tgz packages via packager
2019-06-27 23:14:19 +03:00
alesapin
265c18b45f Fix tgz-release in push packages 2019-06-27 19:00:26 +03:00
proller
1bb911f742 release --rpm: Fix redefining version 2019-06-27 18:37:13 +03:00
proller
0bd65f49a2 Better release --rpm 2019-06-27 17:12:53 +03:00
proller
3149b57100
release script: convert .deb to .rpm and .tgz (#5740) 2019-06-25 16:55:31 +03:00
alexey-milovidov
f9cab91447
Merge pull request #5617 from proller/fix15
19.8 build fixes
2019-06-14 17:29:51 +03:00
proller
09f3d68f6e Use logging in clickhouse-local. Use config options in command line in clickhouse-client (#5540)
* Try fix macos server run

* Doc macos build
 # Please enter the commit message for your changes. Lines starting

* CLICKHOUSE-3957 start wip

* tests wip

* wip

* wip

* wip

* wip

* wip

* wip

* wip

* fix

* fix

* Making logger for clickhouse-local

* fixes

* wip

* wip

* wip

* wip

* clean

*      cf

* wip

* fix

* Update CMakeLists.txt

* Update argsToConfig.h

* Update argsToConfig.cpp

* Update ExtendedLogChannel.h

* Update OwnPatternFormatter.cpp
2019-06-14 17:00:37 +03:00
proller
fc7ae399c4 Use system rapidjson; Fix types for macos; 2019-06-14 13:28:30 +03:00
Alexey Milovidov
f38042f006 Check for namespace comments in "check-style" tool #5561 2019-06-13 13:45:32 +03:00
alesapin
d4f474cd19 Add prestable releases to packages pusher 2019-05-31 14:42:36 +03:00
Alexey Milovidov
f406eb17ae Added a tool to calculate checksums caused by bit flips 2019-05-19 01:48:28 +03:00
proller
51ca4cbaa4
Build fixes (#5278) 2019-05-15 20:19:39 +03:00
Ivan
4a5832b18a
Check the time limit every (flush_interval / poll_timeout) number of rows from Kafka (#5249) 2019-05-14 18:52:03 +03:00
proller
cc3de4115f
Build fixes (#5261) 2019-05-14 12:58:33 +03:00
Ivan
1eb835be35
Reduce maximum page size (#5140) 2019-04-29 17:22:04 +03:00
proller
fd63093032 Add gperf to build requirements (for upcoming pull request #5030 ) 2019-04-25 17:31:08 +03:00
alesapin
8d808aedf3 Fix bug in s3uploader 2019-04-23 14:50:43 +03:00
Alexey Milovidov
720f911379 Removed obsolete files 2019-04-22 22:28:10 +03:00
alexey-milovidov
0cf40e0029
Merge pull request #5082 from yandex/pvs-studio-fixes-3
Resolved some of PVS-Studio warnings
2019-04-22 22:06:07 +03:00
alexey-milovidov
b1cf026b5b
Merge pull request #5080 from abyss7/issue-4736
Do not drop Kafka Consumer buffers after deletion of stream
2019-04-22 19:18:33 +03:00
Alexey Milovidov
58d7d1e451 Resolved some of PVS-Studio warnings 2019-04-22 19:07:09 +03:00
Ivan Lezhankin
7723a63d0a Add helper utils to interact with Kafka broker 2019-04-18 17:36:51 +03:00
proller
525726a5e2
Remove pocoext (#5036) 2019-04-17 20:36:58 +03:00
alesapin
ed47aa109d
Merge pull request #4998 from abyss7/release-helpers
Detect backports by PRs to stable branches with `pr-backport` label
2019-04-16 20:05:18 +03:00
alesapin
faeb95cfd7
Merge branch 'master' into adaptive_index_granularity 2019-04-15 19:36:36 +03:00
Ivan Lezhankin
31a566c4f2 Detect backports by PRs to stable branches with pr-backport label
Also add some fancy colors.
2019-04-12 19:08:38 +03:00
alesapin
3accb16cc6
Merge pull request #4949 from abyss7/release-helpers
Add python util to help with releases
2019-04-11 19:28:58 +03:00
Ivan Lezhankin
722e022e54 Allow to filter PRs by login 2019-04-11 19:16:57 +03:00
Ivan Lezhankin
af7ab86ab6 Refactor queries 2019-04-11 18:08:25 +03:00
alesapin
9544784b71 Retry 500-error codes in changelog script 2019-04-11 13:54:19 +03:00
Ivan Lezhankin
1311244203 Detect backports via manually set labels. 2019-04-09 14:57:46 +03:00
Ivan Lezhankin
78d5de9dd3 Respect label color to check for backporting 2019-04-09 12:55:10 +03:00
Ivan Lezhankin
40be310fa0 Prettify output 2019-04-09 12:25:18 +03:00
Ivan Lezhankin
692c5a6ed2 Better filter associated pull-requests 2019-04-08 22:28:08 +03:00
Ivan Lezhankin
5a909b01b0 Print more problems 2019-04-08 19:11:13 +03:00
Ivan Lezhankin
be23dff3b0 Initial implementation.
Prints "good" and "bad" commits.
2019-04-08 18:33:05 +03:00
alesapin
a53b002973 Merge remote-tracking branch 'origin' into adaptive_index_granularity 2019-04-08 14:29:33 +03:00
Danila Kutenin
37d70ac558 MarkCache and UncompressedCache use different allocator to catch segfaults more reliable 2019-04-06 18:27:39 +03:00
alesapin
1291ecbed7 Better logging in adjust block util 2019-04-04 22:44:04 +03:00
alesapin
43ed0a8e7f Style fix 2019-04-04 16:03:20 +03:00
alesapin
ee49252160 Add util for adjust block numbers in zookeper 2019-04-04 16:01:48 +03:00
alesapin
7b67200258 Merge remote-tracking branch 'origin' into adaptive_index_granularity 2019-04-01 11:54:19 +03:00
proller
1584fd4367
Fix hyperscan library find and use (#4798) 2019-03-26 00:31:00 +03:00
alesapin
b5d6813604 Fix vertical merge again 2019-03-20 20:04:34 +03:00
alesapin
2b2a637a38 Simpliest write/merge/select test works 2019-03-18 18:54:58 +03:00
Alexey Milovidov
825f0aab48 Fixed typo 2019-03-15 21:31:36 +03:00
proller
8c70de3bc7
Build fixes (freebsd) (#4696) 2019-03-14 23:52:10 +03:00
proller
cf8001b6a9
Fix includes (#4673) 2019-03-13 16:58:04 +03:00
proller
d2e18d47fb
Fix link in split mode (#4574) 2019-03-04 20:47:31 +03:00
alesapin
11a3a4bf68 Add first version of script for packages push 2019-03-04 15:56:46 +03:00
Amos Bird
26ab5dd7a7 A Proper lookup table that uses HashTable's API
This is the first step of allowing heterogeneous cells in hash tables.

performance test results are

```

1. HashMap<UInt16, UInt8, TrivialHash, HashTableFixedGrower<16>>;
2. NewLookupMap<UInt16, UInt8>

ResolutionWidth 30000 1 .................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................223550276.46
ResolutionWidth 30000 2 .................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................248772721.24
Best: 2 - 24877272124

ResolutionWidth 100000 1 ..........................................................................................................................................................................................................................................................238498413.99
ResolutionWidth 100000 2 ..........................................................................................................................................................................................................................................................261808889.98
Best: 2 - 26180888998

ResolutionWidth 300000 1 ...................................................................................239307348.81
ResolutionWidth 300000 2 ...................................................................................257592761.30
Best: 2 - 25759276130

ResolutionWidth 1000000 1 .........................240144759.26
ResolutionWidth 1000000 2 .........................257093531.91
Best: 2 - 25709353191

ResolutionWidth 5000000 1 .....241573260.35
ResolutionWidth 5000000 2 .....259314162.79
Best: 2 - 25931416279

ResolutionDepth 30000 1 .................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................217108119.84
ResolutionDepth 30000 2 .................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................249459504.41
Best: 2 - 24945950441

ResolutionDepth 100000 1 ..........................................................................................................................................................................................................................................................229065162.17
ResolutionDepth 100000 2 ..........................................................................................................................................................................................................................................................253769105.64
Best: 2 - 25376910564

ResolutionDepth 300000 1 ...................................................................................233079225.18
ResolutionDepth 300000 2 ...................................................................................256316273.78
Best: 2 - 25631627378

ResolutionDepth 1000000 1 .........................234184633.51
ResolutionDepth 1000000 2 .........................261100491.57
Best: 2 - 26110049157

ResolutionDepth 5000000 1 .....233118795.66
ResolutionDepth 5000000 2 .....252436160.41
Best: 2 - 25243616041

```
2019-03-01 16:47:13 +08:00
Vitaly Baranov
2e8669211a Improve test: check input/output with protobuf schema containing nested messages. 2019-02-27 14:37:17 +03:00
Vitaly Baranov
78c808da10 Add a test for checking reading data from protobuf messages. 2019-02-20 07:28:18 +03:00
proller
e20c77e4c6 Add parquet support. Fixes, tests, ... 2019-02-19 23:51:44 +03:00
proller
f5560660be Fix brotli (unbundled, missing, ...) 2019-02-13 18:35:11 +03:00
Alexey Milovidov
57e038c754 Added a script to check for ungrouped includes 2019-02-10 20:40:18 +03:00
Alexey Milovidov
fdf69f38c0 Added a script to check for duplicate includes 2019-02-10 20:00:29 +03:00
proller
e4f3713102 Fix link in split mode 2019-02-06 17:14:16 +03:00
alesapin
1c2087d3b8 Read revision from files only if it was not specified explicitly 2019-02-05 14:07:28 +03:00
alesapin
9d61d09c8c Add ability to set version in release_lib.sh via env variables 2019-02-04 18:14:44 +03:00
alexey-milovidov
012bd5267b
Merge pull request #4195 from yandex/convert-parts-from-old-format
А tool to convert an old month-partition part to the custom-partitioned format
2019-01-31 22:45:44 +03:00
Alexey Zatelepin
8957e73681 a tool to convert an old month-partition part to the custom-partitioned format [#CLICKHOUSE-4231] 2019-01-30 16:51:39 +03:00
alesapin
0531722fc9 Better logging in script 2019-01-29 19:29:03 +03:00
alesapin
b7583337a8 Add s3uploader script in tools 2019-01-29 15:12:28 +03:00
alexey-milovidov
a175c9734a
Merge pull request #4173 from yandex/make-chengelog-script
make_changelog.py review fixes.
2019-01-28 23:37:51 +03:00
Nikolai Kochetov
8263b66510 make_changelog.py review fixes. 2019-01-28 21:06:13 +03:00
alexey-milovidov
25e0f56e39
Merge pull request #4169 from yandex/make-chengelog-script
Added script for changelog.
2019-01-28 19:48:39 +03:00
Nikolai Kochetov
b82c34f0c2 Added script for changelog. 2019-01-28 18:33:34 +03:00
Alexey Milovidov
4e3d9a0f15 Merge branch 'master' of github.com:yandex/ClickHouse into global-thread-pool 2019-01-28 14:20:24 +03:00
proller
5328251ff1
Fix build without protobuf, gtest, cppkafka (#4152) 2019-01-25 23:02:03 +03:00
Vitaly Baranov
ed1136e49e Use more IO/WriteHelpers.h functions in the class ProtobufSimpleWriter,
rename variant=>varint.
2019-01-25 17:15:44 +03:00
Alexey Milovidov
65f8e4d4a8 Merge branch 'master' into global-thread-pool 2019-01-25 16:33:50 +03:00
Vitaly Baranov
2e383bfdeb Added tests for writing protobufs. 2019-01-24 17:54:57 +03:00
proller
0939387514
Build fixes (#4076)
Move copy_headers.sh and formath.sh from root.
Debian: use default build dir (obj-x86_64-linux-gnu)
Debian: add test after build (GLIBC_required_version)
cmake: dont run copy headers if already copied
2019-01-18 18:19:53 +03:00