Commit Graph

37 Commits

Author SHA1 Message Date
Dmitrii Kovalkov
ea177061e8 Fix PODArray.insert 2019-11-15 17:36:52 +03:00
Alexander Kuzmenkov
8a1d57bddb Include PODArray.h into fewer files. 2019-10-11 14:28:16 +03:00
alexey-milovidov
0ece3708e7
Update PODArray.h 2019-08-08 19:07:58 +03:00
chertus
d67abcf691 better alignment 2019-08-08 15:11:54 +03:00
Alexander Kuzmenkov
a719933c58 Fix initial size of some inline PODArray's.
A template parameter of PODArray named INITIAL_SIZE didn't make its
units clear, which made some callers to erroneously assume that it
specifies the number of elements and not the number of bytes.
Rename it, fix the wrong usages and, where possible, use the
PODArrayWithStackMemory typedef for arrays with inline memory.
2019-06-28 16:03:14 +03:00
proller
b5efce5b8a Freebsd build fix (#4650)
* Update contrib/cppkafka

* Fix

* Freebsd build fix
2019-03-11 16:10:47 +03:00
alexey-milovidov
6db73152d2
Hardening debug build (experimental) (#4632)
* Hardening debug build: more granular memory mappings and ASLR; add memory protection for mark cache and index

* Addition to prev. revision

* Addition to prev. revision

* Addition to prev. revision
2019-03-10 06:16:51 +03:00
Alexey Milovidov
56690070fa Merge branch 'master' of github.com:yandex/ClickHouse into debug-pod-array 2019-03-08 15:59:39 +03:00
Alexey Milovidov
4905cd2b0a Added missing include 2019-03-08 15:59:06 +03:00
Alexey Milovidov
73c571412c Fixed awful error after #3920 2019-03-08 06:32:43 +03:00
Alexey Milovidov
9d89cc0fc1 Debugging PODArray 2019-03-08 06:23:02 +03:00
Alexey Milovidov
da449ff9d1 Little better #3920 2019-01-08 17:56:50 +03:00
Alexey Milovidov
e33e5150b7 Miscellaneous [#CLICKHOUSE-2] 2019-01-02 09:44:36 +03:00
Alexey Milovidov
5abb2d02b9 Fixed UB #3926 2018-12-26 08:34:25 +03:00
Alexey Milovidov
b7f085c525 Fixed UB #3926 2018-12-26 05:47:16 +03:00
Alexey Milovidov
8f306e8b45 Small improvements #3920 2018-12-25 22:31:18 +03:00
alexey-milovidov
8120d5495e
Update PODArray.h 2018-12-25 21:52:43 +03:00
alexey-milovidov
d99072ffb0
Update PODArray.h 2018-12-25 21:51:37 +03:00
alexey-milovidov
e1568fd9ad
Update PODArray.h 2018-12-25 21:49:09 +03:00
Amos Bird
8736a3908f left pad 2018-12-24 23:51:06 +08:00
Alexey Milovidov
1c6d8e235c Respect alignment in groupArray and maxIntersections aggregate functions [#CLICKHOUSE-2] 2018-09-02 22:20:27 +03:00
Amos Bird
8851fbcab2 Padding for IO buffers.
Testing data

```
select 'aaaaaaaa','bbbbbbbb','cccccccc','dddddddd','eeeeeeee','ffffffff','gggg','hhh' from numbers(3000000) into outfile '/tmp/test.tsv'
```

Testing command
```
echo "select count() from file('/tmp/test.tsv', CSV, 'a String, b String, c String, d String, e String, f String, g String, h String') where not ignore(e)" | clickhouse-benchmark
```

TSV parser has less overhead than CSV, using it would better unveil the benefits of memcpySmall.

Before
```
QPS: 1.662, RPS: 4985463.906, MiB/s: 603.823, result RPS: 1.662, result MiB/s: 0.000.
0.000%  0.559 sec.
10.000% 0.564 sec.
20.000% 0.568 sec.
30.000% 0.572 sec.
40.000% 0.575 sec.
50.000% 0.581 sec.
60.000% 0.592 sec.
70.000% 0.624 sec.
80.000% 0.639 sec.
90.000% 0.664 sec.
95.000% 0.686 sec.
99.000% 0.711 sec.
99.900% 0.715 sec.
99.990% 0.716 sec.
```

After
```
QPS: 1.861, RPS: 5582303.107, MiB/s: 676.110, result RPS: 1.861, result MiB/s: 0.000.
0.000%  0.510 sec.
10.000% 0.514 sec.
20.000% 0.517 sec.
30.000% 0.521 sec.
40.000% 0.523 sec.
50.000% 0.527 sec.
60.000% 0.530 sec.
70.000% 0.539 sec.
80.000% 0.558 sec.
90.000% 0.584 sec.
95.000% 0.589 sec.
99.000% 0.608 sec.
99.900% 0.655 sec.
99.990% 0.663 sec.
```
2018-08-29 09:39:44 +08:00
Alexey Milovidov
36db216abf Preparation for extra warnings [#CLICKHOUSE-2] 2018-08-10 07:02:56 +03:00
Alexey Milovidov
8cb65277e2 Non significant changes according to clang's -Weverything, part 5 [#CLICKHOUSE-2] 2018-06-04 01:11:50 +03:00
Alexey Milovidov
1c2b024c39 Non significant changes according to clang's -Weverything, part 2 [#CLICKHOUSE-2] 2018-06-03 20:43:56 +03:00
Alexey Milovidov
203363ea73 Merge branch 'master' of github.com:yandex/ClickHouse 2017-12-26 20:53:36 +03:00
Alexey Milovidov
7a60d773ec Fixed strange code [#CLICKHOUSE-2]. 2017-12-26 20:53:31 +03:00
alexey-milovidov
9bf06a26cc Update PODArray.h 2017-12-26 20:52:22 +03:00
chenxing.xc
e7efee8f41 fix potential memory issue 2017-12-26 20:52:22 +03:00
Alexey Milovidov
7284a64740 Better semantic of sharing columns: development [#CLICKHOUSE-2]. 2017-12-16 00:32:25 +03:00
Alexey Milovidov
ec676baee7 Fixed error after merge [#CLICKHOUSE-2]. 2017-07-25 22:07:07 +03:00
Vitaliy Lyudvichenko
870b1aefcb Get rid of of PODArray copypaste. [#CLICKHOUSE-3084] 2017-07-25 20:04:10 +03:00
Vitaliy Lyudvichenko
c2cc8d6147 Add several groupArray implementations. [#CLICKHOUSE-3084] 2017-07-25 20:04:10 +03:00
Nikolai Kochetov
985e449bd3 added IDataType::updateAvgValueSizeHints; renamed PODArray::allocated_size to PODArray::allocated_bytes; renamed renamed IColumn::allocatedSize to IColumn::allocatedBytes; removed IColumn.h from IDataType.h 2017-07-13 19:49:09 +03:00
Alexey Milovidov
7bf7242ad3 Fixed translation errors; miscellaneous changes [#CLICKHOUSE-3]. 2017-05-10 00:00:19 -04:00
f1yegor
46db454562 translate comments 2017-05-09 13:03:35 -04:00
Alexey Milovidov
310736cd7e Moved headers and sources to same place [#CLICKHOUSE-3]. 2017-04-01 12:22:42 +03:00