Commit Graph

31 Commits

Author SHA1 Message Date
alexey-milovidov
6db73152d2
Hardening debug build (experimental) (#4632)
* Hardening debug build: more granular memory mappings and ASLR; add memory protection for mark cache and index

* Addition to prev. revision

* Addition to prev. revision

* Addition to prev. revision
2019-03-10 06:16:51 +03:00
Alexey Milovidov
56690070fa Merge branch 'master' of github.com:yandex/ClickHouse into debug-pod-array 2019-03-08 15:59:39 +03:00
Alexey Milovidov
4905cd2b0a Added missing include 2019-03-08 15:59:06 +03:00
Alexey Milovidov
73c571412c Fixed awful error after #3920 2019-03-08 06:32:43 +03:00
Alexey Milovidov
9d89cc0fc1 Debugging PODArray 2019-03-08 06:23:02 +03:00
Alexey Milovidov
da449ff9d1 Little better #3920 2019-01-08 17:56:50 +03:00
Alexey Milovidov
e33e5150b7 Miscellaneous [#CLICKHOUSE-2] 2019-01-02 09:44:36 +03:00
Alexey Milovidov
5abb2d02b9 Fixed UB #3926 2018-12-26 08:34:25 +03:00
Alexey Milovidov
b7f085c525 Fixed UB #3926 2018-12-26 05:47:16 +03:00
Alexey Milovidov
8f306e8b45 Small improvements #3920 2018-12-25 22:31:18 +03:00
alexey-milovidov
8120d5495e
Update PODArray.h 2018-12-25 21:52:43 +03:00
alexey-milovidov
d99072ffb0
Update PODArray.h 2018-12-25 21:51:37 +03:00
alexey-milovidov
e1568fd9ad
Update PODArray.h 2018-12-25 21:49:09 +03:00
Amos Bird
8736a3908f left pad 2018-12-24 23:51:06 +08:00
Alexey Milovidov
1c6d8e235c Respect alignment in groupArray and maxIntersections aggregate functions [#CLICKHOUSE-2] 2018-09-02 22:20:27 +03:00
Amos Bird
8851fbcab2 Padding for IO buffers.
Testing data

```
select 'aaaaaaaa','bbbbbbbb','cccccccc','dddddddd','eeeeeeee','ffffffff','gggg','hhh' from numbers(3000000) into outfile '/tmp/test.tsv'
```

Testing command
```
echo "select count() from file('/tmp/test.tsv', CSV, 'a String, b String, c String, d String, e String, f String, g String, h String') where not ignore(e)" | clickhouse-benchmark
```

TSV parser has less overhead than CSV, using it would better unveil the benefits of memcpySmall.

Before
```
QPS: 1.662, RPS: 4985463.906, MiB/s: 603.823, result RPS: 1.662, result MiB/s: 0.000.
0.000%  0.559 sec.
10.000% 0.564 sec.
20.000% 0.568 sec.
30.000% 0.572 sec.
40.000% 0.575 sec.
50.000% 0.581 sec.
60.000% 0.592 sec.
70.000% 0.624 sec.
80.000% 0.639 sec.
90.000% 0.664 sec.
95.000% 0.686 sec.
99.000% 0.711 sec.
99.900% 0.715 sec.
99.990% 0.716 sec.
```

After
```
QPS: 1.861, RPS: 5582303.107, MiB/s: 676.110, result RPS: 1.861, result MiB/s: 0.000.
0.000%  0.510 sec.
10.000% 0.514 sec.
20.000% 0.517 sec.
30.000% 0.521 sec.
40.000% 0.523 sec.
50.000% 0.527 sec.
60.000% 0.530 sec.
70.000% 0.539 sec.
80.000% 0.558 sec.
90.000% 0.584 sec.
95.000% 0.589 sec.
99.000% 0.608 sec.
99.900% 0.655 sec.
99.990% 0.663 sec.
```
2018-08-29 09:39:44 +08:00
Alexey Milovidov
36db216abf Preparation for extra warnings [#CLICKHOUSE-2] 2018-08-10 07:02:56 +03:00
Alexey Milovidov
8cb65277e2 Non significant changes according to clang's -Weverything, part 5 [#CLICKHOUSE-2] 2018-06-04 01:11:50 +03:00
Alexey Milovidov
1c2b024c39 Non significant changes according to clang's -Weverything, part 2 [#CLICKHOUSE-2] 2018-06-03 20:43:56 +03:00
Alexey Milovidov
203363ea73 Merge branch 'master' of github.com:yandex/ClickHouse 2017-12-26 20:53:36 +03:00
Alexey Milovidov
7a60d773ec Fixed strange code [#CLICKHOUSE-2]. 2017-12-26 20:53:31 +03:00
alexey-milovidov
9bf06a26cc Update PODArray.h 2017-12-26 20:52:22 +03:00
chenxing.xc
e7efee8f41 fix potential memory issue 2017-12-26 20:52:22 +03:00
Alexey Milovidov
7284a64740 Better semantic of sharing columns: development [#CLICKHOUSE-2]. 2017-12-16 00:32:25 +03:00
Alexey Milovidov
ec676baee7 Fixed error after merge [#CLICKHOUSE-2]. 2017-07-25 22:07:07 +03:00
Vitaliy Lyudvichenko
870b1aefcb Get rid of of PODArray copypaste. [#CLICKHOUSE-3084] 2017-07-25 20:04:10 +03:00
Vitaliy Lyudvichenko
c2cc8d6147 Add several groupArray implementations. [#CLICKHOUSE-3084] 2017-07-25 20:04:10 +03:00
Nikolai Kochetov
985e449bd3 added IDataType::updateAvgValueSizeHints; renamed PODArray::allocated_size to PODArray::allocated_bytes; renamed renamed IColumn::allocatedSize to IColumn::allocatedBytes; removed IColumn.h from IDataType.h 2017-07-13 19:49:09 +03:00
Alexey Milovidov
7bf7242ad3 Fixed translation errors; miscellaneous changes [#CLICKHOUSE-3]. 2017-05-10 00:00:19 -04:00
f1yegor
46db454562 translate comments 2017-05-09 13:03:35 -04:00
Alexey Milovidov
310736cd7e Moved headers and sources to same place [#CLICKHOUSE-3]. 2017-04-01 12:22:42 +03:00