thevar1able/ClickHouse
1
0
Fork 0
mirror of https://github.com/ClickHouse/ClickHouse.git synced 2024-10-10 18:40:52 +00:00
Code Issues Packages Projects Releases Wiki Activity
34,577 Commits 8,991 Branches 1,770 Tags 2.1 GiB
b84d5c2139
Commit Graph

696 Commits

Author SHA1 Message Date
Nikolai Kochetov
833499cfb6 Merged with master. 2020-01-03 15:34:17 +03:00
Nikolai Kochetov
92baec6488 Fix MergingSorted 2020-01-02 23:07:07 +03:00
Alexey Milovidov
218ab1b25b Merge branch 'master' into better-priority-queue 2020-01-02 13:40:33 +03:00
Nikolai Kochetov
85e1c88d12 Disable affinity. 2020-01-02 09:27:53 +03:00
Nikolai Kochetov
cc67ab1107 Enable affinity only for multiple threads. 2020-01-01 21:42:15 +03:00
Nikolai Kochetov
faf118fb15 Do not create extra thread in PipelineExecutor if num_threads is 1. 2020-01-01 14:18:24 +03:00
Nikolai Kochetov
65a00150b2 Update num threads in processors. 2020-01-01 13:42:46 +03:00
Nikolai Kochetov
04193460aa Try disable affinity. 2019-12-31 12:10:44 +03:00
Nikolai Kochetov
42f86fe4f5 Better exceptions handling in PipelineExecutor. 2019-12-30 23:09:37 +03:00
Nikolai Kochetov
96a732ac02 Better exceptions handling in PipelineExecutor. 2019-12-30 22:45:27 +03:00
Nikolai Kochetov
1138162dc8 Better exceptions handling in PipelineExecutor. 2019-12-30 21:29:24 +03:00
Nikolai Kochetov
1284d2eb4e Try enable affinity 2019-12-30 15:26:14 +03:00
Nikolai Kochetov
84072fe977 Try disable affinity. 2019-12-29 23:09:11 +03:00
Nikolai Kochetov
d3060f42e0 Remove commented code. 2019-12-29 10:30:26 +03:00
Nikolai Kochetov
755cd1bea2 Disable logging in processors pipeline. 2019-12-28 21:42:07 +03:00
Nikolai Kochetov
05fe9ef179 Add sort improvement to processors. 2019-12-27 21:59:50 +03:00
Nikolai Kochetov
2398dc954c Fix SortingAggregatedTransform. 2019-12-27 15:46:39 +03:00
Nikolai Kochetov
330676737a Disable quota . 2019-12-27 13:59:43 +03:00
Nikolai Kochetov
0034afdf10 Better task queue for PipelineExecutor. 2019-12-26 21:23:31 +03:00
Nikolai Kochetov
5a5d15c095 Enable quota for more processors. 2019-12-26 19:52:15 +03:00
Nikolai Kochetov
bb19e22bd7 Add threads quota for processors. 2019-12-26 19:34:08 +03:00
Nikolai Kochetov
9d9ab833b7 Add threads quota for processors. 2019-12-26 19:15:31 +03:00
Maxim Ulanovskiy
32995e3ad5 cosmetic doc fixes 2019-12-26 18:59:38 +03:00
Nikolai Kochetov
fbbab2486f Update pipelineExecutor 2019-12-26 17:47:48 +03:00
alexey-milovidov
af3c52d5fc
Merge pull request #8334 from maxulan/parquet_list_reading_fix 
Parquet list reading fix
 2019-12-26 17:33:30 +03:00
Nikolai Kochetov
3b2d6a66d1 Update pipelineExecutor 2019-12-26 17:23:34 +03:00
Nikolai Kochetov
a5a8372713 Update pipelineExecutor 2019-12-26 15:58:09 +03:00
Nikolai Kochetov
3ccd33eeb8
Merge pull request #8362 from ClickHouse/processors-4.5 
Affinity for processors pipeline. Fix integration tests.
 2019-12-26 12:14:32 +03:00
Nikolai Kochetov
438ea5bc22
Remove context from formats (#8388) 
* Remove Context from formats.
 2019-12-25 22:17:41 +03:00
Nikolai Kochetov
5b2847fb90 Fix mysql_protocol integration tests. 2019-12-25 21:46:37 +03:00
Maxim Ulanovskiy
b98e85851a cosmetics 2019-12-25 07:47:53 +03:00
Maxim Ulanovskiy
d3b827272f fixed excessive var copy 2019-12-25 04:37:40 +03:00
Maxim Ulanovskiy
b43ea04548 Merge branch 'master' into parquet_list_reading_fix 2019-12-25 04:09:39 +03:00
Nikolai Kochetov
2148f09220 Disable affinity for apple and FreeBSD. 2019-12-24 20:00:43 +03:00
Nikolai Kochetov
e53b68d00f Fix apple build. 2019-12-24 16:55:28 +03:00
Nikolai Kochetov
6fbc202bb3 Try fix tests with processors. 2019-12-24 16:30:28 +03:00
Nikolai Kochetov
a82079ccc2 Set affinity for PipelineExecutor threads. 2019-12-23 19:55:11 +03:00
Maxim Ulanovskiy
e9021f6377 flatbuffers lib downloading replaced with contrib/flatbuffers 2019-12-23 09:51:35 +03:00
Alexey Milovidov
8613b90d84 Using SortingHeap in MergingSortedTransform 2019-12-22 17:22:42 +03:00
Alexey Milovidov
53606c6e8f Using optimization of single column sort in Processors 2019-12-22 12:55:43 +03:00
maxim
558324e773 fixed reading of parquet files containing columns of type list 2019-12-22 10:15:51 +03:00
Alexey Milovidov
9f3afed5ff Optimization of priority queue 2019-12-22 03:19:07 +03:00
Alexey Milovidov
eb9d6983c8 Added optimization for Processors; added reserve. 2019-12-22 01:16:39 +03:00
kreuzerkrieg
9612bb0e79 More GCC warnings 2019-12-16 23:19:50 +02:00
Nikolai Kochetov
a73eb4292b Functions refactor part 1. 2019-12-09 00:06:37 +03:00
Vitaly Baranov
0e21673271 Rework Quota based on IAccessEntity. 2019-12-05 21:03:57 +03:00
Nikolai Kochetov
86ff01d3aa
Merge pull request #7988 from ClickHouse/processors-4.4 
Better updated ports check in processors
 2019-12-05 13:54:40 +03:00
Mikhail Korotov
88e37020e0 JSONCompactEachRow and JSONCompactEachRowWithNamesAndTypes (#7841) 
* Research commit

* Created Output EachRow Format

* Fixed bugs

* Created output format JSONCompactEachRowWithNamesAndTypes without totals

* Fixed bugs

* Fixed bugs

* Totals for JSONCompactEachRowWithNamesAndTypes

* Deleted needless debug

* Working commit

* Working commit

* Working commit

* Working commit

* Working commit

* Working commit

* Working commit

* Working commit

* Working commit

* Working commit

* Working commit

* Working commit

* Tests added

* Input Format for JSONCompactEachRow

* Fixed bugs for JSONCompactEachRow Input format

* Fixed bugs for JSONCompactEachRowRowInputFormat.cpp

* JSONCompactEachRow and JSONCompactEachRowWithNamesAndTypes united

* Created input format for both formats

* fixed bugs

* fixed bugs

* Working commit

* Working commit

* Working commit

* Working commit

* tests

* Working commit

* Final tests

* Performance tests added
 2019-12-05 13:13:40 +03:00
Nikolai Kochetov
3ac103f21c Fix the number of rows in MergingSortedTransform. 2019-12-04 16:45:42 +03:00
Nikolai Kochetov
901a6b4627 Style fix. 2019-12-04 12:56:08 +03:00
Nikolai Kochetov
efe1616fda Fix optimization for 'WHERE column in (empty set)' case. 2019-12-04 12:55:01 +03:00
Nikolai Kochetov
81b5b17828 Fix pvs studio varning. 2019-12-04 12:55:01 +03:00
Nikolai Kochetov
fa98587c19 Init update_info in port. 2019-12-04 12:55:01 +03:00
Nikolai Kochetov
8524a75580 Check once if filter column can be always false in filter transform. 2019-12-04 12:55:01 +03:00
Nikolai Kochetov
9465183408 Add info about affected ports after prepare. 2019-12-04 12:55:01 +03:00
Nikolai Kochetov
4f2f474fde Add info about affected ports to IProcessor::prepare 2019-12-04 12:55:01 +03:00
Nikolai Kochetov
31d5c66867 Fix num rows in IRowInputFormat 2019-12-03 16:43:40 +03:00
Nikolai Kochetov
448d755a3b Add forgotten rows number check to chunk constructor. 2019-12-03 14:56:51 +03:00
alexey-milovidov
87adf355e8
Merge pull request #7935 from filimonov/kafka_perf 
[wip] attempt to improve kafka parsing performance
 2019-12-03 03:52:40 +03:00
alexey-milovidov
6fdfdcfd4e
Update ValuesBlockInputFormat.cpp 2019-12-03 03:51:10 +03:00
alexey-milovidov
4d65ad4034
Update ValuesBlockInputFormat.cpp 2019-12-03 03:50:50 +03:00
alexey-milovidov
4a69082fbb
Update ProtobufRowInputFormat.h 2019-12-03 03:49:50 +03:00
alexey-milovidov
a7521b97f9
Update IInputFormat.cpp 2019-12-03 03:49:05 +03:00
Yuriy
211e1364f6 fixed style 2019-12-02 06:12:27 +03:00
Yuriy
3677d1dcfa implemented ProtocolText 2019-12-01 15:17:49 +03:00
Mikhail Filimonov
07722dfa93 more progress - cleanup internal cycles 2019-11-29 00:06:03 +01:00
Mikhail Filimonov
6217cb51f6 Get rid of InputStream layer for Kafka, use InputStream directly. Reopening port during reset. 2019-11-28 17:43:06 +01:00
Mikhail Filimonov
deec48a3e0 attempt to fix kafka parsing performance regression https://github.com/ClickHouse/ClickHouse/issues/7261 2019-11-27 00:46:19 +01:00
alexey-milovidov
0633f9f8db
Update CSVRowInputFormat.cpp 2019-11-23 03:24:25 +03:00
Nikita Mikhaylov
22a8e8efa7 better segmenating + move read functions to avoid linker errors 2019-11-22 16:53:26 +03:00
Nikita Mikhaylov
d495e282c7 returning back JSON and CSV 2019-11-22 13:38:08 +03:00
Nikita Mikhaylov
6f80b0fed4 move specific functions to ReadHelpers 2019-11-22 13:12:24 +03:00
tavplubix
b75b6c294d
Merge pull request #7762 from ClickHouse/possible_segfaults_in_table_functions 
Fix Storage lifetime in table functions
 2019-11-22 02:29:06 +03:00
Nikita Mikhaylov
1d74aecda8 fix typo in asserts 2019-11-21 21:14:47 +03:00
Alexander Tokmakov
ba3969527f move table locks to main pipeline 2019-11-21 18:37:59 +03:00
Nikita Mikhaylov
31cb69269b small fix 2019-11-21 16:44:11 +03:00
Alexander Kuzmenkov
c913155d95 Fix TSV segmentation. 2019-11-20 20:24:44 +03:00
Alexander Kuzmenkov
9a2b864940 Cleanup 2019-11-19 21:42:51 +03:00
Alexander Kuzmenkov
7e5731d64e Merge remote-tracking branch 'origin/master' into HEAD 2019-11-19 16:15:47 +03:00
Alexander Kuzmenkov
168e15b2ae chunk size -> chunk bytes 2019-11-18 22:45:26 +03:00
Alexander Kuzmenkov
4ab7ac14bd Remove all segmentation engines except TSV 2019-11-18 16:12:28 +03:00
Alexander Kuzmenkov
83030b98a2 remove MemoryExt<> 2019-11-18 16:10:14 +03:00
Vitaly Baranov
ff6cba192b Replace pointer with reference in SettingsCollection<T>::MemberInfos::findStrict(). 
Rename SettingsCommon.h -> SettingsCollection.h for consistency.
 2019-11-17 03:51:51 +03:00
Alexander Tokmakov
55f60a6bad hold shared pointers to table function Storage and Context from InterpreterSelectQuery 2019-11-15 21:42:32 +03:00
Alexander Kuzmenkov
5d5882d92b wip: a saner segmentation function for TSV 2019-11-15 21:08:17 +03:00
Alexander Kuzmenkov
7f34c0089c Merge remote-tracking branch 'origin/master' into HEAD 2019-11-14 18:53:36 +03:00
Nikolai Kochetov
296a56407f Add thread name for pipeline threads. 2019-11-09 22:46:46 +03:00
Nikolai Kochetov
dd7ed390f6 Merge branch 'master' into processors-4-tmp 2019-11-08 18:53:03 +03:00
Nikolai Kochetov
7db03cfaf7 Fix performance in FilterTransform. 2019-11-08 14:27:52 +03:00
alexey-milovidov
a2e79cc427
Merge pull request #7574 from ClickHouse/processors-4 
Fix tests for processors
 2019-11-08 00:46:30 +03:00
Nikolai Kochetov
a34023192d Fix limits for pipe. 2019-11-06 14:36:33 +03:00
Alexander Kuzmenkov
233212ac68
Merge pull request #7531 from amosbird/getkeymapped 
Unify hash tables interface (separated for review)
 2019-11-06 13:49:39 +03:00
Nikolai Kochetov
055f21c9b7 Less wrappers for procesors pipeline. 2019-11-05 20:33:03 +03:00
Amos Bird
fbfbe161ec
Unify hash tables interface. 2019-11-06 00:08:04 +08:00
Nikita Mikhaylov
0d3a05ce3b remove logging + fix for PrettySpace + overrided readSuffix and readPrefix 2019-11-05 15:58:32 +03:00
Nikolai Kochetov
a0e9f9fdcf Skip empty totals in SourceFromInputStream. 2019-11-05 15:50:47 +03:00
Nikita Mikhaylov
817b52314e Merge branch 'master' of github.com:ClickHouse/ClickHouse into parallel_parsing 2019-11-05 12:32:26 +03:00
alexey-milovidov
ada6ee4137
Merge pull request #7591 from ClickHouse/one-more-attempt-djvu-bugfix 
One more attempt of bugfix of infinite loop in pretty space format
 2019-11-02 23:40:53 +03:00
proller
6a573b4092 Allow to use mysql format without ssl - try2 with mysql interface split (#7524) 
* Allow use mysql format without ssl

* fix

* fix

*  fix

* Also disable poco's optional libraries

* clean

* fix

* fix

* Requested changes

* clean

* Requested fixes

* Update MySQLHandler.cpp
 2019-11-02 13:20:46 +03:00
stavrolia
e58aa4e579 One more attempt of bugfix of infinite loop in pretty space format 2019-11-02 11:53:35 +03:00
stavrolia
d503c38cac Revert "Merge pull request #7587 from ClickHouse/fix-nonsignificant-djvu-bug" 
This reverts commit 102a76ab47, reversing
changes made to dea9220e3c.
 2019-11-02 03:23:27 +03:00
stavrolia
89d8e6de93 Fix 2019-11-02 02:39:43 +03:00
Nikita Mikhaylov
3c57b8e9c2 test 2019-11-01 21:59:54 +03:00
Nikolai Kochetov
1f7a798c97 Add flag to set that set is created. 2019-11-01 13:58:29 +03:00
Nikita Mikhaylov
9d8bbeb473 bad fix for PrettyCompact 2019-10-31 17:31:19 +03:00
Nikita Mikhaylov
b691cc744c comments and checks 2019-10-30 18:49:10 +03:00
Nikita Mikhaylov
682b9df17f remove SharedReadBuffer + remove lambdas 2019-10-25 15:28:24 +03:00
Nikolai Kochetov
9abab40512 Added more comments. 2019-10-23 06:45:43 +03:00
Nikita Mikhaylov
34d8ade4a0 Merge branch 'master' of github.com:ClickHouse/ClickHouse into parallel_parsing 2019-10-22 15:56:51 +03:00
Nikolai Kochetov
dad1e397e2 Fix build. 2019-10-22 02:51:36 +03:00
Nikolai Kochetov
e7ba48ee84 Fix build. 2019-10-22 02:49:44 +03:00
Nikolai Kochetov
2b334a4adb Review fixes. 2019-10-21 19:26:29 +03:00
Nikolai Kochetov
2893c35930 Merged with master. 2019-10-21 18:33:44 +03:00
Nikolai Kochetov
f7d2e1b758 Added Pipe class. Updated MergeTreeDataSelectExecutor. 2019-10-21 18:16:08 +03:00
Alexander Kuzmenkov
5e2cc37381
Distinguish Array and Tuple field types when creating from array of Fields. (#7179) 2019-10-18 18:57:05 +03:00
tavplubix
0046b9f137 Wait for jobs to finish on exception (fixes rare segfaults) (#7350) 2019-10-17 17:41:27 +03:00
Alexander Tokmakov
e9e8d055af null_as_default for Values 2019-10-16 22:55:24 +03:00
Alexander Tokmakov
102cbfd25a fix old bug with default values 2019-10-16 22:27:33 +03:00
Alexander Tokmakov
5f6703130e fixes 2019-10-16 18:28:48 +03:00
Alexander Tokmakov
aa9d29d6ae Merge branch 'master' into formats_improvements 2019-10-16 17:15:13 +03:00
Nikolai Kochetov
5364f76625 Fix build. 2019-10-14 16:50:16 +03:00
Alexander Kuzmenkov
160d8a6416 Ignore non-convertible values at any depth on the right side of IN 
operator.

The values that are not convertible to the left argument type can't
match anyway, so it is safe to discard them.
 2019-10-14 14:25:03 +03:00
Nikolai Kochetov
7c2575542b Fix build. 2019-10-12 21:52:20 +03:00
Nikolai Kochetov
757488369f Merge branch 'master' into processors-3 2019-10-12 19:24:02 +03:00
Nikolai Kochetov
51bce40d5e
Merge pull request #7284 from ClickHouse/fix-7216 
Fix for #7216
 2019-10-12 19:20:33 +03:00
Alexander Kuzmenkov
31bd359100
Merge pull request #7231 from ClickHouse/aku/podarray-includes 
Include PODArray.h into fewer files.
 2019-10-12 15:08:41 +03:00
Nikolai Kochetov
4967bcdbd0 Fix test. 2019-10-11 21:02:34 +03:00
Nikolai Kochetov
2684bd0d5e Fixes for 7216 2019-10-11 20:27:54 +03:00
Alexander Kuzmenkov
8a1d57bddb Include PODArray.h into fewer files. 2019-10-11 14:28:16 +03:00
Vitaly Baranov
18ccb4d64d Move backQuote() and quoteString() to a separate file, use StringRefs. 2019-10-11 00:18:52 +03:00
Nikolai Kochetov
ef14df4632 Added more comments. 2019-10-10 17:16:15 +03:00
Nikolai Kochetov
9c5ae5f536 Merge branch 'master' into processors-and-storages 2019-10-09 14:12:47 +03:00
Nikolai Kochetov
eb2677c94e Try fix progressbar. 2019-10-09 12:44:24 +03:00
Nikolai Kochetov
ea27918de8 Try fix progressbar. 2019-10-09 12:40:30 +03:00
Nikolai Kochetov
c7bb83262e Fix progress callback for processors pipeline. 2019-10-09 12:33:16 +03:00
Alexander Kuzmenkov
2b30f2696c Include Field.h in less files. 2019-10-08 16:23:24 +03:00
Alexander Tokmakov
73aa1d1518 diagnostic info for bad csv delimiters 2019-10-07 19:47:25 +03:00
Alexander Tokmakov
a2c83ac82e add tests 2019-10-07 19:31:30 +03:00
Alexander Tokmakov
32b0b8272c setup csv delimiter in Template format 2019-10-07 19:03:01 +03:00
proller
594c535bd4 Build fixes (#7063) 
* Build fixes

*            fix

* Fix

* fix

* Fix install(export..

* Freebsd fixes

* Freebsd fixes

* Fix warning

* fix

* More PRIVATE linking

* Fix review

* Timmy

* fix

* fix
 2019-10-05 22:25:31 +03:00
Alexander Tokmakov
a90d126b93 support defaults_for_omitted_fields in TSV 2019-10-04 22:44:48 +03:00
Alexander Tokmakov
d936cee836 support null_as_default in most text formats 2019-10-04 22:42:35 +03:00
Nikolai Kochetov
95ec0f7c2d Merged with master. 2019-10-04 20:53:21 +03:00
Nikolai Kochetov
d4f11af817 Update QueryPipeline. 2019-10-04 20:49:14 +03:00
Nikolai Kochetov
23069ca6d0 Progress for MergeTreeSelectProcessor. 2019-10-04 20:50:07 +03:00
Nikolai Kochetov
627d48c19a Added ExecutionSpeedLimits. 2019-10-04 20:49:57 +03:00
Nikolai Kochetov
e48f7faebc Fix MergeTreeRangeReader. 
Fix MergeTreeReader.

Fix MergeTreeBaseSelectProcessor.

Better exception message for TreeExecutor.

Added header_without_virtual_columns to MergeTreeBaseSelectProcessor.

Fix MergeTreeReverseSelectProcessor.

Fix MergeTreeDataSelectExecutor.
 2019-10-04 20:49:29 +03:00
Nikolai Kochetov
54d32da5a1 Update TreeExecutor. 2019-10-04 20:49:24 +03:00
Nikolai Kochetov
1689576770 Update MergeTreeDataSelectExecutor. 2019-10-04 20:49:14 +03:00
Alexander Tokmakov
ec79e5aa5b refactor null_as_default 2019-10-04 20:19:49 +03:00