thevar1able/ClickHouse
1
0
Fork 0
mirror of https://github.com/ClickHouse/ClickHouse.git synced 2024-10-02 06:30:55 +00:00
Code Issues Packages Projects Releases Wiki Activity
30,919 Commits 8,979 Branches 1,767 Tags 1.8 GiB
544af39d23
Commit Graph

1682 Commits

Author SHA1 Message Date
Alexey Milovidov
8b87511e25 Namespace comments are unneeded according to the code style. 
find dbms -name '*.h' -or -name '*.cpp' | xargs grep -l -P '}\s*//+\s*namespace\s*' | xargs sed -i -r -e 's/}\s*\/\/+\s*namespace\s*\w+/}/'
 2019-06-13 13:37:13 +03:00
Vitaliy Zakaznikov
5983273694 Fixing bugs reported by sanitizers 
* data race condition on storage is_dropped access
* invalid reference to storage after it is deleted
* invalid reference to mutex after storage is deleted
 2019-06-12 09:11:44 -04:00
Vitaliy Zakaznikov
12060d8879 * Fixing errors that prevented clang build. 2019-06-11 08:27:47 -04:00
Vitaliy Zakaznikov
b6efd8599f * Trying again to fix style checks. Now running ./utils/check-style/check-style reports no errors. 2019-06-11 06:30:57 -04:00
Vitaliy Zakaznikov
a467e7c105 * Moving uexpect.py so that it can be found 
* Trying to fix failed style checks
* Trying to fix clang build fail
 2019-06-10 22:22:53 -04:00
Vitaliy Zakaznikov
fc4ea55b98 * Fixing bug in dbms/src/DataStreams/PushingToViewsBlockOutputStream.cpp 
that was introduced when trying to fix a clang error.
 2019-06-10 08:11:43 -04:00
Vitaliy Zakaznikov
a68980ab38 * Style check fixes 2019-06-10 07:41:33 -04:00
Vitaliy Zakaznikov
87b58e4150 * Fixing clang errors 
* Fixing LIVE VIEW tests
 2019-06-10 07:18:33 -04:00
Vitaliy Zakaznikov
b65ff910b6 Merge branch 'master' of https://github.com/vzakaznikov/ClickHouse into liveview 2019-06-07 08:02:59 -04:00
Vitaliy Zakaznikov
2930965938 * Renaming live_view_heartbeat_delay setting to live_view_heartbeat_interval 
and making the setting to be in seconds instead of usec
* Updated LIVE VIEW table to keep version consistent as long as the server is up
* Removed calculation of hash in writeIntoLiveView method as it is recalculated
  in the LiveViewBlockOutputStream
* Changed to using values from the local context for live_view_heartbeat_interval and
  temporary_live_view_timeout instead of the global context
* Updated LIVE VIEW tests to match the changes
 2019-06-06 21:10:56 -04:00
Gleb Novikov
375e464086 Fixed exception text 2019-06-06 00:25:48 +03:00
Vitaliy Zakaznikov
5f3be8134d * Disallowing writes into LIVE VIEW tables 
* Adding support for watching live views via HTTPHandler
* Small fix to WriteBufferValidUTF8.cpp to propagate next() call
* Updated copyData.cpp to treat block with no rows as
  "flush block"
* Updated PushingToViewsBlockOutputStream.cpp to directly use
  LIVE VIEW output stream instead of calling its write method
 2019-06-05 07:30:29 -04:00
Gleb Novikov
f413b1e346 Implemented memoryIsByte, replaced memoryIsZero with it, implemented memory check in CheckConstraintsBlockOutputStream 2019-06-05 11:05:46 +03:00
Gleb Novikov
b63623d014 Extended constraint exception with constraint name and expression 2019-06-05 10:33:34 +03:00
Ivan Lezhankin
b311984879 Merge remote-tracking branch 'upstream/master' into issue-5286 2019-06-03 17:19:09 +03:00
Konstantin Podshumok
f993ea6127 add timeouts to remote streams 2019-06-02 12:43:20 +03:00
Gleb Novikov
2b5cf46842 Merge branch 'master' into table-constraints 2019-06-02 08:33:36 +03:00
palasonicq
ea86a758a1 Added some improvements after code review 2019-05-30 23:12:44 +03:00
Nikita Lapkov
8f36af7760 Merge remote-tracking branch 'upstream/master' into query-poor-mans-profiler 2019-05-30 10:33:33 +00:00
Vitaliy Zakaznikov
673d1a46a0 * Adding support for _version virtual column to LIVE VIEWs when using SELECT 
* Adding support for _version column to LIVE VIEWS when using WATCH query
* Adding initial support for WATCH query on LIVE VIEWs
 2019-05-29 17:52:13 -04:00
Vitaliy Zakaznikov
d112695c42 * Adding other changes to support LIVE VIEWs 2019-05-28 17:17:48 -04:00
palasonicq
0823e397ea Added missed modifications 2019-05-28 21:30:10 +03:00
Ivan Lezhankin
1eccbc39c5 Don't add virtual column to empty block 2019-05-28 00:01:24 +03:00
Anastasiya Rodigina
21e27cb854 Make custom upper_bound - probably will change it 2019-05-27 10:50:37 +00:00
Gleb Novikov
1aaab07459 Fixed exception handling in 00952 test 2019-05-27 02:57:18 +03:00
Vitaliy Zakaznikov
9dd07bcc23 * Work in progress to redo live view implementation to be less invasive 2019-05-26 18:03:30 -04:00
Anastasiya Rodigina
cd5b3e60c5 Try 2 to fix tests 2019-05-26 21:41:12 +00:00
Anastasiya Rodigina
abec62bc5d Try 1 to fix tests - edit tabs 2019-05-26 20:47:48 +00:00
Anastasiya Rodigina
1c3f6ee6f0 Try 1 to fix tests - edit tabs 2019-05-26 20:43:46 +00:00
Anastasiya Rodigina
99f1aa65b3 Try 1 to fix tests 2019-05-26 20:41:51 +00:00
Gleb Novikov
337897c4b8 Merge branch 'master' into table-constraints 2019-05-26 12:36:02 +03:00
Yuriy
96e3574a06 Improvements of MySQL Wire Protocol 2019-05-26 09:52:29 +03:00
alexey-milovidov
461c4919d3
Merge pull request #5116 from PerformanceVision/send_header 
Send a X-ClickHouse summary on the header for HTTP client with number of rows inserted
 2019-05-25 20:20:35 +03:00
Nikita Lapkov
06d370dee2 Merge remote-tracking branch 'upstream/master' into query-poor-mans-profiler 2019-05-25 16:23:08 +00:00
Alexey Milovidov
b94f2be154 Merge branch 'mysql' of https://github.com/yurriy/ClickHouse into yurriy-mysql 2019-05-25 17:14:57 +03:00
Gleb Novikov
c401d282da Merge branch 'master' into table-constraints 2019-05-25 14:26:08 +03:00
Nikita Lapkov
30c31bc85a Merge remote-tracking branch 'upstream/master' into query-poor-mans-profiler 2019-05-24 13:28:42 +00:00
Ivan Lezhankin
646d6f3fb5 Fix order of destruction 2019-05-23 16:54:11 +03:00
Ivan Lezhankin
800854119e Add buffer callback to fill in virtual columns 2019-05-23 14:15:18 +03:00
Nikita Lapkov
382beefdb8 Merge remote-tracking branch 'upstream/master' into query-poor-mans-profiler 2019-05-21 22:52:57 +00:00
Guillaume Tassery
77b7158cd8 Progress rename for total_rows and write_[rows|bytes] 2019-05-20 18:37:41 +07:00
alexey-milovidov
02937294ce
Merge pull request #5311 from azat-archive/SimpleAggregateFunction-Arena-fix 
Fix SimpleAggregateFunction for String longer MAX_SMALL_STRING_SIZE
 2019-05-19 13:12:38 +03:00
Nikita Lapkov
1dd87261ae move SleepFor* to libcommon 2019-05-19 09:14:23 +00:00
Gleb Novikov
9e6625441c Returned context to CheckConstraintsBlockOutputStream constructor 2019-05-19 10:19:44 +03:00
Gleb Novikov
d1492fc05d Removed context from CheckConstraintsBlockOutputStream 2019-05-19 10:17:06 +03:00
Gleb Novikov
2e7b6af137 Merge branch 'master' into table-constraints 2019-05-19 09:03:04 +03:00
Gleb Novikov
300ec160f4 Constraints MVP 2019-05-19 08:27:00 +03:00
Azat Khuzhin
db274bf516
Allocates arena for SimpleAggregateFunction only if IAggregateFunction requires 2019-05-19 03:33:04 +03:00
Azat Khuzhin
4e8370b0b0
Fix SimpleAggregateFunction for String longer MAX_SMALL_STRING_SIZE 
SimpleAggregateFunction do not pass arena to the
add_function -> getAddressOfAddFunction(), hence next crash happens:
  (gdb) bt
  #0  DB::Arena::alloc (size=64, this=0x0) at ../dbms/src/Common/Arena.h:124
  #1  DB::SingleValueDataString::changeImpl (this=0x7f97424a27d8, value=..., arena=0x0) at ../dbms/src/AggregateFunctions/AggregateFunctionMinMaxAny.h:274
  #2  0x0000000005ea5319 in DB::AggregateFunctionNullUnary<true>::add (arena=<optimized out>, row_num=<optimized out>, columns=<optimized out>, place=<optimized out>, this=<optimized out>) at ../dbms/src/AggregateFunctions/AggregateFunctionNull.h:43
  #3  DB::IAggregateFunctionHelper<DB::AggregateFunctionNullUnary<true> >::addFree (that=<optimized out>, place=<optimized out>, columns=<optimized out>, row_num=<optimized out>, arena=<optimized out>) at ../dbms/src/AggregateFunctions/IAggregateFunction.h:131
  #4  0x000000000679772f in DB::AggregatingSortedBlockInputStream::addRow (this=this@entry=0x7f982de19c00, cursor=...) at ../dbms/src/Common/AlignedBuffer.h:31
  #5  0x0000000006797faa in DB::AggregatingSortedBlockInputStream::merge (this=this@entry=0x7f982de19c00, merged_columns=..., queue=...) at ../dbms/src/DataStreams/AggregatingSortedBlockInputStream.cpp:140
  #6  0x0000000006798979 in DB::AggregatingSortedBlockInputStream::readImpl (this=0x7f982de19c00) at ../dbms/src/DataStreams/AggregatingSortedBlockInputStream.cpp:78
  #7  0x000000000622db55 in DB::IBlockInputStream::read (this=0x7f982de19c00) at ../dbms/src/DataStreams/IBlockInputStream.cpp:56
  #8  0x0000000006613bee in DB::MergeTreeDataMergerMutator::mergePartsToTemporaryPart (this=this@entry=0x7f97ec65e1a0, future_part=..., merge_entry=..., time_of_merge=<optimized out>, disk_reservation=<optimized out>, deduplicate=<optimized out>) at /usr/include/c++/8/bits/shared_ptr_base.h:1018
  #9  0x000000000658f7a4 in DB::StorageReplicatedMergeTree::tryExecuteMerge (this=0x7f97ec65b810, entry=...) at /usr/include/c++/8/bits/unique_ptr.h:342
  #10 0x00000000065940ab in DB::StorageReplicatedMergeTree::executeLogEntry (this=0x7f97ec65b810, entry=...) at ../dbms/src/Storages/StorageReplicatedMergeTree.cpp:910
  <snip>

  (gdb) f 1
  (gdb) p MAX_SMALL_STRING_SIZE
  $1 = 48
  (gdb) p capacity
  $2 = 64
  (gdb) p value
  $3 = {data = 0x7f97242fcbd0 "HHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHH", size = 61}

v2: avoid leaking of allocated by Arena memory on the intermediate step

Fixes: 8f8d2c048e ("Merge pull request #4629 from bgranvea/simple_aggregate_function")
 2019-05-19 03:32:55 +03:00
Nikita Lapkov
483f68b728 refactor. introduce SleepFor* functions 2019-05-19 00:25:45 +00:00
anrodigina
d7ee2cb907
Merge branch 'master' into clickhouse-4013 2019-05-18 15:34:23 +03:00
alexey-milovidov
fa4a7eb3d1
Merge branch 'master' into merge-itable-istorage 2019-05-18 00:37:12 +03:00
Ivan Lezhankin
dcff73c8d4 Fix build 2019-05-17 21:45:42 +03:00
Ivan Lezhankin
0821d62516 Merge ITableDeclaration into IStorage. 
Also a couple of massive include-refactorings with better forwarding
 2019-05-17 17:34:25 +03:00
Artem Zuikov
4eee10d788
Merge pull request #5271 from 4ertus2/some 
Cache ExpressionBlockInputStream header
 2019-05-17 13:14:22 +03:00
chertus
927557b0f8 move caching to ctor 2019-05-16 20:16:25 +03:00
Yuriy
0cd3094240 fixed stack buffer overflow 2019-05-16 20:15:43 +03:00
Yuriy
a51c293ec6 merged 'origin/master' into mysql 2019-05-16 14:19:05 +03:00
Yuriy
4ee84810b0 including information about query execution in response 2019-05-16 08:36:08 +03:00
Yuriy
459ec05828 fixed style 2019-05-16 06:45:17 +03:00
Yuriy
ff4937859e added MySQL wire protocol presentational format 2019-05-16 06:34:04 +03:00
chertus
4a5e2dfd3c cache ExpressionBlockInputStream header 2019-05-14 21:26:19 +03:00
Ivan
4a5832b18a
Check the time limit every (flush_interval / poll_timeout) number of rows from Kafka (#5249) 2019-05-14 18:52:03 +03:00
Nikolai Kochetov
808d0f3b08 Merged with master. 2019-05-14 13:31:19 +03:00
Anastasiya Rodigina
af4fff970b Revert "Changes in read in pk_order, UnionBlockInputStream and InterpreterSelectQuery" 
This reverts commit 61d49e1e5f.
 2019-05-10 23:22:45 +03:00
Anastasiya Rodigina
61d49e1e5f Changes in read in pk_order, UnionBlockInputStream and InterpreterSelectQuery 2019-05-10 22:09:15 +03:00
alexey-milovidov
8f8d2c048e
Merge pull request #4629 from bgranvea/simple_aggregate_function 
SimpleAggregateFunction data type
 2019-05-09 18:45:59 +03:00
alexey-milovidov
b611bc0695
Update ReverseBlockInputStream.h 2019-05-05 23:25:49 +03:00
alexey-milovidov
00753506dc
Update ReverseBlockInputStream.cpp 2019-05-05 23:24:05 +03:00
alexey-milovidov
c04c614bc0
Merge branch 'master' into clickhouse-4013 2019-05-05 23:22:45 +03:00
Alexey Milovidov
1be21e3cb6 Removed bad and useless code in ColumnsDescription 2019-05-02 00:43:05 +03:00
CurtizJ
7766f5c0c3 added offset for limit by 2019-04-29 16:12:39 +03:00
Anastasiya Rodigina
87b49f13b7 Edit review issues 2019-04-27 15:43:28 +03:00
Anastasiya Rodigina
e750755f8f Add comments and edit style 2019-04-27 14:59:08 +03:00
dmitriiut
a2c3fd2057 bug fixes 2019-04-23 04:48:51 +03:00
Alexey Milovidov
58d7d1e451 Resolved some of PVS-Studio warnings 2019-04-22 19:07:09 +03:00
dmitriiut
50c322bc6d WITH FILL version 2019-04-22 02:04:23 +03:00
dmitriiut
3c2922c406
Merge branch 'master' into dmitriiut-WITH_TIES_and_WITH_FILL 2019-04-21 19:37:38 +03:00
dmitriiut
e94575e1da fix progress 2019-04-21 19:16:25 +03:00
dmitrii
100cee18c3 comments + fix naming 2019-04-19 18:45:42 +03:00
dmitrii
a130850e15 limit with ties 2019-04-19 16:38:25 +03:00
Anastasiya Rodigina
a11fcffd0e fix style (removed whitespace) 2019-04-18 02:07:36 +03:00
Anastasiya Rodigina
ef0be2a721 Fix build and style issues 2019-04-18 01:58:24 +03:00
Anastasiya Rodigina
0c1735f1b1 ReverseBlockInputStream, optimization of group by, tests 2019-04-18 00:20:51 +03:00
alesapin
faeb95cfd7
Merge branch 'master' into adaptive_index_granularity 2019-04-15 19:36:36 +03:00
Anton Popov
7f93f9ad2f TTL for columns and tables (#4212) 
Add TTL for columns and tables.
 2019-04-15 12:30:45 +03:00
Danila Kutenin
622b2c8472 Enable LFAlloc for MarkCache and UncompressedCache 2019-04-13 15:07:43 +03:00
Nikolai Kochetov
54b15385bd Calculate rows_before_limit_at_least. 2019-04-08 17:55:20 +03:00
bgranvea
42b07c5ee9 refactor to avoid dynamic_cast in data type serialization 2019-04-08 15:39:42 +02:00
bgranvea
faa7d38cb5 fix for style 2019-04-08 15:39:42 +02:00
bgranvea
9d9d16e1ea support for SimpleAggregateFunction data type 2019-04-08 15:39:41 +02:00
alesapin
a53b002973 Merge remote-tracking branch 'origin' into adaptive_index_granularity 2019-04-08 14:29:33 +03:00
Alexey Milovidov
879d746abd Miscellaneous changes 2019-04-07 01:20:09 +03:00
Danila Kutenin
1c030e4ed1 Fix allocations for a while 2019-04-06 23:53:25 +03:00
Danila Kutenin
37d70ac558 MarkCache and UncompressedCache use different allocator to catch segfaults more reliable 2019-04-06 18:27:39 +03:00
Alexey Milovidov
571bc7065a Removed unused code related to MemoryTracker 2019-04-06 01:35:56 +03:00
Ivan Lezhankin
34cf495db8 Fix BlockIO::operator= 2019-04-05 19:21:46 +03:00
Nikolai Kochetov
7626b1b267 Multiple fixes. 2019-04-05 13:52:07 +03:00
Nikolai Kochetov
5e39ec610c Merged with master 2019-04-03 14:21:38 +03:00
Nikolai Kochetov
94ff7f694a QueryPipeline [in progress]. 2019-04-03 13:14:36 +03:00
alesapin
da19254fa9 Remove useless code 2019-04-01 14:29:31 +03:00
alesapin
7b67200258 Merge remote-tracking branch 'origin' into adaptive_index_granularity 2019-04-01 11:54:19 +03:00
Ivan
957d23267b
Minimal implementation of row-level security CLICKHOUSE-4315 (#4792) 
For detailed description see the related PR
 2019-03-29 23:31:06 +03:00
zhang2014
aab314f154 const insert interpreter 2019-03-29 23:47:16 +08:00
Alexey Milovidov
c8bc4d6e26 Fixed error 2019-03-28 19:48:14 +03:00
Alexey Milovidov
fa598d427d Fixed error 2019-03-28 19:28:54 +03:00
alesapin
c139c801f8 Better stop condition 2019-03-28 14:12:59 +03:00
alesapin
1b12d0219c Fix build 2019-03-28 12:31:57 +03:00
alesapin
1b8392a3d0 Style fixed 2019-03-28 12:02:56 +03:00
alesapin
5332642fee CI Fails fixes and little performance improvement 2019-03-28 11:52:09 +03:00
alesapin
e449760fde Remove debug print 2019-03-27 19:50:01 +03:00
alesapin
48fb090cda Small fixes 2019-03-26 15:37:42 +03:00
alesapin
0378400972 Move all vertically possible streams to stopcondition 2019-03-26 14:37:32 +03:00
alesapin
2d0224aab4 Add average blocks size for ReplacingBlockInputStream 2019-03-26 13:23:14 +03:00
alesapin
673a72eac6 Merge remote-tracking branch 'origin' into adaptive_index_granularity 2019-03-25 11:41:38 +03:00
Alexey Milovidov
fb19cf1eec Attempt to make compositions with COWPtr more convenient 2019-03-25 04:43:54 +03:00
proller
fce9db12b9 Move Interpreters/Settings* -> Core/Settings* 2019-03-22 15:08:30 +03:00
alesapin
b5d6813604 Fix vertical merge again 2019-03-20 20:04:34 +03:00
alesapin
95a8be569d Check marks for adaptive granularity 2019-03-20 19:18:13 +03:00
alesapin
ec474472e4 Make avg block size for stream optional 2019-03-19 17:36:42 +03:00
alesapin
2f037bad58 Fix bug in merging algorithm 2019-03-19 16:10:24 +03:00
alesapin
d8aa5c7c49 Slightly clearer debug and fix alter 2019-03-19 12:57:29 +03:00
alesapin
ce03636f05 Merge master 2019-03-18 15:02:33 +03:00
Alexey Zatelepin
304c67da99 Merge branch 'master' into fix-add-materialized-column-after 
Conflicts:
	dbms/src/Interpreters/InterpreterCreateQuery.cpp
	dbms/src/Interpreters/InterpreterDescribeQuery.cpp
	dbms/src/Interpreters/interpretSubquery.cpp
	dbms/src/Storages/ColumnsDescription.cpp
 2019-03-17 00:46:53 +03:00
Alexey Zatelepin
a030ce90b5 fix build 2019-03-15 20:40:16 +03:00
Alexey Zatelepin
b5a0a3fa23 store all kinds of columns in the same list in ColumnsDescription [#CLICKHOUSE-3101] 2019-03-15 19:37:52 +03:00
Ivan Lezhankin
d1ead22073 Rename As<…> → as<…> 2019-03-11 16:22:51 +03:00
Ivan Lezhankin
1e9f7847dc Merge remote-tracking branch 'upstream/master' into iast-as 2019-03-11 16:11:22 +03:00
Ivan Lezhankin
a7e838e328 Replace all other casts to method IAST::As<Derived> 
Also remove some redundant methods like IsIdentifier() et. al.
 2019-03-11 15:49:39 +03:00
alexey-milovidov
617a0a8938
Merge pull request #4592 from yandex/fix-concurrent-alters2 
Fix a race condition during concurrent ALTER COLUMN queries
 2019-03-10 19:11:49 +03:00
alexey-milovidov
24bec290b5
Merge pull request #4584 from Felixoid/system.graphite_retentions 
Rework system.graphite_retentions
 2019-03-10 04:30:53 +03:00
alexey-milovidov
bc6235c2f2
Update LimitBlockInputStream.cpp 2019-03-08 18:15:30 +03:00
alexey-milovidov
87e270c4a0
Update LimitBlockInputStream.cpp 2019-03-08 17:54:32 +03:00
Mikhail Filimonov
5f626dc99e Fix broken progress in 19.3 (regression in 92769a2460) 
Introduce total_rows for table function `numbers()`.

fixes https://github.com/yandex/ClickHouse/issues/4429
resolves https://github.com/yandex/ClickHouse/issues/4284
 2019-03-08 15:36:40 +01:00
Mikhail f. Shiryaev
9e82b44b62 Review adjustment 2019-03-08 08:00:46 +01:00
Alexey Zatelepin
3344955154 separate Read and Write lock holders, better method names 2019-03-07 21:10:21 +03:00
Alexey Zatelepin
ab025805a3 alter intention lock 2019-03-07 20:21:18 +03:00
Mikhail f. Shiryaev
bccbd52d78 Rework system.graphite_retentions table 2019-03-07 01:05:24 +01:00
Alexey Zatelepin
aff14bc899 clarify comment 2019-03-06 16:48:59 +03:00
Alexey Zatelepin
bc30ed92d4 fix order of destruction of table locks and child streams 
Incorrect order could lead to a very rare `mutex lock failed: Invalid argument`
error when MergeTree table was dropped and its parts were deleted defore the destruction
of streams that were reading from that parts.
 2019-03-06 15:25:59 +03:00
alexey-milovidov
1df9c1720e
Merge pull request #4426 from Felixoid/graphite-rollup 
Graphite rollup: combined rules
 2019-03-06 03:10:45 +03:00
alexey-milovidov
2e6dde45b4
Update GraphiteRollupSortedBlockInputStream.cpp 2019-03-06 03:09:49 +03:00
zhang2014
fb44b6692a rename setting name 2019-03-04 10:09:44 +08:00
zhang2014
eae6406f34 Better method name 2019-03-02 15:08:02 +08:00
zhang2014
be158c145b fix divide by zero crash 2019-03-02 15:08:02 +08:00
zhang2014
b696ef34d2 Add max_execution_speed & min_execution_bytes_speed & max_execution_bytes_speed 2019-03-02 15:08:02 +08:00
Alexey Zatelepin
0d7ab9e3ea allow acquiring read lock to a table out of order if it was already locked by the same query [#CLICKHOUSE-3789] 
this is important in preventing ALTER deadlocks
 2019-02-27 21:34:38 +03:00
Nikolai Kochetov
2f98e779e1 Added MergingSortedTransform. 2019-02-26 21:40:08 +03:00
Mikhail f. Shiryaev
88d63a0b3a Use pair of patterns to make combined RollupRules 2019-02-26 10:49:39 +01:00
Nikolai Kochetov
e91a0a31b7 Merge branch 'master' into processors 2019-02-21 19:19:35 +03:00
Vitaly Baranov
76aae5f5d0 Add support for settings 'format_schema' in a "INSERT INTO table FORMAT" query. 2019-02-20 05:32:29 +03:00
proller
e20c77e4c6 Add parquet support. Fixes, tests, ... 2019-02-19 23:51:44 +03:00
proller
88076bb8c9 Merge commit 'bf09c2047a47b74f089d701b9b1e4fcbe8955a7f' into fix23 2019-02-19 23:46:37 +03:00
Vitaly Baranov
ad377d421f MergingSortedBlockInputStream class constructor, "max_block_size" parameter: change type UInt64 -> size_t. 2019-02-19 14:56:08 +03:00
Nikolai Kochetov
b6fd31865e Merged with master. 2019-02-15 19:22:29 +03:00
Alexey Milovidov
4051306fa7 Fixed includes #4372 2019-02-12 22:09:51 +03:00
Alexey Milovidov
d558cf345c Faster calcelling of vertical merges 2019-02-12 22:04:13 +03:00
Ivan Lezhankin
2bd14117f4 Merge remote-tracking branch 'upstream/master' into issue-2675 2019-02-11 13:57:40 +03:00
alexey-milovidov
81a184c47f
Merge pull request #4301 from yandex/input-data-in-perf-test 
Fix perf-test input data and refactor two tests
 2019-02-11 12:52:03 +03:00
Alexey Milovidov
0861af12a3 Fixed thread names 2019-02-11 00:15:14 +03:00
Alexey Milovidov
58a6accee5 Updated test #4246 2019-02-10 19:55:12 +03:00
Alexey Milovidov
4799a343ee Addition to prev. revision #4246 2019-02-10 19:22:38 +03:00
Alexey Milovidov
c603d270f4 Cleanups #4246 2019-02-10 18:17:45 +03:00
Alexey Milovidov
322c46383e Addition to prev. revision #4297 2019-02-08 20:17:16 +03:00
Alexey Milovidov
9599e8ad2a Addition to prev. revision #4297 2019-02-08 18:21:06 +03:00
alesapin
dc98b50f14 Fix HTTP insert 2019-02-08 16:24:24 +03:00
Ivan Lezhankin
018df69d3d Merge remote-tracking branch 'upstream/master' into issue-2675 2019-02-07 15:45:21 +03:00
Alexey Milovidov
e6ae1e36b6 Addition to prev. revision #4297 2019-02-07 00:44:17 +03:00
Alexey Milovidov
bcd7d3cc63 Fixed wrong behaviour of -WithNames formats when doing INSERT SELECT ... FROM file #3469 2019-02-07 00:40:49 +03:00
alexey-milovidov
2686f64233
Merge pull request #4128 from yandex/unified-sets 
Unified sets
 2019-02-06 20:40:11 +03:00
Nikita Vasilev
a1b0dede07 Data Skipping Indices (#4143) 
* made index parser

* added index parsing

* some fixes

* added index interface and factory

* fixed compilation

* ptrs

* added indexParts

* indextypes

* index condition

* IndexCondition

* added indexes in selectexecutor

* fix

* changed comment

* fix

* added granularity

* comments

* fix

* fix

* added writing indexes

* removed indexpart class

* fix

* added setSkipIndexes

* add rw for MergeTreeIndexes

* fixes

* upd error

* fix

* fix

* reading

* test index

* fixed nullptr error

* fixed

* fix

* unique names

* asts -> exprlist

* minmax index

* fix

* fixed select

* fixed merging

* fixed mutation

* working minmax

* removed test index

* fixed style

* added indexes to checkDataPart

* added tests for minmax index

* fixed constructor

* fix style

* fixed includes

* fixed setSkipIndexes

* added indexes meta to zookeeper

* added parsing

* removed throw

* alter cmds parse

* fix

* added alter

* fix

* alters fix

* fix alters

* fix "after"

* fixed alter

* alter fix + test

* fixes

* upd setSkipIndexes

* fixed alter bug with drop all indices

* fix metadata editing

* new test and repl fix

* rm test files

* fixed repl alter

* fix

* fix

* indices

* MTReadStream

* upd test for bug

* fix

* added useful parsers and ast classes

* fix

* fix comments

* replaced columns

* fix

* fixed parsing

* fixed printing

* fix err

* basic IndicesDescription

* go to IndicesDescr

* moved indices

* go to indicesDescr

* fix test minmax_index*

* fixed MT alter

* fixed bug with replMT indices storing in zk

* rename

* refactoring

* docs ru

* docs ru

* docs en

* refactor

* rename tests

* fix docs

* refactoring

* fix

* fix

* fix

* fixed style

* unique idx

* unique

* fix

* better minmax calculation

* upd

* added getBlock

* unique_condition

* added termForAST

* unique

* fixed not

* uniqueCondition::mayBeTrueOnGranule

* fix

* fixed bug with double column

* is always true

* fix

* key set

* spaces

* test

* tests

* fix

* unique

* fix

* fix

* fixed bug with duplicate column

* removed unused data

* fix

* fixes

* __bitSwapLastTwo

* fix
 2019-02-05 17:50:25 +03:00
Nikolai Kochetov
8bcc9e580a Merged with master 2019-02-05 15:15:35 +03:00
Nikolai Kochetov
91c63c201c Delete commented code. 2019-02-05 13:55:08 +03:00
Nikolai Kochetov
264da7f9d3 Implemented sets using ColumnsHashing. 2019-02-05 13:55:15 +03:00
Alexey Milovidov
fe94a15092 Merge branch 'master' into dictionaries-user-profile 2019-02-04 17:11:53 +03:00
chertus
d6450bc488 Refactoring: extract SubqueryForSet to own files 2019-01-30 15:01:00 +03:00
Alexey Milovidov
0b0960e28f Fixed "Attempt to attach to nullptr thread group" when reloading dictionaries 2019-01-29 20:24:54 +03:00
Alexey Milovidov
4e3d9a0f15 Merge branch 'master' of github.com:yandex/ClickHouse into global-thread-pool 2019-01-28 14:20:24 +03:00
Léo Ercolanelli
e1d6017120 use sumMapWithOverflow in SummingSortedBlockInputStream 2019-01-25 20:36:18 +01:00
Alexey Milovidov
253ac93459 Addition to prev. revision #4150 2019-01-25 21:44:30 +03:00
Alexey Milovidov
65f8e4d4a8 Merge branch 'master' into global-thread-pool 2019-01-25 16:33:50 +03:00
Ivan Lezhankin
681266abd0 Poll messages in batches of max_block_size size. 2019-01-25 15:48:59 +03:00
Ivan Lezhankin
05ab15cc84 Merge IBlockInputStream and IProfilingBlockInputStream into one 2019-01-23 17:48:50 +03:00
maiha
6c83beafdd dbms: Fixed misspells in comments 2019-01-23 04:56:53 +09:00
Alexey Milovidov
f6b9b06307 Attempt to implemnt global thread pool #4018 2019-01-14 22:22:09 +03:00
Alexey Milovidov
abcd5a2a49 Attempt to implemnt global thread pool #4018 2019-01-11 22:12:36 +03:00
Alexey Milovidov
38b7a459d1 Merge branch 'master' into processors 2019-01-11 18:53:53 +03:00
Alexey Milovidov
19f4652959 Fixed bugs found by PVS-Studio 2019-01-09 18:44:20 +03:00
Alexey Milovidov
1d4701b0bc Added some warnings from clang's -Weverything 2019-01-04 15:10:00 +03:00
Alexey Milovidov
e33e5150b7 Miscellaneous [#CLICKHOUSE-2] 2019-01-02 09:44:36 +03:00
proller
300bbdfb43 Fix cyclic lib depend ppart 2: clean 2018-12-28 21:15:26 +03:00
Alexey Milovidov
3c84e47419 Fixed UB #3926 2018-12-27 03:33:54 +03:00
Alexey Milovidov
713a44c38e Fixed UB #3926 2018-12-27 03:33:32 +03:00
Alexey Milovidov
1191f1575d Less dependencies [#CLICKHOUSE-2] 2018-12-26 02:44:44 +03:00
Alexey Milovidov
a8f09809f5 Simplified logic with "IColumn::convertToFullColumnIfConst" (suggested by Amos Bird) [#CLICKHOUSE-2] 2018-12-21 19:00:07 +03:00
Nikolai Kochetov
4eb7a820d6 Fix style 2018-12-19 20:54:46 +03:00
Nikolai Kochetov
78321a04a1 Added low_cardinality_allow_in_native_format setting. 2018-12-19 19:47:30 +03:00
alexey-milovidov
cea269883c
Merge pull request #3803 from yandex/low-cardinality-native-format-conversion-2 
LowCardinality support for old clients, part 2
 2018-12-10 21:03:43 +03:00
Nikolai Kochetov
1a6127dce4 Remove LowCardinality from NativeBlockOutputStream types for old clients. 2018-12-10 15:09:37 +03:00
alexey-milovidov
0fdb3b9628
Merge branch 'master' into issue-3578 2018-12-07 23:53:34 +03:00
KochetovNicolai
431cff1613
Update NativeBlockInputStream.cpp 
Fix type for LowCardinality inserts.
 2018-12-07 20:17:50 +03:00
chertus
60dc8fcac2 fixes for review CLICKHOUSE-3578 2018-12-06 20:20:17 +03:00
Nikolai Kochetov
2bb57ce472 Support insertion into LowCardinality from old native clients. 2018-12-06 17:08:42 +03:00
Alexey Milovidov
f66b15efb3 Removed useless file #3754 2018-12-05 17:59:48 +03:00
proller
61328a2c9b
ARM build fixes (#3754) 2018-12-05 16:41:29 +03:00
chertus
1a7313eaa0 resolve class name conflict 2018-12-05 15:27:21 +03:00
chertus
3db00b7b98 Merge branch 'master' into issue-3578 2018-12-05 14:43:14 +03:00
chertus
a71d03737c send defaults via serialized ColumnsDescription CLICKHOUSE-3578 2018-12-04 23:03:04 +03:00
alesapin
7925abcd74 Deep debugging 2018-12-04 17:44:42 +03:00
chertus
933c055104 CLICKHOUSE-3578 review proress 2018-12-04 17:09:47 +03:00
alesapin
bf338b957f Merge master 2018-12-03 12:10:06 +03:00
alexey-milovidov
02636b3388
Merge pull request #3729 from amosbird/dryrun 
Function execution with dry runs
 2018-12-02 22:45:07 +03:00
Amos Bird
3cc0829cc1 Function execution with dry runs 
This commit prevents stateful functions like rowNumberInAllBlocks from being modified in getHeader() calls.
 2018-12-02 19:02:04 +08:00
alexey-milovidov
bf7b68cf95
Merge pull request #3689 from abyss7/CLICKHOUSE-3936 
CLICKHOUSE-3936
 2018-12-01 01:50:04 +03:00
alesapin
5524b77915 Compilable code! 2018-11-30 18:36:10 +03:00
Alexey Milovidov
f615b062d8 Fixed build [#CLICKHOUSE-2] 2018-11-28 19:29:56 +03:00
Ivan
448846fc0d
Merge branch 'master' into CLICKHOUSE-3936 2018-11-28 18:59:57 +03:00
Ivan Lezhankin
8b5a05947c Remove redundant information from RWLock. 
And fix broken exception in some race conditions
 2018-11-28 18:50:52 +03:00
Alexey Milovidov
52fea90a86 Removed useless code [#CLICKHOUSE-2] 2018-11-28 17:33:40 +03:00
alexey-milovidov
a12927a439
Merge pull request #3603 from vitlibar/CLICKHOUSE-4127 
CLICKHOUSE-4127: Fix ALTER of destination table for the BUFFER engine.
 2018-11-27 21:38:40 +03:00
Vitaly Baranov
44ca56c731 CLICKHOUSE-4127: Convert destination table's data when reading from 
StorageBuffer.
 2018-11-27 03:43:58 +03:00
Alexey Milovidov
7d6fffff48 More style checks [#CLICKHOUSE-3] 2018-11-24 04:48:06 +03:00
Alexey Milovidov
dbbacf4f87 Added more style checks [#CLICKHOUSE-3] 2018-11-23 21:52:00 +03:00
alexey-milovidov
733ab51089
Merge pull request #3643 from yandex/fix-parallel-inputs-processor-deadlock 
Fix deadlock in ParallelInputsProcessor in case thread creation fails.
 2018-11-23 00:30:01 +03:00
alexey-milovidov
2c2d75cceb
Don't allow exceptions without code (#3645) 
* Don't allow exceptions without code #3633

* Don't allow exceptions without code #3633
 2018-11-23 00:19:58 +03:00
Alexey Zatelepin
8b25084637 fix deadlock in ParallelInputsProcessor in case thread creation fails [#CLICKHOUSE-4155] 2018-11-22 20:29:49 +03:00
proller
1d40c2c871 Better link and deps (#3631) 
* try fix 1

* Better deps

* fix

* fix

* fix

* Update CMakeLists.txt

* Update CMakeLists.txt

* fix

* fix

* fix

* disable old

* Update find_odbc.cmake
 2018-11-21 22:20:27 +03:00
Marek Vavruša
8fad726d95 Added null guards for all CurrentThread::attachToIfDetached() 
refs #3622
 2018-11-20 09:10:34 -08:00
chertus
811b824b01 AddingDefaultsBlockInputStream fixed types optimisation 2018-11-15 23:26:51 +03:00
chertus
c642e16ee1 clearer evaluateMissingDefaults [CLICKHOUSE-3578] 2018-11-15 19:57:20 +03:00
chertus
13646eb4c4 move BlockMissingValues from Block to IBlockInputStream::getMissingValues() 2018-11-15 18:57:20 +03:00
chertus
5c67e02205 fix build 2018-11-15 13:39:13 +03:00
chertus
ebf3d60186 column defaults without CapNProto [CLICKHOUSE-3578] 2018-11-14 21:20:16 +03:00
chertus
9966f975a3 Merge branch 'master' into issue-3578 2018-11-12 17:58:00 +03:00
chertus
2fe3cdb3f5 restore lost commits [CLICKHOUSE-3578] 2018-11-12 17:52:30 +03:00
Nikolai Kochetov
1e9aeba603 Split ExpressionAnalyzer and SyntaxAnalyzer. 2018-11-09 18:01:18 +03:00
chertus
cc005c3ac9 Merge branch 'master' into issue-3578 2018-11-09 13:12:34 +03:00
Nikolai Kochetov
726ae0cb9a Split ExpressionAnalyzer and SyntaxAnalyzer. 2018-11-08 19:47:12 +03:00
alexey-milovidov
b1db9ec23c
Merge pull request #3436 from amosbird/master 
Flexible fields assignment
 2018-11-01 20:22:28 +03:00
Alexey Zatelepin
e4e38f71e1 allow empty header in RemoteBlockOutputStream #3411 
The bug with inserts to Distributed tables was introduced in https://github.com/yandex/ClickHouse/pull/3171
It added a workaround specifically for inserting in the Native format without specifying the list of columns.
Native (as opposed to other formats) historically supports this. To signal that the input block structure
shouldn't conform to any fixed header in this case, the remote server started sending empty header block.
This commit adds support for empty headers to RemoteBlockOutputStream.
 2018-10-26 18:26:07 +03:00
Amos Bird
3cf2177268 Flexible fields assignment 
Field f;

before:

f = Int64(-42);

after:

f = -42;
 2018-10-24 08:47:33 +08:00
alexey-milovidov
4bf54337b9
Merge pull request #3292 from CurtizJ/order-by-efficient 
Efficiently finish sorting by (x, y) stream, that already sorted by (x) [CLICKHOUSE-4022]
 2018-10-23 11:34:22 +03:00
alexey-milovidov
21e7c25134
Update FinishSortingBlockInputStream.cpp 2018-10-23 11:32:28 +03:00
Alex Zatelepin
4449d7e059
Update FinishSortingBlockInputStream.cpp 2018-10-19 16:21:50 +03:00
CurtizJ
6ff8a60460 fix style 2018-10-19 16:04:50 +03:00
CurtizJ
8a72ddd94b wip on finish sorting 2018-10-19 15:02:31 +03:00
CurtizJ
f86b9d3983 add lock for .inner. table 2018-10-17 17:11:20 +03:00
CurtizJ
d81ed27004 add lock for .inner. table 2018-10-17 17:08:52 +03:00
chertus
5896e45dac SummingMergeTree for Decimal128 [issue-3282] 2018-10-11 17:33:01 +03:00
CurtizJ
c565c75350 fix style 2018-10-11 12:27:16 +03:00