Commit Graph

3414 Commits

Author SHA1 Message Date
sundy-li
ad01534bd5 Merge branch 'master' into alias_column_partition_prune 2021-01-12 18:28:30 +08:00
alexey-milovidov
f7e7725b8e
Merge pull request #18884 from fuwhu/feature/fix-windowFunnel-inconsistency
fix the inconsistent result of windowFunnel in case of same timestamp for different events
2021-01-10 14:56:58 +03:00
alexey-milovidov
95ac01ab82
Merge pull request #18893 from ClickHouse/fix-clickhouse-local
Fix hang at shutdown in clickhouse-local
2021-01-10 13:26:44 +03:00
Alexey Milovidov
79a38c4c6e Fix hang at shutdown in clickhouse-local 2021-01-10 06:35:05 +03:00
HuFuwang
d0378395c5 add tests 01646_fix_window_funnel_inconistency. 2021-01-10 07:49:11 +08:00
Azat Khuzhin
471deab63a Rename fsync_tmp_directory to fsync_directories for Distributed engine 2021-01-09 17:51:30 +03:00
Azat Khuzhin
b5ace27014 Add fsync support for Distributed engine.
Two new settings (by analogy with MergeTree family) has been added:

- `fsync_after_insert` - Do fsync for every inserted. Will decreases
  performance of inserts.

- `fsync_tmp_directory` - Do fsync for temporary directory (that is used
  for async INSERT only) after all part operations (writes, renames,
  etc.).

Refs: #17380 (p1)
2021-01-09 11:31:32 +03:00
Azat Khuzhin
a24be01025 Drop Kafka storage from 01645_system_table_engines for fasttest 2021-01-09 00:59:03 +03:00
Azat Khuzhin
c312676368 Add a smoke test for system.table_engines 2021-01-08 14:57:24 +03:00
sundy-li
5dbda5d627 Update tests 2021-01-08 16:18:12 +08:00
alexey-milovidov
45f53bacfa
Merge pull request #18845 from azat/fsync-fixes
Fix never worked fsync_part_directory/fsync_after_insert/in_memory_parts_insert_sync
2021-01-08 07:26:24 +03:00
Alexey Milovidov
ffa5bbd5fd Add SYSTEM SUSPEND command #15979 2021-01-07 22:19:33 +03:00
Azat Khuzhin
798fb4e842 Smoke coverage of various fsync capabilities 2021-01-07 19:30:25 +03:00
alexey-milovidov
a08db94343
Revert "Add metrics for part number in MergeTree in ClickHouse" 2021-01-07 16:40:52 +03:00
alexey-milovidov
f91626e7ff
Merge pull request #17838 from weeds085490/dev/add_metrics_for_parts
Add metrics for part number in MergeTree in ClickHouse
2021-01-07 15:27:04 +03:00
alexey-milovidov
0f28473ec1
Merge pull request #18808 from ClickHouse/lld-build-id
Generate build id when ClickHouse is linked with lld
2021-01-07 15:26:26 +03:00
alexey-milovidov
b73722e587
Merge pull request #18806 from azat/If-combinator-Nullable-fix
Fix *If combinator with unary function and Nullable types
2021-01-07 15:25:54 +03:00
alexey-milovidov
65b4008d1f
Update 01600_count_of_parts_metrics.sh 2021-01-07 06:36:00 +03:00
Alexey Milovidov
6f75901ffb Update test 2021-01-07 04:09:18 +03:00
Azat Khuzhin
fdcfacda60 Fix *If combinator with Nullable types
sumIf(Nullable()) and similar unary functions (unary w/o If combinator)
was working incorrectly, since it returns "sum" from the getName()
helper, and so distributed query processing fails.

The problem is in the optimization in
AggregateFunctionIfNullUnary::add() for the unary functions. It pass
only one column to write result to, instead of all passed arguments +
result columns.
While AggregateFunctionIf::add() assumes that it accepts arguments  +
result columns, and use last column as a result.

Introduced-in: #16610
Fixes: #18210
2021-01-07 03:09:13 +03:00
Azat Khuzhin
6261d4135c Add sanity checks for Sim/Min hash arguments
Fixes: #18799
Fixes: #18524
2021-01-06 22:38:05 +03:00
alexey-milovidov
13e4579052
Merge pull request #18712 from amosbird/limitpartition
add max_partitions_to_read setting
2021-01-06 21:29:58 +03:00
alexey-milovidov
c944035f0b
Merge pull request #18699 from amosbird/exceptregex
column excepts with regex
2021-01-06 21:28:09 +03:00
alexey-milovidov
f84426ebef
Merge pull request #18771 from den-crane/tests/simple_aggregate_funcs2
more tests for simple aggregate functions in summingMT aggregatingMT try2
2021-01-06 21:26:06 +03:00
alexey-milovidov
49f70b3b5f
Merge pull request #18763 from azat/marks-corruption-test
Add a regression test for marks corruption
2021-01-06 21:20:55 +03:00
Alexey Milovidov
8ab40d2747 Newline 2021-01-06 21:06:34 +03:00
jianmei zhang
4950377fbf code changes according to reviewer's comments 2021-01-06 21:05:45 +03:00
jianmei zhang
2256227361 SQL compatibility: provide POSITION(needle IN haystack) syntax. 2021-01-06 21:05:45 +03:00
alexey-milovidov
417e685830
Merge pull request #18775 from ClickHouse/dont-insert-empty-blocks-distributed-sync
Do not insert empty blocks on sync Distributed INSERT
2021-01-06 20:06:35 +03:00
weeds085490
b2e4c0ee71 refine test 2021-01-06 19:29:51 +08:00
weeds085490
5f5b86b485 Merge remote-tracking branch 'origin' into dev/add_metrics_for_parts 2021-01-06 17:32:45 +08:00
Amos Bird
0260953a47
better 2021-01-06 17:18:48 +08:00
Alexey Milovidov
438f0f971b Fix the issue with async Distributed INSERTs and network_compression_method #18741 2021-01-06 03:24:42 +03:00
Alexey Milovidov
d77dfeaafb Arcadia does not support distributed tables 2021-01-06 03:06:19 +03:00
Alexey Milovidov
7547aee66a Add a test 2021-01-06 03:05:45 +03:00
alexey-milovidov
d68fdd8798
Update 01640_marks_corruption_regression.sql 2021-01-06 02:05:02 +03:00
Denis Zhuravlev
d23409da50 more tests for simple aggregate functions in summingMT aggregatingMT 2021-01-05 16:25:35 -04:00
Alexey Milovidov
f8313a33aa Add test for some possible ambiguities in syntax 2021-01-05 23:10:10 +03:00
alexey-milovidov
202d1f2211
Merge pull request #18760 from spongedu/fix_#18701
[For #18707] MySQL compatibility: support DIV and MOD operators
2021-01-05 20:42:58 +03:00
alexey-milovidov
06143d73ca
Merge pull request #15260 from ClickHouse/revert-15259-revert-14962-log-avoid-deadlock
Avoid deadlocks in Log/TinyLog (part 2)
2021-01-05 20:12:17 +03:00
alexey-milovidov
2d1afa5dad
Merge pull request #18753 from ClickHouse/null-fuzz
Add a test from #15641
2021-01-05 19:58:57 +03:00
alexey-milovidov
06225f7910
Merge pull request #18749 from ClickHouse/uuid-fuzz
Don't allow conversion between UUID and numeric types
2021-01-05 19:57:33 +03:00
alexey-milovidov
2e98f6f4ee
Merge pull request #18745 from ClickHouse/dont-throw-from-parser
Do not throw from Parser
2021-01-05 19:57:17 +03:00
Azat Khuzhin
6c50f537a0 Add a regression test for marks corruption
In #17120 (that was reverted in #17918 already) marks adjustemnt was
introduced, but it may lead to corruption of marks files, that may cause
two things:
1) Incorrect marks files, which lead to reading more rows than there are
   (can be reproduced with `max_threads`>1 or/and `PREWHERE`, and
    `optimize_move_to_prewhere`)
2) Can't adjust last granule because it has X rows, but try to subtract Y
   rows (#9260)

And 1) is pretty hard to diagnosis, since it does not throw any error,
it just may return wrong result.

Fortunately both problems can be fixed with `OPTIMIZE TABLE ... [ FINAL]`.

Cc: @alesapin
Refs: #17943
Refs: #18223
2021-01-05 15:41:54 +03:00
spongedc
99335563d1 [For #18707] MySQL compatibility: support DIV and MOD operators 2021-01-05 13:03:19 +08:00
Alexey Milovidov
cbc54e2dd7 Merge branch 'master' into revert-15259-revert-14962-log-avoid-deadlock 2021-01-05 04:27:32 +03:00
Alexey Milovidov
a1ce6c4165 Fix errors 2021-01-05 04:26:29 +03:00
Alexey Milovidov
ab6798addd One more test 2021-01-05 04:03:38 +03:00
Alexey Milovidov
c2c1d97da2 Arcadia does not support distributed queries 2021-01-05 03:59:09 +03:00
Alexey Milovidov
f6dff13db8 Add a test for #14974 2021-01-05 03:56:56 +03:00