thevar1able/ClickHouse
1
0
Fork 0
mirror of https://github.com/ClickHouse/ClickHouse.git synced 2024-11-30 03:22:14 +00:00
Code Issues Packages Projects Releases Wiki Activity
75,567 Commits 9,189 Branches 1,782 Tags 2.2 GiB
5dc2f9a04e
Commit Graph

12789 Commits

Author SHA1 Message Date
Kruglov Pavel
27e8a83269
Merge pull request #30426 from amosbird/jsonextractstring3 
JSONExtractString raw string support.
 2021-10-21 12:29:11 +03:00
kssenii
b58f065806 One more test 2021-10-21 08:12:16 +00:00
mergify[bot]
aee446352a
Merge branch 'master' into update_keeper_config 2021-10-21 07:48:23 +00:00
Maksim Kita
650a79a907 SQLUserDefinedFunctions composition fix 2021-10-21 10:08:08 +03:00
Kseniia Sumarokova
feeb572219
Merge pull request #30474 from kssenii/sql-json-fix 
sql json change order of arguments
 2021-10-21 09:47:12 +03:00
Kseniia Sumarokova
5544e866f8
Merge pull request #30219 from lhuang09287750/master 
make date32 type comparable with date/datetime/string
 2021-10-21 09:38:55 +03:00
Amos Bird
e679e952c8
Let's check without projection just in case 2021-10-21 10:16:11 +08:00
kssenii
ec7c93728b Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into fix-local-exceptions 2021-10-20 23:42:27 +00:00
kssenii
5845336acb Adjust tests 2021-10-20 23:19:36 +00:00
kssenii
c96b884951 Fix 2021-10-20 20:47:34 +00:00
alexey-milovidov
d3df1c02bc
Merge pull request #29672 from ClickHouse/clickhouse-obfuscator-2 
More enhancements for query obfuscator
 2021-10-20 23:06:29 +03:00
Maksim Kita
e550e0c22d
Merge pull request #30435 from kitaisreal/sql-user-defined-functions-support-lambdas 
SQLUserDefinedFunctions support lambdas
 2021-10-20 21:36:52 +03:00
Maksim Kita
1b4829d071
Merge pull request #30454 from kitaisreal/sql-user-defined-functions-create-or-replace-no-exists-support 
SQLUserDefinedFunctions support CREATE OR REPLACE, CREATE IF NOT EXISTS
 2021-10-20 21:36:42 +03:00
Kseniia Sumarokova
cae31437e8
Merge pull request #30336 from kssenii/fix-local-defaults 
Send table columns in clickhouse-local
 2021-10-20 21:18:02 +03:00
Nikita Mikhaylov
56869c0ec4
Merge pull request #30360 from nikitamikhaylov/allow-graphite-final 
Allow to use FINAL clause in SELECT from GraphiteMergeTree
 2021-10-20 19:57:44 +03:00
feng lv
6565e1d4b2 fix conflict 2021-10-20 15:22:16 +00:00
Maksim Kita
ff48017f4a SQLUserDefinedFunctions support CREATE OR REPLACE, CREATE IF NOT EXISTS 2021-10-20 17:56:46 +03:00
Maksim Kita
f47aec6751 Fixed tests 2021-10-20 17:52:28 +03:00
Maksim Kita
73e6110b2a
Merge pull request #30437 from kitaisreal/sql-user-defined-functions-drop-if-exists 
SQLUserDefinedFunctions added DROP IF EXISTS support
 2021-10-20 17:24:57 +03:00
Nikita Mikhaylov
367e58357a Better test 2021-10-20 13:43:39 +00:00
Amos Bird
240895fba7
Fix projections with JOIN alias columns 2021-10-20 21:30:15 +08:00
Nikolai Kochetov
8986de7e50
Merge pull request #30384 from amosbird/projection-fix21 
Fix crash when minmax_count projection is used with primary key in partition expr
 2021-10-20 16:17:13 +03:00
Anton Popov
78c925ddef
Merge pull request #30177 from CurtizJ/initializeAggregation-nullable 
Support nullable arguments in function `initializeAggregation`
 2021-10-20 15:39:07 +03:00
mergify[bot]
5491389299
Merge branch 'master' into fix-positional 2021-10-20 12:19:15 +00:00
alesapin
2e1ca33311
Merge pull request #30447 from ClickHouse/trying_actions 
Fix s3 for github actions
 2021-10-20 14:56:29 +03:00
alesapin
6ea04b2ea6 Fix region 2021-10-20 14:52:03 +03:00
alesapin
d120d3720a Trying aws secrets 2021-10-20 14:48:27 +03:00
alesapin
0d6712532a Revert "Remove statuses from actions" 
This reverts commit 0dcb36df01.
 2021-10-20 14:25:14 +03:00
mergify[bot]
0d99cba08b
Merge branch 'master' into fix-positional 2021-10-20 11:04:48 +00:00
alesapin
d9fca805cf
Merge pull request #30444 from ClickHouse/trying_actions 
Remove statuses from actions
 2021-10-20 14:04:21 +03:00
alesapin
0dcb36df01 Remove statuses from actions 2021-10-20 13:57:41 +03:00
mergify[bot]
d1f7e74e6f
Merge branch 'master' into fix-positional 2021-10-20 10:40:39 +00:00
alesapin
0cd4941dfa
Merge pull request #30439 from ClickHouse/trying_actions 
Use robot token in actions for statuses
 2021-10-20 13:39:05 +03:00
alesapin
ba442b7ce5 Use robot token in actions for statuses 2021-10-20 13:31:48 +03:00
Maksim Kita
fe93533ba4 Fixed tests 2021-10-20 13:09:33 +03:00
Maksim Kita
ad409d9b47 SQLUserDefinedFunctions added DROP IF EXISTS support 2021-10-20 13:05:57 +03:00
Amos Bird
ddcf12c83b
JSONExtractString raw string support. 2021-10-20 17:57:14 +08:00
mergify[bot]
35b5cf23cb
Merge branch 'master' into update_keeper_config 2021-10-20 09:57:09 +00:00
alesapin
9e8dfdb089
Merge pull request #28851 from ClickHouse/trying_actions 
Trying github actions
 2021-10-20 12:55:53 +03:00
Maksim Kita
83787e26f2 SQLUserDefinedFunctions support lambdas 2021-10-20 12:43:03 +03:00
Kseniia Sumarokova
c692155c7e
Merge pull request #30309 from kssenii/fix-file-symlinks 
Fix symlinks in file table function
 2021-10-20 11:09:51 +03:00
alesapin
26d40a6622 Update tests configs 2021-10-20 10:56:29 +03:00
kssenii
b73a77ad48 Better test 2021-10-20 07:52:48 +00:00
kssenii
6c990400d1 Better positional args 2021-10-20 07:52:39 +00:00
lhuang0928
008a13df8b fix date32 comparison with datetime/datetime64 2021-10-20 03:36:07 +00:00
alexey-milovidov
23312c4808
Merge pull request #30361 from nikitamikhaylov/rename-geo-functions 
Rename readWkt* functions to readWKT*, added an alias SVG for svg function
 2021-10-20 03:46:42 +03:00
Kseniia Sumarokova
5324cc8359
Merge pull request #30282 from kssenii/fix-local-less-threads 
Less threads in clickhouse-local, fix Ok. printing
 2021-10-19 22:54:28 +03:00
alesapin
9699a71806 Update amis 2021-10-19 22:39:55 +03:00
Amos Bird
05d93796dc
Fix minmax_count projection with primary key in partition expr 2021-10-19 23:36:07 +08:00
alesapin
6d8853698b Merge branch 'master' into trying_actions 2021-10-19 17:45:37 +03:00
Anton Popov
82b409e2b0 better perf test 2021-10-19 17:13:52 +03:00
Anton Popov
82bff416f6 Merge remote-tracking branch 'upstream/master' into HEAD 2021-10-19 16:48:47 +03:00
alesapin
042eebd981 Add test for leader remove 2021-10-19 16:37:28 +03:00
Anton Popov
c547ffa313 improve performance of aggregation in order primary key with function with heavy states 2021-10-19 16:36:31 +03:00
Nikita Mikhaylov
08f3a01830
Update 01236_graphite_mt.sql 2021-10-19 16:26:16 +03:00
feng lv
05fd6f7caf fix comflict 2021-10-19 12:50:22 +00:00
Nikita Mikhaylov
1114d06bc0 Done 2021-10-19 12:11:18 +00:00
alesapin
2d4b601d38 Better 2021-10-19 15:00:26 +03:00
Nikita Mikhaylov
4fbd332bf1 Done 2021-10-19 11:53:55 +00:00
Vladimir C
49685f0b9a
Merge pull request #30292 from Joeywzr/trim_dev 2021-10-19 14:49:43 +03:00
Nikita Mikhaylov
ea2a647724
Merge pull request #30192 from azat/granula-adjust-LOGICAL_ERROR-fix 
Fix reading from MergeTree with max_read_buffer_size=0
 2021-10-19 13:25:55 +03:00
Nikolai Kochetov
cfa685c29c Fix another test. 2021-10-19 13:16:30 +03:00
Ilya Yatsishin
4396daeb1f
Merge pull request #30064 from azat/client-print-profile-events 2021-10-19 12:42:09 +03:00
vdimir
3dfbc80f0b
Add cases to test replaceRegexpAll_bug 2021-10-19 12:38:11 +03:00
Kruglov Pavel
1e2ceeb2e7
Merge pull request #29291 from Avogar/capnproto 
Add CapnProto output format, refactor CapnProto input format
 2021-10-19 11:54:55 +03:00
Kruglov Pavel
de2b75abf0
Merge pull request #30053 from Avogar/clickhouse-local 
Remove unused headers and handle exception 'unrecognised option' in clickhouse-local
 2021-10-19 11:52:15 +03:00
kssenii
4bf1f2ca12 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into fix-local-exceptions 2021-10-19 08:28:47 +00:00
Kseniia Sumarokova
eb0ce68f10
Update 02051_symlinks_to_user_files.sh 2021-10-19 11:27:48 +03:00
Nikolai Kochetov
254eecf227 Update some tests. 2021-10-19 11:11:54 +03:00
alesapin
53ad965f8e
Merge pull request #30170 from ClickHouse/debug_keeper 
Start keeper asynchronously in some cases
 2021-10-19 10:14:36 +03:00
Azat Khuzhin
424bf6fcf4 client: add ability to print raw profile events 
This can be useful for debugging and for testing (since you will not
need to obtain query_id and look at query_log).

v2:
- mark test as long
- add option to docs
- add type of profile event into logs too
v3:
- resolve conflicts
- and fix onProfileEvents callback
v4:
- add --print-profile-events separate switch
 2021-10-19 00:54:38 +03:00
Nikita Mikhaylov
75c16b8f89
Merge pull request #30284 from Algunenano/sequential_tests 
Adjust resource heavy tests
 2021-10-18 22:42:14 +03:00
alexey-milovidov
885c4daf94
Merge pull request #30191 from azat/aio-O_DIRECT-fix 
Fix pread_fake_async/pread_threadpool with min_bytes_to_use_direct_io
 2021-10-18 22:29:31 +03:00
Azat Khuzhin
4e3910e564 Add a test for adjusting last granula with max_read_buffer_size=0 2021-10-18 21:19:34 +03:00
Anton Popov
1d9cfc04ef improve performance of aggregation in order of primary key 2021-10-18 18:32:09 +03:00
kssenii
b7a53df9de Send columns description in clickhouse-local 2021-10-18 14:53:42 +00:00
Nikolay Degterinsky
f18dca3836 Add test 2021-10-18 17:23:27 +03:00
tavplubix
837670fd85
Merge pull request #30320 from azat/clickhouse-test-longer-wait 
Increase default wait of the server start in clickhouse-test
 2021-10-18 15:11:32 +03:00
feng lv
b2976fadb0 fix test 2021-10-18 11:57:03 +00:00
Vladimir C
4a4700424e
Merge pull request #30230 from vdimir/CLOUDSUPPORT-92764 2021-10-18 14:46:02 +03:00
Kruglov Pavel
003955b59f
Merge branch 'master' into clickhouse-local 2021-10-18 14:24:08 +03:00
avogar
a28b048415 Fix test 2021-10-18 14:22:27 +03:00
vdimir
042e61febf
Allow identifiers staring with numbers in multiple joins 2021-10-18 13:41:40 +03:00
lhuang0928
a6937a21cf fix a bug:reference file without a newline at the end 2021-10-18 09:58:53 +00:00
Anton Popov
1131a3ebe8 fix test 2021-10-18 12:15:08 +03:00
alesapin
6d24ca4c3a Review fixes 2021-10-18 12:13:24 +03:00
lhuang0928
37441fe44e Merge remote-tracking branch 'origin/master' 2021-10-18 08:57:25 +00:00
lhuang0928
109e664188 fix date32 comparison with datetime/datetime64 2021-10-18 08:53:25 +00:00
kssenii
1cc511789d Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into fix-local-less-threads 2021-10-18 08:30:59 +00:00
Azat Khuzhin
09b782a52e Increase default wait of the server start in clickhouse-test 
Set --server-check-retries to 90 (and this is ~45 seconds), since right
now sometimes it is not enough [1].

  [1]: https://clickhouse-test-reports.s3.yandex.net/30191/0e34a9d550cfe6924fe575871f36c44dd44acdaa/functional_stateless_tests_(memory).html#fail1

And the reason I guess is clickhouse-test had been rewritten to
http.client in #30065, and since now it does not need to execute
clickhouse-client binary, which in debug/sanitizers builds can take also
sometime.
That said that with clickhouse-client for hung check it was not 15
seconds, but more (each clickhouse-client requires 0.6sec with
sanitizers for simple SELECT 1, while w/o 0.1second, also too much
should be optimized)
 2021-10-18 10:46:02 +03:00
feng lv
1e3df5780c Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into filelog-engine 2021-10-18 07:33:11 +00:00
Kseniia Sumarokova
ec6b778501
Update 02051_symlinks_to_user_files.sh 2021-10-18 10:29:57 +03:00
feng lv
6cf82f859c fix 2021-10-18 07:27:37 +00:00
alesapin
f1fe96e194 Merge branch 'master' into debug_keeper 2021-10-18 10:16:07 +03:00
alesapin
158b4c26b7
Merge pull request #30134 from ClickHouse/fix-network-bytes-test 
Fix flaky test 01939_network_send_bytes_metrics
 2021-10-18 10:11:59 +03:00
feng lv
a32abda322 fix 2021-10-18 07:08:37 +00:00
feng lv
074e02eb14 fix 2021-10-18 06:38:47 +00:00
Azat Khuzhin
14baed927f Add extensive test for various read settings 
The following settings had been covered:
- min_bytes_to_use_direct_io
- local_filesystem_read_method
- local_filesystem_read_prefetch
- read_priority
- max_read_buffer_size
 2021-10-17 23:54:58 +03:00
Kseniia Sumarokova
a8a7ba9005
Update 02051_symlinks_to_user_files.sh 2021-10-17 22:09:17 +03:00
alexey-milovidov
7beffb04ad
Merge pull request #29495 from ClickHouse/improvement_for_strange_mutations 
Minor improvement for strange mutations
 2021-10-17 20:57:06 +03:00
alexey-milovidov
0ce1462f1c
Merge pull request #30295 from traceon/misc-install-fixes 
Various fixes to install procedure
 2021-10-17 20:55:08 +03:00
alexey-milovidov
f4bfed9d3a
Merge pull request #29586 from evillique/log_levels_update 
Add log levels updates
 2021-10-17 20:54:46 +03:00
Alexey Milovidov
301caa8091 Update test 2021-10-17 20:52:21 +03:00
Kseniia Sumarokova
5dab184d8b
Update 02051_symlinks_to_user_files.sh 2021-10-17 18:21:43 +03:00
Nikolai Kochetov
2a95d7fc87
Merge pull request #29918 from amosbird/projection-improve5 
Add primary key to minmax_count_projection
 2021-10-17 14:04:18 +03:00
Kseniia Sumarokova
e1969e2693
Merge pull request #30288 from kssenii/fix-local-syntax-exception 
Fix throwing syntax exception in clickhouse-local
 2021-10-17 12:16:40 +03:00
kssenii
059fc1de69 Allow symlinks in file storage 2021-10-17 09:11:06 +00:00
alexey-milovidov
3e9cf0b5ba
Merge pull request #30243 from Algunenano/multiIf_shortcircuit_fix 
Fix crash with shortcircuit and LowCardinality in multiIf
 2021-10-17 06:16:09 +03:00
Alexey Milovidov
04d8f611d2 Merge branch 'master' into clickhouse-obfuscator-2 2021-10-17 05:52:13 +03:00
alexey-milovidov
b253f6122a
Merge pull request #30218 from azat/clickhouse-test-fix-hung-check 
Fix --hung-check in clickhouse-test
 2021-10-17 03:15:51 +03:00
Maksim Kita
0dd8c70d28
Merge pull request #30242 from kitaisreal/added-hashed-array-dictionary 
Added HashedArray dictionary
 2021-10-17 01:18:43 +03:00
kssenii
8b0359584a Update test 2021-10-16 19:08:37 +00:00
Raúl Marín
662b5d40e9 Adjust the tests to do less work 2021-10-16 20:35:41 +02:00
Denis Glazachev
329d81a0ef Various fixes to install procedure 2021-10-16 20:03:45 +03:00
alexey-milovidov
3d2fb2f67b
Merge pull request #30275 from kssenii/fix-local-query-stage 
--stage for clickhouse-local
 2021-10-16 18:42:28 +03:00
WangZengrui
6752be4c4e fix bug and add test 2021-10-16 23:11:45 +08:00
Azat Khuzhin
612a21cc97 clickhouse-test: do not propagate CLICKHOUSE_PORT_HTTP to clickhouse-client 2021-10-16 17:59:56 +03:00
Azat Khuzhin
c6e61e9497 clickhouse-test: use splitlines() over split('\n') 2021-10-16 17:59:56 +03:00
Azat Khuzhin
3102d24872 Fix --hung-check in clickhouse-test 
JSONEachRow cannot be parsed with a simple json.loads(), instead it
should be passed to json.loads() line by line.

Fixes: #30065
 2021-10-16 17:59:56 +03:00
Anton Popov
1a947d30bf add perf test 2021-10-16 16:43:10 +03:00
alesapin
9418eda122
Merge pull request #30111 from ClickHouse/remove_trash 
Remove trash from MergeTreeReadPool
 2021-10-16 15:41:41 +03:00
kssenii
c79c0526ff Fix clickhouse-local syntax exception 2021-10-16 12:20:14 +00:00
kssenii
e127fa6976 Add test 2021-10-16 11:48:19 +00:00
Raúl Marín
c5b09b4907 Tag resource heavy tests as no-parallel 2021-10-16 13:03:51 +02:00
kssenii
9525437499 Less threads in local, fix Ok. printing 2021-10-16 10:25:39 +00:00
Amos Bird
77a2022cf5
Add primary key to minmax_count_projection 2021-10-16 18:13:41 +08:00
kssenii
6c0eaf76da Query stage for local 2021-10-16 08:43:18 +00:00
feng lv
8b7721ae6f Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into filelog-engine 2021-10-16 05:14:11 +00:00
alexey-milovidov
8359a82a0d
Merge pull request #30149 from azat/disable-fsync_metadata-on-ci 
Disable fsync_metadata on CI
 2021-10-15 23:01:00 +03:00
Maksim Kita
fceb763228 Fixed test 2021-10-15 23:00:30 +03:00
Raúl Marín
01fbd52758 Fix crash with shortcircuit and locardinality in multiIf 2021-10-15 18:52:23 +02:00
Maksim Kita
33ef3edcfa Updated tests 2021-10-15 18:54:41 +03:00
Maksim Kita
c9638bacbf Added HashedArray dictionary 2021-10-15 18:53:17 +03:00
avogar
be4fc79d32 Better handling exceptions, update tests 2021-10-15 18:30:32 +03:00
mergify[bot]
477ea62257
Merge branch 'master' into remove-sample-by 2021-10-15 15:14:17 +00:00
kssenii
72a1b928cf Update install.sh 2021-10-15 14:04:31 +00:00
kssenii
7b81766168 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into remote-connection 2021-10-15 12:36:44 +00:00
Nikita Mikhaylov
d1138a8a25
Merge pull request #29691 from azat/fix-merge-mutate-memory-tracking 
Fix memory tracking for merges and mutations
 2021-10-15 13:53:52 +03:00
Maksim Kita
27fdeef4b6
Merge pull request #29650 from kitaisreal/add-default-database-visitor-support-dict-get 
AddDefaultDatabaseVisitor support dictGet
 2021-10-15 12:28:58 +03:00
liang.huang
f82d79854c
Merge branch 'ClickHouse:master' into master 2021-10-15 16:11:15 +08:00
lhuang09287750
766e08567c complete date32 comparison with date/datetime/string and give a test file 2021-10-15 08:09:37 +00:00
alesapin
4ab6f7d771 Finally fix test 2021-10-15 10:39:31 +03:00
Maksim Kita
8db2c844d3 Fixed test 2021-10-15 02:07:52 +03:00
Azat Khuzhin
ae980fcd62 Move 01200_mutations_memory_consumption out from bugs 2021-10-15 01:43:27 +03:00
Azat Khuzhin
5d5f94f456 Mark 01200_mutations_memory_consumption as long and allow run in fasttest 2021-10-15 01:43:27 +03:00
Azat Khuzhin
a063097fdf Fix INSERT SELECT incorrectly fills MATERIALIZED column based of Nullable column 
Required columns of the default expression should not be converted to NULL,
since this map value to default and MATERIALIZED values will not work.

Consider the following structure:
- A Nullable(Int64)
- X Int64 materialized coalesce(A, -1)

With recursive_null_as_default=true you will get:

    _CAST(coalesce(A, -1), 'Int64') AS X, NULL AS A

And this will ignore default expression.

Fixes: #23524 (Cc: @kssenii)
Fixes: #29729 (Cc: @tavplubix)
Backport: 21.7+
 2021-10-15 01:36:09 +03:00
Azat Khuzhin
bb8105951f Disable fsync_metadata on CI 
Sometimes we see that pretty simple queries like CREATE DATABASE can
take > 30 seconds, let's try to disable fsync.

CI: https://clickhouse-test-reports.s3.yandex.net/30065/e5bc573250d3d6938937739b05d6f8cf618722db/functional_stateless_tests_(address).html#fail1
CI: https://clickhouse-test-reports.s3.yandex.net/30065/e5bc573250d3d6938937739b05d6f8cf618722db/functional_stateless_tests_(release).html#fail1
 2021-10-15 00:53:34 +03:00
Maksim Kita
a51ab78c68 Fixed style check 2021-10-14 23:13:41 +03:00
Maksim Kita
83879415b4 Fixed tests 2021-10-14 22:12:06 +03:00
Azat Khuzhin
d030e08d05 Make test_MemoryTracking::test_http not flaky 
By comparing only megabytes in the memory changes, instead of bytes as
before, since it may be tricky at least due to max_untracked_memory and
how thread pool handle it.

It should be safe, since originally it was written in #16121 which fixes
issue #15932, which has ~4MB consumption of memory per request.
 2021-10-14 21:06:39 +03:00