Commit Graph

86366 Commits

Author SHA1 Message Date
alesapin
885447342c More logs on unsuccessful part removal 2022-04-04 13:17:33 +02:00
Maksim Kita
e6c9a36ac7
Merge pull request #35733 from kitaisreal/ipv6-invalid-insert-test
Added test for insert of invalid IPv6 value
2022-04-04 12:28:16 +02:00
Azat Khuzhin
e5a837e574 Add id/parent_ids into system.processors_profile_log
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-04-04 13:19:43 +03:00
Azat Khuzhin
58ee917e94 Mesure processors profiles only if it was enabled
Since it may use little extra CPU.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-04-04 13:19:43 +03:00
Azat Khuzhin
99528e296c Rename need_data_elapsed_us/port_full_elapsed_us to input_wait_us/output_wait_us
$ gg -e need_data_ -e port_full_  | cut -d: -f1 | sort -u | xargs sed -i -e s/port_full_/output_wait_/g -e s/need_data_/input_wait_/g -e s/getPortFull/getOutputWait/g -e s/getNeedData/getInputWait/g

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-04-04 13:19:43 +03:00
Azat Khuzhin
0d06dab362 tests: cover processors_profile_log
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-04-04 13:19:43 +03:00
Azat Khuzhin
765b4bc45a Implement log_processors_profiles (write to processors_profile_log, OFF by default)
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-04-04 13:19:43 +03:00
Azat Khuzhin
5fd402eaba Measure time that Process spent in work/NeedData/PortFull
Note, that right now it is done not in IProcessor, but in
ExecutingGraph/ExecutionThreadContext, to avoid lots of changes in the
IProcessor interface, to make review easier, but I'm not against of
change the IProcessor interface to incapsulate it there.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-04-04 13:19:43 +03:00
Azat Khuzhin
14538f6456 Add system.processors_profile_log
This is the system table that will contain Processors level profiling.

v2: one entry per Processor, not 3 (PortFull/NeedData/work())
v3: us over ms
v4: Enable processors_profile_log table by default

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-04-04 13:19:41 +03:00
Nikolai Kochetov
19819c72f8
Merge pull request #35290 from bigo-sg/function_enumerate_streams
Add function getTypeSerializationStreams
2022-04-04 12:09:53 +02:00
alesapin
803a1a2a9c Fix tests and check 2022-04-04 11:19:02 +02:00
Anton Popov
11e18a16f3
Merge pull request #35724 from Avogar/fix-order
Improve schema inference for JSONEachRow and TSKV formats
2022-04-04 11:00:21 +02:00
kssenii
36c583d0de Better version of cache on insert 2022-04-04 10:58:59 +02:00
Anton Popov
ae53aae106 fix clang-tidy 2022-04-04 08:48:31 +00:00
mergify[bot]
bf9644639a
Merge branch 'master' into fix-postgres-test-2 2022-04-04 08:40:28 +00:00
Azat Khuzhin
93bbe9641a Fix formatting of INSERT ... COMPRESSION
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-04-04 10:33:12 +03:00
Azat Khuzhin
9a76efb850 Fix formatting of INSERT INFILE queries (missing quotes)
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-04-04 10:33:12 +03:00
Antonio Andelic
a926bc19ea Address PR comments 2022-04-04 07:24:42 +00:00
Antonio Andelic
d96b682a55 Refactor 2022-04-04 07:24:42 +00:00
taiyang-li
f4772d3b8f chmod a+x 02250_hints_for_columns/02250_hints_for_projections 2022-04-04 07:24:42 +00:00
taiyang-li
10bbb96512 fix stateless test 2022-04-04 07:24:42 +00:00
taiyang-li
9dd1a76fd8 fix stateless tests 2022-04-04 07:24:42 +00:00
taiyang-li
6bc1786047 fix style 2022-04-04 07:24:42 +00:00
taiyang-li
d6247338de fix failed stateless tests 2022-04-04 07:24:42 +00:00
taiyang-li
eda299b48b fix building 2022-04-04 07:24:42 +00:00
taiyang-li
fd9a10ef53 add hints for projections 2022-04-04 07:24:42 +00:00
taiyang-li
4547ed370a add hints for column description 2022-04-04 07:24:42 +00:00
Azat Khuzhin
4cd159746e Fix polling of socket with negative timeout (when poll() interrupted by EINTR)
In case of EINTR the timeout will be adjusted, but this should not be
done in case of negative timeout since it means infinite timeout, and
in that adjustment block negative timeout will be reset to 0, which will
make poll() return (since zero timeout means return immediatelly even if
no fd is ready).

This should also fix 02127_connection_drain flap on CI [1].

  [1]: https://s3.amazonaws.com/clickhouse-test-reports/32928/ddd5bebe555ce8feebcdd339e47fc45184c20dd1/stateless_tests__release__wide_parts_enabled__actions_.html

Refs: https://github.com/ClickHouse/poco/pull/55
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-04-04 10:24:07 +03:00
Alexey Milovidov
44293e6f94
Merge pull request #35734 from azat/use-bld-over-src-dir
Do not require writable source directory for generating krb5 error tables
2022-04-04 07:31:56 +03:00
Alexey Milovidov
d9e5ca2119
Merge pull request #34394 from holadepo/last_day
Add toLastDayOfMonth function
2022-04-04 07:02:08 +03:00
Alexey Milovidov
4f33a3053d
Merge pull request #35617 from nikandfor/patch-1
fix link in documentation
2022-04-04 07:00:08 +03:00
mergify[bot]
4d9bb9f6fd
Merge branch 'master' into test/crash_35551 2022-04-04 03:59:10 +00:00
Alexey Milovidov
efe5bab594
Merge pull request #35873 from ClickHouse/disable-session-log
Disable session_log
2022-04-04 06:57:27 +03:00
Alexey Milovidov
599e52fbc8
Merge pull request #35894 from ClickHouse/revert-35858-master
Revert "Format changes for new docs"
2022-04-04 02:05:51 +03:00
Alexey Milovidov
9854b55835
Revert "Format changes for new docs" 2022-04-04 02:05:35 +03:00
Alexey Milovidov
86558bba5a Move tests to bugs 2022-04-04 00:52:43 +02:00
Habibullah Oladepo
2dd7420fc7 Add tests for toLastDayOfMonth 2022-04-03 23:42:39 +01:00
mergify[bot]
003ef1f3b8
Merge branch 'master' into patch-1 2022-04-03 22:14:21 +00:00
mergify[bot]
2251df4582
Merge branch 'master' into fix-postgres-test-2 2022-04-03 22:06:52 +00:00
kssenii
93fc604223 Fix 2022-04-03 18:39:14 +02:00
alesapin
a8c1ccdb20 Forbit to reset non existing settings 2022-04-03 18:29:24 +02:00
Kseniia Sumarokova
30c1afe29d
Merge pull request #35646 from bigo-sg/reduce-mutex-scope
narrow mutex scope when setenv LIBHDFS3_CONF
2022-04-03 17:59:24 +02:00
alesapin
c923a52ebc
Merge pull request #35872 from ClickHouse/update-url-in-test-visualizer
Update URL in test visualizer
2022-04-03 17:39:33 +02:00
Rich Raposa
e56b6f4828
Merge pull request #35858 from rfraposa/master
Format changes for new docs
2022-04-03 09:13:19 -06:00
alesapin
7b35920d4c Make more alters of nested types metadata-only 2022-04-03 14:03:34 +02:00
alesapin
91453fe4d6
Merge pull request #35759 from chen9t/fix_dirty_metacache
Clean dirty meta cache when part is broken during part loading phase
2022-04-03 13:33:46 +02:00
Azat Khuzhin
3ce4844d4b Properly cancel the query after client format error
In case of format error (i.e. select 2 format Template settings
format_template_row='/dev/null') the client will reset the connection,
since it will not expect Data blocks.

To fix this, catch this client error and properly cancel the query. This
should also fix query hang checks (the one that executed after each test).

v2: use getCurrentExceptionMessage()/getCurrentExceptionCode()
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-04-03 14:01:16 +03:00
Alexey Milovidov
808c802cae Disable session_log 2022-04-03 05:07:37 +02:00
Alexey Milovidov
7c3227adc5
Merge pull request #35870 from ClickHouse/update-examples-in-config
Update examples and remove obsolete embedded dictionaries from configs
2022-04-03 05:55:19 +03:00
Alexey Milovidov
6780cd2d82 Update URL in test visualizer 2022-04-03 04:53:59 +02:00