Commit Graph

131602 Commits

Author SHA1 Message Date
Alexey Milovidov
35e27ab1a3
Merge pull request #58213 from azat/tests/processes-cleanup-v2
Fix leftover processes/hangs in tests (resubmit)
2023-12-25 05:07:43 +01:00
Alexey Milovidov
9196c2b994 Follow-up 2023-12-25 04:54:54 +01:00
Alexey Milovidov
c2f93ecf4d
Merge pull request #58211 from ClickHouse/binary-viewer
Binary (symbols) viewer
2023-12-25 04:52:57 +01:00
Nikolay Degterinsky
98a6d67ae3 Disable tests with CREATE AS SELECT for database Replicated 2023-12-24 23:49:26 +00:00
Nikolay Degterinsky
d524951416
Merge pull request #58198 from azat/exception-fmt
Fix all Exception with missing arguments
2023-12-25 00:40:18 +01:00
Azat Khuzhin
3be3b0a280 Fix incorrect Exceptions
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-12-24 21:26:32 +01:00
Azat Khuzhin
435e1de7b0 Remove Exception's ctor to create it from a simple string-like object
This may cause troubles, like forgetting to pass arguments, and there
are few places in the code (see the upcomming patch).

I doubt that this will make any performance changes, since the check
should be compile time.

And anyway Exception is an exceptional situation which should be rare
(there is no such code with single argument for logging, while logging
is more common).

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-12-24 21:26:31 +01:00
Nikolay Degterinsky
033fb14a2a Merge remote-tracking branch 'upstream/master' into replicated-database-forbid-create-as-select 2023-12-24 20:07:12 +00:00
Kevin Mingtarja
807d815df1 Merge branch 'master' into optimize-long-and-notequals-chain 2023-12-24 18:49:30 +00:00
Kevin Mingtarja
5416bd6e93 Add optimization for AND notEquals chain to NOT IN 2023-12-24 13:26:41 +00:00
Azat Khuzhin
c5dbde8407 Replace timeout --foreground with one workaround
The problem with --foreground option is that it send the signal only to
the process that had been spawned by timeout(1), while it can create
lots of children, and when you killing parent you are closing pipes and
childrens will get EPIPE, like in [1].

  [1]: https://s3.amazonaws.com/clickhouse-test-reports/0/069f8bbb2f48541cc736903e1da5459fa2c27da0/stateless_tests__debug__%5B2_5%5D.html

Another problem is that now child process will finish correctly, which
may also print some errors like QUERY_WAS_CANCELLED (see [2]).

  [2]: https://s3.amazonaws.com/clickhouse-test-reports/0/ef66714bf20042ba9cb5d59b7839befe26110b93/stateless_tests__release__analyzer_.html

In general this is not required actually, since all timeout invocations
uses timeout value less then the default test limit (10min). But it may
leave some processes in case of overriding this limit, i.e.
`clickhouse-test --timeout 1`

So to workaround this at least somehow, let's send SIGTERM and only
after some timeout (here I use 0.1), SIGKILL. This will give at least
some ability to terminate all childrens that had been spawned by
timeout(1).

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-12-24 13:23:09 +01:00
Pradeep Chhetri
1ed19fc8b1 Add test 2023-12-24 19:59:14 +08:00
Alexey Milovidov
325ccacc45
Merge pull request #58208 from ClickHouse/dbase
Fix DWARFBlockInputFormat using wrong base address sometimes
2023-12-24 12:33:21 +01:00
Alexey Milovidov
6eaa17d5a4
Merge pull request #58206 from ClickHouse/fix-error-in-archive-reader
Fix error in archive reader
2023-12-24 12:32:49 +01:00
Alexey Milovidov
658336f674 Add documentation 2023-12-24 12:22:31 +01:00
Alexey Milovidov
7c18530a8c Add a test 2023-12-24 12:19:31 +01:00
Alexey Milovidov
0e89d01b94 Binary (symbols) viewer 2023-12-24 12:14:45 +01:00
Pradeep Chhetri
5899ee99bd Add support for specifying query parameters in the command line in clickhouse-local 2023-12-24 18:07:26 +08:00
Azat Khuzhin
1fdee81ad5 Fix leftover processes/hangs in tests
One of such cases is 02479_race_condition_between_insert_and_droppin_mv
[1], yes it can be fixed (by using fixed number of iterations, or with
some bash trickery), but it is better to fix them completelly,
eventually such tests will be submitted and pass review anyway.

By allocating process group for each test we can kill all the processes
in this process group, and this what this patch does.

This will also fix some test hangs (like in [1]) as well as some
possible issues in stress tests.

  [1]: https://s3.amazonaws.com/clickhouse-test-reports/0/e2c1230b00386c4d0096a245396ab3be7ce60950/stateless_tests__release__analyzer_/run.log

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
(cherry picked from commit 72fa58e192)
2023-12-24 09:43:58 +01:00
Michael Kolupaev
a3f204cb7e Fix base address for ranges 2023-12-24 05:14:34 +00:00
Alexey Milovidov
f459a2b0c9
Merge pull request #58207 from ClickHouse/revert-58200-tests/processes-cleanup
Revert "Fix leftover processes/hangs in tests"
2023-12-24 05:57:53 +01:00
Alexey Milovidov
71c5ae548f
Revert "Fix leftover processes/hangs in tests" 2023-12-24 07:57:43 +03:00
Alexey Milovidov
f582a9b39c Add a test 2023-12-24 05:55:53 +01:00
Alexey Milovidov
ae51334ba5 Merge branch 'master' into fix-error-in-archive-reader 2023-12-24 05:53:22 +01:00
Alexey Milovidov
e98c49a58f Fix a benign error in archive reader 2023-12-24 05:44:24 +01:00
Alexey Milovidov
1054118607
Merge pull request #58133 from ClickHouse/parallel-replicas-in-subquery
Disable parallel replicas with IN (subquery)
2023-12-24 05:03:35 +01:00
Alexey Milovidov
3f4c8e4ae8
Merge pull request #58167 from jrdi/part-log-uncompressed-bytes
Add bytes_uncompressed to system.part_log
2023-12-24 04:11:35 +01:00
Alexey Milovidov
b4bf1d1c4c
Merge pull request #58136 from azat/system.stack_trace-rt_tgsigqueueinfo-v2
Fix system.stack_trace for threads with blocked SIGRTMIN (resubmit)
2023-12-24 03:51:13 +01:00
Alexey Milovidov
4f3f69521d
Merge pull request #58173 from ClickHouse/parallel-replicas-used-count
Profile event 'ParallelReplicasUsedCount'
2023-12-24 03:46:09 +01:00
Alexey Milovidov
00fa9085b1
Merge pull request #58178 from chhetripradeep/add-base-backup-name-to-system-tables
Add base backup name to system.backups and system.backup_log tables
2023-12-24 03:38:20 +01:00
Alexey Milovidov
ef66714bf2
Merge pull request #58196 from ClickHouse/strange-code
Looking at strange code
2023-12-24 03:36:41 +01:00
Alexey Milovidov
069f8bbb2f
Merge pull request #58200 from azat/tests/processes-cleanup
Fix leftover processes/hangs in tests
2023-12-24 03:34:06 +01:00
Alexey Milovidov
2544e4697f
Merge pull request #58204 from ClickHouse/df5
Fix DWARFBlockInputFormat failing on DWARF 5 unit address ranges
2023-12-24 03:31:13 +01:00
Alexey Milovidov
817d0c6553
Merge pull request #58202 from vitlibar/explicit-finalize-in-zip-archive-writer
Explicit finalize in ZipArchiveWriter
2023-12-24 03:30:21 +01:00
Vitaly Baranov
e1a136b791 Explicit finalize() function in ZipArchiveWriter.
Simplify too complicated code in ZipArchiveWriter.
2023-12-24 00:33:59 +01:00
Michael Kolupaev
172687f53a Fix DWARFBlockInputFormat failing on DWARF 5 unit address ranges 2023-12-23 21:43:37 +00:00
Jordi Villar
f713e28438 Sorting is difficult 2023-12-23 19:07:17 +01:00
Kruglov Pavel
54320ae19a
Fix typo 2023-12-23 18:27:44 +01:00
Jordi Villar
01289411da Let's order by part name to avoid flakiness 2023-12-23 17:33:35 +01:00
Azat Khuzhin
72fa58e192 Fix leftover processes/hangs in tests
One of such cases is 02479_race_condition_between_insert_and_droppin_mv
[1], yes it can be fixed (by using fixed number of iterations, or with
some bash trickery), but it is better to fix them completelly,
eventually such tests will be submitted and pass review anyway.

By allocating process group for each test we can kill all the processes
in this process group, and this what this patch does.

This will also fix some test hangs (like in [1]) as well as some
possible issues in stress tests.

  [1]: https://s3.amazonaws.com/clickhouse-test-reports/0/e2c1230b00386c4d0096a245396ab3be7ce60950/stateless_tests__release__analyzer_/run.log

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-12-23 16:40:33 +01:00
Jordi Villar
56e7965d8d Try to fix tests for the CI 2023-12-23 15:37:38 +01:00
Nikolay Degterinsky
a30980c930
Merge pull request #58139 from zvonand/zvonand-issue-53190
Fix `accurateCastOrNull` for out-of-range DateTime
2023-12-23 14:52:59 +01:00
Azat Khuzhin
2f6c0487ad Ignore ENOENT for SigBlk check for system.stack_trace
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-12-23 14:35:38 +01:00
Azat Khuzhin
ac542199c5 Add some comments about racy code for system.stack_trace
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-12-23 13:42:26 +01:00
Alexey Milovidov
d0ca383bca
Merge pull request #58095 from azat/metrics/max-rss
Add max/peak RSS into system.asynchronous_metrics
2023-12-23 13:13:44 +01:00
Alexey Milovidov
6bb181ce55 Looking at strange code 2023-12-23 13:06:34 +01:00
Igor Nikonov
3c85042679 Fix typo 2023-12-23 12:05:02 +00:00
Igor Nikonov
2894ad06fd Merge remote-tracking branch 'origin/master' into parallel-replicas-in-subquery 2023-12-23 11:44:45 +00:00
Igor Nikonov
701c8ac9ba Cleanup & comments 2023-12-23 11:44:02 +00:00
Igor Nikonov
d644a208bf Merge remote-tracking branch 'origin/master' into parallel-replicas-used-count 2023-12-23 11:02:28 +00:00