Commit Graph

127318 Commits

Author SHA1 Message Date
Robert Schulze
04272fa481
Convert unnecessary std::scoped_lock to std::lock_guard 2023-10-25 09:26:16 +00:00
Salvatore Mesoraca
0bda99e880
Fix code style 2023-10-25 11:07:34 +02:00
Robert Schulze
665dfe6135
Merge pull request #55278 from kitaisreal/context-added-tsa
Context added TSA
2023-10-25 10:41:00 +02:00
Robert Schulze
975f954a26
Merge pull request #54629 from aiven-sal/aiven-sal/cast2
Re-add fix for accurateCastOrNull
2023-10-25 10:31:40 +02:00
Raúl Marín
bee9eb5df4
Merge pull request #55962 from Algunenano/show_databases_limit
Fix `SHOW DATABASES LIMIT <N>`
2023-10-25 10:27:43 +02:00
Robert Schulze
3f30342bc7
Add isInt() convenience function 2023-10-25 08:12:34 +00:00
Salvatore Mesoraca
a95a2a5d66
formatQueryOneLine: create new function format queries on one line 2023-10-25 10:10:04 +02:00
Robert Schulze
9838e0ce3a
Update docs 2023-10-25 08:01:57 +00:00
Robert Schulze
46d34a412f
Fix style 2023-10-25 07:56:10 +00:00
jetgm
ca766e3033 update doc and change order by 2023-10-25 11:08:25 +08:00
robot-ch-test-poll1
ef78889aa2
Merge pull request #55952 from ClickHouse/disable_apply_deleted_mask
Added a setting to allow reading rows marked as deleted
2023-10-25 01:14:07 +02:00
MeenaRenganathan22
d378e10a4d Fixed the sytle check 2023-10-24 14:09:46 -07:00
avogar
c080ba9d7e Fix output LowCardinality as Arrow dictionary 2023-10-24 19:49:04 +00:00
Andrey Zvonov
22cab68524
Merge branch 'ClickHouse:master' into zvonand-parsing-dt64-fix 2023-10-24 21:10:57 +02:00
李扬
465962df7f
Support orc filter push down (file + stripe + rowgroup level) (#55330)
* support orc filter push down

* update orc lib version

* replace setqueryinfo with setkeycondition

* fix issue https://github.com/ClickHouse/ClickHouse/issues/53536

* refactor source with key condition

* fix building error

* remove std::cout

* update orc

* update orc version

* fix bugs

* improve code

* upgrade orc lib

* fix code style

* change as requested

* add performance tests for orc filter push down

* add performance tests for orc filter push down

* fix all bugs

* fix default as null issue

* add uts for null as default issues

* upgrade orc lib

* fix failed orc lib uts and fix typo

* fix failed uts

* fix failed uts

* fix ast fuzzer tests

* fix bug of uint64 overflow in https://s3.amazonaws.com/clickhouse-test-reports/55330/de22fdcaea2e12c96f300e95f59beba84401712d/fuzzer_astfuzzerubsan/report.html

* fix asan fatal caused by reused column vector batch in native orc input format. refer to https://s3.amazonaws.com/clickhouse-test-reports/55330/be39d23af2d7e27f5ec7f168947cf75aeaabf674/stateless_tests__asan__[4_4].htm

* fix wrong performance tests

* disable 02892_orc_filter_pushdown on aarch64. https://s3.amazonaws.com/clickhouse-test-reports/55330/be39d23af2d7e27f5ec7f168947cf75aeaabf674/stateless_tests__aarch64_.html

* add some comments

* add some comments

* inline range::equals and range::less

* fix data race of key condition

* trigger ci
2023-10-24 12:08:17 -07:00
Robert Schulze
57df56733f
Merge pull request #55963 from rschu1ze/bump-protobuf
Bump protobuf to v3.19.6
2023-10-24 19:20:30 +02:00
AN
f8348681aa
Update architecture.md
Russian language fixes (hyphens in compounds, tautologies etc.), term unification («column» → «столбец», а было то «столбец», то «колонка», «строка/столбец» is traditional translation for ‘row/column‘ in translations (see translations of Date)
2023-10-24 19:47:27 +03:00
Maksim Kita
0e176fa0ed Fixed code review issues 2023-10-24 19:39:25 +03:00
Sergei Trifonov
8f3eb23f3c
Merge pull request #55956 from bigo-sg/json_seder_skip_null
Allow skip null values when serailize tuple to json objects
2023-10-24 18:32:01 +02:00
Robert Schulze
f94c33586c
Fix issue #42966 2023-10-24 15:14:20 +00:00
xuzifu666
010cc6918a
Add get_direct_children_number command to keeper-client (#55898) 2023-10-24 17:02:54 +02:00
Robert Schulze
1375733643
Merge pull request #55955 from rschu1ze/test-bug-43644
Test for Bug 43644
2023-10-24 16:16:52 +02:00
Robert Schulze
0955107e8e
Merge pull request #55948 from rschu1ze/arrayFold-switch-args
arrayFold: Switch accumulator and array arguments
2023-10-24 16:16:02 +02:00
Salvatore Mesoraca
2d2eaceb77
formatQuery: move doc 2023-10-24 16:13:15 +02:00
Salvatore Mesoraca
3e0b6eb77b
formatQuery: validate args using helper function 2023-10-24 16:10:43 +02:00
Azat Khuzhin
66c4a3bdbc tests: more robust 02903_rmt_retriable_merge_exception
- separate uuid extraction
- add preliminary exit
- disable for ordinary database
- less number of attempts
- add optimize_throw_if_noop and missing sync replica, to fix:

  2023.10.24 15:18:35.925533 [ 640 ] {da7418c6-3d51-45bc-a0d0-4970bb0cdd51} <Debug> test_3kgjgry1.rmt1 (d18afb81-3a4b-4c02-b281-5575dce2f440): Cannot select parts for optimization: Entry for part all_1_1_0 hasn't been read from the replication log yet (in partition all)

- fix in case of ZooKeeper retries

  2023.10.24 11:50:24.792511 [ 1437 ] {c39fd15b-e2e6-4291-9912-39fda75ebcd5} <Trace> test_qxkzmigq.rmt1 (1c086c74-9ebe-495c-bbd2-87ab2d8ec43d): Renaming temporary part tmp_insert_all_1_1_0 to all_1_1_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000).
  2023.10.24 11:50:24.797320 [ 1437 ] {c39fd15b-e2e6-4291-9912-39fda75ebcd5} <Trace> test_qxkzmigq.rmt1 (1c086c74-9ebe-495c-bbd2-87ab2d8ec43d) (Replicated OutputStream): ZooKeeperWithFaultInjection call FAILED: seed=17644626169032325693 func=tryMulti path=/clickhouse/zero_copy code=Session expired message=Fault injection before operation
  2023.10.24 11:50:24.797536 [ 1437 ] {c39fd15b-e2e6-4291-9912-39fda75ebcd5} <Debug> test_qxkzmigq.rmt1 (1c086c74-9ebe-495c-bbd2-87ab2d8ec43d): Undoing transaction. Rollbacking parts state to temporary and removing from working set: all_1_1_0.
  ...
  2023.10.24 11:50:25.000349 [ 1437 ] {c39fd15b-e2e6-4291-9912-39fda75ebcd5} <Trace> test_qxkzmigq.rmt1 (1c086c74-9ebe-495c-bbd2-87ab2d8ec43d): Renaming temporary part tmp_insert_all_1_1_0 to all_2_2_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000).
  2023.10.24 11:50:25.007477 [ 760 ] {} <Trace> test_qxkzmigq.rmt1 (ReplicatedMergeTreeQueue): Insert entry queue-0000000000 to queue with type GET_PART with virtual parts [all_2_2_0]

CI:
- https://s3.amazonaws.com/clickhouse-test-reports/55944/da408df4a7296835897d7cef80d63f252df79b75/stateless_tests__tsan__s3_storage__[2_5].html
- https://s3.amazonaws.com/clickhouse-test-reports/55944/da408df4a7296835897d7cef80d63f252df79b75/stateless_tests_flaky_check__asan_.html
- https://s3.amazonaws.com/clickhouse-test-reports/55944/02fdd0513f7d413ce4ac39a70566855327ebfade/stateless_tests__aarch64_.html
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-10-24 16:03:57 +02:00
Andrey Zvonov
b5e7955298
Merge branch 'ClickHouse:master' into zvonand-parsing-dt64-fix 2023-10-24 16:02:38 +02:00
Salvatore Mesoraca
457e7ba7bd
formatQuery: improve doc 2023-10-24 15:38:24 +02:00
Salvatore Mesoraca
6be7fd0fa1
Ignore formatQuery word during spell check 2023-10-24 15:38:24 +02:00
Salvatore Mesoraca
1380dc942e
Add formatQuery function 2023-10-24 15:38:24 +02:00
Salvatore Mesoraca
7e8dac6064
Fix logic 2023-10-24 15:36:17 +02:00
Salvatore Mesoraca
fdabea6158
clickhouse-client: don't show "0 rows in set" if it is zero and if exception was thrown 2023-10-24 15:36:14 +02:00
Alexander Gololobov
40062ca210
Fix test 2023-10-24 15:30:32 +02:00
MeenaRenganathan22
2ec9433b4e S390x by default uses openssl. So, the error message is different from boringSSL. Update the tets to match the error message 2023-10-24 06:10:11 -07:00
Alexander Tokmakov
2619eecd2f
Merge pull request #55890 from ClickHouse/tavplubix-patch-9
Update stress.py
2023-10-24 14:58:22 +02:00
Kruglov Pavel
62b154930a
Merge pull request #53504 from filimonov/ignore_max_distributed_connections_for_async_remote
Disable logic max_threads=max_distributed_connections when async_socket_for_remote=1
2023-10-24 14:15:21 +02:00
Kruglov Pavel
cb63b07e89
Merge pull request #55912 from wxybear/fix/storage_null_supports_subcolumns
fix: StorageNull supports subcolumns
2023-10-24 14:03:46 +02:00
Alexander Gololobov
04b82d6463
Merge pull request #55935 from ClickHouse/set_has_lwd
Set storage.has_lightweight_delete_parts flag when a part has been loaded
2023-10-24 14:01:11 +02:00
Kruglov Pavel
9a56ec4d63
Merge pull request #55891 from Avogar/try-fix-orc
Try to fix possible segfault in Native ORC input format
2023-10-24 13:57:43 +02:00
Azat Khuzhin
ff7e9e16d5 Fix possible performance test error
CI [1]:

    2023-10-24 12:18:27	 ++ rg -c array_fill.xml changed-test-definitions.txt
    2023-10-24 12:18:27	 + '[' '' -gt 0 ']'
    2023-10-24 12:18:27	 right/scripts/compare.sh: line 288: [: : integer expression expected

  [1]: https://s3.amazonaws.com/clickhouse-test-reports/55944/da408df4a7296835897d7cef80d63f252df79b75/performance_comparison_[2_4]/compare.log

v1: use --include-zero
v2: revert to grep
v3: check exit code
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-10-24 13:51:57 +02:00
Kruglov Pavel
9f4f851505
Merge pull request #55899 from srikanthccv/issue-55023
Introduce setting `create_table_empty_primary_key_by_default`
2023-10-24 13:47:23 +02:00
Alexander Gololobov
ab8fe68571
Update tests/queries/0_stateless/02902_diable_apply_deleted_mask.sql
Co-authored-by: SmitaRKulkarni <Smita.Kulkarni@clickhouse.com>
2023-10-24 13:45:27 +02:00
Alexander Gololobov
247722d44e
Update tests/queries/0_stateless/02902_diable_apply_deleted_mask.sql
Co-authored-by: SmitaRKulkarni <Smita.Kulkarni@clickhouse.com>
2023-10-24 13:45:19 +02:00
Alexander Gololobov
837637caa6
Fix typo
Co-authored-by: SmitaRKulkarni <Smita.Kulkarni@clickhouse.com>
2023-10-24 13:45:01 +02:00
Salvatore Mesoraca
4cf17dc50a
Add other fuzzer tests 2023-10-24 13:36:56 +02:00
Salvatore Mesoraca
6b7b3a641f
Fix more fuzzying issues 2023-10-24 13:36:56 +02:00
Salvatore Mesoraca
471fe28165
Improve tests 2023-10-24 13:36:56 +02:00
Salvatore Mesoraca
22ae8731f2
Handle the case when bool serialization generates incorrect values on failure
Fix issue found by fuzzer
2023-10-24 13:36:55 +02:00
Salvatore Mesoraca
36da379b93
Revert "Add stronger exception guarantees to bool serialization"
This reverts commit 62d06a0a4cd39344b41b90300b772299f9719924.
2023-10-24 13:36:55 +02:00
Salvatore Mesoraca
f417de4820
Add tests for issue found fuzzing 2023-10-24 13:36:55 +02:00