Commit Graph

13806 Commits

Author SHA1 Message Date
Han Fei
e70dc7d507 improve move_primary_key_columns_to_end_of_prewhere 2023-08-11 17:36:52 +02:00
SmitaRKulkarni
cd77406fba
Bug fix for checksum of compress marks (#51777)
* add a test for cmrk and cidx checksums

* Bug fix for checksum of compress marks

* Fixed issue with .cidx checksum

* Fixed style check

* Updated 02253_empty_part_checksums.reference file with part details output

* Update 02253_empty_part_checksums.sh

* Updated to check is_compressed flag instead of size

* Update 02253_empty_part_checksums.sh

---------

Co-authored-by: Alexander Tokmakov <tavplubix@clickhouse.com>
2023-08-08 17:55:07 +03:00
vdimir
3f915491f0
Merge pull request #53046 from canhld94/ch_fix_direct_hash_join 2023-08-08 11:55:17 +02:00
robot-ch-test-poll
066dd8a2e8
Merge pull request #52949 from CurtizJ/fix-nested-array-lowcardinality
Fix reading of empty `Nested(Array(LowCardinality(...)))`
2023-08-07 23:32:25 +02:00
Sean Haynes
77dd869414
Add ability to log when max_partitions_per_insert_block is reached (#50948)
* Add ability to log when max_partitions_per_insert_block is reached

There's plenty of reasons to drop max_partitions_per_insert_block
down from it's default of 100, with the main one being even touching
remotely close to this number of partitions will create a lot of
merge activity that can de-stabilise a cluster.

This commit adds the ability to log when the above limit is reached
rather than throw an exception, so that you can gauge the impact on
users when dropping this value down.

* Update docs/ru/operations/settings/query-complexity.md

Co-authored-by: Nikita Taranov <nickita.taranov@gmail.com>

* Update docs/ru/operations/settings/query-complexity.md

Co-authored-by: Nikita Taranov <nickita.taranov@gmail.com>

* Update docs/ru/operations/settings/query-complexity.md

Co-authored-by: Nikita Taranov <nickita.taranov@gmail.com>

---------

Co-authored-by: Nikita Taranov <nickita.taranov@gmail.com>
2023-08-07 23:28:19 +02:00
Azat Khuzhin
2f414950b7
Fix logging for asynchronous non-batched distributed sends (#52583)
Before you may see the following:

  2023.07.25 09:21:39.705559 [ 692 ] {6b5e1299-1b64-4dbb-b25d-45e10027db22} <Trace> test_hkt5nnqj.dist_opentelemetry.DirectoryMonitor.default: Finished processing `` (took 37 ms)

Because file_path and current_file are the references to the same
variable in DistributedAsyncInsertDirectoryQueue::processFile().

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-08-07 20:57:42 +02:00
Duc Canh Le
cd02980130
Merge branch 'master' into ch_fix_direct_hash_join 2023-08-07 22:20:29 +08:00
Anton Popov
981da23144 fix reading of empty Nested(Array(...)) 2023-08-07 12:32:12 +00:00
SmitaRKulkarni
75f81bdc44
Merge pull request #50795 from ClickHouse/azure_table_function_cluster
Table function azureBlobStorageCluster
2023-08-07 09:16:52 +02:00
Duc Canh Le
ed2a1d7c9b select required columns when getting join 2023-08-07 03:15:20 +00:00
Antonio Andelic
cafa5ef2f3 Merge branch 'master' into add-reading-from-archives 2023-08-06 10:21:47 +00:00
Antonio Andelic
1d793e69f2 Fix 2023-08-05 17:06:44 +00:00
SmitaRKulkarni
1e3ae89161
Merge branch 'master' into azure_table_function_cluster 2023-08-04 21:39:32 +02:00
Anton Popov
991abde851 fix reading of empty Nested(Array(...)) 2023-08-04 13:10:50 +00:00
Antonio Andelic
d2b6646fc2 Merge branch 'master' into add-reading-from-archives 2023-08-04 12:42:46 +00:00
Duc Canh Le
8aaa46ca90 StorageJoin: do not create clone hash join with all columns 2023-08-04 11:07:33 +00:00
Kruglov Pavel
b1fe9ce8f7
Merge branch 'master' into formats-with-subcolumns 2023-08-04 13:01:12 +02:00
Antonio Andelic
d4d93331dd Merge branch 'master' into add-reading-from-archives 2023-08-04 09:00:20 +00:00
Vitaly Baranov
587877dba3
Merge branch 'master' into disable-fs-cache-for-backups 2023-08-04 01:15:23 +02:00
Alexander Tokmakov
968c79cf3f
Merge pull request #52956 from ClickHouse/fixes_for_databases
Fix some issues with databases
2023-08-03 19:13:41 +03:00
Kseniia Sumarokova
68b48a0bc0
Merge pull request #50063 from KevinyhZou/minor_improve_hdfs_read_buffer
Minor improve HDFS ReadBuffer for read end of file
2023-08-03 17:55:48 +02:00
avogar
f0eb22ac5f Fix build for S3Queue 2023-08-03 14:20:19 +00:00
Anton Popov
92cb5e9ae3
Merge pull request #52687 from alkorgun/fix-named-collections-on-cluster-23.7
Fix named collections on cluster 23.7
2023-08-03 14:50:28 +02:00
Smita Kulkarni
2a681f1577 Removed unused function and fixed build after merge 2023-08-03 14:32:03 +02:00
Smita Kulkarni
68a10e7cae Merge branch 'master' into azure_table_function_cluster 2023-08-03 13:59:59 +02:00
Vitaly Baranov
e127d27453 Disable using fs cache for backup/restore #2. 2023-08-03 13:52:35 +02:00
Vitaly Baranov
f427c779eb Disable using fs cache for backup/restore. 2023-08-03 13:52:32 +02:00
Antonio Andelic
d9f136ce0c Add tests for globs 2023-08-03 10:42:47 +00:00
Alexander Tokmakov
7684e68008
Add system stop pulling replication log (#52881)
* add system stop pulling replication log

* add const

* fix another stupid test

* Update test.py
2023-08-03 13:34:43 +03:00
Alexander Tokmakov
9e0d27dc4d
don't create empty parts on drop partittion if we have a transaction (#52945) 2023-08-03 13:16:32 +03:00
Nikolai Kochetov
5d64e036ba
Merge pull request #52695 from yariks5s/in_schema_case_sensitiveness
Information_schema case sensitiveness
2023-08-03 12:15:31 +02:00
Smita Kulkarni
5cdc50b9ba Fixed style 2023-08-03 11:31:15 +02:00
Kseniia Sumarokova
73ac1bf84f
Merge branch 'master' into minor_improve_hdfs_read_buffer 2023-08-03 10:56:24 +02:00
Antonio Andelic
96bad0537a Merge branch 'master' into add-reading-from-archives 2023-08-03 08:36:42 +00:00
Alexander Tokmakov
48d736f8fd select only required columns from system.databases 2023-08-02 23:23:52 +02:00
Azat Khuzhin
cd74da4c03 Remove unused code in StorageSystemStackTrace
This columns mask is actually useless, since the main thing is done
without out, in particular:
- detect does the signal should be sent to thread
- does the thread name should be read for this thread

And this cannot be done with columns mask, because multiple columns
depends on signals and thread names.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-08-02 21:25:00 +02:00
Anton Popov
d43e76b147 fix reading of empty Nested(Array(LowCardinality(...))) 2023-08-02 16:48:08 +00:00
Nikolai Kochetov
b3bc3e89b6
Merge pull request #52837 from ClickHouse/cleanup-local-backup
Cleanup localBackup
2023-08-02 17:10:36 +02:00
Anton Popov
ff137773e7
Merge branch 'master' into formats-with-subcolumns 2023-08-02 15:24:56 +02:00
Smita Kulkarni
2c47679918 Merge branch 'master' into azure_table_function_cluster 2023-08-02 14:19:45 +02:00
Yarik Briukhovetskyi
e811d5c4e9
Update attachInformationSchemaTables.cpp 2023-08-02 14:06:20 +02:00
Yarik Briukhovetskyi
dab77b044b
Update attachInformationSchemaTables.cpp 2023-08-02 13:23:18 +02:00
yariks5s
0174244fe1 fixed tests 2023-08-02 11:21:47 +00:00
Alexander Tokmakov
d8da47520b
Merge branch 'master' into fix_mutations_with_transactions 2023-08-02 13:56:59 +03:00
Kseniia Sumarokova
8180474e71
Merge branch 'master' into minor_improve_hdfs_read_buffer 2023-08-02 11:57:41 +02:00
Kseniia Sumarokova
a3dd2e5c2f
Merge pull request #48424 from ClickHouse/kssenii-patch-6
Fix outdated cache configuration in s3 tests: s3_storage_policy_by_defau…
2023-08-02 11:38:57 +02:00
Antonio Andelic
9423976b7a Add support for file globs 2023-08-02 07:42:56 +00:00
Alexander Tokmakov
d6a2c631da fix assertion in mutations with transactions 2023-08-01 21:16:22 +02:00
yariks5s
6db7eaf4d8 fixed ast 2023-08-01 19:14:11 +00:00
Antonio Andelic
2430ebabf5 Merge branch 'master' into add-reading-from-archives 2023-08-01 17:22:38 +00:00