Commit Graph

13674 Commits

Author SHA1 Message Date
Nikolai Kochetov
01cb502af3
Merge pull request #52151 from amosbird/fix_52075
Fix incorrect projection analysis when aggregation expression contains monotonic functions
2023-07-21 18:30:27 +02:00
Alexander Sapin
a2b170a18e Avoid exception which I didn't understand 2023-07-21 17:42:55 +02:00
Antonio Andelic
6ed97a944f
Merge pull request #49450 from myrrc/feature/keeper-dyn-reconf
`reconfig` support for CH Keeper
2023-07-21 15:59:25 +02:00
Nikolai Kochetov
b5cf644668
Check projection metadata the same way we check ordinary metadata. (#52361)
* Check projection metadata the same way we check ordinary metadata.

* Allow aggregate projection to have empty PK

---------

Co-authored-by: Alexander Tokmakov <tavplubix@clickhouse.com>
2023-07-21 16:23:04 +03:00
robot-clickhouse-ci-2
0db9c79886
Merge pull request #52332 from rschu1ze/better-formatsettings
Minor: Less awkward IAST::FormatSettings
2023-07-21 14:49:58 +02:00
robot-ch-test-poll4
62e01df545
Merge pull request #52104 from filimonov/last_removal_attempt_time_typo
Fix typo last_removal_attemp_time
2023-07-21 14:49:36 +02:00
Alexey Milovidov
dc0abd38a9
Merge pull request #52376 from Algunenano/hot_cold_zero_copy
[RFC] Wait for zero copy replication lock even if some disks don't support it
2023-07-21 15:28:41 +03:00
Antonio Andelic
59ad2d9acc
Merge branch 'master' into feature/keeper-dyn-reconf 2023-07-21 14:08:26 +02:00
Alexander Tokmakov
d9161c7276
Merge pull request #52382 from ClickHouse/tavplubix-patch-8
Less replication errors
2023-07-21 14:58:25 +03:00
Kseniia Sumarokova
1c2fea4980
Merge pull request #52381 from ClickHouse/kssenii-patch-7
Follow up to #49698
2023-07-21 13:51:33 +02:00
Antonio Andelic
10c2d5dade
Merge branch 'master' into feature/keeper-dyn-reconf 2023-07-21 13:24:18 +02:00
Alexander Sapin
714a3a8d12 Don't do it on drop 2023-07-21 12:23:22 +02:00
Amos Bird
68e7583dbf
reorganize tests and add some comments 2023-07-21 14:54:51 +08:00
Amos Bird
9b0eb9cdd7
ignore ast opt when doing projection calc 2023-07-21 14:54:48 +08:00
Alexander Gololobov
fe7cff5c1c Added move_primary_key_columns_to_end_of_prewhere setting 2023-07-21 08:14:57 +02:00
Alexander Gololobov
51e81b37a4 Move condtions with columns from PK to the end of PREWHERE chain 2023-07-21 08:14:57 +02:00
Alexander Gololobov
06c1e686a4
Merge pull request #46365 from ClickHouse/split_prewhere_dag_test_enable
Multi-stage PREWHERE enabled by default
2023-07-21 08:13:55 +02:00
Alexander Tokmakov
09e6bbc0e2
Update DataPartsExchange.cpp 2023-07-20 21:10:59 +03:00
Kseniia Sumarokova
045ecdf71f
Update src/Storages/PostgreSQL/MaterializedPostgreSQLConsumer.cpp
Co-authored-by: Alexander Tokmakov <tavplubix@clickhouse.com>
2023-07-20 19:03:06 +02:00
Kseniia Sumarokova
500f1e6757
Follow up to #49698 2023-07-20 18:55:41 +02:00
kssenii
d2195cff11 Small fixes 2023-07-20 18:21:37 +02:00
Raúl Marín
13f8d72f54 Wait for zero copy replication lock even if some disks don't support it 2023-07-20 18:04:26 +02:00
robot-ch-test-poll
21f22c4043
Merge pull request #49698 from kssenii/fix-pg-sync-tables-exception-broken-sync
Fix materialised pg syncTables
2023-07-20 15:38:18 +02:00
Nikita Mikhaylov
668062dc29
Merge branch 'master' into no-keep-context-lock-while-calculating-access 2023-07-20 14:42:13 +02:00
avogar
fe934d3059 Make better 2023-07-20 12:38:41 +00:00
Nikita Mikhaylov
b8f73db4d1
Merge branch 'master' into happy_grandma 2023-07-20 14:26:31 +02:00
Alexander Tokmakov
2b29e3dc83
Update MergeTreeBackgroundExecutor.cpp (#52261) 2023-07-20 14:22:22 +03:00
Robert Schulze
bd761c365a
Make serializeAST() more regular 2023-07-20 10:39:26 +00:00
Alexander Gololobov
03a890f91c
Merge branch 'master' into filter_system_databases 2023-07-20 12:38:15 +02:00
Robert Schulze
25ddcc256b
Make IAST::FormatSettings more regular, pt. III 2023-07-20 10:34:05 +00:00
Robert Schulze
9933589c56
Merge pull request #52312 from rschu1ze/beautify-system-query-cache
Beautify pretty-printing of the query string in SYSTEM.QUERY_CACHE
2023-07-20 12:20:04 +02:00
Nikita Mikhaylov
ec20786940
Merge pull request #52347 from vitlibar/zooKeeper-retries-control-rethrows-with-original-callstack
ZooKeeperRetriesControl rethrows with original callstack
2023-07-20 12:14:04 +02:00
Vitaly Baranov
27ca367b2c ZooKeeperRetriesControl rethrows with original callstack. 2023-07-20 10:25:38 +02:00
avogar
2b8e4ebd4c Allow to disable decoding/encoding path in uri in URL engine 2023-07-19 19:48:39 +00:00
Alexander Sapin
544081163d Remove redundant deactivate 2023-07-19 17:21:01 +02:00
Han Fei
6bbdf702ae
Merge branch 'master' into hanfei/support-insert-token 2023-07-19 17:05:12 +02:00
alesapin
b34655e743
Update src/Storages/StorageReplicatedMergeTree.cpp
Co-authored-by: Alexander Tokmakov <tavplubix@clickhouse.com>
2023-07-19 17:05:03 +02:00
Nikita Mikhaylov
4a3f5234af
Merge pull request #51038 from evillique/headers-blacklist
Add HTTP header filtering
2023-07-19 15:49:12 +02:00
Azat Khuzhin
53818dde8c MergeTree/ReplicatedMergeTree should use server timezone for log entries
Otherwise session_timezone/use_client_time_zone will break things

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-07-19 15:25:15 +02:00
Robert Schulze
3eb23d899f
Merge remote-tracking branch 'rschu1ze/master' into beautify-system-query-cache 2023-07-19 12:55:09 +00:00
alesapin
45a7134478
Merge branch 'master' into feature/keeper-dyn-reconf 2023-07-19 14:04:59 +02:00
alesapin
f8fa79c30f
Merge branch 'master' into fix_test_producing_no_such_key 2023-07-19 11:59:23 +02:00
xiedeyantu
d0e886070c system.events and system.metrics tables add column name as an alias to event and metric 2023-07-19 17:39:00 +08:00
Robert Schulze
f22452c78c
Beautify pretty-printing of the query string in SYSTEM.QUERY_CACHE.
Output of SYSTEM.QUERY_CACHE

- before this PR:

    SELECT * FROM system.query_cache

    Query id: 4989008b-b84c-4e57-bfe5-7fb551814812

    Row 1:
    ──────
    query:   	   SELECT 1 SETTINGS
    [...]

- after this PR:

    SELECT * FROM system.query_cache

    Query id: 4989008b-b84c-4e57-bfe5-7fb551814812

    Row 1:
    ──────
    query:   	   SELECT 1 SETTINGS use_query_cache = 1
    [...]
2023-07-19 09:10:26 +00:00
Sema Checherinda
ed5310ce48
Merge branch 'master' into last_removal_attempt_time_typo 2023-07-19 10:23:25 +02:00
Han Fei
e8be6ec23f
Merge branch 'master' into hanfei/support-insert-token 2023-07-19 10:06:03 +02:00
robot-clickhouse-ci-1
32b765a4ba
Merge pull request #50559 from zvonand/zvonand-issue-49290
Add support for multi-directory globs
2023-07-19 06:24:38 +02:00
Alexey Milovidov
d666272b76 Enable allow_vertical_merges_from_compact_to_wide_parts by default 2023-07-19 05:29:12 +02:00
Alexey Milovidov
6a61786959 Merge branch 'master' into sparse-columns-by-default 2023-07-19 01:07:59 +02:00
Kseniia Sumarokova
1545ad3389
Merge branch 'master' into fix-pg-sync-tables-exception-broken-sync 2023-07-18 23:19:01 +02:00
Alexey Milovidov
6fd27b6cd8 Fix build 2023-07-18 22:19:35 +02:00
Alexey Milovidov
8cd2e7c7d6 Merge branch 'master' into fix-potentially-bad-code 2023-07-18 22:18:22 +02:00
alesapin
0502a4c73e Set startup event during shutdown 2023-07-18 19:09:01 +02:00
alesapin
cf0b58a831
Merge pull request #52197 from ClickHouse/fix_sticky_mutations_test
Fix sticky mutations test (and extremely rare race condition)
2023-07-18 16:49:31 +02:00
avogar
3682254342 Fix hdfs tests 2023-07-18 13:49:23 +00:00
alesapin
24cf163e61 Merge branch 'master' into add_delay_for_replicated 2023-07-18 15:37:32 +02:00
alesapin
66531965f9
Merge pull request #52218 from ClickHouse/avoid_zero_copy
Use one copy replication more agressively
2023-07-18 14:46:52 +02:00
alesapin
f3f62097e5
Merge branch 'master' into fix_sticky_mutations_test 2023-07-18 14:46:24 +02:00
Ilya Yatsishin
73246b4788
Merge pull request #52056 from ClickHouse/ignore-create-index-query
Allow to ignore CREATE INDEX query for better SQL syntax compatibility
2023-07-18 14:40:38 +02:00
Nikolai Kochetov
58c5e91047
Merge pull request #52152 from amosbird/add_optimize_use_implicit_projections
Disable implicit projections by default
2023-07-18 14:32:04 +02:00
alesapin
c752acf3fc
Merge branch 'master' into avoid_zero_copy 2023-07-18 14:07:52 +02:00
Kruglov Pavel
64e88cde21
Merge branch 'master' into better-progress-bar-2 2023-07-18 13:37:53 +02:00
kssenii
353b0f817a Merge remote-tracking branch 'origin/fix-pg-sync-tables-exception-broken-sync' into fix-pg-sync-tables-exception-broken-sync 2023-07-18 12:26:17 +02:00
kssenii
0cfd12aba4 Fix 2023-07-18 12:24:04 +02:00
Raúl Marín
169c90a8c5 Merge remote-tracking branch 'blessed/master' into happy_grandma 2023-07-18 11:01:26 +02:00
Alexander Gololobov
44595b98d0 Update src/Storages/System/StorageSystemDatabases.cpp
Co-authored-by: Nikolay Degterinsky <43110995+evillique@users.noreply.github.com>
2023-07-18 08:25:38 +02:00
Alexander Gololobov
2f6bf4590b Filter databases list before querying potentially slow fields 2023-07-18 08:25:37 +02:00
Amos Bird
d8dd480cd7
Disable implicit projections by default 2023-07-18 09:50:41 +08:00
Alexey Milovidov
ffc6f246bf Merge branch 'master' into sparse-columns-by-default 2023-07-18 01:36:52 +02:00
Han Fei
4043174a81 fix special build 2023-07-17 23:46:45 +02:00
Nikolai Kochetov
a955d5621d Rename constants in KeyCondition analysis. 2023-07-17 18:53:12 +00:00
Alexander Sapin
2db14e36b4 Fix build 2023-07-17 19:15:07 +02:00
Nikita Mikhaylov
ee0bbc0e54
Merge branch 'master' into headers-blacklist 2023-07-17 19:08:52 +02:00
Nikita Mikhaylov
11cc8b4adf
Merge branch 'master' into add_delay_for_replicated 2023-07-17 19:04:29 +02:00
Alexander Sapin
b70349852c Better message on timeout and fix test 2023-07-17 19:02:29 +02:00
Alexander Sapin
918e3f7712 Fix flaky test 2023-07-17 18:41:12 +02:00
Nikita Mikhaylov
0caa49d85f Fix build 2023-07-17 14:25:14 +00:00
kssenii
fe53cd3d74 Minor changes 2023-07-17 16:11:58 +02:00
Alexander Sapin
2ad1109dbd Avoid zero copy replication more agressively 2023-07-17 16:03:39 +02:00
Andrey Zvonov
d339c22a2f
Merge branch 'master' into zvonand-issue-49290 2023-07-17 16:43:15 +03:00
Vitaly Baranov
815a3857de Remove non-const function Context::getClientInfo(). 2023-07-17 15:02:07 +02:00
Nikita Mikhaylov
d5b97e4cc1
Merge branch 'master' into deprecate-metadata-cache 2023-07-17 15:00:27 +02:00
Nikita Mikhaylov
01cd7a1fd7 Better 2023-07-17 12:59:58 +00:00
Han Fei
b75c4ae2e5 Merge branch 'master' into hanfei/support-insert-token 2023-07-17 14:57:48 +02:00
kssenii
7359dd518f Merge remote-tracking branch 'upstream/master' into s3queue 2023-07-17 14:23:12 +02:00
Alexander Sapin
477b8f04b6 Fix sticky mutations test (and extremely rare race condition) 2023-07-17 13:09:34 +02:00
Antonio Andelic
61dc020b4d
Merge branch 'master' into feature/keeper-dyn-reconf 2023-07-17 12:50:17 +02:00
Raúl Marín
41bdcdabfa Create ZK ancestors optimistically 2023-07-17 12:02:32 +02:00
Kseniia Sumarokova
200dfc24b6
Merge branch 'master' into fix-pg-sync-tables-exception-broken-sync 2023-07-17 11:53:42 +02:00
Sergei Trifonov
381ab07e1b
Merge pull request #51496 from yariks5s/add-index-bytes-to-system-parts
Add column primary_key_size to system.parts
2023-07-17 10:39:56 +02:00
Alexey Milovidov
09b300cf07
Merge pull request #52143 from ClickHouse/remove-default-value
Remove default argument value
2023-07-16 19:22:30 +03:00
Alexander Gololobov
2f9043f16c Properly deal with columns computed at previous steps 2023-07-16 08:24:12 +02:00
robot-ch-test-poll
3b0a4040cd
Merge pull request #51876 from evillique/fix-mongodb-inserts
Fix inserts into MongoDB tables
2023-07-16 05:28:43 +02:00
Alexey Milovidov
9a421369d7
Merge pull request #49709 from amosbird/fix_49695
Fix projection with optimize_aggregators_of_group_by_keys
2023-07-16 04:10:54 +03:00
Alexey Milovidov
7e6551dbd0
Merge branch 'master' into fix-mongodb-inserts 2023-07-16 01:47:52 +03:00
Alexey Milovidov
095624fbd1 Remove default argument value 2023-07-15 23:33:11 +02:00
Han Fei
7761e5ef9d support async_deduplicate_token for async insert 2023-07-15 14:42:08 +02:00
Mikhail Filimonov
575de8d497 Fix typo last_removal_attemp_time 2023-07-14 07:04:17 +02:00
Yatsishin Ilya
2ee7a9846f fix 2023-07-12 12:47:24 +00:00
Amos Bird
52246ab5b5
Ignore setting constraints for projection ASTs 2023-07-12 10:34:36 +08:00
Yarik Briukhovetskyi
9afafa9554
Merge branch 'master' into add-index-bytes-to-system-parts 2023-07-11 14:51:46 +02:00
李扬
6aec25e681
Merge branch 'master' into fix_hdfs_read_buffer_heap_overflow 2023-07-11 10:03:09 +08:00
Andrey Zvonov
c030e9dbe4
Merge branch 'master' into zvonand-issue-49290 2023-07-10 11:01:26 +02:00
Azat Khuzhin
5835e72fd6 More generic approach to disable native copy
Previous patch implements this only for BACKUP/RESTORE, but it can be
useful for regular disks as well, so add allow_native_copy for disks.

Note, that there is s3_allow_native_copy query setting, since it looks
redundant, since it make sense only for S3 disks, and not on a per query
basis.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-07-09 08:20:02 +02:00
Alexey Milovidov
4c20d482ba
Merge branch 'master' into is_obsolete 2023-07-09 08:49:00 +03:00
Alexey Milovidov
612a785fd0
Merge pull request #51674 from ClickHouse/system_jemalloc
System table with jemalloc stats
2023-07-09 08:48:05 +03:00
Alexey Milovidov
84600287a6
Merge pull request #50066 from bigo-sg/improve_geohash
Allow geoHashEncode when its arguments are mixed with const and non-const columns
2023-07-09 08:44:35 +03:00
robot-ch-test-poll4
8b329e83bd
Merge pull request #51959 from ClickHouse/fixes_for_transactions2
Fix some issues with transactions
2023-07-09 06:55:27 +02:00
robot-clickhouse-ci-1
4666838a5d
Merge pull request #49438 from azat/build/unwind
Force libunwind usage (removes gcc_eh support)
2023-07-09 05:38:34 +02:00
Alexey Milovidov
3d4800995f
Merge pull request #49732 from nickitat/impr_prefetch
Improve reading with prefetch
2023-07-09 06:10:58 +03:00
Alexey Milovidov
e2c8cea381
Merge pull request #51801 from ClickHouse/fix_broken_parts_handling
Fix broken parts handling in `ReplicatedMergeTree`
2023-07-09 05:32:51 +03:00
Alexey Milovidov
ab93967fb4
Merge pull request #51171 from ClickHouse/retry
Decrease default timeouts for S3 and HTTP requests
2023-07-09 03:49:56 +03:00
Azat Khuzhin
a10aa9ad50 Force libunwind usage (removes gcc_eh support)
libunwind is reentrant and signal safe, and works faster then then
gcc_eh (plus it has some custom patches for problems that have been
found during it's usage in ClickHouse).

gcc_eh may be missing in the system (if gcc was not installed), and
even if it exists clickhouse uses -nodefaultlibs, so some care should be
made to make it work.

Also this library is tiny and there shouln't be any problem to require
it always (there is already tendency to require some contrib libraries,
i.e. poco).

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-07-08 20:55:50 +02:00
Alexey Milovidov
52277d6252
Merge pull request #51363 from azat/clickhouse-local-default-settings
Use separate default settings for clickhouse-local
2023-07-08 19:37:27 +03:00
Alexander Tokmakov
44ae3a0986 fix a bug in projections 2023-07-08 16:13:07 +02:00
Alexander Tokmakov
df31034820 rollback merge tasks on exception 2023-07-08 14:03:08 +02:00
Alexey Milovidov
b1d1918607
Merge branch 'master' into retry 2023-07-08 03:08:48 +03:00
Alexey Milovidov
236ee81266
Merge pull request #51847 from canhld94/ch_fix_segfault
Fix segfault when create invalid EmbeddedRocksdb table
2023-07-08 02:50:11 +03:00
Andrey Zvonov
3e8d0249e8
Merge branch 'master' into zvonand-issue-49290 2023-07-07 14:10:37 +02:00
Alexander Gololobov
05649c7b38 Removed duplicate header 2023-07-07 13:22:52 +02:00
Alexander Sapin
e618dd05cc Fix clang tidy and race 2023-07-07 13:03:44 +02:00
Alexey Milovidov
4a6a6fc4f2
Merge branch 'master' into disks-space-improvement 2023-07-07 13:43:04 +03:00
Alexey Milovidov
b5f9a170eb
Merge pull request #51848 from ClickHouse/many-fixes-3
Many fixes [3]
2023-07-07 13:29:49 +03:00
Duc Canh Le
5d6fb7b7b0
Merge branch 'master' into ch_fix_segfault 2023-07-07 13:13:33 +08:00
Nikolay Degterinsky
e98d136243
Merge branch 'master' into headers-blacklist 2023-07-07 04:44:06 +02:00
Alexander Tokmakov
fdbd59ec6c
Merge pull request #51135 from ClickHouse/fix_trash_in_disks
Try to fix some trash in Disks and part moves
2023-07-07 02:02:17 +03:00
Mike Kot
8b6376005a "reconfig" support for CH Keeper 2023-07-07 00:20:54 +03:00
Alexander Tokmakov
58793816a7 fix paranoid check 2023-07-06 19:06:35 +02:00
Alexander Sapin
8cdb181c39 Reduce logging level 2023-07-06 17:52:31 +02:00
Igor Nikonov
83af43b8ba
Merge pull request #51852 from ClickHouse/fix-misleading-naming-in-joins
Change misleading name in joins: addJoinedBlock -> addBlockToJoin
2023-07-06 17:27:26 +02:00
Igor Nikonov
7c0e50c4d5
Merge branch 'master' into fix-misleading-naming-in-joins 2023-07-06 17:26:38 +02:00
Alexander Tokmakov
abf36065b7 fix 2023-07-06 17:24:06 +02:00
Alexander Sapin
9ae0dc730c Review fixes + enable in ci 2023-07-06 17:15:26 +02:00
Nikolay Degterinsky
67e2dee7e2 Allow SETTINGS before FORMAT in DESCRIBE TABLE query 2023-07-06 14:29:58 +00:00
Alexey Milovidov
6d8434c702 Merge branch 'master' into many-fixes-3 2023-07-06 16:17:32 +02:00
Alexey Milovidov
1fa21700ad Merge remote-tracking branch 'origin/less-flaky-test_start_stop_moves' into many-fixes-3 2023-07-06 16:17:13 +02:00
avogar
810d1ee069 Fix tests 2023-07-06 13:48:57 +00:00
Alexander Sapin
30bcc73c63 Merge branch 'master' into add_delay_for_replicated 2023-07-06 14:29:15 +02:00
Kseniia Sumarokova
e97e107bcc
Merge branch 'master' into add-separate-access-for-use-named-collections 2023-07-06 12:16:53 +02:00
Andrey Zvonov
cc0210f760
Merge branch 'master' into zvonand-issue-49290 2023-07-06 11:13:51 +02:00
Alexander Gololobov
1336a9ec67 Better naming 2023-07-06 09:09:55 +02:00
Nikolay Degterinsky
b9fffacc65 Fix build 2023-07-06 06:31:09 +00:00
Nikolay Degterinsky
546f12dc85 Fix inserts to MongoDB tables 2023-07-06 05:05:27 +00:00
Alexey Milovidov
2e454ef89e
Merge branch 'master' into disks-space-improvement 2023-07-06 03:58:45 +03:00
Alexey Milovidov
1a24bface0
Merge branch 'master' into clickhouse-local-default-settings 2023-07-06 03:30:11 +03:00
Alexey Milovidov
89788f3d5b
Merge branch 'master' into fix-potentially-bad-code 2023-07-06 02:23:28 +03:00
Alexey Milovidov
2c592a6a2c
Merge pull request #51805 from ClickHouse/fix_for_parallel_replicas_and_empty_header
Fix for parallel replicas not completely disabled by granule count threshold
2023-07-06 01:46:52 +03:00
Alexey Milovidov
b28fa1f054 Merge branch 'many-fixes-3' of github.com:ClickHouse/ClickHouse into many-fixes-3 2023-07-05 23:54:48 +02:00
Alexey Milovidov
9bcc85d60f Merge branch 'fix-drop-column-sparse' of github.com:CurtizJ/ClickHouse into many-fixes-3 2023-07-05 23:54:27 +02:00
alesapin
66484a4dd0
Merge branch 'master' into add_delay_for_replicated 2023-07-05 20:03:34 +02:00