Kseniia Sumarokova
bb26903675
Merge pull request #35771 from bigo-sg/fix-filebuffer-pos
...
fix filebuffer pos in RemoteReadBuffer
2022-04-06 11:57:05 +02:00
taiyang-li
acb9f1632e
suppoort skip splits in orc and parquet
2022-04-06 16:40:22 +08:00
Antonio Andelic
84eef61d17
Pull under reader mutex
2022-04-06 06:39:56 +00:00
fenglv
a2ce366c34
parallel reading files for FileLog Engine
2022-04-06 04:49:43 +00:00
taiyang-li
43e8af697a
fix code style
2022-04-06 11:41:16 +08:00
Mikhail Filimonov
f9a4cd12d4
Make parallel reading of kafka consumers work again (issue #35153 )
2022-04-05 21:46:56 +02:00
Mikhail Filimonov
3412be9d4d
Change KafkaDirectReads to KafkaConsumersInUse
2022-04-05 20:25:05 +02:00
Nikolai Kochetov
def33323a0
Merge pull request #35788 from amosbird/better-projection1
...
Improve minmax_count_projection
2022-04-05 19:59:45 +02:00
kssenii
cbd7f4acfb
Fix
2022-04-05 19:24:10 +02:00
Alexander Tokmakov
37a06eec1a
fixes
2022-04-05 17:36:53 +02:00
Alexander Tokmakov
d9e3e9b69f
Merge branch 'master' into faster_replicated_ddl
2022-04-05 14:38:38 +02:00
Alexander Tokmakov
1fe50ad201
Merge branch 'master' into mvcc_prototype
2022-04-05 14:38:02 +02:00
Azat Khuzhin
8ebaf84989
Fix clang-tidy readability-simplify-boolean-expr warning in AlterCommands.cpp
...
I want to make the code more readable before, but clang-tidy is too
smart...
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-04-05 13:39:39 +03:00
alesapin
eaa72ef002
Merge pull request #35904 from ClickHouse/more_logs_on_unsuccessful_part_removal
...
More logs on unsuccessful part removal
2022-04-05 11:29:08 +02:00
Alexander Tokmakov
da00beaf7f
Merge branch 'master' into mvcc_prototype
2022-04-05 11:14:42 +02:00
Azat Khuzhin
c6f182163a
Require mutations for per-table TTL only when it had been changed
...
Before this patch only per-column TTL did not requires mutation if it
had not been changed, after per-table TTL will also check whether it had
been changed or not.
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-04-05 11:08:35 +03:00
Amos Bird
5bc09550d8
Fix tests
2022-04-05 15:56:39 +08:00
Amos Bird
35a8bb2a9b
add comment
2022-04-05 15:56:38 +08:00
Amos Bird
163664fad7
Improve minmax_count_projection
2022-04-05 15:56:37 +08:00
Vladimir C
54b4049ea5
Merge pull request #35794 from awakeljw/fork_chmaster
2022-04-05 09:44:45 +02:00
Alexander Tokmakov
4e9ec5dc2f
make some replicated DDL faster
2022-04-05 00:51:48 +02:00
Alexey Milovidov
1b562923f9
Merge pull request #35941 from ClickHouse/revert-35184-clang-tidy-issues
...
Revert "clang-tidy report issues with Medium priority"
2022-04-04 23:42:21 +03:00
alesapin
69fceb7e6d
Merge pull request #35926 from ClickHouse/better_consumers
...
Better check for kafka_num_consumers
2022-04-04 22:42:05 +02:00
Alexey Milovidov
4d6c030d23
Revert "clang-tidy report issues with Medium priority"
2022-04-04 23:41:42 +03:00
Mikhail Filimonov
53c7376e37
Add some metrics to engine Kafka
2022-04-04 20:25:53 +02:00
alesapin
d04c48e67a
Fix build
2022-04-04 20:14:09 +02:00
alesapin
1e4fe5e3b5
Merge pull request #35882 from ClickHouse/more_metadata_alters
...
Make more alters of nested types metadata-only
2022-04-04 20:11:31 +02:00
alesapin
0477e74f42
Get rid of caps
2022-04-04 19:41:54 +02:00
alesapin
72331856eb
fix message
2022-04-04 18:28:26 +02:00
alesapin
86f42e7a3a
Better check for kafka_num_consumers
2022-04-04 18:07:36 +02:00
Anton Popov
bd93be65aa
Merge pull request #35820 from azat/columns-ttl-fix
...
Avoid processing per-column TTL multiple times
2022-04-04 16:42:50 +02:00
Anton Popov
d08d4a2437
Merge pull request #35806 from CurtizJ/dynamic-columns-8
...
Fix inserts to columns of type `Object` in partitioned tables
2022-04-04 16:16:54 +02:00
kssenii
4e50da722b
Better s3 settings
2022-04-04 16:14:56 +02:00
Antonio Andelic
db75bf6f5d
Merge pull request #35852 from ClickHouse/bigo-sg-add_hints
...
Refactoring of hints for column descriptor
2022-04-04 15:37:08 +02:00
alesapin
3ccf99c3d7
Merge pull request #35884 from ClickHouse/don_t_allow_to_reset_settings
...
Forbid to reset non existing settings
2022-04-04 15:27:34 +02:00
Alexander Tokmakov
a2167f12b8
Merge branch 'master' into mvcc_prototype
2022-04-04 14:24:23 +02:00
Nikita Taranov
bd89fcafdb
Make SortDescription::column_name always non-empty ( #35805 )
2022-04-04 14:17:15 +02:00
alesapin
9b75ef6ce9
Fix build
2022-04-04 14:03:16 +02:00
alesapin
885447342c
More logs on unsuccessful part removal
2022-04-04 13:17:33 +02:00
alesapin
803a1a2a9c
Fix tests and check
2022-04-04 11:19:02 +02:00
Anton Popov
ae53aae106
fix clang-tidy
2022-04-04 08:48:31 +00:00
taiyang-li
38f149b533
optimize trivial count hive query
2022-04-04 15:28:26 +08:00
Antonio Andelic
a926bc19ea
Address PR comments
2022-04-04 07:24:42 +00:00
Antonio Andelic
d96b682a55
Refactor
2022-04-04 07:24:42 +00:00
taiyang-li
6bc1786047
fix style
2022-04-04 07:24:42 +00:00
taiyang-li
d6247338de
fix failed stateless tests
2022-04-04 07:24:42 +00:00
taiyang-li
fd9a10ef53
add hints for projections
2022-04-04 07:24:42 +00:00
taiyang-li
4547ed370a
add hints for column description
2022-04-04 07:24:42 +00:00
taiyang-li
4e2d5f1841
Merge remote-tracking branch 'bigo-sg/use_minmax_index' into optimize_trivial_hive_query
2022-04-04 10:42:28 +08:00
taiyang-li
cbfc0f6bac
fix typo
2022-04-04 10:42:22 +08:00
alesapin
a8c1ccdb20
Forbit to reset non existing settings
2022-04-03 18:29:24 +02:00
Kseniia Sumarokova
30c1afe29d
Merge pull request #35646 from bigo-sg/reduce-mutex-scope
...
narrow mutex scope when setenv LIBHDFS3_CONF
2022-04-03 17:59:24 +02:00
alesapin
7b35920d4c
Make more alters of nested types metadata-only
2022-04-03 14:03:34 +02:00
alesapin
91453fe4d6
Merge pull request #35759 from chen9t/fix_dirty_metacache
...
Clean dirty meta cache when part is broken during part loading phase
2022-04-03 13:33:46 +02:00
Azat Khuzhin
195b4c47ea
Avoid processing per-column TTL multiple times
...
Before this patch ttl.txt will not be written for per-column TTLs, and
hence it will be calculated every time after server restart of
DETACH/ATTACH cycle (note, that it will work w/o restart since in-memory
representation will avoid this).
v2: convert test to .sh to get correct current database over default for MV
v3: extract UUID to avoid error like in [1]:
[ 490 ] {} <Error> void DB::SystemLog<DB::TextLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) []: Code: 349. DB::Exception: Cannot convert NULL value to non-Nullable type: While processing query_id LIKE concat('%', CAST(_CAST(NULL, 'Nullable(UUID)') AS uuid, 'String'), '%'): while pushing to view test_0hc2ro.this_text_log (c64e5af4-059e-4330-a728-354ecf83c031). (CANNOT_INSERT_NULL_IN_ORDINARY_COLUMN)
[1]: https://s3.amazonaws.com/clickhouse-test-reports/35820/a512d322b024d37d2f1082c4833f59f86057555f/stateless_tests_flaky_check__address__actions_.html
v4: add no-parallel to avoid issues with disappeared underlying table while pushing to text_log
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-04-02 15:19:39 +03:00
shuchaome
a565a93740
reduce mutex scope when setenv LIBHDFS3_CONF
2022-04-02 06:52:39 +08:00
kssenii
6c8e073a61
Merge master
2022-04-01 16:48:29 +02:00
Alexander Tokmakov
6591d1ceb7
Merge branch 'master' into mvcc_prototype
2022-04-01 15:38:46 +02:00
fenglv
97523a3329
Try remove unneed variable
2022-04-01 09:58:23 +00:00
Kseniia Sumarokova
d3b3294872
Merge pull request #35365 from bigo-sg/improve_access_type
...
Improve check access in table functions
2022-04-01 10:47:02 +02:00
Kseniia Sumarokova
9c39320e75
Merge pull request #35800 from ucasfl/mutex
...
remove unused variable
2022-04-01 10:46:23 +02:00
Kseniia Sumarokova
04729ecc70
Merge pull request #35798 from xiedeyantu/patch-1
...
Delete duplicate code
2022-04-01 10:43:31 +02:00
jewisliu
9a4cc78dfb
support ALTER TABLE t DETACH PARTITION ALL syntax
2022-04-01 13:13:07 +08:00
Alexey Milovidov
5c6b84c398
Merge pull request #35586 from kssenii/fix-virtual-columns-s3
...
Fix s3 engine getting virtual columns
2022-04-01 04:43:32 +03:00
Alexander Tokmakov
63e8d73ba4
better message for incorrect *MergeTree arguments
2022-03-31 17:08:30 +02:00
Anton Popov
42acb1dc29
fix inserts to columns of type Object in partitioned tables
2022-03-31 13:30:01 +00:00
fenglv
e2e4b02d13
remove unused variable
2022-03-31 12:01:10 +00:00
xiedeyantu
d141dbc388
Delete duplicate code
...
Delete duplicate code
2022-03-31 19:34:30 +08:00
Nikita Mikhaylov
f6bfdcc0c9
Added support for schema inference for hdfsCluster ( #35602 )
2022-03-31 12:47:36 +02:00
Alexander Tokmakov
5a50ad9de3
Merge branch 'master' into mvcc_prototype
2022-03-31 11:35:04 +02:00
Kseniia Sumarokova
a711fc0402
Merge pull request #35572 from bigo-sg/hdfs_config_prefix
...
Deduce absolute hdfs config path
2022-03-31 10:08:32 +02:00
Antonio Andelic
13b4fabee4
Merge pull request #35743 from bigo-sg/remote_filter_for_hive
...
Respect remote_url_allow_hosts for hive
2022-03-31 08:54:37 +02:00
taiyang-li
539ce5f1b8
Merge branch 'master' into use_minmax_index
2022-03-31 12:27:32 +08:00
taiyang-li
70087bc959
Merge branch 'master' into improve_access_type
2022-03-31 12:19:17 +08:00
taiyang-li
f6ccda8097
Merge branch 'master' into hdfs_config_prefix
2022-03-31 12:16:05 +08:00
chen9t
b40a69f59a
Code style
2022-03-31 10:10:05 +08:00
kssenii
98e85dd68e
Fix build
2022-03-30 20:27:04 +02:00
shuchaome
738966b6b6
fix filebuffer pos in RemoteReadBuffer
2022-03-31 00:03:45 +08:00
kssenii
099fa0e668
Merge master
2022-03-30 17:33:32 +02:00
kssenii
0fc92fe2aa
Get rid of all "remote" mentions
2022-03-30 17:15:29 +02:00
chen9t
5cb2301e39
Clean dirty meta cache when part is broken during part loading phase
2022-03-30 20:40:20 +08:00
Antonio Andelic
a3ad99be03
Create CallbackRunner in Storage
2022-03-30 11:24:50 +00:00
kssenii
98ad3f4a91
Fix tests, rename some remote mentions
2022-03-30 12:21:59 +02:00
lgbo-ustc
08e1fdc6b8
Fixed :a elimate AMBIGUOUS_COLUMN_NAME exception
...
elimate AMBIGUOUS_COLUMN_NAME exception in hdfs/s3 cluster when run a query with join
2022-03-30 17:06:38 +08:00
Antonio Andelic
1173eab15e
Use same IOThreadPool for URL and S3
2022-03-30 08:15:20 +00:00
taiyang-li
16bb4c4ad0
respect remote_url_allow_hosts for hive
2022-03-30 15:33:59 +08:00
Antonio Andelic
03a09dc914
Merge pull request #35571 from ClickHouse/parallel-s3-downloading
...
Parallel S3 downloading
2022-03-30 08:14:49 +02:00
Antonio Andelic
d85ed8f2a9
Merge pull request #35655 from ClickHouse/exception-compile-time-message-check
...
Use compile-time check for `Exception` messages
2022-03-30 08:11:32 +02:00
taiyang-li
0af6fdb576
fix building
2022-03-30 11:28:21 +08:00
taiyang-li
fcfabf4a0c
Merge remote-tracking branch 'ck/master' into use_minmax_index
2022-03-30 11:23:24 +08:00
taiyang-li
e76ed3acde
Merge branch 'master' into improve_access_type
2022-03-30 11:04:57 +08:00
taiyang-li
9ffb42d507
Merge branch 'master' into hdfs_config_prefix
2022-03-30 11:02:31 +08:00
Anton Popov
1cba31c305
Merge pull request #35687 from CurtizJ/dynamic-columns-7
...
Fix reading from type object
2022-03-30 00:21:32 +02:00
Alexander Tokmakov
287d858fda
Merge branch 'master' into mvcc_prototype
2022-03-29 16:24:12 +02:00
Dmitry Novik
8f935a72d6
Merge pull request #33230 from CurtizJ/read_in_order_max_rows_to_read
...
Proper handle of 'max_rows_to_read' in case of reading in order of sorting key
2022-03-29 15:16:34 +02:00
Antonio Andelic
ef484547bf
Fix GCC build
2022-03-29 13:16:11 +00:00
taiyang-li
67c3c0be3d
Merge branch 'master' into improve_access_type
2022-03-29 20:42:57 +08:00
taiyang-li
631352ba4b
Merge branch 'master' into hdfs_config_prefix
2022-03-29 20:40:32 +08:00
kssenii
4374415bd7
Fix clang-tidy, style check
2022-03-29 14:20:21 +02:00
Kruglov Pavel
fe60560c03
Merge pull request #35619 from Avogar/check-remote-url-allow-hosts
...
Check remote_url_allow_hosts before schema inference in URL engine
2022-03-29 14:08:02 +02:00
Anton Popov
d42632dc13
Merge pull request #32928 from bigo-sg/rocksdb_metacache
...
Speed up parts loading process of MergeTree by metadata cache
2022-03-29 14:05:22 +02:00
taiyang-li
59727a423e
Merge remote-tracking branch 'ck/master' into use_minmax_index
2022-03-29 19:39:09 +08:00
Maksim Kita
a1a4552740
Merge pull request #35184 from DevTeamBK/clang-tidy-issues
...
clang-tidy report issues with Medium priority
2022-03-29 13:19:54 +02:00
taiyang-li
77314246f3
Merge branch 'master' into hdfs_config_prefix
2022-03-29 18:32:59 +08:00
taiyang-li
834ac3a1b9
Merge remote-tracking branch 'ck/master' into rocksdb_metacache
2022-03-29 18:32:06 +08:00
Nikolai Kochetov
86690f18ee
Merge pull request #35667 from amosbird/projection-fix2
...
Another fix of projection part check
2022-03-29 10:22:01 +02:00
Antonio Andelic
362e877529
Merge branch 'master' into parallel-s3-downloading
2022-03-29 07:05:26 +00:00
Amos Bird
3ab8fc1e7b
Fix projection part check
...
Fix projection part check when projection part type is different from
parent part type.
2022-03-29 10:39:07 +08:00
kssenii
44157e5c80
Merge master
2022-03-29 02:19:32 +02:00
kssenii
c6b1f86306
Merge with master
2022-03-29 02:03:28 +02:00
Nikita Mikhaylov
85282f1b4d
Made schema inference work with s3Cluster table function ( #35544 )
2022-03-29 00:46:35 +02:00
kssenii
1d49a85963
Merge master
2022-03-28 22:51:56 +02:00
kssenii
a2013ebe2b
Better
2022-03-28 22:40:27 +02:00
Kseniia Sumarokova
9a8e9198e5
Merge pull request #35593 from kssenii/named-collections-fix
...
Fix headers with named collections, add compression_method
2022-03-28 22:10:32 +02:00
Alexander Tokmakov
208b242188
Merge branch 'master' into mvcc_prototype
2022-03-28 19:58:06 +02:00
Anton Popov
0e4af89f69
fix reading from type object
2022-03-28 17:23:34 +00:00
mergify[bot]
f09ebea2d8
Merge branch 'master' into read_in_order_max_rows_to_read
2022-03-28 13:30:34 +00:00
taiyang-li
38702be40c
Merge remote-tracking branch 'ck/master' into rocksdb_metacache
2022-03-28 21:03:22 +08:00
mergify[bot]
70b339ea4e
Merge branch 'master' into check-remote-url-allow-hosts
2022-03-28 11:55:48 +00:00
mergify[bot]
a022de4a6e
Merge branch 'master' into fix-materialized-postgresql
2022-03-28 10:55:41 +00:00
Antonio Andelic
d9d826c813
Address PR review
2022-03-28 08:19:23 +00:00
kssenii
c4832f7633
Fix
2022-03-28 09:28:02 +02:00
kssenii
c6706b8bfa
Better
2022-03-25 19:30:13 +01:00
kssenii
141c290344
Fix build
2022-03-25 18:31:15 +01:00
taiyang-li
b79cec6806
Merge branch 'use_minmax_index' of https://github.com/bigo-sg/ClickHouse into use_minmax_index
2022-03-25 23:33:49 +08:00
taiyang-li
eee8949150
fix code
2022-03-25 23:33:46 +08:00
Alexander Tokmakov
9ec0951de5
update comment for mismatching checksums
2022-03-25 15:54:05 +01:00
taiyang-li
4aaa361f2e
Merge remote-tracking branch 'ck/master' into use_minmax_index
2022-03-25 22:48:03 +08:00
taiyang-li
fbadd8fc0e
only deduce absolute path of hdfs config when it's relative path do not exists
2022-03-25 22:28:47 +08:00
taiyang-li
c013cd0b52
Merge branch 'master' into hdfs_config_prefix
2022-03-25 22:13:45 +08:00
taiyang-li
3ca487030d
Merge branch 'master' into improve_access_type
2022-03-25 22:11:08 +08:00
avogar
ecc57b436c
Check remote_url_allow_hosts before schema inference in URL engine
2022-03-25 13:30:45 +00:00
Antonio Andelic
394682b983
Merge branch 'master' into parallel-s3-downloading
2022-03-25 13:00:44 +00:00
kssenii
6769b84638
Merge master
2022-03-24 20:47:43 +01:00
kssenii
d9d9f3bc6d
Fix
2022-03-24 19:10:53 +01:00
kssenii
e91e30aaa4
Fix
2022-03-24 17:10:27 +01:00
Sergei Trifonov
a90e83665d
Merge pull request #35343 from ClickHouse/parallel-multipart-upload-for-s3storage
...
allow parallelization of multipart S3 storage upload; fixes #34350
2022-03-24 15:58:29 +01:00
kssenii
d6ab6de30a
Minor changes
2022-03-24 15:32:08 +01:00
taiyang-li
c0eb9f73a9
remote std::cout
2022-03-24 21:17:43 +08:00
taiyang-li
6eccd09e2b
deduce hdfs config path
2022-03-24 18:04:29 +08:00
Antonio Andelic
62a495a5fc
Small refactor
2022-03-24 09:45:30 +00:00
Nikolai Kochetov
283e20a9a5
Merge pull request #35395 from amosbird/distributedmultiplejoin
...
Validate some thoughts over making sets
2022-03-24 10:30:26 +01:00
Antonio Andelic
c52cee2219
Merge branch 'master' into parallel-s3-downloading
2022-03-24 08:11:52 +00:00
Maksim Kita
1df1721648
Merge pull request #35546 from kitaisreal/refactor-external-models-loader
...
ExternalModelsLoader refactoring
2022-03-24 01:24:45 +01:00
kssenii
d4161b5925
Add optin read_from_cache_if_exists_otherwise_bypass_cache (for merges)
2022-03-23 20:24:00 +01:00
Maksim Kita
3df6a86387
ExternalModelsLoader refactoring
2022-03-23 20:05:17 +01:00
kssenii
d2a3cfe5dc
Cache on all write operations
2022-03-23 19:14:33 +01:00
Yakov Olkhovskiy
1631656803
Merge pull request #34353 from zvonand/issue_33147
...
Extended usage of Milliseconds, Microseconds, Nanoseconds
2022-03-23 13:33:07 -04:00
kssenii
e39aba37a2
Minor changes
2022-03-23 18:11:52 +01:00
Alexander Tokmakov
9aed0507b7
Merge branch 'master' into mvcc_prototype
2022-03-23 18:07:22 +01:00
