thevar1able/ClickHouse
1
0
Fork 0
mirror of https://github.com/ClickHouse/ClickHouse.git synced 2024-12-17 03:42:48 +00:00
Code Issues Packages Projects Releases Wiki Activity
78,318 Commits 9,315 Branches 1,783 Tags 2.1 GiB
5a273d4dda
Commit Graph

20327 Commits

Author SHA1 Message Date
kssenii
05c548035f Some fixes 2021-11-22 11:04:04 +03:00
Anton Popov
c034491da9 fix style check 2021-11-21 23:02:33 +03:00
Anton Popov
afe8d3c424 refactor merged index conditions 2021-11-21 22:49:34 +03:00
Alexey Milovidov
c5fcef03c3 Remove trash 2021-11-21 18:12:05 +03:00
alesapin
1cf204c581 Small changes 2021-11-21 15:28:45 +03:00
Alexey Milovidov
6246cec409 Fix build on AArch64 2021-11-21 14:30:04 +03:00
Alexey Milovidov
d604cf5573 Remove the infamous "unbundled" build 2021-11-21 13:58:26 +03:00
alexey-milovidov
faae69f631
Merge pull request #31534 from aiven/kmichel-fix-json-colum-name-encoding 
Fix invalid JSON in column names
 2021-11-21 11:34:33 +03:00
alexey-milovidov
4cdb40e3cd
Merge pull request #31565 from azat/fix-MySQLWire 
Fix MySQLWire format (this will also fix performance tests)
 2021-11-21 11:32:53 +03:00
alexey-milovidov
796c76638a
Merge pull request #31574 from ClickHouse/fix-trash 
Fix broken non-x86 builds
 2021-11-21 01:16:44 +03:00
tavplubix
711b738dd1
Merge pull request #31542 from ClickHouse/mutations_remove_multimap 
Remove strange multimap for mutations in StorageMergeTree
 2021-11-20 20:41:49 +03:00
Alexander Tokmakov
856502fa81 log long operations in Keeper 2021-11-20 20:39:31 +03:00
Vitaly Baranov
9a0d98fa6d
Merge pull request #31557 from vitlibar/better-exception-message-wrong-user-hash 
Better exception message wrong user hash
 2021-11-20 19:47:07 +03:00
Kruglov Pavel
d9c1a0c8ec
Merge branch 'master' into fix-write-buffers 2021-11-20 17:48:24 +03:00
Azat Khuzhin
dd7f780978 Fix Progress for short INSERT SELECT queries 
Note, that we cannot send Progress for regular INSERT (w/ VALUES) w/o
breaking protocol compatibility, but it can be done by increasing
revision.
 2021-11-20 16:41:35 +03:00
Azat Khuzhin
0b4d855c08 Reduce copy-paste in TCPHandler::processInsertQuery() 2021-11-20 16:41:35 +03:00
kssenii
6c8867a719 Fix style check 2021-11-20 16:21:43 +03:00
Alexey Milovidov
e898c6608c Fix broken non-x86 builds 2021-11-20 15:58:44 +03:00
Azat Khuzhin
6aa94ae032 Fix MySQLWire format (in case of multiple writes) 
In case of multiple writes File() engine will set doNotWritePrefix(),
and this will avoid serializations initilization, move this to do this
always.

Fixes: #31004
 2021-11-20 15:26:21 +03:00
kssenii
ff969b4605 Merge branch 'master' of github.com:ClickHouse/ClickHouse into seekable-read-buffers 2021-11-20 15:03:13 +03:00
kssenii
f29ef7d18b Add one more test 2021-11-20 15:01:45 +03:00
Kevin Michel
edbeeaf6ec
Fix invalid JSON in column names 
If the column name contains invalid UTF-8 sequences
and the output data types are all considered safe,
then the output will not be sanitized and the generated
JSON will be invalid.

A minimal reproduction case is :
`SELECT length('\x80') FORMAT JSONCompact`
where we auto-generate a non-UTF-8 column name with only
integer outputs, whereas :
`SELECT '\x80' FORMAT JSONCompact`
would be sanitized because the column type is String and
will trigger UTF-8 sanitization over the entire document.
 2021-11-20 12:35:41 +01:00
kssenii
fda66adf52 Correct merge with master 2021-11-20 13:47:55 +03:00
Vladimir C
4498aecaf6
Merge pull request #31528 from vdimir/disable_partial_merge_join_left_table_buffer_bytes 2021-11-20 13:11:35 +03:00
kssenii
29978f9707 Merge branch 'master' of github.com:ClickHouse/ClickHouse into vxider-window-view 2021-11-20 12:13:39 +03:00
Vitaly Baranov
57ac39f99e Add more information to exceptions raised by UsersConfigAccessStorage. 2021-11-20 12:10:45 +03:00
kssenii
5c9509d68b Fix attach 2021-11-20 12:03:39 +03:00
Alexey Milovidov
9ca5c960b7 Remove useless code 2021-11-20 10:06:28 +03:00
Alexey Milovidov
334535a4c4 Better exception message when users.xml cannot be loaded due to bad password hash 2021-11-20 10:06:20 +03:00
Vitaly Baranov
940b5edbd7
Merge pull request #31509 from vitlibar/split-row-policy-and-quota-headers 
Split row policy and quota headers
 2021-11-20 10:01:18 +03:00
Vitaly Baranov
0684b28377
Merge pull request #31337 from sunny19930321/fix-use-quota-bug 
fix: quota limit was not reached, but the limit was exceeded
 2021-11-20 09:52:24 +03:00
tavplubix
67753e5b83
Update StorageMergeTree.cpp 2021-11-19 20:05:45 +03:00
Alexander Tokmakov
8d7413b0d6 remove strange multimap from mutations 2021-11-19 19:54:43 +03:00
Kruglov Pavel
4856b50c23
Merge pull request #31409 from excitoon-favorites/s3envsegfaults 
Resolve `nullptr` in STS credentials provider for S3
 2021-11-19 18:45:38 +03:00
alesapin
1afef1733b Ignore overhead 2021-11-19 18:22:46 +03:00
Anton Popov
099c40d251 fix tests 2021-11-19 17:14:56 +03:00
Kruglov Pavel
fdd1f53d3a
Update CustomSeparatedRowOutputFormat.h 2021-11-19 16:52:48 +03:00
Kruglov Pavel
3070bf1e4d
Update CustomSeparatedRowOutputFormat.cpp 2021-11-19 16:52:31 +03:00
Kruglov Pavel
cded91b013
Update verbosePrintString.h 2021-11-19 16:51:49 +03:00
Kruglov Pavel
eb1cc834dc
Merge branch 'master' into custom-with-names-and-types 2021-11-19 16:51:25 +03:00
kssenii
9bdad8ab64 Rewrite from DataStreams to Processors 2021-11-19 16:09:12 +03:00
alesapin
587a1a622d Fix tests 2021-11-19 16:03:01 +03:00
alesapin
d1eba74c04 Trim string 2021-11-19 13:52:03 +03:00
SuperDJY
dd2972b8c3
return fake create query when executing show create table on system's tables. (#31391) 
* clarify that cannot show create table of system's tables

* clarify that cannot show create table of system's tables in the document

* bypass test style-check for required `database=currentDatabase()` because `show create table` do not have condition

* rename supportsShowCreateTable to isSystemStorage

* build fake create query for show create table of system's tables

* fix tests for show create table on system's table:

1. only build fake create query when cannot get real query
2. only test rocksdb when it's enabled.

* fix test for show create table system.tables

* fix test for ASTCreateQuery set table and database

* change to LOGICAL_ERROR when cannot get in_memory metadata

Co-authored-by: tavplubix <tavplubix@gmail.com>

* implement common getCreateQueryFromStorage

Co-authored-by: tavplubix <tavplubix@gmail.com>
 2021-11-19 13:25:55 +03:00
vdimir
2e0d3efba0
disable partial_merge_join_left_table_buffer_bytes due to bug 2021-11-19 12:59:23 +03:00
vdimir
f3d0e6d999
remove partial_merge_join_optimizations 
this option is redundant because optimization is controlled by partial_merge_join_left_table_buffer_bytes
 2021-11-19 12:58:46 +03:00
alesapin
7820af7cbd More compatible output format 2021-11-19 12:48:38 +03:00
alesapin
f33e93e305 Merge branch 'add_4_letter_words_commands' of github.com:JackyWoo/ClickHouse into JackyWoo_add_4_letter_words_commands 2021-11-19 12:31:03 +03:00
alesapin
3f8f08e816 Slightly better 2021-11-19 12:30:58 +03:00
JackyWoo
33396b054e fix build error 2021-11-19 15:52:35 +08:00
Amos Bird
c47ec31617
fix 2021-11-19 11:51:05 +08:00
Vitaly Baranov
af56b20da7 Rename IAccessEntity::Type -> AccessEntityType and move it to Access/Common. 2021-11-19 02:48:00 +03:00
Vitaly Baranov
06077a2952 Rename Quota::KeyType -> QuotaKeyType and move it to Access/Common. 2021-11-19 00:14:23 +03:00
Vitaly Baranov
6634fcbac7 Rename Quota::ResourceType -> QuotaType and move it to Access/Common. 2021-11-19 00:14:23 +03:00
Vitaly Baranov
33ea7a7262 Rename RowPolicy::ConditionType -> RowPolicyFilterType and move it to Access/Common. 2021-11-19 00:14:23 +03:00
Vitaly Baranov
2883ca012e Rename RowPolicy::NameParts -> RowPolicyName and move it to Access/Common. 2021-11-19 00:14:23 +03:00
alexey-milovidov
12a471507e
Merge pull request #31169 from sundy-li/notlike-fix 
ISSUES-30801: Remove not like function into RPNElement
 2021-11-18 23:40:57 +03:00
alexey-milovidov
b30f9124c0
Merge pull request #31008 from kssenii/sql-json-fix-2 
Improve usability of JSON_VALUE
 2021-11-18 23:39:17 +03:00
alesapin
04dba4c360 Merge branch 'add_4_letter_words_commands' of github.com:JackyWoo/ClickHouse into JackyWoo_add_4_letter_words_commands 2021-11-18 23:18:12 +03:00
alesapin
dcec086573 Small refactoring 2021-11-18 23:17:22 +03:00
Vitaly Baranov
f4b5d5a0d7
Update src/Access/EnabledQuota.cpp 2021-11-18 21:49:36 +03:00
Amos Bird
d1a14d76f1
fix 2021-11-19 02:29:35 +08:00
Stig Bakken
f8c53e839a fix clang13 warning 2021-11-18 16:53:41 +01:00
Amos Bird
c988a4e770
fix again 2021-11-18 23:09:17 +08:00
Anton Popov
69559a4fd9 fix convertion to CNF 2021-11-18 17:54:07 +03:00
kssenii
6a39d871b2 Merge branch 'master' of github.com:ClickHouse/ClickHouse into vxider-window-view 2021-11-18 17:29:11 +03:00
JackyWoo
0d19f2a485 ignore clang-tidy for IntNode in gtest_coordination 2021-11-18 21:27:43 +08:00
Stig Bakken
b91f21d658 Don't use setInternalQuery() when forwarding drop calls to database 2021-11-18 11:46:51 +01:00
Stig Bakken
9190a883d3 Print CREATE, not ATTACH 2021-11-18 11:46:51 +01:00
Stig Bakken
eb5115adb8 Fail when loading MaterializeMySQL database without uuid 
and print instructions on how to remove and recreate.
 2021-11-18 11:46:51 +01:00
Stig Bakken
18ce50fd7f Add hasReplicationThread() and stopReplication() methods to IDatabase 2021-11-18 11:46:51 +01:00
Stig Bakken
ff46e8bb51 Drop support for DatabaseOrdinary in MaterializedMySQL 
1. Dropped support for DatabaseOrdinary for MaterializeMySQL. It
   is marked as experimental, and dropping support makes the code
   more maintaible, and speeds up integration tests by 50%.

2. Get rid of thread name logic for StorageMaterializeMySQL wrapping,
   use setInternalQuery instead (similar to MaterializedPostgreSQL).
 2021-11-18 11:46:51 +01:00
JackyWoo
afd8a321b4 ignore explicit-constructor in gtest_coordination.cpp 2021-11-18 18:34:44 +08:00
kssenii
11ab1f1ae5 Fix 2021-11-18 08:46:31 +00:00
kssenii
4016530b99 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into sql-json-fix-2 2021-11-18 08:33:50 +00:00
kssenii
1a9817f872 Correct merge 2021-11-18 07:56:10 +00:00
Vladimir Chebotarev
8b622bd4ff Fixed a typo. 2021-11-18 10:54:59 +03:00
JackyWoo
27d50edc59 adjust log output 2021-11-18 15:49:43 +08:00
Vladimir C
0a3a43c017
Merge pull request #30984 from qieqieplus/untuple-func-alias 2021-11-18 10:42:20 +03:00
JackyWoo
007366b506 remove sizeOf method from SnapshotableHashTable 2021-11-18 12:35:32 +08:00
Kruglov Pavel
f27fcf8372
Merge pull request #31004 from Avogar/output-formats 
Small refactoring in formats
 2021-11-17 20:44:46 +03:00
alesapin
52cd5a3c36 Merge branch 'add_4_letter_words_commands' of github.com:JackyWoo/ClickHouse into JackyWoo_add_4_letter_words_commands 2021-11-17 19:50:33 +03:00
Anton Popov
dfb9bc2a01 minor fixes in constraints 2021-11-17 18:43:02 +03:00
Amos Bird
feb3a12d34
fix 2021-11-17 23:11:23 +08:00
Amos Bird
4cfb105d5a
better 2021-11-17 22:07:56 +08:00
Amos Bird
7b9a19f066
enhance minmax_count projection 2021-11-17 22:05:57 +08:00
JackyWoo
4438e4c778 fix stress test error 2021-11-17 21:21:12 +08:00
alesapin
45cd535839 Fix my own wrong command usage 2021-11-17 15:44:07 +03:00
alesapin
5f3eca4cd1 Merge branch 'master' into JackyWoo_add_4_letter_words_commands 2021-11-17 12:59:20 +03:00
alexey-milovidov
e5fba49947
Merge pull request #31450 from ClickHouse/tavplubix-patch-6 
Change default http timeout from 1800 to 180
 2021-11-17 10:33:42 +03:00
alexey-milovidov
2a5c70c5f9
Merge pull request #31400 from ClickHouse/remove-thread-local-std-string 
Remove thread_local std::string
 2021-11-17 10:29:34 +03:00
alexey-milovidov
1e058fb207
Merge pull request #30190 from azat/ReadBuffer-throw-on-empty 
Do not allow zero-length reads
 2021-11-17 10:21:08 +03:00
mergify[bot]
41fa94f482
Merge branch 'master' into notlike-fix 2021-11-17 07:14:21 +00:00
Kseniia Sumarokova
d1374481df
Merge pull request #31457 from azat/local-pager 
Add --pager support for clickhouse-local
 2021-11-17 09:29:56 +03:00
Azat Khuzhin
bbbbd261b8 Add --pager support for clickhouse-local 2021-11-16 22:25:32 +03:00
avogar
1ebcbf4748 Fix style 2021-11-16 17:10:30 +03:00
Kruglov Pavel
be7a358f17 Fix 2021-11-16 17:10:30 +03:00
Kruglov Pavel
4f5e731513 Try fix tests 2021-11-16 17:10:30 +03:00
avogar
8e9783388b Add formats CustomSeparatedWithNames/WithNamesAndTypes 2021-11-16 17:10:30 +03:00
avogar
73d1918410 tmp 2021-11-16 17:10:30 +03:00
Nikolay Degterinsky
d365d6c496 Fix merge 2021-11-16 14:04:33 +00:00
tavplubix
9ed97eec96
Update Defines.h 2021-11-16 15:42:37 +03:00
Nikolay Degterinsky
dd3b0e4140 Merge branch 'master' into query_parameters 2021-11-16 12:42:26 +00:00
tavplubix
33122597fe
Merge pull request #31410 from stigsb/materialized-mysql-create-table-like 
Handle CREATE TABLE LIKE in MaterializedMySQL
 2021-11-16 14:10:58 +03:00
Nikolay Degterinsky
2f6a565b06 Merge branch 'master' into query_parameters 2021-11-16 10:37:58 +00:00
Nikolai Kochetov
38935d91ac
Merge pull request #31317 from azat/fix-tsan-in-async_socket_for_remote 
Fix possible data-race in case of query cancellation with async_socket_for_remote
 2021-11-16 13:03:05 +03:00
Nikolai Kochetov
15cd3dc307
Merge pull request #31006 from vzakaznikov/fix_live_view_underusing_cpu 
Fixing query performance issue in Live Views
 2021-11-16 12:43:33 +03:00
Vladimir Chebotarev
1e79177ce2 Build fix. 2021-11-16 12:31:51 +03:00
Nikolay Degterinsky
64927938c6 Minor refactor 2021-11-16 08:58:28 +00:00
Kruglov Pavel
1bbe0df945
Fix perf test 2021-11-16 11:41:50 +03:00
tavplubix
710fbebafc
Merge pull request #30977 from ClickHouse/check_dependencies_on_drop 
Check dependencies on DROP TABLE
 2021-11-16 11:38:42 +03:00
Nikolay Degterinsky
ba50e8387d Merge branch 'master' into query_parameters 2021-11-15 19:55:54 +00:00
Nikolay Degterinsky
5d07387987 Fix INFILE tests 2021-11-15 19:55:27 +00:00
Nikolay Degterinsky
5c5897c1cd Apply suggestions from code review 
Co-authored-by: Kseniia Sumarokova <54203879+kssenii@users.noreply.github.com>
 2021-11-15 17:57:26 +00:00
Kseniia Sumarokova
b040890fcf
Merge pull request #31420 from kssenii/fix-positional-args-bug 
Fix group by with positional args
 2021-11-15 20:42:58 +03:00
Ilya Yatsishin
e5301ab712
Merge pull request #31286 from cfcz48/add_oss_support 
Aliyun OSS Storage support
 2021-11-15 17:00:27 +03:00
Stig Bakken
3eac620d4d Handle CREATE TABLE LIKE in MaterializedMySQL 2021-11-15 14:43:50 +01:00
tavplubix
c3219a00aa
Merge pull request #31333 from azat/global-ctx-tmp-tables 
Do not try to resolve temporary tables from global context
 2021-11-15 16:35:02 +03:00
Vitaliy Zakaznikov
63c70f6281 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into fix_live_view_underusing_cpu 2021-11-15 07:50:27 -05:00
kssenii
6fe803e31e Fix 2021-11-15 15:09:04 +03:00
avogar
8f7be52ac4 Update test, remove commented code 2021-11-15 14:58:18 +03:00
Amos Bird
30b06a969b
Cancel vertical merges (#31057) 
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 2021-11-15 14:32:53 +03:00
Alexander Tokmakov
416a82b99a Merge branch 'master' into check_dependencies_on_drop 2021-11-15 13:35:45 +03:00
alesapin
af820f85d3
Merge pull request #31259 from azat/temporary_directories_lifetime-message-fix 
Print warning during old directories cleanup in MergeTree only if it is old
 2021-11-15 12:56:31 +03:00
avogar
8c87f8861c Fix style 2021-11-15 12:48:28 +03:00
avogar
ba06953ee7 Fix tests 2021-11-15 12:47:00 +03:00
alesapin
a4c711ba8b
Merge pull request #31406 from ClickHouse/tavplubix-patch-5 
Remove excessive debug info from the log message in DDLWorker
 2021-11-15 12:38:03 +03:00
Vladimir Chebotarev
5e9710a26e Attempt to resolve nullptr in STS credentials provider for S3. 2021-11-15 10:46:43 +03:00
Azat Khuzhin
fe36884110 Convert assert(!isGlobalContext()) to LOGICAL_ERROR 2021-11-15 10:32:19 +03:00
Azat Khuzhin
68068ff71d Remove check for clickhouse-local 
From #26231 clickhouse-local uses local context for query execution.
 2021-11-15 10:32:19 +03:00
Azat Khuzhin
fa317e96e8 Do not try to resolve temporary tables from global context 2021-11-15 10:32:19 +03:00
kssenii
37f482d478 Merge branch 'master' of github.com:ClickHouse/ClickHouse into versioning 2021-11-15 07:31:11 +00:00
kssenii
f4ffedd5f3 Better 2021-11-15 10:23:35 +03:00
alesapin
2a9ed85f23
Merge pull request #31300 from ClickHouse/fix_intersecting_parts_to_do3 
Remove strange code from mutations
 2021-11-15 10:08:32 +03:00
qieqieplus
b6aa781c9b add dot separator 2021-11-15 14:47:34 +08:00
JackyWoo
0991eddcd4 fix build error 2021-11-15 10:16:11 +08:00
tavplubix
b5b20f84bc
Update DDLWorker.cpp 2021-11-14 17:41:55 +03:00
Kseniia Sumarokova
846fbd059b
Merge pull request #31403 from kssenii/fix-client-output 
Fix client
 2021-11-14 15:01:30 +03:00
kssenii
ad1b7c83cd Fix 2021-11-14 07:19:59 +00:00
Alexey Milovidov
052a7a92e8 Whitespace 2021-11-14 10:05:20 +03:00
Alexey Milovidov
fe3ee85d80 Fix MaterializedMySQL 2021-11-14 10:04:45 +03:00
alexey-milovidov
cb6342025d
Merge pull request #31229 from zhanglistar/fsync 
Change all fsync to fdatasync
 2021-11-14 05:16:01 +03:00
Alexey Milovidov
bd684f02f2 Fix clang-tidy 2021-11-14 04:57:59 +03:00
Alexey Milovidov
1e4e36ff2d Remove thread_local std::string 2021-11-14 02:43:17 +03:00
alexey-milovidov
e323b83f6a
Merge pull request #30876 from pmed/backslash_letter_interactive_input 
add aliases for `\<letter>` interactive client commands
 2021-11-14 01:43:13 +03:00
Azat Khuzhin
f2c74a81f7 Fix QueryScope in MaterializedMySQLSyncThread 
QueryScope should exist for the whole query execution time.
 2021-11-13 20:06:08 +03:00
Kseniia Sumarokova
59d4eb99c2
Merge pull request #31291 from kssenii/update-async-reads-setting 
Make remote_filesystem_read_method=threadpool by default
 2021-11-13 19:19:35 +03:00
kssenii
f18dcd2287 Merge branch 'master' of github.com:ClickHouse/ClickHouse into seekable-read-buffers 2021-11-13 14:38:57 +03:00
Azat Khuzhin
11be942bb0 Fix possible data-race in case of query cancellation with async_socket_for_remote 
RemoteQueryExecutor::cancel() (that is called in another thread), steal
the fiber, and process any pending packets, to leave the connection in
the correct state (so that it can be reused for further queries).

However this requires processing pending packets, and this will update
the RemoteQueryExecutorReadContext::packet field, which can be read in
another thread by the RemoteQueryExecutor::read().

This was pretty tricky due to fibers, but AFAICS I understand this
correctly and this should fix the race.

Note, that if you will look at the logs from the #28854, you will see,
that all those data races was triggered after query cancellation.

Fixes: #28854
Refs: #18715

v2: fix daedlock in case of duplicated parts
v3: do not hold the mutex, since was_cancelled is atomic
 2021-11-13 12:44:02 +03:00
Kseniia Sumarokova
c7be79b4e7
Merge pull request #31136 from LiuYangkuan/IDiskRemote_metadata_disk 
use DiskPtr instead of OS's file system API in class IDiskRemote
 2021-11-13 12:16:05 +03:00
mergify[bot]
5d0306ed0c
Merge branch 'master' into notlike-fix 2021-11-12 22:35:10 +00:00
Maksim Kita
38be11a622
Merge pull request #31334 from kitaisreal/bloom-filter-index-check-fix 
BloomFilter index check fix
 2021-11-13 01:26:08 +03:00
Kseniia Sumarokova
c6fd56ede9
Update DiskLocal.cpp 2021-11-13 00:00:32 +03:00
mergify[bot]
22e7efa8b0
Merge branch 'master' into add_oss_support 2021-11-12 18:25:26 +00:00
LiuYangkuan
4366fcbc83 fix build check and make rename robust in DiskS3::restoreFileOperations 2021-11-12 22:54:10 +08:00
Tomáš Hromada
445b0ba7cc
Expose all GlobalThreadPool config params (#31285) 2021-11-12 16:24:47 +03:00
Kruglov Pavel
051a9e7c69
Merge pull request #31249 from vitlibar/fix-show-grants 
Fix SHOW GRANTS when partial revokes are used.
 2021-11-12 15:49:12 +03:00
JackyWoo
a2f3337ca1 code style change 2021-11-12 20:48:42 +08:00
tavplubix
8916d3bebf
Merge pull request #31305 from ClickHouse/rename_support_ifexists 
Merging #31081
 2021-11-12 15:22:43 +03:00
Anton Popov
7769ed76ce
Merge pull request #31261 from CurtizJ/tuple-element-to-subcolumn 
Optimize tupleElement to reading of subcolumn
 2021-11-12 15:00:53 +03:00
kssenii
6f895036e6 Disable for hdfs until tested, adjust tests with profile events 2021-11-12 14:09:19 +03:00
Vitaly Baranov
79a93c819f
Merge pull request #31262 from vitlibar/initial-user-role-row-policy 
Initial user's roles are used now to find row policies
 2021-11-12 13:51:20 +03:00
liyang830
7b88c956c8 fix: quota limit was not reached, but the limit was exceeded 2021-11-12 18:22:55 +08:00
zhanglistar
8bcef97e11 1. style check fix. 2021-11-12 17:23:22 +08:00
Maksim Kita
1b5ff67eaa BloomFilter index check fix 2021-11-12 12:22:43 +03:00
Kseniia Sumarokova
99cbf64044
Merge pull request #31325 from ClickHouse/kssenii-fix 
Fix check in async buffer
 2021-11-12 12:09:13 +03:00
Nikolai Kochetov
6623c609cf
Merge pull request #19587 from ClickHouse/refactor-pipeline-executor 
Refactor pipeline executor
 2021-11-12 11:49:05 +03:00
zhanglistar
d13256242a 1. fix sytle check 2021-11-12 16:15:39 +08:00
Kseniia Sumarokova
074d24fcf3
Merge pull request #31318 from kssenii/fix-progress-numbers-mt 
Proper progress for numbers_mt
 2021-11-12 11:13:32 +03:00
zhanglistar
4e7823ade7 1. add macosx fix 2021-11-12 15:49:21 +08:00
LiuYangkuan
f7078a17ce add DiskLocalDirectoryIterator() when path not directory or nonexist, fix remove from_path after moveDirectory in DiskS3::restoreFileOperations 2021-11-12 11:36:48 +08:00
alexey-milovidov
b1f177e2ae
Merge pull request #31309 from Civil/riscv 
Initial support for risc-v
 2021-11-12 03:41:57 +03:00
kssenii
031754b465 Fix 2021-11-12 01:37:18 +03:00
Kseniia Sumarokova
e709c3ba90
Update AsynchronousReadIndirectBufferFromRemoteFS.h 2021-11-12 01:13:44 +03:00
kssenii
f46569a46b Fix 2021-11-12 00:42:36 +03:00
Kseniia Sumarokova
1bf30709f0
Merge pull request #31258 from cccgp/move_InputCreatorFunc_to_InputCreator 
move InputCreatorFunc to InputCreator
 2021-11-12 00:05:21 +03:00
Kseniia Sumarokova
2313981fd7
Merge pull request #31260 from azat/external-cleanup 
Cleanup extern ProfileEvents/CurrentMetrics and add a style check
 2021-11-12 00:02:57 +03:00
Azat Khuzhin
10fa34c73a Print warning during old directories cleanup in MergeTree only if it is old 2021-11-11 23:57:44 +03:00
Anton Popov
4c6c80b9a2
Merge pull request #31044 from kssenii/fix-storage-merge-with-aliases-and-where 
Fix StorageMerge with aliases and where
 2021-11-11 21:46:02 +03:00
Vladimir Smirnov
48451182f8 Initial support for risc-v 
Make ClickHouse compilable and runnable on risc-v 64

So far only basic functionality was tested (on real hw),
clickhouse server runs, exceptions works, client works,
simple tests works.

What doesn't work:
 1. traces - they are always empty
 2. system.stack_trace only have first frame
 2021-11-11 19:23:34 +01:00
avogar
e5661b9b62 Minor change 2021-11-11 21:09:21 +03:00
Kruglov Pavel
1c9105da8c
Update WriteBuffer.h 2021-11-11 21:00:33 +03:00
tavplubix
de6a6f3227
Merge pull request #31180 from ClickHouse/merge_selecting_backoff 
Slightly better backoff for merge selecting task
 2021-11-11 20:57:40 +03:00
Nikolay Degterinsky
bcfe902b0d
Merge pull request #31226 from georgthegreat/master 
Fix typo in USE_MYSQL check
 2021-11-11 20:49:30 +03:00
avogar
51831afff8 Fix tests 2021-11-11 20:27:23 +03:00
alexey-milovidov
572aec481a
Update DirectoryMonitor.cpp 2021-11-11 20:17:55 +03:00
Kseniia Sumarokova
b3bacac021
Merge pull request #29894 from kssenii/retriable-http 
Make http read buffer retriable
 2021-11-11 19:50:50 +03:00
cgp
18504f545a move InputCreatorFunc to InputCreator 2021-11-12 00:34:59 +08:00
Nikolai Kochetov
36954a910e try fix header. 2021-11-11 19:30:59 +03:00
Alexander Tokmakov
73ab518e97 minor improvements 2021-11-11 19:29:56 +03:00
mergify[bot]
58c5981cab
Merge branch 'master' into refactor-pipeline-executor 2021-11-11 16:16:52 +00:00
Alexander Tokmakov
5858a4f74f remove strange code from mutations 2021-11-11 17:03:33 +03:00
Nikolay Degterinsky
0d58c5231f Better 2021-11-11 13:28:18 +00:00
kssenii
d8ef39461f Fix 2021-11-11 16:10:07 +03:00
tavplubix
ce8893ad43
Merge pull request #31010 from amosbird/narrowlock 
Only grab AlterLock when we do alter.
 2021-11-11 16:04:09 +03:00
tavplubix
51d2328d9b
Update DDLWorker.cpp 2021-11-11 15:27:38 +03:00
Nikolay Degterinsky
7b5954b736 Merge branch 'master' into query_parameters 2021-11-11 11:43:00 +00:00
Nikolai Kochetov
90cf835277 A little bit more refactoring. 2021-11-11 14:41:15 +03:00
Alexander Tokmakov
108b5a70e2 mark settings as obsolete 2021-11-11 14:21:42 +03:00
Alexander Tokmakov
627dde7aba Merge branch 'master' into merge_selecting_backoff 2021-11-11 13:43:10 +03:00
tavplubix
dd720ec9b4
Merge pull request #31252 from ClickHouse/warning_for_obsolete_settings 
Show warning if some obsolete setting changed
 2021-11-11 13:41:49 +03:00
kssenii
0dda1f280b Update setting remote_filesystem_read_method 2021-11-11 13:19:49 +03:00
Kseniia Sumarokova
e20cb0c10a
Merge branch 'master' into retriable-http 2021-11-11 11:52:06 +03:00
Nikolai Kochetov
b062c8ca51
Merge pull request #31031 from cmsxbc/throw-exception-offset-fetch-without-order-by 
improve error message while using OFFSET FETCH clause without ORDER BY
 2021-11-11 11:37:16 +03:00
cfcz48
d0425016e3 I hereby agree to the terms of the CLA available at: https://yandex.ru/legal/cla/?lang=en 
Changelog category (leave one):
New Feature

Changelog entry (a user-readable short description of the changes that goes to CHANGELOG.md):
Aliyun OSS Storage support.
 2021-11-11 16:26:29 +08:00
Vladimir C
b85710a673
Merge pull request #31105 from abel-cheng/fix-rewrite-in-local-in 2021-11-11 10:02:52 +03:00
cms
bc6616d8be
improve error message while using OFFSET FETCH clause without ORDER BY 2021-11-11 08:20:21 +08:00
avogar
c521a9131a Small refactoring of WriteBiffer-s 2021-11-11 02:11:18 +03:00
kssenii
18b9a8f7fd Fix build check 2021-11-11 02:03:56 +03:00
alexey-milovidov
e3650b865a
Merge pull request #30965 from kssenii/intersect-except-fix 
Fix cases when intersect / except is not checked
 2021-11-11 01:59:59 +03:00
Kseniia Sumarokova
c916f24a06
Merge pull request #31224 from kssenii/rename-setting 
Rename setting value read_threadpool to threadpool
 2021-11-11 01:04:58 +03:00
kssenii
62c70ce5cf Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into retriable-http 2021-11-10 21:16:11 +00:00
kssenii
175f903624 Fix 2021-11-10 21:14:17 +00:00
Anton Popov
47e19a4cd9 optimize tupleElement to reading of subcolumn 2021-11-10 22:24:28 +03:00
Vitaly Baranov
db5ac1ed06 Initial user's roles are used now to find row policies. 2021-11-10 22:21:50 +03:00
Azat Khuzhin
f9428450cd Fix OpenedFileCacheHits/OpenedFileCacheMisses 2021-11-10 21:15:27 +03:00
Azat Khuzhin
baf14444e6 Cleanup ProfileEvents and CurrentMetrics 2021-11-10 21:15:27 +03:00
Azat Khuzhin
47a18e8ac5 Remove non existing BackgroundPoolTask in ReplicatedMergeTreeQueue 2021-11-10 21:15:26 +03:00
Anton Popov
833652e8f4 Merge branch 'nikvas0/simple_optimizations' of git://github.com/nikvas0/ClickHouse into merging-constraints 2021-11-10 19:35:28 +03:00
kssenii
a2326f5035 Fix 2021-11-10 19:03:54 +03:00
Alexander Tokmakov
9d83832bde show warning if some obsolete setting changed 2021-11-10 18:49:13 +03:00
Vitaly Baranov
1579bcfd20
Merge pull request #31178 from vitlibar/backup-engines-and-improvements 
Backup engines and improvements
 2021-11-10 18:20:41 +03:00
kssenii
de1bb90fec Fix build check 2021-11-10 15:07:42 +00:00
Nikolai Kochetov
c11243619c Roll back boost contrib. 2021-11-10 18:01:26 +03:00
LiuYangkuan
006dca1362 use DiskPtr instead of OS's file system API in class IDiskRemote 2021-11-10 22:50:15 +08:00
Nikolai Kochetov
650fe5a834 Refactor a littel bit more. 2021-11-10 17:13:27 +03:00
Vitaly Baranov
b74999b6bd Fix SHOW GRANTS when partial revokes are used. 2021-11-10 17:03:02 +03:00
Anton Popov
9538dcf0c7
Merge pull request #31218 from CurtizJ/map-contains-to-subcolumn 
Optimize `mapContains` to reading of subcolumn
 2021-11-10 16:34:26 +03:00
mergify[bot]
5084003ed8
Merge branch 'master' into narrowlock 2021-11-10 13:07:07 +00:00
Vladimir C
19e2cbcabc
Apply suggestions from code review 2021-11-10 14:44:35 +03:00
kssenii
f4f0bd8b5c Fix 2021-11-10 13:16:39 +03:00
zhanglistar
aaad3f84da
Merge branch 'ClickHouse:master' into fsync 2021-11-10 17:44:08 +08:00
zhanglistar
96b8df5899 1. chagne all fsync to fdatasync 2021-11-10 17:40:16 +08:00
kssenii
6bc7fb1edf Fixes 2021-11-10 09:33:48 +00:00
kssenii
60ed991c2c Fix 2021-11-10 11:47:03 +03:00
Yuriy Chernyshov
abf4fbe82f Fix typo in USE_MYSQL check 2021-11-10 11:38:03 +03:00
kssenii
e166bfbf26 Save redirect result 2021-11-10 08:27:07 +00:00
Vitaly Baranov
71359433dd Add parameters "backups.allowed_path" and "backups.allowed_disk" to config. 2021-11-10 11:03:09 +03:00
Vitaly Baranov
606e94f4cc Fix backup of database. 2021-11-10 11:03:09 +03:00
Vitaly Baranov
e0f475c724 Split backup implementation into two parts to help implementing other backup engines. 2021-11-10 11:03:03 +03:00
kssenii
618c332f9c Rename read_threadpool to threadpool 2021-11-10 07:46:18 +00:00
JackyWoo
1cbe9f6024 fix build error 2021-11-10 10:50:12 +08:00
alexey-milovidov
7006147268
Merge pull request #31159 from snar/freebsd-disk-space 
correct disk space calculations
 2021-11-10 02:48:29 +03:00
Anton Popov
c2eb9e7e78 optimize mapContains to subcolumn 2021-11-10 00:44:51 +03:00
alexey-milovidov
b8f98fdc79
Merge pull request #31147 from georgthegreat/master 
Do not include unnecessary experimental/type_traits
 2021-11-09 23:18:10 +03:00
Vitaly Baranov
bf8606a931 Add UUID and timestamp to backup metadata. 2021-11-09 23:16:45 +03:00
Vitaly Baranov
8a93001245 Switch to XML format for backup's metadata. 2021-11-09 23:16:45 +03:00
Vitaly Baranov
cf77c0b3fc New syntax for BACKUP/RESTORE: set backup engine explicitly. 2021-11-09 23:16:40 +03:00
Alexander Tokmakov
4f542ab019 add test 2021-11-09 23:11:02 +03:00
alesapin
d4cb8dad94
Merge pull request #31175 from ClickHouse/add_unit_tests 
Add unit tests to CI
 2021-11-09 20:18:35 +03:00
sundy-li
d8aaac36ec Add stable order by tests result 2021-11-09 21:34:55 +08:00
sundy-li
45cab9f3b0 Add stable order by tests result 2021-11-09 21:31:31 +08:00
Kruglov Pavel
17085183bf
Merge pull request #31042 from Avogar/hdfs-bad-url 
Add additional hdfs url check
 2021-11-09 16:23:59 +03:00
alesapin
b91b90d639 Fix test local address 2021-11-09 16:02:17 +03:00
Alexander Tokmakov
51bd98294e better merge selecting backoff 2021-11-09 15:26:51 +03:00
kssenii
bfde7fd36c Better 2021-11-09 12:06:43 +00:00
JackyWoo
b480b40ff7 add docs 2021-11-09 19:40:35 +08:00
Dmitry Novik
406bb4d997
Merge pull request #28965 from nicelulu/issues_28774 
128bit hash-functions accepting arbitrary list of arguments
 2021-11-09 14:40:25 +03:00
kssenii
ee9ceaf7d4 Better 2021-11-09 14:27:17 +03:00
Amos Bird
33dfed584d
Fix exception message 2021-11-09 18:19:00 +08:00
Amos Bird
94fe925773
Better 2021-11-09 18:02:17 +08:00
JackyWoo
094f79c47b fix code style error 2021-11-09 17:49:42 +08:00
JackyWoo
c71fb3337f add more 4lwd commands 2021-11-09 17:39:28 +08:00
Alexandre Snarskii
c36c64a9a0 more corrections for disk size calculations 2021-11-09 12:28:59 +03:00
alesapin
68a3baf3cd
Merge pull request #31150 from ClickHouse/fix_keeper_log_gap 
Fix bug in Keeper when some logs was lost
 2021-11-09 10:28:55 +03:00
Kseniia Sumarokova
581986c0d3
Merge pull request #30997 from kssenii/rabbitmq-fixes 
RabbitMQ: fix one issue and add more tests
 2021-11-09 10:15:01 +03:00
kssenii
36f213e51c Fix build 2021-11-09 07:11:44 +00:00
sundy-li
3a981de643 ISSUES-30801: Remove not like function into RPNElement 2021-11-09 10:57:37 +08:00
Dmitry Novik
f5a92c6f0b cleanup code 2021-11-08 23:47:57 +03:00
kssenii
7e57368c82 Fix 2021-11-08 19:48:38 +00:00
Kseniia Sumarokova
c458f73138
Update AsynchronousReadIndirectBufferFromRemoteFS.cpp 2021-11-08 22:12:04 +03:00
Kseniia Sumarokova
1167e5aae8
Merge pull request #31112 from kssenii/fix-async-reads 
Fix threadpool read for remote disks
 2021-11-08 22:10:30 +03:00
tavplubix
7079a6abff
Merge pull request #31060 from ClickHouse/fix_intersecting_parts_to_do2 
Fix intersecting parts in `parts_to_do` 2
 2021-11-08 20:08:13 +03:00
mergify[bot]
f55e1439cb
Merge branch 'master' into output-formats 2021-11-08 15:33:45 +00:00
alesapin
13d39fdbd4 Fix tautology 2021-11-08 17:59:38 +03:00
Nikolai Kochetov
14a3988f8c
Merge pull request #31033 from azat/remap-log 
Log size of remapped memory (remap_executable)
 2021-11-08 17:12:04 +03:00
Dmitry Novik
0cd858263f Update protocol version 2021-11-08 16:43:34 +03:00
Dmitry Novik
a093395b9b Process incremental profile events on client 2021-11-08 16:38:31 +03:00
kssenii
dead99011b Merge branch 'master' of github.com:ClickHouse/ClickHouse into intersect-except-fix 2021-11-08 16:15:33 +03:00
Vladimir C
a3d8bcb82f
Merge pull request #31149 from vdimir/fix_optimize_syntax_fuse_functions 2021-11-08 16:14:39 +03:00
Kseniia Sumarokova
9e3f112d89
Update src/Storages/RabbitMQ/StorageRabbitMQ.h 
Co-authored-by: tavplubix <tavplubix@gmail.com>
 2021-11-08 16:10:22 +03:00
alesapin
e64efbb2b1 Fix Bug in Keeper with inability to start 2021-11-08 15:53:45 +03:00
Vladimir C
a9689c0f27
Merge pull request #25894 from vdimir/join-on-const-to-cross 2021-11-08 15:52:40 +03:00
vdimir
56bc802ee2
Support join on constant 2021-11-08 15:44:13 +03:00
vdimir
4bc9798c63
Some optimizations for constant conditions in JOIN ON 2021-11-08 15:36:34 +03:00
vdimir
2fb21906de
Disable optimize_syntax_fuse_functions by default 2021-11-08 15:25:56 +03:00
Yuriy Chernyshov
479ebc0652 Do not include unnecessary experimental/type_traits 2021-11-08 14:16:19 +03:00
kssenii
83d64f1c2d Better 2021-11-08 13:32:32 +03:00
Amr Alaa
ad81977ace
Skip max_partition_size_to_drop check in case of ATTACH PARTITION ... FROM (#30995) 
* Skip checkPartitionCanBeDropped check in case of ATTACH PARTITION ... FROM

* Add integration test

* Fix syntax error

* Fix integration test

* Fix integration test

* Fix integration test

* Skip max_partition_size_to_drop for MOVE PARTITION
 2021-11-08 13:07:14 +03:00
kssenii
ab44123f49 Fix 2021-11-08 13:00:42 +03:00
Dmitry Novik
8708e00b3a Send incremental profile events to client 2021-11-08 12:40:31 +03:00
kssenii
b4bebc5977 Add comments 2021-11-08 12:01:24 +03:00
vicgao
209d1a21e1 code style 2021-11-08 16:51:22 +08:00
vicgao
cdb1227b69 code style 2021-11-08 16:49:56 +08:00
vicgao
8e7023cdb4 rename database/table/dictionary support IF EXISTS syntax 2021-11-08 16:27:10 +08:00
mergify[bot]
9606b11903
Merge branch 'master' into fix_intersecting_parts_to_do2 2021-11-08 07:18:42 +00:00
vicgao
6020c23145 code review 2021-11-08 15:14:45 +08:00
Kseniia Sumarokova
908d78febe
Merge pull request #30851 from kssenii/clickhouse-local-improve 
Allow delayed interactive mode
 2021-11-08 10:07:29 +03:00
Alexandre Snarskii
248709ea16 correct disk space calculations 2021-11-07 19:51:48 +03:00
kssenii
90b2a67909 Skip test 2021-11-07 13:25:06 +03:00