Commit Graph

20256 Commits

Author SHA1 Message Date
Vladimir Chebotarev
30cd133418 Fixed duplication commands bug. 2021-11-25 17:11:28 +03:00
Vladimir Chebotarev
aa3eecbd6d Fixed bug with frozen mutations. 2021-11-25 17:11:27 +03:00
Vladimir Chebotarev
6599124dba Attempt to skip mutations of different partitions in StorageMergeTree. 2021-11-25 17:10:11 +03:00
Raúl Marín
b398a7bab6 Avg: Use countBytesInFilter 2021-11-25 13:50:04 +01:00
avogar
37abab7fdb Better naming 2021-11-25 15:09:13 +03:00
Kruglov Pavel
b39c19399f
Merge pull request #31691 from kssenii/testing-1
Allow named_collections for kafka / rabbit
2021-11-25 14:06:31 +03:00
Kruglov Pavel
f28130193a
Merge branch 'master' into fix-whole-text-serialization 2021-11-25 14:00:20 +03:00
Kruglov Pavel
5d1520be72
Merge pull request #31736 from Avogar/fix-json-with-progress
Fix race in JSONEachRowWithProgress output format
2021-11-25 13:58:41 +03:00
Kruglov Pavel
5f17109a84
Merge pull request #31712 from Avogar/fix-write-after-finalize
Fix possible Logical error: Cannot write to finalized buffer
2021-11-25 13:43:14 +03:00
Alexander Tokmakov
1ab8b5d4df fix segfault on attach parititon 2021-11-25 13:04:39 +03:00
alesapin
fe7f21acf9
Merge pull request #31697 from ClickHouse/fix_31686
Fix parsing of domain data types
2021-11-25 11:31:41 +03:00
Kseniia Sumarokova
87b920594e
Merge pull request #31678 from ucasfl/log
fix typo
2021-11-25 11:29:36 +03:00
Kseniia Sumarokova
93cf66df12
Merge pull request #30936 from kssenii/seekable-read-buffers
Reduce memory usage for some formats when reading with s3/url/hdfs
2021-11-25 11:19:24 +03:00
Raúl Marín
78656f4956 Merge remote-tracking branch 'blessed/master' into speedup_avg_sumcount 2021-11-25 09:17:10 +01:00
Vladimir C
e835671c88
Merge pull request #31624 from nicelulu/fix_sparkbar 2021-11-25 11:01:25 +03:00
freedomDR
c8c827fc78 fix code comment 2021-11-25 11:11:25 +08:00
alexey-milovidov
e1c2e629d8
Merge pull request #30011 from ClickHouse/hermetic-builds
Hermetic builds
2021-11-25 05:27:25 +03:00
alexey-milovidov
423d497b27
Merge pull request #31742 from CurtizJ/fix-map
Fix usage of `Buffer` table engine with type `Map`
2021-11-25 04:56:37 +03:00
Alexey Milovidov
2373456866 Fix build 2021-11-25 04:18:54 +03:00
kssenii
20c59b66f9 ClickHouse dictionary support named collections 2021-11-25 01:51:38 +03:00
Alexey Milovidov
310367fad1 Merge branch 'master' into hermetic-builds 2021-11-25 01:35:06 +03:00
alexey-milovidov
ac66433650
Merge pull request #31672 from ClickHouse/better-crosscompiling-freebsd
More easy cross-compiling for FreeBSD
2021-11-25 01:31:41 +03:00
Anton Popov
37350e007c fix mutate of ColumnMap 2021-11-25 00:05:08 +03:00
kssenii
038bdcf9b9 Fix 2021-11-24 23:56:36 +03:00
Alexey Milovidov
a4e57228cf Add a test from #31662 2021-11-24 23:09:50 +03:00
Alexey Milovidov
21f112b30e Merge branch 'better-crosscompiling-freebsd' into hermetic-builds 2021-11-24 22:43:30 +03:00
Alexey Milovidov
f1b8e2a2c8 Fix build 2021-11-24 22:43:12 +03:00
Kruglov Pavel
690b460c3d
Fix style 2021-11-24 22:36:36 +03:00
avogar
e4ba685d15 Fix race in JSONEachRowWithProgressRowOutputFormat 2021-11-24 22:29:43 +03:00
Kruglov Pavel
ad7768e42a
Fix 2021-11-24 22:25:41 +03:00
Kruglov Pavel
b20f4439df
Make better 2021-11-24 22:25:03 +03:00
kssenii
46d2fdc5e6 Update 2021-11-24 21:53:53 +03:00
tavplubix
bebee01b34
Merge pull request #31638 from ClickHouse/fix_rename_dictionary
Fix rename dictionary
2021-11-24 20:25:35 +03:00
avogar
1bd8c57908 Fix 2021-11-24 20:21:21 +03:00
Alexey Milovidov
8e4c7fccc3 Fix build 2021-11-24 20:19:52 +03:00
mergify[bot]
9ce9aef40a
Merge branch 'master' into parallel-formatting 2021-11-24 15:40:01 +00:00
Kruglov Pavel
758c0e1c5e
Fix build 2021-11-24 18:35:18 +03:00
avogar
7c84d95908 Fix possible Logical error: Cannot write to finalized buffer 2021-11-24 18:32:41 +03:00
zhangxiao871
f8190b7074 Fix min_x max_x and AST Fuzzer check 2021-11-24 23:25:30 +08:00
Alexey Milovidov
438619389f Fix build 2021-11-24 16:53:51 +03:00
Alexey Milovidov
bd1964a2eb Fix exception on some of the applications of "decrypt" function on Nullable columns 2021-11-24 16:46:20 +03:00
avogar
8d34f0c59f Minor change 2021-11-24 16:43:54 +03:00
avogar
f5447a5e74 Fix tests, support parallel formatting for Template format 2021-11-24 16:42:07 +03:00
yandd
7b43608e1f
Fixed function ngrams 2021-11-24 21:18:38 +08:00
Kseniia Sumarokova
7cf6bb5aa3
Update ExternalDataSourceConfiguration.cpp 2021-11-24 16:13:26 +03:00
mergify[bot]
2ab091a85b
Merge branch 'master' into fix-whole-text-serialization 2021-11-24 12:44:53 +00:00
Kruglov Pavel
31f1103cdd
Fix style 2021-11-24 15:44:26 +03:00
Alexander Tokmakov
e5972e6f71 fix 2021-11-24 15:44:04 +03:00
Alexey Milovidov
ecf7822153 Fix build 2021-11-24 15:28:54 +03:00
alexey-milovidov
82fd7cc212
Merge pull request #31673 from ClickHouse/remove-wrong-code-live-view
Remove outstandingly wrong code with LIVE VIEW
2021-11-24 15:20:54 +03:00
Raúl Marín
5dd3cc6595 Share code between Avg and SumCount 2021-11-24 13:13:54 +01:00
tavplubix
04b98ee1d7
Revert "Fixed null pointer exception in MATERIALIZE COLUMN" 2021-11-24 14:56:12 +03:00
kssenii
980c87c466 Add named collection for kafka / rabbit 2021-11-24 14:53:01 +03:00
alesapin
646cf38213
Merge pull request #28981 from JackyWoo/add_4_letter_words_commands
Add four letter commands to keeper
2021-11-24 13:32:36 +03:00
Raúl Marín
dde264cd53 Implement batching for SumCount 2021-11-24 11:14:31 +01:00
Raúl Marín
d2dcbdd1ee Implement batch operators for avg 2021-11-24 11:14:31 +01:00
kssenii
29579962cb Update test, tiny changes 2021-11-24 12:55:36 +03:00
Maksim Kita
527480bd8e
Merge pull request #31679 from excitoon-favorites/fixmaterializecolumn
Fixed null pointer exception in `MATERIALIZE COLUMN`
2021-11-24 12:29:23 +03:00
Maksim Kita
801c6c1e99
Merge pull request #31119 from nautaa/fix-file-log
remove unnecessary assert in StorageFileLog
2021-11-24 12:28:13 +03:00
tavplubix
5eae7710ea
Update DatabaseOnDisk.cpp 2021-11-24 12:06:19 +03:00
Vladimir Chebotarev
4f7f9795a1 Fixed null pointer exception in MATERIALIZE COLUMN. 2021-11-24 09:17:43 +03:00
feng lv
89e9569ad6 fix typo 2021-11-24 04:34:25 +00:00
Alexey Milovidov
e59e833cc6 Fix build 2021-11-24 03:11:22 +03:00
Alexey Milovidov
1acbafdffe Remove outstandingly wrong code 2021-11-24 00:48:57 +03:00
Alexander Tokmakov
9237b251d5 allow rename dict in Ordrinary, fix another issue 2021-11-23 20:53:45 +03:00
avogar
4470365fb3 Fix 2021-11-23 19:56:44 +03:00
avogar
b81d8426d3 Clean up 2021-11-23 19:56:43 +03:00
avogar
a900a26691 Support parallel formatting for all text output formats 2021-11-23 19:56:43 +03:00
Kruglov Pavel
6987e5bfd0
Update SerializationDecimal.cpp 2021-11-23 17:30:52 +03:00
Kruglov Pavel
d68880754c
Merge pull request #31652 from ClickHouse/Avogar-patch-1
Try to fix possible data race in RemoteQueryExecutorReadContext
2021-11-23 16:47:29 +03:00
Kruglov Pavel
b63b47f0f0
Merge pull request #31265 from Avogar/fix-write-buffers
Fix and refactor WriteBiffer-s a little
2021-11-23 16:46:09 +03:00
Kruglov Pavel
6d942401bb
Merge pull request #31510 from azat/fix-progress-for-insert
Fix progress for short INSERT SELECT queries
2021-11-23 16:37:06 +03:00
Ilya Golshtein
ae15126d20 just more verbose comment 2021-11-23 12:56:14 +00:00
Ilya Golshtein
e27ce34cf2 get Build ID via Section headers first 2021-11-23 12:56:14 +00:00
alexey-milovidov
341f705419
Merge pull request #30599 from ClickHouse/zlib-ng-own-cmake
Use our own CMakeLists for `zlib-ng`, `cassandra`, `mariadb-connector-c` and `xz`, `re2`, `sentry`, `gsasl`, `arrow`, `protobuf`.
2021-11-23 13:33:29 +03:00
alesapin
16f034fe4c Flush bytes after 4 letter commands 2021-11-23 13:31:10 +03:00
Kruglov Pavel
65233110ae
Try to fix possible data race 2021-11-23 12:43:06 +03:00
tavplubix
7a43a87f5b
Use shard and replica name from Replicated database arguments (#31488)
* fix another issue

* use shard and replica name from Replicated database

* fix

Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2021-11-23 12:41:54 +03:00
Vitaly Baranov
8eae84b8cf
Merge pull request #31607 from vitlibar/stop-reloading-all-configs-on-shutdown-early
Stop all periodic reloading of all the configuration files on shutdown earlier
2021-11-22 22:45:14 +03:00
kssenii
7fae3b1cc9 Update tests 2021-11-22 20:57:31 +03:00
tavplubix
d2aa56fc1f
Update DatabaseOnDisk.cpp 2021-11-22 20:44:06 +03:00
Alexander Tokmakov
5868f7590c fix race between replicas 2021-11-22 19:46:34 +03:00
Alexander Tokmakov
ba6adafae3 Merge branch 'master' into tavplubix-patch-4 2021-11-22 18:50:38 +03:00
tavplubix
667dbef4a0
Merge branch 'master' into fix_rename_dictionary 2021-11-22 18:48:22 +03:00
Alexander Tokmakov
d56950a207 fix rename dictionary 2021-11-22 18:41:35 +03:00
kssenii
4c41e719ed Add comments 2021-11-22 18:09:45 +03:00
alesapin
5825242a7d Merge branch 'add_4_letter_words_commands' of github.com:JackyWoo/ClickHouse into JackyWoo_add_4_letter_words_commands 2021-11-22 18:02:22 +03:00
alesapin
35de9e42d9
Merge branch 'master' into add_4_letter_words_commands 2021-11-22 18:02:02 +03:00
tavplubix
0772f6c215
Merge pull request #31584 from ClickHouse/debug_expired_sessions
Try to debug expired sessions
2021-11-22 17:06:46 +03:00
mergify[bot]
2adaf54d33
Merge branch 'master' into fix-whole-text-serialization 2021-11-22 14:00:51 +00:00
mergify[bot]
a9c1fd1647
Merge branch 'master' into fix-write-buffers 2021-11-22 13:59:31 +00:00
Anton Popov
43cfa4467b
Merge pull request #31476 from CurtizJ/merging-constraints
Merging #18787 (Constraints)
2021-11-22 15:57:59 +03:00
Kruglov Pavel
8391f1f315 Update ISerialization.cpp 2021-11-22 14:26:48 +03:00
avogar
9bee988e16 Fix tests 2021-11-22 14:26:48 +03:00
avogar
ec9e87aff1 Fix deserializeWholeText 2021-11-22 14:26:48 +03:00
mergify[bot]
a7ba3e23a0
Merge branch 'master' into fix-write-buffers 2021-11-22 11:24:27 +00:00
avogar
b8695e8236 Fix comments 2021-11-22 14:19:26 +03:00
tavplubix
dc6d48ff83
Merge pull request #31292 from stigsb/materialized-mysql-atomic-only
Drop support for DatabaseOrdinary in MaterializedMySQL
2021-11-22 14:03:50 +03:00
Kruglov Pavel
814a36ba69
Merge pull request #31434 from Avogar/custom-with-names-and-types
Add formats CustomSeparatedWithNames/WithNamesAndTypes
2021-11-22 13:24:00 +03:00
zhangxiao871
5f10159a7d Fix sparkbars are not aligned. 2021-11-22 18:07:08 +08:00
Nikolai Kochetov
b814f54f50
Merge pull request #31474 from amosbird/projection-improve6
Allow partition column to be used for minmax_count projection
2021-11-22 13:01:57 +03:00
Vitaly Baranov
2f8c829395 Stop all periodic reloading of all the configuration files on shutdown earlier. 2021-11-22 12:26:05 +03:00
kssenii
05c548035f Some fixes 2021-11-22 11:04:04 +03:00
Anton Popov
c034491da9 fix style check 2021-11-21 23:02:33 +03:00
Anton Popov
afe8d3c424 refactor merged index conditions 2021-11-21 22:49:34 +03:00
Alexey Milovidov
c5fcef03c3 Remove trash 2021-11-21 18:12:05 +03:00
alesapin
1cf204c581 Small changes 2021-11-21 15:28:45 +03:00
Alexey Milovidov
6246cec409 Fix build on AArch64 2021-11-21 14:30:04 +03:00
Alexey Milovidov
d604cf5573 Remove the infamous "unbundled" build 2021-11-21 13:58:26 +03:00
alexey-milovidov
faae69f631
Merge pull request #31534 from aiven/kmichel-fix-json-colum-name-encoding
Fix invalid JSON in column names
2021-11-21 11:34:33 +03:00
alexey-milovidov
4cdb40e3cd
Merge pull request #31565 from azat/fix-MySQLWire
Fix MySQLWire format (this will also fix performance tests)
2021-11-21 11:32:53 +03:00
alexey-milovidov
796c76638a
Merge pull request #31574 from ClickHouse/fix-trash
Fix broken non-x86 builds
2021-11-21 01:16:44 +03:00
tavplubix
711b738dd1
Merge pull request #31542 from ClickHouse/mutations_remove_multimap
Remove strange multimap for mutations in StorageMergeTree
2021-11-20 20:41:49 +03:00
Alexander Tokmakov
856502fa81 log long operations in Keeper 2021-11-20 20:39:31 +03:00
Vitaly Baranov
9a0d98fa6d
Merge pull request #31557 from vitlibar/better-exception-message-wrong-user-hash
Better exception message wrong user hash
2021-11-20 19:47:07 +03:00
Kruglov Pavel
d9c1a0c8ec
Merge branch 'master' into fix-write-buffers 2021-11-20 17:48:24 +03:00
Azat Khuzhin
dd7f780978 Fix Progress for short INSERT SELECT queries
Note, that we cannot send Progress for regular INSERT (w/ VALUES) w/o
breaking protocol compatibility, but it can be done by increasing
revision.
2021-11-20 16:41:35 +03:00
Azat Khuzhin
0b4d855c08 Reduce copy-paste in TCPHandler::processInsertQuery() 2021-11-20 16:41:35 +03:00
kssenii
6c8867a719 Fix style check 2021-11-20 16:21:43 +03:00
Alexey Milovidov
e898c6608c Fix broken non-x86 builds 2021-11-20 15:58:44 +03:00
Azat Khuzhin
6aa94ae032 Fix MySQLWire format (in case of multiple writes)
In case of multiple writes File() engine will set doNotWritePrefix(),
and this will avoid serializations initilization, move this to do this
always.

Fixes: #31004
2021-11-20 15:26:21 +03:00
kssenii
ff969b4605 Merge branch 'master' of github.com:ClickHouse/ClickHouse into seekable-read-buffers 2021-11-20 15:03:13 +03:00
kssenii
f29ef7d18b Add one more test 2021-11-20 15:01:45 +03:00
Kevin Michel
edbeeaf6ec
Fix invalid JSON in column names
If the column name contains invalid UTF-8 sequences
and the output data types are all considered safe,
then the output will not be sanitized and the generated
JSON will be invalid.

A minimal reproduction case is :
`SELECT length('\x80') FORMAT JSONCompact`
where we auto-generate a non-UTF-8 column name with only
integer outputs, whereas :
`SELECT '\x80' FORMAT JSONCompact`
would be sanitized because the column type is String and
will trigger UTF-8 sanitization over the entire document.
2021-11-20 12:35:41 +01:00
kssenii
fda66adf52 Correct merge with master 2021-11-20 13:47:55 +03:00
Vladimir C
4498aecaf6
Merge pull request #31528 from vdimir/disable_partial_merge_join_left_table_buffer_bytes 2021-11-20 13:11:35 +03:00
kssenii
29978f9707 Merge branch 'master' of github.com:ClickHouse/ClickHouse into vxider-window-view 2021-11-20 12:13:39 +03:00
Vitaly Baranov
57ac39f99e Add more information to exceptions raised by UsersConfigAccessStorage. 2021-11-20 12:10:45 +03:00
kssenii
5c9509d68b Fix attach 2021-11-20 12:03:39 +03:00
Alexey Milovidov
9ca5c960b7 Remove useless code 2021-11-20 10:06:28 +03:00
Alexey Milovidov
334535a4c4 Better exception message when users.xml cannot be loaded due to bad password hash 2021-11-20 10:06:20 +03:00
Vitaly Baranov
940b5edbd7
Merge pull request #31509 from vitlibar/split-row-policy-and-quota-headers
Split row policy and quota headers
2021-11-20 10:01:18 +03:00
Vitaly Baranov
0684b28377
Merge pull request #31337 from sunny19930321/fix-use-quota-bug
fix: quota limit was not reached, but the limit was exceeded
2021-11-20 09:52:24 +03:00
tavplubix
67753e5b83
Update StorageMergeTree.cpp 2021-11-19 20:05:45 +03:00
Alexander Tokmakov
8d7413b0d6 remove strange multimap from mutations 2021-11-19 19:54:43 +03:00
Kruglov Pavel
4856b50c23
Merge pull request #31409 from excitoon-favorites/s3envsegfaults
Resolve `nullptr` in STS credentials provider for S3
2021-11-19 18:45:38 +03:00
alesapin
1afef1733b Ignore overhead 2021-11-19 18:22:46 +03:00
Anton Popov
099c40d251 fix tests 2021-11-19 17:14:56 +03:00
Kruglov Pavel
fdd1f53d3a
Update CustomSeparatedRowOutputFormat.h 2021-11-19 16:52:48 +03:00
Kruglov Pavel
3070bf1e4d
Update CustomSeparatedRowOutputFormat.cpp 2021-11-19 16:52:31 +03:00
Kruglov Pavel
cded91b013
Update verbosePrintString.h 2021-11-19 16:51:49 +03:00
Kruglov Pavel
eb1cc834dc
Merge branch 'master' into custom-with-names-and-types 2021-11-19 16:51:25 +03:00
kssenii
9bdad8ab64 Rewrite from DataStreams to Processors 2021-11-19 16:09:12 +03:00
alesapin
587a1a622d Fix tests 2021-11-19 16:03:01 +03:00
alesapin
d1eba74c04 Trim string 2021-11-19 13:52:03 +03:00
SuperDJY
dd2972b8c3
return fake create query when executing show create table on system's tables. (#31391)
* clarify that cannot show create table of system's tables

* clarify that cannot show create table of system's tables in the document

* bypass test style-check for required `database=currentDatabase()` because `show create table` do not have condition

* rename supportsShowCreateTable to isSystemStorage

* build fake create query for show create table of system's tables

* fix tests for show create table on system's table:

1. only build fake create query when cannot get real query
2. only test rocksdb when it's enabled.

* fix test for show create table system.tables

* fix test for ASTCreateQuery set table and database

* change to LOGICAL_ERROR when cannot get in_memory metadata

Co-authored-by: tavplubix <tavplubix@gmail.com>

* implement common getCreateQueryFromStorage

Co-authored-by: tavplubix <tavplubix@gmail.com>
2021-11-19 13:25:55 +03:00
vdimir
2e0d3efba0
disable partial_merge_join_left_table_buffer_bytes due to bug 2021-11-19 12:59:23 +03:00
vdimir
f3d0e6d999
remove partial_merge_join_optimizations
this option is redundant because optimization is controlled by partial_merge_join_left_table_buffer_bytes
2021-11-19 12:58:46 +03:00
alesapin
7820af7cbd More compatible output format 2021-11-19 12:48:38 +03:00
alesapin
f33e93e305 Merge branch 'add_4_letter_words_commands' of github.com:JackyWoo/ClickHouse into JackyWoo_add_4_letter_words_commands 2021-11-19 12:31:03 +03:00