Commit Graph

19716 Commits

Author SHA1 Message Date
Vladimir C
a3d8bcb82f
Merge pull request #31149 from vdimir/fix_optimize_syntax_fuse_functions 2021-11-08 16:14:39 +03:00
Kseniia Sumarokova
9e3f112d89
Update src/Storages/RabbitMQ/StorageRabbitMQ.h
Co-authored-by: tavplubix <tavplubix@gmail.com>
2021-11-08 16:10:22 +03:00
alesapin
e64efbb2b1 Fix Bug in Keeper with inability to start 2021-11-08 15:53:45 +03:00
Vladimir C
a9689c0f27
Merge pull request #25894 from vdimir/join-on-const-to-cross 2021-11-08 15:52:40 +03:00
vdimir
56bc802ee2
Support join on constant 2021-11-08 15:44:13 +03:00
vdimir
4bc9798c63
Some optimizations for constant conditions in JOIN ON 2021-11-08 15:36:34 +03:00
vdimir
2fb21906de
Disable optimize_syntax_fuse_functions by default 2021-11-08 15:25:56 +03:00
Yuriy Chernyshov
479ebc0652 Do not include unnecessary experimental/type_traits 2021-11-08 14:16:19 +03:00
kssenii
83d64f1c2d Better 2021-11-08 13:32:32 +03:00
Amr Alaa
ad81977ace
Skip max_partition_size_to_drop check in case of ATTACH PARTITION ... FROM (#30995)
* Skip checkPartitionCanBeDropped check in case of ATTACH PARTITION ... FROM

* Add integration test

* Fix syntax error

* Fix integration test

* Fix integration test

* Fix integration test

* Skip max_partition_size_to_drop for MOVE PARTITION
2021-11-08 13:07:14 +03:00
kssenii
b4bebc5977 Add comments 2021-11-08 12:01:24 +03:00
vicgao
209d1a21e1 code style 2021-11-08 16:51:22 +08:00
vicgao
cdb1227b69 code style 2021-11-08 16:49:56 +08:00
vicgao
8e7023cdb4 rename database/table/dictionary support IF EXISTS syntax 2021-11-08 16:27:10 +08:00
mergify[bot]
9606b11903
Merge branch 'master' into fix_intersecting_parts_to_do2 2021-11-08 07:18:42 +00:00
vicgao
6020c23145 code review 2021-11-08 15:14:45 +08:00
Kseniia Sumarokova
908d78febe
Merge pull request #30851 from kssenii/clickhouse-local-improve
Allow delayed interactive mode
2021-11-08 10:07:29 +03:00
Alexandre Snarskii
248709ea16 correct disk space calculations 2021-11-07 19:51:48 +03:00
kssenii
fdaca4d8be Better 2021-11-06 19:12:32 +00:00
tavplubix
94a66f724e
Merge pull request #30135 from FArthur-cmd/add_parallel_reading_from_infile
Add parallel file reading `FROM INFILE` in client
2021-11-06 15:54:27 +03:00
abel-wang
2e52277cd7 Rewrite right distributed table in local join. 2021-11-06 11:07:01 +08:00
kssenii
03c16117b3 Tiny fix 2021-11-05 20:12:34 +00:00
kssenii
9189966106 Fix 2021-11-05 20:01:21 +03:00
Vitaly Baranov
78e9af8f0a
Merge pull request #31013 from vitlibar/no-sessions-in-clickhouse-dictionary-source
Disable using session log for the local session inside Clickhouse dictionary source
2021-11-04 18:04:22 +03:00
kssenii
4bc2a29345 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into retriable-http 2021-11-04 14:41:24 +00:00
kssenii
b95f0738fb Fix 2021-11-04 14:39:53 +00:00
vicgao
ec2c70ab75 rename/exchange database/table/dictionary support IF EXISTS syntax 2021-11-04 22:35:34 +08:00
kssenii
26c4affc18 Fixes 2021-11-04 11:00:35 +00:00
Azat Khuzhin
7769d75088 Log size of remapped memory (remap_executable) 2021-11-04 00:19:00 +03:00
Alexander Tokmakov
d4677dc6d8 fix intersecting parts in parts_to_do 2 2021-11-03 21:48:17 +03:00
Vitaly Baranov
49d8360fc5 Turn off sending events for the LOCAL interface to the system log. 2021-11-03 16:21:34 +03:00
Vladimir C
6dc51bf540
Merge pull request #31035 from vdimir/fuse-syntax-settings 2021-11-03 16:13:44 +03:00
Vitaly Baranov
bdf640326b Clickhouse dictionary source no longer keep a session after creation.
This fixes tsan alert on shutdown.
2021-11-03 16:12:39 +03:00
vdimir
08545795b5
Separate option for enabling fuse syntax for sum, avg, count 2021-11-03 15:13:09 +03:00
kssenii
38466cb76f Storage merge fix aliases with where 2021-11-03 14:17:11 +03:00
Kruglov Pavel
77f5ef476a
Merge branch 'master' into hdfs-bad-url 2021-11-03 14:08:55 +03:00
avogar
3839d521a0 Add additional hdfs url check 2021-11-03 14:01:50 +03:00
Nikita Mikhaylov
59c8ed9b0c
Fixed is_cancelled predicate inside MergeTask (#30996) 2021-11-03 13:25:45 +03:00
Vitaly Baranov
1f217aeb5a
Merge pull request #30998 from vitlibar/rename-access-control-manager
Rename AccessControlManager
2021-11-03 12:20:17 +03:00
kssenii
285742dcba Fix tests 2021-11-03 11:57:33 +03:00
Kruglov Pavel
327a34e9da
Merge pull request #30497 from Avogar/null-deserialization
Add custom null representation support for TSV/CSV input formats, fix Nullable(String) deserializing in some formats
2021-11-03 11:30:25 +03:00
Kruglov Pavel
a22ab40468
Merge pull request #24539 from ildus/map_combinator
add Map combinator for the Map type
2021-11-03 11:25:23 +03:00
Kruglov Pavel
2f950ee138
Merge pull request #30927 from CurtizJ/with-fill-interval
Support `INTERVAL` type in `STEP` clause for `WITH FILL` modifier
2021-11-03 11:23:21 +03:00
Amos Bird
710f7d64e4
Add retry to check alter_partition_version 2021-11-03 15:48:16 +08:00
Anton Popov
2a617e6a5a
Merge pull request #31003 from kssenii/sql-json-fix
Allow spaces in JSONPath.
2021-11-03 00:59:54 +03:00
mergify[bot]
1ba871a664
Merge branch 'master' into fix-format-row 2021-11-02 21:56:44 +00:00
Anton Popov
44875ae79d fix pvs check 2021-11-03 00:06:08 +03:00
kssenii
feb3d8bc75 Merge branch 'master' of github.com:ClickHouse/ClickHouse into clickhouse-local-improve 2021-11-02 20:01:15 +00:00
Kseniia Sumarokova
065106c299
Merge pull request #30690 from kssenii/partitioned-write
Partitioned write for file, hdfs, url storages and table functions
2021-11-02 22:58:16 +03:00
kssenii
b899dd9af5 Better 2021-11-02 22:47:27 +03:00
Vitaly Baranov
cb05c0504e Move more implementations from headers to cpp. 2021-11-02 22:38:32 +03:00
Amos Bird
b25b778349
Only grab AlterLock when we do alter. 2021-11-03 01:08:17 +08:00
kssenii
f662c1829d Fix 2021-11-02 18:08:10 +03:00
kssenii
01684ad05a Fix 2021-11-02 16:53:47 +03:00
avogar
62c5951dd7 Fix segfault in formatRow function 2021-11-02 16:26:14 +03:00
Kruglov Pavel
1d2f197e70
Fix build 2021-11-02 16:09:20 +03:00
Kseniia Sumarokova
4c675f0151
Merge pull request #30970 from kssenii/add-setting-for-remote-reads
Add settings for remote async reads
2021-11-02 15:28:09 +03:00
Kruglov Pavel
3b12c54bf9
Fix PVS check 2021-11-02 15:05:59 +03:00
Vitaly Baranov
afe2c9c040 Rename AccessControlManager -> AccessControl. 2021-11-02 14:06:20 +03:00
avogar
42ab57f0e5 Set output_format_avro_rows_in_file default to 1 2021-11-02 14:06:10 +03:00
Kruglov Pavel
901ebcede6
Merge pull request #30351 from arenadata/ADQM-335
output_format_avro_rows_in_file
2021-11-02 12:25:27 +03:00
Kruglov Pavel
1f8535c02b
Merge branch 'master' into null-deserialization 2021-11-02 12:15:21 +03:00
Vitaly Baranov
a0c38a3dfd Rename AuthenticationType::MAX_TYPE. 2021-11-02 12:02:22 +03:00
kssenii
9080d2ea52 Fix tests 2021-11-02 07:27:13 +00:00
alesapin
085cb275de
Merge pull request #30826 from azat/replicated-mt-fix-sanity-on-failed-drop
Fix possible "The local set of parts of X doesn't look like the set of parts in ZooKeeper" error
2021-11-02 10:15:43 +03:00
Vitaly Baranov
acf4e66771
Merge pull request #30973 from vitlibar/move-access-code
Move access-rights source code
2021-11-02 09:57:15 +03:00
robot-clickhouse
4289336c27 Auto version update to [21.12.1.1] [54457] 2021-11-02 00:56:45 +03:00
Kruglov Pavel
9a1275cb10
Merge pull request #30178 from Avogar/tsv-csv
Refactor and improve TSV, CSV, JSONCompactEachRow, RowBinary formats. Fix bugs in formats
2021-11-02 00:38:30 +03:00
Kseniia Sumarokova
351c7bc8d6
Merge pull request #30881 from kssenii/fix-local-verbose
clickhouse-local interactive fix --verbose and allow logging into file
2021-11-01 23:08:49 +03:00
alexey-milovidov
af4a0a9ed2
Merge pull request #29528 from DimasKovas/allow_nulls_first_in_key_condition
Support NULLS FIRST in KeyCondition
2021-11-01 23:02:22 +03:00
alexey-milovidov
38f7d1ebc2
Update KeyCondition.cpp 2021-11-01 22:59:57 +03:00
Vitaly Baranov
3bc9bf28f4
Merge pull request #30688 from vitlibar/backup-and-restore-for-log-family
Implement BACKUP & RESTORE for Log family
2021-11-01 19:57:39 +03:00
Vitaly Baranov
ab01b9afc8 Split Authentication.h to common and main parts. 2021-11-01 19:13:49 +03:00
Vitaly Baranov
3ed7f8f0b3 Move access-rights' source files needed for parser to a separate target. 2021-11-01 19:13:49 +03:00
kssenii
53c0e1ae61 Add setting for remote reads 2021-11-01 18:14:18 +03:00
kssenii
35349056b8 Fix 2021-11-01 16:33:19 +03:00
Vladimir C
503a418ded
Merge pull request #30797 from ianton-ru/MDB-15168 2021-11-01 13:11:21 +03:00
Ilya Golshtein
8efa1743cf output_format_avro_rows_in_file fix and test for _timestamp 2021-11-01 13:09:18 +03:00
Vladimir C
77edd081a5
Fix whitespace in src/Disks/S3/DiskS3.cpp 2021-11-01 13:00:21 +03:00
alexey-milovidov
04f5c4bd9a
Merge pull request #30938 from kssenii/fix-local-file-progress
Fix file progress for clickhouse-local
2021-11-01 12:39:12 +03:00
Vitaly Baranov
a1f29d31ea Support BACKUP & RESTORE for log family. 2021-11-01 12:07:17 +03:00
Vladimir C
2e58a3bf62
Merge branch 'master' into MDB-15168 2021-11-01 11:59:13 +03:00
Kruglov Pavel
9f6af8501e
Fix build 2021-11-01 11:58:49 +03:00
Vladimir C
9d967e9883
Merge pull request #30840 from nickitat/nickitat_any_type_4_arrayStringConcat 2021-11-01 11:48:45 +03:00
Vitaly Baranov
8fbd6e3d46
Merge pull request #30941 from vitlibar/fix-flaky-read-tiny-log
Fix reading from TinyLog
2021-11-01 11:44:06 +03:00
Azat Khuzhin
60a411581f Fix possible "The local set of parts of X doesn't look like the set of parts in ZooKeeper" error
If during removing replica_path from zookeeper, some error occurred
(zookeeper goes away), then it may not remove everything from zookeeper.

And on DETACH/ATTACH (or server restart, like stress tests does in the
analysis from this comment [1]), it will trigger an error:

    The local set of parts of table test_1.alter_table_4 doesn't look like the set of parts in ZooKeeper:

  [1]: https://github.com/ClickHouse/ClickHouse/pull/28296#issuecomment-915829943

Fix this, by removing "metadata" at first, and only after this
everything else, this will avoid this error, since on ATTACH such table
will be marked as read-only.

v2: forget to remove remote_replica_path itself
v3: fix test_drop_replica by adding a check for remote_replica_path existence
2021-11-01 08:59:28 +03:00
Azat Khuzhin
ca22e7acfb Use existing local remote_replica_path var in StorageReplicatedMergeTree::dropReplica() 2021-11-01 08:53:31 +03:00
Vitaly Baranov
d2363d625c Fix reading from TinyLog. 2021-11-01 04:07:43 +03:00
alexey-milovidov
e879c510b8
Merge pull request #30917 from ClickHouse/miscellaneous
Miscellaneous
2021-11-01 00:44:16 +03:00
kssenii
d7dab834ec Fix file progress for local 2021-11-01 00:33:03 +03:00
Anton Popov
07d6013bc6 fix with fill 2021-10-31 22:48:12 +03:00
alexey-milovidov
f652c8ce24
Merge pull request #30852 from ucasfl/modify-table-comment
enable modify table comment of rest table engine
2021-10-31 22:12:07 +03:00
alexey-milovidov
ac38f8f459
Merge pull request #30903 from ClickHouse/reimplement-28639
Reimplement #28639
2021-10-31 22:10:58 +03:00
Kseniia Sumarokova
ca48c5f302
Merge pull request #30832 from ucasfl/filelog-fix
filelog engine tests improve
2021-10-31 21:27:48 +03:00
Anton Popov
aff2711f1a support INTERVAL type in WITH FILL 2021-10-31 19:42:43 +03:00
Vitaly Baranov
d29b73e301
Merge pull request #30689 from vitlibar/refactor-log-family
Refactoring of Log family
2021-10-31 18:50:08 +03:00
Alexey Milovidov
993f3faefd Miscellaneous 2021-10-31 18:11:46 +03:00
Pavel Medvedev
7b50ab7136 skip spaces before and after \<letter> alias
... for proper single letter like `\l`, `\d` handling.

Using `std::search()` for alias substring search instead of `.starts_with()`
to get the alias start position, to check the leading range contains only space
characters, and to get the rest of input after the space.

See issue #9339
2021-10-31 15:46:30 +01:00
alexey-milovidov
1285d3bd8c
Merge pull request #30877 from amosbird/projection-fix22
Fix invalid header in projection block calculation
2021-10-31 16:30:02 +03:00
mergify[bot]
3cb034880b
Merge branch 'master' into allow_nulls_first_in_key_condition 2021-10-31 12:19:08 +00:00
Alexey Milovidov
c38540786e Reimplement #28639 2021-10-31 15:11:00 +03:00
alexey-milovidov
b18e5fcfe4
Merge branch 'master' into issues_28774 2021-10-31 15:07:26 +03:00
mergify[bot]
1102b1dcef
Merge branch 'master' into tsv-csv 2021-10-31 12:03:24 +00:00
alexey-milovidov
34009ea4a3
Merge pull request #30310 from amosbird/projection-fix20
Fix IN set filtering when projection is used.
2021-10-31 15:00:45 +03:00
alexey-milovidov
15b9d65221
Merge pull request #30662 from azat/conf-clickhouse
Switch everything left from `<yandex>` to `<clickhouse>`
2021-10-31 14:56:51 +03:00
alexey-milovidov
459130b179
Merge pull request #30887 from amosbird/setindexfix
Fix index analysis for set index
2021-10-31 14:50:11 +03:00
alexey-milovidov
35c6558043
Merge pull request #30864 from ClickHouse/fix-server-revision
Fix protocol revision.
2021-10-31 14:24:55 +03:00
alexey-milovidov
38518070b7
Merge pull request #30882 from vitlibar/rename-columns-in-session-log
Rename columns in SessionLog
2021-10-31 12:30:01 +03:00
alexey-milovidov
0ffb580515
Merge pull request #30888 from CurtizJ/with-fill-no-rows
Fix WITH FILL with set TO and FROM and no rows in result set
2021-10-31 12:29:07 +03:00
alexey-milovidov
6b2dc88dd6
Merge pull request #30886 from ClickHouse/client-fix-parallel-formatting
Fix parallel formatting and progress flicker in clickhouse-client
2021-10-31 12:27:38 +03:00
alesapin
2b28e87a7f
Merge pull request #30880 from ClickHouse/fix_message_keeper
Fix error message in Keeper handler
2021-10-31 10:43:16 +03:00
Amos Bird
b3a8ad124f
Fix index analysis for set index 2021-10-31 12:35:20 +08:00
Vitaly Baranov
0e8c9b089f Keep indices for StorageStripeLog in memory. 2021-10-31 03:52:41 +03:00
Vitaly Baranov
42596b16bc Make StorageLog.cpp to implement both Log and TinyLog engines.
Refactoring of implementation of the Log family.
2021-10-31 03:52:36 +03:00
Anton Popov
5fe4bcd22e fix WITH FILL with set TO and FROM and no rows in result set 2021-10-30 21:38:40 +03:00
alexey-milovidov
c504e0c08d
Update ClientBase.cpp 2021-10-30 21:17:38 +03:00
alexey-milovidov
9adff8a2b8
Merge pull request #30871 from ClickHouse/parse-date-yyyymmdd
Allow to parse Date as YYYYMMDD
2021-10-30 21:10:41 +03:00
Alexey Milovidov
05c2cd098c Fix parallel formatting and progress flicker in clickhouse-client 2021-10-30 21:02:33 +03:00
Vitaly Baranov
54c89e0f0e Rename column "changed_settings"->"settings" in SessionLog. 2021-10-30 17:59:56 +03:00
Vitaly Baranov
973a7aea92 Rename columns "session_id"->"auth_id", "session_name"->"session_id" in SessionLog. 2021-10-30 17:59:32 +03:00
Nikolai Kochetov
1404af4c1e Fix style. 2021-10-30 17:47:50 +03:00
mergify[bot]
de43a7f4b0
Merge branch 'master' into fix-server-revision 2021-10-30 14:41:18 +00:00
kssenii
e97233f33d Fix --verbose in local and logging 2021-10-30 17:23:24 +03:00
alesapin
30ab4b3a7f
Update KeeperTCPHandler.cpp 2021-10-30 16:02:05 +03:00
Maksim Kita
2e3ff53725
Merge pull request #30708 from ClickHouse/revert-30707-revert-30673-improve-usability-remote-host-filter
Revert "Revert "Improve usability of `remote_url_allow_hosts`""
2021-10-30 15:55:24 +03:00
alesapin
40bffcec3a Fix error message in Keeper 2021-10-30 15:32:29 +03:00
Amos Bird
d647a2db0c
Fix invalid header in projection block calculation 2021-10-30 17:26:43 +08:00
Pavel Medvedev
f4e3d053c2 add aliases for \<letter> interactive client commands
initial implementation for:
  * \d aka SHOW TABLES
  * \l aka SHOW DATABASES
  * \c aka USE

Replace prefix of interactive `input` string with an aliased command
inside of the loop of `ClientBase::runInteractive()` in order to allow
command parameters, like `\c db_name`.

See issue #9339
2021-10-30 09:00:45 +02:00
Alexey Milovidov
aa737b7a11 Allow to parse Date as YYYYMMDD 2021-10-30 00:23:03 +03:00
mergify[bot]
cf227c477a
Merge branch 'master' into alter_in_memory_db 2021-10-29 19:41:53 +00:00
Kseniia Sumarokova
6035e0498b
Merge pull request #30786 from kssenii/fix-filelog-test
Fix test 02022
2021-10-29 22:06:28 +03:00
Kseniia Sumarokova
bf290d0678
Merge pull request #30837 from kssenii/remove-redundant
Remove redundant from http buffer
2021-10-29 22:04:06 +03:00
Kseniia Sumarokova
2050d0a33d
Merge pull request #30793 from lingtaolf/feature/function_mapExtractKeyLike
Add  new function mapExtractKeyLike
2021-10-29 21:54:39 +03:00
tavplubix
a5901f2901
Update DatabasesCommon.cpp 2021-10-29 19:58:13 +03:00
Alexander Tokmakov
3933cd8259 support alter table for Memory database 2021-10-29 19:47:57 +03:00
Nikolai Kochetov
41c2c24b61 Fix protocol revision. 2021-10-29 19:18:36 +03:00
Nikolai Kochetov
73395e02be Fix UpgradableLock. 2021-10-29 18:08:01 +03:00
avogar
8213003422 Fix PVS check, mark tests as no-parallel 2021-10-29 16:51:57 +03:00
Kruglov Pavel
7d4f211d5b
Merge branch 'master' into tsv-csv 2021-10-29 16:38:06 +03:00
mergify[bot]
00b1024d75
Merge branch 'master' into map_combinator 2021-10-29 13:36:47 +00:00
kssenii
07bab5193f Delayed interactive 2021-10-29 16:23:53 +03:00
Kseniia Sumarokova
b49797ad51
Update ReadBufferFromS3.cpp 2021-10-29 15:54:40 +03:00
Nikolai Kochetov
a482ed3db3 Add custom ugradable lock. 2021-10-29 15:34:55 +03:00
feng lv
6f12348282 enable modify table comment of some table 2021-10-29 12:31:18 +00:00
Amos Bird
211c3d4d49
Better Projection IN 2021-10-29 20:24:36 +08:00
Amos Bird
0bf1efff97
Fix build 2021-10-29 19:51:34 +08:00
kssenii
12a27d445b Adjutments after merge with master 2021-10-29 09:29:35 +00:00
tavplubix
f50b2b651b
Merge pull request #30822 from ClickHouse/fix_29052
Fix ambiguity when extracting auxiliary ZooKeeper name
2021-10-29 12:15:29 +03:00
Filatenkov Artur
44b5dd1161
Refactoring in codec encrypted (#30564)
* refactoring

* remove mistake in docs
2021-10-29 11:44:28 +03:00
kssenii
b56c2f9499 Remove redundant lines from http buffer 2021-10-29 11:40:21 +03:00