Commit Graph

1571 Commits

Author SHA1 Message Date
Azat Khuzhin
724c09a22c Add missing DROP TABLE in 01319_mv_constants_bug 2020-06-18 21:49:29 +03:00
Azat Khuzhin
6507247328 optimize_skip_unused_shards=2 will disable it for nested distributed queries
P.S. Looks like settings can be converted between SettingUInt64 and
SettingBool without breaking binary protocol.

FWIW maybe it is a good idea to change the semantics of the settings as
follow (but I guess that changing semantic is not a good idea, better to
add new settings and deprecate old ones):
- optimize_skip_unused_shards -- accept nesting level on which the
  optimization will work
- force_skip_optimize_shards_nesting -- accept nesting level on which
  the optimization will work
2020-06-18 21:49:29 +03:00
Azat Khuzhin
041533eae2 Disable optimize_skip_unused_shards if sharding_key has non-deterministic func
Example of such functions is rand()

And this patch disables only optimize_skip_unused_shards, i.e. INSERT
code path does not changed, so it will work as before.
2020-06-18 21:49:29 +03:00
Anton Popov
bd28b7e1c2 better code 2020-06-18 20:05:26 +03:00
Ruslan
23cd919681
Any input optimize (#11529)
* workig commit №1

* working commit №2

* first version of ArithmeticOperationsInAgrFuncOptimize (min, max, sum)

* fix conflicts

* fix №2

* attempt №3

* Description + little mistake

* fix style + expanded optimization + add performance test

* style + merge with new version

* one more branch

* bug fix + merge

* just merge

* some code style and logic fixes

* little changes

* tests

* test(2)

* style

* seems to have fixed everything that was required

* bug fix

* style

* build fix

* fix typo

* fix clang-10 warning

* fix clang-10 warning

* nolint

* add new files to ya.make

* extract all functions from Any

* add last new lines.

* extract all functions from Any

* add last new lines.

* build + requested changes

* code style

* build + little perf test + anyLast

* minor changes

* bug fix

* minor changes

* another minor changes

* fix + experement

* experement 2.0

* experement 3.0

* experement 3.1

* experement 4.0

* last experement(think so)

* just another attempt to fix UB

* minor changes

* I think I won

* ya.make

* fix requested changes

Co-authored-by: Artem Zuikov <chertus@gmail.com>
2020-06-18 19:34:29 +03:00
Amos Bird
d524301038
add scalars in time 2020-06-19 00:14:19 +08:00
Alexander Tokmakov
5e42441a72 add test 2020-06-18 17:19:14 +03:00
Nikolai Kochetov
35ab9ad051 Merge branch 'master' into fix-parallel-final-stuck 2020-06-18 16:04:14 +03:00
Artem Zuikov
6af36cb703
CAST keep nullable (#11733) 2020-06-18 13:18:28 +03:00
alexey-milovidov
c9924b8aa1
Merge pull request #11697 from CurtizJ/fix-with-fill
Fix 'ORDER BY ... WITH FILL' over const columns.
2020-06-18 06:38:24 +03:00
alexey-milovidov
b42f622a77
Merge pull request #11739 from azat/replicated-parse-zk-metadata
[RFC] Parse metadata stored in zookeeper before checking for equality
2020-06-18 03:26:48 +03:00
Anton Popov
8ba5bd8530 Merge remote-tracking branch 'upstream/master' into distinct-combinator 2020-06-18 01:44:36 +03:00
tavplubix
bb16544bee
Merge pull request #11732 from ClickHouse/fix_type_duduction_in_values_format
Fix type duduction in Values format
2020-06-18 00:21:03 +03:00
Anton Popov
88b325dcdc rework distinct combinator 2020-06-17 22:36:27 +03:00
Nikolai Kochetov
38bebfb20d Merge remote-tracking branch 'origin' into provert-master 2020-06-17 22:05:45 +03:00
Azat Khuzhin
4572b1ede7 Cover re-parsing of metadata from zookeeper 2020-06-17 21:05:26 +03:00
alesapin
ac93f2795c
Merge pull request #11706 from ClickHouse/add_column_check
Add column if not exists tests
2020-06-17 20:09:57 +03:00
Vitaly Baranov
7011401cd4
Merge pull request #11670 from vitlibar/rbac-improve-parser-multiple-entities
RBAC: improve syntax
2020-06-17 16:26:02 +03:00
Alexander Tokmakov
3938b051c2 fix type duduction in values format 2020-06-17 16:21:06 +03:00
Anton Popov
5abbaeecf5 distinct combinator for single numeric arguments 2020-06-17 15:01:47 +03:00
Nikita Mikhaylov
d2be6c036b
Merge pull request #11602 from ClickHouse/fix-buffer-sample
Fix buffer sample
2020-06-17 14:44:48 +04:00
Nikita Mikhaylov
ff0262626a
Merge pull request #11645 from azat/load-balancing-round-robin
Add round_robin load_balancing
2020-06-17 14:34:59 +04:00
Nikolai Kochetov
091995f1db Updated perftests. 2020-06-17 13:00:28 +03:00
xPoSx
2d8110ce45
Eliminate min/max/any aggregators of GROUP BY keys in SELECT section (#11667) 2020-06-17 12:32:43 +03:00
Nikita Mikhaylov
edec79cf69
Merge pull request #11703 from nikitamikhaylov/merging-alter-query
Merging #11508
2020-06-17 12:47:34 +04:00
alesapin
aaa1063275 Fix test and additional case 2020-06-17 11:29:56 +03:00
Nikita Mikhaylov
ab04a6bb62
Merge pull request #11615 from azat/SYSTEM-FLUSH-LOGS-force-table-creation-v2
Force table creation on SYSTEM FLUSH LOGS (v2)
2020-06-17 11:09:19 +04:00
alexey-milovidov
8eb811140a
Merge pull request #11717 from ClickHouse/fix-test-mysql-federated
Added retries to test_mysql_federated
2020-06-17 09:26:33 +03:00
alexey-milovidov
e07d02015c
Merge pull request #11661 from ClickHouse/return-not-nullable-from-count-distinct-2
Return non-Nullable results from COUNT(DISTINCT), more complete.
2020-06-17 09:25:45 +03:00
alexey-milovidov
598fd75caf
Merge pull request #11639 from ClickHouse/remove-leader-election-2
Remove leader election, step 2: allow multiple leaders
2020-06-17 09:25:23 +03:00
Alexey Milovidov
634829bccb Merge branch 'return-not-nullable-from-count-distinct-2' of github.com:yandex/ClickHouse into return-not-nullable-from-count-distinct-2 2020-06-17 02:01:49 +03:00
Alexey Milovidov
69067efe7a Update test 2020-06-17 02:01:23 +03:00
Alexey Milovidov
a655765040 Merge branch 'master' into return-not-nullable-from-count-distinct-2 2020-06-17 01:15:57 +03:00
Alexander Kuzmenkov
9cab822718
Merge pull request #11683 from ClickHouse/aku/merge-minmap-11603
Merge minMap, maxMap (#11603)
2020-06-17 00:02:33 +03:00
Alexey Milovidov
3e7ac1f9ab Added retries to test_mysql_federated 2020-06-16 23:52:31 +03:00
Artem Zuikov
857d84bf7c
Buffer left blocks optimisation for MergeJoin (#10601) 2020-06-16 23:13:18 +03:00
alexey-milovidov
f387752cf1
Merge pull request #11702 from ClickHouse/fix-mv-header
Fix mv header
2020-06-16 22:43:38 +03:00
Alexey Milovidov
0a6054eece Merge branch 'master' into return-not-nullable-from-count-distinct-2 2020-06-16 22:31:33 +03:00
alexey-milovidov
ad53ef2c14
Merge pull request #11686 from ClickHouse/proper-query-formatting-in-log
Don't break multiline queries when they are printed in server log
2020-06-16 22:17:30 +03:00
alexey-milovidov
47bd8df9de
Merge pull request #11692 from ClickHouse/fix-flaky-test-incremental-streaming
Fix flaky test 01064_incremental_streaming_from_2_src_with_feedback
2020-06-16 22:12:46 +03:00
alexey-milovidov
d55155502f
Merge pull request #11694 from ClickHouse/maybe-fix-max-parser-depth-test
Maybe fix max_parser_depth flaky test
2020-06-16 22:11:36 +03:00
Alexey Milovidov
2024d2de54 Update test 2020-06-16 22:10:25 +03:00
Alexey Milovidov
bf4c82dbd8 Update test 2020-06-16 22:04:19 +03:00
alesapin
d214a504d7
Merge pull request #11681 from ClickHouse/fix_mutations_premature_finish
Fix mutations premature "finish"
2020-06-16 21:26:14 +03:00
Anton Popov
d92ba0b216 Merge remote-tracking branch 'upstream/master' into distinct-combinator 2020-06-16 21:13:20 +03:00
Nikita Mikhaylov
fc06f99476 build and test fixes 2020-06-16 21:07:41 +03:00
Artem Zuikov
a3d6e047fe
Fix lambdas with multiple_joins_rewriter v2 (#11587) 2020-06-16 19:32:32 +03:00
Ivan Blinkov
7e2bb1fd83 Merge branch 'master' of github.com:ClickHouse/ClickHouse into sentry 2020-06-16 16:02:55 +03:00
alesapin
0ac5132eb0 Add some tests for alter add column if not exists 2020-06-16 14:36:39 +03:00
alesapin
c403dd6b2f Add test for alter add column if not exists 2020-06-16 14:31:54 +03:00
alesapin
d5b76b2fe1 Fix parts count in mutations 2020-06-16 13:34:59 +03:00
alesapin
0cb14c836c
Merge pull request #11691 from ClickHouse/fix-race-condition-system-sync-replicas
Fix race condition in SYSTEM SYNC REPLICA
2020-06-16 13:29:18 +03:00
alesapin
362aaf1385
Merge pull request #11516 from ClickHouse/consistent_metadata4
Storage metadata as a single struct.
2020-06-16 13:28:22 +03:00
xPoSx
9fc37e1f75
Remove functions of other keys in GROUP BY section (#10051) 2020-06-16 12:14:25 +03:00
Vitaly Baranov
c5229301fc
Merge pull request #11671 from vitlibar/fix-minor-bugs-in-rbac
Fix minor bugs in RBAC
2020-06-16 12:09:54 +03:00
franklee
264e44ecef support distributed DDLs on cross replication clusters.
(cherry picked from commit fd09994d91)
2020-06-16 11:53:27 +03:00
Nikolai Kochetov
86bafbe6c3 Added test from #9043 2020-06-16 11:25:59 +03:00
Bharat Nallan
aa2d724ea1 add max_thread_pool_size setting to tests
This adds the `max_thread_pool_size` config to
tests/server-test.xml file.
2020-06-15 22:04:30 -07:00
Alexey Milovidov
bd330cfeb6 Update test 2020-06-16 05:56:50 +03:00
Alexey Milovidov
125b007360 Merge branch 'master' into remove-leader-election-2 2020-06-16 05:56:29 +03:00
Anton Popov
03058c3c25 fix 'ORDER BY WITH FILL' over const columns 2020-06-16 05:56:16 +03:00
alexey-milovidov
679c3f8ff3
Update 00446_clear_column_in_partition_zookeeper.sql 2020-06-16 04:50:22 +03:00
Alexey Milovidov
edff54e3ab Maybe fix max_parser_depth test 2020-06-16 04:08:01 +03:00
alexey-milovidov
9b734ffded
Update http_server.py 2020-06-16 03:21:20 +03:00
Alexey Milovidov
c85b9ae151 Fix test 2020-06-16 02:43:05 +03:00
Alexey Milovidov
97d5897d2b Fix test 2020-06-16 02:42:10 +03:00
Alexey Milovidov
a753ba9c6a Checked and corrected all other tests 2020-06-16 02:24:32 +03:00
Alexey Milovidov
e0f4c64acf Fix flaky test 2020-06-16 02:18:15 +03:00
Alexey Milovidov
00224ee94f Added a test 2020-06-16 02:04:12 +03:00
Anton Popov
eabbabed04 fix 'LIMIT WITH TIES' with aliases 2020-06-16 01:24:00 +03:00
Alexey Milovidov
ba82441989 Added a test 2020-06-15 23:13:57 +03:00
alesapin
bd17aa8a0e Increase timeout in test 2020-06-15 22:11:17 +03:00
Vitaly Baranov
a40885fa84 Add new command SHOW ACCESS. 2020-06-15 22:07:47 +03:00
Vitaly Baranov
9fe47df2e8 Support multiple users/roles in SHOW CREATE USER(ROLE, etc.) and SHOW GRANTS FOR commands.
Support syntax "SHOW CREATE USER ALL" and "SHOW GRANTS FOR ALL".
2020-06-15 22:07:47 +03:00
Vitaly Baranov
4187edd9f9 Split integration test 'test_grant_and_revoke' into two tests. 2020-06-15 22:07:47 +03:00
Vitaly Baranov
a5b70fbdda Add tests. 2020-06-15 22:07:47 +03:00
Alexander Tokmakov
d6e69211b1 fix test 2020-06-15 22:05:36 +03:00
Alexander Kuzmenkov
7cc54fd4f1 renames + perf test 2020-06-15 21:53:54 +03:00
Alexander Kuzmenkov
82b5ada130
Merge pull request #11650 from ksvladimir/master
Allow using groupArrayArray and groupUniqArrayArray as SimpleAggregateFunction
2020-06-15 21:29:57 +03:00
tavplubix
86e2cfe999
Merge pull request #11628 from zhang2014/feature/ISSUES-7572
ISSUES-7572 support config default http handler
2020-06-15 20:37:04 +03:00
Vitaly Baranov
4bd00b02e2 Improve syntax of CREATE QUOTA. Now resource types and key types could be written with underscores.
Also rename columns key_type=>keys and source=>storage in table system.quotas.
2020-06-15 20:10:34 +03:00
Vitaly Baranov
9f31184d76 Support for multiple names in one CREATE/ALTER command. 2020-06-15 20:10:28 +03:00
Alexey Milovidov
a5e9d793b0 Merge branch 'master' into avoid-trailing-whitespaces-in-some-cases 2020-06-15 19:48:07 +03:00
Alexander Kuzmenkov
0743e8c15d Merge remote-tracking branch 'origin/master' into minmap 2020-06-15 19:39:57 +03:00
alexey-milovidov
3878254e0c
Trigger CI 2020-06-15 19:21:52 +03:00
Alexander Kuzmenkov
e460d7c2bd
Merge pull request #11638 from azat/skip-idx-bloom-filter-fix
Fix bloom filters for String (data skipping indices)
2020-06-15 18:41:04 +03:00
alesapin
8f66c1b22c Merge with master 2020-06-15 17:31:37 +03:00
alesapin
8945d0073a Fix misunderstanding bug in mutations finalization 2020-06-15 16:37:40 +03:00
Vitaly Baranov
c7140724a8 Fix that ALTER USER RENAME could change allowed hosts. 2020-06-15 16:34:16 +03:00
Artem Zuikov
24059efad5
Change push down logic in VIEW (#11513) 2020-06-15 15:36:10 +03:00
Nikolai Kochetov
f9c4721ba2 Added test. 2020-06-15 15:04:30 +03:00
Mikhail Malafeev
10566e2b43
Remove duplicate ORDER BY and DISTINCT from subqueries (#10067) 2020-06-15 15:03:01 +03:00
Alexander Tokmakov
def0158638 configure query handler as default 2020-06-15 14:33:44 +03:00
tavplubix
20b8e1e9ec
Merge pull request #11057 from Potya/null_data_mods
Null data mods
2020-06-15 13:04:51 +03:00
alesapin
bc9a3c0458 Merge branch 'master' into consistent_metadata4 2020-06-15 11:20:30 +03:00
Alexey Milovidov
65a8fe7cf0 Update tests 2020-06-15 09:14:58 +03:00
Alexey Milovidov
6ddc6d7f08 Make the test faster #11637 2020-06-15 07:51:27 +03:00
Alexey Milovidov
e99c6d9143 Update tests 2020-06-15 07:42:29 +03:00
Alexey Milovidov
94d55abfd1 Update tests 2020-06-15 07:40:03 +03:00
Alexey Milovidov
d5e3e7ff76 Update tests 2020-06-15 07:36:55 +03:00
Alexey Milovidov
e2607f005c Fix error with ALTER CONSTRAINT formatting; added a test 2020-06-15 07:36:20 +03:00
Alexey Milovidov
0c1b2d48a3 Update test 2020-06-15 06:58:07 +03:00
Alexey Milovidov
fdc8f7ad14 Merge branch 'master' into avoid-trailing-whitespaces-in-some-cases 2020-06-15 06:52:14 +03:00
alexey-milovidov
fd6115cccf
Merge pull request #11648 from ClickHouse/simplify-code-functions-comparison-3
Allow comparison with String in index analysis; simplify code.
2020-06-15 05:47:03 +03:00
Alexey Milovidov
b51cbbdf15 Update test 2020-06-15 04:08:56 +03:00
alexey-milovidov
550838adbb
Merge pull request #11647 from ClickHouse/simplify-code-functions-comparison-2
Allow comparison of numbers with constant string in IN and VALUES
2020-06-15 03:33:45 +03:00
Alexey Milovidov
b596831342 Merge branch 'master' into remove-leader-election-2 2020-06-15 03:16:41 +03:00
alexey-milovidov
814265b66e
Merge pull request #11665 from ClickHouse/clear-password-from-command-line
Clear password from command line
2020-06-15 02:17:21 +03:00
alexey-milovidov
71dd46bd64
Merge pull request #11664 from ClickHouse/fix-syntax-hilite-create-user
Fix syntax hilite in CREATE USER query
2020-06-15 02:17:11 +03:00
alexey-milovidov
9b6942aa46
Merge pull request #11663 from ClickHouse/fix-timeout-in-test-sql-fuzzy
Fix timeout in sql_fuzzy test
2020-06-15 01:18:34 +03:00
Alexey Milovidov
303d1ebdaf Fix error; more tests 2020-06-15 01:17:06 +03:00
Alexey Milovidov
c4f18d2896 Fix tests 2020-06-15 00:39:22 +03:00
Alexey Milovidov
22366471d0 Added a test 2020-06-14 22:31:45 +03:00
Alexey Milovidov
3663e2a47e Fix syntax hilite in CREATE USER query 2020-06-14 22:11:32 +03:00
Alexey Milovidov
3aedef99ce Added a test 2020-06-14 21:31:42 +03:00
Alexey Milovidov
db0fc6c9a6 Fix tests 2020-06-14 21:24:25 +03:00
Alexey Milovidov
5d891f6c87 Fix tests 2020-06-14 21:13:39 +03:00
alexey-milovidov
561d4b5b01
Merge pull request #11655 from ClickHouse/position-in-system-columns
Added column "position" to system.columns and "column_position" to system.parts_columns
2020-06-14 21:01:41 +03:00
Alexey Milovidov
fcd23d02ee Fix timeout in sql_fuzzy test 2020-06-14 20:57:50 +03:00
Alexey Milovidov
394fb64a9c Better way of implementation 2020-06-14 20:42:11 +03:00
alexey-milovidov
d990b98b90
Merge pull request #11593 from ClickHouse/return-not-nullable-from-count-distinct
Return non-Nullable results from COUNT(DISTINCT)
2020-06-14 20:39:19 +03:00
Alexander Tokmakov
6a439a5eb5 fixes 2020-06-14 19:39:06 +03:00
Alexander Tokmakov
5f9739fbf9 Merge branch 'master' into fork-potya/null_data_mods 2020-06-14 18:11:55 +03:00
Ivan Blinkov
b8611cf46c experiment 2020-06-14 18:05:15 +03:00
Winter Zhang
dc6f904f0a
Merge branch 'master' into feature/ISSUES-7572 2020-06-14 18:28:06 +08:00
alexey-milovidov
88cf3f7083
Merge pull request #11653 from ClickHouse/parse-date-time-best-effort-incompletely-parsed-value
Return NULL or zero when value is not parsed completely in parseDateTimeBestEffortOr* functions
2020-06-14 10:59:10 +03:00
alexey-milovidov
56b8d81ef6
Merge pull request #11651 from ClickHouse/empty-parameters-url
Skip empty URL parameters
2020-06-14 09:00:52 +03:00
Alexey Milovidov
3958a032ac Added a test 2020-06-14 08:15:29 +03:00
alexey-milovidov
b9b725a39f
Merge pull request #11649 from ClickHouse/case-insensitive-regexp
Allow case-insensitive regexps; added a test
2020-06-14 07:55:09 +03:00
Alexey Milovidov
e2f7a41a1a Fix error; clarify more results in test 2020-06-14 07:16:52 +03:00
Alexey Milovidov
4024840795 Add a test 2020-06-14 07:16:52 +03:00
Alexey Milovidov
e24576c56c Update test 2020-06-14 07:13:27 +03:00
Alexey Milovidov
fb040ef09f Update test result (now it is better) 2020-06-14 07:09:02 +03:00
Alexey Milovidov
59d4df19f0 Update test 2020-06-14 07:05:31 +03:00
Alexey Milovidov
cb395ff099 Update test 2020-06-14 07:04:19 +03:00
Alexey Milovidov
d6cf62e587 Added column "position" to system.columns and "column_position" to system.parts_columns 2020-06-14 04:56:22 +03:00
Alexey Milovidov
fae12d5e42 Return NULL or zero when value is not parsed completely in parseDateTimeBestEffortOr* functions 2020-06-14 04:45:03 +03:00
zhang2014
e1317ef8ae ISSUES-7572 fix test failure 2020-06-14 09:44:05 +08:00
Alexey Milovidov
970a8e3ecc Skip empty URL parameters #10749 2020-06-14 03:56:13 +03:00
Alexey Milovidov
30f1f88118 Allow case-insensitive regexps; added a test #11101 2020-06-14 03:43:42 +03:00
Volodymyr Kuznetsov
713f8f0b22
Added groupArrayArray and groupUniqArrayArray to SimpleAggregateFunction 2020-06-13 17:21:33 -07:00
Alexey Milovidov
f2677a7841 Added a test just in case 2020-06-14 01:30:17 +03:00
Azat Khuzhin
9386478a77 Add test for load_balancing algorithms 2020-06-14 01:09:22 +03:00
Alexey Milovidov
a421e7e4b4 Added a test 2020-06-14 00:13:52 +03:00
Alexey Milovidov
e1ae9500f9 Merge branch 'master' into remove-leader-election-2 2020-06-13 23:42:32 +03:00
alexey-milovidov
f53da4d36b
Merge pull request #11608 from ClickHouse/fix-nullable-prewhere-type
Fix nullable prewhere type
2020-06-13 20:29:12 +03:00
Alexey Milovidov
d8312d0f00 Remove "fail" from test name; fix typo in test name #11151 2020-06-13 20:25:13 +03:00
Azat Khuzhin
901a657417 Rename 01307_data_skip_bloom_filter to 01307_bloom_filter_index_string_multi_granulas
This better reflects the covered case.
2020-06-13 14:20:42 +03:00
alesapin
5d3de747cd Merge remote-tracking branch 'origin/master' into consistent_metadata4 2020-06-13 11:50:27 +03:00
Ildus Kurbangaliev
01d903c60d add minMap and maxMap functions 2020-06-13 08:49:00 +00:00
Alexey Milovidov
18f8861fa0 Better test 2020-06-13 04:35:49 +03:00
Alexey Milovidov
22dd47c13f Added a test 2020-06-13 04:34:05 +03:00
Azat Khuzhin
0b1ff4f9cc Update max_rows_to_read in 00945_bloom_filter_index test
The expected values was incorrect, since for strings we have 1 and 10
and there will be at least two index granulas, hence 12 rows.
2020-06-13 01:37:20 +03:00
Azat Khuzhin
7f52b615e0 Fix bloom filters for String (data skipping indices)
bloom filter was broken for the first element, if all of the following
conditions satisfied:
- they are created on INSERT (in thie case bloom filter hashing uses
  offsets, in case of OPTIMIZE it does not, since it already has
  granulars).
- the record is not the first in the block
- the record is the first per index_granularity (do not confuse this
  with data skipping index GRANULARITY).
- type of the field for indexing is "String" (not FixedString)

Because in this case there was incorrect length and *data* for that string.
2020-06-12 22:46:40 +03:00
zhang2014
8d9b770da4 ISSUES-7572 fix defaults config level & add replicas_status and prometheus handler 2020-06-13 00:15:02 +08:00
alexey-milovidov
13ceaa4779
Merge pull request #11554 from Enmk/extractAllGroups-Horizontal-and-Vertical
extractAllGroupsHorizontal and extractAllGroupsVertical
2020-06-12 16:56:14 +03:00
Ivan Blinkov
e98a91e9f7 Merge branch 'master' of github.com:ClickHouse/ClickHouse into sentry 2020-06-12 16:53:00 +03:00
zhang2014
1c55aa0333 ISSUES-7572 add integration test 2020-06-12 18:19:03 +08:00
Azat Khuzhin
103eb17107 Force table creation on SYSTEM FLUSH LOGS (v2)
After this patch SYSTEM FLUSH LOGS will force system.*_log table
creatoins (only for enabled tables of course).

This will avoid such hacks like:

   set log_queries=1;
   select 1;
   system flush logs;

This is the second version of the patch, since first has a deadlock [1]
(reported by @alesapin). This version does not use separate lock and do
not issue CREATE TABLE from the query execution thread, instead it
activate flushing thread to do so, hence this should be the same as if
the table will be created during flush.

  [1]: https://gist.github.com/alesapin/d915d1deaa27d49aa31223daded02be2

Fixes: #11563
Cc: @alesapin
Cc: @nikitamikhaylov
2020-06-11 23:12:23 +03:00
Alexey Milovidov
11c79e1371 Fix JSON in clickhouse-benchmark; add test 2020-06-11 20:53:33 +03:00
Nikolai Kochetov
8234a430a0 Added test. 2020-06-11 19:40:44 +03:00
alesapin
a39d010f94 Merge branch 'master' into consistent_metadata4 2020-06-11 18:47:41 +03:00
alexey-milovidov
89df9915bb
Merge pull request #11592 from ClickHouse/replicated-merge-tree-create-drop-race-garbage
Fix race conditions in CREATE/DROP of different replicas of ReplicatedMergeTree
2020-06-11 17:11:38 +03:00
Nikolai Kochetov
3eed1c8c2b Added test 2020-06-11 16:41:14 +03:00
Ivan Blinkov
ce36f409c9 Merge branch 'master' of github.com:ClickHouse/ClickHouse into sentry 2020-06-11 13:34:58 +03:00
alesapin
5a9a63e9a1
Revert "Force table creation on SYSTEM FLUSH LOGS" 2020-06-11 13:22:24 +03:00
Ivan Blinkov
b70ed921ea Merge branch 'master' of github.com:ClickHouse/ClickHouse into sentry 2020-06-11 12:22:13 +03:00
Ivan Blinkov
706c545248 experiment 2020-06-11 12:18:12 +03:00
Ivan Blinkov
22707508c1 experiment 2020-06-11 12:17:33 +03:00
tavplubix
1777bd0273
Merge pull request #11467 from hexiaoting/showcreate
Add "SHOW CLUSTER(s)" queries support
2020-06-11 12:01:28 +03:00
Vasily Nemkov
50a184acac extractAllGroupsHorizontal and extractAllGroupsVertical
Split tests, fixed some error messages

Fixed test and error reporting of extractGroups
2020-06-11 11:03:17 +03:00
alexey-milovidov
c7be0d6bc0
Merge pull request #11578 from ClickHouse/fix_10240
Fix query_id of http queries
2020-06-11 06:55:04 +03:00
alexey-milovidov
9c20afbc81
Merge pull request #11579 from ClickHouse/fix_11490
Fix segfault in SHOW CREATE TABLE
2020-06-11 06:54:47 +03:00
alexey-milovidov
9e688307cb
Merge pull request #11580 from ClickHouse/fix-bug-prewhere-in-subquery
Fix prewhere in subquery
2020-06-11 06:53:44 +03:00
alexey-milovidov
8e9c2dbf85
Merge pull request #11582 from ClickHouse/fix_test_replica_fetch
Better integration test test_always_fetch_merged.
2020-06-11 06:51:56 +03:00
Alexey Milovidov
c0f8a3b5f2 Added a test 2020-06-11 06:27:20 +03:00
Nikita Mikhaylov
425c20eeb8
Merge pull request #11563 from azat/SYSTEM-FLUSH-LOGS-force-table-creation
Force table creation on SYSTEM FLUSH LOGS
2020-06-11 02:03:34 +04:00
Nikita Mikhaylov
4bf46ed288
Merge pull request #11573 from nikitamikhaylov/copier-test-fix
Fix copier test
2020-06-11 00:38:27 +04:00
Vitaly Baranov
d6e16629ae
Merge pull request #11028 from Potya/master
Support numeric parameters in Number and String data types
2020-06-10 23:23:59 +03:00
alexey-milovidov
4f2ed7a5e3
Merge branch 'master' into arch-chooser 2020-06-10 22:31:19 +03:00
alexey-milovidov
123a017057
Merge pull request #11528 from azat/use_compact_format_in_distributed_parts_names-fix
Fix shard_num/replica_num for <node> (breaks use_compact_format_in_distributed_parts_names)
2020-06-10 22:02:51 +03:00
tavplubix
982c85ac6c
Update 01293_show_clusters.reference 2020-06-10 21:13:16 +03:00
Alexander Tokmakov
3f389c1a19 try fix flacky test 2020-06-10 20:58:55 +03:00
alesapin
c21fac11cc Merge branch 'master' into consistent_metadata4 2020-06-10 20:20:46 +03:00
alesapin
e221a64c4b Better test 2020-06-10 18:56:18 +03:00
Nikolai Kochetov
e2c6d09019 Added test. 2020-06-10 18:06:55 +03:00
Alexander Tokmakov
08073903ed fix query_id of http queries 2020-06-10 17:24:42 +03:00
Alexander Tokmakov
9166ddea41 fix segfault in show create table 2020-06-10 15:53:12 +03:00
Nikita Mikhaylov
93b0d5b29b done 2020-06-10 15:47:34 +03:00
alesapin
8be957ecb5 Better checks around metadata 2020-06-10 14:16:31 +03:00
Alexander Kuzmenkov
04b0089776
Merge pull request #11515 from ClickHouse/aku/more-stable-perf-tests
More stable perf tests
2020-06-10 13:25:52 +03:00
Ivan Blinkov
90ee4d52f4 merge master 2020-06-10 13:18:41 +03:00
alesapin
ec933d9d03 Better naming 2020-06-10 12:09:51 +03:00
tavplubix
a93ae46ac1
Merge pull request #11079 from ClickHouse/merging_external_source_cassandra
Merging #4978
2020-06-10 10:39:18 +03:00
Alexander Kuzmenkov
af1c8f8a5f fixup 2020-06-10 02:57:31 +03:00
Alexander Kuzmenkov
f6136ec279 Merge remote-tracking branch 'origin/master' into HEAD 2020-06-10 02:37:52 +03:00
Alexander Kuzmenkov
898d83491d fixup 2020-06-10 02:37:48 +03:00
Alexey Milovidov
c95d5786fd Fixup 2020-06-10 01:52:25 +03:00
alesapin
4f398b5dea Merge remote-tracking branch 'origin/master' into consistent_metadata4 2020-06-09 23:53:38 +03:00
alexey-milovidov
8e05558a5f
Merge pull request #11540 from ClickHouse/fix-direct-io
Fix direct IO with PREWHERE
2020-06-09 23:53:09 +03:00
alexey-milovidov
324f2ee3ce
Merge pull request #11543 from azat/flacky-01293_system_distribution_queue
Fix 01293_system_distribution_queue flackiness
2020-06-09 23:51:25 +03:00
Azat Khuzhin
8a78cffe5c Force table creation on SYSTEM FLUSH LOGS 2020-06-09 21:11:08 +03:00
Alexander Tokmakov
6bb68329f8 Merge branch 'master' into merging_external_source_cassandra 2020-06-09 19:51:14 +03:00
Nikolai Kochetov
e0de3aa7c9
Revert "Addition to #11184" 2020-06-09 19:39:26 +03:00
Nikolai Kochetov
5cc2f318c9
Merge pull request #11495 from vzakaznikov/live_view_support_for_prewhere
Adding support for PREWHERE in live view tables.
2020-06-09 19:09:17 +03:00
Ivan Blinkov
6f7064928f Merge branch 'master' of github.com:ClickHouse/ClickHouse into sentry 2020-06-09 19:07:57 +03:00
alesapin
f7a397242f Merge branch 'master' into consistent_metadata4 2020-06-09 18:59:59 +03:00
alesapin
e3ae0734c9 Better test 2020-06-09 18:04:56 +03:00
alesapin
e4b5515f3b
Merge pull request #11548 from ClickHouse/fix_01079_detach
Better 01079_parallel_alter tests
2020-06-09 17:11:45 +03:00
Alexander Kuzmenkov
5719549ee1 fixup 2020-06-09 16:29:07 +03:00
Alexander Kuzmenkov
dd41f6a574
Merge pull request #11527 from azat/dist-insert-local-fix
Fix async INSERT into Distributed for prefer_localhost_replica=0 and w/o internal_replication
2020-06-09 15:21:05 +03:00
Alexander Kuzmenkov
6071b9b9d9 Merge remote-tracking branch 'origin/master' into HEAD 2020-06-09 15:06:32 +03:00
alesapin
a5268b7c46
Update 01079_parallel_alter_detach_table_zookeeper.sh 2020-06-09 13:05:01 +03:00
alesapin
96cdeecd81 Better parallel tests 2020-06-09 13:03:22 +03:00
alesapin
30b02b20e5 Merge branch 'master' into fix-direct-io 2020-06-09 12:39:51 +03:00
Ivan Blinkov
5b3fef526e Merge branch 'master' of github.com:ClickHouse/ClickHouse into sentry 2020-06-09 11:51:29 +03:00
Azat Khuzhin
ba4d964388 Add comments for 01281_group_by_limit_memory_tracking test 2020-06-09 11:18:08 +03:00
Azat Khuzhin
1a6c1d1796 Fix 01293_system_distribution_queue test flackiness 2020-06-09 11:18:04 +03:00
Ilya Yatsishin
822c19ddad
Merge pull request #11537 from ClickHouse/usability-exception-message-parse-columns-declaration-list
Better exception message when cannot parse columns declaration list
2020-06-09 09:55:40 +03:00
hexiaoting
75075a7b2b Add DISTINCT keyword when show clusters 2020-06-09 10:39:37 +08:00
Alexey Milovidov
09b9a308cb Fix obvious race condition in test 2020-06-09 05:03:22 +03:00
alesapin
223f45685f Review fixes 2020-06-09 05:03:22 +03:00
alesapin
bdeafe830b Better comment 2020-06-09 04:48:30 +03:00
alesapin
508e0f44d1 Fix modify test 2020-06-09 04:48:30 +03:00
Alexey Milovidov
6936da4e5d Fix bad test 2020-06-09 03:42:56 +03:00
Alexey Milovidov
6ee6b751be Added failing test #11539 2020-06-09 03:38:47 +03:00
alexey-milovidov
91d06c7e4f
Merge pull request #11523 from ClickHouse/fixing_01079_tests
Fixing test and benign race condition during table drop
2020-06-09 02:02:39 +03:00
alexey-milovidov
85363ebe56
Update aggregating_merge_tree.xml 2020-06-09 01:41:57 +03:00
Alexander Kuzmenkov
cb71f2df1f Merge remote-tracking branch 'origin/master' into HEAD 2020-06-09 01:13:38 +03:00
Alexander Kuzmenkov
6a3df071a2 fixup 2020-06-09 01:13:08 +03:00
Alexey Milovidov
f9ea964c87 Added performance test 2020-06-09 00:59:58 +03:00
MovElb
e6dcece2fd return tcp_port 2020-06-08 22:39:02 +03:00
Azat Khuzhin
eee2fb867a Update test_distributed_format to cover remote_servers via <node> 2020-06-08 22:32:06 +03:00
alexey-milovidov
2bff9b4607
Merge pull request #11496 from ClickHouse/fix-aggregation-state-exception-safety-memory-leak
Fix memory leak when exception is thrown in the middle of aggregation with -State functions
2020-06-08 22:03:52 +03:00
Azat Khuzhin
222bbe95d6 Cover load_balancing for Distributed INSERT w/o internal_replication 2020-06-08 21:58:56 +03:00
alesapin
0d375e4522 Fix constraints 2020-06-08 21:49:54 +03:00
alesapin
ce73b30505 Review fixes 2020-06-08 21:08:55 +03:00
alesapin
5db83dad07 Better comment 2020-06-08 18:18:33 +03:00
alesapin
68bd636c9c Fix modify test 2020-06-08 18:16:01 +03:00
Alexander Kuzmenkov
e2e5e1d5f8 More stable perf tests 2020-06-08 16:57:33 +03:00
Alexey Milovidov
7ba2d7e15f Changed timeouts in test 2020-06-08 15:35:57 +03:00
MovElb
fc981a2869 fix for review 2020-06-08 15:05:49 +03:00
alesapin
483c60fadd Merging #8377 2020-06-08 14:25:30 +03:00
Vitaliy Zakaznikov
5fe67c4292 * Removing supportsPrewhere() from StorageLiveView.h as it is not valid.
* Updating test to check using PREWHERE in query against live view table.
* Updating test to check using PREWHERE in the stored query against the table that does
  not support PREWHWERE.
2020-06-08 13:12:40 +02:00
Alexey Milovidov
4216f2fe37 Merge branch 'master' into fix-aggregation-state-exception-safety-memory-leak 2020-06-08 06:31:20 +03:00
hexiaoting
75768413ad fix errors found by Style Check 2020-06-08 10:23:57 +08:00
alexey-milovidov
16f0e3a467
Merge pull request #11493 from ClickHouse/kuskarov-fix_history_bugs
Merging #11453 (save history in clickhouse-client after every query)
2020-06-08 02:13:20 +03:00
Alexey Milovidov
e507f6b836 More crystallized test 2020-06-08 02:01:04 +03:00
Alexey Milovidov
d5443293a3 Added a test 2020-06-08 01:49:26 +03:00
Vitaliy Zakaznikov
75c97ca82a Adding support for PREWHERE in live view tables. 2020-06-08 00:19:23 +02:00