Commit Graph

1522 Commits

Author SHA1 Message Date
alexey-milovidov
0135771d7f
Merge pull request #11839 from ClickHouse/tuple-compare-const-string
Fix comparison of tuple with constant string
2020-06-21 21:59:15 +03:00
alexey-milovidov
746676d762
Update general_purpose_hashes.xml 2020-06-21 21:32:12 +03:00
alexey-milovidov
d4fce9d0f3
Update great_circle_dist.xml 2020-06-21 21:31:58 +03:00
alexey-milovidov
045553d00f
Update synthetic_hardware_benchmark.xml 2020-06-21 21:31:31 +03:00
alexey-milovidov
dcda561815
Update synthetic_hardware_benchmark.xml 2020-06-21 21:31:19 +03:00
alexey-milovidov
c3a5c32a48
Merge branch 'master' into arch-chooser 2020-06-21 21:30:06 +03:00
Alexey Milovidov
7117b419b9 Don't allow arrayJoin inside higher order functions #3933 2020-06-21 21:22:34 +03:00
alexey-milovidov
59d3e200ce
Merge pull request #11831 from ClickHouse/decimal-cut-extra-digits-after-point
Make reading of Decimal more compatible with other DBMS
2020-06-21 21:03:06 +03:00
Alexey Milovidov
9c97a1e6d1 Merge branch 'master' into mysql-vars 2020-06-21 19:12:24 +03:00
Alexey Milovidov
0b2ffb9c77 Merge branch 'master' into print-build-id 2020-06-21 19:08:07 +03:00
Alexey Milovidov
71317dd59c Merge branch 'master' into send-logs-on-fatal-errors 2020-06-21 19:05:20 +03:00
Azat Khuzhin
bffd4cf576 Add a test for memory tracking via HTTP interface 2020-06-21 17:37:42 +03:00
Alexey Milovidov
9514965207 Fix comparison of tuple with constant string 2020-06-21 16:23:32 +03:00
Azat Khuzhin
fb30629ff2 Add settings to control nesting level for shards skipping optimization
- optimize_skip_unused_shards_nesting (allows control nesting level for
  shards skipping optimization)
- force_skip_optimize_shards_nesting (allows control nesting level for
  checking was shards skipped or not)
- deprecates force_skip_optimize_shards_no_nested
2020-06-21 15:27:01 +03:00
alexey-milovidov
4ee623ccac
Merge pull request #10242 from MovElb/movelb-postgresql-wire-protocol-impl
PostgreSQL wire protocol implementation
2020-06-21 14:39:22 +03:00
Alexey Milovidov
fe71a8eb8c Merge branch 'master' into send-logs-on-fatal-errors 2020-06-21 13:55:11 +03:00
Alexey Milovidov
fd885e86f7 Merge branch 'master' into mysql-vars 2020-06-21 13:53:37 +03:00
Alexey Milovidov
227afea032 Merge branch 'master' into decimal-cut-extra-digits-after-point 2020-06-21 13:50:06 +03:00
Alexey Milovidov
7f05d2bac0 Merge branch 'master' into print-build-id 2020-06-21 13:44:32 +03:00
Azat Khuzhin
bd45592539 Fix test_distributed_load_balancing flaps (due to config reload)
At startup, server loads configuration files.

However ConfigReloader does not know about already loaded files (files
is empty()), hence it will always reload the configuration just after
server starts (+ 2 seconds, reload timeout).

And on configuration reload the clusters will be re-created, so some
internal stuff will be reseted:
- error_count
- last_used (round_robing)

And if the reload will happen during round_robin test it will start
querying from the beginning, so let's issue config reload just after
start to avoid reload in the middle of the test execution.
2020-06-21 12:01:15 +03:00
alexey-milovidov
bcf086e592
Merge pull request #11834 from ClickHouse/fix-test-always-merged
Fix bad integration test "always_fetch_merged"
2020-06-21 03:55:52 +03:00
alexey-milovidov
31dd02c45b
Merge pull request #11833 from ClickHouse/disable-bad-optimization
Disable bad optimization #10047
2020-06-21 02:03:50 +03:00
alexey-milovidov
485c4c9055
Merge pull request #11828 from ClickHouse/fix-fixed-string-comparison
Fix FixedString comparison #11393
2020-06-21 00:21:13 +03:00
alexey-milovidov
cd3d7c9155
Merge pull request #11806 from azat/optimize_aggregators_of_group_by_keys-fix-alias
Preserve column alias with optimize_aggregators_of_group_by_keys
2020-06-21 00:13:19 +03:00
alexey-milovidov
017f55a715
Merge pull request #11821 from ClickHouse/hostname-alias
Added "hostname" as an alias to function "hostName"
2020-06-20 21:46:21 +03:00
Alexey Milovidov
25af2d0b0a Fix bad integration test "always_fetch_merged" 2020-06-20 21:21:29 +03:00
Alexey Milovidov
147cda2581 Merge branch 'master' into print-build-id 2020-06-20 21:05:31 +03:00
Alexey Milovidov
14e29f2c11 Disable bad optimization #10047 2020-06-20 21:00:00 +03:00
Alexey Milovidov
7c4fb669db Update tests 2020-06-20 20:57:02 +03:00
alexey-milovidov
9bfefc99ab
Merge pull request #11599 from filimonov/better_kafka_states
Kafka work with formats based on PeekableReadBuffer and other improvements
2020-06-20 20:36:54 +03:00
alexey-milovidov
5d68dda35b
Merge pull request #11820 from ClickHouse/added-test-for-mutations-after-freeze
Added a test for #6549
2020-06-20 19:17:32 +03:00
Alexey Milovidov
e6a969e2e6 Added support for MySQL style global variables syntax 2020-06-20 19:05:49 +03:00
Alexey Milovidov
408fc241d6 Make reading of Decimal more compatible with other DBMS 2020-06-20 17:43:01 +03:00
alexey-milovidov
df0b66c75b
Merge pull request #11817 from ClickHouse/check-for-tests-with-fail-in-their-names
Check for tests with "fail" in their names
2020-06-20 16:50:42 +03:00
Alexey Milovidov
3658ea6e55 Fix FixedString comparison #11393 2020-06-20 16:13:51 +03:00
Alexey Milovidov
a02fdbcad0 Update tests 2020-06-20 14:29:01 +03:00
Alexey Milovidov
d0b948dc3f Added a test 2020-06-20 12:18:53 +03:00
Azat Khuzhin
9bfda65134 Add a test for distributed_replica_max_ignored_errors 2020-06-20 11:21:08 +03:00
Alexey Milovidov
f25416beb8 Added "hostname" as an alias to function "hostName" 2020-06-20 10:43:35 +03:00
Alexey Milovidov
a7cc800138 Added a test for #6549 2020-06-20 10:36:17 +03:00
Alexey Milovidov
f2296ba313 Added a test 2020-06-20 09:56:37 +03:00
Alexey Milovidov
9f26ac06ea Fix another 10% of bad code #11529 2020-06-20 09:54:05 +03:00
Alexey Milovidov
dec883e21b Check for tests with "fail" in their names 2020-06-20 09:28:19 +03:00
alexey-milovidov
f27ae6a12a
Merge pull request #11682 from ClickHouse/fix-parallel-final-stuck
Fix parallel final stuck
2020-06-20 09:05:32 +03:00
alexey-milovidov
7baf1e0994
Merge pull request #11718 from ClickHouse/test-hyperscan
Added a test for stack unwinding from within Hyperscan
2020-06-20 08:33:57 +03:00
alexey-milovidov
4129300fdb
Merge pull request #11788 from ClickHouse/fix-too-many-threads
Fix too many threads
2020-06-20 08:24:47 +03:00
tavplubix
b8685322b7
Merge pull request #11767 from amosbird/fs1
add scalars in time
2020-06-20 01:01:20 +03:00
Alexander Kuzmenkov
288f217df3 Merge remote-tracking branch 'origin/master' into HEAD 2020-06-19 23:07:53 +03:00
Azat Khuzhin
5f14622bfd Preserve column alias with optimize_aggregators_of_group_by_keys
optimize_aggregators_of_group_by_keys has been introduced in #11667
2020-06-19 23:04:19 +03:00
alexey-milovidov
85974dd699
Update 00816_long_concurrent_alter_column.sh 2020-06-19 22:56:18 +03:00
Alexey Milovidov
03f39fe1f4 Added MSan suppression for Hyperscan 2020-06-19 22:28:49 +03:00
Alexey Milovidov
3142006182 Leave only relevant part of the test 2020-06-19 21:44:33 +03:00
alesapin
a462462610 Merge branch 'master' into atomic_metadata5 2020-06-19 18:58:42 +03:00
alesapin
b504fc6a90 Fix error code 2020-06-19 16:37:27 +03:00
Nikolai Kochetov
6e38d9ec10 Update test. 2020-06-19 15:26:03 +03:00
Alexey Milovidov
26ea16537c Added a test for stack unwinding from within Hyperscan 2020-06-19 14:50:33 +03:00
Nikolai Kochetov
f7b4039058 Added test. 2020-06-19 14:13:03 +03:00
alesapin
4b6db63fff Fix alter key when materialized column passed 2020-06-19 13:53:20 +03:00
Nikolai Kochetov
12026ab9c2 Rename test file. 2020-06-19 13:24:17 +03:00
Nikolai Kochetov
690b88d331
Merge pull request #11291 from Provet/master
Partial sorting optimization fix
2020-06-19 12:58:44 +03:00
Mikhail Filimonov
9609bd9dee Kafka better states, formats based on PeekableReadBuffer, and other minor fixes.
Add formats tests, fixes for JSONCompactEachRowWithNamesAndTypes, TSVWithNamesAndTypes. Some CR fixes
Add sanitizing for kafka_max_block_size and kafka_poll_max_batch_size
2020-06-19 10:49:05 +02:00
Anton Popov
36b9847d9a
Merge pull request #11768 from CurtizJ/any-input-optimize
Sligtly better code after #11529.
2020-06-19 03:36:49 +03:00
tavplubix
bed1f37790
Merge pull request #11214 from Potya/multiword_data_type
Add some multiword data types
2020-06-18 23:47:37 +03:00
Ruslan
f44dbcd2ab
Fix crash in min(multiply(1)) with optimize_arithmetic_operations_in_aggregate_functions (#11756) 2020-06-18 22:25:28 +03:00
Azat Khuzhin
0e218b0f15 Improve 01319_optimize_skip_unused_shards_no_nested
Before there is no check that optimize_skip_unused_shards was working
for the first level, use cluster with unavalable shard to guarantee
this.
2020-06-18 21:49:29 +03:00
Azat Khuzhin
724c09a22c Add missing DROP TABLE in 01319_mv_constants_bug 2020-06-18 21:49:29 +03:00
Azat Khuzhin
6507247328 optimize_skip_unused_shards=2 will disable it for nested distributed queries
P.S. Looks like settings can be converted between SettingUInt64 and
SettingBool without breaking binary protocol.

FWIW maybe it is a good idea to change the semantics of the settings as
follow (but I guess that changing semantic is not a good idea, better to
add new settings and deprecate old ones):
- optimize_skip_unused_shards -- accept nesting level on which the
  optimization will work
- force_skip_optimize_shards_nesting -- accept nesting level on which
  the optimization will work
2020-06-18 21:49:29 +03:00
Azat Khuzhin
041533eae2 Disable optimize_skip_unused_shards if sharding_key has non-deterministic func
Example of such functions is rand()

And this patch disables only optimize_skip_unused_shards, i.e. INSERT
code path does not changed, so it will work as before.
2020-06-18 21:49:29 +03:00
Anton Popov
bd28b7e1c2 better code 2020-06-18 20:05:26 +03:00
Ruslan
23cd919681
Any input optimize (#11529)
* workig commit №1

* working commit №2

* first version of ArithmeticOperationsInAgrFuncOptimize (min, max, sum)

* fix conflicts

* fix №2

* attempt №3

* Description + little mistake

* fix style + expanded optimization + add performance test

* style + merge with new version

* one more branch

* bug fix + merge

* just merge

* some code style and logic fixes

* little changes

* tests

* test(2)

* style

* seems to have fixed everything that was required

* bug fix

* style

* build fix

* fix typo

* fix clang-10 warning

* fix clang-10 warning

* nolint

* add new files to ya.make

* extract all functions from Any

* add last new lines.

* extract all functions from Any

* add last new lines.

* build + requested changes

* code style

* build + little perf test + anyLast

* minor changes

* bug fix

* minor changes

* another minor changes

* fix + experement

* experement 2.0

* experement 3.0

* experement 3.1

* experement 4.0

* last experement(think so)

* just another attempt to fix UB

* minor changes

* I think I won

* ya.make

* fix requested changes

Co-authored-by: Artem Zuikov <chertus@gmail.com>
2020-06-18 19:34:29 +03:00
Amos Bird
d524301038
add scalars in time 2020-06-19 00:14:19 +08:00
Alexander Tokmakov
5e42441a72 add test 2020-06-18 17:19:14 +03:00
Nikolai Kochetov
35ab9ad051 Merge branch 'master' into fix-parallel-final-stuck 2020-06-18 16:04:14 +03:00
Artem Zuikov
6af36cb703
CAST keep nullable (#11733) 2020-06-18 13:18:28 +03:00
alexey-milovidov
c9924b8aa1
Merge pull request #11697 from CurtizJ/fix-with-fill
Fix 'ORDER BY ... WITH FILL' over const columns.
2020-06-18 06:38:24 +03:00
alexey-milovidov
b42f622a77
Merge pull request #11739 from azat/replicated-parse-zk-metadata
[RFC] Parse metadata stored in zookeeper before checking for equality
2020-06-18 03:26:48 +03:00
tavplubix
bb16544bee
Merge pull request #11732 from ClickHouse/fix_type_duduction_in_values_format
Fix type duduction in Values format
2020-06-18 00:21:03 +03:00
Nikolai Kochetov
38bebfb20d Merge remote-tracking branch 'origin' into provert-master 2020-06-17 22:05:45 +03:00
Azat Khuzhin
4572b1ede7 Cover re-parsing of metadata from zookeeper 2020-06-17 21:05:26 +03:00
alesapin
ac93f2795c
Merge pull request #11706 from ClickHouse/add_column_check
Add column if not exists tests
2020-06-17 20:09:57 +03:00
Vitaly Baranov
7011401cd4
Merge pull request #11670 from vitlibar/rbac-improve-parser-multiple-entities
RBAC: improve syntax
2020-06-17 16:26:02 +03:00
Alexander Tokmakov
3938b051c2 fix type duduction in values format 2020-06-17 16:21:06 +03:00
Nikita Mikhaylov
d2be6c036b
Merge pull request #11602 from ClickHouse/fix-buffer-sample
Fix buffer sample
2020-06-17 14:44:48 +04:00
Nikita Mikhaylov
ff0262626a
Merge pull request #11645 from azat/load-balancing-round-robin
Add round_robin load_balancing
2020-06-17 14:34:59 +04:00
Nikolai Kochetov
091995f1db Updated perftests. 2020-06-17 13:00:28 +03:00
xPoSx
2d8110ce45
Eliminate min/max/any aggregators of GROUP BY keys in SELECT section (#11667) 2020-06-17 12:32:43 +03:00
Nikita Mikhaylov
edec79cf69
Merge pull request #11703 from nikitamikhaylov/merging-alter-query
Merging #11508
2020-06-17 12:47:34 +04:00
alesapin
aaa1063275 Fix test and additional case 2020-06-17 11:29:56 +03:00
Nikita Mikhaylov
ab04a6bb62
Merge pull request #11615 from azat/SYSTEM-FLUSH-LOGS-force-table-creation-v2
Force table creation on SYSTEM FLUSH LOGS (v2)
2020-06-17 11:09:19 +04:00
alexey-milovidov
8eb811140a
Merge pull request #11717 from ClickHouse/fix-test-mysql-federated
Added retries to test_mysql_federated
2020-06-17 09:26:33 +03:00
alexey-milovidov
e07d02015c
Merge pull request #11661 from ClickHouse/return-not-nullable-from-count-distinct-2
Return non-Nullable results from COUNT(DISTINCT), more complete.
2020-06-17 09:25:45 +03:00
alexey-milovidov
598fd75caf
Merge pull request #11639 from ClickHouse/remove-leader-election-2
Remove leader election, step 2: allow multiple leaders
2020-06-17 09:25:23 +03:00
Alexey Milovidov
634829bccb Merge branch 'return-not-nullable-from-count-distinct-2' of github.com:yandex/ClickHouse into return-not-nullable-from-count-distinct-2 2020-06-17 02:01:49 +03:00
Alexey Milovidov
69067efe7a Update test 2020-06-17 02:01:23 +03:00
Alexey Milovidov
a655765040 Merge branch 'master' into return-not-nullable-from-count-distinct-2 2020-06-17 01:15:57 +03:00
Alexander Kuzmenkov
9cab822718
Merge pull request #11683 from ClickHouse/aku/merge-minmap-11603
Merge minMap, maxMap (#11603)
2020-06-17 00:02:33 +03:00
Alexey Milovidov
3e7ac1f9ab Added retries to test_mysql_federated 2020-06-16 23:52:31 +03:00
Artem Zuikov
857d84bf7c
Buffer left blocks optimisation for MergeJoin (#10601) 2020-06-16 23:13:18 +03:00
alexey-milovidov
f387752cf1
Merge pull request #11702 from ClickHouse/fix-mv-header
Fix mv header
2020-06-16 22:43:38 +03:00
Alexey Milovidov
0a6054eece Merge branch 'master' into return-not-nullable-from-count-distinct-2 2020-06-16 22:31:33 +03:00
alexey-milovidov
ad53ef2c14
Merge pull request #11686 from ClickHouse/proper-query-formatting-in-log
Don't break multiline queries when they are printed in server log
2020-06-16 22:17:30 +03:00
alexey-milovidov
47bd8df9de
Merge pull request #11692 from ClickHouse/fix-flaky-test-incremental-streaming
Fix flaky test 01064_incremental_streaming_from_2_src_with_feedback
2020-06-16 22:12:46 +03:00
alexey-milovidov
d55155502f
Merge pull request #11694 from ClickHouse/maybe-fix-max-parser-depth-test
Maybe fix max_parser_depth flaky test
2020-06-16 22:11:36 +03:00
Alexey Milovidov
2024d2de54 Update test 2020-06-16 22:10:25 +03:00
Alexey Milovidov
bf4c82dbd8 Update test 2020-06-16 22:04:19 +03:00
alesapin
d214a504d7
Merge pull request #11681 from ClickHouse/fix_mutations_premature_finish
Fix mutations premature "finish"
2020-06-16 21:26:14 +03:00
Nikita Mikhaylov
fc06f99476 build and test fixes 2020-06-16 21:07:41 +03:00
Artem Zuikov
a3d6e047fe
Fix lambdas with multiple_joins_rewriter v2 (#11587) 2020-06-16 19:32:32 +03:00
Ivan Blinkov
7e2bb1fd83 Merge branch 'master' of github.com:ClickHouse/ClickHouse into sentry 2020-06-16 16:02:55 +03:00
alesapin
0ac5132eb0 Add some tests for alter add column if not exists 2020-06-16 14:36:39 +03:00
alesapin
c403dd6b2f Add test for alter add column if not exists 2020-06-16 14:31:54 +03:00
alesapin
d5b76b2fe1 Fix parts count in mutations 2020-06-16 13:34:59 +03:00
alesapin
0cb14c836c
Merge pull request #11691 from ClickHouse/fix-race-condition-system-sync-replicas
Fix race condition in SYSTEM SYNC REPLICA
2020-06-16 13:29:18 +03:00
alesapin
362aaf1385
Merge pull request #11516 from ClickHouse/consistent_metadata4
Storage metadata as a single struct.
2020-06-16 13:28:22 +03:00
xPoSx
9fc37e1f75
Remove functions of other keys in GROUP BY section (#10051) 2020-06-16 12:14:25 +03:00
Vitaly Baranov
c5229301fc
Merge pull request #11671 from vitlibar/fix-minor-bugs-in-rbac
Fix minor bugs in RBAC
2020-06-16 12:09:54 +03:00
franklee
264e44ecef support distributed DDLs on cross replication clusters.
(cherry picked from commit fd09994d91)
2020-06-16 11:53:27 +03:00
Nikolai Kochetov
86bafbe6c3 Added test from #9043 2020-06-16 11:25:59 +03:00
Bharat Nallan
aa2d724ea1 add max_thread_pool_size setting to tests
This adds the `max_thread_pool_size` config to
tests/server-test.xml file.
2020-06-15 22:04:30 -07:00
Alexey Milovidov
bd330cfeb6 Update test 2020-06-16 05:56:50 +03:00
Alexey Milovidov
125b007360 Merge branch 'master' into remove-leader-election-2 2020-06-16 05:56:29 +03:00
Anton Popov
03058c3c25 fix 'ORDER BY WITH FILL' over const columns 2020-06-16 05:56:16 +03:00
alexey-milovidov
679c3f8ff3
Update 00446_clear_column_in_partition_zookeeper.sql 2020-06-16 04:50:22 +03:00
Alexey Milovidov
edff54e3ab Maybe fix max_parser_depth test 2020-06-16 04:08:01 +03:00
alexey-milovidov
9b734ffded
Update http_server.py 2020-06-16 03:21:20 +03:00
Alexey Milovidov
c85b9ae151 Fix test 2020-06-16 02:43:05 +03:00
Alexey Milovidov
97d5897d2b Fix test 2020-06-16 02:42:10 +03:00
Alexey Milovidov
a753ba9c6a Checked and corrected all other tests 2020-06-16 02:24:32 +03:00
Alexey Milovidov
e0f4c64acf Fix flaky test 2020-06-16 02:18:15 +03:00
Alexey Milovidov
00224ee94f Added a test 2020-06-16 02:04:12 +03:00
Anton Popov
eabbabed04 fix 'LIMIT WITH TIES' with aliases 2020-06-16 01:24:00 +03:00
Alexey Milovidov
ba82441989 Added a test 2020-06-15 23:13:57 +03:00
alesapin
bd17aa8a0e Increase timeout in test 2020-06-15 22:11:17 +03:00
Vitaly Baranov
a40885fa84 Add new command SHOW ACCESS. 2020-06-15 22:07:47 +03:00
Vitaly Baranov
9fe47df2e8 Support multiple users/roles in SHOW CREATE USER(ROLE, etc.) and SHOW GRANTS FOR commands.
Support syntax "SHOW CREATE USER ALL" and "SHOW GRANTS FOR ALL".
2020-06-15 22:07:47 +03:00
Vitaly Baranov
4187edd9f9 Split integration test 'test_grant_and_revoke' into two tests. 2020-06-15 22:07:47 +03:00
Vitaly Baranov
a5b70fbdda Add tests. 2020-06-15 22:07:47 +03:00
Alexander Tokmakov
d6e69211b1 fix test 2020-06-15 22:05:36 +03:00
Alexander Kuzmenkov
7cc54fd4f1 renames + perf test 2020-06-15 21:53:54 +03:00
Alexander Kuzmenkov
82b5ada130
Merge pull request #11650 from ksvladimir/master
Allow using groupArrayArray and groupUniqArrayArray as SimpleAggregateFunction
2020-06-15 21:29:57 +03:00
tavplubix
86e2cfe999
Merge pull request #11628 from zhang2014/feature/ISSUES-7572
ISSUES-7572 support config default http handler
2020-06-15 20:37:04 +03:00
Vitaly Baranov
4bd00b02e2 Improve syntax of CREATE QUOTA. Now resource types and key types could be written with underscores.
Also rename columns key_type=>keys and source=>storage in table system.quotas.
2020-06-15 20:10:34 +03:00
Vitaly Baranov
9f31184d76 Support for multiple names in one CREATE/ALTER command. 2020-06-15 20:10:28 +03:00
Alexey Milovidov
a5e9d793b0 Merge branch 'master' into avoid-trailing-whitespaces-in-some-cases 2020-06-15 19:48:07 +03:00
Alexander Kuzmenkov
0743e8c15d Merge remote-tracking branch 'origin/master' into minmap 2020-06-15 19:39:57 +03:00
alexey-milovidov
3878254e0c
Trigger CI 2020-06-15 19:21:52 +03:00
Alexander Kuzmenkov
e460d7c2bd
Merge pull request #11638 from azat/skip-idx-bloom-filter-fix
Fix bloom filters for String (data skipping indices)
2020-06-15 18:41:04 +03:00
alesapin
8f66c1b22c Merge with master 2020-06-15 17:31:37 +03:00
alesapin
8945d0073a Fix misunderstanding bug in mutations finalization 2020-06-15 16:37:40 +03:00
Vitaly Baranov
c7140724a8 Fix that ALTER USER RENAME could change allowed hosts. 2020-06-15 16:34:16 +03:00