alexey-milovidov
a3f0ba17ea
Update SortDescription.h
2020-07-05 19:26:57 +03:00
Anton Popov
73676f5022
Improve performace of reading in order of sorting key. ( #11696 )
...
* simplify reading in order of sorting key
* add perf test for reading many parts
* Revert "simplify reading in order of sorting key"
This reverts commit 7267d7c46e
.
* add threshold for preliminary merge for reading in order
* better threshold
* limit threads in test
2020-07-04 15:48:51 +03:00
Anton Popov
4422df2e37
Merge remote-tracking branch 'upstream/master' into HEAD
2020-07-02 20:18:21 +03:00
alesapin
64583ceb22
Merge branch 'master' into add-storage-rabbitmq-read-only
2020-07-02 16:08:29 +03:00
Nikolai Kochetov
8587c2025d
Merge branch 'master' into initial-explain
2020-06-29 23:35:56 +03:00
tavplubix
99dfd33e71
Merge pull request #12007 from oandrew/avro-allow-missing-fields
...
Avro: allow_missing_fields setting
2020-06-29 14:40:27 +03:00
alexey-milovidov
935d2be826
Merge pull request #12003 from ClickHouse/fix-typos
...
Fix typos in code
2020-06-28 15:49:17 +03:00
Andrew Onyshchuk
9054862dde
Avro: allow missing fields
2020-06-27 21:23:21 -05:00
alexey-milovidov
5a99cdb0d9
Merge pull request #11996 from BohuTANG/mysql_engine_enum
...
ISSUES-3985 Support MySQL engine reading Enums type
2020-06-27 22:18:25 +03:00
Alexey Milovidov
1462a66d1e
Fix typos
2020-06-27 22:05:00 +03:00
Nikolai Kochetov
5b1596cdb2
Refactor some code.
2020-06-27 17:02:24 +03:00
Nikolai Kochetov
893a75bcf7
Merge branch 'master' into initial-explain
2020-06-27 12:45:40 +03:00
Nikolai Kochetov
ca01094f4b
More actions description.
2020-06-27 12:31:11 +03:00
Nikolai Kochetov
47d9f4af9c
Header for explain.
2020-06-27 12:30:51 +03:00
BohuTANG
f609fd34f7
Support Enums type for MySQL engine #3985
2020-06-27 09:10:07 +08:00
alesapin
e9c47dc89c
Merge branch 'master' into CurtizJ-polymorphic-parts
2020-06-26 14:27:19 +03:00
Alexander Kuzmenkov
593a0181bd
Merge pull request #11616 from ClickHouse/aku/perf-benchmark
...
Add concurrent benchmark to performance test
2020-06-25 09:36:52 +03:00
Artem Zuikov
2391ac22b7
Rewrite arithmetic in aggregate functions optimisation ( #11899 )
2020-06-24 21:49:55 +03:00
alesapin
3fc65b3269
Merge branch 'master' into kssenii-rabbit-mq
2020-06-24 20:14:28 +03:00
alexey-milovidov
18eb141ea1
Merge pull request #11715 from azat/dist-optimize_skip_unused_shards-fixes
...
Control nesting level for shards skipping and disallow non-deterministic functions
2020-06-24 12:54:58 +03:00
Alexander Kuzmenkov
e0bdbe73d2
Merge remote-tracking branch 'origin/master' into HEAD
2020-06-23 15:31:09 +03:00
Alexander Kuzmenkov
ab809f59b9
memory usage settings
2020-06-23 15:30:45 +03:00
alesapin
4185fe9975
Merge branch 'master' into atomic_metadata5
2020-06-23 11:13:05 +03:00
alexey-milovidov
1c1e12f06b
Merge pull request #11826 from ClickHouse/send-logs-on-fatal-errors
...
Send logs to client on fatal errors if possible
2020-06-23 09:49:48 +03:00
alesapin
1fefb86f7b
Merge branch 'master' into atomic_metadata5
2020-06-22 17:00:33 +03:00
Alexey Milovidov
b50b4b14de
Merge branch 'master' into send-logs-on-fatal-errors
2020-06-22 15:48:46 +03:00
Alexander Kuzmenkov
7ab326a143
remove unneeded define
2020-06-22 15:34:25 +03:00
Alexander Kuzmenkov
ffc5b21bad
Merge remote-tracking branch 'origin/master' into HEAD
2020-06-22 15:28:03 +03:00
tavplubix
0e42649e39
Merge pull request #11855 from zhang2014/fix/build_failure
...
fix PostgreSQL protocol build failure
2020-06-22 14:07:22 +03:00
zhang2014
903cb4c4e2
fix PostgreSQL protocol build failure
2020-06-22 17:12:00 +08:00
alesapin
b9e74f4e82
Merge branch 'master' into atomic_metadata5
2020-06-22 12:03:53 +03:00
Alexey Milovidov
8cc411c5b5
Clarify setting
2020-06-21 21:50:02 +03:00
alexey-milovidov
c3a5c32a48
Merge branch 'master' into arch-chooser
2020-06-21 21:30:06 +03:00
Alexey Milovidov
71317dd59c
Merge branch 'master' into send-logs-on-fatal-errors
2020-06-21 19:05:20 +03:00
Azat Khuzhin
fb30629ff2
Add settings to control nesting level for shards skipping optimization
...
- optimize_skip_unused_shards_nesting (allows control nesting level for
shards skipping optimization)
- force_skip_optimize_shards_nesting (allows control nesting level for
checking was shards skipped or not)
- deprecates force_skip_optimize_shards_no_nested
2020-06-21 15:27:01 +03:00
Alexey Milovidov
3f96bdaa24
Minor changes after merge
2020-06-21 15:16:08 +03:00
alexey-milovidov
4ee623ccac
Merge pull request #10242 from MovElb/movelb-postgresql-wire-protocol-impl
...
PostgreSQL wire protocol implementation
2020-06-21 14:39:22 +03:00
Alexey Milovidov
fe71a8eb8c
Merge branch 'master' into send-logs-on-fatal-errors
2020-06-21 13:55:11 +03:00
Denis Glazachev
6c1b2a4831
Merge branch 'master' into ldap-per-user-authentication
...
* master: (114 commits)
Update alter.md (#11823 )
Update PODArray.h
Added a test for #6549
Update create.md
Update create.md
replacingmergetree translate into "替换合并树“ better (#11814 )
Whitespace
Fix style
Added a test
Fix another 10% of bad code #11529
Update join.md (#11798 )
Update memory.md (#11800 )
Whitespace
Check for tests with "fail" in their names
Fix 10% of bad code #11756
Update PODArray.h
avoid duplicate short system name
adapt recent result as well
[website] tune benchmark pages styling + add extra checks
Added MSan suppression for Hyperscan
...
# Conflicts:
# src/Common/ErrorCodes.cpp
2020-06-20 22:01:12 +04:00
Alexey Milovidov
14e29f2c11
Disable bad optimization #10047
2020-06-20 21:00:00 +03:00
Alexey Milovidov
826fdf44ae
Set send_logs_level to fatal by default
2020-06-20 14:28:49 +03:00
Azat Khuzhin
caa195c034
Add number of errors to ignore while choosing replicas (distributed_replica_max_ignored_errors)
...
This will allow avoid switching to another replica in case of error
(since error can be temporary).
2020-06-20 11:20:16 +03:00
Alexey Milovidov
9f26ac06ea
Fix another 10% of bad code #11529
2020-06-20 09:54:05 +03:00
Vxider
add49518f3
Merged with master
2020-06-19 23:12:25 +08:00
Denis Glazachev
5db60202b6
Merge branch 'master' into ldap-per-user-authentication
2020-06-19 00:11:08 +04:00
Azat Khuzhin
6507247328
optimize_skip_unused_shards=2 will disable it for nested distributed queries
...
P.S. Looks like settings can be converted between SettingUInt64 and
SettingBool without breaking binary protocol.
FWIW maybe it is a good idea to change the semantics of the settings as
follow (but I guess that changing semantic is not a good idea, better to
add new settings and deprecate old ones):
- optimize_skip_unused_shards -- accept nesting level on which the
optimization will work
- force_skip_optimize_shards_nesting -- accept nesting level on which
the optimization will work
2020-06-18 21:49:29 +03:00
alesapin
2ca9cfa753
Merge branch 'master' into atomic_metadata5
2020-06-18 20:28:01 +03:00
Ruslan
23cd919681
Any input optimize ( #11529 )
...
* workig commit №1
* working commit №2
* first version of ArithmeticOperationsInAgrFuncOptimize (min, max, sum)
* fix conflicts
* fix №2
* attempt №3
* Description + little mistake
* fix style + expanded optimization + add performance test
* style + merge with new version
* one more branch
* bug fix + merge
* just merge
* some code style and logic fixes
* little changes
* tests
* test(2)
* style
* seems to have fixed everything that was required
* bug fix
* style
* build fix
* fix typo
* fix clang-10 warning
* fix clang-10 warning
* nolint
* add new files to ya.make
* extract all functions from Any
* add last new lines.
* extract all functions from Any
* add last new lines.
* build + requested changes
* code style
* build + little perf test + anyLast
* minor changes
* bug fix
* minor changes
* another minor changes
* fix + experement
* experement 2.0
* experement 3.0
* experement 3.1
* experement 4.0
* last experement(think so)
* just another attempt to fix UB
* minor changes
* I think I won
* ya.make
* fix requested changes
Co-authored-by: Artem Zuikov <chertus@gmail.com>
2020-06-18 19:34:29 +03:00
alesapin
d79982f497
Better locks in Storages
2020-06-18 19:10:47 +03:00
Artem Zuikov
6af36cb703
CAST keep nullable ( #11733 )
2020-06-18 13:18:28 +03:00
alesapin
ebb36bec8a
Merge branch 'master' into atomic_metadata5
2020-06-18 11:57:16 +03:00
alesapin
dffdece350
getColumns in StorageInMemoryMetadta (only compilable)
2020-06-17 19:39:58 +03:00
Nikita Mikhaylov
ff0262626a
Merge pull request #11645 from azat/load-balancing-round-robin
...
Add round_robin load_balancing
2020-06-17 14:34:59 +04:00
xPoSx
2d8110ce45
Eliminate min/max/any aggregators of GROUP BY keys in SELECT section ( #11667 )
2020-06-17 12:32:43 +03:00
alesapin
2fac3290f0
Merge branch 'master' into atomic_metadata5
2020-06-17 11:14:03 +03:00
Artem Zuikov
857d84bf7c
Buffer left blocks optimisation for MergeJoin ( #10601 )
2020-06-16 23:13:18 +03:00
alesapin
eae901f58d
Merge branch 'master' into atomic_metadata5
2020-06-16 14:44:45 +03:00
xPoSx
9fc37e1f75
Remove functions of other keys in GROUP BY section ( #10051 )
2020-06-16 12:14:25 +03:00
Anton Popov
b19d48a11c
Merge remote-tracking branch 'upstream/master' into HEAD
2020-06-16 06:37:55 +03:00
alesapin
36ba0192df
Metadata in read and write methods of IStorage
2020-06-15 22:08:58 +03:00
Mikhail Malafeev
10566e2b43
Remove duplicate ORDER BY and DISTINCT from subqueries ( #10067 )
2020-06-15 15:03:01 +03:00
tavplubix
20b8e1e9ec
Merge pull request #11057 from Potya/null_data_mods
...
Null data mods
2020-06-15 13:04:51 +03:00
alexey-milovidov
fd6115cccf
Merge pull request #11648 from ClickHouse/simplify-code-functions-comparison-3
...
Allow comparison with String in index analysis; simplify code.
2020-06-15 05:47:03 +03:00
Alexey Milovidov
067cf4cc40
Fix gcc build
2020-06-14 21:31:42 +03:00
Alexander Tokmakov
5f9739fbf9
Merge branch 'master' into fork-potya/null_data_mods
2020-06-14 18:11:55 +03:00
Alexey Milovidov
6c278fee61
Better exception message
2020-06-14 04:07:47 +03:00
Azat Khuzhin
0e378590fe
Add load_balancing=round_robin
2020-06-14 01:09:21 +03:00
Azat Khuzhin
5f82cc0021
Fix description for LoadBalancing::IN_ORDER
2020-06-13 23:17:30 +03:00
kssenii
18820814f5
Merge
2020-06-10 23:25:33 +00:00
Denis Glazachev
9e3a28a6b8
Merge branch 'master' into ldap-per-user-authentication
...
* master: (414 commits)
Update file.md
Update merge.md
Update dictionary.md
Update external-data.md
Update distributed.md
Update null.md
Update set.md
Update join.md
Update url.md
Update view.md
Update materializedview.md
Update memory.md
Update buffer.md
Update generate.md
removed a sentence about global lock during rename (#11577 )
greatCircleAngle en translation (#11584 )
Update configuration-files.md
try fix flacky test
Update why.html
Update rich.html
...
# Conflicts:
# src/Common/ErrorCodes.cpp
# utils/ci/jobs/quick-build/run.sh
2020-06-11 03:06:17 +04:00
alexey-milovidov
4f2ed7a5e3
Merge branch 'master' into arch-chooser
2020-06-10 22:31:19 +03:00
Vxider
ab160a3d92
Merged with master
2020-06-09 16:48:04 +08:00
Ivan
058821fa02
Merge branch 'master' into kafka_better_settings
2020-06-06 19:50:38 +03:00
Anton Popov
5c42408add
Merge pull request #9113 from dimarub2000/group_by_in_order_optimization
...
[WIP] Optimization of GROUP BY with respect to table sorting key.
2020-06-06 14:25:59 +03:00
alexey-milovidov
5f99d887cc
Merge pull request #11443 from 4ertus2/strange
...
Rename setting
2020-06-06 01:45:21 +03:00
Artem Zuikov
ab86ca2fb6
rename v2
2020-06-05 01:10:52 +03:00
Alexander Kuzmenkov
377da4656d
cleanup
2020-06-04 18:51:34 +03:00
Artem Zuikov
24ee7346a9
rename setting
2020-06-04 17:31:57 +03:00
Mikhail Filimonov
ea6545a175
Return output_format_pretty_max_value_width after rebase
2020-06-03 20:28:28 +02:00
Mikhail Filimonov
4956ade67d
Support for all format settings in Kafka, expose some setting on table level, better defaults.
2020-06-03 19:01:41 +02:00
Anton Popov
1ce09e1faa
Merge remote-tracking branch 'upstream/master' into polymorphic-parts
2020-06-03 16:27:54 +03:00
Alexander Kuzmenkov
3bf9cec63b
Merge remote-tracking branch 'origin/master' into HEAD
2020-06-03 14:49:49 +03:00
Ruslan
7757c9ec57
Remove arithmetic operations from aggregation functions ( #10047 )
2020-06-03 13:28:30 +03:00
Denis Glazachev
c61cbe8e98
Merge branch 'master' into ldap-per-user-authentication
...
* master: (114 commits)
Update PushingToViewsBlockOutputStream.cpp
Update PushingToViewsBlockOutputStream.cpp
make clang-10 happy
Fix sync_async test (remove timeout)
CLICKHOUSEDOCS-631: temporary_files_codec, join_on_disk_max_files_to_merge settings. (#11242 )
Suppress output of cancelled queries in clickhouse-client #9473
Better log messages in ConfigReloader
fix select from StorageJoin
Fix unit tests under MSan
Added test.
Fix build.
Fix arguments for AggregateFunctionQuantile/
Update style.md
Add a guide on error messages.
Report dictionary name on dictionary load errors.
more types in ASOF JOIN (#11301 )
Fix part_log test
Update test.
Add perftest.
Parallel processing for PushingToViewsBlockOutputStream::writeSuffix
...
2020-06-02 12:42:29 +04:00
Alexey Milovidov
d34b1a8791
Merge branch 'master' into improve-performance-of-client-interactive-mode
2020-06-02 04:24:17 +03:00
kssenii
d3b069e37b
Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into add-storage-rabbitmq-read-only
2020-06-01 18:25:36 +00:00
Alexander Kuzmenkov
9a2474ba84
move settings to a more suitable location
2020-06-01 20:17:31 +03:00
Alexander Kuzmenkov
03d8bf9242
Merge remote-tracking branch 'origin/master' into HEAD
2020-06-01 20:15:25 +03:00
Alexey Milovidov
a76bd99e84
Added setting "output_format_pretty_max_value_width"
2020-06-01 01:12:13 +03:00
alexey-milovidov
9984e989c1
Merge pull request #11317 from ClickHouse/logger-fmt-2
...
Preparation for structured logging
2020-06-01 00:11:29 +03:00
alexey-milovidov
bebc6f82fc
Merge pull request #10678 from livace/add_geo_types
...
Add geo data types Point and Polygon
2020-05-31 17:25:15 +03:00
Denis Glazachev
e8144976fe
Merge branch 'master' into ldap-per-user-authentication
2020-05-31 15:09:16 +04:00
kssenii
e80b405359
Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into add-storage-rabbitmq-read-only
2020-05-31 10:30:53 +00:00
Alexey Milovidov
25f941020b
Remove namespace pollution
2020-05-31 00:57:37 +03:00
Dmitry
4b0d32f026
Merge branch 'master' of github.com:yandex/ClickHouse into group_by_in_order_optimization
2020-05-31 00:21:02 +03:00
MovElb
142c63e487
done rebase
2020-05-30 23:02:11 +03:00
MovElb
b4b5c90343
squash
2020-05-30 20:05:05 +03:00
Alexey Milovidov
421a62e978
Merge branch 'master' into fix-false-too-slow
2020-05-30 19:36:55 +03:00
Alexey Ilyukhov
b84c8fcbd8
Add allow_experimental_geo_types; add test
2020-05-30 18:26:19 +03:00
Nikolai Kochetov
22cba267e3
Merge pull request #11295 from ClickHouse/abb-back-experimental_use_processors-setting
...
Revert setting.
2020-05-30 10:04:07 +03:00
Alexey Milovidov
0eb2f4dee9
Change default value of "timeout_before_checking_execution_speed" to make it reasonable
2020-05-29 21:51:51 +03:00
Nikolai Kochetov
36b1a37927
Revert setting.
2020-05-29 21:23:11 +03:00
Dmitry
adcb88a1d5
turn OFF by default
2020-05-29 13:54:13 +03:00
Dmitrii Kovalkov
9387981abe
Add afwul option for choosing implementation
2020-05-29 07:35:01 +02:00
Alexey Milovidov
9120495c48
Increase chunk size for parallel parsing just in case
2020-05-29 05:31:45 +03:00
Alexey Milovidov
23d7947549
Fix constraints for DEFAULT fields; fix constraints for temporary tables; improve performance of INSERT for small blocks
2020-05-29 05:08:48 +03:00
Denis Glazachev
2863de750e
Merge branch 'master' into ldap-per-user-authentication
2020-05-28 01:30:52 +04:00
Denis Glazachev
d74f1357d4
Add LDAP authentication support
2020-05-28 01:06:33 +04:00
Alexander Kuzmenkov
640df68e05
Merge pull request #11184 from ClickHouse/enable-log-queries
...
Enable log_queries by default
2020-05-27 20:55:31 +03:00
Alexander Kuzmenkov
db84f0e892
Merge remote-tracking branch 'origin/master' into HEAD
2020-05-27 16:30:13 +03:00
Dmitry
38c585f867
Merge branch 'master' of github.com:yandex/ClickHouse into group_by_in_order_optimization
2020-05-26 21:27:50 +03:00
kssenii
ad1c0de8db
Merge
2020-05-26 17:45:39 +00:00
Vasily Nemkov
28a2cc0a82
Functions {to,from}UnixTimestamp64{Milli,Micro,Nano}
...
* Family of functions to convert DateTime64 to Int64 and back, usefull for
imporintg/exporting raw timestamp values of certain precision.
* Docs
* Tests
* Fixed ya.make
2020-05-26 16:42:22 +03:00
Ivan Blinkov
548fc7141a
Enable log_queries by default
2020-05-25 21:12:03 +03:00
Alexey Milovidov
7e1813825b
Return old names of macros
2020-05-24 01:24:01 +03:00
Alexey Milovidov
e391b77d81
find {base,src,programs} -name '*.h' -or -name '*.cpp' | xargs grep -l -P 'LOG_\w+\([^,]+, "[^"]+" << [^<]+ << "[^"]+"\);' | xargs sed -i -r -e 's/(LOG_\w+)\(([^,]+), "([^"]+)" << ([^<]+) << "([^"]+)"\);/\1_FORMATTED(\2, "\3{}\5", \4);/'
2020-05-23 19:56:05 +03:00
Alexey Milovidov
ee4ffbc332
find {base,src,programs} -name '*.h' -or -name '*.cpp' | xargs grep -l -P 'LOG_\w+\([^,]+, "[^"]+" << [^<]+\);' | xargs sed -i -r -e 's/(LOG_\w+)\(([^,]+), "([^"]+)" << ([^<]+)\);/\1_FORMATTED(\2, "\3{}", \4);/'
2020-05-23 19:47:56 +03:00
Alexey Milovidov
8d2e80a5e2
find {base,src,programs} -name '*.h' -or -name '*.cpp' | xargs grep -l -P 'LOG_\w+\([^,]+, "[^"]+"\)' | xargs sed -i -r -e 's/(LOG_\w+)\(([^,]+, "[^"]+")\)/\1_FORMATTED(\2)/'
2020-05-23 19:42:39 +03:00
Andrey Skobtsov
d1d9af4fea
Perf metrics disabled by default
2020-05-22 14:16:41 +03:00
alesapin
b9dfa61774
Merge pull request #11042 from CurtizJ/modify-ttl
...
Apply TTL for old data, after ALTER MODIFY TTL query
2020-05-22 11:12:14 +03:00
Dmitry
47778c0259
Merge branch 'master' of github.com:yandex/ClickHouse into group_by_in_order_optimization
2020-05-21 23:45:12 +03:00
Andrey Skobtsov
8b98bfe1d4
Enable perf measurements by default for performance tests
2020-05-20 21:28:58 +03:00
Andrey Skobtsov
4816abed28
Settings for measuring only particular metrics via perf events
2020-05-20 21:25:49 +03:00
Anton Popov
d62fe980ef
Merge remote-tracking branch 'upstream/master' into modify-ttl
2020-05-20 16:52:30 +03:00
kssenii
3b75f214c5
Register RabbitMQ storage
2020-05-20 09:09:20 +03:00
potya
a21cc0e76e
Add NULL and NOT NULL modifiers for data types in create query
2020-05-20 04:26:19 +03:00
potya
d8bb98bbcf
Add NULL and NOY NULL modifiers for data types in create query
2020-05-20 04:22:32 +03:00
potya
cee9c1517e
cast_keep_nullable set to false
2020-05-20 01:51:06 +03:00
potya
f138628727
Add cast_keep_nullable setting
2020-05-20 01:18:49 +03:00
Nikolai Kochetov
c147badf4f
Merge remote-tracking branch 'upstream/master' into min_mv_insert_block_size
2020-05-19 18:24:21 +03:00
Anton Popov
58ed04dc24
materialize TTL after its modifying
2020-05-19 04:53:01 +03:00
Artem Zuikov
97c7447130
Bitonic sort improvements ( #10934 )
2020-05-19 00:41:23 +03:00
alexey-milovidov
7efd2a825f
Merge pull request #10463 from ClickHouse/parallel-final
...
Parallel final
2020-05-18 05:20:18 +03:00
alexey-milovidov
7cf3538840
Merge pull request #10270 from ClickHouse/quota-key-in-client
...
Support quota_key for Native client
2020-05-17 14:09:40 +03:00
Azat Khuzhin
c1cf31f87d
Introduce min_insert_block_size_{rows,bytes}_for_materialized_views
...
With tons of MATERIALIZED VIEW attached to one table pushing to this
views can be pretty memory consuming due to blocks squashing, add
ability to control this separatelly for MATERIALIZED VIEWs.
Plus squashing is useless if the underlying engine is Buffer().
2020-05-17 12:21:05 +03:00
alexey-milovidov
a3346e9331
Merge pull request #10912 from ClickHouse/static-mutate
...
Static mutate
2020-05-17 09:05:35 +03:00
Alexey Milovidov
f4ac1eec04
Merge branch 'master' into quota-key-in-client
2020-05-17 08:15:13 +03:00
Alexey Milovidov
2df8c4f62e
Merge branch 'master' into input-format-use-header-by-default
2020-05-17 05:40:01 +03:00
alesapin
be4037abb5
Merge pull request #10895 from ClickHouse/fix_multiple_renames
...
Fix error in multiple rename commands in a single query.
2020-05-16 12:54:04 +03:00
Nikolai Kochetov
c957154fef
Merge pull request #10952 from ClickHouse/fix-distributed-queries-incompatibility-19.16-20.1
...
Fix incompatibility of two-level aggregation between 19.16 and 20.1
2020-05-16 10:17:15 +03:00
Nikolai Kochetov
fb38c2a30b
Remove experimental_use_processors setting, part 1. ( #10924 )
...
Remove experimental_use_processors setting, part 1.
2020-05-15 22:28:10 +03:00
Alexey Milovidov
485d37b043
Fix incompatibility of two-level aggregation between 19.16 and 20.1
2020-05-15 22:09:32 +03:00
Alexey Milovidov
7a20d95339
Enable input_format_with_names_use_header by default
2020-05-15 10:30:26 +03:00
Anton Popov
14e1a46a8c
Merge remote-tracking branch 'upstream/master' into polymorphic-parts
2020-05-15 03:48:27 +03:00
Ri
fc7afaa639
Bitonic sort on GPU (OpenCL) ( #10232 )
2020-05-15 03:01:14 +03:00
Nikolai Kochetov
4d22374f24
Merged with master.
2020-05-14 12:06:15 +03:00
Nikolai Kochetov
4d0503f021
Make IColumn::mutate() static.
2020-05-14 11:30:18 +03:00
alesapin
ab760846c2
Fix some rename cases
2020-05-13 20:43:30 +03:00
Dmitry
c4295d97f9
Merge branch 'master' of github.com:yandex/ClickHouse into group_by_in_order_optimization
2020-05-12 17:57:32 +03:00
Dmitry
3ec80b5531
now aggregates in parallel
2020-05-12 17:50:13 +03:00
potya
723e61c410
go back
2020-05-12 16:19:38 +03:00
alexey-milovidov
75607db571
Merge pull request #10826 from azat/block-sort-fix
...
Fix columns order after Block::sortColumns()
2020-05-12 06:39:18 +03:00
Azat Khuzhin
b963085920
Fix style check in Block::sortColumns() (sigh)
2020-05-12 04:04:25 +03:00
Azat Khuzhin
4de7d7a84f
Sort iterators to avoid extra std::string creation in Block::sortColumns()
...
Since std::string is pretty heavy.
Suggested-by: @alexey-milovidov
2020-05-12 03:53:08 +03:00
Azat Khuzhin
0e117abd2b
Optimize Block::sortColumns()
...
Suggested-by: @alexey-milovidov
2020-05-12 03:45:50 +03:00
Azat Khuzhin
ce26c09d02
Make order of columns strict in Block::sortColumns()
...
Before it depends on the buckets, since it uses plain unordered_set.
2020-05-12 02:50:42 +03:00
alexey-milovidov
1e70230991
Merge pull request #10722 from Enmk/DateTime64_fixes
...
function toStartOfSecond(DateTime64) -> DateTime64
2020-05-11 20:20:58 +03:00
Vasily Nemkov
2c2005817f
New function toStartOfSecond(DateTime64) -> DateTime64
...
This funtion nullifies sub-second part of DateTime64 value.
2020-05-11 12:06:06 +03:00
alexey-milovidov
33d491edf3
Merge pull request #10516 from azat/dist-GROUP_BY-sharding_key-fixes
...
Disable GROUP BY sharding_key optimization by default (and fix for WITH ROLLUP/CUBE/TOTALS)
2020-05-11 12:03:27 +03:00
alexey-milovidov
40ef113503
Merge branch 'master' into parallel-final
2020-05-11 06:47:44 +03:00
alexey-milovidov
ddc84163a7
Merge pull request #10486 from azat/dist-send-on-INSERT
...
Fix distributed send that are scheduled by INSERT query
2020-05-11 06:28:35 +03:00
Azat Khuzhin
7342f46394
Fix setting type for the memory_profiler_sample_probability
2020-05-10 15:49:31 +03:00
Chao Wang
bc5f9d5322
Fix comment for merge_tree_max_bytes_to_use_cache
2020-05-08 16:39:00 -04:00
Ivan
85d783c247
Poco contrib refactoring ( #10396 )
...
* Remove config_common.h
* Refactor libcpuid contrib
* Remove support for libcpuinfo
* Define USE_CPUID in Arcadia
* Refactor Poco libraries
2020-05-08 17:11:19 +03:00
Dmitry
7bbb85dbe5
small fixes
2020-05-07 18:37:19 +03:00
tavplubix
04a24c59dc
Add tests with DatabaseAtomic ( #10714 )
...
* add tests with DatabaseAtomic
* fix
2020-05-07 14:29:58 +03:00
Anton Popov
387041a97e
Merge remote-tracking branch 'upstream/master' into polymorphic-parts
2020-05-06 19:22:07 +03:00
Dmitry
e98c23a8cf
read in order enabled
2020-05-05 17:35:23 +03:00
alexey-milovidov
c54f6d5a66
Merge pull request #10546 from kyprizel/master
...
Lexer, ast, checksum and column specs fuzzers added
2020-05-05 14:50:55 +03:00
Alexey Milovidov
99c18c5a09
Check for suspicious codecs #4966
2020-05-04 03:11:49 +03:00
alexey-milovidov
0cdd48e468
Merge pull request #10598 from ClickHouse/sampling-memory-profiler
...
Add sampling memory profiler
2020-05-03 15:17:03 +03:00
Azat Khuzhin
0157fd5d93
Fix distributed send that are scheduled by INSERT query
...
Before this patch each INSERT query re-schedule distributed send, thus
each time it resets the timer, while this is not the expected behaviour,
since in on frequent INSERT distributed sends will not be triggered at
all.
Fix this by not resetting the timer.
2020-05-03 14:46:42 +03:00
tavplubix
a073cd6c79
Fix segfault in StorageBuffer when exception on server startup ( #10609 )
...
* fix segfault in StorageBuffer when exception on server startup
* Trigger CI
Co-authored-by: alexey-milovidov <milovidov@yandex-team.ru>
2020-05-02 19:54:20 +03:00
Alexey Milovidov
439777ef23
Allow to set memory_profiler_sample_probability per query
2020-05-01 22:17:56 +03:00
Anton Popov
aa723d245f
Merge remote-tracking branch 'upstream/master' into polymorphic-parts
2020-04-30 18:27:39 +03:00
Nikolai Kochetov
19dadb8c2d
Add parallel final.
2020-04-30 12:59:08 +03:00
Potya
351d62aa83
Nothing interesting
2020-04-29 15:17:40 +03:00
Nikolai Kochetov
a9d63d4520
Merge pull request #10498 from vzakaznikov/insert_into_watch_from_live_view
...
Adding support for INSERT INTO table WATCH query to build streaming systems using LIVE VIEW tables
2020-04-29 12:15:54 +03:00
Azat Khuzhin
038235684d
Add optimize_distributed_group_by_sharding_key and disable it by default
...
I know at least one way to fool that optimization, by using as sharding
key something like `if(col1>0, col1, col2)` (although this is not common
sharding key I would say, but can be useful if this will work
correctly), so let's disable it by default.
2020-04-29 00:09:25 +03:00
Artem Zuikov
e34a9457e6
Improve right table insert for Partial MergeJoin on disk ( #10467 )
2020-04-28 16:55:50 +03:00
Eldar Zaitov
043be916cb
Add miniman fuzzing documentation, fix code style.
2020-04-28 13:35:44 +03:00
Eldar Zaitov
670ed4bf1b
lexer, ast, checksum and column specs fuzzers added
2020-04-28 02:12:18 +03:00
Nikolai Kochetov
32baa073b5
Merge remote-tracking branch 'upstream/master' into insert_into_watch_from_live_view
2020-04-27 17:49:50 +03:00
alexey-milovidov
0a9bcae0ed
Merge pull request #10511 from ClickHouse/fix-ubsan-datetime64
...
Fixed UBSan for DateTime64; added a test
2020-04-26 20:17:01 +03:00
alexey-milovidov
378d73d477
Merge pull request #10449 from azat/metrics-for-new-bg-schedule-pools
...
Add tasks/memory metrics for distributed/buffer schedule pools
2020-04-26 20:16:02 +03:00
Alexey Milovidov
a70637ab4b
Fixed UBSan; added a test
2020-04-26 17:57:45 +03:00
Vitaliy Zakaznikov
369b4d53ef
Adding support for output_format_enable_streaming
format setting.
2020-04-26 15:44:11 +02:00
Dmitry
d9ac0e8fef
Merge branch 'master' of github.com:yandex/ClickHouse into group_by_in_order_optimization
2020-04-26 14:44:06 +03:00
Vitaliy Zakaznikov
71a40d6ec9
Revert "Working on adding AUTO REFRESH to LIVE VIEW tables."
...
This reverts commit 855e06b031
.
2020-04-25 09:56:57 -04:00
Vitaliy Zakaznikov
855e06b031
Working on adding AUTO REFRESH to LIVE VIEW tables.
2020-04-24 17:15:17 -04:00
Alexander Tokmakov
04d6b59ac0
Merge branch 'master' into database_atomic
2020-04-23 17:31:37 +03:00
Azat Khuzhin
4f5ec14f27
Configure thread names for buffer/distributed schedule pools
2020-04-23 03:16:14 +03:00
Azat Khuzhin
d854049d21
Add tasks/memory metrics for distributed/buffer schedule pools
...
Follow-up-for: #10315
Follow-up-for: #10263
2020-04-23 02:18:37 +03:00
Alexander Tokmakov
fefbbd37df
Merge branch 'master' into database_atomic
2020-04-22 17:02:30 +03:00
Alexey Milovidov
be22a4b94e
Checkpoint
2020-04-22 08:39:31 +03:00
Alexey Milovidov
0482e2e3ea
Implement suggestion from Sergey Veletsky
2020-04-22 01:40:18 +03:00
alexey-milovidov
4ecc86beca
Merge pull request #9950 from ClickHouse/aku/literal-columns
...
Create unique columns for literals
2020-04-21 02:30:17 +03:00
alexey-milovidov
faeab5f649
Merge pull request #10370 from amosbird/clang-10
...
clang-10 fix
2020-04-20 22:47:12 +03:00
Alexander Tokmakov
b29bddac12
Merge branch 'master' into database_atomic
2020-04-20 14:09:09 +03:00
alexey-milovidov
9d0004cba0
Merge pull request #10365 from ClickHouse/avoid-infinite-loop-in-hierarchical-dictionaries
...
Avoid infinite loop in hierarchical dictionaries
2020-04-20 10:54:16 +03:00
Amos Bird
2d08c8e4ab
clang-10 fix
2020-04-20 15:45:37 +08:00
Alexey Milovidov
d99c26a40c
Fix infinite loop in dictIsIn function #515
2020-04-20 05:31:21 +03:00
Anton Popov
4069dbcc58
in-memory parts: add waiting for insert
2020-04-20 04:38:38 +03:00
Alexey Milovidov
1d885b3ff9
Merge branch 'master' into quota-key-in-client
2020-04-20 02:15:37 +03:00
Alexey Milovidov
3755a5ba54
Added suggestion from Azat
2020-04-20 01:59:21 +03:00
Alexey Milovidov
2987e70aab
Introduce "max_server_memory_usage" setting
2020-04-20 01:59:21 +03:00
Azat Khuzhin
5d11118cc9
Use thread pool (background_distributed_schedule_pool_size) for distributed sends
...
After #8756 the problem with 1 thread for each (distributed table, disk)
for distributed sends became even worse (since there can be multiple
disks), so use predefined thread pool for this tasks, that can be
controlled with background_distributed_schedule_pool_size knob.
2020-04-19 12:01:56 +03:00
Azat Khuzhin
201d5d5b25
Update comment for background_schedule_pool_size
...
Include info about:
- kafka streaming
- dns cache updates
2020-04-19 11:20:57 +03:00
alexey-milovidov
17b6e0b3e5
Merge pull request #10315 from azat/buffer-flush-bg-pool
...
Use background thread pool for background buffer flushes
2020-04-18 15:04:35 +03:00
Dmitry
25cd4ce132
Merge branch 'master' of github.com:yandex/ClickHouse into group_by_in_order_optimization
2020-04-18 12:56:34 +03:00
alexey-milovidov
17e7d4d88a
Merge pull request #10307 from abyss7/arcadia-4
...
Changes for auto-sync with Arcadia
2020-04-17 05:08:34 +03:00
Azat Khuzhin
a9b1b36907
Use separate pool for buffer flushes (background_buffer_flush_schedule_pool_size)
2020-04-16 20:14:28 +03:00
Ivan Lezhankin
e230632645
Changes required for auto-sync with Arcadia
2020-04-16 15:31:57 +03:00
Alexey Milovidov
cdeda4ab91
Fix usage of max_parser_depth setting; remove harmful default function arguments
2020-04-16 04:06:10 +03:00
Alexey Milovidov
fe59524481
Implemented in a different way
2020-04-15 04:59:14 +03:00
Alexey Milovidov
c22f91db01
Allow to pass quota_key in clickhouse-client
2020-04-15 04:15:05 +03:00
Alexander Kuzmenkov
59e8230271
Merge remote-tracking branch 'origin/master' into HEAD
2020-04-14 02:27:46 +03:00
Alexander Tokmakov
6c0d9723e0
Merge branch 'master' into database_atomic
2020-04-13 18:47:47 +03:00
Alexander Tokmakov
20e6593f96
disable by default
2020-04-12 21:52:59 +03:00
Alexander Tokmakov
5e6d4b9449
Merge branch 'master' into database_atomic
2020-04-12 16:35:44 +03:00
Azat Khuzhin
365b5207b7
Add log_queries_min_type to filter which entries will be written to query_log
...
Can be used to write into query_log only failed queries (i.e. on memory
exceeded error), by using:
set log_queries_min_type='EXCEPTION_WHILE_PROCESSING'
2020-04-12 10:46:36 +03:00
alexey-milovidov
9203db0ad5
Merge pull request #10140 from BohuTANG/20200409_bug_fix_mysql_handshake_scramble
...
Fix scramble issue for native mysql-connector-java(JDBC)
2020-04-12 03:53:19 +03:00
alexey-milovidov
2adeabd3c7
Update Settings.h
2020-04-12 01:58:45 +03:00
alexey-milovidov
00d8e7eefb
Merge branch 'master' into transform_null_in
2020-04-11 23:15:54 +03:00
alexey-milovidov
25236d3544
Merge branch 'master' into setting_allow_nondeterministic_mutations
2020-04-10 23:58:46 +03:00
alexey-milovidov
330d138106
Update Settings.h
2020-04-10 23:58:13 +03:00
Mikhail Filimonov
2f5b4b0f9b
Added ability to relax the restriction on non-deterministic functions usage in mutations with allow_nondeterministic_mutations setting.
2020-04-10 22:01:10 +02:00
Alexander Kazakov
26dd6140b2
Added new config settings to control timeouts
...
* "lock_acquire_timeout" controls for how long a query will continue to
acquire each lock on its argument tables
* "lock_acquire_timeout_for_background_operations" is a per-table
setting for storages of *MergeTree family
2020-04-09 21:10:27 +03:00
alexey-milovidov
cb6c860d89
Update MySQLProtocol.h
2020-04-09 06:25:20 +03:00
alexey-milovidov
ccf5cb2a66
Update MySQLProtocol.h
2020-04-09 06:24:09 +03:00
BohuTANG
e544edd726
Fix random scramble using seperator character issue during MySQL handshakes
2020-04-09 09:43:02 +08:00
Alexander Tokmakov
135197aa75
fixes
2020-04-08 04:02:00 +03:00
philip.han
53b5dade5e
Implement transform_null_in
2020-04-07 20:08:13 +09:00
Alexander Kuzmenkov
35783af25d
Merge remote-tracking branch 'origin/master' into HEAD
2020-04-07 03:34:39 +03:00
Alexander Tokmakov
08bae4668d
Merge branch 'master' into database_atomic
2020-04-06 16:18:07 +03:00
Vxider
2fb9138505
merged with master
2020-04-06 17:36:44 +08:00
Ivan Lezhankin
06446b4f08
dbms/ → src/
2020-04-03 18:14:31 +03:00