Commit Graph

262 Commits

Author SHA1 Message Date
Andrew Onyshchuk
7320447f92 Add Avro formats
Add Avro file input/output formats
Add AvroConfluent input format (for Kafka)
2020-01-08 03:18:00 -06:00
alexey-milovidov
42226b1a96
Added setting "min_bytes_to_use_mmap_io" (#8520)
* Added setting "min_bytes_to_use_mmap_io"

* Added setting "min_bytes_to_use_mmap_io"

* Added setting "min_bytes_to_use_mmap_io"

* Added setting "min_bytes_to_use_mmap_io"

* Added setting "min_bytes_to_use_mmap_io"

* Added setting "min_bytes_to_use_mmap_io"

* Added setting "min_bytes_to_use_mmap_io"

* Added setting "min_bytes_to_use_mmap_io"

* Added setting "min_bytes_to_use_mmap_io"

* Added setting "min_bytes_to_use_mmap_io"

* Added setting "min_bytes_to_use_mmap_io"

* Added setting "min_bytes_to_use_mmap_io": better error message

* Added setting "min_bytes_to_use_mmap_io": fixed error
2020-01-04 08:46:50 +03:00
alexey-milovidov
e712b22dda
Merge pull request #8484 from ClickHouse/obsolete-mark-cache-min-lifetime
Make "mark_cache_min_lifetime" setting obsolete
2019-12-31 20:56:54 +03:00
Alexey Milovidov
3339b8e0e5 Make "mark_cache_min_lifetime" setting obsolete 2019-12-31 05:47:10 +03:00
Alexey Milovidov
6e74bea7ea Added setting "optimize_if_chain_to_miltiif" 2019-12-31 03:00:41 +03:00
alexey-milovidov
89eeaa50e9
Merge branch 'master' into enable-experimental-indices-and-make-settings-obsolete 2019-12-26 22:16:50 +03:00
alesapin
f168977b9a Merge branch 'master' into synchronous_mutations 2019-12-23 16:24:50 +03:00
Alexey Milovidov
9ce8d5fe54 Deprecate "merge_tree_uniform_read_distribution" setting 2019-12-20 01:38:05 +03:00
Nikolai Kochetov
7a78bdc974 Set 0 as default for max_insert_threads. 2019-12-19 18:54:32 +03:00
alesapin
9fea941009 Make wait endless 2019-12-19 18:27:56 +03:00
alesapin
8116351f09 Fix setting description 2019-12-18 12:20:33 +03:00
Alexey Milovidov
f804ff5d1a Make the setting obsolete 2019-12-18 08:19:56 +03:00
alesapin
9a005d27ea Merge branch 'master' into synchronous_mutations 2019-12-17 15:27:36 +03:00
Vxider
2a94832ef6 parallel INSERT in INSERT SELECT query 2019-12-17 12:22:58 +08:00
alesapin
2695aa13c4 Add ability to execute mutations asynchronously 2019-12-16 18:51:15 +03:00
Alexander Tokmakov
cab852dd0e enable values optimization by default 2019-12-16 12:25:31 +03:00
Alexey Milovidov
8916b8f2e6 Make data skipping indices non-experimental. Make settings about data skipping indices, multiple JOINs and CROSS to INNER JOIN conversion obsolete, 2019-11-30 23:41:02 +03:00
Vladimir Chebotarev
37bebd1370 Improved BackgroundProcessingPool to use with background moves task. 2019-11-26 16:09:57 +03:00
Vladimir Chebotarev
e96c24786b Separated pool for background moves. 2019-11-26 16:08:59 +03:00
Nikita Mikhaylov
762d295ab0
Merge pull request #7780 from ClickHouse/aku/parallel-parsing
Merging parallel format parsing
2019-11-22 01:54:47 +03:00
Vitaly Baranov
6e2f9f6f6d Invert flags in Settings.h: IGNORABLE flag is replaced with IMPORTANT flag. 2019-11-20 19:37:04 +03:00
Alexander Kuzmenkov
7e5731d64e Merge remote-tracking branch 'origin/master' into HEAD 2019-11-19 16:15:47 +03:00
Alexander Kuzmenkov
f8f6de836a remove separate control for threads 2019-11-18 22:45:28 +03:00
Alexander Kuzmenkov
168e15b2ae chunk size -> chunk bytes 2019-11-18 22:45:26 +03:00
Vitaly Baranov
e40c140982 Add the ignorable flag for the settings. 2019-11-17 03:56:18 +03:00
Vitaly Baranov
ff6cba192b Replace pointer with reference in SettingsCollection<T>::MemberInfos::findStrict().
Rename SettingsCommon.h -> SettingsCollection.h for consistency.
2019-11-17 03:51:51 +03:00
Alexander Kuzmenkov
7f34c0089c Merge remote-tracking branch 'origin/master' into HEAD 2019-11-14 18:53:36 +03:00
Vasily Nemkov
5624bb3abb odbc table function now respects external_table_functions_use_nulls setting
* Passing setting value to ODBC-bridge on each request
 * Handling that setting value correctly in ODBC-bridge
 * Fixed issue with executing table-functions on context with no settings
   applied in `SELECT ... SETTINGS x=foo` query.
 * Added tests to verify fix.
2019-11-08 14:30:11 +03:00
Nikita Mikhaylov
817b52314e Merge branch 'master' of github.com:ClickHouse/ClickHouse into parallel_parsing 2019-11-05 12:32:26 +03:00
Nikita Mikhaylov
cb48ee42a3 enable feature 2019-10-30 23:51:23 +03:00
Nikita Mikhaylov
874f88e5a5 disable feature to test 2019-10-30 18:54:02 +03:00
Amos Bird
2c75a51d4f
Instant count() for MergeTree
Use (Replicated)MergeTree's metadata to do trivial count()
2019-10-29 17:45:47 +08:00
Nikita Mikhaylov
756a10707d Merge branch 'master' of github.com:ClickHouse/ClickHouse into parallel_parsing 2019-10-28 13:51:52 +03:00
Nikita Mikhaylov
980528ed75 docs 2019-10-25 17:32:57 +03:00
Amos Bird
295864e6e0
better scalar query 2019-10-23 21:37:54 +08:00
Nikita Mikhaylov
34d8ade4a0 Merge branch 'master' of github.com:ClickHouse/ClickHouse into parallel_parsing 2019-10-22 15:56:51 +03:00
Alexander Tokmakov
5f6703130e fixes 2019-10-16 18:28:48 +03:00
Alexander Tokmakov
aa9d29d6ae Merge branch 'master' into formats_improvements 2019-10-16 17:15:13 +03:00
Artem Zuikov
b70ca30447
Merge pull request #7335 from 4ertus2/ast
Remove asterisk_left_columns_only setting
2019-10-16 13:57:17 +03:00
Artem Zuikov
cf99f88bc4 PartialMergeJoin flush data on disk (#7186) 2019-10-15 19:31:49 +03:00
chertus
9667e54201 remove asterisk_left_columns_only setting 2019-10-15 17:42:57 +03:00
Alexander Tokmakov
1c5ee018df update docs 2019-10-07 21:55:12 +03:00
Alexander Tokmakov
a90d126b93 support defaults_for_omitted_fields in TSV 2019-10-04 22:44:48 +03:00
Alexander Tokmakov
d936cee836 support null_as_default in most text formats 2019-10-04 22:42:35 +03:00
Alexander Tokmakov
565c273eaa Merge branch 'master' into merging_values_with_expressions 2019-10-02 20:51:44 +03:00
Artem Zuikov
48ab9afce6
Merge pull request #7122 from 4ertus2/mjoin
Squash left-hand blocks in partial merge join (optimization)
2019-10-01 17:23:10 +03:00
Nikita Mikhaylov
d47d4cd6c1 parallel parsing 2019-10-01 13:48:46 +03:00
Alexander Tokmakov
979f235e38 Merge branch 'master' into merging_values_with_expressions 2019-09-30 18:06:58 +03:00
chertus
5212d43ae4 simplify pmj settings 2019-09-30 17:36:45 +03:00
alexey-milovidov
e50a874537
Merge pull request #7118 from ClickHouse/improve_template_format
Minor improvements of Template format
2019-09-30 15:00:27 +03:00
chertus
baaf0a7c5b partial_merge_join_optimisations -> partial_merge_join_optimizations 2019-09-27 15:25:02 +03:00
Alexander Tokmakov
004455a029 fixes 2019-09-27 00:40:14 +03:00
chertus
10eaef1adc squash left-hand blocks in pmj (phase 2) 2019-09-26 21:51:17 +03:00
tavplubix
c3ed1f38a6
Merge branch 'master' into improve_template_format 2019-09-26 19:19:11 +03:00
chertus
dd08f06c81 squash left-hand blocks in partial merge join 2019-09-25 22:17:32 +03:00
alexey-milovidov
64e889d872
Merge pull request #7070 from 4ertus2/mjoin
PartialMergeJoin optimisation (skip not intersected blocks)
2019-09-25 02:24:42 +03:00
Alexander Tokmakov
d642304b1d add CustomSeparated format 2019-09-24 22:56:45 +03:00
alexey-milovidov
bc9667d881
Merge pull request #7085 from ClickHouse/merge-s3
Merge s3
2019-09-24 17:51:57 +03:00
Alexander Tokmakov
e197cc8a49 read settings from file 2019-09-24 17:45:04 +03:00
chertus
1f9b8418e0 pmj skip not intersected optimisation 2019-09-23 22:36:47 +03:00
Vladimir Chebotarev
f8c0fef919 Attempt to make table-level setting s3_min_upload_part_size. 2019-09-23 12:41:59 +00:00
maqroll
a6e7519f9d Merge remote-tracking branch 'upstream/master' 2019-09-23 07:55:07 +00:00
Alexander Tokmakov
0080639f79 Merge branch 'master' into merging_values_with_expressions 2019-09-20 23:26:01 +03:00
chertus
b8b6197288 partial_merge_join settings affects LEFT and INNER JOINs only 2019-09-18 22:12:53 +03:00
Artem Zuikov
aae82eed5a
Merge pull request #6940 from 4ertus2/mjoin
PartialMergeJoin
2019-09-18 16:16:10 +03:00
root
ea5480fd72 merge
Committer: maqroll <loteroc@gmail.com>
2019-09-18 13:13:40 +00:00
Alexey Milovidov
79a206b092 Fixed typo #6895 2019-09-14 18:41:47 +03:00
Alexander Tokmakov
aa10bc99cc improvements 2019-09-13 21:19:14 +03:00
chertus
bb5287841f make things wrong 2 2019-09-12 21:06:25 +03:00
Azat Khuzhin
02befdd8c2
Introduce distributed_directory_monitor_max_sleep_time_ms setting
This will replace static 30 seconds max_sleep_time for the
StorageDistributedDirectoryMonitor, since in some cases 30 seconds can
be too large.
2019-09-12 03:16:06 +03:00
Alexander Tokmakov
f323476111 Merge branch 'master' into merging_values_with_expressions 2019-09-11 23:31:37 +03:00
l
adb4a58092 Style checks & security considerations added to setting description. 2019-09-11 22:18:22 +02:00
l
cdbcfc2c90 + Redirect 2019-09-11 18:39:30 +02:00
chertus
1b313eedfa MergeJoin in progress 2019-09-09 22:43:37 +03:00
alexey-milovidov
25de2e12a2
Merge pull request #6399 from Enmk/replica_recovery_interval
Improvements for failover of Distributed queries
2019-09-07 03:21:30 +03:00
Vasily Nemkov
c2fc71b5e5 Post-PR fixes
Renamed settings, updated docs.
2019-09-05 13:35:36 +03:00
Alexander Tokmakov
52fb9585d4 improvements 2019-09-04 22:59:08 +03:00
alex-zaitsev
9032d8a196
Fixed tcp_keep_alive_timeout description 2019-09-03 16:30:15 +03:00
alexey-milovidov
87e061d0e1
Merge pull request #6733 from 4ertus2/some
Add subquery_requires_alias setting (disabled by default)
2019-09-03 14:34:28 +03:00
Alexander Tokmakov
a5f194cae9 Add setting to enable/disable template deduction for Values 2019-09-02 17:33:10 +03:00
Vasily Nemkov
f98c488834 Post-review fixes
* Actually using the replica recovery settings for cluster
* A bit of doc on DBMS_CONNECTION_POOL_WITH_FAILOVER_MAX_ERROR_COUNT
* StorageDistributedDirectoryMonitor using settings for ConnectionPoolWithFailover
* Using SettingSeconds instead of SettingUInt64 for replica_error_decrease_period
2019-09-02 17:26:25 +03:00
Vasily Nemkov
84fc4ba4c8 Replica recovery fixes
* Added a limit on how many errors can replica accumulate
* Decreased default error halving time to 60 seconds
* Made both configurable via settings
* Showing errors count and estimated recovery time for each replica in system.clusters
2019-09-02 17:26:25 +03:00
chertus
bc95027cee better setting name: joined_subquery_requires_alias 2019-09-02 15:53:31 +03:00
chertus
2c0d569fa8 Merge branch 'master' into some 2019-09-02 15:32:24 +03:00
Alexander Tokmakov
e2928481a3 Merge branch 'master' into merging_template_format 2019-09-02 12:41:34 +03:00
alesapin
6f30338c08 Fixes 2019-08-30 21:31:35 +03:00
alesapin
808f4d0b8a Intermediate refactoring 2019-08-30 19:50:59 +03:00
chertus
3ad43daae3 Merge branch 'master' into some 2019-08-29 21:50:47 +03:00
chertus
d5cfbcf6e1 subquery_requires_alias setting (disabled by default) 2019-08-29 21:45:34 +03:00
Alexander Tokmakov
03c83169bd Merge branch 'master' into merging_template_format 2019-08-29 16:34:25 +03:00
Alexey Milovidov
b6a0dba2df Added a setting "connection_pool_max_wait_ms" 2019-08-28 18:27:26 +03:00
Alexey Milovidov
d1c268c2ed Added setting "kafka_max_wait_ms" 2019-08-28 18:24:23 +03:00
Alexey Milovidov
d06e350312 Added setting "replace_running_query_max_wait_ms" 2019-08-28 18:20:22 +03:00
Alexey Milovidov
a9702aa6f2 Merge branch 'master' into remove-queue_max_wait_ms 2019-08-28 18:16:53 +03:00
Alexey Milovidov
32c7f9688a Removed extra quoting from Settings 2019-08-28 13:13:22 +03:00
Alexey Milovidov
0add95b7d8 Set default value of "queue_max_wait_ms" to zero, because current value makes no sense 2019-08-27 22:21:53 +03:00
Alexey Milovidov
25c53ccd9e Rename setting 2019-08-27 22:05:35 +03:00
Alexey Milovidov
5ca8f8d695 Merge branch 'master' of https://github.com/weiqxu/ClickHouse into weiqxu-master 2019-08-27 21:52:09 +03:00
Weiqing Xu
2fbcd607f3 check free space when use external sort/aggerator 2019-08-27 08:23:07 +08:00
Alexey Milovidov
66203973f2 Merge branch 'master' of github.com:yandex/ClickHouse 2019-08-27 00:41:18 +03:00