Maksim Kita
c86191a6b9
SortingTransform add cursor order
2022-06-18 18:20:00 +02:00
Maksim Kita
d82ab22333
Fixed style check
2022-06-18 18:20:00 +02:00
Maksim Kita
3664f02690
Replaced SortingHeap with SortingQueue
2022-06-18 18:20:00 +02:00
Maksim Kita
9670504781
Fixed tests
2022-06-18 18:20:00 +02:00
Maksim Kita
9f55a2cbac
Fixed tests
2022-06-18 18:20:00 +02:00
Maksim Kita
d7e3e85d2f
Sorting added batch queue variants
2022-06-18 18:20:00 +02:00
Alexey Milovidov
73709b0488
Revert "Revert "Add a setting to use more memory for zstd decompression""
2022-06-18 15:55:35 +03:00
Antonio Andelic
dd75e9cba5
Merge pull request #38149 from vdimir/multiple_joins_original_names_34697
...
Add setting multiple_joins_try_to_keep_original_names
2022-06-18 14:47:31 +02:00
alesapin
16e8b85fbf
Revert "Add a setting to use more memory for zstd decompression"
2022-06-18 14:08:14 +02:00
Alexey Milovidov
e20259e9ca
Merge pull request #37015 from wuxiaobai24/zstd_window_log_max
...
Add a setting to use more memory for zstd decompression
2022-06-18 04:19:27 +03:00
vdimir
2a9942ee80
Add setting multiple_joins_try_to_keep_original_names
2022-06-16 15:50:03 +00:00
Maksim Kita
cd1bbc6a1b
SortDescription compile fix typo
2022-06-16 16:40:02 +02:00
Azat Khuzhin
4baa7690ae
Send profile events for INSERT queries (previously only SELECT was supported)
...
Reproducer:
echo "1" | clickhouse-client --query="insert into function null('foo String') format TSV" --print-profile-events --profile-events-delay-ms=-1
However, clickhouse-local is differnt, it does sent the periodically,
but only if query was long enough, i.e.:
# yes | head -n100000 | clickhouse-local --query="insert into function null('foo String') format TSV" --print-profile-events --profile-events-delay-ms=-1
[s1.ch] 2022.05.20 15:20:27 [ 0 ] ContextLock: 10 (increment)
[s1.ch] 2022.05.20 15:20:27 [ 0 ] DiskReadElapsedMicroseconds: 29 (increment)
[s1.ch] 2022.05.20 15:20:27 [ 0 ] IOBufferAllocBytes: 200000 (increment)
[s1.ch] 2022.05.20 15:20:27 [ 0 ] IOBufferAllocs: 1 (increment)
[s1.ch] 2022.05.20 15:20:27 [ 0 ] InsertQuery: 1 (increment)
[s1.ch] 2022.05.20 15:20:27 [ 0 ] InsertedBytes: 1000000 (increment)
[s1.ch] 2022.05.20 15:20:27 [ 0 ] InsertedRows: 100000 (increment)
[s1.ch] 2022.05.20 15:20:27 [ 0 ] MemoryTrackerUsage: 1521975 (gauge)
[s1.ch] 2022.05.20 15:20:27 [ 0 ] OSCPUVirtualTimeMicroseconds: 102148 (increment)
[s1.ch] 2022.05.20 15:20:27 [ 0 ] OSReadChars: 135700 (increment)
[s1.ch] 2022.05.20 15:20:27 [ 0 ] OSWriteChars: 8 (increment)
[s1.ch] 2022.05.20 15:20:27 [ 0 ] Query: 1 (increment)
[s1.ch] 2022.05.20 15:20:27 [ 0 ] RWLockAcquiredReadLocks: 2 (increment)
[s1.ch] 2022.05.20 15:20:27 [ 0 ] ReadBufferFromFileDescriptorRead: 5 (increment)
[s1.ch] 2022.05.20 15:20:27 [ 0 ] ReadBufferFromFileDescriptorReadBytes: 134464 (increment)
[s1.ch] 2022.05.20 15:20:27 [ 0 ] RealTimeMicroseconds: 293747 (increment)
[s1.ch] 2022.05.20 15:20:27 [ 0 ] SoftPageFaults: 382 (increment)
[s1.ch] 2022.05.20 15:20:27 [ 0 ] TableFunctionExecute: 1 (increment)
[s1.ch] 2022.05.20 15:20:27 [ 0 ] UserTimeMicroseconds: 102148 (increment)
v2: Proper support ProfileEvents in INSERTs (with protocol change)
v3: Receive profile events on INSERT queries
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-06-16 11:59:01 +03:00
mergify[bot]
ff9f4af28c
Merge branch 'master' into enable-some-settings
2022-06-16 03:51:59 +00:00
kssenii
416c6008ee
Merge master
2022-06-15 16:50:25 +02:00
mergify[bot]
c2afc2f6c6
Merge branch 'master' into background-schedule-pool-refactoring
2022-06-15 13:43:31 +00:00
Alexey Milovidov
5e9e5a4eaf
Merge pull request #37525 from Avogar/avro-structs
...
Support Maps and Records, allow to insert null as default in Avro format
2022-06-15 00:04:29 +03:00
Maksim Kita
bff82b961b
Fixed tests
2022-06-14 21:43:28 +02:00
Maksim Kita
6ae20d6282
Fixed style check
2022-06-14 21:43:28 +02:00
Maksim Kita
bd1d54d689
BackgroundSchedulePool remove Poco::NotificationQueue
2022-06-14 21:43:28 +02:00
kssenii
4813b90281
Merge master
2022-06-13 21:32:00 +02:00
Maksim Kita
b63089ab7a
Examples coroutines build fix
2022-06-13 15:21:37 +02:00
kssenii
aaf9a46f07
Merge master
2022-06-11 15:56:05 +02:00
Maksim Kita
d5b148792b
Merge pull request #37990 from kitaisreal/sorting-added-sort-queue-variants
...
Sorting added sort queue variants
2022-06-11 15:22:29 +02:00
Maksim Kita
95a3a10769
Sorting added sort queue variants
2022-06-10 17:45:11 +02:00
Kseniia Sumarokova
580a30c6ae
Merge pull request #37859 from KinderRiven/support_max_request_cache_size
...
Support to set max cache size for per query in local cache
2022-06-10 16:17:18 +02:00
KinderRiven
6883ecda96
fix
2022-06-08 14:19:50 +08:00
Anton Popov
df6882d2b9
Revert "Fix errors of CheckTriviallyCopyableMove type"
2022-06-07 13:53:10 +02:00
Kruglov Pavel
91c8951a1a
Merge pull request #37698 from Avogar/update_format_settings_docs
...
Refactor docs related to format settings
2022-06-07 13:28:36 +02:00
KinderRiven
3b2a427002
fix
2022-06-07 11:50:56 +08:00
mergify[bot]
58c3f31bf4
Merge branch 'master' into bug-with-fill-date
2022-06-06 15:10:33 +00:00
Yakov Olkhovskiy
52ae3f0e92
full refactoring - move type check to transform
2022-06-05 22:39:21 -04:00
KinderRiven
13e74bef5e
support skip_download_if_exceeds_query_cache
2022-06-06 02:36:23 +08:00
Robert Schulze
2d87af2a15
Merge pull request #37647 from DevTeamBK/Fix-all-CheckTriviallyCopyableMove-Errors
...
Fix errors of CheckTriviallyCopyableMove type
2022-06-05 19:58:47 +02:00
KinderRiven
95796cca76
set default max_query_cache_size
2022-06-05 17:51:18 +08:00
KinderRiven
3ffb0b3549
support_max_query_cache_size
2022-06-05 16:21:36 +08:00
Anton Popov
3ace077401
Merge pull request #37695 from CurtizJ/replace-multiif-to-if
...
Replace `multiIf` to `if` in case of one condition
2022-06-03 14:56:43 +02:00
Nikolai Kochetov
bc166e4394
Merge pull request #37543 from ClickHouse/refactor-read-metrics-and-callbacks
...
Refactor read metrics and callbacks
2022-06-03 09:43:25 +02:00
Nikolai Kochetov
8991f39412
Merge branch 'master' into refactor-read-metrics-and-callbacks
2022-06-02 17:00:08 +00:00
HeenaBansal2009
e3080f2a97
Merge remote-tracking branch 'origin' into Fix-all-CheckTriviallyCopyableMove-Errors
2022-06-02 07:30:08 -07:00
mergify[bot]
f678fdb0c2
Merge branch 'master' into tonickkozlov/odbc-disable-connection-pooling
2022-06-02 13:08:30 +00:00
Kruglov Pavel
23290c6047
Merge branch 'master' into update_format_settings_docs
2022-06-02 13:12:58 +02:00
Anton Popov
dd3774a75d
Merge pull request #37756 from CurtizJ/named_tuples_as_objects
...
Turn on setting `output_format_json_named_tuples_as_objects` by default
2022-06-02 12:51:55 +02:00
Nikolai Kochetov
edac3d6714
Merge branch 'master' into refactor-read-metrics-and-callbacks
2022-06-02 09:36:20 +00:00
Anton Popov
1ef48c3a4a
turn on setting output_format_json_named_tuples_as_objects by default
2022-06-01 15:42:12 +00:00
Dmitry Novik
7fbe91ca81
Merge pull request #37460 from ClickHouse/memory-overcommit-improvement
...
Memory Overcommit: update defaults, exception message and add ProfileEvent
2022-06-01 17:06:33 +02:00
kssenii
aa60de8f63
Merge master
2022-06-01 15:32:01 +02:00
HeenaBansal2009
10990402ac
Removed move ctor from EventBase hierarchy
2022-06-01 06:01:22 -07:00
Nikolai Kochetov
86fbb74703
Merge branch 'master' into refactor-read-metrics-and-callbacks
2022-05-31 18:07:47 +00:00
Anton Kozlov
3576625647
CLICKHOUSE-2131 Add an option to disable connection pooling in ODBC bridge
2022-05-31 16:26:08 +00:00
avogar
858570d335
Refactor docs related to format settings
2022-05-31 15:18:49 +00:00
HeenaBansal2009
2584bbb7f1
Fix Style check
2022-05-31 07:49:54 -07:00
Maksim Kita
bacee7f19c
Merge pull request #37195 from kitaisreal/merging-sorted-algorithm-single-column-specialization
...
MergingSortedAlgorithm single column specialization
2022-05-31 16:46:18 +02:00
Anton Popov
00f87b0f57
replace multiIf to if in case of one condition
2022-05-31 14:45:12 +00:00
mergify[bot]
ba49c6bb46
Merge branch 'master' into memory-overcommit-improvement
2022-05-31 13:17:06 +00:00
Kruglov Pavel
7cc87d9a65
Merge pull request #37537 from Avogar/skip-first-lines
...
Allow to skip some of the first lines in CSV/TSV formats
2022-05-31 14:26:21 +02:00
HeenaBansal2009
3976afa56a
Fix build failures
2022-05-30 20:06:27 -07:00
Dmitry Novik
9d04305a5a
Update Settings.h
2022-05-30 23:00:28 +02:00
kssenii
bdfd166eb1
Merge master
2022-05-30 21:31:47 +02:00
mergify[bot]
b43cfd056f
Merge branch 'master' into floating_seconds
2022-05-30 19:18:35 +00:00
Nikolai Kochetov
77b07dd0a8
Merge pull request #37163 from ClickHouse/grouping-function
...
Add GROUPING function
2022-05-30 20:45:04 +02:00
HeenaBansal2009
b7eb6bbd38
Fixed clang-tidy-CheckTriviallyCopyableMove-errors
2022-05-30 11:09:03 -07:00
avogar
139a7e19a9
Fix comments
2022-05-30 11:43:29 +00:00
Nikolai Kochetov
5b4658aa5e
Merge branch 'master' into refactor-read-metrics-and-callbacks
2022-05-30 09:47:35 +00:00
flynn
9ffa5f5e0d
fix typo
2022-05-30 08:10:16 +00:00
Alexey Milovidov
ed83ba1c9a
Merge branch 'master' into enable-some-settings
2022-05-29 02:35:16 +02:00
Dmitry Novik
60b9d81773
Remove global_memory_usage_overcommit_max_wait_microseconds
2022-05-27 16:30:29 +00:00
kssenii
25b1ed526d
Merge master
2022-05-27 16:50:45 +02:00
tchepavel
42cd854688
Merge branch 'master' into nats-integration
2022-05-27 16:05:08 +03:00
Alexey Milovidov
8d1697c976
Merge branch 'master' into enable-some-settings
2022-05-27 04:38:20 +02:00
Dmitry Novik
3c1b6609ae
Add comments and make tests more verbose
2022-05-25 21:23:35 +00:00
mergify[bot]
49cce189e3
Merge branch 'master' into floating_seconds
2022-05-25 21:08:55 +00:00
kssenii
b89a4edc04
Merge master
2022-05-25 20:55:04 +02:00
alesapin
6f5c86e55e
Merge branch 'master' into i_object_storage
2022-05-25 20:49:01 +02:00
avogar
ede6e2f433
Add docs for settings
2022-05-25 15:10:20 +00:00
avogar
4c9812d4c1
Allow to skip some of the first rows in CSV/TSV formats
2022-05-25 15:00:11 +00:00
Nikolai Kochetov
1b85f2c1d6
Merge branch 'master' into refactor-read-metrics-and-callbacks
2022-05-25 16:27:40 +02:00
avogar
038a422aeb
Add setting to insert null as default
2022-05-25 12:56:59 +00:00
Maksim Kita
fbec38ddb9
Fixed performance tests
2022-05-25 12:51:21 +02:00
Maksim Kita
9a9df26eec
Fixed tests
2022-05-25 11:44:37 +02:00
Maksim Kita
6c033f340b
Fixed tests
2022-05-25 11:44:37 +02:00
Maksim Kita
0e5f13e53e
MergingSortedAlgorithm single column specialization
2022-05-25 11:44:37 +02:00
Nikolai Kochetov
3d84aae0ab
Better.
2022-05-24 20:06:08 +00:00
tchepavel
43226a57fc
Merge branch 'master' into nats-integration
2022-05-24 18:15:11 +03:00
Raúl Marín
2f37ad7fb8
Improve comment
2022-05-24 17:11:15 +02:00
Raúl Marín
a86aa43baa
Merge remote-tracking branch 'blessed/master' into floating_seconds_2
2022-05-24 17:10:45 +02:00
Alexander Tokmakov
229d35408b
Merge pull request #37398 from ClickHouse/fixes_for_transactions
...
Fixes for transactions
2022-05-24 15:28:01 +03:00
Kruglov Pavel
6c9a524f6b
Merge pull request #37192 from Avogar/formats-with-names
...
Improve performance and memory usage for select of subset of columns for some formats
2022-05-24 13:28:14 +02:00
李扬
e33cfc889c
Fix bug of datetime64 parsed from string '1969-12-31 23:59:59.123' ( #37039 )
2022-05-24 10:47:17 +02:00
mergify[bot]
51ff49a0ee
Merge branch 'master' into i_object_storage
2022-05-23 20:29:49 +00:00
Nikolai Kochetov
fd97a9d885
Move some resources
2022-05-23 19:47:32 +00:00
Alexander Tokmakov
6bc68c0cbc
Merge branch 'master' into fixes_for_transactions
2022-05-23 18:49:21 +02:00
alesapin
e76597e5d3
Update src/Core/Settings.h
...
Co-authored-by: Kseniia Sumarokova <54203879+kssenii@users.noreply.github.com>
2022-05-23 14:46:21 +02:00
tchepavel
d9436ec7dd
Merge branch 'master' into nats-integration
2022-05-23 14:30:09 +03:00
Kruglov Pavel
f539fb835d
Merge branch 'master' into formats-with-names
2022-05-23 12:14:20 +02:00
Kruglov Pavel
ce48e8e102
Merge pull request #36975 from Avogar/json-columns-formats
...
Add columnar JSON formats
2022-05-23 12:11:28 +02:00
Kruglov Pavel
9bc74439c1
Merge pull request #37327 from Avogar/arrow-strings
...
Allow to use String type instead of Binary in Arrow/Parquet/ORC formats
2022-05-23 12:05:33 +02:00
alesapin
c8d92b87c8
Merge branch 'master' into i_object_storage
2022-05-22 12:16:10 +02:00
Vxider
5f84f06d6d
simplify windowview
2022-05-22 10:13:16 +00:00
kssenii
9aa20193d5
Merge master
2022-05-22 00:56:20 +02:00
kssenii
ffd8d9723a
Continuation
2022-05-22 00:21:40 +02:00
Alexey Milovidov
4bfbb0b7ba
Merge pull request #37388 from CurtizJ/explicit-bool-operator
...
Mark all `operator bool()` as explicit
2022-05-22 00:18:19 +03:00
Alexander Tokmakov
44f2d4529a
better waiting, add fault injection
2022-05-20 22:10:01 +02:00
Anton Popov
cb0e6c2718
mark all operators bool() as explicit
2022-05-20 15:29:54 +00:00
avogar
566d1b15fd
Merge branch 'master' of github.com:ClickHouse/ClickHouse into formats-with-names
2022-05-20 13:54:52 +00:00
Michael Nutt
23dbf1b257
Merge branch 'master' into hashid
2022-05-20 08:42:01 -04:00
avogar
a6a430c5ee
Merge branch 'master' of github.com:ClickHouse/ClickHouse into json-columns-formats
2022-05-20 11:08:30 +00:00
mergify[bot]
1ac4199e78
Merge branch 'master' into arrow-strings
2022-05-20 10:43:33 +00:00
Kruglov Pavel
4dd447b232
Merge pull request #37332 from Avogar/schema-inference-with-globs
...
Apply input_format_max_rows_to_read_for_schema_inference for all files in globs in total
2022-05-20 12:42:32 +02:00
alesapin
654b27e307
Merge branch 'master' into i_object_storage
2022-05-20 11:56:13 +02:00
Robert Schulze
b475fbc9a7
Merge pull request #37300 from ClickHouse/cmake-cleanup-pt3
...
Various cmake cleanups
2022-05-20 10:02:36 +02:00
Dmitry Novik
b3ccf96c81
Merge remote-tracking branch 'origin/master' into grouping-function
2022-05-19 17:58:33 +00:00
mergify[bot]
efdb49a222
Merge branch 'master' into arrow-strings
2022-05-19 10:48:41 +00:00
Michael Nutt
c87638d2ba
put hashid behind allow_experimental_hash_functions setting
2022-05-18 19:06:33 -04:00
Azat Khuzhin
dea1706d4e
Fix GROUP BY AggregateFunction ( #37093 )
...
* Fix GROUP BY AggregateFunction
finalizeChunk() was unconditionally converting AggregateFunction to the
underlying type, however this should be done only if the aggregate was
applied.
So pass names of aggregates as an argument to the finalizeChunk()
Fuzzer report [1]:
Logical error: 'Bad cast from type DB::ColumnArray to DB::ColumnAggregateFunction'. Received signal 6 Received signal Aborted (6)
For the following query:
SELECT
arraySort(groupArrayArray(grp_simple)),
grp_aggreg,
arraySort(groupArrayArray(grp_simple)),
b,
arraySort(groupArrayArray(grp_simple)) AS grs
FROM data_02294
GROUP BY
a,
grp_aggreg,
b
SETTINGS optimize_aggregation_in_order = 1
[1]: https://s3.amazonaws.com/clickhouse-test-reports/37050/323ae98202d80fc4b311be1e7308ef2ac39e6063/fuzzer_astfuzzerdebug,actions//fuzzer.log
v2: fix conflicts in src/Interpreters/InterpreterSelectQuery.cpp
v3: Fix header for GROUP BY AggregateFunction WITH TOTALS
v4: Add sanity check into finalizeBlock()
v5: Use typeid_cast<&> to get more sensible error in case of bad cast (as suggested by @nickitat)
v6: Fix positions passed to finalizeChunk()
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
* Core/ColumnNumbers.h: remove unused <string>
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
* Optimize finalizeChunk()/finalizeBlock()
v2: s/ByPosition/Mask/ s/by_position/mask/
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-05-18 23:37:43 +02:00
Michael Nutt
e453132db8
remove hashid define guard
2022-05-18 15:26:54 -04:00
avogar
cd6a29897e
Apply input_format_max_rows_to_read_for_schema_inference for all files in globs in total
2022-05-18 17:56:36 +00:00
Dmitry Novik
6356112a76
Refactor GROUPING function
2022-05-18 15:23:31 +00:00
avogar
a0369fb9a6
Allow to use String type instead of Binary in Arrow/Parquet/ORC formats
2022-05-18 14:51:21 +00:00
Vladimir C
1779fb08ed
Merge pull request #36271 from yuuch/support_collation_in_create_query
2022-05-18 12:43:49 +02:00
avogar
12010a81b7
Make better
2022-05-18 09:25:26 +00:00
kssenii
6a51dea791
Merge master
2022-05-16 22:13:22 +02:00
Robert Schulze
43945cea1b
Fixing some warnings
2022-05-16 20:59:27 +02:00
tchepavel
270c01bcb7
Merge branch 'master' of github.com:ClickHouse/ClickHouse into nats-integration
2022-05-16 19:18:51 +03:00
alesapin
ce6d5f7dcc
Merge branch 'master' into i_object_storage
2022-05-16 17:42:22 +02:00
tchepavel
2f00139347
Fix review issues; add insert queue parameter
2022-05-16 16:35:17 +03:00
Robert Schulze
ed7df7cabd
Merge pull request #36960 from ClickHouse/clangtidies
...
Enable clangtidies
2022-05-16 14:22:50 +02:00
alesapin
1829256ae2
Merge pull request #37178 from ClickHouse/ignore_auto_increment_in_create_table_2
...
Ignore AUTO_INCREMENT in CREATE TABLE to simplify migration from MySQL
2022-05-16 13:29:22 +02:00
Robert Schulze
e3cfec5b09
Merge remote-tracking branch 'origin/master' into clangtidies
2022-05-16 10:12:50 +02:00
alesapin
4f1d4dde22
Disable s3 logging by default
2022-05-16 00:16:00 +02:00
tchepavel
7317c76d3c
Merge branch 'master' into nats-integration
2022-05-15 14:41:22 +03:00
mergify[bot]
00a3967c97
Merge branch 'master' into enable-some-settings
2022-05-15 02:31:41 +00:00
Alexey Milovidov
8334329dff
Merge pull request #37023 from ClickHouse/chained-or
...
Merging #34932 .
2022-05-15 04:32:31 +03:00
Michael Nutt
8bff9b8ce9
Merge branch 'master' into hashid
2022-05-14 09:52:05 +09:00
mergify[bot]
c4afeeb542
Merge branch 'master' into enable-some-settings
2022-05-14 00:51:59 +00:00
Raúl Marín
369c18ad7f
Fix clang tidy not error
2022-05-13 23:09:17 +02:00
Raúl Marín
23dfe4941b
Fix clang tidy error
2022-05-13 20:31:45 +02:00
kssenii
58faaf0ea3
Merge master
2022-05-13 18:51:07 +02:00
Raúl Marín
a2870ef65e
Allow negative values for seconds
2022-05-13 17:28:05 +02:00
Dmitry Novik
ae81268d4d
Try to compute helper column lazy
2022-05-13 14:55:50 +00:00
Raúl Marín
d492b1c44d
Fix timeout and better comment
2022-05-13 16:11:45 +02:00
avogar
b17fec659a
Improve performance and memory usage for select of subset of columns for some formats
2022-05-13 13:51:28 +00:00
Raúl Marín
6d4bac321e
Style
2022-05-13 15:08:37 +02:00
Raúl Marín
002498bd2b
Add tests to check decimal value in seconds
2022-05-13 14:54:24 +02:00
wuxiaobai24
f3e573bfde
Merge remote-tracking branch 'upstream/master' into zstd_window_log_max
2022-05-13 20:42:54 +08:00
mergify[bot]
4a661b6e78
Merge branch 'master' into json-columns-formats
2022-05-13 11:32:03 +00:00
Raúl Marín
c330c7703b
WIP: Seconds as floating point
2022-05-13 11:46:58 +02:00
Igor Nikonov
f423e9bf40
Ignore AUTO_INCREMENT in CREATE TABLE to simplify migration from MySQL
...
Issue #35893
2022-05-13 09:22:52 +00:00
Dmitry Novik
c5b40a9c91
WIP on GROUPING function
2022-05-12 16:40:26 +00:00
tchepavel
cc94378698
Add nats-io cmake; finally fix publishing
2022-05-12 19:11:32 +03:00
Dmitry Novik
df071bb701
Merge pull request #37129 from ClickHouse/enable-overcommit-for-user
...
Update documentation and defaults for memory overcommit
2022-05-12 14:38:43 +02:00
Alexander Gololobov
8e843a1e7c
Merge pull request #37077 from ClickHouse/disable-log-query-threads
...
Disable `log_query_threads` by default
2022-05-12 13:12:55 +02:00
Kseniia Sumarokova
64944e9d08
Merge pull request #37124 from kssenii/add-exception
...
Add check for columns size in Block::cloneWithColumns
2022-05-12 12:25:52 +02:00
mergify[bot]
f4bae3969d
Merge branch 'master' into enable-overcommit-for-user
2022-05-11 20:04:20 +00:00
Maksim Kita
e8c024ac5c
Fixed build
2022-05-11 21:59:51 +02:00
Maksim Kita
437d70d4da
Fixed tests
2022-05-11 21:59:51 +02:00
Maksim Kita
496302cb1d
Fix tests
2022-05-11 21:59:51 +02:00
Maksim Kita
75555c436b
Fix usage of min_count_to_compile_sort_description setting
2022-05-11 21:59:51 +02:00
Maksim Kita
fcc42fe3a8
Fix style check
2022-05-11 21:59:51 +02:00
Maksim Kita
06b21a5cc4
Fix build
2022-05-11 21:59:51 +02:00
Maksim Kita
4e7d10297b
Fixed style
2022-05-11 21:59:51 +02:00
Maksim Kita
c17a8b1a23
Fixed tests
2022-05-11 21:59:51 +02:00
Maksim Kita
8721e434e6
Fixed tests
2022-05-11 21:59:51 +02:00
Maksim Kita
512d88ddc6
Fixed tests
2022-05-11 21:59:51 +02:00
Maksim Kita
cbfb773b50
Fixed tests
2022-05-11 21:59:51 +02:00
Maksim Kita
8ceb63ee6c
Added JIT compilation of SortDescription
2022-05-11 21:59:51 +02:00
Nikolai Kochetov
ec34761d9f
Merge pull request #33631 from ClickHouse/grouping-sets-fix
...
Support GROUPING SETS
2022-05-11 21:28:46 +02:00
Michael Nutt
2ff13c4e5d
Merge branch 'master' into hashid
2022-05-12 03:12:10 +09:00
Dmitry Novik
17608b3d93
Update documentation and defaults for memory overcommit
2022-05-11 16:18:41 +00:00
Vladimir C
641e2be6ef
Merge pull request #37085 from vdimir/force-cross-to-inner-option
...
Option to force cross_to_inner_join_rewrite
2022-05-11 18:03:53 +02:00
kssenii
5e6ebe7bbe
Add exception
2022-05-11 15:20:08 +02:00
Alexey Milovidov
27c6307ef6
Disable setting by default
2022-05-11 01:28:49 +02:00
Alexey Milovidov
3fcf63830c
Merge branch 'master' into chained-or
2022-05-11 01:28:12 +02:00
wuxiaobai24
85356bbf64
fix
2022-05-11 00:53:09 +08:00
vdimir
00cd21cacf
Option to force cross_to_inner_join_rewrite
2022-05-10 15:12:17 +00:00
Alexey Milovidov
485aee0db7
Disable log_query_threads by default
2022-05-10 14:59:52 +02:00
avogar
f6b16880bd
Merge branch 'master' of github.com:ClickHouse/ClickHouse into json-columns-formats
2022-05-10 12:57:18 +00:00
Anton Popov
aec30c4076
Merge pull request #37053 from CurtizJ/remove-streams-comments
...
Remove last mentions of data streams
2022-05-10 13:38:13 +02:00
Michael Nutt
b3340caea4
fixing hashid function registration when hashid is disabled
2022-05-10 20:26:42 +09:00
Anton Popov
e911900054
remove last mentions of data streams
2022-05-09 19:15:24 +00:00
mergify[bot]
55a6d22ad3
Merge branch 'master' into grouping-sets-fix
2022-05-09 14:02:10 +00:00
mergify[bot]
8ea87a3530
Merge branch 'master' into enable-memory-overcommit
2022-05-09 14:00:54 +00:00
avogar
04fdd75c56
Make JSONColumns frormats mono block by default
2022-05-09 11:13:44 +00:00
Robert Schulze
1b81bb49b4
Enable clang-tidy modernize-deprecated-headers & hicpp-deprecated-headers
...
Official docs:
Some headers from C library were deprecated in C++ and are no longer
welcome in C++ codebases. Some have no effect in C++. For more details
refer to the C++ 14 Standard [depr.c.headers] section. This check
replaces C standard library headers with their C++ alternatives and
removes redundant ones.
2022-05-09 08:23:33 +02:00
Alexey Milovidov
56abce6a75
Merge branch 'chained_or' of github.com:danlark1/ClickHouse into chained-or
2022-05-08 23:37:09 +02:00
Alexey Milovidov
00680a7b65
Update Settings.h
2022-05-08 16:31:12 +03:00
wuxiaobai24
58755cb156
add zstd_window_log_max setting
2022-05-08 14:02:40 +08:00
Alexey Milovidov
d6a7841b4e
Update Settings.h
2022-05-07 14:09:32 +03:00
avogar
62a7ba3f26
Add columnar JSON formats
2022-05-06 16:48:48 +00:00
Vladimir C
bd5fab97d9
Merge pull request #36415 from bigo-sg/concurrent_join
2022-05-06 17:11:10 +02:00
mergify[bot]
bad1603ea3
Merge branch 'master' into enable-memory-overcommit
2022-05-05 22:43:18 +00:00
Dmitry Novik
4cc26aa38b
Merge remote-tracking branch 'origin/master' into grouping-sets-fix
...
And fix execution of the query with only one grouping set
2022-05-05 17:14:52 +00:00
Vitaly Baranov
dd51265218
Merge pull request #36864 from vitlibar/backup-improvements-4
...
Backup improvements
2022-05-05 15:37:51 +02:00
mergify[bot]
6d3a20b2a2
Merge branch 'master' into enable-memory-overcommit
2022-05-05 13:29:20 +00:00
Nikita Mikhaylov
27fd255be6
Do not throw exception if obsolete setting appeared in top level config ( #36917 )
2022-05-05 11:50:41 +02:00
mergify[bot]
76af9938bd
Merge branch 'master' into enable-memory-overcommit
2022-05-04 22:17:02 +00:00
Kruglov Pavel
77e55c344c
Merge pull request #36667 from Avogar/mysqldump-format
...
Add MySQLDump input format
2022-05-04 19:49:48 +02:00
mergify[bot]
64084b5e32
Merge branch 'master' into shared_ptr_helper3
2022-05-03 20:46:16 +00:00
Vitaly Baranov
5257ce31f8
Improved using ThreadPool for making backup or restoring, changed columns in system.backups.
2022-05-03 11:03:13 +02:00
Dmitry Novik
ba028cc395
Enable GlobalOvercommitTracker by default
2022-05-02 20:30:14 +00:00
mergify[bot]
1a92a34514
Merge branch 'master' into enable-memory-overcommit
2022-05-02 17:04:08 +00:00
Kruglov Pavel
d613f7eab0
Merge branch 'master' into mysqldump-format
2022-05-02 13:31:57 +02:00
Kruglov Pavel
8d647eff06
Merge pull request #36749 from Avogar/fix-timeouts
...
Fix bug in receive timeouts in Hedged requests
2022-05-02 13:16:03 +02:00
Antonio Andelic
a1a22b0007
Merge pull request #35149 from ContentSquare/nullables_with_proto3
...
Nullables with proto3 using Google wrappers
2022-05-02 09:49:37 +02:00
Robert Schulze
330212e0f4
Remove inherited create() method + disallow copying
...
The original motivation for this commit was that shared_ptr_helper used
std::shared_ptr<>() which does two heap allocations instead of
make_shared<>() which does a single allocation. Turned out that
1. the affected code (--> Storages/) is not on a hot path (rendering the
performance argument moot ...)
2. yet copying Storage objects is potentially dangerous and was
previously allowed.
Hence, this change
- removes shared_ptr_helper and as a result all inherited create() methods,
- instead, Storage objects are now created using make_shared<>() by the
caller (for that to work, many constructors had to be made public), and
- all Storage classes were marked as noncopyable using boost::noncopyable.
In sum, we are (likely) not making things faster but the code becomes
cleaner and harder to misuse.
2022-05-02 08:46:52 +02:00
KinderRiven
9c44ef1188
fix
2022-05-01 19:45:16 +08:00
KinderRiven
d80aa0fd17
impl system.filesystem_cache_log
2022-05-01 19:45:16 +08:00
KinderRiven
ce9a6965d0
impl system.log_table
2022-05-01 19:45:16 +08:00
Robert Schulze
89aa9ae00f
Fixed clang-tidy check "bugprone-branch-clone"
...
The check is currently *not* part of .clang-tidy. It complains about:
(1) "switch has multiple consecutive identical branches"
(2) "repeated branch in conditional chain"
About (1): Lots of findings in switches were about redundant
"[[fallthrough]]" in places where the compiler would not warn anyways. I
have cleaned these up.
About (2): In if-else_if-else chains, fixing the warning would usually
mean concatenating multiple if-conditions. As this would reduce
readability in most cases, I did not fix these places.
Because of (2), I also refrained from adding "bugprone-branch-clone" to
.clang-tidy.
2022-04-30 19:40:28 +02:00
Alexey Milovidov
1ddb04b992
Merge pull request #36715 from amosbird/refactorbase
...
Reorganize source files so that base won't depend on Common
2022-04-30 09:40:58 +03:00
Nikolai Kochetov
5807ca47b0
Merge pull request #36425 from ClickHouse/pool-size-hot-reload
...
Allow to increase number of threads and tasks for background executors
2022-04-29 17:24:12 +02:00
Jakub Kuklis
a1f2dd6d34
Adding two settings in place of one, improvements to the test clarity
2022-04-29 10:01:51 +02:00
Jakub Kuklis
507ba1042c
Adding a setting to enable Google wrappers special treatment
2022-04-29 10:01:51 +02:00
Amos Bird
4a5e4274f0
base should not depend on Common
2022-04-29 10:26:35 +08:00
mergify[bot]
d96c9c5cff
Merge branch 'master' into fix-timeouts
2022-04-28 15:03:19 +00:00
avogar
d295de1689
Fix comments and test
2022-04-28 14:59:35 +00:00
Kruglov Pavel
4d08587559
Merge branch 'master' into mysqldump-format
2022-04-28 15:58:18 +02:00
avogar
81f85892eb
Fix bug in receive timeouts in Hedged requests
2022-04-28 13:10:27 +00:00
zhanglistar
7d798b3655
Count distinct optimization by using subquery of group by ( #35993 )
2022-04-28 14:55:37 +02:00
kssenii
0c43b7b08a
Merge master
2022-04-26 16:10:47 +02:00
avogar
33d845dade
Add MySQLDump input format
2022-04-26 10:42:56 +00:00
Memo
420d343e83
Update src/Core/Settings.h
...
Co-authored-by: alesapin <alesapin@gmail.com>
2022-04-26 10:26:09 +08:00
Memo
6b5d9201f6
Update src/Core/Settings.h
...
Co-authored-by: alesapin <alesapin@gmail.com>
2022-04-26 10:25:58 +08:00
mergify[bot]
a5aab53b70
Merge branch 'master' into add_query_level_settingss
2022-04-25 21:41:36 +00:00
lgbo-ustc
981d560553
Merge remote-tracking branch 'ck/master' into concurrent_join
2022-04-25 13:00:04 +08:00
alesapin
7380a71333
Merge pull request #31833 from ClickHouse/musl-check
...
Build clickhouse-keeper with Musl
2022-04-22 22:41:16 +02:00
Nikita Mikhaylov
aaa7112405
Even better
2022-04-22 13:56:16 +00:00
Nikita Mikhaylov
36bdee0499
Deleted settings
2022-04-22 13:56:16 +00:00
Nikita Mikhaylov
31ccb9c1c3
Done
2022-04-22 13:56:16 +00:00
Maksim Kita
57444fc7d3
Merge pull request #36444 from rschu1ze/clang-tidy-fixes
...
Clang tidy fixes
2022-04-21 16:11:27 +02:00
tavplubix
5b74281a02
Merge pull request #35463 from ClickHouse/tavplubix-patch-1
...
Set `distributed_ddl_entry_format_version` to 2 by default
2022-04-21 15:45:15 +03:00
kssenii
24e376337d
Merge with master
2022-04-21 12:33:56 +02:00
Dmitry Novik
61deae7105
Merge branch 'master' into grouping-sets-fix
2022-04-21 03:34:42 +02:00
lgbo-ustc
c844415578
add new join_algorithm parallel_hash
2022-04-20 19:47:16 +08:00
李扬
a1e54c3918
Fix wrong result of datetime64 when negative ( #35440 )
2022-04-20 13:11:31 +02:00
mergify[bot]
0df5fda6ed
Merge branch 'master' into musl-check
2022-04-20 09:28:40 +00:00
mergify[bot]
9e0cc9606b
Merge branch 'master' into tavplubix-patch-1
2022-04-20 09:05:21 +00:00
lgbo-ustc
9e364912d8
update Settings comment
2022-04-20 17:01:02 +08:00
Robert Schulze
b24ca8de52
Fix various clang-tidy warnings
...
When I tried to add cool new clang-tidy 14 warnings, I noticed that the
current clang-tidy settings already produce a ton of warnings. This
commit addresses many of these. Almost all of them were non-critical,
i.e. C vs. C++ style casts.
2022-04-20 10:29:05 +02:00
Antonio Andelic
bbb0be6a44
Merge pull request #36402 from rschu1ze/clang-tidy-contains
...
Activate clang-tidy warning "readability-container-contains"
2022-04-20 08:15:46 +02:00
alesapin
ffca5c3cdc
Merge branch 'master' into musl-check
2022-04-19 17:51:54 +02:00
fenglv
72b0aa18e7
Add setting throw_if_no_data_to_insert
2022-04-19 17:44:27 +02:00
Alexey Milovidov
c46715db82
Remove abbreviation
2022-04-19 17:44:26 +02:00
kssenii
7cfc0ac433
Merge with master
2022-04-19 15:13:45 +02:00
mergify[bot]
3c1dd44b80
Merge branch 'master' into fix-insert-select
2022-04-19 12:17:31 +00:00
lgbo-ustc
3f2fe3ff66
fixed code style
2022-04-19 18:47:29 +08:00
lgbo-ustc
3d7338581b
Improve join
...
now adding joined blocks from right table can be run parallelly, speedup the join process
2022-04-19 16:07:30 +08:00
Robert Schulze
118e94523c
Activate clang-tidy warning "readability-container-contains"
...
This check suggests replacing <Container>.count() by
<Container>.contains() which is more speaking and in case of
multimaps/multisets also faster.
2022-04-18 23:53:11 +02:00
fenglv
735c38cdcc
fix typo
2022-04-18 04:59:41 +00:00
Memo
b3adf150b5
add_query_level_settings
2022-04-18 12:15:41 +08:00
Alexey Milovidov
1333b4cd89
Merge pull request #36345 from ucasfl/throw-no-data
...
Add setting throw_if_no_data_to_insert
2022-04-18 07:04:16 +03:00
Alexey Milovidov
e8f2d33c88
Adapt test
2022-04-18 02:30:45 +02:00
Alexey Milovidov
242919eddd
Remove abbreviation
2022-04-18 01:02:49 +02:00
Alexey Milovidov
f495cf45e0
Merge branch 'master' into enable-some-settings
2022-04-17 16:33:41 +02:00
fenglv
b25850a665
Add setting throw_if_no_data_to_insert
2022-04-17 05:42:07 +00:00
yuuch
0aabda2058
fix something in settings desc
2022-04-16 20:57:26 +08:00
mergify[bot]
08e885d517
Merge branch 'master' into exact-rows-before-limit
2022-04-15 06:27:54 +00:00
avogar
ae01646136
Place new logic of schema inference in insert select from table function under setting
2022-04-14 19:05:20 +00:00
Dmitry Novik
a16710c750
Merge remote-tracking branch 'origin/master' into grouping-sets-fix
2022-04-14 17:29:51 +00:00
yuuch
29e0b4c3bb
support collation in create query
2022-04-15 00:12:31 +08:00
kssenii
37242a0103
Allow non-evictable file segments based on predicate
2022-04-12 16:55:25 +02:00
mergify[bot]
078d8baf1d
Merge branch 'master' into enable-memory-overcommit
2022-04-11 17:09:02 +00:00
Yakov Olkhovskiy
155a2a0d42
Merge pull request #35349 from yakov-olkhovskiy/interpolate-feature
...
Interpolate feature
2022-04-11 11:15:50 -04:00
tavplubix
faae540a85
Merge pull request #24258 from ClickHouse/mvcc_prototype
...
MVCC prototype for MergeTree
2022-04-08 22:02:13 +03:00
Kruglov Pavel
d7b88d7683
Merge pull request #35582 from Avogar/improve-schema-inference
...
Improve schema inference and add some fixes
2022-04-08 13:44:52 +02:00
Alexander Tokmakov
141fbc6980
Merge branch 'master' into mvcc_prototype
2022-04-08 13:38:11 +02:00
Alexander Tokmakov
49c35f3261
Merge branch 'master' into mvcc_prototype
2022-04-08 13:34:40 +02:00
alesapin
becd4eda34
Merge pull request #36047 from ClickHouse/fix-typo
...
Fix typo
2022-04-08 12:38:24 +02:00
Vitaly Baranov
45dea9933b
Merge pull request #35883 from azat/format-settings
...
Do not allow SETTINGS after FORMAT for INSERT queries
2022-04-08 12:38:14 +02:00
alesapin
8ec802bc62
Merge pull request #35475 from kssenii/remote-fs-cache-improvements
...
Allow to write remote fs cache on all write operations. Add `system.remote_filesystem_cache` table. Add `drop remote filesystem cache (<path>)` query. Add `system.remote_data_paths` table.
2022-04-08 12:06:26 +02:00
Alexey Milovidov
88134c86a5
Fix typo
2022-04-07 20:32:47 +02:00
Azat Khuzhin
33d99c8ffb
Introduce compatiblity mode for SETTINGS after FORMAT
...
Add allow_settings_after_format_in_insert setting, OFF by default.
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
v2: s/parser_settings_after_format_compact/allow_settings_after_format_in_insert/ (suggested by vitlibar)
v3: replace ParserSettings with a flag (requested by vitlibar)
2022-04-07 16:36:34 +03:00
Alexander Tokmakov
7f54e7b422
Merge branch 'master' into mvcc_prototype
2022-04-07 15:14:06 +02:00
avogar
d2017a63b1
Merge branch 'master' of github.com:ClickHouse/ClickHouse into improve-schema-inference
2022-04-07 11:36:40 +00:00
Kruglov Pavel
f3f8f27db5
Merge pull request #35735 from Avogar/allow-read-bools-as-numbers
...
Allow to infer and parse bools as numbers in JSON input formats
2022-04-07 13:20:49 +02:00
Nikolai Kochetov
3e1b3f14c0
Merge pull request #34355 from azat/processors-profiling
...
Profiling on Processors level
2022-04-07 12:13:14 +02:00
Kruglov Pavel
ec2213493f
Merge branch 'master' into allow-read-bools-as-numbers
2022-04-06 14:53:02 +02:00
Kruglov Pavel
9141066de3
Merge branch 'master' into improve-schema-inference
2022-04-06 13:51:07 +02:00
Yakov Olkhovskiy
6b9a349083
Update SortDescription.h
...
wrong merge fix
2022-04-05 15:02:34 -04:00
Yakov Olkhovskiy
90c4cd3de7
Merge branch 'master' into interpolate-feature
2022-04-05 14:39:07 -04:00
mergify[bot]
bc882ded42
Merge branch 'master' into enable-memory-overcommit
2022-04-05 14:46:18 +00:00
MaxWk
032df9dc5d
Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into exact-rows-before-limit
2022-04-05 22:28:48 +08:00
Alexander Tokmakov
da00beaf7f
Merge branch 'master' into mvcc_prototype
2022-04-05 11:14:42 +02:00
Dmitry Novik
b4fed414e3
Enable memory overcommit
2022-04-04 14:28:05 +00:00
Alexander Tokmakov
a2167f12b8
Merge branch 'master' into mvcc_prototype
2022-04-04 14:24:23 +02:00
Nikita Taranov
bd89fcafdb
Make SortDescription::column_name always non-empty ( #35805 )
2022-04-04 14:17:15 +02:00
Maksim Kita
e6c9a36ac7
Merge pull request #35733 from kitaisreal/ipv6-invalid-insert-test
...
Added test for insert of invalid IPv6 value
2022-04-04 12:28:16 +02:00
Azat Khuzhin
765b4bc45a
Implement log_processors_profiles (write to processors_profile_log, OFF by default)
...
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-04-04 13:19:43 +03:00
kssenii
6c8e073a61
Merge master
2022-04-01 16:48:29 +02:00
Yakov Olkhovskiy
a15996315e
bugfix - columns order tracking
2022-03-31 11:51:13 -04:00
avogar
ab2a963287
Merge branch 'master' of github.com:ClickHouse/ClickHouse into allow-read-bools-as-numbers
2022-03-31 14:09:43 +00:00
mergify[bot]
24ade25d61
Merge branch 'master' into improve-schema-inference
2022-03-31 13:42:47 +00:00
Alexander Tokmakov
5a50ad9de3
Merge branch 'master' into mvcc_prototype
2022-03-31 11:35:04 +02:00
Nikita Taranov
30f2a942c5
Predict size of hash table for GROUP BY ( #33439 )
...
* use AggregationMethod ctor with reserve
* add new settings
* add HashTablesStatistics
* support queries with limit
* support distributed and with external aggregation
* add new profile events
* add some tests
* add perf test
* export cache stats through AsynchronousMetrics
* rm redundant trace
* fix style
* fix 02122_parallel_formatting test
* review fixes
* fix 02122_parallel_formatting test
* apply also to two-level HTs
* try simpler strategy
* increase max_size_to_preallocate_for_aggregation for experiment
* fixes
* Revert "increase max_size_to_preallocate_for_aggregation for experiment"
This reverts commit 6cf6f75704
2022-03-30 22:47:51 +02:00
Yakov Olkhovskiy
6a1e116c46
refactoring
2022-03-30 16:34:19 -04:00
kssenii
0fc92fe2aa
Get rid of all "remote" mentions
2022-03-30 17:15:29 +02:00
Maksim Kita
371cdc956a
Added input format settings for parsing invalid IPv4, IPv6 addresses as default values
2022-03-30 12:54:19 +02:00
avogar
3fc36627b3
Allow to infer and parse bools as numbers in JSON input formats
2022-03-29 17:37:31 +00:00
Alexander Tokmakov
287d858fda
Merge branch 'master' into mvcc_prototype
2022-03-29 16:24:12 +02:00
mergify[bot]
343588de2c
Merge branch 'master' into improve-schema-inference
2022-03-29 13:06:00 +00:00
