thevar1able/ClickHouse
1
0
Fork 0
mirror of https://github.com/ClickHouse/ClickHouse.git synced 2024-11-18 21:51:57 +00:00
Code Issues Packages Projects Releases Wiki Activity
48,654 Commits 9,131 Branches 1,778 Tags 2 GiB
e45edd57f2
Commit Graph

5625 Commits

Author SHA1 Message Date
alexey-milovidov
292b0a02f2
Merge pull request #14586 from Avogar/Custom-null-representation-in-TCV 
Custom null representation in tsv
 2020-09-08 23:42:44 +03:00
Nikita Mikhaylov
614e01b0e4 better 2020-09-08 23:12:55 +03:00
myrrc
78eac658b0 adding correct LC nested nullability checker 2020-09-08 22:51:44 +03:00
Nikolai Kochetov
fe0507663b Remove useless line. 2020-09-08 22:40:22 +03:00
alexey-milovidov
a5499ab9d6
Merge pull request #14555 from 4ertus2/some 
Hide symbols in nameless namespace
 2020-09-08 19:55:56 +03:00
Anton Popov
a419267dc6 minor fixes 2020-09-08 19:28:49 +03:00
nikitamikhaylov
c4f0465a7c limit 2020-09-08 18:54:30 +03:00
robot-clickhouse
8def718661 Auto version update to [20.10.1.1] [54440] 2020-09-08 17:04:41 +03:00
Alexey Milovidov
a687bdb370 Merge branch 'Custom-null-representation-in-TCV' of https://github.com/Avogar/ClickHouse into Avogar-Custom-null-representation-in-TCV 2020-09-08 15:51:00 +03:00
Kruglov Pavel
902ac5c33f
Change setting description 2020-09-08 15:49:57 +03:00
Alexey Milovidov
b460c67a4f Merge branch 'Custom-null-representation-in-TCV' of https://github.com/Avogar/ClickHouse into Avogar-Custom-null-representation-in-TCV 2020-09-08 15:47:10 +03:00
Kruglov Pavel
401b0e5ebb
Fix mistake 2 2020-09-08 15:47:02 +03:00
Alexey Milovidov
843b51bbb5 Merge branch 'Custom-null-representation-in-TCV' of https://github.com/Avogar/ClickHouse into Avogar-Custom-null-representation-in-TCV 2020-09-08 15:45:38 +03:00
alesapin
f0f7f2b5d2 Merge branch 'master' into recompression_in_background 2020-09-08 15:43:37 +03:00
alesapin
6ad91d1018
Merge pull request #14490 from ClickHouse/control_ttl_merges_in_pool 
Control ttl merges in pool
 2020-09-08 15:42:20 +03:00
Kruglov Pavel
70be9b152c
Add custom null representation in tsv 2020-09-08 15:39:24 +03:00
Kruglov Pavel
0e8946eb9f
Fix mistake 2020-09-08 15:38:11 +03:00
Kruglov Pavel
cce3f3fe4e
Change setting name 2020-09-08 15:37:18 +03:00
Kruglov Pavel
563f1486e6
Add output_tsv_null_representation 2020-09-08 15:36:11 +03:00
Kruglov Pavel
ac5d6caef5
Add tsv_null_representation 2020-09-08 15:32:31 +03:00
Nikolai Kochetov
dbd7ef9ee6 Fix build. 2020-09-08 15:31:36 +03:00
Kruglov Pavel
0e9612d9ff
Add null_representation setting in TSV 2020-09-08 15:29:22 +03:00
alesapin
bea15175d6
Merge pull request #14496 from Jokser/disk-s3-shutdown 
Disable S3 requests processing during context shutdown to speed up termination process
 2020-09-08 15:21:54 +03:00
Pavel Kovalenko
5e39f8b32b Add comment explaining DiskS3::shutdown 2020-09-08 15:20:35 +03:00
Ilya Yatsishin
a3d6732662
Merge pull request #14558 from bharatnc/ncb/improve-config-path-processing 
use std::filesystem::path in ConfigProcessor for filepath concatenation
 2020-09-08 14:39:23 +03:00
Nikolai Kochetov
b0cb5511a9 Fix build. 2020-09-08 14:17:39 +03:00
Nikita Mikhaylov
80f193f615
Merge pull request #14252 from bharatnc/ncb/time-query-log-in-ms 
add query_start_time_microseconds field to system.query_log & system.query_thread_log tables
 2020-09-08 15:11:50 +04:00
Nikolai Kochetov
4aeed33d4c Fix build. 2020-09-08 14:07:26 +03:00
Nikolai Kochetov
07e835381c Fix build. 2020-09-08 14:06:36 +03:00
Artem Zuikov
69e82e647e another fix for clang tidy 2020-09-08 14:01:17 +03:00
Nikolai Kochetov
39aad9979a Remove Join from ExpressionActions. 2020-09-08 13:40:53 +03:00
Artem Zuikov
d95614ad60 fix for clang tidy 2020-09-08 12:16:50 +03:00
Ilya Yatsishin
11a247d2f4
Merge pull request #14556 from ClickHouse/fix-arcadia-2 
Lower binary size in "Arcadia" build
 2020-09-08 12:08:35 +03:00
Nikolai Kochetov
c3eeb8f71e
Merge pull request #14412 from ClickHouse/pipes-and-creating-sets 
Pipes and creating sets
 2020-09-08 10:47:56 +03:00
Nikolai Kochetov
d771ce5609
Merge pull request #14500 from ClickHouse/many-rows-in-totals 
Many rows in totals
 2020-09-08 10:40:14 +03:00
alesapin
4364bff3bc
Merge pull request #12761 from kssenii/rabbitmq-improvements 
RabbitMQ improvements
 2020-09-08 09:38:25 +03:00
alesapin
8ff0aedebe Merge branch 'control_ttl_merges_in_pool' into recompression_in_background 2020-09-08 09:34:03 +03:00
alesapin
405a204514 Lower timeout for TTL merges 2020-09-08 09:33:00 +03:00
alesapin
f4846e2ef1
Update src/Storages/MergeTree/ReplicatedMergeTreeQueue.cpp 
Co-authored-by: Anton Popov <pad11rus@gmail.com>
 2020-09-08 09:30:54 +03:00
Winter Zhang
18b4c5997d
Merge branch 'master' into fix/datetime 2020-09-08 11:32:48 +08:00
bharatnc
0c00b992d5 StorageReplicatedMergeTree - cleanup data dir after Zk exceptions 
It's possible for `getZooKeeper()` to timeout if  zookeeper host(s) can't
be reached. In such cases `Poco::Exception` is thrown after a connection
timeout - refer to `src/Common/ZooKeeper/ZooKeeperImpl.cpp:866` for more info.

Side effect of this is that the CreateQuery gets interrupted and it exits.
But the data Directories for the tables being created aren't cleaned up.
This unclean state will hinder table creation on any retries and will
complain that the Directory for table already exists.

To achieve a clean state on failed table creations, catch this error if
the exception is of type Poco::Exception and call `dropIfEmpty()` method,
then proceed throwing the exception. Without this, the Directory for the
tables need to be manually deleted before retrying the CreateQuery.
 2020-09-07 18:09:09 -07:00
Artem Zuikov
7373aaf465 add IsOperation helper 2020-09-08 03:59:13 +03:00
Anton Popov
ee218c354e fix segfault in combinator -Resample 2020-09-08 02:21:12 +03:00
alexey-milovidov
1076a42cf5
Merge pull request #14549 from ClickHouse/lower-binary-size-in-debug 
Lower binary size in debug build
 2020-09-08 01:20:44 +03:00
Alexey Milovidov
e3924b8057 Fix "Arcadia" 2020-09-08 01:14:13 +03:00
bharatnc
7b89adb10d use std::filesystem::path in ConfigProcessor 
This PR improves the way the ClickHouse config path,
preprocessed_configs path etc are being joined inside
`ConfigProcessor.cpp`.

Uses `std::filesystem::path` to join the paths instead of
standard string concatenation. This would improve path concatenation.
Current method of concatenation results in:

```bash
➜  clickhouse-server ls -latr
total 68
-rw-r--r--   1 root root  5587 Aug 31 05:00 users.xml
drwxr-xr-x 143 root root 12288 Sep  7 11:23 ..
lrwxrwxrwx   1 root root    41 Sep  7 11:23 preprocessed -> /var/lib/clickhouse//preprocessed_configs
drwxr-xr-x   2 root root  4096 Sep  7 11:23 users.d
-rw-r--r--   1 root root 34252 Sep  7 11:28 config.xml
drwxr-xr-x   4 root root  4096 Sep  7 11:28 .
drwxr-xr-x   2 root root  4096 Sep  7 11:28 config.d
```

The symlink `/var/lib/clickhouse//preprocessed_configs` will still work.
amd this PR is an improvement to the current method of path
concatenation.
 2020-09-07 12:45:52 -07:00
alexey-milovidov
4bd5524da9
Merge pull request #14522 from ClickHouse/formats-dont-skip-bom-in-constructor 
More consistent invocation of skipBOMIfExists
 2020-09-07 21:38:03 +03:00
zhang2014
564dfac737 ISSUES-4006 fix decimal type decimal number part 2020-09-08 02:36:07 +08:00
Artem Zuikov
b3eafc1106 hide symbols in nameless namespace 2020-09-07 21:00:37 +03:00
Nikita Mikhaylov
a56d42de67 fix arcadia 2020-09-07 20:55:06 +03:00
Nikolai Kochetov
73de00f4df Review fix. 2020-09-07 20:49:23 +03:00
zhang2014
46c84b054e ISSUES-4006 fix negative decimal number 2020-09-08 01:28:20 +08:00
Nikita Mikhaylov
5d9367aea4
Merge pull request #14411 from nikitamikhaylov/rank-corr 
Merging #11769 (Rank Correlation Spearman)
 2020-09-07 21:18:19 +04:00
alexey-milovidov
e1104135c8
Merge pull request #13939 from fastio/master 
Multithreading implementation of Kafka engine
 2020-09-07 20:12:06 +03:00
Nikita Mikhaylov
2c04b0a8e6 comment added 2020-09-07 19:07:34 +03:00
Alexey Milovidov
53e39b05b2 Lower binary size in debug build 2020-09-07 18:35:18 +03:00
kssenii
40c8290dde Tiny fixes, better tests 2020-09-07 14:48:50 +00:00
Nikita Mikhaylov
8793281e3e remove cout 2020-09-07 17:02:59 +03:00
Nikita Mikhaylov
c09d86e5e4 another fixes 2020-09-07 16:15:04 +03:00
tavplubix
1f1b570832
Merge pull request #14523 from BohuTANG/mysql_replication_1 
Remove dryrun event to update position
 2020-09-07 15:49:33 +03:00
alesapin
17650e803f Tiny improvements 2020-09-07 14:08:53 +03:00
Nikolai Kochetov
382ebc700e Added comment. 2020-09-07 12:47:59 +03:00
zhang2014
b7e9d5e72d ISSUES-4006 support decimal for MaterializedMySQL engine 2020-09-07 17:43:25 +08:00
alesapin
f6237dc334 Better name 2020-09-07 12:32:45 +03:00
alesapin
4ce975c512 Merge branch 'master' into kssenii-rabbitmq-improvements 2020-09-07 11:36:08 +03:00
alesapin
f274ffc9d1 Add comments 2020-09-07 10:59:14 +03:00
Amos Bird
4c3c1cdaf3
Fix Nullable String to Enum conversion. 2020-09-07 15:32:44 +08:00
alesapin
ba70de63f8 Fix diff 2020-09-07 10:28:04 +03:00
alexey-milovidov
3903794386
Update ExecutableDictionarySource.cpp 2020-09-07 09:45:01 +03:00
alexey-milovidov
1f0d2be17a
Update ExecutableDictionarySource.h 2020-09-07 09:44:32 +03:00
Alexey Milovidov
8dd98f74a5 Remove debug output 2020-09-07 09:43:28 +03:00
Alexey Milovidov
04a6965006 Fix error with executable dictionary source 2020-09-07 09:40:01 +03:00
alesapin
7f301eab63 Merge branch 'master' into recompression_in_background 2020-09-07 09:31:16 +03:00
BohuTANG
576c6e9757 Remove dryrun event to update position 2020-09-07 13:18:28 +08:00
Alexey Milovidov
4a336e3814 More consistent invocation of skipBOMIfExists 2020-09-07 07:21:55 +03:00
alexey-milovidov
8b0a6d5609
Merge pull request #14404 from dimarub2000/system_events_show_zero_values 
system_events_show_zero_values setting added
 2020-09-07 06:40:36 +03:00
Alexey Milovidov
1400bdbf83 Fix unit tests 2020-09-07 06:11:35 +03:00
hexiaoting
dc0e276bba Add new feature: SHOW DATABASES LIKE 2020-09-07 11:06:21 +08:00
hexiaoting
a3671a15f6 Add new feature: SHOW DATABASES LIKE 2020-09-07 10:54:59 +08:00
Alexey Milovidov
83d2eafd12 Merge branch 'master' of github.com:yandex/ClickHouse into git-to-clickhouse 2020-09-07 03:19:44 +03:00
bharatnc
fd22450a2a Merge remote-tracking branch 'upstream/master' into ncb/time-query-log-in-ms 2020-09-06 13:19:27 -07:00
bharatnc
1c1f50c6b6 MetricLog - add event_time_microseconds column 2020-09-06 08:31:27 -07:00
bharatnc
25ca5e91bd AsynchronousMetricLog - add event_time_microseconds column 2020-09-06 08:31:27 -07:00
Dmitry
9639846ca9 Merge branch 'master' into system_events_show_zero_values 2020-09-06 14:55:14 +03:00
alexey-milovidov
a78b04b56a
Merge pull request #14455 from ClickHouse/prepare-clang-11 
Prepare for clang 11
 2020-09-06 11:02:58 +03:00
Peng Jian
ac25c41f22 Update docs for Kafka engine 2020-09-06 11:17:19 +08:00
Peng Jian
fd82272cfe Fix code style, and update docs for Kafka engine 2020-09-06 11:17:19 +08:00
Peng Jian
e6bfd9d586 1. Add new setting for Kafka engine, named kafka_thread_per_consumer which default value is false. 2. Create separate thread pool for Kafka engine. 2020-09-06 11:17:19 +08:00
Peng Jian
de0a40aedc fix code style 2020-09-06 11:17:19 +08:00
Peng Jian
61ac52cf29 Multithreading implementation of Kafka engine 2020-09-06 11:17:18 +08:00
alexey-milovidov
d61dda36ef
Update Sources.h 2020-09-06 01:09:59 +03:00
Anton Popov
3b9be70c8c Merge remote-tracking branch 'upstream/master' into HEAD 2020-09-05 18:53:55 +03:00
Anton Popov
30a867e387 Merge remote-tracking branch 'upstream/master' into HEAD 2020-09-05 17:00:14 +03:00
bharatnc
425c4d0634 fix style check - declare error code ILLEGAL_TYPE_OF_ARGUMENT 2020-09-04 21:26:51 -07:00
bharatnc
25080f3a88 additional checks for empty tz for toStartOfMonth|Quarter|Year 2020-09-04 20:15:37 -07:00
bharatnc
8fd00ff77b rename test files and fix tests - add ; at the end 2020-09-04 18:42:43 -07:00
bharatnc
cf110f4eb0 toStartOfInterval* functions - disallow empty timezone 2020-09-04 17:32:38 -07:00
Nikolai Kochetov
29918c9411 Update IAccumulatingTransform. 2020-09-04 23:44:15 +03:00
Nikolai Kochetov
499405504f Merge branch 'master' into pipes-and-creating-sets 2020-09-04 23:41:20 +03:00
Nikolai Kochetov
01d0f6e5c5
Merge pull request #14402 from ClickHouse/stop-threads-if-exception-in-pipeline-executor 
Stop query execution if exception happened in PipelineExecutor itself.
 2020-09-04 23:40:22 +03:00
Pavel Kovalenko
9d11d4dd44 Variable inline. 2020-09-04 21:45:22 +03:00
Nikita Mikhaylov
4fadb6c3ec fast test 2020-09-04 21:05:06 +03:00
Nikolai Kochetov
d7be761484 Try fix test. 2020-09-04 20:14:36 +03:00
bharatnc
05fcc68862 update QueryThreadLog.cpp 2020-09-04 10:12:17 -07:00
Nikita Mikhaylov
f67a7b3a3d better 2020-09-04 19:53:50 +03:00
Anton Popov
c73bb98002 fix clang-tidy 2020-09-04 19:50:40 +03:00
bharatnc
1c1826361f more formatting changes in QueryLog.cpp 2020-09-04 09:47:02 -07:00
bharatnc
f2848d5820 fix formatting in files 2020-09-04 09:42:18 -07:00
bharatnc
44e168bea7 query_start_time_microseconds field in system.query_log 
Add a new field called `query_start_time_microseconds`  that will add
`microseconds`. This new field will be of type `DateTime64`.
 2020-09-04 09:42:18 -07:00
Anton Popov
f1cf03f1bb Merge remote-tracking branch 'upstream/master' into HEAD 2020-09-04 17:40:22 +03:00
Nikita Mikhaylov
d718c5af99 fixed 2020-09-04 17:36:08 +03:00
alesapin
37a2bd0bfd less debug 2020-09-04 17:23:32 +03:00
alesapin
de911aaabe Merge branch 'master' into recompression_in_background 2020-09-04 17:21:27 +03:00
alesapin
2d1042614e Less comments 2020-09-04 17:19:41 +03:00
alesapin
79ef72178e Less garbage 2020-09-04 17:18:49 +03:00
Pavel Kovalenko
c933f72adb Disable S3 requests processing during context shutdown to speed up termination process. 2020-09-04 17:17:27 +03:00
alesapin
f48d654d35 Less garbage 2020-09-04 17:15:34 +03:00
alesapin
fecb2f1311 Less copypaste 2020-09-04 17:08:43 +03:00
alesapin
ea7168580b Fixes 2020-09-04 16:55:07 +03:00
Artem Zuikov
7c20aa2c62
Another 256-bit integers (strict 32 bytes) (#14229) 2020-09-04 16:33:02 +03:00
Nikolai Kochetov
7f88e3de1f Review fix. 2020-09-04 15:54:31 +03:00
Anton Popov
68913eab62 better reading from compact parts with differents codecs 2020-09-04 15:48:55 +03:00
Nikolai Kochetov
41a3fad1ea Allow many rows in totals. 2020-09-04 15:34:36 +03:00
alesapin
f8aa6cfe8a
Merge pull request #14438 from ClickHouse/apply_ttl_if_not_calculated 
Apply TTL if it's not calculated for part
 2020-09-04 15:32:50 +03:00
alesapin
f9dd4cc98d Merge branch 'control_ttl_merges_in_pool' into recompression_in_background 2020-09-04 14:32:25 +03:00
alesapin
e42d0f60da Fix several bugs 2020-09-04 14:27:27 +03:00
Nikolai Kochetov
40768593c3
Merge pull request #14469 from BohuTANG/mysql_set_@@var 
Support MySQL handler 'set @@xx' settting
 2020-09-04 14:18:57 +03:00
alesapin
4079636f81 Merge 2020-09-04 13:52:51 +03:00
alesapin
6f5ba4d8e5 Fix ya.make 2020-09-04 13:31:29 +03:00
alesapin
69b31ab90d More comments 2020-09-04 13:29:55 +03:00
Nikolai Kochetov
0bf0fb0e55
Merge pull request #14468 from BohuTANG/mysql_replication_gtid_format 
Fix mysql replication GTID event dump format
 2020-09-04 13:19:05 +03:00
alesapin
82c56349a5 Some comments 2020-09-04 13:08:09 +03:00
Nikolai Kochetov
c761970bc5 Merge branch 'master' into pipes-and-creating-sets 2020-09-04 11:38:35 +03:00
Nikolai Kochetov
b7e53208d1 Fix tests. 2020-09-04 11:36:47 +03:00
alesapin
c96a2b4f22
Merge pull request #14444 from ClickHouse/fix_select_parts_for_merge 
Fix select parts for merge
 2020-09-04 09:55:48 +03:00
alesapin
61ecaebcb1 Simplify settings for TTL merges 2020-09-04 09:55:19 +03:00
alexey-milovidov
54ede2e1bb
Merge pull request #14467 from ClickHouse/topk-check-overflow 
Check for array size overflow in topK
 2020-09-04 09:15:33 +03:00
alexey-milovidov
d623048dd1
Merge pull request #14454 from amosbird/im1 
Remove redundant conditions
 2020-09-04 09:14:35 +03:00
Alexey Milovidov
d3fa22280a Merge branch 'prepare-clang-11' into git-to-clickhouse 2020-09-04 09:12:27 +03:00
Alexey Milovidov
23b9677879 Added a script to import git repository to ClickHouse 2020-09-04 08:46:58 +03:00
BohuTANG
c094ff7eca ISSUES-9336 support MySQL handler 'set @@xx' settting 2020-09-04 12:51:15 +08:00
BohuTANG
4b0264c2a8 Fix mysql replication GTID event dump format 2020-09-04 12:00:37 +08:00
Alexey Milovidov
1cee6d5a31 Check for array size overflow in topK #14452 2020-09-04 04:05:57 +03:00
alexey-milovidov
12a21cb1a4
Merge pull request #14440 from matwey/fix/missed-atomic 
Add missed #include <atomic>
 2020-09-04 03:47:15 +03:00
Alexey Milovidov
4b3220f79a Prepare for clang 11 2020-09-04 03:39:56 +03:00
alexey-milovidov
4f9df21d3e
Merge pull request #10373 from azat/dist-SELECT-optimization 
Optimize queries with LIMIT/LIMIT BY/ORDER BY for distributed with GROUP BY sharding_key
 2020-09-04 01:38:56 +03:00
Anton Popov
6883ee7eea create less compressed streams while writing compact parts 2020-09-04 01:38:17 +03:00
Anton Popov
d5da58918e create less compressed streams while writing compact parts 2020-09-04 01:04:46 +03:00
Alexey Milovidov
796e3ae87d Prepare for clang 11 2020-09-03 22:40:21 +03:00
Amos Bird
3817c0efa7
Remove redundant conditions 2020-09-04 02:13:57 +08:00
Anton Popov
98011f6fc3 Merge remote-tracking branch 'upstream/master' into HEAD 2020-09-03 17:53:05 +03:00
alesapin
0dab4d9485 Merge branch 'fix_select_parts_for_merge' into control_ttl_merges_in_pool 2020-09-03 17:41:23 +03:00
alesapin
bd24c3a059 Fix build useless binary 2020-09-03 17:38:56 +03:00
Kseniia Sumarokova
4b7c303eaf
Merge branch 'master' into rabbitmq-improvements 2020-09-03 17:26:04 +03:00
Vitaly Baranov
dda884d6d0
Update AccessControlManager.h 
Add "override" for the destructor of AccessControlManager
 2020-09-03 17:20:14 +03:00
alesapin
15a02321bf Merge branch 'fix_select_parts_for_merge' into control_ttl_merges_in_pool 2020-09-03 17:16:29 +03:00
alesapin
55adb6f9f2
Update src/Storages/MergeTree/MergeSelector.h 
Co-authored-by: Nikita Mikhaylov <mikhaylovnikitka@gmail.com>
 2020-09-03 16:55:34 +03:00
alexey-milovidov
6a32d30578
Merge pull request #14431 from ClickHouse/fix-lazy-database 
Fix for Lazy database
 2020-09-03 16:38:59 +03:00
alesapin
e48e4309b2 Better names 2020-09-03 16:29:18 +03:00
alesapin
565555e55c Fix bug in parts selection 2020-09-03 16:04:28 +03:00
alesapin
13248a744b Fix bug in parts selection 2020-09-03 16:02:24 +03:00
alesapin
f4c7ff0376 Add fixed size of Merge TTLS 2020-09-03 16:00:13 +03:00
alesapin
aa47d0aabc Merge branch 'apply_ttl_if_not_calculated' into recompression_in_background 2020-09-03 12:07:03 +03:00
alesapin
acc0ee0657 Apply TTL if it's not calculated for part 2020-09-03 11:59:41 +03:00
Ilya Yatsishin
2b8ad576cc
Merge pull request #14323 from qoega/try-dns-fix 
Add tag pass for integration base image. Add explicit dns options for docker-compose.
 2020-09-03 11:27:24 +03:00
kssenii
e1ef558a2d Fixes 2020-09-03 06:50:20 +00:00
zhang2014
802a5a31a0 ISSUES-4006 fix code style 2020-09-03 11:11:18 +08:00
zhang2014
9c091fb2c1 ISSUES-4006 remove unsupport data type 2020-09-03 11:08:38 +08:00
zhang2014
dd0feeeaa1 ISSUES-4006 support datetime with precision 2020-09-03 11:03:28 +08:00
alexey-milovidov
edea940e17
Update StorageDistributed.cpp 2020-09-03 04:39:36 +03:00
Alexey Milovidov
96038e9d54 Fix for Lazy database 2020-09-03 04:06:12 +03:00
alexey-milovidov
1c2435d4f7
Merge pull request #14233 from amosbird/apply 
Introduce columns transformers.
 2020-09-03 01:37:40 +03:00
alexey-milovidov
72417d2716
Merge pull request #14368 from BohuTANG/materialize_mysql_query_filter_1 
change string.rfind to string starts_with and add some tests
 2020-09-03 01:09:53 +03:00
alexey-milovidov
4b1b744644
Revert "Less number of threads in builder" 2020-09-03 01:00:41 +03:00
Azat Khuzhin
fffeeeba06 Force WithMergeableStateAfterAggregation via distributed_group_by_no_merge (convert to UInt64) 
Possible values:
- 1 - Do not merge aggregation states from different servers for distributed query processing - in case it is for certain that there are different keys on different shards.
- 2 - same as 1 but also apply ORDER BY and LIMIT stages
 2020-09-03 00:52:51 +03:00
Azat Khuzhin
10b4f3b41f Optimize queries with LIMIT/LIMIT BY/ORDER BY for distributed with GROUP BY sharding_key 
Previous set of QueryProcessingStage does not allow to do this.
But after WithMergeableStateAfterAggregation had been introduced the
following queries can be optimized too under
optimize_distributed_group_by_sharding_key:
- GROUP BY sharding_key LIMIT
- GROUP BY sharding_key LIMIT BY
- GROUP BY sharding_key ORDER BY

And right now it is still not supports:
- WITH TOTALS (looks like it can be supported)
- WITH ROLLUP (looks like it can be supported)
- WITH CUBE
- SETTINGS extremes=1 (looks like it can be supported)
But will be implemented separatelly.

vX: fixes
v2: fix WITH *
v3: fix extremes
v4: fix LIMIT OFFSET (and make a little bit cleaner)
v5: fix HAVING
v6: fix ORDER BY
v7: rebase against 20.7
v8: move out WithMergeableStateAfterAggregation
v9: add optimize_distributed_group_by_sharding_key into test names
 2020-09-03 00:52:51 +03:00
Azat Khuzhin
4043be3121 Add new query processing stage WithMergeableStateAfterAggregation 
Process query until the stage where the aggregate functions were
calculated and finalized.

It will be used for optimize_distributed_group_by_sharding_key.

v2: fix aliases
v3: Fix protocol ABI breakage due to WithMergeableStateAfterAggregation
    Conditions >= for QueryProcessingStage::Enum has been verified, and they
    are ok (in InterpreterSelectQuery).
 2020-09-03 00:51:08 +03:00
alexey-milovidov
7bd31fb3d3
Merge pull request #14313 from ClickHouse/fix-fuzz-test6 
Better check for tuple size in SSD cache complex key external dictionaries
 2020-09-03 00:50:24 +03:00
Matwey V. Kornilov
9b4da1e82f Add missed #include <atomic> 
std::atomic<Data*> at line 199 requires including <atomic>
 2020-09-02 23:40:27 +03:00
Alexander Kuzmenkov
3a7181cfcb
Merge pull request #14397 from zhang2014/fix/ISSUES-14114 
ISSUES-14114 Implicitly convert primary key to not null in MaterializeMySQL
 2020-09-02 23:12:33 +03:00
alesapin
dcbddbb8d0 Add recompression ttls tests and fix bugs 2020-09-02 19:15:41 +03:00
Ilya Yatsishin
a5e9449bc3
Merge branch 'master' into try-dns-fix 2020-09-02 19:01:30 +03:00
alexey-milovidov
8e2fba5be1
Merge pull request #12567 from amosbird/fmi 
table function view
 2020-09-02 17:07:57 +03:00
Alexey Milovidov
95493352fe Remove wrong checks 2020-09-02 17:07:25 +03:00
Nikita Mikhaylov
cdb1f30630 style + fast test 2020-09-02 16:49:47 +03:00
Nikolai Kochetov
92c937db8b Remove CreatingSetsBlockInputStream 2020-09-02 16:13:13 +03:00
Nikolai Kochetov
acfd35a908 Update QueryPipeline::addCreatingSetsTransform 2020-09-02 16:04:54 +03:00
Ilya Yatsishin
136e7aa33d
Merge pull request #14362 from ClickHouse/less-number-of-threads-in-builder 
Less number of threads in builder
 2020-09-02 16:01:00 +03:00
Nikita Mikhaylov
7021f6edc1 better 
(cherry picked from commit 81481f26b5)
 2020-09-02 15:47:23 +03:00
Nikita Mikhaylov
e9a1f4a383 update ya.make 
(cherry picked from commit e62043e83b)
(cherry picked from commit a850388e62)
 2020-09-02 15:47:17 +03:00
Nikita Mikhaylov
eee19dada4 fixes + test 
(cherry picked from commit 5daee1cae1)
(cherry picked from commit c3dfb8e838)
 2020-09-02 15:47:09 +03:00
antikvist
a695344434 rank corr 
(cherry picked from commit 649e4dd913)
(cherry picked from commit ae17810201)
 2020-09-02 15:46:42 +03:00
antikvist
efc59d6686 rank corr 
(cherry picked from commit 11c94bee69)
(cherry picked from commit 483409f2e1)
 2020-09-02 15:46:29 +03:00
antikvist
e32887d300 rank corr 
(cherry picked from commit 2815397a19)
(cherry picked from commit d244797def)
 2020-09-02 15:45:59 +03:00
antikvist
950094c233 rank correlation 
(cherry picked from commit f9dda1e13e)
(cherry picked from commit 2a7026cb0c)
 2020-09-02 15:45:51 +03:00
antikvist
098561def3 welch t-test 
(cherry picked from commit 5cd118dcee)
(cherry picked from commit 8f19270f8d)
 2020-09-02 15:45:37 +03:00
antikvist
df668d6297 Rank Correlation 
(cherry picked from commit 3009c3885b)
(cherry picked from commit 024ff439e7)
 2020-09-02 15:45:31 +03:00
alexey-milovidov
09850dbdbc
Update ASTColumnsTransformers.cpp 2020-09-02 15:39:34 +03:00
alexey-milovidov
c009ace7a2
Update StorageSystemEvents.cpp 2020-09-02 15:28:29 +03:00
alesapin
128cb7ce22 Don't select already selected parts 2020-09-02 15:16:12 +03:00
alesapin
12f76d9448
Merge pull request #14325 from azat/suppress-wget-output 
Suppress superfluous wget (-nv) output
 2020-09-02 14:59:28 +03:00
Dmitry
13ba8cd5a7 fixed spaces 2020-09-02 14:25:11 +03:00
alesapin
06b38a4d44 Remove cerr 2020-09-02 13:31:31 +03:00
alesapin
aac466ab1c Merge branch 'better_ttl_merges_selection' into recompression_in_background 2020-09-02 13:30:04 +03:00
Dmitry
6f18cd772c fixes 2020-09-02 13:07:23 +03:00
Dmitry
2180cdc400 system_events_show_zero_values setting added 2020-09-02 13:00:49 +03:00
Nikolai Kochetov
811e44a937
Merge pull request #14315 from azat/EXPLAIN-SIGSEGV-fix 
[RFC] Fix QueryPlan lifetime (for EXPLAIN PIPELINE graph=1) for queries with nested interpreter
 2020-09-02 12:46:59 +03:00
Nikolai Kochetov
13e0464138 Stop query execution if exception happened in PipelineExecutor itself. 2020-09-02 12:39:49 +03:00
alesapin
fbb37c37df Simplier interface 2020-09-02 11:28:46 +03:00
alesapin
b08056fa8c Better selection of Merges with TTL 2020-09-02 11:18:50 +03:00
Yatsishin Ilya
45e54f81c7 better resolv.conf, add DNSCacheUpdater logs 2020-09-02 11:07:46 +03:00
Amos Bird
6bd753d85d
TableFunction view. 2020-09-02 16:02:10 +08:00
Amos Bird
be925f8d9c
Introduce columns transformers. 2020-09-02 15:36:34 +08:00
zhang2014
1f908af189 ISSUES-14114 fix create parse failure when mysql nullable primary key 2020-09-02 13:05:09 +08:00
hcz
a80c1adee8 Add JSONCompactStrings formats 2020-09-02 12:15:58 +08:00
alexey-milovidov
adf50fd774
Merge pull request #13761 from zhang2014/improvement/date_time 
ISSUES-4006 add precision argument for DateTime type
 2020-09-02 05:12:35 +03:00
alexey-milovidov
2d85213629
Merge pull request #13792 from azat/lambda-arrayJoin-fix 
[RFC] Fix arrayJoin() capturing in lambda
 2020-09-02 05:10:58 +03:00
alexey-milovidov
bfa5a9ef03
Merge pull request #13987 from vitlibar/fix-grant-all-on-table 
Fix GRANT ALL statement when executed on a non-global level
 2020-09-02 05:06:32 +03:00
alexey-milovidov
04c88ca9e4
Update AccessFlags.h 2020-09-02 05:06:21 +03:00
alexey-milovidov
5a529f171c
Merge pull request #13988 from vitlibar/user-directories-mixed-style 
Add storages from <user_directories> after ones from <users_config> and <access_control_path>.
 2020-09-02 05:03:34 +03:00
alexey-milovidov
08ed74732e
Merge pull request #14320 from bharatnc/ncb/fix-alter-live-lock 
fix ALTER LIVE VIEW  [REFRESH] lock issue
 2020-09-02 04:52:35 +03:00
Alexey Milovidov
deb483eee5 Merge branch 'master' into fix-fuzz-test6 2020-09-02 04:40:42 +03:00
Alexey Milovidov
56bbac1569 Trigger CI 2020-09-02 04:28:52 +03:00
BohuTANG
6dfab88156 ISSUES-14235 change string.rfind to string starts_with and add some tests 2020-09-02 08:31:51 +08:00
alexey-milovidov
d58f6bd7c0
Merge pull request #14334 from ClickHouse/stop-threads-if-exception-in-pipeline-executor 
Stop query execution if exception happened in PipelineExecutor itself.
 2020-09-02 03:17:50 +03:00
Alexander Kuzmenkov
fa04b39d32
Revert "Change query event filter and add integration test for empty GTID transaction" 2020-09-02 02:06:53 +03:00
Anton Popov
7c3712c121
Merge pull request #13688 from it1804/master 
Redis dictionary support for simple Redis requirepass authorization
 2020-09-02 01:43:02 +03:00
Anton Popov
4fe57fc169 Merge remote-tracking branch 'upstream/master' into HEAD 2020-09-02 01:29:44 +03:00
Anton Popov
26d75f7602 do fsync for WAL 2020-09-02 01:25:10 +03:00
kssenii
6682c62a90 Fixes 2020-09-01 20:07:34 +00:00
bharatnc
f0d1c6c794 Merge remote-tracking branch 'upstream/master' into ncb/fix-alter-live-lock 2020-09-01 09:06:10 -07:00
Anton Popov
3cadc9033a fsyncs for metadata files of part 2020-09-01 18:53:22 +03:00
Alexander Kuzmenkov
949a41f8b5
Merge pull request #14321 from BohuTANG/materialize_mysql_query_filter 
Change query event filter and add integration test for empty GTID transaction
 2020-09-01 17:44:58 +03:00
Alexander Kuzmenkov
2f3bb5844a
Merge branch 'master' into suppress-wget-output 2020-09-01 16:59:04 +03:00
Nikolai Kochetov
f82b799f12 Update CreatingSetsTransform. 2020-09-01 16:53:11 +03:00
tavplubix
cb4644ea6d
Merge pull request #14326 from ClickHouse/fix_crash_alter_table_function 
Throw exception on alter for storages created from table functions
 2020-09-01 15:03:09 +03:00
alesapin
c37a19f7b0 Better 2020-09-01 14:23:38 +03:00
kssenii
15f735bb24 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into rabbitmq-improvements 2020-09-01 10:51:34 +00:00
alesapin
f0dc5a3085 First working test 2020-09-01 13:49:53 +03:00
Nikolai Kochetov
8fac595428 Stop query execution if exception happened in PipelineExecutor itself. 2020-09-01 13:29:10 +03:00
Artem Zuikov
d304d522cc
Refactoring: rename types to allow change bigint library (#14219) 2020-09-01 12:54:50 +03:00
hcz
babd3beec0 Fix nullable data parsing 2020-09-01 17:48:19 +08:00
hcz
86fa185bb6 Add JSONStrings formats 2020-09-01 17:06:36 +08:00
hcz
602535396d Refactor, move function declarations 2020-09-01 16:36:27 +08:00
BohuTANG
453fb837d8 ISSUES-14235 change string.rfind to stringstarts_with 2020-09-01 16:25:15 +08:00
kssenii
c2fb72abf8 Better mv, more comments 2020-09-01 07:58:41 +00:00
alesapin
b751319f9e Merge branch 'master' into recompression_in_background 2020-09-01 10:31:10 +03:00
alesapin
a0b4cc78d6 Throw exception on alter for storages created from table functions 2020-09-01 10:26:31 +03:00
Azat Khuzhin
2d7cb03120 Suppress superfluous wget (-nv) output 
Since for dowloading some of files wget logging may take 50% of overall
log [1].

  [1]: https://clickhouse-builds.s3.yandex.net/14315/c32ff4c98cb3b83a12f945eadd180415b7a3b269/clickhouse_build_check/build_log_761119955_1598923036.txt
 2020-09-01 10:25:13 +03:00
Azat Khuzhin
d04cda0367 Fix QueryPlan lifetime (for EXPLAIN PIPELINE graph=1) for queries with nested interpreter 
Example of such queries are distributed queries, which creates local
InterpreterSelectQuery, which will have it's own QueryPlan but returns
Pipes that has that IQueryPlanStep attached.

After EXPLAIN PIPELINE graph=1 tries to use them, and will get SIGSEGV.

- TSAN:

<details>

```
==2782113==ERROR: AddressSanitizer: heap-use-after-free on address 0x6120000223c0 at pc 0x00002b8f3f3e bp 0x7fff18cfbff0 sp 0x7fff18cfbfe8
READ of size 8 at 0x6120000223c0 thread T22 (TCPHandler)
    #0 0x2b8f3f3d in DB::printPipelineCompact(std::__1::vector<std::__1::shared_ptr<DB::IProcessor>, std::__1::allocator<std::__1::shared_ptr<DB::IProcessor> > > const&, DB::WriteBuffer&, bool) /build/obj-x86_64-linux-gnu/../src/Processors/printPipeline.cpp:116:53
    #1 0x29ee698c in DB::InterpreterExplainQuery::executeImpl() /build/obj-x86_64-linux-gnu/../src/Interpreters/InterpreterExplainQuery.cpp:275:17
    #2 0x29ee2e40 in DB::InterpreterExplainQuery::execute() /build/obj-x86_64-linux-gnu/../src/Interpreters/InterpreterExplainQuery.cpp:73:14
    #3 0x2a7b44a2 in DB::executeQueryImpl(char const*, char const*, DB::Context&, bool, DB::QueryProcessingStage::Enum, bool, DB::ReadBuffer*) /build/obj-x86_64-linux-gnu/../src/Interpreters/executeQuery.cpp:389:28
    #4 0x2a7b1cb3 in DB::executeQuery(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&, DB::Context&, bool, DB::QueryProcessingStage::Enum, bool) /build/obj-x86_64-linux-gnu/../src/Interpreters/executeQuery.cpp:675:30
    #5 0x2b7993b2 in DB::TCPHandler::runImpl() /build/obj-x86_64-linux-gnu/../src/Server/TCPHandler.cpp:253:24
    #6 0x2b7b649a in DB::TCPHandler::run() /build/obj-x86_64-linux-gnu/../src/Server/TCPHandler.cpp:1217:9
    #7 0x31d9c57e in Poco::Net::TCPServerConnection::start() /build/obj-x86_64-linux-gnu/../contrib/poco/Net/src/TCPServerConnection.cpp:43:3
    #8 0x31d9d281 in Poco::Net::TCPServerDispatcher::run() /build/obj-x86_64-linux-gnu/../contrib/poco/Net/src/TCPServerDispatcher.cpp:114:20
    #9 0x3206b5d5 in Poco::PooledThread::run() /build/obj-x86_64-linux-gnu/../contrib/poco/Foundation/src/ThreadPool.cpp:199:14
    #10 0x320657ad in Poco::ThreadImpl::runnableEntry(void*) /build/obj-x86_64-linux-gnu/../contrib/poco/Foundation/src/Thread_POSIX.cpp:345:27
    #11 0x7ffff7f853e8 in start_thread (/usr/lib/libpthread.so.0+0x93e8)
    #12 0x7ffff7ea2292 in clone (/usr/lib/libc.so.6+0x100292)

0x6120000223c0 is located 0 bytes inside of 272-byte region [0x6120000223c0,0x6120000224d0)
freed by thread T22 (TCPHandler) here:
    #0 0x122f3b62 in operator delete(void*, unsigned long) (/src/ch/tmp/master-20200831/clickhouse+0x122f3b62)
    #1 0x2bd9e9fa in std::__1::default_delete<DB::IQueryPlanStep>::operator()(DB::IQueryPlanStep*) const /build/obj-x86_64-linux-gnu/../contrib/libcxx/include/memory:2363:5
    #2 0x2bd9e9fa in std::__1::unique_ptr<DB::IQueryPlanStep, std::__1::default_delete<DB::IQueryPlanStep> >::reset(DB::IQueryPlanStep*) /build/obj-x86_64-linux-gnu/../contrib/libcxx/include/memory:2618:7
    #3 0x2bd9e9fa in std::__1::unique_ptr<DB::IQueryPlanStep, std::__1::default_delete<DB::IQueryPlanStep> >::~unique_ptr() /build/obj-x86_64-linux-gnu/../contrib/libcxx/include/memory:2572:19
    #4 0x2bd9e9fa in DB::QueryPlan::Node::~Node() /build/obj-x86_64-linux-gnu/../src/Processors/QueryPlan/QueryPlan.h:66:12
    #5 0x2bd9e9fa in void std::__1::allocator_traits<std::__1::allocator<std::__1::__list_node<DB::QueryPlan::Node, void*> > >::__destroy<DB::QueryPlan::Node>(std::__1::integral_constant<bool, false>, std::__1::allocator<std::__1::__list_node<DB::QueryPlan::Node, void*> >&,
 DB::QueryPlan::Node*) /build/obj-x86_64-linux-gnu/../contrib/libcxx/include/memory:1798:23
    #6 0x2bd9e9fa in void std::__1::allocator_traits<std::__1::allocator<std::__1::__list_node<DB::QueryPlan::Node, void*> > >::destroy<DB::QueryPlan::Node>(std::__1::allocator<std::__1::__list_node<DB::QueryPlan::Node, void*> >&, DB::QueryPlan::Node*) /build/obj-x86_64-lin
ux-gnu/../contrib/libcxx/include/memory:1630:14
    #7 0x2bd9e9fa in std::__1::__list_imp<DB::QueryPlan::Node, std::__1::allocator<DB::QueryPlan::Node> >::clear() /build/obj-x86_64-linux-gnu/../contrib/libcxx/include/list:762:13
    #8 0x29fece08 in DB::InterpreterSelectQuery::execute() /build/obj-x86_64-linux-gnu/../src/Interpreters/InterpreterSelectQuery.cpp:492:1
    #9 0x2abf7484 in DB::ClusterProxy::(anonymous namespace)::createLocalStream(std::__1::shared_ptr<DB::IAST> const&, DB::Block const&, DB::Context const&, DB::QueryProcessingStage::Enum) /build/obj-x86_64-linux-gnu/../src/Interpreters/ClusterProxy/SelectStreamFactory.cpp:
78:33
    #10 0x2abea85d in DB::ClusterProxy::SelectStreamFactory::createForShard(DB::Cluster::ShardInfo const&, std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&, std::__1::shared_ptr<DB::IAST> const&, DB::Context const&, std::__1::shar
ed_ptr<DB::Throttler> const&, DB::SelectQueryInfo const&, std::__1::vector<DB::Pipe, std::__1::allocator<DB::Pipe> >&)::$_0::operator()() const /build/obj-x86_64-linux-gnu/../src/Interpreters/ClusterProxy/SelectStreamFactory.cpp:133:51
    #11 0x2abea85d in DB::ClusterProxy::SelectStreamFactory::createForShard(DB::Cluster::ShardInfo const&, std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&, std::__1::shared_ptr<DB::IAST> const&, DB::Context const&, std::__1::shar
ed_ptr<DB::Throttler> const&, DB::SelectQueryInfo const&, std::__1::vector<DB::Pipe, std::__1::allocator<DB::Pipe> >&) /build/obj-x86_64-linux-gnu/../src/Interpreters/ClusterProxy/SelectStreamFactory.cpp:189:13
    #12 0x2abe6d99 in DB::ClusterProxy::executeQuery(DB::ClusterProxy::IStreamFactory&, std::__1::shared_ptr<DB::Cluster> const&, Poco::Logger*, std::__1::shared_ptr<DB::IAST> const&, DB::Context const&, DB::Settings const&, DB::SelectQueryInfo const&) /build/obj-x86_64-lin
ux-gnu/../src/Interpreters/ClusterProxy/executeQuery.cpp:107:24
    #13 0x2abc4b74 in DB::StorageDistributed::read(std::__1::vector<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> >, std::__1::allocator<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > > > const&, s
td::__1::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::SelectQueryInfo const&, DB::Context const&, DB::QueryProcessingStage::Enum, unsigned long, unsigned int) /build/obj-x86_64-linux-gnu/../src/Storages/StorageDistributed.cpp:514:12
    #14 0x2bda1c5a in DB::ReadFromStorageStep::ReadFromStorageStep(std::__1::shared_ptr<DB::RWLockImpl::LockHolderImpl>, std::__1::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::SelectQueryOptions, std::__1::shared_ptr<DB::IStorage>, std::__1::vector<std::__1::basic_st
ring<char, std::__1::char_traits<char>, std::__1::allocator<char> >, std::__1::allocator<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > > > const&, DB::SelectQueryInfo const&, std::__1::shared_ptr<DB::Context>, DB::QueryProcessingStage
::Enum, unsigned long, unsigned long) /build/obj-x86_64-linux-gnu/../src/Processors/QueryPlan/ReadFromStorageStep.cpp:39:26
    #15 0x2a01ca70 in std::__1::__unique_if<DB::ReadFromStorageStep>::__unique_single std::__1::make_unique<DB::ReadFromStorageStep, std::__1::shared_ptr<DB::RWLockImpl::LockHolderImpl>&, std::__1::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::SelectQueryOptions&, std
::__1::shared_ptr<DB::IStorage>&, std::__1::vector<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> >, std::__1::allocator<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > > >&, DB::SelectQueryInfo&, st
d::__1::shared_ptr<DB::Context>&, DB::QueryProcessingStage::Enum&, unsigned long&, unsigned long&>(std::__1::shared_ptr<DB::RWLockImpl::LockHolderImpl>&, std::__1::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::SelectQueryOptions&, std::__1::shared_ptr<DB::IStorage>&,
std::__1::vector<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> >, std::__1::allocator<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > > >&, DB::SelectQueryInfo&, std::__1::shared_ptr<DB::Context>&,
DB::QueryProcessingStage::Enum&, unsigned long&, unsigned long&) /build/obj-x86_64-linux-gnu/../contrib/libcxx/include/memory:3028:32
    #16 0x29ff556a in DB::InterpreterSelectQuery::executeFetchColumns(DB::QueryProcessingStage::Enum, DB::QueryPlan&, std::__1::shared_ptr<DB::PrewhereInfo> const&, std::__1::vector<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> >, std::
__1::allocator<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > > > const&) /build/obj-x86_64-linux-gnu/../src/Interpreters/InterpreterSelectQuery.cpp:1383:26
    #17 0x29fe6b83 in DB::InterpreterSelectQuery::executeImpl(DB::QueryPlan&, std::__1::shared_ptr<DB::IBlockInputStream> const&, std::__1::optional<DB::Pipe>) /build/obj-x86_64-linux-gnu/../src/Interpreters/InterpreterSelectQuery.cpp:795:9
    #18 0x29fe5771 in DB::InterpreterSelectQuery::buildQueryPlan(DB::QueryPlan&) /build/obj-x86_64-linux-gnu/../src/Interpreters/InterpreterSelectQuery.cpp:473:5
    #19 0x2a47d370 in DB::InterpreterSelectWithUnionQuery::buildQueryPlan(DB::QueryPlan&) /build/obj-x86_64-linux-gnu/../src/Interpreters/InterpreterSelectWithUnionQuery.cpp:182:38
    #20 0x29ee5bff in DB::InterpreterExplainQuery::executeImpl() /build/obj-x86_64-linux-gnu/../src/Interpreters/InterpreterExplainQuery.cpp:265:21
    #21 0x29ee2e40 in DB::InterpreterExplainQuery::execute() /build/obj-x86_64-linux-gnu/../src/Interpreters/InterpreterExplainQuery.cpp:73:14
    #22 0x2a7b44a2 in DB::executeQueryImpl(char const*, char const*, DB::Context&, bool, DB::QueryProcessingStage::Enum, bool, DB::ReadBuffer*) /build/obj-x86_64-linux-gnu/../src/Interpreters/executeQuery.cpp:389:28
    #23 0x2a7b1cb3 in DB::executeQuery(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&, DB::Context&, bool, DB::QueryProcessingStage::Enum, bool) /build/obj-x86_64-linux-gnu/../src/Interpreters/executeQuery.cpp:675:30
    #24 0x2b7993b2 in DB::TCPHandler::runImpl() /build/obj-x86_64-linux-gnu/../src/Server/TCPHandler.cpp:253:24
    #25 0x2b7b649a in DB::TCPHandler::run() /build/obj-x86_64-linux-gnu/../src/Server/TCPHandler.cpp:1217:9
    #26 0x31d9c57e in Poco::Net::TCPServerConnection::start() /build/obj-x86_64-linux-gnu/../contrib/poco/Net/src/TCPServerConnection.cpp:43:3
    #27 0x31d9d281 in Poco::Net::TCPServerDispatcher::run() /build/obj-x86_64-linux-gnu/../contrib/poco/Net/src/TCPServerDispatcher.cpp:114:20
    #28 0x3206b5d5 in Poco::PooledThread::run() /build/obj-x86_64-linux-gnu/../contrib/poco/Foundation/src/ThreadPool.cpp:199:14
    #29 0x320657ad in Poco::ThreadImpl::runnableEntry(void*) /build/obj-x86_64-linux-gnu/../contrib/poco/Foundation/src/Thread_POSIX.cpp:345:27
    #30 0x7ffff7f853e8 in start_thread (/usr/lib/libpthread.so.0+0x93e8)
```

</details>
 2020-09-01 10:04:08 +03:00
alesapin
05b10048a6
Merge pull request #14116 from ClickHouse/parts_default_compression 
Save parts default compression
 2020-09-01 09:43:42 +03:00
alesapin
e28b477f79
Merge pull request #14263 from bharatnc/ncb/disallow-codec-for-alias 
Disallow codec for ALIAS columns types
 2020-09-01 09:42:53 +03:00
alesapin
4d96510a29
Merge pull request #14274 from ClickHouse/pipes-for-mutations 
Use QueryPipeline in MutationsInterpreter.
 2020-09-01 09:40:11 +03:00
bharatnc
c3dd968931 fix ALTER LIVE VIEW lock issue 
This PR fixes a lock issue that happens while executing
`ALTER LIVE VIEW` query with the `REFRESH` command that
results in a exception. The problem is that lock is currently
being acquired in `InterpreterALterQuery.cpp`
in the `InterpreterAlterQuery::execute()` method and lock
is again being reacquired in `StorageLiveView.cpp` in the
` StorageLiveView::refresh` method. This removes that extra
lock.

Before fix:

```sql
--create table

CREATE TABLE test0 (
    c0 UInt64
) ENGINE = MergeTree() PARTITION BY c0 ORDER BY c0;

-- enable experimental_live_view

:) SET allow_experimental_live_view=1

-- create live view;

:) CREATE LIVE VIEW live1 AS SELECT * FROM table0;

-- alter live view results in exception

:) ALTER LIVE VIEW live1 REFRESH;

...
...

Received exception from server (version 20.8.1):
Code: 49. DB::Exception: Received from localhost:9000. DB::Exception: RWLockImpl::getLock(): RWLock is already locked in exclusive mode.

```

After fix:

```sql
:)  ALTER LIVE VIEW live1 REFRESH;

ALTER LIVE VIEW live1
    REFRESH

Ok.

0 rows in set. Elapsed: 0.016 sec.
```
 2020-08-31 22:17:58 -07:00
Anton Popov
25140b9bd5 fsync MergeTree format file 2020-09-01 04:39:36 +03:00
Alexey Milovidov
142a5bcede Added validation of key types to SSD Cache dictionary 2020-09-01 02:10:04 +03:00
Alexey Milovidov
8fa61f785f Better check for tuple size in complex key external dictionaries 2020-09-01 01:55:52 +03:00
robot-clickhouse
e2fa0eae2f Auto version update to [20.9.1.1] [54439] 2020-08-31 23:07:41 +03:00
alesapin
46f833b7df Some changes 2020-08-31 22:50:42 +03:00
bharatnc
c377c228ef fix tests 2020-08-31 10:22:53 -07:00
alexey-milovidov
75ca3d217f
Merge pull request #14232 from zhang2014/fix/ISSUES-14231 
ISSUES-14231 fix wrong lexer in MaterializeMySQL database engine dump stage
 2020-08-31 19:03:04 +03:00
bharatnc
c4e235b000 Merge remote-tracking branch 'upstream/master' into ncb/disallow-codec-for-alias 2020-08-31 09:01:07 -07:00
bharatnc
caed8cd474 change error code to BAD_ARGUMENTS (36) 2020-08-31 09:00:32 -07:00
Alexander Kuzmenkov
bc8765d5ad
Merge pull request #14095 from azat/DistributedFilesToInsert-fix 
Fix DistributedFilesToInsert metric (zeroed when it should not)
 2020-08-31 18:58:30 +03:00
alexey-milovidov
f5a38fa78d
Merge pull request #14203 from donge/master 
fix issue #14202
 2020-08-31 17:48:39 +03:00
Alexander Kuzmenkov
134aae89f3
Merge pull request #14110 from 4ertus2/decimal 
Fix Decimal to Float conversion and toDecimal256() function
 2020-08-31 17:08:49 +03:00
alesapin
b20a0bc254 Add recompression flag in ReplicatedEntry 2020-08-31 16:42:42 +03:00
alesapin
067eb4599d Fix empty columns case 2020-08-31 16:39:27 +03:00
alesapin
adc18f4d3f Write with recompression TTL 2020-08-31 16:29:31 +03:00
Nikolai Kochetov
4ceb12b1de Use QueryPipeline in MutationsInterpreter. 2020-08-31 15:45:20 +03:00
alesapin
42c210fcba Recompress TTLs in memory metadata 2020-08-31 15:12:51 +03:00
alexey-milovidov
0586f0d555
Merge pull request #14253 from BohuTANG/mysql_replication_empty_transaction_issue14235 
Fix MaterializeMySQL empty GTID transaction issue #14235
 2020-08-31 15:08:34 +03:00
alesapin
4834bed35b Add recompression TTL parser 2020-08-31 14:35:53 +03:00
alexey-milovidov
bd04658fc0
Merge pull request #14218 from markpapadakis/patch-4 
Update AggregatingTransform.cpp
 2020-08-31 14:30:26 +03:00
kssenii
e57d1c827f Better shutdown 2020-08-31 10:00:28 +00:00
kssenii
647cf5718e Better settings 2020-08-31 09:27:42 +00:00
alesapin
034f1a895d Merge branch 'master' into recompression_in_background 2020-08-31 11:10:14 +03:00
bharatnc
6bb575fae9 fix style check 2020-08-31 00:39:58 -07:00
alesapin
5b0822902b
Merge pull request #14155 from amosbird/fzk 
Allow FETCH PARTITION from other zookeepers
 2020-08-31 09:54:51 +03:00
bharatnc
5c83b09a2f disallow CODEC setting for column type ALIAS 
This commit adds checks in place during table creation
and updates to ensure that we don't allow `CODEC` for
ALIAS (`default_type` column) like:

```sql
CREATE TABLE compression_codec_on_alias
(
    `c0` ALIAS c1 CODEC(ZSTD),
    `c1` UInt64
)
ENGINE = MergeTree()
PARTITION BY c0
ORDER BY c1;
```

After these safeguards in place, when trying to create/update column
codec, we will get excaptions like this:

```sql

-- create

CREATE TABLE compression_codec_on_alias
(
    `c0` ALIAS c1 CODEC(ZSTD),
    `c1` UInt64
)
ENGINE = MergeTree()
PARTITION BY c0
ORDER BY c1

Received exception from server (version 20.8.1):
Code: 377. DB::Exception: Received from localhost:9000. DB::Exception: Cannot specify codec for column type ALIAS.

0 rows in set. Elapsed: 0.006 sec.

-- modify

ALTER TABLE compression_codec_on_alias
    ADD COLUMN `c3` ALIAS c2 CODEC(ZSTD) AFTER c2

Received exception from server (version 20.8.1):
Code: 377. DB::Exception: Received from localhost:9000. DB::Exception: Cannot specify codec for column type ALIAS.

0 rows in set. Elapsed: 0.005 sec.

```
 2020-08-30 23:45:53 -07:00
zhang2014
b38c5a844c ISSUES-14231 better comment 2020-08-31 14:16:19 +08:00
zhang2014
761512413e ISSUES-14231 allow dollar and numver in identifier 2020-08-31 14:14:02 +08:00
zhang2014
592b6dcdce Revert "ISSUES-14231 add mysql identifier parser" 
This reverts commit ab1d665006.
 2020-08-31 13:48:20 +08:00
zhang2014
d24bf8de51 ISSUES-14231 allow dollar sign in identifier 2020-08-31 12:46:41 +08:00
zhang2014
ab1d665006 ISSUES-14231 add mysql identifier parser 2020-08-31 12:33:33 +08:00
BohuTANG
4d4b4b9532 Fix MaterializeMySQL empty GTID transaction issue #14235 2020-08-30 15:55:34 +08:00
alexey-milovidov
b1efc5df01
Merge pull request #14225 from amosbird/bf1 
Fix bug in mark inclusion search.
 2020-08-30 02:58:22 +03:00
alexey-milovidov
2a514eae21
Merge pull request #14223 from nikitamikhaylov/update-permutaiton-bug-fix 
Fixed incorrect sorting order if LowCardinality column.
 2020-08-29 18:25:26 +03:00
alesapin
2d33a4029b
Merge pull request #14220 from ClickHouse/remove_redundant_flag 
Disable force TTL on optimize final
 2020-08-29 10:40:36 +03:00
zhang2014
4182596961 ISSUES-14231 try fix wrong lexer 2020-08-29 12:28:04 +08:00
Amos Bird
591a4d60d4
Fix bug in mark inclusion search. 2020-08-29 09:46:46 +08:00
alesapin
ebc163c924 Merge branch 'master' into parts_default_compression 2020-08-28 23:11:42 +03:00
alexey-milovidov
c6f55bbe6a
Merge pull request #14151 from 4ertus2/some 
Add functions: isDecimalOverflow(), countDigits()
 2020-08-28 22:01:54 +03:00
alesapin
10c7a6c45e
Add ability to specify Default codec for columns (#14049) 
* Add ability to specify DefaultCompression codec which correspond to settings specified in config.xml

* Fix style

* Rename DefaultCompression to simple Default

* Fix compression codec

* Better codec description representation

* Less strange code and one method

* Fix delta
 2020-08-28 20:40:45 +03:00
alesapin
65c33f0802
Merge pull request #13280 from amosbird/as 
ALTER MODIFY SAMPLE BY
 2020-08-28 19:32:09 +03:00
Nikita Mikhaylov
fc84d12542 better 2020-08-28 18:28:46 +03:00
Nikita Mikhaylov
9d1cb7e22e done 2020-08-28 18:15:15 +03:00
alesapin
232c264d7d Disable force TTL on optimise 2020-08-28 16:45:42 +03:00
Mark Papadakis
ff76790a59
Update AggregatingTransform.cpp 
Replaced redundant call to chunk.getNumRows() with local var.
 2020-08-28 16:08:06 +03:00
alesapin
c1ca09653e Update custom parts of storage AST only if it has extended definition 2020-08-28 14:30:53 +03:00
alesapin
1ea00d5e7a Fix test and better messages 2020-08-28 14:12:51 +03:00
alesapin
b599d0a1ff Simplify function 2020-08-28 13:47:29 +03:00
alesapin
0896b49533 Small fixes 2020-08-28 13:18:56 +03:00
Artem Zuikov
881cd3331a gix comment and useDefault*(), add tests for nullables 2020-08-28 13:16:42 +03:00
kssenii
4e0c619721 Global refactoring 2020-08-28 10:03:54 +00:00
alesapin
6f16c08191 Fix ya.make 2020-08-28 12:29:07 +03:00
alesapin
d8d7c46711 Remove ya.make update 2020-08-28 12:27:59 +03:00
alesapin
77faf9587f Better interface 2020-08-28 12:07:20 +03:00
Dongdong Yang
7e48edf42c fix issue #14202 2020-08-28 13:29:15 +08:00
Alexey Milovidov
5763737d97 Fixups 2020-08-28 03:53:22 +03:00
Alexey Milovidov
ed1d120de0 Added another test; fixup 2020-08-28 03:28:37 +03:00
Alexey Milovidov
c4e8aaac16 Fixups 2020-08-28 03:07:51 +03:00
Alexey Milovidov
6082697c4d Support for quorum 2020-08-28 02:39:12 +03:00
Alexey Milovidov
cdba5e727c Fix mistake 2020-08-28 02:30:07 +03:00
Alexey Milovidov
88db4938f5 Fix error; refinements 2020-08-28 02:22:00 +03:00
Alexey Milovidov
c04dc4e722 Merge branch 'master' into manual-write-duplicate-parts-to-replicas 2020-08-28 01:56:11 +03:00
Alexey Milovidov
01567d62a4 Fix nullptr dereference in defaultValueOfTypeName 2020-08-27 21:36:18 +03:00
Amos Bird
1476a9e236
Add replicated_merge_tree_settings table 2020-08-27 22:41:59 +08:00
Amos Bird
05a5a13e08
specific ReplicatedMergeTree settings 2020-08-27 22:37:41 +08:00
Amos Bird
078b14610d
ALTER MODIFY SAMPLE BY 2020-08-27 22:31:30 +08:00
Amos Bird
0c1cf22c00
Allow FETCH PARTITION from other zookeepers 2020-08-27 22:19:18 +08:00
alesapin
32db38b4d2 Fix compression codec in WAL 2020-08-27 17:06:14 +03:00
Artem Zuikov
4c49539ad7
Revert division 2020-08-27 16:56:22 +03:00
Artem Zuikov
a521451af8
Update src/Core/DecimalFunctions.h 
Co-authored-by: Alexander Kuzmenkov <36882414+akuzm@users.noreply.github.com>
 2020-08-27 16:51:48 +03:00
alesapin
d426751e26 Default codec if part is not stored on disk 2020-08-27 16:32:23 +03:00
Artem Zuikov
2a0b98b19c add countDigits() function 2020-08-27 16:17:13 +03:00
alesapin
0ff5e5412e Merge branch 'master' into parts_default_compression 2020-08-27 16:01:37 +03:00
alexey-milovidov
ea0122de7e
Merge pull request #14120 from ClickHouse/parallel-insert-more-storages 
Support parallel INSERT for more table engines
 2020-08-27 15:08:56 +03:00
alexey-milovidov
9baa0fbf81
Merge pull request #14129 from CurtizJ/fix-performance 
Slightly optimize very short queries with LowCardinality
 2020-08-27 15:07:19 +03:00
Alexander Tokmakov
7943c5c73c remove "UUID" word for tables from logs 2020-08-27 14:46:19 +03:00
Nikita Mikhaylov
badd5a00c5
Merge pull request #14105 from nikitamikhaylov/nm-better-update-timeout 
Fix hardcoded timeout
 2020-08-27 15:16:47 +04:00
alesapin
afe4702c2c
Merge pull request #14139 from bharatnc/ncb/min_index_granularity_bytes 
add setting min_index_granularity_bytes
 2020-08-27 12:08:07 +03:00
tavplubix
478adb75ef
Merge pull request #14143 from ClickHouse/fix-named-tuple 
Fix creation of tables with named tuples #13027
 2020-08-27 11:56:59 +03:00
alesapin
1225c09a02 Fix default codec for in-memory parts 2020-08-27 11:35:55 +03:00
alesapin
886a7b485e Fixed codec in clone part 2020-08-27 09:49:41 +03:00
Artem Zuikov
724b38adc9 isDecimalOverflow() function 2020-08-27 04:14:10 +03:00
alexey-milovidov
67f16d5ae8
Merge pull request #14122 from ClickHouse/fix-fuzz-test-compile-expressions 
More range checks when compile_expressions = 1
 2020-08-27 02:15:40 +03:00
alexey-milovidov
0f706c01ca
Merge pull request #13888 from vladimir-golovchenko/add-date-trunc-function 
Added date_trunc function
 2020-08-27 02:12:27 +03:00
bharatnc
ffb73adb11 fix style check 2020-08-26 15:31:48 -07:00
bharatnc
593f054b10 minor fix exception message 2020-08-26 15:31:48 -07:00
bharatnc
3a35aedb56 add comments explaining index_granularity_bytes safe guard 2020-08-26 15:31:48 -07:00
bharatnc
4ac9b59cec format file 2020-08-26 15:31:48 -07:00
bharatnc
37416045ba setting min_index_granularity_bytes 
This PR adds a new setting called `min_index_granularity_bytes`.

If the `index_granularity_bytes` is > 0 and is lesser than the
`min_index_granularity_bytes`, throw an exception inside the
`registerStorageMergeTree.cpp` file.
 2020-08-26 15:31:48 -07:00
alexey-milovidov
330997dd0a
Merge pull request #14119 from ClickHouse/aku/min-decimal 
Fix formatting of minimal negative decimal
 2020-08-27 01:16:37 +03:00
Alexey Milovidov
651fb3539c Fix creation of tables with named tuples #13027 2020-08-27 00:57:42 +03:00
Azat Khuzhin
a588947fe2 Fix DistributedFilesToInsert metric (zeroed when it should not) 
CurrentMetrics::Increment add amount for specified metric only for the
lifetime of the object, but this is not the intention, since
DistributedFilesToInsert is a gauge and after #10263 it can exit from
the callback (and enter again later, for example after SYSTEM STOP
DISTRIBUTED SEND it will always exit from it, until SYSTEM START
DISTRIBUTED SEND).

So make Increment member of a class (this will also fix possible issues
with substructing value on DROP TABLE).
 2020-08-27 00:43:00 +03:00
Azat Khuzhin
d04d652ad4 Use CurrentMetrics::Metric over ProfileEvents::Event (cosmetic, both are size_t) 2020-08-27 00:43:00 +03:00
alexey-milovidov
f6f8dc9b8a
Merge pull request #13964 from zhang2014/fix/agg_combinator 
Try fix IfAggCombinator with NullAggCombinator
 2020-08-26 23:47:29 +03:00
alesapin
44eb702fbe Remove redundant code 2020-08-26 22:41:57 +03:00
alesapin
3a680dc8fb Fix removal bug 2020-08-26 22:40:04 +03:00
kssenii
4fecfdbe2f Better & cleaner 2020-08-26 18:52:45 +00:00
Anton Popov
eeb78bf291 slightly optimize very short queries with LowCardinality 2020-08-26 21:46:18 +03:00
alexey-milovidov
c53854df19
Merge pull request #14079 from livace/fix_2d_pip 
Fix pointInPolygon with const 2d array
 2020-08-26 21:02:58 +03:00
Alexander Kuzmenkov
c4fc434a13
Merge pull request #14060 from azat/parallel_distributed_insert_select-2 
Extend parallel_distributed_insert_select to run INSERT into local table
 2020-08-26 20:37:36 +03:00
Alexey Milovidov
5dbdd8ea3d More range checks when compile_expressions = 1 2020-08-26 19:49:19 +03:00
Alexey Milovidov
2a09aa53cc Support parallel INSERT for more table engines 2020-08-26 19:41:30 +03:00
alexey-milovidov
65ee7dcb18
Merge pull request #13941 from gervarela/avro_confluent_skip_missing_magic_or_schema_id 
Skip abnormaly small messages in AvroConfluent format
 2020-08-26 19:34:42 +03:00
Alexander Kuzmenkov
1a4fcf6650 Fix formatting of minimal negative decimal 2020-08-26 19:34:00 +03:00
alesapin
1fb93a8bf2 Remove read helpers 2020-08-26 18:57:06 +03:00
alesapin
18eb0dbcaa Better remove 2020-08-26 18:39:11 +03:00
alesapin
2fc80189af Add default compression codec to merge tree data part 2020-08-26 18:29:46 +03:00
alexey-milovidov
7ea28d976a
Update date_trunc.cpp 2020-08-26 17:28:54 +03:00
Nikita Mikhaylov
d05230c55a
Update CacheDictionary.cpp 2020-08-26 17:04:05 +03:00
Artem Zuikov
fe5db661ce fix decimal to float conversion and toDecimal256() 2020-08-26 15:26:12 +03:00
tavplubix
cff92c8ad3
Merge pull request #13820 from BohuTANG/mysql_replica_gtid_issue_4006 
ISSUES-4006 support MySQL GTID based replication #4006
 2020-08-26 15:02:53 +03:00
Nikita Mikhaylov
da16f234cc
Update CacheDictionary.cpp 2020-08-26 14:06:32 +03:00
Vitaly Baranov
7ac4bd7d1e Add storages from <user_directories> after ones from <users_config> and <access_control_path>. 2020-08-26 13:45:35 +03:00
alexey-milovidov
c157b7a685
Merge pull request #14056 from ClickHouse/alternative-14043 
Alternative implementation of #14043
 2020-08-26 13:15:30 +03:00
alesapin
4326c9c971 Fix delta 2020-08-26 12:16:32 +03:00
alesapin
249c4b4a94 Less strange code and one method 2020-08-26 11:59:02 +03:00
alesapin
21d78f8513 Better codec description representation 2020-08-26 11:45:13 +03:00
alesapin
7428c46737 Merge branch 'master' into recompressing_in_background 2020-08-26 10:28:03 +03:00
BohuTANG
e3bfd1a5b8 ISSUES-4006 fix clang-tidy error on boost::is_any_of 2020-08-26 14:33:05 +08:00
BohuTANG
3510afd149 ISSUES-4006 change UUID from MySQL big-endian to ClickHouse little-endian 2020-08-26 10:39:07 +08:00
alexey-milovidov
d3a9389465
Merge branch 'master' into bharatnc-ncb/timezones-table 2020-08-26 04:26:37 +03:00
alexey-milovidov
31460db37c
Merge pull request #14028 from ClickHouse/hczhcz-patch-0819-2 
Merging #13877
 2020-08-26 04:24:24 +03:00
BohuTANG
81e679dc22 ISSUES-4006 support gtid sets with whitespace 2020-08-26 09:04:33 +08:00
alexey-milovidov
f40b80ed45
Merge pull request #12756 from sundy-li/hotfix/dict-access 
Fix ClickHouseDictionarySource wrong access check
 2020-08-26 03:33:42 +03:00
alexey-milovidov
7271c9c983
Merge pull request #14059 from azat/gcc10-fixes 
gcc10 build fixes
 2020-08-26 03:31:03 +03:00
Alexey Milovidov
0e021c6151 Merge branch 'master' into manual-write-duplicate-parts-to-replicas 2020-08-26 03:24:35 +03:00
alexey-milovidov
7edb911e91
Merge pull request #13687 from podshumok/forcers 
cmake: Add option to fail configuration instead of auto-reconfiguration. And make it default
 2020-08-26 03:00:26 +03:00
vladimir golovchenko
b0dd1d92b4 Added date_trunc function. 2020-08-25 16:41:08 -07:00
alexey-milovidov
c1c5474730
Merge pull request #14051 from javisantana/fix/info_in_read_only_table 
adds some info to the exception about zookeeper path
 2020-08-26 02:27:01 +03:00
alexey-milovidov
3c6675f7f4
Update AvroRowInputFormat.cpp 2020-08-26 02:26:27 +03:00
alexey-milovidov
7c3c18da92
Merge branch 'master' into bharatnc-ncb/timezones-table 2020-08-26 02:14:53 +03:00
Alexey Milovidov
0101fa0af9 Fix error 2020-08-26 02:12:16 +03:00
alexey-milovidov
00c697df06
Merge pull request #14005 from ClickHouse/ucasFL-new-branch 
Merging #12195
 2020-08-26 01:33:54 +03:00
Alexey Ilyukhov
f32b7f48f1 Fix pointInPolygon with const 2d array 2020-08-26 01:13:47 +03:00
alexey-milovidov
75a3bbf5b2
Merge pull request #13722 from javisantana/fix/replicas_status_verbose 
return 200 when replicas status is ok and verbose = 1
 2020-08-26 00:35:47 +03:00
alexey-milovidov
5d4507907d
Update AvroRowInputFormat.cpp 2020-08-26 00:19:51 +03:00
alexey-milovidov
efa5b76605
Update AvroRowInputFormat.cpp 2020-08-26 00:17:39 +03:00
Alexey Milovidov
e2721e95d8 Merge branch 'master' into hczhcz-patch-0819-2 2020-08-25 23:50:41 +03:00
Alexey Milovidov
63feb75306 Some tweaks 2020-08-25 23:49:22 +03:00
Alexey Milovidov
64af0db94a Fix error 2020-08-25 23:40:32 +03:00
Azat Khuzhin
50a312534c Extend parallel_distributed_insert_select to run INSERT into local table 
Before this patch there was:

- parallel_distributed_insert_select=1, that executes:

    INSERT INTO dist_out SELECT ... FROM underlying_dist_in

After this patch there will be:

- parallel_distributed_insert_select=2, that executes:

    INSERT INTO underlying_dist_out SELECT ... FROM underlying_dist_in

And cover the behaviour w/o integration test, by using the following
techincs:
- SYSTEM STOP DISTRIBUTED SENDS
- prefer_localhost_replica=0
 2020-08-25 22:49:13 +03:00
Alexey Milovidov
7aadd3803c Fix error 2020-08-25 22:46:47 +03:00
alesapin
e5bc5ea419 Fix compression codec 2020-08-25 22:30:52 +03:00
Azat Khuzhin
99db9341a2 Fix -Werror=type-limits in AggregateFunctionTimeSeriesGroupSum.h (size_t() >= 0) 
gcc10 reports:

    In file included from ../src/AggregateFunctions/AggregateFunctionTimeSeriesGroupSum.cpp:1:
    ../src/AggregateFunctions/AggregateFunctionTimeSeriesGroupSum.h: In instantiation of ‘void DB::AggregateFunctionTimeSeriesGroupSumData<rate>::add(DB::UInt64, DB::Int64, DB::Float64) [with bool rate = true; DB::UInt64 = long unsigned int; DB::Int64 = long int; DB::Float64 = double]’:
    ../src/AggregateFunctions/AggregateFunctionTimeSeriesGroupSum.h:246:34:   required from ‘void DB::AggregateFunctionTimeSeriesGroupSum<rate>::add(DB::AggregateDataPtr, const DB::IColumn**, size_t, DB::Arena*) const [with bool rate = true; DB::AggregateDataPtr = char*; size_t = long unsigned int]’
    ../src/AggregateFunctions/AggregateFunctionTimeSeriesGroupSum.h:239:10:   required from here
    ../src/AggregateFunctions/AggregateFunctionTimeSeriesGroupSum.h:113:71: error: comparison of unsigned expression in ‘>= 0’ is always true [-Werror=type-limits]
      113 |         while (result[i].first > it_ss->second.dps.front().first && i >= 0)
          |                                                                     ~~^~~~
    ../src/AggregateFunctions/AggregateFunctionTimeSeriesGroupSum.h: In instantiation of ‘void DB::AggregateFunctionTimeSeriesGroupSumData<rate>::add(DB::UInt64, DB::Int64, DB::Float64) [with bool rate = false; DB::UInt64 = long unsigned int; DB::Int64 = long int; DB::Float64 = double]’:
    ../src/AggregateFunctions/AggregateFunctionTimeSeriesGroupSum.h:246:34:   required from ‘void DB::AggregateFunctionTimeSeriesGroupSum<rate>::add(DB::AggregateDataPtr, const DB::IColumn**, size_t, DB::Arena*) const [with bool rate = false; DB::AggregateDataPtr = char*; size_t = long unsigned int]’
    ../src/AggregateFunctions/AggregateFunctionTimeSeriesGroupSum.h:239:10:   required from here
    ../src/AggregateFunctions/AggregateFunctionTimeSeriesGroupSum.h:113:71: error: comparison of unsigned expression in ‘>= 0’ is always true [-Werror=type-limits]
 2020-08-25 21:20:04 +03:00
Azat Khuzhin
9071457d3f Fix C++20 comparison calls recursively with reversed arguments in UInt128.h (over.match.oper#3.4.4 in gcc10) 
Due to [1], gcc10 reports:

    ../src/Common/UInt128.h:92:81: error: in C++20 this comparison calls the current function recursively with reversed arguments [-Werror]
       92 | template <typename T> bool inline operator == (T a, const UInt128 b) { return b == a; }

  [1]: http://eel.is/c++draft/over.match.oper#3.4.4
 2020-08-25 21:19:57 +03:00
Azat Khuzhin
308e094d04 Fix arrayJoin() capturing in lambda 
Fixes the following LOGICAL_ERROR:

    $ clickhouse-client -q 'select arrayFilter((a) -> ((a, arrayJoin([[]])) IN (Null, [Null])), [])'
    2020.08.16 00:32:01.967102 [ 1744189 ] {b40a5ebd-d710-4f03-bb18-57db67de1181} <Error> : Logical error: 'Lambda captured argument arrayJoin(array(array())) not found in required columns.'.
    clickhouse-server: ../src/Common/Exception.cpp:45: DB::Exception::Exception(const string&, int): Assertion `false' failed.

Since there are multiple input columns for arrayJoin():

    (gdb) p captured_names_
    $6 = std::vector of length 3, capacity 4 = {"arrayJoin(array(array()))", "arrayJoin(array(array()))", "__set"}

While FunctionCaptureOverloadResolver cannot handle non-unique columns.
 2020-08-25 21:06:21 +03:00
Alexey Milovidov
b3845b10d4 More simple 2020-08-25 20:54:44 +03:00
Alexey Milovidov
39730bfc30 Alternative implementation of #14043 2020-08-25 20:42:35 +03:00
Konstantin Podshumok
17c46faaa7
cmake: fix parquet/arrow variables 
squashed:

- sync FindArrow.cmake and FindParquet.cmake with arrow repo
- unbundled: add arrow to dbms link libraries
- cmake: fix-up unbundled Arrow support

Signed-off-by: Konstantin Podshumok <kpp.live+signed@gmail.com>
 2020-08-25 20:16:41 +03:00
alexey-milovidov
ea4aa34697
Little bit more pretty 2020-08-25 20:09:35 +03:00
Javi Santana
4942d85090 adds some info to the exception about zookeeper path 2020-08-25 18:09:22 +02:00
alesapin
9ca8c5e77a Rename DefaultCompression to simple Default 2020-08-25 18:53:06 +03:00
alesapin
7bf0b74293 Fix style 2020-08-25 18:22:21 +03:00
Alexander Tokmakov
59d879b1fe fix "no space left" extra info for Poco::Exception 2020-08-25 18:06:24 +03:00
alesapin
1180bad3a7 Add ability to specify DefaultCompression codec which correspond to settings specified in config.xml 2020-08-25 18:02:32 +03:00
kssenii
31b1b6fe9f Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into rabbitmq-improvements 2020-08-25 14:47:03 +00:00
BohuTANG
d01f4d38eb ISSUES-4006 fix fast build warning and remove binlog file name 2020-08-25 17:44:23 +08:00
BohuTANG
d8e88499a5 ISSUES-4006 remove old BinlogDump style 2020-08-25 16:01:51 +08:00
BohuTANG
80af056cb4 ISSUES-4006 change the error code from UNKNOWN_EXCEPTION to LOGICAL_ERROR 2020-08-25 15:49:47 +08:00
BohuTANG
0876ab63ec ISSUES-4006 change to UUID type 2020-08-25 15:44:38 +08:00
Alexey Milovidov
b0908144b3 Fix clang-tidy 2020-08-25 01:20:43 +03:00
Alexey Milovidov
31240aa243 Minor modifications 2020-08-24 23:35:38 +03:00
bharatnc
70d00abe4f try and fix gcc-9 build. 
This tries to fix the failing gcc-9 unbundled build:

https://clickhouse-builds.s3.yandex.net/13880/e437d85b927a47da69b8bdc4dde95917c2261cbe/clickhouse_build_check/build_log_753740668_1598037713.txt
 2020-08-24 23:31:21 +03:00
bharatnc
a44a90fe99 remove older script that generated tz data 2020-08-24 23:30:41 +03:00
Alexey Milovidov
b504b9a917 Fix conflict + minor modification. 2020-08-24 23:29:56 +03:00
bharatnc
b85bcc5b8b add time_zones tables 
This table adds a new table called the `time_zones` table:

```
:) select * from system.time_zones limit 10;

SELECT *
FROM system.time_zones
LIMIT 10

┌─time_zone──────────┐
│ Africa/Abidjan     │
│ Africa/Accra       │
│ Africa/Addis_Ababa │
│ Africa/Algiers     │
│ Africa/Asmara      │
│ Africa/Asmera      │
│ Africa/Bamako      │
│ Africa/Bangui      │
│ Africa/Banjul      │
│ Africa/Bissau      │
└────────────────────┘

10 rows in set. Elapsed: 0.012 sec.
```

The available timezones are parsed from under
`ClickHouse/contrib/cctz/testdata/zoneinfo` through a script
and the table content is constructed from the
StorageSystemTimeZones.generated.cpp`.

I was able to test this locally and was able to get a list of time
zones as shown above.
 2020-08-24 23:26:00 +03:00
alexey-milovidov
7ea5364299
Merge pull request #13648 from filimonov/tzdata_version2 
tzdata improvements
 2020-08-24 23:07:37 +03:00
Alexey Milovidov
99009a3468 utils/generate-ya-make/generate-ya-make.sh 2020-08-24 23:02:29 +03:00
Alexey Milovidov
846cdd70fc Merge branch 'patch-0819' of https://github.com/hczhcz/ClickHouse into hczhcz-patch-0819-2 2020-08-24 23:01:59 +03:00
Nikita Mikhaylov
e4fc48254a
Merge pull request #13818 from bharatnc/ncb/quantileExactLowHigh 
add functions for quantileExactLow & quantileExactHigh
 2020-08-24 23:51:30 +04:00
Alexander Kuzmenkov
e3c919ec19
Merge pull request #13847 from hexiaoting/dev_rmcode 
Deprecate ODBCDriver format
 2020-08-24 22:34:52 +03:00
alexey-milovidov
2e6ff0c5ec
Merge pull request #13925 from 4ertus2/ast 
Rewrite duplicate distinct optimization
 2020-08-24 22:33:22 +03:00
alexey-milovidov
6a164634d7
Merge pull request #12550 from myrrc/bug/low-cardinality-arrays-optimisations 
Optimising has(), indexOf(), and countEqual() for Array(LowCardinality(T)) and constant right arguments
 2020-08-24 22:31:29 +03:00
alexey-milovidov
14400b5b41
Merge pull request #13940 from hczhcz/patch-0821 
Fix parser to reject create table as table function with engine
 2020-08-24 22:01:40 +03:00
alesapin
d806e0c052
Merge pull request #13450 from ClickHouse/fix_ddl_worker_timeouts 
Fix DDL worker timeouts for long queries
 2020-08-24 19:23:09 +03:00
Alexey Milovidov
612382b74e Minor modification 2020-08-24 17:45:00 +03:00
Alexey Milovidov
e1ccebe8f3 Minor modification 2020-08-24 17:42:12 +03:00
Alexey Milovidov
1fa4978685 Make the code more clear; add comments 2020-08-24 17:29:31 +03:00
Alexey Milovidov
0a7fb4eb80 Remove strange files 2020-08-24 16:27:47 +03:00
Alexey Milovidov
dfe870e38c Merge branch 'new-branch' of https://github.com/ucasFL/ClickHouse into ucasFL-new-branch 2020-08-24 16:26:08 +03:00
Anton Popov
4331158d30 merge with master 2020-08-24 16:09:23 +03:00
Nikita Mikhaylov
7209809e29 get rid of virtual call 2020-08-24 14:54:04 +03:00
Artem Zuikov
69c77ff229 Merge branch 'master' into ast 2020-08-24 14:09:30 +03:00
Winter Zhang
75af61ea95
Try fix style failure 2020-08-24 18:51:54 +08:00
Anton Popov
4df5c72878 Merge remote-tracking branch 'upstream/master' into HEAD 2020-08-24 12:57:27 +03:00
Anton Popov
93d49e5815
Merge pull request #13237 from vdimir/string-locate-startpos-3776 
Support start_pos argument in `position` function
 2020-08-24 12:23:19 +03:00
alesapin
0177b35998 Review fixes 2020-08-24 12:07:37 +03:00
alesapin
f5730a3a5f Merge branch 'master' into fix_ddl_worker_timeouts 2020-08-24 11:50:11 +03:00
zhang2014
63868aaed3 Try fix CI 2020-08-24 13:05:59 +08:00
alexey-milovidov
d0b6ba35d1
Merge pull request #8367 from amosbird/scalarfix 
fix scalar subquery hash conflicts
 2020-08-24 01:14:34 +03:00
bharatnc
64d848f5c8 fix gcc-9 build check error 2020-08-23 10:09:41 -07:00
bharatnc
dd3068e2bb fix file formatting 2020-08-23 10:09:41 -07:00
bharatnc
e1bf87019c add quantileExactLow & quantileExactHigh functions 
This PR adds the quantileExactLow and quantileExactHigh
implementations which are equivalent to how the `median_low`
and `median_high` functions are implemented in python.

`median_low`: https://github.com/python/cpython/blob/master/Lib/statistics.py#L438
`median_high`: https://github.com/python/cpython/blob/master/Lib/statistics.py#L460
 2020-08-23 10:09:41 -07:00
alexey-milovidov
c633168c51
Merge pull request #13922 from ClickHouse/fix_rename_distributed_table_deadlock 
Fix lock order inversion when renaming Distributed table
 2020-08-23 16:45:32 +03:00
alexey-milovidov
d7871f3976
Merge pull request #13947 from Felixoid/unlimit_resample 
Increase limit in -Resample combinator to 1M
 2020-08-23 15:56:44 +03:00
alexey-milovidov
f41118f230
Merge pull request #13929 from Enmk/ConnectionPoolWithFailover_data_race_fix 
First attempt to fix data race in ConnectionPoolWithFailover::getStatus()
 2020-08-23 15:54:56 +03:00
zhang2014
0e8cb96eb1 Try fix IfAggCombinator with NullAggCombinator 2020-08-22 22:57:46 +08:00
Vitaly Baranov
2a96151516 Fix GRANT ALL statement when executed on a non-global level. 2020-08-22 01:59:52 +03:00
alexey-milovidov
7b53a0ef33 Revert "Added allow_merges option for volumes in multi-disk configuration (#13402)" 
This reverts commit 1e2616542a.
 2020-08-21 18:44:29 +03:00
alexey-milovidov
b71ef6db22
Update AvroRowInputFormat.cpp 2020-08-21 18:34:15 +03:00
alexey-milovidov
84db9a3a66
Merge pull request #13906 from tomjiang1987/optimize_error_msg_for_null 
optimize error msg for null value of TabSeparatedRow format
 2020-08-21 16:06:16 +03:00
alexey-milovidov
cda85a7828
Update AggregateFunctionResample.h 2020-08-21 15:05:58 +03:00
Mikhail f. Shiryaev
622c2d7e45
Increase limit in -Resample combinator to 1M 2020-08-21 13:35:19 +02:00
alexey-milovidov
55ac192417
Merge pull request #13928 from ClickHouse/wring-error-for-too-long-query 
Fix wrong error for long queries.
 2020-08-21 13:18:19 +03:00
Gervasio Varela
a6a18b62f9 AvroConfluent + Kafla: Skip malformed messages that do not contain at least the AvroConfluent magic number and the schema id definition. 2020-08-21 11:11:41 +02:00
Vladimir Chebotarev
1e2616542a
Added allow_merges option for volumes in multi-disk configuration (#13402) 2020-08-21 12:04:13 +03:00
hcz
73c5fbcba5 Fix create table as table function with engine 2020-08-21 16:11:49 +08:00
zhang2014
b679b2e30c ISSUES-4006 fix toDateTime64 with scale 0 2020-08-21 13:16:50 +08:00
zhang2014
3318b6ea00 ISSUES-4006 try fix build failure 2020-08-21 13:09:41 +08:00
zhang2014
ec1572d7be ISSUES-4006 support parserDateTime32 functions 2020-08-21 13:09:25 +08:00
tao jiang
294aa985e0 fix typo exception name 2020-08-21 08:53:00 +08:00
Nikita Mikhaylov
8f1ba521a0
Merge pull request #13624 from nikitamikhaylov/cache-dictionary-bugfix 
cache-dictionary flap
 2020-08-21 02:24:26 +04:00
Artem Zuikov
0f49291733 make clang tidy happy 2020-08-21 01:05:06 +03:00
Artem Zuikov
13bb3774ff update tests 2020-08-20 23:50:53 +03:00
Vasily Nemkov
f94f786cc3 First attempt to fix data race in ConnectionPoolWithFailover::getStatus() 2020-08-20 23:25:38 +03:00
Artem Zuikov
f99622be33 minor fix 2020-08-20 22:04:46 +03:00
Nikolai Kochetov
99b31480fd Fix wrong error for long queries. 2020-08-20 21:56:50 +03:00
Artem Zuikov
f4e84d93ba fix indirect distinct with less columns 2020-08-20 21:51:22 +03:00
Artem Zuikov
9f5538c14d fix crash in case of no tables in select 2020-08-20 21:09:48 +03:00
alexey-milovidov
c5a7b1c456
Update RowInputFormatWithDiagnosticInfo.cpp 2020-08-20 20:34:55 +03:00
alexey-milovidov
911946b517
Update TabSeparatedRowInputFormat.cpp 2020-08-20 20:32:49 +03:00
alexey-milovidov
6cf1a61735
Merge pull request #13841 from azat/unknown-packet-fix 
Unknown packet fix (for Protocol::Server::Log for distributed queries)
 2020-08-20 20:25:58 +03:00
alexey-milovidov
5e24329333
Merge pull request #13896 from azat/executeQuery-lambda-build-fix 
Fix gcc10 build by reducing storage of the lambdas in executeQuery
 2020-08-20 20:22:00 +03:00
alexey-milovidov
fb0e68f808
Merge pull request #12771 from arenadata/ADQM-109 
krb5 + cyrus-sasl + kerberized kafka
 2020-08-20 20:13:01 +03:00
Artem Zuikov
911e6efe3e rewrite duplicate distinct optimization 2020-08-20 20:04:42 +03:00
Nikolai Kochetov
7c0fcb2039
Merge pull request #13611 from ClickHouse/array-join-processor 
Refactor ARRAY JOIN
 2020-08-20 17:56:37 +03:00
zhang2014
45cc0778a0 ISSUES-4006 support scale with parserDateTime 2020-08-20 22:41:13 +08:00
Alexander Tokmakov
dd4b8b9663 fix lock order inversion when renaming distributed table 2020-08-20 16:36:22 +03:00
Amos Bird
333ec2e496
fix scalar subquery hash conflicts 2020-08-20 21:19:10 +08:00
Nikita Mikhailov
9a7849e1d7 Merge remote-tracking branch 'upstream/master' into cache-dictionary-bugfix 2020-08-20 14:59:48 +03:00
zhang2014
edeb983eb0 ISSUES-4006 some refactor 2020-08-20 19:18:29 +08:00
tao jiang
189c284597 fix if statement code style check 2020-08-20 18:42:14 +08:00
tao jiang
70ef84ee4b fix code style check 2020-08-20 18:06:41 +08:00
Nikolai Kochetov
d3fa5895fb Fix build. 2020-08-20 12:33:16 +03:00
Nikolai Kochetov
5928eab2c4
Fix lgamma race. (#13842) 
* Fix lgamma race.
 2020-08-20 12:27:29 +03:00
myrrc
d298409660 Merge remote-tracking branch 'upstream/master' into bug/low-cardinality-arrays-optimisations 2020-08-20 12:07:02 +03:00
Jiang Tao
613e3f7247 optimize error msg for null value 2020-08-20 11:25:28 +08:00
hcz
4d093e8e26 Fix type error 2020-08-20 10:50:34 +08:00
Nikolai Kochetov
b3791d7f6e Fix build. 2020-08-19 22:58:23 +03:00
Nikolai Kochetov
5cd4312529 Review fixes. 2020-08-19 22:33:49 +03:00
myrrc
4f96291c35 rewrote the LC spec as a dispatcher 2020-08-19 21:59:39 +03:00
Nikolai Kochetov
322cb241b9
Merge pull request #13887 from ClickHouse/fix-fixed-string-partial-sort 
Fix fixed string partial sort
 2020-08-19 21:41:25 +03:00
Azat Khuzhin
42dd661b6a Fix gcc10 build by reducing storage of the lambdas in executeQuery 
There is no need to capture query AST for the status_info_to_query_log,
since callers already captured it anyway.

gcc10 reports:
    ../src/Interpreters/executeQuery.cpp: In member function ‘void std::__1::function<_Rp(_ArgTypes ...)>::swap(std::__1::function<_Rp(_ArgTypes ...)>&) [with _Rp = void; _ArgTypes = {DB::IBlockInputStream*, DB::IBlockOutputStream*, DB::QueryPipeline*}]’:
    ../src/Interpreters/executeQuery.cpp:490:49: error: array subscript 35 is outside array bounds of ‘std::__1::aligned_storage<32, 16>::type [1]’ [-Werror=array-bounds]
      490 |             auto status_info_to_query_log = [ast](QueryLogElement &element, const QueryStatusInfo &info) mutable
          |                                                 ^
    In file included from ../contrib/libcxx/include/algorithm:644,
                     from ../contrib/libcxx/include/__string:57,
                     from ../contrib/libcxx/include/string_view:175,
                     from ../contrib/libcxx/include/string:504,
                     from ../src/Common/formatReadable.h:3,                                                                                                  from ../src/Interpreters/executeQuery.cpp:1:
    ../contrib/libcxx/include/functional:1877:60: note: while referencing ‘__tempbuf’
     1877 |             typename aligned_storage<sizeof(__buf_)>::type __tempbuf;
          |                                                            ^~~~~~~~~
 2020-08-19 21:25:28 +03:00
zhang2014
e44975df3b ISSUES-4006 try fix test failure 2020-08-19 23:39:36 +08:00
tavplubix
de3a6d78fc
Merge pull request #13822 from zhang2014/fix/materialize_integration_test 
ISSUES-4006 try fix materialize mysql database integration test
 2020-08-19 17:32:38 +03:00
Vitaly Baranov
fb5f98e800
Merge pull request #13863 from vitlibar/fix-handling-embedded-config 
Fix handling embedded config.
 2020-08-19 15:27:51 +03:00
Nikolai Kochetov
8ad82a38a8 Fix ColumnString::updatePermutationWithCollation. 2020-08-19 15:10:14 +03:00
Nikita Mikhaylov
21a50aab30
Merge branch 'master' into cache-dictionary-bugfix 2020-08-19 15:53:23 +04:00
Artem Zuikov
becc186c91
Add support for extended precision integers and decimals (#13097) 2020-08-19 14:52:17 +03:00
tavplubix
3b8ac01ed0
Merge pull request #13756 from ClickHouse/test-drop-database-race 
Fix race condition in DROP DATABASE
 2020-08-19 13:27:50 +03:00
alexey-milovidov
1a33f6d0b8
Merge pull request #13866 from ClickHouse/remove-useless-code-zkutil 
Remove useless code around zkutil
 2020-08-19 12:32:08 +03:00
Alexey Milovidov
5a00941303 Fix "Arcadia" 2020-08-19 12:31:28 +03:00
alexey-milovidov
6d72777b6e
Merge pull request #13868 from ClickHouse/stratify-array-compact-nan 
Stratify nans comparison in arrayCompact function
 2020-08-19 11:53:58 +03:00
hcz
4bbcec3d33 Add defaultValueOfTypeName 2020-08-19 14:44:11 +08:00
zhang2014
bdb20738e5 ISSUES-4006 compatible DateTime64 2020-08-19 13:19:36 +08:00
hexiaoting
e9be2f14ea fix implementation for \n separated lines 2020-08-19 11:50:43 +08:00
BohuTANG
26525a5eb1 Merge remote-tracking branch 'origin/master' into mysql_replica_gtid_issue_4006 2020-08-19 08:04:02 +08:00
myrrc
5ef5c889fd moved the LC stuff to its implementations (some bugs remaining) 2020-08-18 23:09:41 +03:00
alexey-milovidov
23ccb0b6be
Merge pull request #13677 from hagen1778/merge-tree-fail-fast-on-rows-limit 
[mergeTree]: fail fast if max_rows_to_read limit exceeded on parts scan
 2020-08-18 22:24:39 +03:00
Alexey Milovidov
acf312467e Stratify nans comparison in arrayCompact function 2020-08-18 22:16:53 +03:00
Alexey Milovidov
5c0a9648fb Remove even more useless code 2020-08-18 22:03:23 +03:00
Alexey Milovidov
eeb769d2d4 Remove useless code around zkutil 2020-08-18 22:02:07 +03:00
Alexander Tokmakov
e686616756 add exclusive DDLGuard for database 2020-08-18 18:15:27 +03:00
Vitaly Baranov
c800941ab7 Fix handling embedded config. 2020-08-18 18:08:50 +03:00
BohuTANG
30b8159bb0 ISSUES-4006 fix empty gtid format when sets parse 2020-08-18 23:01:21 +08:00
Mark Papadakis
734f57462b
Update PipelineExecutor.cpp 
Should have used back_edges instead of direct_edges
 2020-08-18 15:09:23 +03:00
Alexey Milovidov
9615b1f06a Generate ya.make 2020-08-18 12:46:02 +03:00
BohuTANG
a78604db2b ISSUES-4006 add constructor to initialize number member 2020-08-18 11:56:40 +08:00
hexiaoting
ddbfe0ce21 Deprecate ODBCDriver format 2020-08-18 11:29:40 +08:00
hexiaoting
0451d57293 Add new feature: LineAsString Format 2020-08-18 10:35:08 +08:00
BohuTANG
34975d1dd3 ISSUES-4006 try to fix PVS check error 2020-08-18 08:56:18 +08:00
myrrc
3337d206ba some bugs remaining 2020-08-18 01:55:41 +03:00
myrrc
69a0ca2564 checking other const approach 2020-08-18 01:43:20 +03:00
Azat Khuzhin
2e933a94a6 Handle Protocol::Server::Log in the RemoteQueryExecutor::finish() 
Even when finish() is called, there can be no EndOfStream sent, so it is
100% correct to handle Log packages there.

W/o fix in RemoteQueryExecutor:

    Code: 100, e.displayText() = DB::Exception: Unknown packet 10 from one of the following replicas: : While executing Remote (version 20.8.1.1) (from [::1]:56960) (in query: select * from remote('127.{2,3}', system.numbers) where number = 10 limit 1; ), Stack trace (when copying this message, always include the lines below):

    0. Common/StackTrace.cpp:291: StackTrace::tryCapture() @ 0x28b80a
    1. Common/StackTrace.cpp:256: StackTrace::StackTrace() @ 0x28b6ab
    2. Common/Exception.cpp:42: DB::Exception::Exception(std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, int) @ 0x2481ba
    3. Common/Exception.h:28: DB::Exception::Exception<>() @ 0x334d48
    4. DataStreams/RemoteQueryExecutor.cpp:288: DB::RemoteQueryExecutor::finish() @ 0x330314
    5. Processors/Sources/RemoteSource.cpp:46: DB::RemoteSource::generate() @ 0x6fce5
 2020-08-17 21:55:09 +03:00
Alexander Tokmakov
f5c14a0766 Merge branch 'master' into fix/materialize_integration_test 2020-08-17 21:47:53 +03:00
Azat Khuzhin
3c6a8ed7be Improve error message on unknown packet for distributed queries 
Although replica information is likely already empty (since it was
reseted due to error or disconnect), but let's keep it for now.
 2020-08-17 21:38:24 +03:00
Alexey Milovidov
ba4c42abfe Support UUID aliases in normalizeQuery 2020-08-17 21:17:20 +03:00
Artem Zuikov
bc6ddac52c one more unroll for arerage.cpp 2020-08-17 19:23:05 +03:00
BohuTANG
8c9236fefd ISSUES-4006 adapted GTID replication to Materialize MySQL 2020-08-17 22:12:41 +08:00
alexey-milovidov
abf3cb8746
Merge pull request #13816 from ClickHouse/normalize-query 
Add function "normalizeQuery"
 2020-08-17 16:23:24 +03:00
Vitaly Baranov
695c2aafba
Merge pull request #13425 from vitlibar/user-directories 
user_directories in the main config
 2020-08-17 15:49:24 +03:00
hexiaoting
405a6fb08f New feature: LineAsString format. #13630 2020-08-17 18:20:23 +08:00
zhang2014
ead3d34323 ISSUES-4006 try fix build 2020-08-17 18:11:50 +08:00
roman
35e28b4c6b [mergeTree]: make exception message more clear 2020-08-17 09:52:04 +01:00
BohuTANG
c3561cd7e8 ISSUES-4006 add BIT/SET field type support 2020-08-17 16:30:13 +08:00
BohuTANG
ee6ac28773 ISSUES-4006 fix up meta parse 2020-08-17 16:27:34 +08:00
Alexey Milovidov
59b8153506 Fix "Arcadia" and "Unbundled" builds 2020-08-17 11:20:20 +03:00
BohuTANG
6557e706c9 ISSUES-4006 fix special build check errors #4006 2020-08-17 16:01:18 +08:00
Javi Santana
ce64a73342 fixed tests and style 2020-08-17 09:46:38 +02:00
BohuTANG
adc6cce96e ISSUES-4006 fetch executed_gtid_set from replication position #4006 2020-08-17 15:38:09 +08:00
BohuTANG
a8465cfce6 ISSUES-4006 move MySQL command to the PacketsGeneric.h #4006 2020-08-17 15:27:35 +08:00
BohuTANG
cfc1fea619 ISSUES-4006 add startBinlogDumpGTID api for MySQLClient #4006 2020-08-17 15:21:20 +08:00
BohuTANG
059bf166ae ISSUES-4006 add GTID unit tests #4006 2020-08-17 14:45:43 +08:00
zhang2014
2cbc1df3ce ISSUES-4006 try fix bad integration test 2020-08-17 13:14:02 +08:00
BohuTANG
3ccc650995 ISSUES-4006 add position.Dump() #4006 2020-08-17 09:30:16 +08:00
BohuTANG
e90679707a ISSUES-4006 add MySQL replication GTIDEvent #4006 2020-08-17 09:23:54 +08:00