thevar1able/ClickHouse
1
0
Fork 0
mirror of https://github.com/ClickHouse/ClickHouse.git synced 2024-11-18 21:51:57 +00:00
Code Issues Packages Projects Releases Wiki Activity
48,654 Commits 9,131 Branches 1,778 Tags 2 GiB
e45edd57f2
Commit Graph

5625 Commits

Author SHA1 Message Date
Nikolai Kochetov
9a6b4b3355 Split has. 2020-09-16 16:49:09 +03:00
Nikolai Kochetov
ec6390231a Split has. 2020-09-16 16:43:36 +03:00
Nikolai Kochetov
0eff356c38 Split has. 2020-09-16 16:37:16 +03:00
Nikolai Kochetov
bc1031be9b Split has. 2020-09-16 16:33:28 +03:00
alesapin
cbe85327e2 Check stack size 2020-09-16 16:24:07 +03:00
Nikolai Kochetov
715b1a41ed Update arrayConcat 2020-09-16 16:14:46 +03:00
Nikolai Kochetov
2a2e369c6e Update arrayConcat 2020-09-16 16:11:42 +03:00
Nikolai Kochetov
d362ced0b5 Update arrayConcat 2020-09-16 16:09:32 +03:00
Nikolai Kochetov
e94b814606 Update arrayConcat 2020-09-16 16:07:32 +03:00
Vitaly Baranov
d99a011d07 Fix removing a live view after watching and after timeout has passed. 2020-09-16 15:53:58 +03:00
Amos Bird
3e576a29c9
explict column list in columns matcher (#14775) 2020-09-16 15:44:05 +03:00
tavplubix
28a6b7e622
Merge pull request #14831 from bharatnc/ncb/fix-timespec-construct 
construct query_start_time & query_start_time_microseconds from the same timespec
 2020-09-16 15:42:19 +03:00
Nikolai Kochetov
bbb89d10de Fix build. 2020-09-16 15:40:18 +03:00
Nikolai Kochetov
d36e84cde9 Fix build. 2020-09-16 15:36:54 +03:00
nikitamikhaylov
b33a5e0d14 done 2020-09-16 15:32:33 +03:00
Nikolai Kochetov
e9de8c8875 Fix build. 2020-09-16 15:21:26 +03:00
Nikolai Kochetov
b31ce6a536 Fix build. 2020-09-16 15:19:00 +03:00
Nikolai Kochetov
589fd67146 Fix build. 2020-09-16 15:15:14 +03:00
Nikolai Kochetov
4079a7f319 Fix build. 2020-09-16 15:13:34 +03:00
Nikolai Kochetov
dcb52c1d1d Fix build. 2020-09-16 15:05:24 +03:00
Nikolai Kochetov
5acf73d873 Fix build. 2020-09-16 15:00:34 +03:00
Nikolai Kochetov
675b2c44af Fix build. 2020-09-16 14:56:37 +03:00
Nikolai Kochetov
8bc45c9d42 Fix build. 2020-09-16 14:49:59 +03:00
Nikolai Kochetov
0800ceab5a Fix build. 2020-09-16 14:39:42 +03:00
Nikolai Kochetov
9a92e5eabb Fix build. 2020-09-16 14:33:29 +03:00
Nikolai Kochetov
22e3d471b6 Fix build. 2020-09-16 14:29:43 +03:00
Nikolai Kochetov
6c6e0a88c6 Fix build. 2020-09-16 14:22:08 +03:00
Nikolai Kochetov
b6756472d7 Merge branch 'master' into test-gather-utils-build-time 2020-09-16 14:11:27 +03:00
Nikolai Kochetov
85698e04fa Update slice for arrays. 2020-09-16 13:57:23 +03:00
Nikolai Kochetov
8be45dd3cc Update QueryPipeline::addDelayingPipeline 2020-09-16 13:25:01 +03:00
Nikolai Kochetov
9e00fb44b5 Update creating sink. 2020-09-16 13:18:28 +03:00
Alexander Kuzmenkov
da2a3fffe8 fixup 2020-09-16 13:00:15 +03:00
Amos Bird
38d53c38f6
Explicit define what first replica is. 2020-09-16 17:54:41 +08:00
alesapin
18398c1510 Fix style 2020-09-16 12:08:39 +03:00
Alexander Kuzmenkov
bcea99f2e5
Update ThreadPool.cpp 2020-09-16 11:59:58 +03:00
Nikolai Kochetov
a8e671f015 Fix MutationsInterpreter. 2020-09-16 11:58:27 +03:00
alesapin
78cb39ff92
Update ICompressionCodec.h 2020-09-16 11:21:39 +03:00
alesapin
af8ed46261
Update CompressionCodecGorilla.cpp 2020-09-16 11:20:39 +03:00
alesapin
cf45eb1545
Update CompressionCodecDoubleDelta.cpp 2020-09-16 11:20:22 +03:00
alesapin
e3299d9249
Update CompressionCodecMultiple.cpp 2020-09-16 11:19:59 +03:00
alesapin
da386990fe
Update ICompressionCodec.cpp 2020-09-16 11:18:42 +03:00
alesapin
97baa67f2b
Merge pull request #14839 from Jokser/distributed-storage-multiple-volumes 
Don't throw exception if Distributed storage has multi-volume storage policy configuration
 2020-09-16 10:13:14 +03:00
zhang2014
9246e77b05 Remove CHECKSUM_CRC32_SIGNATURE_LENGTH in mysql event parser 2020-09-16 15:05:44 +08:00
alesapin
74c0b6eb76
Update CompressionCodecGorilla.cpp 2020-09-16 10:00:41 +03:00
zhang2014
172bc46c63 Fix format and dryrun event parse failure 2020-09-16 14:52:59 +08:00
zhang2014
85e990f518 Fix code style 2020-09-16 11:30:14 +08:00
zhang2014
9100dcd37a fix build and test failure 2020-09-16 11:13:17 +08:00
Azat Khuzhin
a35c1f8ed0 Do not check client's host when user comes from interserver secret 2020-09-16 00:35:49 +03:00
myrrc
29ac26f0f2 separated ch parts table 2020-09-16 00:12:37 +03:00
Nikolai Kochetov
13edfeea1f Fix build. 2020-09-15 20:23:49 +03:00
Nikolai Kochetov
3cc89d467c Merge branch 'master' into query-plan-for-creating-sets 2020-09-15 20:15:41 +03:00
Nikolai Kochetov
118a8a513e Update mutations interpreter. 2020-09-15 20:13:13 +03:00
Alexander Kuzmenkov
5afb19faf1
Update ThreadPool.cpp 2020-09-15 19:58:09 +03:00
bharatnc
dc765b77e7 Use std::chrono instead of clock_gettime 2020-09-15 09:37:32 -07:00
Nikolai Kochetov
e29f27e333
Merge pull request #14815 from ClickHouse/storage-read-query-plan 
Return query plan from storage.
 2020-09-15 18:34:11 +03:00
zhang2014
0c06ccc35e Fix parse error packet on event 2020-09-15 23:26:13 +08:00
Vitaly Baranov
74d5b43fe6
Merge pull request #14828 from vitlibar/change-columns-of-system-user-directories 
Add 'params' column to system.user_directories table.
 2020-09-15 18:25:50 +03:00
Alexander Kuzmenkov
a792850ecd
Update ThreadPool.cpp 2020-09-15 18:05:42 +03:00
zhang2014
30352f096d Init buffer in constructor 2020-09-15 22:59:21 +08:00
zhang2014
9c329996ff Revert param name in header file 2020-09-15 22:56:57 +08:00
Alexander Kazakov
7465e00163 Optimized marks selection algorithm for continuous marks ranges 2020-09-15 17:22:32 +03:00
zhang2014
fb92c56beb Fix bad and nice buffer size 2020-09-15 22:22:23 +08:00
zhang2014
84c68947b9 Add test for MySQLBinlogReadBuffer 2020-09-15 22:07:03 +08:00
Nikolai Kochetov
69b02c7500 Remove space. 2020-09-15 16:35:04 +03:00
alesapin
e20c54998c Better exception on non physical columns 2020-09-15 16:29:11 +03:00
Nikolai Kochetov
4c783f19ee Use QueryPlan for SubqueryForSet. 2020-09-15 16:25:14 +03:00
Anton Popov
3e855daefd Merge remote-tracking branch 'upstream/master' into HEAD 2020-09-15 15:31:29 +03:00
Alexander Kuzmenkov
b1741dd87e Merge remote-tracking branch 'origin/master' into HEAD 2020-09-15 15:30:26 +03:00
zhang2014
c517df0b1a Merge branch 'master' into fix/mysql_protocol_parser 2020-09-15 20:29:27 +08:00
zhang2014
106e05ab2f Try fix mysql protocol parse failure 2020-09-15 20:28:42 +08:00
alexey-milovidov
018f596d21
Merge pull request #14685 from ClickHouse/remap-executable 
Attempt to make performance test more reliable
 2020-09-15 15:09:47 +03:00
alesapin
8828a78174 Fix alias on default columns 2020-09-15 14:17:58 +03:00
Alexander Kuzmenkov
3399028de2 Merge remote-tracking branch 'origin/master' into HEAD 2020-09-15 13:55:12 +03:00
Nikolai Kochetov
6eac433c55 Review fixes. 2020-09-15 13:40:39 +03:00
Artem Zuikov
1ba67ea8a1
Improve DecimalBinaryOperation specializations (#14743) 2020-09-15 13:31:15 +03:00
Alexander Kuzmenkov
d943bac1a4 Exception on double init of global thread pool 2020-09-15 13:30:16 +03:00
hexiaoting
023daddbea Fix bug for LineAsString Format 2020-09-15 18:13:39 +08:00
Nikolai Kochetov
dd4d5bc931 Fix build 2020-09-15 13:10:41 +03:00
Artem Zuikov
51ba12c2c3
Try speedup build (#14809) 2020-09-15 12:55:57 +03:00
Nikolai Kochetov
c1f61984e5
Merge pull request #14513 from amosbird/mf1 
Binary operator monotonicity
 2020-09-15 12:45:23 +03:00
Pavel Kovalenko
01ab28a182 Don't throw exception if Distributed storage has multi-volume storage policy configuration. 2020-09-15 12:26:56 +03:00
Nikolai Kochetov
8c2aa7ce8c Added comment. 2020-09-15 12:22:45 +03:00
tavplubix
1d8ee50769
Merge pull request #14628 from ClickHouse/enable_some_tests_with_database_atomic 
Enable more tests with Atomic database
 2020-09-15 12:13:40 +03:00
Nikolai Kochetov
fe9c451966 Fix build. 2020-09-15 10:20:34 +03:00
alesapin
6f8da7dfdf Merge branch 'master' into fix_compression_codec_perf 2020-09-15 09:59:45 +03:00
Nikolai Kochetov
2e7da0e2f9 Fix build. 2020-09-15 09:56:49 +03:00
Nikolai Kochetov
c044c040a8 Fix build. 2020-09-15 09:53:14 +03:00
alesapin
a75254766e
Merge pull request #14609 from ClickHouse/update_to_gcc_10 
Update default build to gcc-10
 2020-09-15 09:49:43 +03:00
bharatnc
e4e3105014 Construct query_start_time(_microseconds) from same timespec 2020-09-14 20:04:16 -07:00
Nikolai Kochetov
95ae1105d9 Remove virtual destructors for Visitor. 2020-09-15 02:05:43 +03:00
Vitaly Baranov
0f53b449fd Add 'params' column to system.user_directories table. 2020-09-15 01:51:53 +03:00
Azat Khuzhin
85b63ecadf Bump revision manually (to make it compatible with other version from this tag) 
As @alexey-milovidov wrote.

P.S. I did not use ./utils/release/release_lib.sh (via ./release), since
it is pretty complex (it fetches tags and so on)

The following macros has been updated:
- VERSION_REVISION -- usually bumped with utils/release/release_lib.sh
  (interesting that even if there were no changes)
- DBMS_MIN_REVISION_WITH_INTERSERVER_SECRET
- DBMS_TCP_PROTOCOL_VERSION -- does not affect anything, some internal
  yandex stuff
 2020-09-15 01:36:28 +03:00
Azat Khuzhin
3fb548b3bb Cluster: use boost::range::remove_erase() over std::erase (c++20) 
@vitlibar:

  "Yandex synchronization check says

  src/Interpreters/Cluster.cpp:299:10: error: no member named 'erase' in namespace 'std'
      std::erase(config_keys, "secret");
      ~~~~~^
  1 error generated.
  Please replace std::erase with boost::range::remove_erase."

  "That's quite an unusual build which links ClickHouse with a lot of closed source code and which still can't use most of C++20 features."
 2020-09-15 01:36:28 +03:00
Azat Khuzhin
785d1b2a75 OpenSSLHelpers cleanup 
Add few more specializations for encodeSHA256():
- std::string encodeSHA256(const std::string_view &);
- std::string encodeSHA256(const void *, size_t);
- void encodeSHA256(const void *, size_t, unsigned char *);
 2020-09-15 01:36:28 +03:00
Azat Khuzhin
0159c74f21 Secure inter-cluster query execution (with initial_user as current query user) [v3] 
Add inter-server cluster secret, it is used for Distributed queries
inside cluster, you can configure in the configuration file:

  <remote_servers>
      <logs>
          <shard>
              <secret>foobar</secret> <!-- empty -- works as before -->
              ...
          </shard>
      </logs>
  </remote_servers>

And this will allow clickhouse to make sure that the query was not
faked, and was issued from the node that knows the secret. And since
trust appeared it can use initial_user for query execution, this will
apply correct *_for_user (since with inter-server secret enabled, the
query will be executed from the same user on the shards as on initator,
unlike "default" user w/o it).

v2: Change user to the initial_user for Distributed queries if secret match
v3: Add Protocol::Cluster package
v4: Drop Protocol::Cluster and use plain Protocol::Hello + user marker
v5: Do not use user from Hello for cluster-secure (superfluous)
 2020-09-15 01:36:28 +03:00
Azat Khuzhin
ec9d7745f3 Break the query loop on UNEXPECTED_PACKET_FROM_CLIENT 2020-09-15 01:36:28 +03:00
Azat Khuzhin
d53bbd3394 Not only send the exception to the client but also log it 
Otherwise there will be only tricky "Unknown packet" exception after
exception during handling INSERT queries.
 2020-09-15 01:36:28 +03:00
Nikolai Kochetov
65a1057aae Revert "Try simplify Visitor." 
This reverts commit 9fcfa560ae.
 2020-09-15 00:40:41 +03:00
Nikolai Kochetov
31660ddb4d Fix build 2020-09-15 00:30:55 +03:00
Alexey Milovidov
b676733b53 Merge branch 'master' into remove-header 2020-09-15 00:18:30 +03:00
Nikolai Kochetov
1b618fd130 Fix build 2020-09-14 23:56:56 +03:00
Nikolai Kochetov
9fcfa560ae Try simplify Visitor. 2020-09-14 23:35:45 +03:00
Nikolai Kochetov
45098f7112 Fix build. 2020-09-14 23:32:38 +03:00
Alexander Tokmakov
da6beb1a91 Merge branch 'master' into enable_some_tests_with_database_atomic 2020-09-14 23:00:14 +03:00
Nikolai Kochetov
d09422e60f Fix build. 2020-09-14 22:49:46 +03:00
alesapin
e96256d367 Trying to improve performance 2020-09-14 22:15:25 +03:00
Nikolai Kochetov
d418ee48a4
Merge pull request #14783 from amosbird/fix3 
Fix signedness conversion monotonicity
 2020-09-14 21:40:51 +03:00
Nikita Mikhaylov
ddea62211d
Merge pull request #11948 from CurtizJ/fsync-parts 
Experiment. Allow to turn on fsync on inserts, merges and fetches.
 2020-09-14 22:37:14 +04:00
Alexey Milovidov
3530f83c01 Remove debug output 2020-09-14 21:12:09 +03:00
Alexey Milovidov
f9361acb88 Disable in shared libraries mode 2020-09-14 21:00:45 +03:00
Alexey Milovidov
0e73b8acf3 Merge branch 'master' into remap-executable 2020-09-14 20:26:16 +03:00
Alexey Milovidov
038ae02126 Fix for #14761, part 2 2020-09-14 20:24:55 +03:00
Nikolai Kochetov
d4542a352c GatherUtils visibility. 2020-09-14 19:40:04 +03:00
Nikolai Kochetov
08d4e96529 GatherUtils visibility. 2020-09-14 19:37:35 +03:00
Ildus Kurbangaliev
67b49862d9
Add mapPopulateSeries function (#13166) 2020-09-14 19:11:50 +03:00
Nikolai Kochetov
c05021abc7 Inline GatherUtils algorithms. 2020-09-14 18:11:15 +03:00
Nikolai Kochetov
d2cd2775eb Inline GatherUtils algorithms. 2020-09-14 17:44:08 +03:00
Nikolai Kochetov
765c8604c9 Inline GatherUtils algorithms. 2020-09-14 17:35:57 +03:00
Nikolai Kochetov
bcfc83022a Return query plan from storage. 2020-09-14 17:13:58 +03:00
Alexey Milovidov
b5620018ca Fix for #14761 2020-09-14 17:02:24 +03:00
alexey-milovidov
752e3f8197
Merge pull request #14453 from amosbird/apply2 
column transformers in insert select
 2020-09-14 16:46:01 +03:00
alexey-milovidov
882206c0b6
Update InterpreterInsertQuery.cpp 2020-09-14 16:45:32 +03:00
Alexey Milovidov
3795dfed14 Remove one header 2020-09-14 16:34:44 +03:00
Alexey Milovidov
b966697939 Style 2020-09-14 16:31:30 +03:00
nikitamikhaylov
2bffefae1a typo 2020-09-14 16:30:44 +03:00
nikitamikhaylov
5697f6d926 style fix 2020-09-14 16:14:18 +03:00
Artem Zuikov
d274125c74
Fix wide integer left shift + refactoring (#14697) 2020-09-14 14:56:43 +03:00
Vxider
a913be9201 add table function null 2020-09-14 19:36:14 +08:00
Amos Bird
004b91511d
Fix wrong code 2020-09-14 18:16:22 +08:00
Amos Bird
5998570762
Fix signedness conversion monotonicity 2020-09-14 18:12:41 +08:00
Amos Bird
654245af3c
Fix signedness conversion monotonicity 2020-09-14 18:11:40 +08:00
alesapin
06575970aa
Merge pull request #14705 from amosbird/misc1 
Add merge_algorithm to system.merges
 2020-09-14 09:58:30 +03:00
alesapin
336430d3c2
Merge pull request #14646 from ClickHouse/if_bug 
Fix bug in if function when then clause contain const nullable column
 2020-09-14 09:51:40 +03:00
Nikolai Kochetov
109fd9d6d7
Merge pull request #13015 from amosbird/jgmko 
Refactor joinGet and implement multi-key lookup.
 2020-09-13 22:39:48 +03:00
Amos Bird
5cc8fd395c
Fix empty key segfault 2020-09-13 21:55:16 +08:00
Amos Bird
72786c8130
Take arithmetic overflow into consideration 2020-09-13 21:55:16 +08:00
Amos Bird
34b9547ce1
Binary operator monotonicity 2020-09-13 21:55:12 +08:00
Amos Bird
016f707ea1
column transformers in insert select 2020-09-13 10:21:13 +08:00
Amos Bird
c2d79bc5cc
Add merge_algorithm to system.merges 2020-09-13 10:00:03 +08:00
Amos Bird
882b2a3348
CTE 2020-09-13 09:39:17 +08:00
alexey-milovidov
c2f762e20a
Merge pull request #14748 from vitlibar/skip-access-storages-with-same-path 
Skip access storages with same path while reading the main config.
 2020-09-12 14:20:02 +03:00
alexey-milovidov
c87f50bc4b
Merge pull request #14761 from zhang2014/fix/osx_build 
Fix build failure in OSX
 2020-09-12 14:15:17 +03:00
alexey-milovidov
1c2ca4e773
Merge pull request #14734 from amosbird/bugfix1 
Fix missing clone in replace column transformer
 2020-09-12 09:54:00 +03:00
zhang2014
5b952a369b Fix build failure in OSX 2020-09-12 12:07:02 +08:00
alexey-milovidov
cc3d1a3922
Merge pull request #14471 from ClickHouse/git-to-clickhouse 
Added a script to import git repository to ClickHouse
 2020-09-12 03:56:31 +03:00
Azat Khuzhin
dd867b787f Allow parallel execution of distributed DDL 
Add distributed_ddl.pool_size to control maximum parallel to handle
distributed DDL.

Also:
- convert Exception constructors to fmt-like
- use sleepFor* over std::this_thread::sleep_for()
 2020-09-12 02:32:08 +03:00
Vitaly Baranov
70b0fe88b1
Merge pull request #14604 from vitlibar/no-detach-threads-2 
Use join() instead of detach() for threads #2
 2020-09-12 02:07:46 +03:00
Vitaly Baranov
5e3260678c
Merge pull request #14561 from vitlibar/no-detach-threads 
Use join() instead of detach() for threads
 2020-09-12 02:04:08 +03:00
Vitaly Baranov
e2c2a679ef Skip access storages with same path while reading the main config. 2020-09-12 01:34:46 +03:00
alesapin
2c4047b280 Revert accident changes 2020-09-11 20:07:00 +03:00
alesapin
6dd75182f0 Better 2020-09-11 20:04:55 +03:00
alesapin
a4c43e51b9 Add a test 2020-09-11 20:04:55 +03:00
alesapin
a5f8899874 First implementation 2020-09-11 20:04:55 +03:00
alesapin
489b9c80ac Starting steps 2020-09-11 20:04:55 +03:00
alesapin
d9394fbf66 Fix code 2020-09-11 18:51:08 +03:00
Artem Zuikov
6dd764bcfe
FunctionBinaryArithmetic refactoring (#14712) 2020-09-11 18:12:08 +03:00
Anton Popov
a64331d79f fix syncing of WAL 2020-09-11 16:09:26 +03:00
Nikita Mikhaylov
26742a3c81
Merge pull request #14703 from nikitamikhaylov/format-line-as-string 
Merging #13846 (Format LineAsString)
 2020-09-11 16:45:57 +04:00
Nikita Mikhaylov
468089a4cd
Merge pull request #14514 from bharatnc/ncb/event_time_microseconds_metric_logs 
add event_time_microseconds field to asynchronous_metric_log & metric_log system tables
 2020-09-11 16:14:00 +04:00
tavplubix
92eb58b555
Merge pull request #14696 from BohuTANG/mysql_replication_tablemapevent 
Fix mysql replication optional metadata ignore
 2020-09-11 15:09:55 +03:00
alesapin
5ce0c21bbe Remove redundant change 2020-09-11 14:24:42 +03:00
alesapin
ebb9de1376 Supress strange warning 2020-09-11 14:13:41 +03:00
alesapin
c36192db23 Remove diff 2020-09-11 13:54:03 +03:00
alesapin
e25b1da29f Disable -Wstringop-overflow for gcc-10 2020-09-11 13:53:26 +03:00
alesapin
c202ce8e63 Merge branch 'master' into update_to_gcc_10 2020-09-11 12:50:10 +03:00
tavplubix
1f47b1ff6b
Merge pull request #14704 from ClickHouse/fix_misleading_message_uuid_macro 
Fix misleading exception message about uuid macro
 2020-09-11 12:45:32 +03:00
alesapin
3b9ab3f1be Fix if 2020-09-11 12:23:31 +03:00
alexey-milovidov
e73ca17ad3
Merge pull request #14725 from BooBSD/formatReadableQuantity 
formatReadableQuantity() function
 2020-09-11 12:09:18 +03:00
alesapin
902624cb7b Merge branch 'master' into if_bug 2020-09-11 10:54:32 +03:00
Amos Bird
da2bb4e0d3
Fix missing clone in replace column transformer 2020-09-11 15:50:25 +08:00
BohuTANG
2873777857 Ignore unprocessed replication payload 2020-09-11 12:54:53 +08:00
BohuTANG
faa394b27c Merge remote-tracking branch 'origin/master' into mysql_replication_tablemapevent 2020-09-11 08:49:17 +08:00
Anton Popov
f2a5216e97 add waiting for fsync in WAL 2020-09-11 02:28:50 +03:00
Anton Popov
af4089c606 Merge remote-tracking branch 'upstream/master' into HEAD 2020-09-11 00:39:21 +03:00
alexey-milovidov
f21cf98960
Merge pull request #14657 from myrrc/feature/disable-debug-symbols-cmake-option 
Extracted the debug info generation for functions into a cmake option
 2020-09-10 21:04:15 +03:00
Alexey Milovidov
5675efbd47 Fix build 2020-09-10 20:16:12 +03:00
nikitamikhaylov
d0c259974d style check 2020-09-10 19:35:18 +03:00
Artem Hnilov
15bdb6048e Function formatReadableQuantity() added. 2020-09-10 16:25:07 +00:00
tavplubix
4581e3a18a
Merge pull request #14563 from bharatnc/ncb/zk-conn-fail-do-cleanup 
ReplicatedMergeTree - cleanup data directory after Zookeeper exceptions
 2020-09-10 19:19:57 +03:00
bharatnc
3b3b7bd5e7 minor changes to comment 2020-09-10 09:09:48 -07:00
tavplubix
a6c9dd0465
Merge pull request #14664 from ClickHouse/fix_missed_database_when_altering_mv 
Fix missed database name when altering MaterializedView
 2020-09-10 17:55:31 +03:00
Alexander Tokmakov
f19f02028b fix misleading exception message about uuid macro 2020-09-10 17:50:10 +03:00
Alexey Milovidov
65e9c678f8 Disable under certain conditions 2020-09-10 17:47:02 +03:00
Nikita Mikhaylov
a39ba57e8c
Merge branch 'master' into dev-nf 2020-09-10 18:10:47 +04:00
Nikita Mikhaylov
f0a65522cc
Merge pull request #14333 from hczhcz/patch-0901 
Add JSONStrings formats
 2020-09-10 17:54:42 +04:00
myrrc
e008198023 fix: default value 2020-09-10 15:44:49 +03:00
BohuTANG
00b8d91eb8 Fix mysql replication TableMapEvent optional metadata ignore 2020-09-10 19:46:59 +08:00
Nikolai Kochetov
7b50341dcc
Merge pull request #14683 from ClickHouse/fix-totals-for-accumulating 
Try fix totals port for IAccumulatingTransform.
 2020-09-10 14:46:49 +03:00
myrrc
598c81ed0a fix: default value 2020-09-10 14:07:08 +03:00
myrrc
c309f55c20 updated setting and added default value 2020-09-10 14:02:52 +03:00
Alexander Tokmakov
20b3823770 do not remove directory on attach 2020-09-10 13:21:13 +03:00
Alexander Kuzmenkov
223fc4d1e7 Avoid error while building the report on broken perf tests 2020-09-10 12:59:10 +03:00
zhang2014
5b3e9eaaf0 Merge branch 'master' into fix/datetime 2020-09-10 17:26:26 +08:00
Alexey Milovidov
532d121100 Fix typo 2020-09-10 12:14:31 +03:00
Alexey Milovidov
a644733139 Attempt to make performance test more reliable 2020-09-10 12:05:57 +03:00
Nikolai Kochetov
7fb45461d1 Try fix totals port for IAccumulatingTransform. 2020-09-10 10:36:29 +03:00
zhang2014
fea763bb75 ISSUES-4006 support decimal 256 for mysql block input stream 2020-09-10 11:37:00 +08:00
alexey-milovidov
e65e29d537
Merge pull request #14647 from fastio/master 
Add QueryMemoryLimitExceeded event
 2020-09-10 06:12:39 +03:00
alexey-milovidov
92b746116a
Merge pull request #14655 from ClickHouse/nested-multiline-comments 
Support for nested multiline comments
 2020-09-10 06:10:31 +03:00
hexiaoting
a173a863a8 fix style error 2020-09-10 11:03:35 +08:00
Anton Popov
b9bf67b6ac allow to randomize part type in MergeTree 2020-09-10 04:27:36 +03:00
bharatnc
05a80518a1 Merge remote-tracking branch 'upstream/master' into ncb/event_time_microseconds_metric_logs 2020-09-09 17:58:29 -07:00
Anton Popov
d1c35dc794 Merge remote-tracking branch 'upstream/master' into HEAD 2020-09-10 03:13:08 +03:00
Alexander Tokmakov
7080d56470 fix missed database name when altering mv 2020-09-09 22:59:34 +03:00
alesapin
b8a2c1d2a2 Push pragma only for new gcc 2020-09-09 22:45:37 +03:00
Vitaly Baranov
2a9ab48279 Use join() instead of detach() for the no_users_thread in StorageLiveView. 2020-09-09 22:39:27 +03:00
Nikita Mikhaylov
44726c37c3
Merge branch 'master' into fix-executable-dictionary-source-hangup 2020-09-09 23:01:41 +04:00
alexey-milovidov
f60267a383
Merge pull request #14611 from amosbird/bf2 
Treat query as function argument.
 2020-09-09 21:20:33 +03:00
myrrc
11ffbda7cc added the debugger info option 2020-09-09 21:17:01 +03:00
alexey-milovidov
453914b6b8
Update ProfileEvents.cpp 2020-09-09 21:02:53 +03:00
Alexey Milovidov
7304bad56f Support for nested multiline comments 2020-09-09 20:51:05 +03:00
Ilya Yatsishin
594ce8ea66
Merge pull request #14636 from mcheshkov/use-global-addincl-for-icu 
Use global ICU ADDINCL for Arcadia build
 2020-09-09 20:50:52 +03:00
Alexander Tokmakov
dee1fefeb4 add more tests 2020-09-09 20:39:49 +03:00
Peng Jian
9fa04cf48b Add QueryMemoryLimitExceeded event 2020-09-10 00:59:38 +08:00
alesapin
62428845a0 Bug in mutation 2020-09-09 19:47:06 +03:00
bharatnc
fe6d6f16ea Merge remote-tracking branch 'upstream/master' into ncb/zk-conn-fail-do-cleanup 2020-09-09 09:25:34 -07:00
alexey-milovidov
38131917ef
Merge pull request #14530 from amosbird/ma 
Fix Nullable String to Enum conversion.
 2020-09-09 19:24:04 +03:00
alexey-milovidov
c6d0944994
Merge pull request #14591 from myrrc/bugfix/lc-nullability-checker 
Correct nullability checker for LowCardinality nested columns
 2020-09-09 19:23:19 +03:00
alexey-milovidov
a6a0d4966c
Merge pull request #14595 from azat/query-format-trailing-whitespace 
Fix some trailing whitespaces in query format (ExpressionList users)
 2020-09-09 19:22:55 +03:00
zhang2014
094897fe69 Merge branch 'master' into fix/datetime 2020-09-09 23:37:54 +08:00
Mikhail Cheshkov
673244876e Use global ICU ADDINCL for Arcadia build 2020-09-09 18:01:52 +03:00
alesapin
bd14c79b0b
Merge pull request #14494 from ClickHouse/recompression_in_background 
Recompression TTL
 2020-09-09 17:46:01 +03:00
alesapin
50dee3f449 Remove false-positive warning 2020-09-09 17:43:17 +03:00
nikitamikhaylov
751e410915 better[3] 2020-09-09 17:11:08 +03:00
Alexander Tokmakov
b68782d285 enable more tests with Atomic database 2020-09-09 16:32:50 +03:00
Artem Zuikov
48f29ae11f
Fix bug in Decimal scale (#14603) 2020-09-09 16:18:58 +03:00
myrrc
a8f5d9e70f added the test and comment 2020-09-09 15:52:44 +03:00
Nikita Mikhaylov
ead6bfe05c better[2] 2020-09-09 15:42:56 +03:00
Nikita Mikhaylov
f04d67b688 better 2020-09-09 15:41:51 +03:00
Nikita Mikhaylov
530057e79f update all columns 2020-09-09 15:27:05 +03:00
Vasily Nemkov
3973a17530
MySql datatypes dateTime64 and decimal (#11512) 2020-09-09 15:18:02 +03:00
Nikita Mikhaylov
c03a9487ca another test + fix 2020-09-09 14:55:20 +03:00
Artem Zuikov
36972d34a7
Fix logical error in GLOBAL JOIN with table function (#14545) 2020-09-09 13:03:13 +03:00
Winter Zhang
3d1d64ec60
Fix currentDatabase function cannot be used in ON CLUSTER ddl query. (#14211) 2020-09-09 12:58:59 +03:00
Anton Popov
32135d96f9
Merge pull request #12183 from CurtizJ/polymorphic-parts-2 
Support codecs in compact parts
 2020-09-09 12:34:13 +03:00
alesapin
485b104898 Use max ttl and add introspection to system parts about recompression 2020-09-09 12:15:42 +03:00
hcz
d8fce448a2 Implement null_as_default for JSONStrings formats 2020-09-09 15:47:32 +08:00
Amos Bird
b40998ca00
Treat query as function argument. 2020-09-09 15:41:38 +08:00
alesapin
a696cf12f6 Merge branch 'master' into recompression_in_background 2020-09-09 10:12:03 +03:00
alexey-milovidov
91edd2bba1
Merge branch 'master' into bugfix/lc-nullability-checker 2020-09-09 09:50:39 +03:00
bharatnc
f37814b367 Merge remote-tracking branch 'upstream/master' into ncb/zk-conn-fail-do-cleanup 2020-09-08 23:45:20 -07:00
alexey-milovidov
cf22527de0
Merge pull request #14590 from ClickHouse/remove-useless-lc-code 
Remove useless line.
 2020-09-09 09:39:07 +03:00
alexey-milovidov
0c2ecb53d1
Update arrayIndex.h 2020-09-09 09:35:05 +03:00
hexiaoting
406f384a45 support ILIKE, and separate like,limit function. 2020-09-09 11:24:47 +08:00
Vitaly Baranov
cce970e40c Use join() instead of detach() for loading threads in ExternalLoader. 2020-09-09 03:19:13 +03:00
Vitaly Baranov
bee629c971 Use join() instead of detach() for the lists_writing_thread in DiskAccessStorage. 2020-09-09 03:19:13 +03:00
Pavel Kovalenko
3632b0bdb3
Add option to DiskS3 that allows it's usage if S3 unavailable (#14497) 2020-09-09 02:35:57 +03:00
Azat Khuzhin
014c7c02bd Fix some trailing whitespaces in query format 
The following statements still has the trailing whitespace:
- WITH
- SELECT
- SELECT DISTINCT
- ARRAY JOIN
- GROUP BY
- ORDER BY
- LIMIT BY
 2020-09-09 01:36:21 +03:00
alexey-milovidov
f2e9a09b11
Merge pull request #14585 from ClickHouse/join-processor 
Remove Join from ExpressionActions
 2020-09-08 23:56:09 +03:00
alexey-milovidov
1e300d9119
Merge pull request #14562 from CurtizJ/fix-fuzz 
Fix segfault in combinator -Resample
 2020-09-08 23:53:14 +03:00
alexey-milovidov
292b0a02f2
Merge pull request #14586 from Avogar/Custom-null-representation-in-TCV 
Custom null representation in tsv
 2020-09-08 23:42:44 +03:00
Nikita Mikhaylov
614e01b0e4 better 2020-09-08 23:12:55 +03:00
myrrc
78eac658b0 adding correct LC nested nullability checker 2020-09-08 22:51:44 +03:00
Nikolai Kochetov
fe0507663b Remove useless line. 2020-09-08 22:40:22 +03:00
alexey-milovidov
a5499ab9d6
Merge pull request #14555 from 4ertus2/some 
Hide symbols in nameless namespace
 2020-09-08 19:55:56 +03:00
Anton Popov
a419267dc6 minor fixes 2020-09-08 19:28:49 +03:00
nikitamikhaylov
c4f0465a7c limit 2020-09-08 18:54:30 +03:00
robot-clickhouse
8def718661 Auto version update to [20.10.1.1] [54440] 2020-09-08 17:04:41 +03:00
Alexey Milovidov
a687bdb370 Merge branch 'Custom-null-representation-in-TCV' of https://github.com/Avogar/ClickHouse into Avogar-Custom-null-representation-in-TCV 2020-09-08 15:51:00 +03:00
Kruglov Pavel
902ac5c33f
Change setting description 2020-09-08 15:49:57 +03:00
Alexey Milovidov
b460c67a4f Merge branch 'Custom-null-representation-in-TCV' of https://github.com/Avogar/ClickHouse into Avogar-Custom-null-representation-in-TCV 2020-09-08 15:47:10 +03:00
Kruglov Pavel
401b0e5ebb
Fix mistake 2 2020-09-08 15:47:02 +03:00
Alexey Milovidov
843b51bbb5 Merge branch 'Custom-null-representation-in-TCV' of https://github.com/Avogar/ClickHouse into Avogar-Custom-null-representation-in-TCV 2020-09-08 15:45:38 +03:00
alesapin
f0f7f2b5d2 Merge branch 'master' into recompression_in_background 2020-09-08 15:43:37 +03:00
alesapin
6ad91d1018
Merge pull request #14490 from ClickHouse/control_ttl_merges_in_pool 
Control ttl merges in pool
 2020-09-08 15:42:20 +03:00
Kruglov Pavel
70be9b152c
Add custom null representation in tsv 2020-09-08 15:39:24 +03:00
Kruglov Pavel
0e8946eb9f
Fix mistake 2020-09-08 15:38:11 +03:00
Kruglov Pavel
cce3f3fe4e
Change setting name 2020-09-08 15:37:18 +03:00
Kruglov Pavel
563f1486e6
Add output_tsv_null_representation 2020-09-08 15:36:11 +03:00
Kruglov Pavel
ac5d6caef5
Add tsv_null_representation 2020-09-08 15:32:31 +03:00
Nikolai Kochetov
dbd7ef9ee6 Fix build. 2020-09-08 15:31:36 +03:00
Kruglov Pavel
0e9612d9ff
Add null_representation setting in TSV 2020-09-08 15:29:22 +03:00
alesapin
bea15175d6
Merge pull request #14496 from Jokser/disk-s3-shutdown 
Disable S3 requests processing during context shutdown to speed up termination process
 2020-09-08 15:21:54 +03:00
Pavel Kovalenko
5e39f8b32b Add comment explaining DiskS3::shutdown 2020-09-08 15:20:35 +03:00
Ilya Yatsishin
a3d6732662
Merge pull request #14558 from bharatnc/ncb/improve-config-path-processing 
use std::filesystem::path in ConfigProcessor for filepath concatenation
 2020-09-08 14:39:23 +03:00
Nikolai Kochetov
b0cb5511a9 Fix build. 2020-09-08 14:17:39 +03:00
Nikita Mikhaylov
80f193f615
Merge pull request #14252 from bharatnc/ncb/time-query-log-in-ms 
add query_start_time_microseconds field to system.query_log & system.query_thread_log tables
 2020-09-08 15:11:50 +04:00
Nikolai Kochetov
4aeed33d4c Fix build. 2020-09-08 14:07:26 +03:00
Nikolai Kochetov
07e835381c Fix build. 2020-09-08 14:06:36 +03:00
Artem Zuikov
69e82e647e another fix for clang tidy 2020-09-08 14:01:17 +03:00
Nikolai Kochetov
39aad9979a Remove Join from ExpressionActions. 2020-09-08 13:40:53 +03:00
Artem Zuikov
d95614ad60 fix for clang tidy 2020-09-08 12:16:50 +03:00
Ilya Yatsishin
11a247d2f4
Merge pull request #14556 from ClickHouse/fix-arcadia-2 
Lower binary size in "Arcadia" build
 2020-09-08 12:08:35 +03:00
Nikolai Kochetov
c3eeb8f71e
Merge pull request #14412 from ClickHouse/pipes-and-creating-sets 
Pipes and creating sets
 2020-09-08 10:47:56 +03:00
Nikolai Kochetov
d771ce5609
Merge pull request #14500 from ClickHouse/many-rows-in-totals 
Many rows in totals
 2020-09-08 10:40:14 +03:00
alesapin
4364bff3bc
Merge pull request #12761 from kssenii/rabbitmq-improvements 
RabbitMQ improvements
 2020-09-08 09:38:25 +03:00
alesapin
8ff0aedebe Merge branch 'control_ttl_merges_in_pool' into recompression_in_background 2020-09-08 09:34:03 +03:00
alesapin
405a204514 Lower timeout for TTL merges 2020-09-08 09:33:00 +03:00
alesapin
f4846e2ef1
Update src/Storages/MergeTree/ReplicatedMergeTreeQueue.cpp 
Co-authored-by: Anton Popov <pad11rus@gmail.com>
 2020-09-08 09:30:54 +03:00
Winter Zhang
18b4c5997d
Merge branch 'master' into fix/datetime 2020-09-08 11:32:48 +08:00
bharatnc
0c00b992d5 StorageReplicatedMergeTree - cleanup data dir after Zk exceptions 
It's possible for `getZooKeeper()` to timeout if  zookeeper host(s) can't
be reached. In such cases `Poco::Exception` is thrown after a connection
timeout - refer to `src/Common/ZooKeeper/ZooKeeperImpl.cpp:866` for more info.

Side effect of this is that the CreateQuery gets interrupted and it exits.
But the data Directories for the tables being created aren't cleaned up.
This unclean state will hinder table creation on any retries and will
complain that the Directory for table already exists.

To achieve a clean state on failed table creations, catch this error if
the exception is of type Poco::Exception and call `dropIfEmpty()` method,
then proceed throwing the exception. Without this, the Directory for the
tables need to be manually deleted before retrying the CreateQuery.
 2020-09-07 18:09:09 -07:00
Artem Zuikov
7373aaf465 add IsOperation helper 2020-09-08 03:59:13 +03:00
Anton Popov
ee218c354e fix segfault in combinator -Resample 2020-09-08 02:21:12 +03:00
alexey-milovidov
1076a42cf5
Merge pull request #14549 from ClickHouse/lower-binary-size-in-debug 
Lower binary size in debug build
 2020-09-08 01:20:44 +03:00
Alexey Milovidov
e3924b8057 Fix "Arcadia" 2020-09-08 01:14:13 +03:00
bharatnc
7b89adb10d use std::filesystem::path in ConfigProcessor 
This PR improves the way the ClickHouse config path,
preprocessed_configs path etc are being joined inside
`ConfigProcessor.cpp`.

Uses `std::filesystem::path` to join the paths instead of
standard string concatenation. This would improve path concatenation.
Current method of concatenation results in:

```bash
➜  clickhouse-server ls -latr
total 68
-rw-r--r--   1 root root  5587 Aug 31 05:00 users.xml
drwxr-xr-x 143 root root 12288 Sep  7 11:23 ..
lrwxrwxrwx   1 root root    41 Sep  7 11:23 preprocessed -> /var/lib/clickhouse//preprocessed_configs
drwxr-xr-x   2 root root  4096 Sep  7 11:23 users.d
-rw-r--r--   1 root root 34252 Sep  7 11:28 config.xml
drwxr-xr-x   4 root root  4096 Sep  7 11:28 .
drwxr-xr-x   2 root root  4096 Sep  7 11:28 config.d
```

The symlink `/var/lib/clickhouse//preprocessed_configs` will still work.
amd this PR is an improvement to the current method of path
concatenation.
 2020-09-07 12:45:52 -07:00
alexey-milovidov
4bd5524da9
Merge pull request #14522 from ClickHouse/formats-dont-skip-bom-in-constructor 
More consistent invocation of skipBOMIfExists
 2020-09-07 21:38:03 +03:00
zhang2014
564dfac737 ISSUES-4006 fix decimal type decimal number part 2020-09-08 02:36:07 +08:00
Artem Zuikov
b3eafc1106 hide symbols in nameless namespace 2020-09-07 21:00:37 +03:00
Nikita Mikhaylov
a56d42de67 fix arcadia 2020-09-07 20:55:06 +03:00